2023-12-08T20:04:01.061 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-08T20:04:01.061 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --verbose --name yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484168 --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484168/orig.config.yaml 2023-12-08T20:04:01.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T20:04:01.212 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484168 branch: main description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: yweinste@redhat.com first_in_suite: false job_id: '7484168' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 3721 sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 targets: smithi043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPrwPV6DYglaqh1SdLWVkFsLXrG//LCHieKepShKZJRUV6I6jHociio4y/9mNE+ygF54LXTeFuuuunJZYy8hyf4= smithi111.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB6xfdZQU+57M8fY+TkjLceDtOSkAcJrrKN9zpb9MCs6gs+/7LQURdiyWZvBCM6jZwff8OUFjzJ3u+Hh1Mj1ckg= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-08_19:31:32 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2023-12-08T20:04:01.212 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa; will attempt to use it 2023-12-08T20:04:01.213 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks 2023-12-08T20:04:01.213 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-08T20:04:01.215 INFO:teuthology.task.internal:Checking packages... 2023-12-08T20:04:01.243 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '9dcc13bb80dcc1cdea72b04d80505b4649a2b882' 2023-12-08T20:04:01.243 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-08T20:04:01.244 INFO:teuthology.packaging:ref: None 2023-12-08T20:04:01.244 INFO:teuthology.packaging:tag: None 2023-12-08T20:04:01.244 INFO:teuthology.packaging:branch: main 2023-12-08T20:04:01.244 INFO:teuthology.packaging:sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:04:01.244 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=main 2023-12-08T20:04:01.481 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-44.g9dcc13bb 2023-12-08T20:04:01.481 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-08T20:04:01.488 INFO:teuthology.task.internal:no buildpackages task found 2023-12-08T20:04:01.488 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-08T20:04:01.568 INFO:teuthology.task.internal:Saving configuration 2023-12-08T20:04:01.588 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-08T20:04:01.594 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-08T20:04:01.618 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484168', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 19:58:28.274975', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPrwPV6DYglaqh1SdLWVkFsLXrG//LCHieKepShKZJRUV6I6jHociio4y/9mNE+ygF54LXTeFuuuunJZYy8hyf4='} 2023-12-08T20:04:01.638 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484168', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 19:58:28.276149', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB6xfdZQU+57M8fY+TkjLceDtOSkAcJrrKN9zpb9MCs6gs+/7LQURdiyWZvBCM6jZwff8OUFjzJ3u+Hh1Mj1ckg='} 2023-12-08T20:04:01.638 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-08T20:04:01.643 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2023-12-08T20:04:01.644 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2023-12-08T20:04:01.644 INFO:teuthology.run_tasks:Running task console_log... 2023-12-08T20:04:01.711 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc31d7a63a0>, signals=[15]) 2023-12-08T20:04:01.712 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-08T20:04:01.718 INFO:teuthology.task.internal:Opening connections... 2023-12-08T20:04:01.718 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi043.front.sepia.ceph.com 2023-12-08T20:04:01.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:04:01.790 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi111.front.sepia.ceph.com 2023-12-08T20:04:01.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:04:01.859 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-08T20:04:01.867 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2023-12-08T20:04:01.891 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2023-12-08T20:04:01.891 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2023-12-08T20:04:01.953 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2023-12-08T20:04:01.953 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8" 2023-12-08T20:04:01.953 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2023-12-08T20:04:01.953 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2023-12-08T20:04:01.953 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8" 2023-12-08T20:04:01.953 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8" 2023-12-08T20:04:01.953 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-08T20:04:01.953 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2023-12-08T20:04:01.953 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-08T20:04:01.953 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2023-12-08T20:04:01.953 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-08T20:04:01.953 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-08T20:04:01.954 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-08T20:04:01.954 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-12-08T20:04:01.978 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2023-12-08T20:04:02.000 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2023-12-08T20:04:02.000 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-12-08T20:04:02.061 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2023-12-08T20:04:02.061 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8" 2023-12-08T20:04:02.061 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2023-12-08T20:04:02.061 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2023-12-08T20:04:02.061 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8" 2023-12-08T20:04:02.061 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8" 2023-12-08T20:04:02.061 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-08T20:04:02.061 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2023-12-08T20:04:02.062 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-08T20:04:02.062 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2023-12-08T20:04:02.062 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-08T20:04:02.062 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-08T20:04:02.062 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-08T20:04:02.062 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-12-08T20:04:02.128 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-08T20:04:02.137 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-08T20:04:02.144 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-08T20:04:02.144 DEBUG:teuthology.orchestra.run.smithi043:> test '!' -e /home/ubuntu/cephtest 2023-12-08T20:04:02.147 DEBUG:teuthology.orchestra.run.smithi111:> test '!' -e /home/ubuntu/cephtest 2023-12-08T20:04:02.167 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-08T20:04:02.173 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-08T20:04:02.173 DEBUG:teuthology.orchestra.run.smithi043:> test -z $(ls -A /var/lib/ceph) 2023-12-08T20:04:02.209 DEBUG:teuthology.orchestra.run.smithi111:> test -z $(ls -A /var/lib/ceph) 2023-12-08T20:04:02.238 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-08T20:04:02.289 INFO:teuthology.run_tasks:Running task kernel... 2023-12-08T20:04:02.310 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-08T20:04:02.310 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-08T20:04:02.310 DEBUG:teuthology.orchestra.run.smithi043:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-08T20:04:02.311 DEBUG:teuthology.orchestra.run.smithi111:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-08T20:04:02.331 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:04:02.332 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2023-12-08T20:04:02.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:04:02.333 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2023-12-08T20:04:02.393 INFO:teuthology.orchestra.run.smithi111.stdout:4.18.0-489.el8.x86_64 2023-12-08T20:04:02.393 INFO:teuthology.task.kernel:Running kernel on smithi111: 4.18.0-489.el8.x86_64 2023-12-08T20:04:02.393 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum install -y kernel 2023-12-08T20:04:02.394 INFO:teuthology.orchestra.run.smithi043.stdout:4.18.0-489.el8.x86_64 2023-12-08T20:04:02.395 INFO:teuthology.task.kernel:Running kernel on smithi043: 4.18.0-489.el8.x86_64 2023-12-08T20:04:02.395 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum install -y kernel 2023-12-08T20:04:06.468 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 8 - AppStream 23 MB/s | 34 MB 00:01 2023-12-08T20:04:06.542 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - AppStream 22 MB/s | 34 MB 00:01 2023-12-08T20:04:15.260 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 8 - BaseOS 26 MB/s | 55 MB 00:02 2023-12-08T20:04:15.444 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - BaseOS 21 MB/s | 55 MB 00:02 2023-12-08T20:04:23.619 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - Extras 51 kB/s | 18 kB 00:00 2023-12-08T20:04:23.884 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 8 - Extras 53 kB/s | 18 kB 00:00 2023-12-08T20:04:24.327 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 6.9 kB 00:00 2023-12-08T20:04:24.618 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 6.9 kB 00:00 2023-12-08T20:04:24.729 INFO:teuthology.orchestra.run.smithi111.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-12-08T20:04:24.937 INFO:teuthology.orchestra.run.smithi043.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-12-08T20:04:25.730 INFO:teuthology.orchestra.run.smithi111.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2023-12-08T20:04:26.139 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-12-08T20:04:29.580 INFO:teuthology.orchestra.run.smithi111.stdout:lab-extras 454 kB/s | 24 kB 00:00 2023-12-08T20:04:30.187 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 590 kB/s | 24 kB 00:00 2023-12-08T20:04:33.246 INFO:teuthology.orchestra.run.smithi111.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-12-08T20:04:33.246 INFO:teuthology.orchestra.run.smithi111.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-12-08T20:04:33.540 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:04:33.541 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:04:33.541 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2023-12-08T20:04:33.541 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:04:33.541 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-12-08T20:04:33.541 INFO:teuthology.orchestra.run.smithi111.stdout: kernel x86_64 4.18.0-526.el8 baseos 10 M 2023-12-08T20:04:33.541 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2023-12-08T20:04:33.541 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-core x86_64 4.18.0-526.el8 baseos 43 M 2023-12-08T20:04:33.542 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-modules x86_64 4.18.0-526.el8 baseos 36 M 2023-12-08T20:04:33.542 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:04:33.542 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-12-08T20:04:33.542 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:04:33.542 INFO:teuthology.orchestra.run.smithi111.stdout:Install 3 Packages 2023-12-08T20:04:33.542 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:04:33.543 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 90 M 2023-12-08T20:04:33.543 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 96 M 2023-12-08T20:04:33.543 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-12-08T20:04:33.620 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] kernel-4.18.0-526.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/kernel-4.18.0-526.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:04:33.621 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] kernel-core-4.18.0-526.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/kernel-core-4.18.0-526.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:04:33.621 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] kernel-modules-4.18.0-526.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/kernel-modules-4.18.0-526.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:04:34.037 INFO:teuthology.orchestra.run.smithi043.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-12-08T20:04:34.037 INFO:teuthology.orchestra.run.smithi043.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-12-08T20:04:34.352 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:04:34.353 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:04:34.353 INFO:teuthology.orchestra.run.smithi043.stdout: Package Architecture Version Repository Size 2023-12-08T20:04:34.353 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:04:34.353 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2023-12-08T20:04:34.353 INFO:teuthology.orchestra.run.smithi043.stdout: kernel x86_64 4.18.0-526.el8 baseos 10 M 2023-12-08T20:04:34.353 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2023-12-08T20:04:34.353 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-core x86_64 4.18.0-526.el8 baseos 43 M 2023-12-08T20:04:34.354 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules x86_64 4.18.0-526.el8 baseos 36 M 2023-12-08T20:04:34.354 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:04:34.354 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-12-08T20:04:34.354 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:04:34.354 INFO:teuthology.orchestra.run.smithi043.stdout:Install 3 Packages 2023-12-08T20:04:34.354 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:04:34.354 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 90 M 2023-12-08T20:04:34.355 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 96 M 2023-12-08T20:04:34.355 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-12-08T20:04:34.465 INFO:teuthology.orchestra.run.smithi111.stdout:(1/3): kernel-4.18.0-526.el8.x86_64.rpm 11 MB/s | 10 MB 00:00 2023-12-08T20:04:34.577 INFO:teuthology.orchestra.run.smithi043.stdout:[MIRROR] kernel-4.18.0-526.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/kernel-4.18.0-526.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:04:34.577 INFO:teuthology.orchestra.run.smithi043.stdout:[MIRROR] kernel-core-4.18.0-526.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/kernel-core-4.18.0-526.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:04:34.577 INFO:teuthology.orchestra.run.smithi043.stdout:[MIRROR] kernel-modules-4.18.0-526.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/kernel-modules-4.18.0-526.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:04:35.571 INFO:teuthology.orchestra.run.smithi043.stdout:(1/3): kernel-4.18.0-526.el8.x86_64.rpm 9.8 MB/s | 10 MB 00:01 2023-12-08T20:04:35.857 INFO:teuthology.orchestra.run.smithi111.stdout:(2/3): kernel-modules-4.18.0-526.el8.x86_64.rpm 16 MB/s | 36 MB 00:02 2023-12-08T20:04:36.440 INFO:teuthology.orchestra.run.smithi111.stdout:(3/3): kernel-core-4.18.0-526.el8.x86_64.rpm 15 MB/s | 43 MB 00:02 2023-12-08T20:04:36.440 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:04:36.441 INFO:teuthology.orchestra.run.smithi111.stdout:Total 31 MB/s | 90 MB 00:02 2023-12-08T20:04:36.997 INFO:teuthology.orchestra.run.smithi043.stdout:(2/3): kernel-core-4.18.0-526.el8.x86_64.rpm 18 MB/s | 43 MB 00:02 2023-12-08T20:04:37.122 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-12-08T20:04:37.397 INFO:teuthology.orchestra.run.smithi043.stdout:(3/3): kernel-modules-4.18.0-526.el8.x86_64.rpm 13 MB/s | 36 MB 00:02 2023-12-08T20:04:37.397 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:04:37.397 INFO:teuthology.orchestra.run.smithi043.stdout:Total 29 MB/s | 90 MB 00:03 2023-12-08T20:04:37.527 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-12-08T20:04:37.527 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-12-08T20:04:38.105 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-12-08T20:04:38.563 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-12-08T20:04:38.563 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-12-08T20:04:38.756 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-12-08T20:04:38.780 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-12-08T20:04:39.855 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-12-08T20:04:39.882 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-12-08T20:04:41.537 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-12-08T20:04:42.113 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-08T20:04:42.825 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-12-08T20:04:43.342 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-08T20:04:45.706 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-08T20:04:46.138 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-08T20:04:47.066 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-08T20:04:47.450 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-08T20:04:49.570 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-08T20:04:49.876 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : kernel-4.18.0-526.el8.x86_64 3/3 2023-12-08T20:04:51.120 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-08T20:04:51.400 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-4.18.0-526.el8.x86_64 3/3 2023-12-08T20:05:11.843 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 3/3 2023-12-08T20:05:11.868 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-08T20:05:12.243 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-4.18.0-526.el8.x86_64 3/3 2023-12-08T20:05:12.243 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : kernel-4.18.0-526.el8.x86_64 1/3 2023-12-08T20:05:12.243 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : kernel-core-4.18.0-526.el8.x86_64 2/3 2023-12-08T20:05:13.361 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-08T20:05:13.361 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:05:13.361 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-12-08T20:05:13.361 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-4.18.0-526.el8.x86_64 kernel-core-4.18.0-526.el8.x86_64 2023-12-08T20:05:13.361 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-modules-4.18.0-526.el8.x86_64 2023-12-08T20:05:13.361 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:05:13.361 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:05:13.495 DEBUG:teuthology.orchestra.run.smithi111:> rpm -q kernel | sort -rV | head -n 1 2023-12-08T20:05:13.711 INFO:teuthology.orchestra.run.smithi111.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-08T20:05:13.712 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-08T20:05:13.712 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-526.el8.x86_64 2023-12-08T20:05:13.712 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-08T20:05:13.712 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-08T20:05:13.712 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2023-12-08T20:05:13.712 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi111.front.sepia.ceph.com, path=None, version=distro) 2023-12-08T20:05:13.712 DEBUG:teuthology.orchestra.run.smithi111:> rpm -q kernel | sort -rV | head -n 1 2023-12-08T20:05:13.920 INFO:teuthology.orchestra.run.smithi111.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-08T20:05:13.920 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-08T20:05:13.920 DEBUG:teuthology.orchestra.run.smithi111:> sudo rpm -qi grub2-tools 2023-12-08T20:05:13.953 INFO:teuthology.orchestra.run.smithi111.stdout:Name : grub2-tools 2023-12-08T20:05:13.954 INFO:teuthology.orchestra.run.smithi111.stdout:Epoch : 1 2023-12-08T20:05:13.954 INFO:teuthology.orchestra.run.smithi111.stdout:Version : 2.02 2023-12-08T20:05:13.954 INFO:teuthology.orchestra.run.smithi111.stdout:Release : 129.el8 2023-12-08T20:05:13.954 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: x86_64 2023-12-08T20:05:13.954 INFO:teuthology.orchestra.run.smithi111.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-08T20:05:13.954 INFO:teuthology.orchestra.run.smithi111.stdout:Group : System Environment/Base 2023-12-08T20:05:13.954 INFO:teuthology.orchestra.run.smithi111.stdout:Size : 9265586 2023-12-08T20:05:13.954 INFO:teuthology.orchestra.run.smithi111.stdout:License : GPLv3+ 2023-12-08T20:05:13.954 INFO:teuthology.orchestra.run.smithi111.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-08T20:05:13.954 INFO:teuthology.orchestra.run.smithi111.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-08T20:05:13.954 INFO:teuthology.orchestra.run.smithi111.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-08T20:05:13.955 INFO:teuthology.orchestra.run.smithi111.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-08T20:05:13.955 INFO:teuthology.orchestra.run.smithi111.stdout:Relocations : (not relocatable) 2023-12-08T20:05:13.955 INFO:teuthology.orchestra.run.smithi111.stdout:Packager : CentOS BuildSystem 2023-12-08T20:05:13.955 INFO:teuthology.orchestra.run.smithi111.stdout:Vendor : CentOS 2023-12-08T20:05:13.955 INFO:teuthology.orchestra.run.smithi111.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-08T20:05:13.955 INFO:teuthology.orchestra.run.smithi111.stdout:Summary : Support tools for GRUB. 2023-12-08T20:05:13.955 INFO:teuthology.orchestra.run.smithi111.stdout:Description : 2023-12-08T20:05:13.955 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:05:13.955 INFO:teuthology.orchestra.run.smithi111.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-08T20:05:13.955 INFO:teuthology.orchestra.run.smithi111.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-08T20:05:13.955 INFO:teuthology.orchestra.run.smithi111.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-08T20:05:13.955 INFO:teuthology.orchestra.run.smithi111.stdout:hardware devices. 2023-12-08T20:05:13.955 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:05:13.956 INFO:teuthology.orchestra.run.smithi111.stdout:This subpackage provides tools for support of all platforms. 2023-12-08T20:05:13.956 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-08T20:05:13.956 INFO:teuthology.task.kernel:Updating grub on smithi111 to boot 4.18.0-526.el8.x86_64 2023-12-08T20:05:13.957 DEBUG:teuthology.orchestra.run.smithi111:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-08T20:05:14.809 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 3/3 2023-12-08T20:05:14.833 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-08T20:05:15.199 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-4.18.0-526.el8.x86_64 3/3 2023-12-08T20:05:15.199 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-4.18.0-526.el8.x86_64 1/3 2023-12-08T20:05:15.199 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-core-4.18.0-526.el8.x86_64 2/3 2023-12-08T20:05:15.351 INFO:teuthology.orchestra.run.smithi111.stderr:Generating grub configuration file ... 2023-12-08T20:05:16.749 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-08T20:05:16.749 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:05:16.749 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-12-08T20:05:16.749 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-4.18.0-526.el8.x86_64 kernel-core-4.18.0-526.el8.x86_64 2023-12-08T20:05:16.749 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules-4.18.0-526.el8.x86_64 2023-12-08T20:05:16.750 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:05:16.750 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:05:16.890 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q kernel | sort -rV | head -n 1 2023-12-08T20:05:17.113 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-08T20:05:17.113 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-08T20:05:17.113 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-526.el8.x86_64 2023-12-08T20:05:17.113 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-08T20:05:17.113 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-08T20:05:17.113 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2023-12-08T20:05:17.113 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi043.front.sepia.ceph.com, path=None, version=distro) 2023-12-08T20:05:17.114 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q kernel | sort -rV | head -n 1 2023-12-08T20:05:17.331 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-08T20:05:17.331 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-08T20:05:17.331 DEBUG:teuthology.orchestra.run.smithi043:> sudo rpm -qi grub2-tools 2023-12-08T20:05:17.366 INFO:teuthology.orchestra.run.smithi043.stdout:Name : grub2-tools 2023-12-08T20:05:17.366 INFO:teuthology.orchestra.run.smithi043.stdout:Epoch : 1 2023-12-08T20:05:17.366 INFO:teuthology.orchestra.run.smithi043.stdout:Version : 2.02 2023-12-08T20:05:17.366 INFO:teuthology.orchestra.run.smithi043.stdout:Release : 129.el8 2023-12-08T20:05:17.366 INFO:teuthology.orchestra.run.smithi043.stdout:Architecture: x86_64 2023-12-08T20:05:17.366 INFO:teuthology.orchestra.run.smithi043.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-08T20:05:17.367 INFO:teuthology.orchestra.run.smithi043.stdout:Group : System Environment/Base 2023-12-08T20:05:17.367 INFO:teuthology.orchestra.run.smithi043.stdout:Size : 9265586 2023-12-08T20:05:17.367 INFO:teuthology.orchestra.run.smithi043.stdout:License : GPLv3+ 2023-12-08T20:05:17.367 INFO:teuthology.orchestra.run.smithi043.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-08T20:05:17.367 INFO:teuthology.orchestra.run.smithi043.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-08T20:05:17.367 INFO:teuthology.orchestra.run.smithi043.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-08T20:05:17.367 INFO:teuthology.orchestra.run.smithi043.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-08T20:05:17.367 INFO:teuthology.orchestra.run.smithi043.stdout:Relocations : (not relocatable) 2023-12-08T20:05:17.367 INFO:teuthology.orchestra.run.smithi043.stdout:Packager : CentOS BuildSystem 2023-12-08T20:05:17.367 INFO:teuthology.orchestra.run.smithi043.stdout:Vendor : CentOS 2023-12-08T20:05:17.367 INFO:teuthology.orchestra.run.smithi043.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-08T20:05:17.367 INFO:teuthology.orchestra.run.smithi043.stdout:Summary : Support tools for GRUB. 2023-12-08T20:05:17.367 INFO:teuthology.orchestra.run.smithi043.stdout:Description : 2023-12-08T20:05:17.367 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:05:17.367 INFO:teuthology.orchestra.run.smithi043.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-08T20:05:17.368 INFO:teuthology.orchestra.run.smithi043.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-08T20:05:17.368 INFO:teuthology.orchestra.run.smithi043.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-08T20:05:17.368 INFO:teuthology.orchestra.run.smithi043.stdout:hardware devices. 2023-12-08T20:05:17.368 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:05:17.368 INFO:teuthology.orchestra.run.smithi043.stdout:This subpackage provides tools for support of all platforms. 2023-12-08T20:05:17.369 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-08T20:05:17.369 INFO:teuthology.task.kernel:Updating grub on smithi043 to boot 4.18.0-526.el8.x86_64 2023-12-08T20:05:17.369 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-08T20:05:18.063 INFO:teuthology.orchestra.run.smithi111.stderr:done 2023-12-08T20:05:18.064 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2023-12-08T20:05:18.094 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.JbsfwU5slo 2023-12-08T20:05:18.095 DEBUG:teuthology.orchestra.run.smithi111:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JbsfwU5slo 2023-12-08T20:05:18.168 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.JbsfwU5slo 2023-12-08T20:05:18.309 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.JbsfwU5slo is 6KB 2023-12-08T20:05:18.360 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.JbsfwU5slo 2023-12-08T20:05:18.378 DEBUG:teuthology.orchestra.run.smithi111:> sudo /bin/ls /boot/loader/entries || true 2023-12-08T20:05:18.448 INFO:teuthology.orchestra.run.smithi111.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-08T20:05:18.448 INFO:teuthology.orchestra.run.smithi111.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-08T20:05:18.448 INFO:teuthology.orchestra.run.smithi111.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-08T20:05:18.448 INFO:teuthology.orchestra.run.smithi111.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64.conf 2023-12-08T20:05:18.450 DEBUG:teuthology.orchestra.run.smithi111:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64 2023-12-08T20:05:18.556 INFO:teuthology.orchestra.run.smithi043.stderr:Generating grub configuration file ... 2023-12-08T20:05:18.611 DEBUG:teuthology.orchestra.run.smithi111:> sudo shutdown -r now 2023-12-08T20:05:20.641 INFO:teuthology.orchestra.run.smithi043.stderr:done 2023-12-08T20:05:20.643 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2023-12-08T20:05:20.672 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.X7QqNCwQTP 2023-12-08T20:05:20.672 DEBUG:teuthology.orchestra.run.smithi043:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.X7QqNCwQTP 2023-12-08T20:05:20.744 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.X7QqNCwQTP 2023-12-08T20:05:20.886 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.X7QqNCwQTP is 6KB 2023-12-08T20:05:20.937 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.X7QqNCwQTP 2023-12-08T20:05:20.959 DEBUG:teuthology.orchestra.run.smithi043:> sudo /bin/ls /boot/loader/entries || true 2023-12-08T20:05:21.026 INFO:teuthology.orchestra.run.smithi043.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-08T20:05:21.026 INFO:teuthology.orchestra.run.smithi043.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-08T20:05:21.026 INFO:teuthology.orchestra.run.smithi043.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-08T20:05:21.026 INFO:teuthology.orchestra.run.smithi043.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64.conf 2023-12-08T20:05:21.027 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64 2023-12-08T20:05:21.193 DEBUG:teuthology.orchestra.run.smithi043:> sudo shutdown -r now 2023-12-08T20:05:48.638 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2023-12-08T20:05:48.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-12-08T20:05:48.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:05:51.198 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2023-12-08T20:05:51.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-12-08T20:05:51.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:06:23.330 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-12-08T20:06:32.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-12-08T20:06:32.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:06:35.398 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-12-08T20:06:47.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-12-08T20:06:47.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:06:51.202 DEBUG:teuthology.orchestra.remote:timed out 2023-12-08T20:07:00.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-12-08T20:07:00.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:07:00.480 DEBUG:teuthology.orchestra.run.smithi043:> true 2023-12-08T20:07:00.766 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-12-08T20:07:00.766 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-526.el8.x86_64"... 2023-12-08T20:07:00.766 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2023-12-08T20:07:00.786 INFO:teuthology.orchestra.run.smithi043.stdout:4.18.0-526.el8.x86_64 2023-12-08T20:07:00.787 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-526.el8.x86_64 vs 4.18.0-526.el8.x86_64 2023-12-08T20:07:00.787 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-08T20:07:00.787 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-08T20:07:01.789 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2023-12-08T20:07:01.789 DEBUG:teuthology.orchestra.run.smithi043:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-08T20:07:01.907 INFO:teuthology.orchestra.run.smithi043.stdout:ttyS1 2023-12-08T20:07:01.926 DEBUG:teuthology.parallel:result is None 2023-12-08T20:07:19.670 DEBUG:teuthology.orchestra.run.smithi111:> true 2023-12-08T20:07:20.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-12-08T20:07:20.359 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-526.el8.x86_64"... 2023-12-08T20:07:20.359 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2023-12-08T20:07:20.414 INFO:teuthology.orchestra.run.smithi111.stdout:4.18.0-526.el8.x86_64 2023-12-08T20:07:20.414 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-526.el8.x86_64 vs 4.18.0-526.el8.x86_64 2023-12-08T20:07:20.415 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-08T20:07:20.415 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-08T20:07:21.417 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2023-12-08T20:07:21.418 DEBUG:teuthology.orchestra.run.smithi111:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-08T20:07:21.477 INFO:teuthology.orchestra.run.smithi111.stdout:ttyS1 2023-12-08T20:07:21.496 DEBUG:teuthology.parallel:result is None 2023-12-08T20:07:21.496 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-08T20:07:21.503 INFO:teuthology.task.internal:Creating test directory... 2023-12-08T20:07:21.503 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-08T20:07:21.507 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-08T20:07:21.530 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-08T20:07:21.536 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-08T20:07:21.545 INFO:teuthology.task.internal:Creating archive directory... 2023-12-08T20:07:21.545 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-08T20:07:21.573 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-08T20:07:21.611 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-08T20:07:21.623 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-08T20:07:21.623 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-08T20:07:21.648 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-08T20:07:21.687 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T20:07:21.695 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T20:07:21.697 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T20:07:21.707 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T20:07:21.709 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-08T20:07:21.719 INFO:teuthology.task.internal:Configuring sudo... 2023-12-08T20:07:21.719 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-08T20:07:21.722 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-08T20:07:21.767 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-08T20:07:21.776 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-08T20:07:21.776 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-08T20:07:21.796 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-08T20:07:21.825 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-08T20:07:21.910 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-08T20:07:21.971 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-08T20:07:22.022 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-08T20:07:22.075 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-12-08T20:07:22.075 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-08T20:07:22.150 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-08T20:07:22.194 DEBUG:teuthology.orchestra.run.smithi111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-08T20:07:22.243 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-08T20:07:22.328 DEBUG:teuthology.orchestra.run.smithi111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-08T20:07:22.372 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-12-08T20:07:22.372 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-08T20:07:22.439 DEBUG:teuthology.orchestra.run.smithi043:> sudo service rsyslog restart 2023-12-08T20:07:22.441 DEBUG:teuthology.orchestra.run.smithi111:> sudo service rsyslog restart 2023-12-08T20:07:22.518 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-08T20:07:22.532 INFO:teuthology.orchestra.run.smithi111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-08T20:07:22.978 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-08T20:07:22.987 INFO:teuthology.task.internal:Starting timer... 2023-12-08T20:07:22.987 INFO:teuthology.run_tasks:Running task pcp... 2023-12-08T20:07:22.997 INFO:teuthology.run_tasks:Running task selinux... 2023-12-08T20:07:23.007 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-08T20:07:23.007 DEBUG:teuthology.orchestra.run.smithi043:> sudo service auditd rotate 2023-12-08T20:07:23.096 INFO:teuthology.orchestra.run.smithi043.stdout:Rotating logs: 2023-12-08T20:07:23.098 DEBUG:teuthology.orchestra.run.smithi111:> sudo service auditd rotate 2023-12-08T20:07:23.185 INFO:teuthology.orchestra.run.smithi111.stdout:Rotating logs: 2023-12-08T20:07:23.186 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-08T20:07:23.187 DEBUG:teuthology.orchestra.run.smithi043:> /usr/sbin/getenforce 2023-12-08T20:07:23.245 INFO:teuthology.orchestra.run.smithi043.stdout:Permissive 2023-12-08T20:07:23.246 DEBUG:teuthology.orchestra.run.smithi111:> /usr/sbin/getenforce 2023-12-08T20:07:23.273 INFO:teuthology.orchestra.run.smithi111.stdout:Permissive 2023-12-08T20:07:23.273 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi043.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi111.front.sepia.ceph.com': 'permissive'} 2023-12-08T20:07:23.273 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-08T20:07:23.309 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:07:23.310 DEBUG:teuthology.orchestra.run.smithi111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-08T20:07:23.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:07:23.339 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-08T20:07:23.340 DEBUG:teuthology.orchestra.run.smithi043:> sudo /usr/sbin/setenforce permissive 2023-12-08T20:07:23.385 DEBUG:teuthology.orchestra.run.smithi111:> sudo /usr/sbin/setenforce permissive 2023-12-08T20:07:23.411 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-08T20:07:23.421 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-08T20:07:23.421 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-08T20:07:23.445 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-08T20:07:23.446 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi043.front.sepia.ceph.com,smithi111.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-08T20:15:47.426 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi043.front.sepia.ceph.com'), Remote(name='ubuntu@smithi111.front.sepia.ceph.com')] 2023-12-08T20:15:47.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-12-08T20:15:47.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:15:47.522 DEBUG:teuthology.orchestra.run.smithi043:> true 2023-12-08T20:15:47.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-12-08T20:15:47.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-12-08T20:15:47.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T20:15:47.668 DEBUG:teuthology.orchestra.run.smithi111:> true 2023-12-08T20:15:47.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-12-08T20:15:47.738 INFO:teuthology.run_tasks:Running task clock... 2023-12-08T20:15:47.751 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-08T20:15:47.751 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-08T20:15:47.751 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T20:15:47.754 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-08T20:15:47.754 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T20:15:47.790 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-08T20:15:47.807 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-08T20:15:47.811 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-08T20:15:47.824 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-08T20:15:47.875 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: ntpd: command not found 2023-12-08T20:15:47.889 INFO:teuthology.orchestra.run.smithi043.stdout:506 Cannot talk to daemon 2023-12-08T20:15:47.895 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: ntpd: command not found 2023-12-08T20:15:47.905 INFO:teuthology.orchestra.run.smithi111.stdout:506 Cannot talk to daemon 2023-12-08T20:15:47.906 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-08T20:15:47.918 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-08T20:15:47.921 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-08T20:15:47.931 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-08T20:15:47.986 INFO:teuthology.orchestra.run.smithi043.stderr:bash: ntpq: command not found 2023-12-08T20:15:47.991 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-08T20:15:47.991 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2023-12-08T20:15:47.991 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T20:15:47.991 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T20:15:47.991 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T20:15:47.991 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T20:15:47.997 INFO:teuthology.orchestra.run.smithi111.stderr:bash: ntpq: command not found 2023-12-08T20:15:48.000 INFO:teuthology.orchestra.run.smithi111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-08T20:15:48.000 INFO:teuthology.orchestra.run.smithi111.stdout:=============================================================================== 2023-12-08T20:15:48.000 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T20:15:48.000 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T20:15:48.000 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T20:15:48.000 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T20:15:48.001 INFO:teuthology.run_tasks:Running task pexec... 2023-12-08T20:15:48.010 INFO:teuthology.task.pexec:Executing custom commands... 2023-12-08T20:15:48.010 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi043.front.sepia.ceph.com 2023-12-08T20:15:48.011 DEBUG:teuthology.orchestra.run.smithi043:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-08T20:15:48.011 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi111.front.sepia.ceph.com 2023-12-08T20:15:48.011 DEBUG:teuthology.orchestra.run.smithi111:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-08T20:15:48.918 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:02:26 ago on Fri 08 Dec 2023 08:13:22 PM UTC. 2023-12-08T20:15:49.048 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:43 ago on Fri 08 Dec 2023 08:14:05 PM UTC. 2023-12-08T20:15:51.083 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:15:51.083 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:15:51.084 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2023-12-08T20:15:51.084 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:15:51.084 INFO:teuthology.orchestra.run.smithi111.stdout:Resetting modules: 2023-12-08T20:15:51.084 INFO:teuthology.orchestra.run.smithi111.stdout: container-tools 2023-12-08T20:15:51.084 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:15:51.084 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-12-08T20:15:51.084 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:15:51.084 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:15:51.354 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:15:51.510 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:15:51.511 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:15:51.511 INFO:teuthology.orchestra.run.smithi043.stdout: Package Architecture Version Repository Size 2023-12-08T20:15:51.512 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:15:51.512 INFO:teuthology.orchestra.run.smithi043.stdout:Resetting modules: 2023-12-08T20:15:51.512 INFO:teuthology.orchestra.run.smithi043.stdout: container-tools 2023-12-08T20:15:51.512 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:15:51.512 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-12-08T20:15:51.512 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:15:51.512 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:15:51.825 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:15:52.285 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:02:30 ago on Fri 08 Dec 2023 08:13:22 PM UTC. 2023-12-08T20:15:52.916 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:47 ago on Fri 08 Dec 2023 08:14:05 PM UTC. 2023-12-08T20:15:54.314 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:15:54.499 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:15:54.499 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-12-08T20:15:54.499 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:15:54.499 INFO:teuthology.orchestra.run.smithi111.stdout:Installing group/module packages: 2023-12-08T20:15:54.499 INFO:teuthology.orchestra.run.smithi111.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-08T20:15:54.499 INFO:teuthology.orchestra.run.smithi111.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-08T20:15:54.499 INFO:teuthology.orchestra.run.smithi111.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-08T20:15:54.499 INFO:teuthology.orchestra.run.smithi111.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-08T20:15:54.499 INFO:teuthology.orchestra.run.smithi111.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-08T20:15:54.499 INFO:teuthology.orchestra.run.smithi111.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-08T20:15:54.499 INFO:teuthology.orchestra.run.smithi111.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-08T20:15:54.499 INFO:teuthology.orchestra.run.smithi111.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-08T20:15:54.499 INFO:teuthology.orchestra.run.smithi111.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-08T20:15:54.499 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2023-12-08T20:15:54.500 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-08T20:15:54.500 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-08T20:15:54.500 INFO:teuthology.orchestra.run.smithi111.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-08T20:15:54.500 INFO:teuthology.orchestra.run.smithi111.stdout:Installing weak dependencies: 2023-12-08T20:15:54.500 INFO:teuthology.orchestra.run.smithi111.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-08T20:15:54.500 INFO:teuthology.orchestra.run.smithi111.stdout:Installing module profiles: 2023-12-08T20:15:54.500 INFO:teuthology.orchestra.run.smithi111.stdout: container-tools/common 2023-12-08T20:15:54.500 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:15:54.500 INFO:teuthology.orchestra.run.smithi111.stdout:Enabling module streams: 2023-12-08T20:15:54.500 INFO:teuthology.orchestra.run.smithi111.stdout: container-tools rhel8 2023-12-08T20:15:54.500 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:15:54.500 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-12-08T20:15:54.500 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:15:54.501 INFO:teuthology.orchestra.run.smithi111.stdout:Install 13 Packages 2023-12-08T20:15:54.501 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:15:54.501 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 27 M 2023-12-08T20:15:54.501 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 89 M 2023-12-08T20:15:54.501 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-12-08T20:15:54.808 INFO:teuthology.orchestra.run.smithi111.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 6.4 MB/s | 750 kB 00:00 2023-12-08T20:15:54.843 INFO:teuthology.orchestra.run.smithi111.stdout:(2/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 6.8 MB/s | 1.0 MB 00:00 2023-12-08T20:15:54.859 INFO:teuthology.orchestra.run.smithi111.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 748 kB/s | 38 kB 00:00 2023-12-08T20:15:54.885 INFO:teuthology.orchestra.run.smithi111.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 5.6 MB/s | 241 kB 00:00 2023-12-08T20:15:54.927 INFO:teuthology.orchestra.run.smithi111.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 4.2 MB/s | 178 kB 00:00 2023-12-08T20:15:54.960 INFO:teuthology.orchestra.run.smithi111.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 743 kB/s | 25 kB 00:00 2023-12-08T20:15:54.994 INFO:teuthology.orchestra.run.smithi111.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 2.7 MB/s | 94 kB 00:00 2023-12-08T20:15:55.119 INFO:teuthology.orchestra.run.smithi111.stdout:(8/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 15 MB/s | 3.9 MB 00:00 2023-12-08T20:15:55.277 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:15:55.303 INFO:teuthology.orchestra.run.smithi111.stdout:(9/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 16 MB/s | 9.6 MB 00:00 2023-12-08T20:15:55.353 INFO:teuthology.orchestra.run.smithi111.stdout:(10/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 11 MB/s | 2.5 MB 00:00 2023-12-08T20:15:55.378 INFO:teuthology.orchestra.run.smithi111.stdout:(11/13): udica-0.2.6-20.module_el8+712+4cd1bd69 701 kB/s | 53 kB 00:00 2023-12-08T20:15:55.404 INFO:teuthology.orchestra.run.smithi111.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 817 kB/s | 41 kB 00:00 2023-12-08T20:15:55.481 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:15:55.482 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2023-12-08T20:15:55.482 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:15:55.482 INFO:teuthology.orchestra.run.smithi043.stdout:Installing group/module packages: 2023-12-08T20:15:55.482 INFO:teuthology.orchestra.run.smithi043.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-08T20:15:55.482 INFO:teuthology.orchestra.run.smithi043.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-08T20:15:55.482 INFO:teuthology.orchestra.run.smithi043.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-08T20:15:55.482 INFO:teuthology.orchestra.run.smithi043.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-08T20:15:55.482 INFO:teuthology.orchestra.run.smithi043.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-08T20:15:55.482 INFO:teuthology.orchestra.run.smithi043.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-08T20:15:55.482 INFO:teuthology.orchestra.run.smithi043.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-08T20:15:55.482 INFO:teuthology.orchestra.run.smithi043.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-08T20:15:55.482 INFO:teuthology.orchestra.run.smithi043.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-08T20:15:55.482 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2023-12-08T20:15:55.482 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-08T20:15:55.483 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-08T20:15:55.483 INFO:teuthology.orchestra.run.smithi043.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-08T20:15:55.483 INFO:teuthology.orchestra.run.smithi043.stdout:Installing weak dependencies: 2023-12-08T20:15:55.483 INFO:teuthology.orchestra.run.smithi043.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-08T20:15:55.483 INFO:teuthology.orchestra.run.smithi043.stdout:Installing module profiles: 2023-12-08T20:15:55.483 INFO:teuthology.orchestra.run.smithi043.stdout: container-tools/common 2023-12-08T20:15:55.483 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:15:55.483 INFO:teuthology.orchestra.run.smithi043.stdout:Enabling module streams: 2023-12-08T20:15:55.483 INFO:teuthology.orchestra.run.smithi043.stdout: container-tools rhel8 2023-12-08T20:15:55.483 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:15:55.483 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-12-08T20:15:55.483 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:15:55.483 INFO:teuthology.orchestra.run.smithi043.stdout:Install 13 Packages 2023-12-08T20:15:55.483 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:15:55.484 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 27 M 2023-12-08T20:15:55.484 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 89 M 2023-12-08T20:15:55.484 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-12-08T20:15:55.529 INFO:teuthology.orchestra.run.smithi111.stdout:(13/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 15 MB/s | 8.1 MB 00:00 2023-12-08T20:15:55.529 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:15:55.530 INFO:teuthology.orchestra.run.smithi111.stdout:Total 26 MB/s | 27 MB 00:01 2023-12-08T20:15:55.795 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-12-08T20:15:55.800 INFO:teuthology.orchestra.run.smithi043.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 5.7 MB/s | 750 kB 00:00 2023-12-08T20:15:55.816 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-12-08T20:15:55.816 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-12-08T20:15:55.834 INFO:teuthology.orchestra.run.smithi043.stdout:(2/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 6.2 MB/s | 1.0 MB 00:00 2023-12-08T20:15:55.859 INFO:teuthology.orchestra.run.smithi043.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 648 kB/s | 38 kB 00:00 2023-12-08T20:15:55.884 INFO:teuthology.orchestra.run.smithi043.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 4.7 MB/s | 241 kB 00:00 2023-12-08T20:15:55.926 INFO:teuthology.orchestra.run.smithi043.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 4.2 MB/s | 178 kB 00:00 2023-12-08T20:15:55.985 INFO:teuthology.orchestra.run.smithi043.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 422 kB/s | 25 kB 00:00 2023-12-08T20:15:56.019 INFO:teuthology.orchestra.run.smithi043.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 2.8 MB/s | 94 kB 00:00 2023-12-08T20:15:56.068 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-12-08T20:15:56.072 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-12-08T20:15:56.152 INFO:teuthology.orchestra.run.smithi043.stdout:(8/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 13 MB/s | 3.9 MB 00:00 2023-12-08T20:15:56.294 INFO:teuthology.orchestra.run.smithi043.stdout:(9/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 15 MB/s | 9.6 MB 00:00 2023-12-08T20:15:56.569 INFO:teuthology.orchestra.run.smithi043.stdout:(10/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 6.1 MB/s | 2.5 MB 00:00 2023-12-08T20:15:56.637 INFO:teuthology.orchestra.run.smithi043.stdout:(11/13): udica-0.2.6-20.module_el8+712+4cd1bd69 154 kB/s | 53 kB 00:00 2023-12-08T20:15:56.662 INFO:teuthology.orchestra.run.smithi043.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 442 kB/s | 41 kB 00:00 2023-12-08T20:15:56.741 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-12-08T20:15:56.762 INFO:teuthology.orchestra.run.smithi043.stdout:(13/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 11 MB/s | 8.1 MB 00:00 2023-12-08T20:15:56.762 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:15:56.763 INFO:teuthology.orchestra.run.smithi043.stdout:Total 21 MB/s | 27 MB 00:01 2023-12-08T20:15:56.942 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-08T20:15:57.055 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-12-08T20:15:57.079 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-12-08T20:15:57.079 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-12-08T20:15:57.130 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-08T20:15:57.321 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-08T20:15:57.359 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-12-08T20:15:57.363 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-12-08T20:15:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-08T20:15:58.053 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-12-08T20:15:58.053 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-08T20:15:58.289 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-08T20:15:58.499 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-08T20:15:58.700 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-08T20:15:58.957 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-08T20:15:59.054 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-08T20:15:59.294 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-08T20:15:59.489 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-08T20:15:59.556 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-08T20:15:59.734 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-08T20:16:00.110 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-08T20:16:00.615 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-08T20:16:00.893 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-08T20:16:00.990 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-08T20:16:01.105 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-08T20:16:01.209 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-08T20:16:01.379 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-08T20:16:01.387 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-08T20:16:01.782 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-08T20:16:01.782 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-08T20:16:01.782 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-08T20:16:01.782 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-08T20:16:01.782 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-08T20:16:01.783 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-08T20:16:01.783 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-08T20:16:01.783 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-08T20:16:01.783 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-08T20:16:01.783 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-08T20:16:01.783 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-08T20:16:01.783 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-08T20:16:01.783 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-08T20:16:01.815 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-08T20:16:02.566 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-08T20:16:02.566 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:16:02.566 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-12-08T20:16:02.567 INFO:teuthology.orchestra.run.smithi111.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-08T20:16:02.567 INFO:teuthology.orchestra.run.smithi111.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-08T20:16:02.567 INFO:teuthology.orchestra.run.smithi111.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-08T20:16:02.567 INFO:teuthology.orchestra.run.smithi111.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-08T20:16:02.567 INFO:teuthology.orchestra.run.smithi111.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-08T20:16:02.567 INFO:teuthology.orchestra.run.smithi111.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-08T20:16:02.567 INFO:teuthology.orchestra.run.smithi111.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-08T20:16:02.567 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-08T20:16:02.567 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-08T20:16:02.567 INFO:teuthology.orchestra.run.smithi111.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-08T20:16:02.567 INFO:teuthology.orchestra.run.smithi111.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-08T20:16:02.567 INFO:teuthology.orchestra.run.smithi111.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-08T20:16:02.567 INFO:teuthology.orchestra.run.smithi111.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-08T20:16:02.567 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:16:02.567 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:16:02.838 DEBUG:teuthology.parallel:result is None 2023-12-08T20:16:02.991 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-08T20:16:03.253 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-08T20:16:03.438 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-08T20:16:03.924 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-08T20:16:03.925 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-08T20:16:03.925 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-08T20:16:03.925 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-08T20:16:03.925 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-08T20:16:03.925 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-08T20:16:03.925 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-08T20:16:03.925 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-08T20:16:03.925 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-08T20:16:03.925 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-08T20:16:03.925 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-08T20:16:03.925 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-08T20:16:03.925 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-08T20:16:04.818 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-08T20:16:04.818 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:16:04.818 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-12-08T20:16:04.818 INFO:teuthology.orchestra.run.smithi043.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-08T20:16:04.818 INFO:teuthology.orchestra.run.smithi043.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-08T20:16:04.818 INFO:teuthology.orchestra.run.smithi043.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-08T20:16:04.818 INFO:teuthology.orchestra.run.smithi043.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-08T20:16:04.818 INFO:teuthology.orchestra.run.smithi043.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-08T20:16:04.818 INFO:teuthology.orchestra.run.smithi043.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-08T20:16:04.818 INFO:teuthology.orchestra.run.smithi043.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-08T20:16:04.818 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-08T20:16:04.819 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-08T20:16:04.819 INFO:teuthology.orchestra.run.smithi043.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-08T20:16:04.819 INFO:teuthology.orchestra.run.smithi043.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-08T20:16:04.819 INFO:teuthology.orchestra.run.smithi043.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-08T20:16:04.819 INFO:teuthology.orchestra.run.smithi043.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-08T20:16:04.819 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:16:04.819 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:16:05.138 DEBUG:teuthology.parallel:result is None 2023-12-08T20:16:05.139 INFO:teuthology.run_tasks:Running task install... 2023-12-08T20:16:05.148 DEBUG:teuthology.task.install:project ceph 2023-12-08T20:16:05.148 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9dcc13bb80dcc1cdea72b04d80505b4649a2b882'}} 2023-12-08T20:16:05.148 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '9dcc13bb80dcc1cdea72b04d80505b4649a2b882'} 2023-12-08T20:16:05.148 INFO:teuthology.task.install:Using flavor: default 2023-12-08T20:16:05.154 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-08T20:16:05.154 INFO:teuthology.task.install:extra packages: [] 2023-12-08T20:16:05.154 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9dcc13bb80dcc1cdea72b04d80505b4649a2b882', 'tag': None, 'wait_for_package': False} 2023-12-08T20:16:05.155 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-08T20:16:05.155 INFO:teuthology.packaging:ref: None 2023-12-08T20:16:05.155 INFO:teuthology.packaging:tag: None 2023-12-08T20:16:05.155 INFO:teuthology.packaging:branch: quincy 2023-12-08T20:16:05.155 INFO:teuthology.packaging:sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:16:05.155 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-08T20:16:05.157 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9dcc13bb80dcc1cdea72b04d80505b4649a2b882', 'tag': None, 'wait_for_package': False} 2023-12-08T20:16:05.157 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-08T20:16:05.157 INFO:teuthology.packaging:ref: None 2023-12-08T20:16:05.158 INFO:teuthology.packaging:tag: None 2023-12-08T20:16:05.158 INFO:teuthology.packaging:branch: quincy 2023-12-08T20:16:05.158 INFO:teuthology.packaging:sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:16:05.158 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-08T20:16:05.412 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/e2143d99877e7c4078bd3ef71a36a87e1b0058e4/centos/8/flavors/default/ 2023-12-08T20:16:05.413 INFO:teuthology.task.install.rpm:Package version is 17.2.7-119.ge2143d99 2023-12-08T20:16:05.470 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/e2143d99877e7c4078bd3ef71a36a87e1b0058e4/centos/8/flavors/default/ 2023-12-08T20:16:05.470 INFO:teuthology.task.install.rpm:Package version is 17.2.7-119.ge2143d99 2023-12-08T20:16:05.732 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/e2143d99877e7c4078bd3ef71a36a87e1b0058e4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/e2143d99877e7c4078bd3ef71a36a87e1b0058e4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/e2143d99877e7c4078bd3ef71a36a87e1b0058e4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-08T20:16:05.732 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-12-08T20:16:05.732 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-08T20:16:05.768 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-08T20:16:05.769 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-08T20:16:05.769 INFO:teuthology.packaging:ref: None 2023-12-08T20:16:05.769 INFO:teuthology.packaging:tag: None 2023-12-08T20:16:05.769 INFO:teuthology.packaging:branch: quincy 2023-12-08T20:16:05.769 INFO:teuthology.packaging:sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:16:05.769 DEBUG:teuthology.orchestra.run.smithi043:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-08T20:16:05.832 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/e2143d99877e7c4078bd3ef71a36a87e1b0058e4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/e2143d99877e7c4078bd3ef71a36a87e1b0058e4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/e2143d99877e7c4078bd3ef71a36a87e1b0058e4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-08T20:16:05.832 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-12-08T20:16:05.832 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-08T20:16:05.844 DEBUG:teuthology.orchestra.run.smithi043:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-08T20:16:05.865 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-08T20:16:05.865 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-08T20:16:05.865 INFO:teuthology.packaging:ref: None 2023-12-08T20:16:05.865 INFO:teuthology.packaging:tag: None 2023-12-08T20:16:05.866 INFO:teuthology.packaging:branch: quincy 2023-12-08T20:16:05.866 INFO:teuthology.packaging:sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:16:05.866 DEBUG:teuthology.orchestra.run.smithi111:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-08T20:16:05.932 DEBUG:teuthology.orchestra.run.smithi043:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-08T20:16:05.937 DEBUG:teuthology.orchestra.run.smithi111:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-08T20:16:05.964 INFO:teuthology.orchestra.run.smithi043.stdout:check_obsoletes = 1 2023-12-08T20:16:05.966 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum clean all 2023-12-08T20:16:06.016 DEBUG:teuthology.orchestra.run.smithi111:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-08T20:16:06.085 INFO:teuthology.orchestra.run.smithi111.stdout:check_obsoletes = 1 2023-12-08T20:16:06.086 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum clean all 2023-12-08T20:16:06.280 INFO:teuthology.orchestra.run.smithi043.stdout:76 files removed 2023-12-08T20:16:06.313 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-radosgw 2023-12-08T20:16:06.354 INFO:teuthology.orchestra.run.smithi111.stdout:76 files removed 2023-12-08T20:16:06.382 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-radosgw 2023-12-08T20:16:07.506 INFO:teuthology.orchestra.run.smithi111.stdout:ceph packages for x86_64 109 kB/s | 78 kB 00:00 2023-12-08T20:16:07.639 INFO:teuthology.orchestra.run.smithi043.stdout:ceph packages for x86_64 91 kB/s | 78 kB 00:00 2023-12-08T20:16:08.282 INFO:teuthology.orchestra.run.smithi111.stdout:ceph noarch packages 12 kB/s | 9.1 kB 00:00 2023-12-08T20:16:08.356 INFO:teuthology.orchestra.run.smithi043.stdout:ceph noarch packages 14 kB/s | 9.1 kB 00:00 2023-12-08T20:16:08.958 INFO:teuthology.orchestra.run.smithi111.stdout:ceph source packages 2.2 kB/s | 1.4 kB 00:00 2023-12-08T20:16:09.040 INFO:teuthology.orchestra.run.smithi043.stdout:ceph source packages 2.2 kB/s | 1.4 kB 00:00 2023-12-08T20:16:09.958 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - AppStream 35 MB/s | 34 MB 00:00 2023-12-08T20:16:10.765 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 8 - AppStream 20 MB/s | 34 MB 00:01 2023-12-08T20:16:17.884 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - BaseOS 34 MB/s | 55 MB 00:01 2023-12-08T20:16:21.207 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 55 MB 00:03 2023-12-08T20:16:25.850 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - Extras 87 kB/s | 18 kB 00:00 2023-12-08T20:16:26.401 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - Extras common packages 19 kB/s | 6.9 kB 00:00 2023-12-08T20:16:27.094 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - PowerTools 12 MB/s | 6.6 MB 00:00 2023-12-08T20:16:28.528 INFO:teuthology.orchestra.run.smithi111.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-12-08T20:16:30.140 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 8 - Extras 90 kB/s | 18 kB 00:00 2023-12-08T20:16:30.749 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.9 kB 00:00 2023-12-08T20:16:30.782 INFO:teuthology.orchestra.run.smithi111.stdout:Extra Packages for Enterprise Linux 7.6 MB/s | 16 MB 00:02 2023-12-08T20:16:31.500 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 8 - PowerTools 11 MB/s | 6.6 MB 00:00 2023-12-08T20:16:33.068 INFO:teuthology.orchestra.run.smithi043.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-12-08T20:16:34.596 INFO:teuthology.orchestra.run.smithi111.stdout:lab-extras 597 kB/s | 24 kB 00:00 2023-12-08T20:16:37.572 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 3.7 MB/s | 16 MB 00:04 2023-12-08T20:16:39.168 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:16:39.171 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:16:39.171 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-12-08T20:16:39.171 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:16:39.171 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-12-08T20:16:39.171 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-radosgw x86_64 2:17.2.7-119.ge2143d99.el8 ceph 17 M 2023-12-08T20:16:39.171 INFO:teuthology.orchestra.run.smithi111.stdout:Upgrading: 2023-12-08T20:16:39.171 INFO:teuthology.orchestra.run.smithi111.stdout: librados2 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 3.5 M 2023-12-08T20:16:39.171 INFO:teuthology.orchestra.run.smithi111.stdout: librbd1 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 3.6 M 2023-12-08T20:16:39.171 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2023-12-08T20:16:39.171 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base x86_64 2:17.2.7-119.ge2143d99.el8 ceph 5.2 M 2023-12-08T20:16:39.171 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-common x86_64 2:17.2.7-119.ge2143d99.el8 ceph 23 M 2023-12-08T20:16:39.171 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-selinux x86_64 2:17.2.7-119.ge2143d99.el8 ceph 24 k 2023-12-08T20:16:39.172 INFO:teuthology.orchestra.run.smithi111.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-08T20:16:39.172 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs2 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 796 k 2023-12-08T20:16:39.172 INFO:teuthology.orchestra.run.smithi111.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-08T20:16:39.172 INFO:teuthology.orchestra.run.smithi111.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-08T20:16:39.172 INFO:teuthology.orchestra.run.smithi111.stdout: libradosstriper1 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 506 k 2023-12-08T20:16:39.172 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-12-08T20:16:39.172 INFO:teuthology.orchestra.run.smithi111.stdout: librgw2 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 5.6 M 2023-12-08T20:16:39.172 INFO:teuthology.orchestra.run.smithi111.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-08T20:16:39.172 INFO:teuthology.orchestra.run.smithi111.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-08T20:16:39.172 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse x86_64 2:17.2.7-119.ge2143d99.el8 ceph 45 k 2023-12-08T20:16:39.172 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common x86_64 2:17.2.7-119.ge2143d99.el8 ceph 115 k 2023-12-08T20:16:39.172 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cephfs x86_64 2:17.2.7-119.ge2143d99.el8 ceph 190 k 2023-12-08T20:16:39.172 INFO:teuthology.orchestra.run.smithi111.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-08T20:16:39.172 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rados x86_64 2:17.2.7-119.ge2143d99.el8 ceph 370 k 2023-12-08T20:16:39.172 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rbd x86_64 2:17.2.7-119.ge2143d99.el8 ceph 358 k 2023-12-08T20:16:39.172 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rgw x86_64 2:17.2.7-119.ge2143d99.el8 ceph 107 k 2023-12-08T20:16:39.173 INFO:teuthology.orchestra.run.smithi111.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-08T20:16:39.173 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:16:39.173 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-12-08T20:16:39.173 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:16:39.173 INFO:teuthology.orchestra.run.smithi111.stdout:Install 21 Packages 2023-12-08T20:16:39.173 INFO:teuthology.orchestra.run.smithi111.stdout:Upgrade 2 Packages 2023-12-08T20:16:39.173 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:16:39.173 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 63 M 2023-12-08T20:16:39.173 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-12-08T20:16:41.919 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 416 kB/s | 24 kB 00:00 2023-12-08T20:16:42.297 INFO:teuthology.orchestra.run.smithi111.stdout:(1/23): ceph-radosgw-17.2.7-119.ge2143d99.el8.x 6.3 MB/s | 17 MB 00:02 2023-12-08T20:16:42.348 INFO:teuthology.orchestra.run.smithi111.stdout:(2/23): ceph-selinux-17.2.7-119.ge2143d99.el8.x 489 kB/s | 24 kB 00:00 2023-12-08T20:16:42.573 INFO:teuthology.orchestra.run.smithi111.stdout:(3/23): ceph-common-17.2.7-119.ge2143d99.el8.x8 7.9 MB/s | 23 MB 00:02 2023-12-08T20:16:42.607 INFO:teuthology.orchestra.run.smithi111.stdout:(4/23): libcephfs2-17.2.7-119.ge2143d99.el8.x86 3.0 MB/s | 796 kB 00:00 2023-12-08T20:16:42.682 INFO:teuthology.orchestra.run.smithi111.stdout:(5/23): libradosstriper1-17.2.7-119.ge2143d99.e 4.6 MB/s | 506 kB 00:00 2023-12-08T20:16:42.841 INFO:teuthology.orchestra.run.smithi111.stdout:(6/23): python3-ceph-argparse-17.2.7-119.ge2143 283 kB/s | 45 kB 00:00 2023-12-08T20:16:42.966 INFO:teuthology.orchestra.run.smithi111.stdout:(7/23): librgw2-17.2.7-119.ge2143d99.el8.x86_64 16 MB/s | 5.6 MB 00:00 2023-12-08T20:16:42.991 INFO:teuthology.orchestra.run.smithi111.stdout:(8/23): python3-ceph-common-17.2.7-119.ge2143d9 769 kB/s | 115 kB 00:00 2023-12-08T20:16:43.016 INFO:teuthology.orchestra.run.smithi111.stdout:(9/23): python3-cephfs-17.2.7-119.ge2143d99.el8 3.7 MB/s | 190 kB 00:00 2023-12-08T20:16:43.092 INFO:teuthology.orchestra.run.smithi111.stdout:(10/23): python3-rados-17.2.7-119.ge2143d99.el8 3.6 MB/s | 370 kB 00:00 2023-12-08T20:16:43.117 INFO:teuthology.orchestra.run.smithi111.stdout:(11/23): python3-rbd-17.2.7-119.ge2143d99.el8.x 3.5 MB/s | 358 kB 00:00 2023-12-08T20:16:43.151 INFO:teuthology.orchestra.run.smithi111.stdout:(12/23): python3-rgw-17.2.7-119.ge2143d99.el8.x 1.8 MB/s | 107 kB 00:00 2023-12-08T20:16:43.234 INFO:teuthology.orchestra.run.smithi111.stdout:(13/23): librdkafka-0.11.4-3.el8.x86_64.rpm 3.0 MB/s | 354 kB 00:00 2023-12-08T20:16:43.260 INFO:teuthology.orchestra.run.smithi111.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.3 MB/s | 259 kB 00:00 2023-12-08T20:16:43.285 INFO:teuthology.orchestra.run.smithi111.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 875 kB/s | 44 kB 00:00 2023-12-08T20:16:43.322 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] librabbitmq-0.9.0-4.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/librabbitmq-0.9.0-4.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:16:43.452 INFO:teuthology.orchestra.run.smithi111.stdout:(16/23): ceph-base-17.2.7-119.ge2143d99.el8.x86 1.3 MB/s | 5.2 MB 00:03 2023-12-08T20:16:43.477 INFO:teuthology.orchestra.run.smithi111.stdout:(17/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 216 kB/s | 47 kB 00:00 2023-12-08T20:16:43.503 INFO:teuthology.orchestra.run.smithi111.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2023-12-08T20:16:43.553 INFO:teuthology.orchestra.run.smithi111.stdout:(19/23): liboath-2.6.2-3.el8.x86_64.rpm 586 kB/s | 59 kB 00:00 2023-12-08T20:16:43.578 INFO:teuthology.orchestra.run.smithi111.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 748 kB/s | 75 kB 00:00 2023-12-08T20:16:43.637 INFO:teuthology.orchestra.run.smithi111.stdout:(21/23): thrift-0.13.0-2.el8.x86_64.rpm 13 MB/s | 1.7 MB 00:00 2023-12-08T20:16:43.862 INFO:teuthology.orchestra.run.smithi111.stdout:(22/23): librbd1-17.2.7-119.ge2143d99.el8.x86_6 13 MB/s | 3.6 MB 00:00 2023-12-08T20:16:44.562 INFO:teuthology.orchestra.run.smithi111.stdout:(23/23): librados2-17.2.7-119.ge2143d99.el8.x86 3.4 MB/s | 3.5 MB 00:01 2023-12-08T20:16:44.564 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:16:44.565 INFO:teuthology.orchestra.run.smithi111.stdout:Total 12 MB/s | 63 MB 00:05 2023-12-08T20:16:44.605 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-12-08T20:16:44.651 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-12-08T20:16:44.651 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-12-08T20:16:45.015 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-12-08T20:16:45.018 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-12-08T20:16:46.152 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-12-08T20:16:46.395 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-08T20:16:46.556 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-08T20:16:46.943 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-08T20:16:47.082 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:16:47.085 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:16:47.085 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2023-12-08T20:16:47.085 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:16:47.085 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2023-12-08T20:16:47.085 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw x86_64 2:17.2.7-119.ge2143d99.el8 ceph 17 M 2023-12-08T20:16:47.085 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2023-12-08T20:16:47.085 INFO:teuthology.orchestra.run.smithi043.stdout: librados2 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 3.5 M 2023-12-08T20:16:47.086 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 3.6 M 2023-12-08T20:16:47.086 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2023-12-08T20:16:47.086 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base x86_64 2:17.2.7-119.ge2143d99.el8 ceph 5.2 M 2023-12-08T20:16:47.086 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common x86_64 2:17.2.7-119.ge2143d99.el8 ceph 23 M 2023-12-08T20:16:47.086 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux x86_64 2:17.2.7-119.ge2143d99.el8 ceph 24 k 2023-12-08T20:16:47.086 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-08T20:16:47.086 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 796 k 2023-12-08T20:16:47.086 INFO:teuthology.orchestra.run.smithi043.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-08T20:16:47.086 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-08T20:16:47.086 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 506 k 2023-12-08T20:16:47.086 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-12-08T20:16:47.087 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2 x86_64 2:17.2.7-119.ge2143d99.el8 ceph 5.6 M 2023-12-08T20:16:47.087 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-08T20:16:47.087 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-08T20:16:47.087 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse x86_64 2:17.2.7-119.ge2143d99.el8 ceph 45 k 2023-12-08T20:16:47.087 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common x86_64 2:17.2.7-119.ge2143d99.el8 ceph 115 k 2023-12-08T20:16:47.087 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs x86_64 2:17.2.7-119.ge2143d99.el8 ceph 190 k 2023-12-08T20:16:47.087 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-08T20:16:47.087 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados x86_64 2:17.2.7-119.ge2143d99.el8 ceph 370 k 2023-12-08T20:16:47.087 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd x86_64 2:17.2.7-119.ge2143d99.el8 ceph 358 k 2023-12-08T20:16:47.087 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw x86_64 2:17.2.7-119.ge2143d99.el8 ceph 107 k 2023-12-08T20:16:47.087 INFO:teuthology.orchestra.run.smithi043.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-08T20:16:47.087 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:16:47.087 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-12-08T20:16:47.087 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:16:47.088 INFO:teuthology.orchestra.run.smithi043.stdout:Install 21 Packages 2023-12-08T20:16:47.088 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 2 Packages 2023-12-08T20:16:47.088 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:16:47.088 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 63 M 2023-12-08T20:16:47.088 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-12-08T20:16:47.106 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : librados2-2:17.2.7-119.ge2143d99.el8.x86_64 3/25 2023-12-08T20:16:47.209 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados2-2:17.2.7-119.ge2143d99.el8.x86_64 3/25 2023-12-08T20:16:47.466 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rados-2:17.2.7-119.ge2143d99.el8.x86_64 4/25 2023-12-08T20:16:47.598 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 5/25 2023-12-08T20:16:48.007 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 5/25 2023-12-08T20:16:48.181 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 6/25 2023-12-08T20:16:48.399 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 6/25 2023-12-08T20:16:48.577 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-08T20:16:48.862 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-08T20:16:48.862 INFO:teuthology.orchestra.run.smithi043.stdout:(1/23): ceph-common-17.2.7-119.ge2143d99.el8.x8 18 MB/s | 23 MB 00:01 2023-12-08T20:16:48.862 INFO:teuthology.orchestra.run.smithi043.stdout:(2/23): ceph-selinux-17.2.7-119.ge2143d99.el8.x 740 kB/s | 24 kB 00:00 2023-12-08T20:16:48.872 INFO:teuthology.orchestra.run.smithi043.stdout:(3/23): libcephfs2-17.2.7-119.ge2143d99.el8.x86 10 MB/s | 796 kB 00:00 2023-12-08T20:16:48.931 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-08T20:16:48.955 INFO:teuthology.orchestra.run.smithi043.stdout:(4/23): libradosstriper1-17.2.7-119.ge2143d99.e 5.9 MB/s | 506 kB 00:00 2023-12-08T20:16:49.280 INFO:teuthology.orchestra.run.smithi043.stdout:(5/23): librgw2-17.2.7-119.ge2143d99.el8.x86_64 17 MB/s | 5.6 MB 00:00 2023-12-08T20:16:49.339 INFO:teuthology.orchestra.run.smithi043.stdout:(6/23): python3-ceph-argparse-17.2.7-119.ge2143 769 kB/s | 45 kB 00:00 2023-12-08T20:16:49.422 INFO:teuthology.orchestra.run.smithi043.stdout:(7/23): python3-ceph-common-17.2.7-119.ge2143d9 1.4 MB/s | 115 kB 00:00 2023-12-08T20:16:49.489 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-08T20:16:49.489 INFO:teuthology.orchestra.run.smithi043.stdout:(8/23): ceph-base-17.2.7-119.ge2143d99.el8.x86_ 2.5 MB/s | 5.2 MB 00:02 2023-12-08T20:16:49.515 INFO:teuthology.orchestra.run.smithi043.stdout:(9/23): python3-cephfs-17.2.7-119.ge2143d99.el8 2.0 MB/s | 190 kB 00:00 2023-12-08T20:16:49.639 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librgw2-2:17.2.7-119.ge2143d99.el8.x86_64 10/25 2023-12-08T20:16:49.705 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librgw2-2:17.2.7-119.ge2143d99.el8.x86_64 10/25 2023-12-08T20:16:49.757 INFO:teuthology.orchestra.run.smithi043.stdout:(10/23): python3-rbd-17.2.7-119.ge2143d99.el8.x 1.4 MB/s | 358 kB 00:00 2023-12-08T20:16:49.782 INFO:teuthology.orchestra.run.smithi043.stdout:(11/23): python3-rados-17.2.7-119.ge2143d99.el8 1.2 MB/s | 370 kB 00:00 2023-12-08T20:16:49.816 INFO:teuthology.orchestra.run.smithi043.stdout:(12/23): python3-rgw-17.2.7-119.ge2143d99.el8.x 1.8 MB/s | 107 kB 00:00 2023-12-08T20:16:49.866 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-ceph-argparse-2:17.2.7-119.ge2143d99.el8.x 11/25 2023-12-08T20:16:50.058 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cephfs-2:17.2.7-119.ge2143d99.el8.x86_64 12/25 2023-12-08T20:16:50.091 INFO:teuthology.orchestra.run.smithi043.stdout:(13/23): librdkafka-0.11.4-3.el8.x86_64.rpm 1.1 MB/s | 354 kB 00:00 2023-12-08T20:16:50.116 INFO:teuthology.orchestra.run.smithi043.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 864 kB/s | 259 kB 00:00 2023-12-08T20:16:50.150 INFO:teuthology.orchestra.run.smithi043.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 748 kB/s | 44 kB 00:00 2023-12-08T20:16:50.257 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rgw-2:17.2.7-119.ge2143d99.el8.x86_64 13/25 2023-12-08T20:16:50.458 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rbd-2:17.2.7-119.ge2143d99.el8.x86_64 14/25 2023-12-08T20:16:50.597 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libradosstriper1-2:17.2.7-119.ge2143d99.el8.x86_64 15/25 2023-12-08T20:16:50.695 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libradosstriper1-2:17.2.7-119.ge2143d99.el8.x86_64 15/25 2023-12-08T20:16:50.817 INFO:teuthology.orchestra.run.smithi043.stdout:(16/23): gperftools-libs-2.7-9.el8.x86_64.rpm 459 kB/s | 306 kB 00:00 2023-12-08T20:16:50.889 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-08T20:16:50.934 INFO:teuthology.orchestra.run.smithi043.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 504 kB/s | 59 kB 00:00 2023-12-08T20:16:51.047 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-08T20:16:51.143 INFO:teuthology.orchestra.run.smithi043.stdout:(18/23): ceph-radosgw-17.2.7-119.ge2143d99.el8. 4.5 MB/s | 17 MB 00:03 2023-12-08T20:16:51.169 INFO:teuthology.orchestra.run.smithi043.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 321 kB/s | 75 kB 00:00 2023-12-08T20:16:51.213 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-08T20:16:51.244 INFO:teuthology.orchestra.run.smithi043.stdout:[MIRROR] librabbitmq-0.9.0-4.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/librabbitmq-0.9.0-4.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:16:51.393 INFO:teuthology.orchestra.run.smithi043.stdout:(20/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 37 kB/s | 47 kB 00:01 2023-12-08T20:16:51.431 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-ceph-common-2:17.2.7-119.ge2143d99.el8.x86 19/25 2023-12-08T20:16:51.728 INFO:teuthology.orchestra.run.smithi043.stdout:(21/23): librbd1-17.2.7-119.ge2143d99.el8.x86_6 11 MB/s | 3.6 MB 00:00 2023-12-08T20:16:51.827 INFO:teuthology.orchestra.run.smithi043.stdout:(22/23): librados2-17.2.7-119.ge2143d99.el8.x86 5.3 MB/s | 3.5 MB 00:00 2023-12-08T20:16:52.010 INFO:teuthology.orchestra.run.smithi043.stdout:(23/23): thrift-0.13.0-2.el8.x86_64.rpm 2.0 MB/s | 1.7 MB 00:00 2023-12-08T20:16:52.015 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:16:52.015 INFO:teuthology.orchestra.run.smithi043.stdout:Total 13 MB/s | 63 MB 00:04 2023-12-08T20:16:52.060 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-12-08T20:16:52.112 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-12-08T20:16:52.112 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-12-08T20:16:52.511 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-12-08T20:16:52.514 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-12-08T20:16:53.613 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-12-08T20:16:53.819 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-08T20:16:53.988 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-08T20:16:54.180 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 20/25 2023-12-08T20:16:54.397 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 20/25 2023-12-08T20:16:54.418 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-08T20:16:54.638 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librados2-2:17.2.7-119.ge2143d99.el8.x86_64 3/25 2023-12-08T20:16:54.743 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:17.2.7-119.ge2143d99.el8.x86_64 3/25 2023-12-08T20:16:54.982 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 20/25 2023-12-08T20:16:54.988 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rados-2:17.2.7-119.ge2143d99.el8.x86_64 4/25 2023-12-08T20:16:55.163 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 5/25 2023-12-08T20:16:55.266 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 21/25 2023-12-08T20:16:55.374 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 21/25 2023-12-08T20:16:55.546 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-selinux-2:17.2.7-119.ge2143d99.el8.x86_64 22/25 2023-12-08T20:16:55.674 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 5/25 2023-12-08T20:16:55.962 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 6/25 2023-12-08T20:16:56.260 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 6/25 2023-12-08T20:16:56.477 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-08T20:16:56.663 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-08T20:16:56.796 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-08T20:16:57.444 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-08T20:16:57.579 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librgw2-2:17.2.7-119.ge2143d99.el8.x86_64 10/25 2023-12-08T20:16:57.647 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librgw2-2:17.2.7-119.ge2143d99.el8.x86_64 10/25 2023-12-08T20:16:57.825 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-argparse-2:17.2.7-119.ge2143d99.el8.x 11/25 2023-12-08T20:16:57.992 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cephfs-2:17.2.7-119.ge2143d99.el8.x86_64 12/25 2023-12-08T20:16:58.193 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rgw-2:17.2.7-119.ge2143d99.el8.x86_64 13/25 2023-12-08T20:16:58.437 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rbd-2:17.2.7-119.ge2143d99.el8.x86_64 14/25 2023-12-08T20:16:58.570 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libradosstriper1-2:17.2.7-119.ge2143d99.el8.x86_64 15/25 2023-12-08T20:16:58.628 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libradosstriper1-2:17.2.7-119.ge2143d99.el8.x86_64 15/25 2023-12-08T20:16:58.884 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-08T20:16:59.047 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-08T20:16:59.279 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-08T20:16:59.463 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-common-2:17.2.7-119.ge2143d99.el8.x86 19/25 2023-12-08T20:17:02.376 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 20/25 2023-12-08T20:17:02.637 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 20/25 2023-12-08T20:17:03.299 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 20/25 2023-12-08T20:17:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 21/25 2023-12-08T20:17:03.700 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 21/25 2023-12-08T20:17:03.928 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-selinux-2:17.2.7-119.ge2143d99.el8.x86_64 22/25 2023-12-08T20:17:13.851 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-selinux-2:17.2.7-119.ge2143d99.el8.x86_64 22/25 2023-12-08T20:17:13.851 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /sys 2023-12-08T20:17:13.851 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /proc 2023-12-08T20:17:13.851 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /dev 2023-12-08T20:17:13.852 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /run 2023-12-08T20:17:13.852 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /mnt 2023-12-08T20:17:13.852 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /var/tmp 2023-12-08T20:17:13.852 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /home 2023-12-08T20:17:13.852 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /tmp 2023-12-08T20:17:13.852 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /dev 2023-12-08T20:17:13.852 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:17:15.546 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-radosgw-2:17.2.7-119.ge2143d99.el8.x86_64 23/25 2023-12-08T20:17:15.625 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-119.ge2143d99.el8.x86_64 23/25 2023-12-08T20:17:15.625 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-08T20:17:15.804 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-08T20:17:15.804 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-08T20:17:16.500 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-08T20:17:16.501 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 1/25 2023-12-08T20:17:16.501 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 2/25 2023-12-08T20:17:16.501 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-radosgw-2:17.2.7-119.ge2143d99.el8.x86_64 3/25 2023-12-08T20:17:16.501 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-selinux-2:17.2.7-119.ge2143d99.el8.x86_64 4/25 2023-12-08T20:17:16.501 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 5/25 2023-12-08T20:17:16.501 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libradosstriper1-2:17.2.7-119.ge2143d99.el8.x86_64 6/25 2023-12-08T20:17:16.501 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librgw2-2:17.2.7-119.ge2143d99.el8.x86_64 7/25 2023-12-08T20:17:16.501 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ceph-argparse-2:17.2.7-119.ge2143d99.el8.x 8/25 2023-12-08T20:17:16.502 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ceph-common-2:17.2.7-119.ge2143d99.el8.x86 9/25 2023-12-08T20:17:16.502 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cephfs-2:17.2.7-119.ge2143d99.el8.x86_64 10/25 2023-12-08T20:17:16.502 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rados-2:17.2.7-119.ge2143d99.el8.x86_64 11/25 2023-12-08T20:17:16.502 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rbd-2:17.2.7-119.ge2143d99.el8.x86_64 12/25 2023-12-08T20:17:16.502 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rgw-2:17.2.7-119.ge2143d99.el8.x86_64 13/25 2023-12-08T20:17:16.502 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-12-08T20:17:16.502 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-08T20:17:16.502 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-08T20:17:16.503 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-08T20:17:16.503 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-08T20:17:16.503 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-08T20:17:16.503 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-08T20:17:16.503 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-08T20:17:16.503 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados2-2:17.2.7-119.ge2143d99.el8.x86_64 22/25 2023-12-08T20:17:16.503 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-08T20:17:16.503 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 24/25 2023-12-08T20:17:17.744 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-08T20:17:17.744 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:17:17.744 INFO:teuthology.orchestra.run.smithi111.stdout:Upgraded: 2023-12-08T20:17:17.744 INFO:teuthology.orchestra.run.smithi111.stdout: librados2-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:17.744 INFO:teuthology.orchestra.run.smithi111.stdout: librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:17.744 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-12-08T20:17:17.744 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:17.744 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:17.744 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-radosgw-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:17.744 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-selinux-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:17.744 INFO:teuthology.orchestra.run.smithi111.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-08T20:17:17.744 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:17.745 INFO:teuthology.orchestra.run.smithi111.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-08T20:17:17.745 INFO:teuthology.orchestra.run.smithi111.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-08T20:17:17.745 INFO:teuthology.orchestra.run.smithi111.stdout: libradosstriper1-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:17.745 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-08T20:17:17.745 INFO:teuthology.orchestra.run.smithi111.stdout: librgw2-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:17.745 INFO:teuthology.orchestra.run.smithi111.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-08T20:17:17.745 INFO:teuthology.orchestra.run.smithi111.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-08T20:17:17.745 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:17.745 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:17.745 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cephfs-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:17.745 INFO:teuthology.orchestra.run.smithi111.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-08T20:17:17.745 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rados-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:17.745 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rbd-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:17.745 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rgw-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:17.746 INFO:teuthology.orchestra.run.smithi111.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-08T20:17:17.746 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:17:17.746 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:17:18.047 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-test 2023-12-08T20:17:18.904 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:44 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:17:20.583 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:17:20.584 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:17:20.584 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-12-08T20:17:20.584 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:17:20.584 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-12-08T20:17:20.584 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-test x86_64 2:17.2.7-119.ge2143d99.el8 ceph 52 M 2023-12-08T20:17:20.584 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2023-12-08T20:17:20.584 INFO:teuthology.orchestra.run.smithi111.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-08T20:17:20.584 INFO:teuthology.orchestra.run.smithi111.stdout: libcephsqlite x86_64 2:17.2.7-119.ge2143d99.el8 ceph 174 k 2023-12-08T20:17:20.584 INFO:teuthology.orchestra.run.smithi111.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-08T20:17:20.584 INFO:teuthology.orchestra.run.smithi111.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-08T20:17:20.584 INFO:teuthology.orchestra.run.smithi111.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-08T20:17:20.584 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:17:20.585 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-12-08T20:17:20.585 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:17:20.585 INFO:teuthology.orchestra.run.smithi111.stdout:Install 6 Packages 2023-12-08T20:17:20.585 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:17:20.585 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 53 M 2023-12-08T20:17:20.585 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 234 M 2023-12-08T20:17:20.585 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-12-08T20:17:20.866 INFO:teuthology.orchestra.run.smithi111.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 2.3 MB/s | 203 kB 00:00 2023-12-08T20:17:20.916 INFO:teuthology.orchestra.run.smithi111.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 4.0 MB/s | 187 kB 00:00 2023-12-08T20:17:20.958 INFO:teuthology.orchestra.run.smithi111.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-12-08T20:17:20.992 INFO:teuthology.orchestra.run.smithi111.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.1 MB/s | 71 kB 00:00 2023-12-08T20:17:21.225 INFO:teuthology.orchestra.run.smithi111.stdout:(5/6): libcephsqlite-17.2.7-119.ge2143d99.el8.x 392 kB/s | 174 kB 00:00 2023-12-08T20:17:23.450 INFO:teuthology.orchestra.run.smithi111.stdout:(6/6): ceph-test-17.2.7-119.ge2143d99.el8.x86_6 19 MB/s | 52 MB 00:02 2023-12-08T20:17:23.452 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:17:23.452 INFO:teuthology.orchestra.run.smithi111.stdout:Total 18 MB/s | 53 MB 00:02 2023-12-08T20:17:23.494 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-12-08T20:17:23.515 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-12-08T20:17:23.515 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-12-08T20:17:23.800 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-12-08T20:17:23.803 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-12-08T20:17:24.268 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-12-08T20:17:24.494 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-08T20:17:24.644 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-08T20:17:24.759 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-08T20:17:24.846 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-08T20:17:25.077 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-08T20:17:25.225 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephsqlite-2:17.2.7-119.ge2143d99.el8.x86_64 5/6 2023-12-08T20:17:25.256 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-selinux-2:17.2.7-119.ge2143d99.el8.x86_64 22/25 2023-12-08T20:17:25.256 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /sys 2023-12-08T20:17:25.256 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /proc 2023-12-08T20:17:25.256 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /dev 2023-12-08T20:17:25.256 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /run 2023-12-08T20:17:25.256 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /mnt 2023-12-08T20:17:25.256 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /var/tmp 2023-12-08T20:17:25.256 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /home 2023-12-08T20:17:25.256 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /tmp 2023-12-08T20:17:25.256 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /dev 2023-12-08T20:17:25.256 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:17:27.132 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-radosgw-2:17.2.7-119.ge2143d99.el8.x86_64 23/25 2023-12-08T20:17:27.211 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-119.ge2143d99.el8.x86_64 23/25 2023-12-08T20:17:27.211 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-08T20:17:27.452 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-08T20:17:27.453 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-08T20:17:28.184 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-08T20:17:28.184 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 1/25 2023-12-08T20:17:28.184 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 2/25 2023-12-08T20:17:28.184 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-radosgw-2:17.2.7-119.ge2143d99.el8.x86_64 3/25 2023-12-08T20:17:28.184 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-selinux-2:17.2.7-119.ge2143d99.el8.x86_64 4/25 2023-12-08T20:17:28.184 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 5/25 2023-12-08T20:17:28.184 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libradosstriper1-2:17.2.7-119.ge2143d99.el8.x86_64 6/25 2023-12-08T20:17:28.184 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librgw2-2:17.2.7-119.ge2143d99.el8.x86_64 7/25 2023-12-08T20:17:28.184 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-argparse-2:17.2.7-119.ge2143d99.el8.x 8/25 2023-12-08T20:17:28.185 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-common-2:17.2.7-119.ge2143d99.el8.x86 9/25 2023-12-08T20:17:28.185 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cephfs-2:17.2.7-119.ge2143d99.el8.x86_64 10/25 2023-12-08T20:17:28.185 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rados-2:17.2.7-119.ge2143d99.el8.x86_64 11/25 2023-12-08T20:17:28.185 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rbd-2:17.2.7-119.ge2143d99.el8.x86_64 12/25 2023-12-08T20:17:28.185 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rgw-2:17.2.7-119.ge2143d99.el8.x86_64 13/25 2023-12-08T20:17:28.185 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-12-08T20:17:28.185 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-08T20:17:28.185 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-08T20:17:28.185 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-08T20:17:28.185 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-08T20:17:28.185 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-08T20:17:28.185 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-08T20:17:28.185 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-08T20:17:28.185 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:17.2.7-119.ge2143d99.el8.x86_64 22/25 2023-12-08T20:17:28.185 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-08T20:17:28.185 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 24/25 2023-12-08T20:17:29.417 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-08T20:17:29.417 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:17:29.417 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2023-12-08T20:17:29.418 INFO:teuthology.orchestra.run.smithi043.stdout: librados2-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:29.418 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:29.418 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-12-08T20:17:29.418 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:29.418 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:29.418 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:29.418 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:29.418 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-08T20:17:29.418 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:29.418 INFO:teuthology.orchestra.run.smithi043.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-08T20:17:29.418 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-08T20:17:29.418 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:29.418 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-08T20:17:29.418 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:29.419 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-08T20:17:29.419 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-08T20:17:29.419 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:29.419 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:29.419 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:29.419 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-08T20:17:29.419 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:29.419 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:29.419 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:29.419 INFO:teuthology.orchestra.run.smithi043.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-08T20:17:29.419 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:17:29.419 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:17:29.641 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-test 2023-12-08T20:17:30.187 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephsqlite-2:17.2.7-119.ge2143d99.el8.x86_64 5/6 2023-12-08T20:17:30.423 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-test-2:17.2.7-119.ge2143d99.el8.x86_64 6/6 2023-12-08T20:17:30.648 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:00:49 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:17:30.705 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-test-2:17.2.7-119.ge2143d99.el8.x86_64 6/6 2023-12-08T20:17:30.705 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-test-2:17.2.7-119.ge2143d99.el8.x86_64 1/6 2023-12-08T20:17:30.705 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephsqlite-2:17.2.7-119.ge2143d99.el8.x86_64 2/6 2023-12-08T20:17:30.705 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-08T20:17:30.705 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-08T20:17:30.705 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-08T20:17:31.469 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-08T20:17:31.470 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:17:31.470 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-12-08T20:17:31.470 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-test-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:31.470 INFO:teuthology.orchestra.run.smithi111.stdout: jq-1.6-8.el8.x86_64 2023-12-08T20:17:31.470 INFO:teuthology.orchestra.run.smithi111.stdout: libcephsqlite-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:31.470 INFO:teuthology.orchestra.run.smithi111.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-08T20:17:31.470 INFO:teuthology.orchestra.run.smithi111.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-08T20:17:31.470 INFO:teuthology.orchestra.run.smithi111.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-08T20:17:31.470 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:17:31.470 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:17:31.707 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph 2023-12-08T20:17:32.526 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:17:32.527 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:17:32.528 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2023-12-08T20:17:32.528 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:17:32.528 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2023-12-08T20:17:32.528 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test x86_64 2:17.2.7-119.ge2143d99.el8 ceph 52 M 2023-12-08T20:17:32.528 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2023-12-08T20:17:32.528 INFO:teuthology.orchestra.run.smithi043.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-08T20:17:32.528 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite x86_64 2:17.2.7-119.ge2143d99.el8 ceph 174 k 2023-12-08T20:17:32.528 INFO:teuthology.orchestra.run.smithi043.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-08T20:17:32.528 INFO:teuthology.orchestra.run.smithi043.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-08T20:17:32.528 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-08T20:17:32.528 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:17:32.528 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-12-08T20:17:32.528 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:17:32.528 INFO:teuthology.orchestra.run.smithi043.stdout:Install 6 Packages 2023-12-08T20:17:32.528 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:17:32.529 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 53 M 2023-12-08T20:17:32.529 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 234 M 2023-12-08T20:17:32.529 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-12-08T20:17:32.563 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:58 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:17:32.664 INFO:teuthology.orchestra.run.smithi043.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 2.1 MB/s | 203 kB 00:00 2023-12-08T20:17:32.718 INFO:teuthology.orchestra.run.smithi043.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 4.7 MB/s | 187 kB 00:00 2023-12-08T20:17:32.765 INFO:teuthology.orchestra.run.smithi043.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-12-08T20:17:32.799 INFO:teuthology.orchestra.run.smithi043.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.1 MB/s | 71 kB 00:00 2023-12-08T20:17:33.249 INFO:teuthology.orchestra.run.smithi043.stdout:(5/6): libcephsqlite-17.2.7-119.ge2143d99.el8.x 257 kB/s | 174 kB 00:00 2023-12-08T20:17:34.232 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:17:34.235 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:17:34.235 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-12-08T20:17:34.235 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:17:34.235 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-12-08T20:17:34.235 INFO:teuthology.orchestra.run.smithi111.stdout: ceph x86_64 2:17.2.7-119.ge2143d99.el8 ceph 6.4 k 2023-12-08T20:17:34.235 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2023-12-08T20:17:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mds x86_64 2:17.2.7-119.ge2143d99.el8 ceph 2.3 M 2023-12-08T20:17:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr x86_64 2:17.2.7-119.ge2143d99.el8 ceph 1.6 M 2023-12-08T20:17:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 238 k 2023-12-08T20:17:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mon x86_64 2:17.2.7-119.ge2143d99.el8 ceph 3.9 M 2023-12-08T20:17:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-osd x86_64 2:17.2.7-119.ge2143d99.el8 ceph 17 M 2023-12-08T20:17:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-08T20:17:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-08T20:17:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-08T20:17:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-08T20:17:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-08T20:17:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-08T20:17:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-08T20:17:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-08T20:17:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-08T20:17:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-08T20:17:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-08T20:17:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-08T20:17:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-08T20:17:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-08T20:17:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-08T20:17:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-08T20:17:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-08T20:17:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-08T20:17:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-08T20:17:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-08T20:17:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-08T20:17:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-08T20:17:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-08T20:17:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-08T20:17:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-08T20:17:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-08T20:17:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:17:34.238 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-12-08T20:17:34.238 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:17:34.238 INFO:teuthology.orchestra.run.smithi111.stdout:Install 32 Packages 2023-12-08T20:17:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:17:34.239 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 28 M 2023-12-08T20:17:34.239 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 110 M 2023-12-08T20:17:34.239 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-12-08T20:17:35.085 INFO:teuthology.orchestra.run.smithi111.stdout:(1/32): ceph-17.2.7-119.ge2143d99.el8.x86_64.rp 15 kB/s | 6.4 kB 00:00 2023-12-08T20:17:35.361 INFO:teuthology.orchestra.run.smithi111.stdout:(2/32): ceph-mgr-17.2.7-119.ge2143d99.el8.x86_6 2.2 MB/s | 1.6 MB 00:00 2023-12-08T20:17:35.645 INFO:teuthology.orchestra.run.smithi111.stdout:(3/32): ceph-mon-17.2.7-119.ge2143d99.el8.x86_6 7.1 MB/s | 3.9 MB 00:00 2023-12-08T20:17:35.687 INFO:teuthology.orchestra.run.smithi111.stdout:(4/32): ceph-mds-17.2.7-119.ge2143d99.el8.x86_6 2.2 MB/s | 2.3 MB 00:01 2023-12-08T20:17:35.701 INFO:teuthology.orchestra.run.smithi043.stdout:(6/6): ceph-test-17.2.7-119.ge2143d99.el8.x86_6 17 MB/s | 52 MB 00:03 2023-12-08T20:17:35.701 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:17:35.703 INFO:teuthology.orchestra.run.smithi043.stdout:Total 17 MB/s | 53 MB 00:03 2023-12-08T20:17:35.728 INFO:teuthology.orchestra.run.smithi111.stdout:(5/32): ceph-mgr-modules-core-17.2.7-119.ge2143 2.8 MB/s | 238 kB 00:00 2023-12-08T20:17:35.748 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-12-08T20:17:35.762 INFO:teuthology.orchestra.run.smithi111.stdout:(6/32): python3-mako-1.0.6-14.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2023-12-08T20:17:35.772 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-12-08T20:17:35.772 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-12-08T20:17:35.778 INFO:teuthology.orchestra.run.smithi111.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 773 kB/s | 39 kB 00:00 2023-12-08T20:17:35.805 INFO:teuthology.orchestra.run.smithi111.stdout:(8/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 2.4 MB/s | 103 kB 00:00 2023-12-08T20:17:35.829 INFO:teuthology.orchestra.run.smithi111.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 1.1 MB/s | 57 kB 00:00 2023-12-08T20:17:35.855 INFO:teuthology.orchestra.run.smithi111.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 8.9 MB/s | 457 kB 00:00 2023-12-08T20:17:35.873 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] python3-cffi-1.11.5-6.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/python3-cffi-1.11.5-6.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:17:35.892 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] python3-cryptography-3.2.1-6.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/python3-cryptography-3.2.1-6.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:17:36.088 INFO:teuthology.orchestra.run.smithi111.stdout:(11/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 962 kB/s | 249 kB 00:00 2023-12-08T20:17:36.089 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-12-08T20:17:36.092 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-12-08T20:17:36.125 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] python3-pycparser-2.14-14.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/python3-pycparser-2.14-14.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:17:36.164 INFO:teuthology.orchestra.run.smithi111.stdout:(12/32): python3-cryptography-3.2.1-6.el8.x86_6 2.0 MB/s | 641 kB 00:00 2023-12-08T20:17:36.189 INFO:teuthology.orchestra.run.smithi111.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 1.1 MB/s | 109 kB 00:00 2023-12-08T20:17:36.431 INFO:teuthology.orchestra.run.smithi111.stdout:(14/32): ceph-osd-17.2.7-119.ge2143d99.el8.x86_ 16 MB/s | 17 MB 00:01 2023-12-08T20:17:36.506 INFO:teuthology.orchestra.run.smithi111.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 127 kB/s | 44 kB 00:00 2023-12-08T20:17:36.629 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-12-08T20:17:36.673 INFO:teuthology.orchestra.run.smithi111.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 383 kB/s | 185 kB 00:00 2023-12-08T20:17:36.765 INFO:teuthology.orchestra.run.smithi111.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2023-12-08T20:17:36.848 INFO:teuthology.orchestra.run.smithi111.stdout:(18/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.1 MB/s | 384 kB 00:00 2023-12-08T20:17:36.865 INFO:teuthology.orchestra.run.smithi111.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 175 kB/s | 18 kB 00:00 2023-12-08T20:17:36.869 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-08T20:17:36.900 INFO:teuthology.orchestra.run.smithi111.stdout:(20/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 369 kB/s | 173 kB 00:00 2023-12-08T20:17:36.949 INFO:teuthology.orchestra.run.smithi111.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 483 kB/s | 49 kB 00:00 2023-12-08T20:17:36.983 INFO:teuthology.orchestra.run.smithi111.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 500 kB/s | 59 kB 00:00 2023-12-08T20:17:37.046 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-08T20:17:37.050 INFO:teuthology.orchestra.run.smithi111.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2023-12-08T20:17:37.084 INFO:teuthology.orchestra.run.smithi111.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 187 kB/s | 19 kB 00:00 2023-12-08T20:17:37.109 INFO:teuthology.orchestra.run.smithi111.stdout:(25/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.3 MB/s | 283 kB 00:00 2023-12-08T20:17:37.159 INFO:teuthology.orchestra.run.smithi111.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 219 kB/s | 24 kB 00:00 2023-12-08T20:17:37.193 INFO:teuthology.orchestra.run.smithi111.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 268 kB/s | 29 kB 00:00 2023-12-08T20:17:37.240 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-08T20:17:37.248 INFO:teuthology.orchestra.run.smithi111.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 199 kB/s | 27 kB 00:00 2023-12-08T20:17:37.293 INFO:teuthology.orchestra.run.smithi111.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.9 MB/s | 255 kB 00:00 2023-12-08T20:17:37.334 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-08T20:17:37.352 INFO:teuthology.orchestra.run.smithi111.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 821 kB/s | 85 kB 00:00 2023-12-08T20:17:37.377 INFO:teuthology.orchestra.run.smithi111.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.3 MB/s | 251 kB 00:00 2023-12-08T20:17:37.402 INFO:teuthology.orchestra.run.smithi111.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 211 kB/s | 23 kB 00:00 2023-12-08T20:17:37.404 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:17:37.404 INFO:teuthology.orchestra.run.smithi111.stdout:Total 9.0 MB/s | 28 MB 00:03 2023-12-08T20:17:37.490 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-12-08T20:17:37.527 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-12-08T20:17:37.527 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-12-08T20:17:37.530 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-08T20:17:37.714 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephsqlite-2:17.2.7-119.ge2143d99.el8.x86_64 5/6 2023-12-08T20:17:37.830 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-12-08T20:17:37.833 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-12-08T20:17:38.970 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-12-08T20:17:39.212 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-08T20:17:39.414 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-08T20:17:39.630 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-08T20:17:39.862 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-08T20:17:40.052 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-08T20:17:40.248 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-08T20:17:40.434 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-08T20:17:40.628 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-08T20:17:40.840 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-08T20:17:41.058 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-08T20:17:41.304 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-08T20:17:41.529 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-08T20:17:41.914 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-08T20:17:42.150 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-08T20:17:42.347 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-08T20:17:42.613 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-08T20:17:42.815 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-08T20:17:43.110 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-08T20:17:43.207 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephsqlite-2:17.2.7-119.ge2143d99.el8.x86_64 5/6 2023-12-08T20:17:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-08T20:17:43.463 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-test-2:17.2.7-119.ge2143d99.el8.x86_64 6/6 2023-12-08T20:17:43.491 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-08T20:17:43.644 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-08T20:17:43.786 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-test-2:17.2.7-119.ge2143d99.el8.x86_64 6/6 2023-12-08T20:17:43.786 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-test-2:17.2.7-119.ge2143d99.el8.x86_64 1/6 2023-12-08T20:17:43.787 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephsqlite-2:17.2.7-119.ge2143d99.el8.x86_64 2/6 2023-12-08T20:17:43.787 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-08T20:17:43.787 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-08T20:17:43.787 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-08T20:17:43.924 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-08T20:17:44.184 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-08T20:17:44.414 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-08T20:17:44.609 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-08T20:17:44.610 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:17:44.610 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-12-08T20:17:44.610 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:44.610 INFO:teuthology.orchestra.run.smithi043.stdout: jq-1.6-8.el8.x86_64 2023-12-08T20:17:44.610 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:44.610 INFO:teuthology.orchestra.run.smithi043.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-08T20:17:44.610 INFO:teuthology.orchestra.run.smithi043.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-08T20:17:44.610 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-08T20:17:44.610 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:17:44.610 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:17:44.739 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-08T20:17:44.837 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph 2023-12-08T20:17:45.018 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-08T20:17:45.393 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-119.ge2143d99.el8.n 27/32 2023-12-08T20:17:45.591 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 28/32 2023-12-08T20:17:45.826 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:04 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:17:47.078 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 28/32 2023-12-08T20:17:47.249 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-osd-2:17.2.7-119.ge2143d99.el8.x86_64 29/32 2023-12-08T20:17:47.642 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-osd-2:17.2.7-119.ge2143d99.el8.x86_64 29/32 2023-12-08T20:17:47.708 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:17:47.712 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:17:47.712 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2023-12-08T20:17:47.712 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:17:47.712 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2023-12-08T20:17:47.712 INFO:teuthology.orchestra.run.smithi043.stdout: ceph x86_64 2:17.2.7-119.ge2143d99.el8 ceph 6.4 k 2023-12-08T20:17:47.712 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2023-12-08T20:17:47.712 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds x86_64 2:17.2.7-119.ge2143d99.el8 ceph 2.3 M 2023-12-08T20:17:47.712 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr x86_64 2:17.2.7-119.ge2143d99.el8 ceph 1.6 M 2023-12-08T20:17:47.713 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 238 k 2023-12-08T20:17:47.713 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon x86_64 2:17.2.7-119.ge2143d99.el8 ceph 3.9 M 2023-12-08T20:17:47.713 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd x86_64 2:17.2.7-119.ge2143d99.el8 ceph 17 M 2023-12-08T20:17:47.713 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-08T20:17:47.713 INFO:teuthology.orchestra.run.smithi043.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-08T20:17:47.713 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-08T20:17:47.713 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-08T20:17:47.713 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-08T20:17:47.713 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-08T20:17:47.713 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-08T20:17:47.713 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-08T20:17:47.713 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-08T20:17:47.713 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-08T20:17:47.713 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-08T20:17:47.713 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-08T20:17:47.713 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-08T20:17:47.714 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-08T20:17:47.714 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-08T20:17:47.714 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-08T20:17:47.714 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-08T20:17:47.714 INFO:teuthology.orchestra.run.smithi043.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-08T20:17:47.714 INFO:teuthology.orchestra.run.smithi043.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-08T20:17:47.714 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-08T20:17:47.714 INFO:teuthology.orchestra.run.smithi043.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-08T20:17:47.714 INFO:teuthology.orchestra.run.smithi043.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-08T20:17:47.714 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-08T20:17:47.714 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-08T20:17:47.714 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-08T20:17:47.715 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-08T20:17:47.715 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:17:47.715 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-12-08T20:17:47.715 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:17:47.715 INFO:teuthology.orchestra.run.smithi043.stdout:Install 32 Packages 2023-12-08T20:17:47.715 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:17:47.715 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 28 M 2023-12-08T20:17:47.715 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 110 M 2023-12-08T20:17:47.716 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-12-08T20:17:47.813 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mon-2:17.2.7-119.ge2143d99.el8.x86_64 30/32 2023-12-08T20:17:48.031 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mon-2:17.2.7-119.ge2143d99.el8.x86_64 30/32 2023-12-08T20:17:48.205 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mds-2:17.2.7-119.ge2143d99.el8.x86_64 31/32 2023-12-08T20:17:48.223 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mds-2:17.2.7-119.ge2143d99.el8.x86_64 31/32 2023-12-08T20:17:48.301 INFO:teuthology.orchestra.run.smithi043.stdout:(1/32): ceph-17.2.7-119.ge2143d99.el8.x86_64.rp 33 kB/s | 6.4 kB 00:00 2023-12-08T20:17:48.371 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-2:17.2.7-119.ge2143d99.el8.x86_64 32/32 2023-12-08T20:17:48.426 INFO:teuthology.orchestra.run.smithi043.stdout:(2/32): ceph-mds-17.2.7-119.ge2143d99.el8.x86_6 7.3 MB/s | 2.3 MB 00:00 2023-12-08T20:17:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-2:17.2.7-119.ge2143d99.el8.x86_64 32/32 2023-12-08T20:17:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-2:17.2.7-119.ge2143d99.el8.x86_64 1/32 2023-12-08T20:17:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mds-2:17.2.7-119.ge2143d99.el8.x86_64 2/32 2023-12-08T20:17:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 3/32 2023-12-08T20:17:48.773 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mon-2:17.2.7-119.ge2143d99.el8.x86_64 4/32 2023-12-08T20:17:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-osd-2:17.2.7-119.ge2143d99.el8.x86_64 5/32 2023-12-08T20:17:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-119.ge2143d99.el8.n 6/32 2023-12-08T20:17:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-08T20:17:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-08T20:17:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-08T20:17:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-08T20:17:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-08T20:17:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-08T20:17:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-08T20:17:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-08T20:17:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-08T20:17:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-08T20:17:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-08T20:17:48.774 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-08T20:17:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-08T20:17:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-08T20:17:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-08T20:17:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-08T20:17:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-08T20:17:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-08T20:17:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-08T20:17:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-08T20:17:48.775 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-08T20:17:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-08T20:17:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-08T20:17:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-08T20:17:48.776 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-08T20:17:48.820 INFO:teuthology.orchestra.run.smithi043.stdout:(3/32): ceph-mgr-17.2.7-119.ge2143d99.el8.x86_6 2.2 MB/s | 1.6 MB 00:00 2023-12-08T20:17:48.918 INFO:teuthology.orchestra.run.smithi043.stdout:(4/32): ceph-mgr-modules-core-17.2.7-119.ge2143 2.4 MB/s | 238 kB 00:00 2023-12-08T20:17:48.994 INFO:teuthology.orchestra.run.smithi043.stdout:(5/32): python3-mako-1.0.6-14.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2023-12-08T20:17:49.027 INFO:teuthology.orchestra.run.smithi043.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 1.1 MB/s | 39 kB 00:00 2023-12-08T20:17:49.069 INFO:teuthology.orchestra.run.smithi043.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 2.4 MB/s | 103 kB 00:00 2023-12-08T20:17:49.245 INFO:teuthology.orchestra.run.smithi043.stdout:(8/32): ceph-osd-17.2.7-119.ge2143d99.el8.x86_6 20 MB/s | 17 MB 00:00 2023-12-08T20:17:49.290 INFO:teuthology.orchestra.run.smithi043.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 259 kB/s | 57 kB 00:00 2023-12-08T20:17:49.328 INFO:teuthology.orchestra.run.smithi043.stdout:[MIRROR] python3-cffi-1.11.5-6.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/python3-cffi-1.11.5-6.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:17:49.387 INFO:teuthology.orchestra.run.smithi043.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 3.2 MB/s | 457 kB 00:00 2023-12-08T20:17:49.424 INFO:teuthology.orchestra.run.smithi043.stdout:[MIRROR] python3-cryptography-3.2.1-6.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/python3-cryptography-3.2.1-6.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:17:49.579 INFO:teuthology.orchestra.run.smithi043.stdout:(11/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 862 kB/s | 249 kB 00:00 2023-12-08T20:17:49.616 INFO:teuthology.orchestra.run.smithi043.stdout:[MIRROR] python3-pycparser-2.14-14.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/python3-pycparser-2.14-14.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:17:49.679 INFO:teuthology.orchestra.run.smithi043.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 1.1 MB/s | 109 kB 00:00 2023-12-08T20:17:49.721 INFO:teuthology.orchestra.run.smithi043.stdout:(13/32): python3-cryptography-3.2.1-6.el8.x86_6 1.9 MB/s | 641 kB 00:00 2023-12-08T20:17:49.956 INFO:teuthology.orchestra.run.smithi043.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 158 kB/s | 44 kB 00:00 2023-12-08T20:17:49.980 INFO:teuthology.orchestra.run.smithi043.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 716 kB/s | 185 kB 00:00 2023-12-08T20:17:50.072 INFO:teuthology.orchestra.run.smithi043.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.4 MB/s | 173 kB 00:00 2023-12-08T20:17:50.131 INFO:teuthology.orchestra.run.smithi043.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 190 kB/s | 11 kB 00:00 2023-12-08T20:17:50.223 INFO:teuthology.orchestra.run.smithi043.stdout:(18/32): python3-jaraco-functools-2.0-4.el8.noa 191 kB/s | 18 kB 00:00 2023-12-08T20:17:50.256 INFO:teuthology.orchestra.run.smithi043.stdout:(19/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.4 MB/s | 384 kB 00:00 2023-12-08T20:17:50.283 INFO:teuthology.orchestra.run.smithi043.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 836 kB/s | 49 kB 00:00 2023-12-08T20:17:50.319 INFO:teuthology.orchestra.run.smithi043.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 1.0 MB/s | 59 kB 00:00 2023-12-08T20:17:50.374 INFO:teuthology.orchestra.run.smithi043.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 267 kB/s | 16 kB 00:00 2023-12-08T20:17:50.433 INFO:teuthology.orchestra.run.smithi043.stdout:(23/32): python3-simplegeneric-0.8.1-17.el8.noa 320 kB/s | 19 kB 00:00 2023-12-08T20:17:50.458 INFO:teuthology.orchestra.run.smithi043.stdout:(24/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2023-12-08T20:17:50.492 INFO:teuthology.orchestra.run.smithi043.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 409 kB/s | 24 kB 00:00 2023-12-08T20:17:50.517 INFO:teuthology.orchestra.run.smithi043.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 498 kB/s | 29 kB 00:00 2023-12-08T20:17:50.551 INFO:teuthology.orchestra.run.smithi043.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 471 kB/s | 27 kB 00:00 2023-12-08T20:17:50.680 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-08T20:17:50.680 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:17:50.680 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-12-08T20:17:50.680 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:50.680 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mds-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:50.680 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:50.680 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-08T20:17:50.680 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mon-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:50.680 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-osd-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:17:50.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-08T20:17:50.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-08T20:17:50.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-08T20:17:50.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-08T20:17:50.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-08T20:17:50.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-08T20:17:50.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-08T20:17:50.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-08T20:17:50.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-08T20:17:50.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-08T20:17:50.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-08T20:17:50.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-08T20:17:50.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-08T20:17:50.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-portend-2.6-1.el8.noarch 2023-12-08T20:17:50.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-08T20:17:50.682 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-08T20:17:50.682 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-08T20:17:50.682 INFO:teuthology.orchestra.run.smithi111.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-08T20:17:50.682 INFO:teuthology.orchestra.run.smithi111.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-08T20:17:50.682 INFO:teuthology.orchestra.run.smithi111.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-08T20:17:50.682 INFO:teuthology.orchestra.run.smithi111.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-08T20:17:50.682 INFO:teuthology.orchestra.run.smithi111.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-08T20:17:50.682 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-08T20:17:50.682 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-08T20:17:50.682 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-08T20:17:50.682 INFO:teuthology.orchestra.run.smithi111.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-08T20:17:50.682 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:17:50.682 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:17:50.693 INFO:teuthology.orchestra.run.smithi043.stdout:(28/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.4 MB/s | 255 kB 00:00 2023-12-08T20:17:50.744 INFO:teuthology.orchestra.run.smithi043.stdout:(29/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.3 MB/s | 251 kB 00:00 2023-12-08T20:17:50.777 INFO:teuthology.orchestra.run.smithi043.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.0 MB/s | 85 kB 00:00 2023-12-08T20:17:50.802 INFO:teuthology.orchestra.run.smithi043.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 393 kB/s | 23 kB 00:00 2023-12-08T20:17:50.812 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-base 2023-12-08T20:17:51.510 INFO:teuthology.orchestra.run.smithi043.stdout:(32/32): ceph-mon-17.2.7-119.ge2143d99.el8.x86_ 1.2 MB/s | 3.9 MB 00:03 2023-12-08T20:17:51.562 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:17:51.562 INFO:teuthology.orchestra.run.smithi043.stdout:Total 7.5 MB/s | 28 MB 00:03 2023-12-08T20:17:51.602 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-12-08T20:17:51.643 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-12-08T20:17:51.643 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-12-08T20:17:51.666 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:17 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:17:51.966 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-12-08T20:17:51.969 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-12-08T20:17:53.114 INFO:teuthology.orchestra.run.smithi111.stdout:Package ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-08T20:17:53.121 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-12-08T20:17:53.335 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:17:53.336 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2023-12-08T20:17:53.336 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:17:53.369 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-08T20:17:53.438 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install cephadm 2023-12-08T20:17:53.622 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-08T20:17:53.882 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-08T20:17:54.162 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-08T20:17:54.288 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:20 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:17:54.359 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-08T20:17:54.567 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-08T20:17:54.757 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-08T20:17:54.977 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-08T20:17:55.197 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-08T20:17:55.450 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-08T20:17:55.663 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-08T20:17:55.939 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-08T20:17:55.964 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:17:55.964 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:17:55.964 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-12-08T20:17:55.964 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:17:55.964 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-12-08T20:17:55.965 INFO:teuthology.orchestra.run.smithi111.stdout: cephadm noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 80 k 2023-12-08T20:17:55.965 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:17:55.965 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-12-08T20:17:55.965 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:17:55.965 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2023-12-08T20:17:55.965 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:17:55.965 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 80 k 2023-12-08T20:17:55.965 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 364 k 2023-12-08T20:17:55.966 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-12-08T20:17:56.234 INFO:teuthology.orchestra.run.smithi111.stdout:cephadm-17.2.7-119.ge2143d99.el8.noarch.rpm 299 kB/s | 80 kB 00:00 2023-12-08T20:17:56.234 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:17:56.235 INFO:teuthology.orchestra.run.smithi111.stdout:Total 298 kB/s | 80 kB 00:00 2023-12-08T20:17:56.235 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-12-08T20:17:56.243 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-12-08T20:17:56.243 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-12-08T20:17:56.244 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-12-08T20:17:56.247 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-12-08T20:17:56.293 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-12-08T20:17:56.349 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-08T20:17:56.585 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-08T20:17:56.788 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-08T20:17:56.789 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/1 2023-12-08T20:17:56.977 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/1 2023-12-08T20:17:57.070 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-08T20:17:57.198 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/1 2023-12-08T20:17:57.315 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-08T20:17:57.666 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-08T20:17:57.853 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/1 2023-12-08T20:17:57.853 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:17:57.854 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-12-08T20:17:57.854 INFO:teuthology.orchestra.run.smithi111.stdout: cephadm-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-08T20:17:57.854 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:17:57.854 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:17:57.904 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-08T20:17:58.064 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-immutable-object-cache 2023-12-08T20:17:58.075 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-08T20:17:58.293 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-08T20:17:58.540 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-08T20:17:58.820 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-08T20:17:58.923 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:24 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:17:59.069 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-08T20:17:59.441 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-08T20:17:59.784 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-08T20:18:00.158 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-119.ge2143d99.el8.n 27/32 2023-12-08T20:18:00.595 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:18:00.595 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:00.595 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repo Size 2023-12-08T20:18:00.595 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:00.595 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-12-08T20:18:00.595 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-119.ge2143d99.el8 ceph 161 k 2023-12-08T20:18:00.596 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:00.596 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-12-08T20:18:00.596 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:00.596 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2023-12-08T20:18:00.596 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:00.596 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 161 k 2023-12-08T20:18:00.597 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 490 k 2023-12-08T20:18:00.597 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-12-08T20:18:00.977 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 28/32 2023-12-08T20:18:01.752 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-immutable-object-cache-17.2.7-119.ge2143d9 140 kB/s | 161 kB 00:01 2023-12-08T20:18:01.753 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:18:01.753 INFO:teuthology.orchestra.run.smithi111.stdout:Total 140 kB/s | 161 kB 00:01 2023-12-08T20:18:01.753 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-12-08T20:18:01.766 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-12-08T20:18:01.766 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-12-08T20:18:01.819 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-12-08T20:18:01.821 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-12-08T20:18:02.239 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-12-08T20:18:02.428 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-119.ge2143d99.e 1/1 2023-12-08T20:18:02.610 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 28/32 2023-12-08T20:18:02.802 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-osd-2:17.2.7-119.ge2143d99.el8.x86_64 29/32 2023-12-08T20:18:02.848 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-119.ge2143d99.e 1/1 2023-12-08T20:18:03.238 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-osd-2:17.2.7-119.ge2143d99.el8.x86_64 29/32 2023-12-08T20:18:03.452 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mon-2:17.2.7-119.ge2143d99.el8.x86_64 30/32 2023-12-08T20:18:03.528 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-119.ge2143d99.e 1/1 2023-12-08T20:18:03.529 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:03.529 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-12-08T20:18:03.529 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-immutable-object-cache-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:18:03.529 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:03.529 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:18:03.692 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mon-2:17.2.7-119.ge2143d99.el8.x86_64 30/32 2023-12-08T20:18:03.726 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr 2023-12-08T20:18:03.894 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mds-2:17.2.7-119.ge2143d99.el8.x86_64 31/32 2023-12-08T20:18:03.917 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mds-2:17.2.7-119.ge2143d99.el8.x86_64 31/32 2023-12-08T20:18:04.036 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-2:17.2.7-119.ge2143d99.el8.x86_64 32/32 2023-12-08T20:18:04.500 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-2:17.2.7-119.ge2143d99.el8.x86_64 32/32 2023-12-08T20:18:04.500 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-2:17.2.7-119.ge2143d99.el8.x86_64 1/32 2023-12-08T20:18:04.500 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mds-2:17.2.7-119.ge2143d99.el8.x86_64 2/32 2023-12-08T20:18:04.501 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 3/32 2023-12-08T20:18:04.501 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mon-2:17.2.7-119.ge2143d99.el8.x86_64 4/32 2023-12-08T20:18:04.501 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-osd-2:17.2.7-119.ge2143d99.el8.x86_64 5/32 2023-12-08T20:18:04.501 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-119.ge2143d99.el8.n 6/32 2023-12-08T20:18:04.501 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-08T20:18:04.501 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-08T20:18:04.501 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-08T20:18:04.501 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-08T20:18:04.501 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-08T20:18:04.501 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-08T20:18:04.501 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-08T20:18:04.501 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-08T20:18:04.501 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-08T20:18:04.501 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-08T20:18:04.501 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-08T20:18:04.502 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-08T20:18:04.502 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-08T20:18:04.502 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-08T20:18:04.502 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-08T20:18:04.502 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-08T20:18:04.502 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-08T20:18:04.502 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-08T20:18:04.502 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-08T20:18:04.502 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-08T20:18:04.502 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-08T20:18:04.502 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-08T20:18:04.502 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-08T20:18:04.502 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-08T20:18:04.502 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-08T20:18:04.584 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:30 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:18:05.728 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-08T20:18:05.728 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:05.728 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-12-08T20:18:05.728 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:18:05.728 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:18:05.728 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:18:05.728 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-08T20:18:05.728 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:18:05.728 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:18:05.728 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-08T20:18:05.728 INFO:teuthology.orchestra.run.smithi043.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-08T20:18:05.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-08T20:18:05.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-08T20:18:05.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-08T20:18:05.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-08T20:18:05.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-08T20:18:05.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-08T20:18:05.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-08T20:18:05.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-08T20:18:05.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-08T20:18:05.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-08T20:18:05.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-08T20:18:05.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend-2.6-1.el8.noarch 2023-12-08T20:18:05.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-08T20:18:05.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-08T20:18:05.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-08T20:18:05.730 INFO:teuthology.orchestra.run.smithi043.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-08T20:18:05.730 INFO:teuthology.orchestra.run.smithi043.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-08T20:18:05.730 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-08T20:18:05.730 INFO:teuthology.orchestra.run.smithi043.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-08T20:18:05.730 INFO:teuthology.orchestra.run.smithi043.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-08T20:18:05.730 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-08T20:18:05.730 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-08T20:18:05.730 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-08T20:18:05.730 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-08T20:18:05.730 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:05.730 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:18:05.884 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-base 2023-12-08T20:18:06.030 INFO:teuthology.orchestra.run.smithi111.stdout:Package ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-08T20:18:06.253 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:18:06.254 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2023-12-08T20:18:06.254 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:18:06.349 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-dashboard 2023-12-08T20:18:06.872 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:25 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:18:07.193 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:33 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:18:08.487 INFO:teuthology.orchestra.run.smithi043.stdout:Package ceph-base-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-08T20:18:08.736 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:18:08.737 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2023-12-08T20:18:08.738 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:18:08.848 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install cephadm 2023-12-08T20:18:08.882 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:18:08.883 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:08.883 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-12-08T20:18:08.884 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:08.884 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-12-08T20:18:08.884 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-dashboard noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 1.7 M 2023-12-08T20:18:08.884 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2023-12-08T20:18:08.884 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-grafana-dashboards noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 23 k 2023-12-08T20:18:08.884 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-prometheus-alerts noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 14 k 2023-12-08T20:18:08.884 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-08T20:18:08.884 INFO:teuthology.orchestra.run.smithi111.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-08T20:18:08.884 INFO:teuthology.orchestra.run.smithi111.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-08T20:18:08.884 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:08.884 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-12-08T20:18:08.884 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:08.884 INFO:teuthology.orchestra.run.smithi111.stdout:Install 6 Packages 2023-12-08T20:18:08.884 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:08.885 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 2.0 M 2023-12-08T20:18:08.885 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 8.0 M 2023-12-08T20:18:08.885 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-12-08T20:18:09.125 INFO:teuthology.orchestra.run.smithi111.stdout:(1/6): ceph-grafana-dashboards-17.2.7-119.ge214 138 kB/s | 23 kB 00:00 2023-12-08T20:18:09.173 INFO:teuthology.orchestra.run.smithi111.stdout:(2/6): ceph-prometheus-alerts-17.2.7-119.ge2143 67 kB/s | 14 kB 00:00 2023-12-08T20:18:09.209 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] python3-jwt-1.6.1-2.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/python3-jwt-1.6.1-2.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:18:09.292 INFO:teuthology.orchestra.run.smithi111.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 282 kB/s | 34 kB 00:00 2023-12-08T20:18:09.334 INFO:teuthology.orchestra.run.smithi111.stdout:(4/6): ceph-mgr-dashboard-17.2.7-119.ge2143d99. 4.5 MB/s | 1.7 MB 00:00 2023-12-08T20:18:09.359 INFO:teuthology.orchestra.run.smithi111.stdout:(5/6): python3-jwt-1.6.1-2.el8.noarch.rpm 182 kB/s | 43 kB 00:00 2023-12-08T20:18:09.386 INFO:teuthology.orchestra.run.smithi111.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 2.1 MB/s | 196 kB 00:00 2023-12-08T20:18:09.387 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:18:09.387 INFO:teuthology.orchestra.run.smithi111.stdout:Total 4.0 MB/s | 2.0 MB 00:00 2023-12-08T20:18:09.397 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-12-08T20:18:09.406 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-12-08T20:18:09.406 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-12-08T20:18:09.481 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-12-08T20:18:09.484 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-12-08T20:18:09.739 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-12-08T20:18:09.832 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:28 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:18:09.985 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-08T20:18:10.212 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-08T20:18:10.396 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-08T20:18:10.549 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-119.ge2143d99.el8.no 4/6 2023-12-08T20:18:10.887 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-119.ge2143d99.el8.n 5/6 2023-12-08T20:18:11.112 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-119.ge2143d99.el8.noarch 6/6 2023-12-08T20:18:11.400 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-119.ge2143d99.el8.noarch 6/6 2023-12-08T20:18:11.400 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-119.ge2143d99.el8.n 1/6 2023-12-08T20:18:11.400 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-119.ge2143d99.el8.noarch 2/6 2023-12-08T20:18:11.400 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-119.ge2143d99.el8.no 3/6 2023-12-08T20:18:11.401 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-08T20:18:11.401 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-08T20:18:11.695 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:18:11.696 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:18:11.696 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2023-12-08T20:18:11.696 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:18:11.696 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2023-12-08T20:18:11.696 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 80 k 2023-12-08T20:18:11.696 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:11.696 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-12-08T20:18:11.696 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:18:11.696 INFO:teuthology.orchestra.run.smithi043.stdout:Install 1 Package 2023-12-08T20:18:11.697 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:11.697 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 80 k 2023-12-08T20:18:11.697 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 364 k 2023-12-08T20:18:11.697 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-12-08T20:18:12.076 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-08T20:18:12.076 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:12.076 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-12-08T20:18:12.077 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-grafana-dashboards-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-08T20:18:12.077 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-dashboard-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-08T20:18:12.077 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-prometheus-alerts-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-08T20:18:12.077 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-08T20:18:12.077 INFO:teuthology.orchestra.run.smithi111.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-08T20:18:12.077 INFO:teuthology.orchestra.run.smithi111.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-08T20:18:12.077 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:12.077 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:18:12.191 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-08T20:18:12.369 INFO:teuthology.orchestra.run.smithi043.stdout:cephadm-17.2.7-119.ge2143d99.el8.noarch.rpm 120 kB/s | 80 kB 00:00 2023-12-08T20:18:12.369 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:18:12.370 INFO:teuthology.orchestra.run.smithi043.stdout:Total 119 kB/s | 80 kB 00:00 2023-12-08T20:18:12.370 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-12-08T20:18:12.380 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-12-08T20:18:12.380 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-12-08T20:18:12.383 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-12-08T20:18:12.387 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-12-08T20:18:12.872 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-12-08T20:18:13.038 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:39 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:18:14.003 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/1 2023-12-08T20:18:14.188 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/1 2023-12-08T20:18:14.452 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/1 2023-12-08T20:18:14.710 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:18:14.712 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================================ 2023-12-08T20:18:14.712 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-12-08T20:18:14.712 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================================ 2023-12-08T20:18:14.712 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-12-08T20:18:14.712 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 7.4 M 2023-12-08T20:18:14.712 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2023-12-08T20:18:14.712 INFO:teuthology.orchestra.run.smithi111.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-08T20:18:14.712 INFO:teuthology.orchestra.run.smithi111.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-08T20:18:14.712 INFO:teuthology.orchestra.run.smithi111.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-08T20:18:14.712 INFO:teuthology.orchestra.run.smithi111.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-08T20:18:14.712 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-08T20:18:14.712 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-08T20:18:14.713 INFO:teuthology.orchestra.run.smithi111.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-12-08T20:18:14.713 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:14.713 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-12-08T20:18:14.713 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================================ 2023-12-08T20:18:14.713 INFO:teuthology.orchestra.run.smithi111.stdout:Install 8 Packages 2023-12-08T20:18:14.713 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:14.713 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 35 M 2023-12-08T20:18:14.714 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 210 M 2023-12-08T20:18:14.714 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-12-08T20:18:15.186 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/1 2023-12-08T20:18:15.186 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:15.186 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-12-08T20:18:15.186 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-08T20:18:15.186 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:15.186 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:18:15.342 INFO:teuthology.orchestra.run.smithi111.stdout:(1/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 20 MB/s | 4.9 MB 00:00 2023-12-08T20:18:15.409 INFO:teuthology.orchestra.run.smithi111.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2023-12-08T20:18:15.417 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-immutable-object-cache 2023-12-08T20:18:15.451 INFO:teuthology.orchestra.run.smithi111.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 5.3 MB/s | 225 kB 00:00 2023-12-08T20:18:15.543 INFO:teuthology.orchestra.run.smithi111.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 19 MB/s | 3.7 MB 00:00 2023-12-08T20:18:15.580 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] libgfortran-8.5.0-21.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/libgfortran-8.5.0-21.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:18:15.893 INFO:teuthology.orchestra.run.smithi111.stdout:(5/8): python3-scipy-1.0.0-21.module_el8.5.0+77 31 MB/s | 14 MB 00:00 2023-12-08T20:18:15.985 INFO:teuthology.orchestra.run.smithi111.stdout:(6/8): ceph-mgr-diskprediction-local-17.2.7-119 8.3 MB/s | 7.4 MB 00:00 2023-12-08T20:18:15.985 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] libquadmath-8.5.0-21.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/libquadmath-8.5.0-21.el8.x86_64.rpm [Failed to connect to mirrors.tripadvisor.com port 80: Connection reset by peer] 2023-12-08T20:18:16.085 INFO:teuthology.orchestra.run.smithi111.stdout:(7/8): libgfortran-8.5.0-21.el8.x86_64.rpm 1.2 MB/s | 645 kB 00:00 2023-12-08T20:18:16.186 INFO:teuthology.orchestra.run.smithi111.stdout:(8/8): libquadmath-8.5.0-21.el8.x86_64.rpm 591 kB/s | 172 kB 00:00 2023-12-08T20:18:16.186 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:18:16.186 INFO:teuthology.orchestra.run.smithi111.stdout:Total 24 MB/s | 35 MB 00:01 2023-12-08T20:18:16.408 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:35 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:18:16.417 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-12-08T20:18:16.435 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-12-08T20:18:16.435 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-12-08T20:18:16.825 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-12-08T20:18:16.829 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-12-08T20:18:17.398 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-12-08T20:18:17.542 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-08T20:18:17.676 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-08T20:18:17.821 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-08T20:18:18.290 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:18:18.291 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:18:18.291 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repo Size 2023-12-08T20:18:18.291 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:18:18.291 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2023-12-08T20:18:18.291 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-119.ge2143d99.el8 ceph 161 k 2023-12-08T20:18:18.291 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:18.291 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-12-08T20:18:18.291 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:18:18.292 INFO:teuthology.orchestra.run.smithi043.stdout:Install 1 Package 2023-12-08T20:18:18.292 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:18.292 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 161 k 2023-12-08T20:18:18.292 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 490 k 2023-12-08T20:18:18.292 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-12-08T20:18:18.402 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-08T20:18:18.592 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-immutable-object-cache-17.2.7-119.ge2143d9 540 kB/s | 161 kB 00:00 2023-12-08T20:18:18.592 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:18:18.592 INFO:teuthology.orchestra.run.smithi043.stdout:Total 537 kB/s | 161 kB 00:00 2023-12-08T20:18:18.593 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-12-08T20:18:18.610 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-12-08T20:18:18.610 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-12-08T20:18:18.664 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-12-08T20:18:18.667 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-12-08T20:18:18.784 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-12-08T20:18:19.025 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-119.ge2143d99.e 1/1 2023-12-08T20:18:19.108 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-08T20:18:19.498 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-119.ge2143d99.e 1/1 2023-12-08T20:18:19.739 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-08T20:18:19.892 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-08T20:18:20.246 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-119.ge2143d99.e 1/1 2023-12-08T20:18:20.246 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:20.246 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-12-08T20:18:20.246 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:18:20.246 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:20.247 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:18:20.454 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-mgr 2023-12-08T20:18:20.565 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-08T20:18:20.885 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-08T20:18:21.091 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-08T20:18:21.447 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:40 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:18:22.850 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-08T20:18:23.079 INFO:teuthology.orchestra.run.smithi043.stdout:Package ceph-mgr-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-08T20:18:23.327 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:18:23.329 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2023-12-08T20:18:23.329 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:18:23.433 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-mgr-dashboard 2023-12-08T20:18:24.047 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-12-08T20:18:24.324 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-119.ge2143d99 8/8 2023-12-08T20:18:24.419 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:43 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:18:24.647 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-119.ge2143d99 8/8 2023-12-08T20:18:24.647 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-119.ge2143d99 1/8 2023-12-08T20:18:24.647 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-08T20:18:24.647 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-08T20:18:24.647 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-08T20:18:24.647 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-08T20:18:24.647 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-12-08T20:18:24.647 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-08T20:18:25.339 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-08T20:18:25.339 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:25.339 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-12-08T20:18:25.339 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-diskprediction-local-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-08T20:18:25.339 INFO:teuthology.orchestra.run.smithi111.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-08T20:18:25.339 INFO:teuthology.orchestra.run.smithi111.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-08T20:18:25.339 INFO:teuthology.orchestra.run.smithi111.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-08T20:18:25.339 INFO:teuthology.orchestra.run.smithi111.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-08T20:18:25.339 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-08T20:18:25.340 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-08T20:18:25.340 INFO:teuthology.orchestra.run.smithi111.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-12-08T20:18:25.340 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:25.340 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:18:25.451 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-rook 2023-12-08T20:18:26.299 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:18:26.300 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:18:26.300 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2023-12-08T20:18:26.301 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:18:26.301 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2023-12-08T20:18:26.301 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 1.7 M 2023-12-08T20:18:26.301 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2023-12-08T20:18:26.301 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 23 k 2023-12-08T20:18:26.301 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 14 k 2023-12-08T20:18:26.301 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-08T20:18:26.301 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-08T20:18:26.301 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-08T20:18:26.301 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:26.301 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-12-08T20:18:26.301 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:18:26.301 INFO:teuthology.orchestra.run.smithi043.stdout:Install 6 Packages 2023-12-08T20:18:26.301 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:26.302 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:52 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:18:26.302 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 2.0 M 2023-12-08T20:18:26.302 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 8.0 M 2023-12-08T20:18:26.303 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-12-08T20:18:26.711 INFO:teuthology.orchestra.run.smithi043.stdout:(1/6): ceph-grafana-dashboards-17.2.7-119.ge214 103 kB/s | 23 kB 00:00 2023-12-08T20:18:26.737 INFO:teuthology.orchestra.run.smithi043.stdout:(2/6): ceph-prometheus-alerts-17.2.7-119.ge2143 58 kB/s | 14 kB 00:00 2023-12-08T20:18:26.774 INFO:teuthology.orchestra.run.smithi043.stdout:[MIRROR] python3-jwt-1.6.1-2.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/python3-jwt-1.6.1-2.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:18:26.962 INFO:teuthology.orchestra.run.smithi043.stdout:(3/6): ceph-mgr-dashboard-17.2.7-119.ge2143d99. 3.6 MB/s | 1.7 MB 00:00 2023-12-08T20:18:26.988 INFO:teuthology.orchestra.run.smithi043.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 155 kB/s | 43 kB 00:00 2023-12-08T20:18:27.254 INFO:teuthology.orchestra.run.smithi043.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 65 kB/s | 34 kB 00:00 2023-12-08T20:18:27.613 INFO:teuthology.orchestra.run.smithi043.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 315 kB/s | 196 kB 00:00 2023-12-08T20:18:27.617 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:18:27.617 INFO:teuthology.orchestra.run.smithi043.stdout:Total 1.5 MB/s | 2.0 MB 00:01 2023-12-08T20:18:27.633 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-12-08T20:18:27.642 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-12-08T20:18:27.642 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-12-08T20:18:27.734 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-12-08T20:18:27.738 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-12-08T20:18:27.972 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:18:27.974 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:27.974 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-12-08T20:18:27.974 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:27.974 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-12-08T20:18:27.974 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-rook noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 47 k 2023-12-08T20:18:27.974 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2023-12-08T20:18:27.974 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-08T20:18:27.974 INFO:teuthology.orchestra.run.smithi111.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-08T20:18:27.974 INFO:teuthology.orchestra.run.smithi111.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-08T20:18:27.974 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-08T20:18:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-08T20:18:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-08T20:18:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-08T20:18:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-08T20:18:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-08T20:18:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-08T20:18:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-08T20:18:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-08T20:18:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:27.975 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-12-08T20:18:27.975 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:27.975 INFO:teuthology.orchestra.run.smithi111.stdout:Install 13 Packages 2023-12-08T20:18:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:27.976 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 1.9 M 2023-12-08T20:18:27.976 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 25 M 2023-12-08T20:18:27.976 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-12-08T20:18:28.053 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-12-08T20:18:28.281 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-08T20:18:28.558 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-08T20:18:28.609 INFO:teuthology.orchestra.run.smithi111.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 458 kB/s | 27 kB 00:00 2023-12-08T20:18:28.634 INFO:teuthology.orchestra.run.smithi111.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 240 kB/s | 20 kB 00:00 2023-12-08T20:18:28.668 INFO:teuthology.orchestra.run.smithi111.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2023-12-08T20:18:28.693 INFO:teuthology.orchestra.run.smithi111.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.8 MB/s | 110 kB 00:00 2023-12-08T20:18:28.729 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] python3-oauthlib-2.1.0-1.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/python3-oauthlib-2.1.0-1.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:18:28.730 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] python3-requests-oauthlib-1.0.0-1.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/python3-requests-oauthlib-1.0.0-1.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:18:28.794 INFO:teuthology.orchestra.run.smithi111.stdout:(5/13): ceph-mgr-rook-17.2.7-119.ge2143d99.el8. 195 kB/s | 47 kB 00:00 2023-12-08T20:18:28.810 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-08T20:18:28.869 INFO:teuthology.orchestra.run.smithi111.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 243 kB/s | 43 kB 00:00 2023-12-08T20:18:28.919 INFO:teuthology.orchestra.run.smithi111.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 263 kB/s | 33 kB 00:00 2023-12-08T20:18:28.944 INFO:teuthology.orchestra.run.smithi111.stdout:(8/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 561 kB/s | 155 kB 00:00 2023-12-08T20:18:28.978 INFO:teuthology.orchestra.run.smithi111.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 149 kB/s | 16 kB 00:00 2023-12-08T20:18:29.020 INFO:teuthology.orchestra.run.smithi111.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 809 kB/s | 81 kB 00:00 2023-12-08T20:18:29.054 INFO:teuthology.orchestra.run.smithi111.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 858 kB/s | 64 kB 00:00 2023-12-08T20:18:29.112 INFO:teuthology.orchestra.run.smithi111.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 666 kB/s | 61 kB 00:00 2023-12-08T20:18:29.156 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-119.ge2143d99.el8.no 4/6 2023-12-08T20:18:29.179 INFO:teuthology.orchestra.run.smithi111.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 5.8 MB/s | 1.2 MB 00:00 2023-12-08T20:18:29.180 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:18:29.180 INFO:teuthology.orchestra.run.smithi111.stdout:Total 1.6 MB/s | 1.9 MB 00:01 2023-12-08T20:18:29.239 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-12-08T20:18:29.257 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-12-08T20:18:29.257 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-12-08T20:18:29.342 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-12-08T20:18:29.345 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-12-08T20:18:29.591 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-119.ge2143d99.el8.n 5/6 2023-12-08T20:18:29.830 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-119.ge2143d99.el8.noarch 6/6 2023-12-08T20:18:29.949 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-12-08T20:18:30.154 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-119.ge2143d99.el8.noarch 6/6 2023-12-08T20:18:30.155 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-119.ge2143d99.el8.n 1/6 2023-12-08T20:18:30.155 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-119.ge2143d99.el8.noarch 2/6 2023-12-08T20:18:30.155 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-119.ge2143d99.el8.no 3/6 2023-12-08T20:18:30.155 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-08T20:18:30.155 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-08T20:18:30.159 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-08T20:18:30.332 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-08T20:18:30.567 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-08T20:18:30.771 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-08T20:18:30.948 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-08T20:18:30.948 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:30.948 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-12-08T20:18:30.948 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-08T20:18:30.948 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-08T20:18:30.948 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-08T20:18:30.948 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-08T20:18:30.948 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-08T20:18:30.948 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-08T20:18:30.948 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:30.948 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:18:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-08T20:18:31.094 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-08T20:18:31.192 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-08T20:18:31.466 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-08T20:18:31.760 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-08T20:18:32.077 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:51 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:18:32.772 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-08T20:18:33.029 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-08T20:18:33.230 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-08T20:18:33.415 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-08T20:18:33.565 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-rook-2:17.2.7-119.ge2143d99.el8.noarch 13/13 2023-12-08T20:18:33.865 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-119.ge2143d99.el8.noarch 13/13 2023-12-08T20:18:33.865 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-rook-2:17.2.7-119.ge2143d99.el8.noarch 1/13 2023-12-08T20:18:33.865 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-08T20:18:33.865 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-08T20:18:33.865 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-08T20:18:33.866 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-08T20:18:33.866 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-08T20:18:33.866 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-08T20:18:33.866 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-08T20:18:33.866 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-08T20:18:33.866 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-08T20:18:33.866 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-08T20:18:33.866 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-08T20:18:33.967 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:18:33.968 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================================ 2023-12-08T20:18:33.968 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2023-12-08T20:18:33.969 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================================ 2023-12-08T20:18:33.969 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2023-12-08T20:18:33.969 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 7.4 M 2023-12-08T20:18:33.969 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2023-12-08T20:18:33.969 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-08T20:18:33.969 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-08T20:18:33.969 INFO:teuthology.orchestra.run.smithi043.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-08T20:18:33.969 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-08T20:18:33.969 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-08T20:18:33.969 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-08T20:18:33.969 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-12-08T20:18:33.969 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:33.969 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-12-08T20:18:33.969 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================================ 2023-12-08T20:18:33.969 INFO:teuthology.orchestra.run.smithi043.stdout:Install 8 Packages 2023-12-08T20:18:33.970 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:33.970 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 35 M 2023-12-08T20:18:33.970 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 210 M 2023-12-08T20:18:33.970 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-12-08T20:18:34.609 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-08T20:18:34.609 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:34.610 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-12-08T20:18:34.610 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-rook-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-08T20:18:34.610 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-08T20:18:34.610 INFO:teuthology.orchestra.run.smithi111.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-08T20:18:34.610 INFO:teuthology.orchestra.run.smithi111.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-08T20:18:34.610 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-08T20:18:34.610 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-08T20:18:34.610 INFO:teuthology.orchestra.run.smithi111.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-08T20:18:34.610 INFO:teuthology.orchestra.run.smithi111.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-08T20:18:34.610 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-08T20:18:34.610 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-08T20:18:34.610 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-08T20:18:34.610 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-08T20:18:34.610 INFO:teuthology.orchestra.run.smithi111.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-08T20:18:34.611 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:34.611 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:18:34.719 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-cephadm 2023-12-08T20:18:34.922 INFO:teuthology.orchestra.run.smithi043.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 6.7 MB/s | 4.7 MB 00:00 2023-12-08T20:18:35.268 INFO:teuthology.orchestra.run.smithi043.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 4.6 MB/s | 4.9 MB 00:01 2023-12-08T20:18:35.531 INFO:teuthology.orchestra.run.smithi043.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 857 kB/s | 225 kB 00:00 2023-12-08T20:18:35.566 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:02:01 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:18:35.599 INFO:teuthology.orchestra.run.smithi043.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 5.5 MB/s | 3.7 MB 00:00 2023-12-08T20:18:35.635 INFO:teuthology.orchestra.run.smithi043.stdout:[MIRROR] libgfortran-8.5.0-21.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/libgfortran-8.5.0-21.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:18:35.944 INFO:teuthology.orchestra.run.smithi043.stdout:(5/8): libgfortran-8.5.0-21.el8.x86_64.rpm 1.8 MB/s | 645 kB 00:00 2023-12-08T20:18:35.980 INFO:teuthology.orchestra.run.smithi043.stdout:[MIRROR] libquadmath-8.5.0-21.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/libquadmath-8.5.0-21.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:18:36.048 INFO:teuthology.orchestra.run.smithi043.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 1.6 MB/s | 172 kB 00:00 2023-12-08T20:18:36.182 INFO:teuthology.orchestra.run.smithi043.stdout:(7/8): ceph-mgr-diskprediction-local-17.2.7-119 3.8 MB/s | 7.4 MB 00:01 2023-12-08T20:18:36.333 INFO:teuthology.orchestra.run.smithi043.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 17 MB/s | 14 MB 00:00 2023-12-08T20:18:36.333 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:18:36.333 INFO:teuthology.orchestra.run.smithi043.stdout:Total 15 MB/s | 35 MB 00:02 2023-12-08T20:18:36.585 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-12-08T20:18:36.605 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-12-08T20:18:36.605 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-12-08T20:18:37.041 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-12-08T20:18:37.044 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-12-08T20:18:37.229 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:18:37.230 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:37.230 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-12-08T20:18:37.230 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:37.230 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-12-08T20:18:37.230 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-cephadm noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 121 k 2023-12-08T20:18:37.230 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2023-12-08T20:18:37.230 INFO:teuthology.orchestra.run.smithi111.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-08T20:18:37.230 INFO:teuthology.orchestra.run.smithi111.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-08T20:18:37.231 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-08T20:18:37.231 INFO:teuthology.orchestra.run.smithi111.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-08T20:18:37.231 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:37.231 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-12-08T20:18:37.231 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:37.231 INFO:teuthology.orchestra.run.smithi111.stdout:Install 5 Packages 2023-12-08T20:18:37.231 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:37.231 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 6.0 M 2023-12-08T20:18:37.232 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 26 M 2023-12-08T20:18:37.232 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-12-08T20:18:37.622 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-12-08T20:18:37.711 INFO:teuthology.orchestra.run.smithi111.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 4.5 MB/s | 538 kB 00:00 2023-12-08T20:18:37.746 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-08T20:18:37.770 INFO:teuthology.orchestra.run.smithi111.stdout:(2/5): ceph-mgr-cephadm-17.2.7-119.ge2143d99.el 691 kB/s | 121 kB 00:00 2023-12-08T20:18:37.828 INFO:teuthology.orchestra.run.smithi111.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-12-08T20:18:37.904 INFO:teuthology.orchestra.run.smithi111.stdout:(4/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 2.4 MB/s | 476 kB 00:00 2023-12-08T20:18:37.916 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-08T20:18:37.929 INFO:teuthology.orchestra.run.smithi111.stdout:(5/5): python3-natsort-7.1.1-2.el8.noarch.rpm 380 kB/s | 60 kB 00:00 2023-12-08T20:18:37.929 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:18:37.930 INFO:teuthology.orchestra.run.smithi111.stdout:Total 8.5 MB/s | 6.0 MB 00:00 2023-12-08T20:18:37.981 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-12-08T20:18:37.992 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-12-08T20:18:37.993 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-12-08T20:18:38.091 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-12-08T20:18:38.092 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-08T20:18:38.094 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-12-08T20:18:38.383 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-12-08T20:18:38.694 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-08T20:18:38.752 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-08T20:18:38.913 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-08T20:18:39.601 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-08T20:18:39.656 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-08T20:18:39.771 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-08T20:18:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-08T20:18:40.274 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-08T20:18:40.430 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-119.ge2143d99.el8.noarch 5/5 2023-12-08T20:18:40.539 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-08T20:18:40.714 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-119.ge2143d99.el8.noarch 5/5 2023-12-08T20:18:40.714 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/5 2023-12-08T20:18:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-08T20:18:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-08T20:18:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-08T20:18:41.120 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-08T20:18:41.354 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-08T20:18:41.427 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-08T20:18:41.427 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:41.427 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-12-08T20:18:41.427 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-cephadm-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-08T20:18:41.427 INFO:teuthology.orchestra.run.smithi111.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-08T20:18:41.427 INFO:teuthology.orchestra.run.smithi111.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-08T20:18:41.427 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-08T20:18:41.428 INFO:teuthology.orchestra.run.smithi111.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-08T20:18:41.428 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:41.428 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:18:41.567 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-fuse 2023-12-08T20:18:42.420 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:02:08 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:18:43.337 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-08T20:18:44.083 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:18:44.083 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2023-12-08T20:18:44.084 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:44.084 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-12-08T20:18:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-fuse x86_64 2:17.2.7-119.ge2143d99.el8 ceph 875 k 2023-12-08T20:18:44.084 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2023-12-08T20:18:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-08T20:18:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:44.084 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-12-08T20:18:44.084 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:44.084 INFO:teuthology.orchestra.run.smithi111.stdout:Install 2 Packages 2023-12-08T20:18:44.084 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:44.085 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 958 k 2023-12-08T20:18:44.085 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 3.0 M 2023-12-08T20:18:44.085 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-12-08T20:18:44.175 INFO:teuthology.orchestra.run.smithi111.stdout:[MIRROR] fuse-2.9.7-17.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/fuse-2.9.7-17.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:18:44.355 INFO:teuthology.orchestra.run.smithi111.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 382 kB/s | 83 kB 00:00 2023-12-08T20:18:44.572 INFO:teuthology.orchestra.run.smithi111.stdout:(2/2): ceph-fuse-17.2.7-119.ge2143d99.el8.x86_6 2.0 MB/s | 875 kB 00:00 2023-12-08T20:18:44.573 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:18:44.573 INFO:teuthology.orchestra.run.smithi111.stdout:Total 1.9 MB/s | 958 kB 00:00 2023-12-08T20:18:44.584 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-12-08T20:18:44.605 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-12-08T20:18:44.605 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-12-08T20:18:44.691 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-12-08T20:18:44.694 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-12-08T20:18:44.696 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-12-08T20:18:44.937 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-119.ge2143d99 8/8 2023-12-08T20:18:44.978 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-12-08T20:18:45.271 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-08T20:18:45.300 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-119.ge2143d99 8/8 2023-12-08T20:18:45.300 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-119.ge2143d99 1/8 2023-12-08T20:18:45.300 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-08T20:18:45.300 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-08T20:18:45.301 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-08T20:18:45.301 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-08T20:18:45.301 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-12-08T20:18:45.301 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-08T20:18:45.462 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 2/2 2023-12-08T20:18:45.855 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 2/2 2023-12-08T20:18:45.855 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 1/2 2023-12-08T20:18:46.092 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-08T20:18:46.092 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:46.092 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-12-08T20:18:46.092 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-08T20:18:46.092 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-08T20:18:46.092 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-08T20:18:46.092 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-08T20:18:46.092 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-08T20:18:46.092 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-08T20:18:46.092 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-08T20:18:46.092 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-12-08T20:18:46.092 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:46.092 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:18:46.218 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-mgr-rook 2023-12-08T20:18:46.561 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-08T20:18:46.561 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:46.561 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-12-08T20:18:46.561 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-08T20:18:46.561 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:46.561 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:18:46.789 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install librados-devel 2023-12-08T20:18:47.212 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:02:06 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:18:47.644 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:02:13 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:18:49.088 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:18:49.090 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:18:49.090 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2023-12-08T20:18:49.090 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:18:49.090 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2023-12-08T20:18:49.090 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 47 k 2023-12-08T20:18:49.090 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2023-12-08T20:18:49.090 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-08T20:18:49.090 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-08T20:18:49.090 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-08T20:18:49.090 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-08T20:18:49.090 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-08T20:18:49.091 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-08T20:18:49.091 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-08T20:18:49.091 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-08T20:18:49.091 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-08T20:18:49.091 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-08T20:18:49.091 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-08T20:18:49.091 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-08T20:18:49.091 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:49.091 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-12-08T20:18:49.091 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:18:49.091 INFO:teuthology.orchestra.run.smithi043.stdout:Install 13 Packages 2023-12-08T20:18:49.091 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:49.092 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 1.9 M 2023-12-08T20:18:49.092 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 25 M 2023-12-08T20:18:49.092 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-12-08T20:18:49.332 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:18:49.333 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:49.333 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repo Size 2023-12-08T20:18:49.333 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:49.333 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-12-08T20:18:49.333 INFO:teuthology.orchestra.run.smithi111.stdout: librados-devel x86_64 2:17.2.7-119.ge2143d99.el8 ceph 130 k 2023-12-08T20:18:49.333 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:49.333 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-12-08T20:18:49.333 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:49.334 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2023-12-08T20:18:49.334 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:49.334 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 130 k 2023-12-08T20:18:49.334 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 464 k 2023-12-08T20:18:49.334 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-12-08T20:18:49.644 INFO:teuthology.orchestra.run.smithi111.stdout:librados-devel-17.2.7-119.ge2143d99.el8.x86_64. 420 kB/s | 130 kB 00:00 2023-12-08T20:18:49.644 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:18:49.645 INFO:teuthology.orchestra.run.smithi111.stdout:Total 418 kB/s | 130 kB 00:00 2023-12-08T20:18:49.645 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-12-08T20:18:49.650 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-12-08T20:18:49.650 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-12-08T20:18:49.699 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-12-08T20:18:49.702 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-12-08T20:18:49.788 INFO:teuthology.orchestra.run.smithi043.stdout:(1/13): python3-jsonpointer-1.10-11.el8.noarch. 336 kB/s | 20 kB 00:00 2023-12-08T20:18:49.812 INFO:teuthology.orchestra.run.smithi043.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 313 kB/s | 27 kB 00:00 2023-12-08T20:18:49.836 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-12-08T20:18:49.846 INFO:teuthology.orchestra.run.smithi043.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2023-12-08T20:18:49.871 INFO:teuthology.orchestra.run.smithi043.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.8 MB/s | 110 kB 00:00 2023-12-08T20:18:49.897 INFO:teuthology.orchestra.run.smithi043.stdout:(5/13): ceph-mgr-rook-17.2.7-119.ge2143d99.el8. 279 kB/s | 47 kB 00:00 2023-12-08T20:18:49.915 INFO:teuthology.orchestra.run.smithi043.stdout:[MIRROR] python3-oauthlib-2.1.0-1.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/python3-oauthlib-2.1.0-1.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:18:49.915 INFO:teuthology.orchestra.run.smithi043.stdout:[MIRROR] python3-requests-oauthlib-1.0.0-1.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.tripadvisor.com/centos/8-stream/BaseOS/x86_64/os/Packages/python3-requests-oauthlib-1.0.0-1.el8.noarch.rpm [Recv failure: Connection reset by peer] 2023-12-08T20:18:50.064 INFO:teuthology.orchestra.run.smithi043.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 222 kB/s | 43 kB 00:00 2023-12-08T20:18:50.089 INFO:teuthology.orchestra.run.smithi043.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 172 kB/s | 33 kB 00:00 2023-12-08T20:18:50.123 INFO:teuthology.orchestra.run.smithi043.stdout:(8/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 561 kB/s | 155 kB 00:00 2023-12-08T20:18:50.181 INFO:teuthology.orchestra.run.smithi043.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 885 kB/s | 81 kB 00:00 2023-12-08T20:18:50.240 INFO:teuthology.orchestra.run.smithi043.stdout:(10/13): python3-rsa-4.9-2.el8.noarch.rpm 1.2 MB/s | 64 kB 00:00 2023-12-08T20:18:50.273 INFO:teuthology.orchestra.run.smithi043.stdout:(11/13): python3-certifi-2018.10.15-7.el8.noarc 78 kB/s | 16 kB 00:00 2023-12-08T20:18:50.299 INFO:teuthology.orchestra.run.smithi043.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 1.0 MB/s | 61 kB 00:00 2023-12-08T20:18:50.557 INFO:teuthology.orchestra.run.smithi043.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 2.7 MB/s | 1.2 MB 00:00 2023-12-08T20:18:50.560 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:18:50.560 INFO:teuthology.orchestra.run.smithi043.stdout:Total 1.3 MB/s | 1.9 MB 00:01 2023-12-08T20:18:50.622 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-12-08T20:18:50.639 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-12-08T20:18:50.640 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-12-08T20:18:50.739 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-12-08T20:18:50.743 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-12-08T20:18:51.367 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-12-08T20:18:51.370 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librados-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:18:51.606 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-08T20:18:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:18:51.810 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-08T20:18:52.043 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-08T20:18:52.295 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-08T20:18:52.343 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:18:52.343 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:52.343 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-12-08T20:18:52.343 INFO:teuthology.orchestra.run.smithi111.stdout: librados-devel-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:18:52.343 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:52.343 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:18:52.503 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-08T20:18:52.612 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install libcephfs2 2023-12-08T20:18:52.814 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-08T20:18:53.118 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-08T20:18:53.395 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-08T20:18:53.478 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:02:19 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:18:54.561 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-08T20:18:54.836 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-08T20:18:54.933 INFO:teuthology.orchestra.run.smithi111.stdout:Package libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-08T20:18:55.036 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-08T20:18:55.158 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:18:55.159 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2023-12-08T20:18:55.159 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:18:55.257 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install libcephfs-devel 2023-12-08T20:18:55.281 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-08T20:18:55.435 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-rook-2:17.2.7-119.ge2143d99.el8.noarch 13/13 2023-12-08T20:18:55.808 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-119.ge2143d99.el8.noarch 13/13 2023-12-08T20:18:55.808 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-rook-2:17.2.7-119.ge2143d99.el8.noarch 1/13 2023-12-08T20:18:55.808 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-08T20:18:55.808 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-08T20:18:55.808 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-08T20:18:55.808 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-08T20:18:55.808 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-08T20:18:55.808 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-08T20:18:55.808 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-08T20:18:55.808 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-08T20:18:55.808 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-08T20:18:55.809 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-08T20:18:55.809 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-08T20:18:56.100 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:02:22 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:18:56.649 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-08T20:18:56.649 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:56.649 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-12-08T20:18:56.649 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-08T20:18:56.649 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-08T20:18:56.649 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-08T20:18:56.649 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-08T20:18:56.649 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-08T20:18:56.650 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-08T20:18:56.650 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-08T20:18:56.650 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-08T20:18:56.650 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-08T20:18:56.650 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-08T20:18:56.650 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-08T20:18:56.650 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-08T20:18:56.650 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-08T20:18:56.650 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:56.650 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:18:56.782 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-mgr-cephadm 2023-12-08T20:18:57.761 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:02:16 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:18:57.773 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:18:57.773 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:57.774 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repo Size 2023-12-08T20:18:57.774 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:57.774 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-12-08T20:18:57.774 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-devel x86_64 2:17.2.7-119.ge2143d99.el8 ceph 25 k 2023-12-08T20:18:57.774 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:57.774 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-12-08T20:18:57.774 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:18:57.774 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2023-12-08T20:18:57.774 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:57.775 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 25 k 2023-12-08T20:18:57.775 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 109 k 2023-12-08T20:18:57.775 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-12-08T20:18:58.009 INFO:teuthology.orchestra.run.smithi111.stdout:libcephfs-devel-17.2.7-119.ge2143d99.el8.x86_64 106 kB/s | 25 kB 00:00 2023-12-08T20:18:58.009 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:18:58.009 INFO:teuthology.orchestra.run.smithi111.stdout:Total 106 kB/s | 25 kB 00:00 2023-12-08T20:18:58.010 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-12-08T20:18:58.014 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-12-08T20:18:58.014 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-12-08T20:18:58.015 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-12-08T20:18:58.018 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-12-08T20:18:58.069 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-12-08T20:18:58.276 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephfs-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:18:58.538 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:18:59.165 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephfs-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:18:59.165 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:59.165 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-12-08T20:18:59.165 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-devel-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:18:59.165 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:18:59.165 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:18:59.274 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install librados2 2023-12-08T20:18:59.644 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:18:59.645 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:18:59.645 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2023-12-08T20:18:59.645 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:18:59.645 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2023-12-08T20:18:59.645 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm noarch 2:17.2.7-119.ge2143d99.el8 ceph-noarch 121 k 2023-12-08T20:18:59.645 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2023-12-08T20:18:59.645 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-08T20:18:59.645 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-08T20:18:59.645 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-08T20:18:59.646 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-08T20:18:59.646 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:59.646 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-12-08T20:18:59.646 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:18:59.646 INFO:teuthology.orchestra.run.smithi043.stdout:Install 5 Packages 2023-12-08T20:18:59.646 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:18:59.646 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 6.0 M 2023-12-08T20:18:59.647 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 26 M 2023-12-08T20:18:59.647 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-12-08T20:18:59.940 INFO:teuthology.orchestra.run.smithi043.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 2.4 MB/s | 538 kB 00:00 2023-12-08T20:18:59.965 INFO:teuthology.orchestra.run.smithi043.stdout:(2/5): ceph-mgr-cephadm-17.2.7-119.ge2143d99.el 493 kB/s | 121 kB 00:00 2023-12-08T20:19:00.099 INFO:teuthology.orchestra.run.smithi043.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2023-12-08T20:19:00.134 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:02:26 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:19:00.207 INFO:teuthology.orchestra.run.smithi043.stdout:(4/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.7 MB/s | 476 kB 00:00 2023-12-08T20:19:00.266 INFO:teuthology.orchestra.run.smithi043.stdout:(5/5): python3-natsort-7.1.1-2.el8.noarch.rpm 204 kB/s | 60 kB 00:00 2023-12-08T20:19:00.268 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:19:00.269 INFO:teuthology.orchestra.run.smithi043.stdout:Total 9.6 MB/s | 6.0 MB 00:00 2023-12-08T20:19:00.326 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-12-08T20:19:00.339 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-12-08T20:19:00.339 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-12-08T20:19:00.463 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-12-08T20:19:00.466 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-12-08T20:19:00.896 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-12-08T20:19:01.267 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-08T20:19:01.602 INFO:teuthology.orchestra.run.smithi111.stdout:Package librados2-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-08T20:19:01.827 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:19:01.828 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2023-12-08T20:19:01.828 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:19:01.923 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install librbd1 2023-12-08T20:19:02.311 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-08T20:19:02.773 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-08T20:19:02.776 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:02:28 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:19:03.092 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-08T20:19:03.284 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-119.ge2143d99.el8.noarch 5/5 2023-12-08T20:19:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-119.ge2143d99.el8.noarch 5/5 2023-12-08T20:19:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-119.ge2143d99.el8.noarch 1/5 2023-12-08T20:19:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-08T20:19:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-08T20:19:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-08T20:19:04.228 INFO:teuthology.orchestra.run.smithi111.stdout:Package librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-08T20:19:04.396 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-08T20:19:04.396 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:04.396 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-12-08T20:19:04.396 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm-2:17.2.7-119.ge2143d99.el8.noarch 2023-12-08T20:19:04.396 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-08T20:19:04.396 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-08T20:19:04.397 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-08T20:19:04.397 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-08T20:19:04.397 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:04.397 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:19:04.450 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:19:04.451 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2023-12-08T20:19:04.451 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:19:04.532 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-fuse 2023-12-08T20:19:04.546 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-rados 2023-12-08T20:19:05.412 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:02:31 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:19:05.513 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:02:24 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:19:06.866 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-rados-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-08T20:19:07.090 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:19:07.091 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2023-12-08T20:19:07.091 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:19:07.188 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-rgw 2023-12-08T20:19:07.378 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:19:07.379 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:19:07.379 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2023-12-08T20:19:07.379 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:19:07.379 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2023-12-08T20:19:07.379 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse x86_64 2:17.2.7-119.ge2143d99.el8 ceph 875 k 2023-12-08T20:19:07.379 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2023-12-08T20:19:07.380 INFO:teuthology.orchestra.run.smithi043.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-08T20:19:07.380 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:07.380 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-12-08T20:19:07.380 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:19:07.380 INFO:teuthology.orchestra.run.smithi043.stdout:Install 2 Packages 2023-12-08T20:19:07.380 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:07.380 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 958 k 2023-12-08T20:19:07.380 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 3.0 M 2023-12-08T20:19:07.381 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-12-08T20:19:07.758 INFO:teuthology.orchestra.run.smithi043.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 445 kB/s | 83 kB 00:00 2023-12-08T20:19:07.849 INFO:teuthology.orchestra.run.smithi043.stdout:(2/2): ceph-fuse-17.2.7-119.ge2143d99.el8.x86_6 3.1 MB/s | 875 kB 00:00 2023-12-08T20:19:07.850 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:19:07.851 INFO:teuthology.orchestra.run.smithi043.stdout:Total 2.0 MB/s | 958 kB 00:00 2023-12-08T20:19:07.863 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-12-08T20:19:07.887 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-12-08T20:19:07.887 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-12-08T20:19:07.989 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-12-08T20:19:07.992 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-12-08T20:19:08.037 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:02:34 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:19:08.178 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-12-08T20:19:08.502 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-08T20:19:08.734 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 2/2 2023-12-08T20:19:09.167 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 2/2 2023-12-08T20:19:09.167 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 1/2 2023-12-08T20:19:09.498 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-rgw-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-08T20:19:09.727 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:19:09.728 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2023-12-08T20:19:09.728 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:19:09.869 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-cephfs 2023-12-08T20:19:09.981 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-08T20:19:09.981 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:09.981 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-12-08T20:19:09.981 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-08T20:19:09.981 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:09.981 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:19:10.185 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install librados-devel 2023-12-08T20:19:10.727 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:02:36 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:19:11.181 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:02:30 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:19:12.190 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-cephfs-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-08T20:19:12.412 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:19:12.413 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2023-12-08T20:19:12.414 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:19:12.513 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-rbd 2023-12-08T20:19:13.042 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:19:13.043 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:19:13.043 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repo Size 2023-12-08T20:19:13.043 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:19:13.043 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2023-12-08T20:19:13.043 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel x86_64 2:17.2.7-119.ge2143d99.el8 ceph 130 k 2023-12-08T20:19:13.043 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:13.044 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-12-08T20:19:13.044 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:19:13.044 INFO:teuthology.orchestra.run.smithi043.stdout:Install 1 Package 2023-12-08T20:19:13.044 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:13.044 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 130 k 2023-12-08T20:19:13.044 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 464 k 2023-12-08T20:19:13.044 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-12-08T20:19:13.354 INFO:teuthology.orchestra.run.smithi043.stdout:librados-devel-17.2.7-119.ge2143d99.el8.x86_64. 418 kB/s | 130 kB 00:00 2023-12-08T20:19:13.355 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:19:13.355 INFO:teuthology.orchestra.run.smithi043.stdout:Total 416 kB/s | 130 kB 00:00 2023-12-08T20:19:13.356 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-12-08T20:19:13.363 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-12-08T20:19:13.363 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-12-08T20:19:13.366 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:02:39 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:19:13.423 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-12-08T20:19:13.427 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-12-08T20:19:13.547 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-12-08T20:19:13.858 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librados-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:14.171 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:14.809 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-rbd-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-08T20:19:14.889 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:14.889 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:14.889 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-12-08T20:19:14.889 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:19:14.890 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:14.890 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:19:15.035 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:19:15.036 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2023-12-08T20:19:15.036 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:19:15.112 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install libcephfs2 2023-12-08T20:19:15.147 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install rbd-fuse 2023-12-08T20:19:16.000 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:02:42 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:19:16.113 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:02:35 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:19:17.673 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:19:17.674 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:19:17.674 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2023-12-08T20:19:17.674 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:19:17.674 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-12-08T20:19:17.674 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-fuse x86_64 2:17.2.7-119.ge2143d99.el8 ceph 90 k 2023-12-08T20:19:17.674 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:19:17.674 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-12-08T20:19:17.674 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:19:17.674 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2023-12-08T20:19:17.674 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:19:17.674 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 90 k 2023-12-08T20:19:17.674 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 264 k 2023-12-08T20:19:17.674 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-12-08T20:19:17.741 INFO:teuthology.orchestra.run.smithi043.stdout:Package libcephfs2-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-08T20:19:17.990 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:19:17.991 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2023-12-08T20:19:17.991 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:19:18.006 INFO:teuthology.orchestra.run.smithi111.stdout:rbd-fuse-17.2.7-119.ge2143d99.el8.x86_64.rpm 273 kB/s | 90 kB 00:00 2023-12-08T20:19:18.007 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:19:18.007 INFO:teuthology.orchestra.run.smithi111.stdout:Total 272 kB/s | 90 kB 00:00 2023-12-08T20:19:18.007 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-12-08T20:19:18.016 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-12-08T20:19:18.017 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-12-08T20:19:18.066 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-12-08T20:19:18.069 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-12-08T20:19:18.194 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-12-08T20:19:18.360 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install libcephfs-devel 2023-12-08T20:19:18.406 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:18.695 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:19.348 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:19.348 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:19:19.348 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-12-08T20:19:19.348 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:19:19.348 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:19:19.349 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:19:19.349 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:02:38 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:19:19.597 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install rbd-mirror 2023-12-08T20:19:20.463 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:02:46 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:19:21.211 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:19:21.212 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:19:21.212 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repo Size 2023-12-08T20:19:21.212 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:19:21.212 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2023-12-08T20:19:21.212 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel x86_64 2:17.2.7-119.ge2143d99.el8 ceph 25 k 2023-12-08T20:19:21.212 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:21.213 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-12-08T20:19:21.213 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:19:21.213 INFO:teuthology.orchestra.run.smithi043.stdout:Install 1 Package 2023-12-08T20:19:21.213 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:21.213 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 25 k 2023-12-08T20:19:21.213 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 109 k 2023-12-08T20:19:21.213 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-12-08T20:19:21.351 INFO:teuthology.orchestra.run.smithi043.stdout:libcephfs-devel-17.2.7-119.ge2143d99.el8.x86_64 180 kB/s | 25 kB 00:00 2023-12-08T20:19:21.352 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:19:21.352 INFO:teuthology.orchestra.run.smithi043.stdout:Total 178 kB/s | 25 kB 00:00 2023-12-08T20:19:21.353 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-12-08T20:19:21.357 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-12-08T20:19:21.357 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-12-08T20:19:21.359 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-12-08T20:19:21.363 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-12-08T20:19:21.414 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-12-08T20:19:21.639 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:21.941 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:22.142 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:19:22.143 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:19:22.143 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repo Size 2023-12-08T20:19:22.143 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:19:22.143 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-12-08T20:19:22.143 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-mirror x86_64 2:17.2.7-119.ge2143d99.el8 ceph 3.5 M 2023-12-08T20:19:22.143 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:19:22.143 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-12-08T20:19:22.144 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:19:22.144 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2023-12-08T20:19:22.144 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:19:22.144 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 3.5 M 2023-12-08T20:19:22.144 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 16 M 2023-12-08T20:19:22.144 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-12-08T20:19:22.653 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs-devel-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:22.653 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:22.653 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-12-08T20:19:22.653 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:19:22.653 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:22.653 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:19:22.777 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install librados2 2023-12-08T20:19:23.176 INFO:teuthology.orchestra.run.smithi111.stdout:rbd-mirror-17.2.7-119.ge2143d99.el8.x86_64.rpm 3.3 MB/s | 3.5 MB 00:01 2023-12-08T20:19:23.176 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:19:23.177 INFO:teuthology.orchestra.run.smithi111.stdout:Total 3.3 MB/s | 3.5 MB 00:01 2023-12-08T20:19:23.177 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-12-08T20:19:23.189 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-12-08T20:19:23.189 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-12-08T20:19:23.254 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-12-08T20:19:23.257 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-12-08T20:19:23.692 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-12-08T20:19:23.768 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:02:42 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:19:23.932 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-mirror-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:24.340 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-mirror-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:25.084 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-mirror-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:25.084 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:19:25.084 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-12-08T20:19:25.084 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-mirror-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:19:25.084 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:19:25.084 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:19:25.320 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install rbd-nbd 2023-12-08T20:19:25.395 INFO:teuthology.orchestra.run.smithi043.stdout:Package librados2-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-08T20:19:25.640 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:19:25.642 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2023-12-08T20:19:25.642 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:19:25.729 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install librbd1 2023-12-08T20:19:26.179 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:02:52 ago on Fri 08 Dec 2023 08:16:34 PM UTC. 2023-12-08T20:19:26.724 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:02:45 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:19:27.852 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2023-12-08T20:19:27.852 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:19:27.852 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2023-12-08T20:19:27.852 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:19:27.852 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2023-12-08T20:19:27.853 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-nbd x86_64 2:17.2.7-119.ge2143d99.el8 ceph 173 k 2023-12-08T20:19:27.853 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:19:27.853 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2023-12-08T20:19:27.853 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2023-12-08T20:19:27.853 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2023-12-08T20:19:27.853 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:19:27.853 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 173 k 2023-12-08T20:19:27.853 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 552 k 2023-12-08T20:19:27.854 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2023-12-08T20:19:28.054 INFO:teuthology.orchestra.run.smithi111.stdout:rbd-nbd-17.2.7-119.ge2143d99.el8.x86_64.rpm 865 kB/s | 173 kB 00:00 2023-12-08T20:19:28.054 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:19:28.054 INFO:teuthology.orchestra.run.smithi111.stdout:Total 860 kB/s | 173 kB 00:00 2023-12-08T20:19:28.054 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2023-12-08T20:19:28.065 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2023-12-08T20:19:28.065 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2023-12-08T20:19:28.115 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2023-12-08T20:19:28.118 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2023-12-08T20:19:28.235 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2023-12-08T20:19:28.339 INFO:teuthology.orchestra.run.smithi043.stdout:Package librbd1-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-08T20:19:28.446 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-nbd-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:28.586 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:19:28.588 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2023-12-08T20:19:28.588 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:19:28.695 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install python3-rados 2023-12-08T20:19:28.730 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-nbd-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:29.402 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-nbd-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:29.402 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:19:29.402 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2023-12-08T20:19:29.403 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-nbd-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:19:29.403 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:19:29.403 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2023-12-08T20:19:29.608 DEBUG:teuthology.parallel:result is None 2023-12-08T20:19:29.697 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:02:48 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:19:31.354 INFO:teuthology.orchestra.run.smithi043.stdout:Package python3-rados-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-08T20:19:31.608 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:19:31.610 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2023-12-08T20:19:31.610 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:19:31.717 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install python3-rgw 2023-12-08T20:19:32.702 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:02:51 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:19:34.325 INFO:teuthology.orchestra.run.smithi043.stdout:Package python3-rgw-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-08T20:19:34.582 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:19:34.584 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2023-12-08T20:19:34.584 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:19:34.692 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install python3-cephfs 2023-12-08T20:19:35.681 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:02:54 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:19:37.292 INFO:teuthology.orchestra.run.smithi043.stdout:Package python3-cephfs-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-08T20:19:37.544 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:19:37.545 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2023-12-08T20:19:37.545 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:19:37.641 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install python3-rbd 2023-12-08T20:19:38.635 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:02:57 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:19:40.247 INFO:teuthology.orchestra.run.smithi043.stdout:Package python3-rbd-2:17.2.7-119.ge2143d99.el8.x86_64 is already installed. 2023-12-08T20:19:40.496 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:19:40.497 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2023-12-08T20:19:40.497 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:19:40.592 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install rbd-fuse 2023-12-08T20:19:41.591 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:03:00 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:19:43.476 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:19:43.477 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:19:43.477 INFO:teuthology.orchestra.run.smithi043.stdout: Package Architecture Version Repository Size 2023-12-08T20:19:43.477 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:19:43.477 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2023-12-08T20:19:43.477 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse x86_64 2:17.2.7-119.ge2143d99.el8 ceph 90 k 2023-12-08T20:19:43.477 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:43.477 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-12-08T20:19:43.477 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:19:43.478 INFO:teuthology.orchestra.run.smithi043.stdout:Install 1 Package 2023-12-08T20:19:43.478 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:43.478 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 90 k 2023-12-08T20:19:43.479 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 264 k 2023-12-08T20:19:43.479 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-12-08T20:19:43.782 INFO:teuthology.orchestra.run.smithi043.stdout:rbd-fuse-17.2.7-119.ge2143d99.el8.x86_64.rpm 297 kB/s | 90 kB 00:00 2023-12-08T20:19:43.783 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:19:43.783 INFO:teuthology.orchestra.run.smithi043.stdout:Total 296 kB/s | 90 kB 00:00 2023-12-08T20:19:43.783 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-12-08T20:19:43.795 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-12-08T20:19:43.795 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-12-08T20:19:43.855 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-12-08T20:19:43.859 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-12-08T20:19:43.978 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-12-08T20:19:44.394 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:44.733 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: rbd-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:45.474 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:45.474 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:45.474 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-12-08T20:19:45.474 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:19:45.475 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:45.475 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:19:45.702 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install rbd-mirror 2023-12-08T20:19:46.703 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:03:05 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:19:48.576 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:19:48.576 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:19:48.577 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repo Size 2023-12-08T20:19:48.577 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:19:48.577 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2023-12-08T20:19:48.577 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror x86_64 2:17.2.7-119.ge2143d99.el8 ceph 3.5 M 2023-12-08T20:19:48.577 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:48.577 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-12-08T20:19:48.577 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:19:48.577 INFO:teuthology.orchestra.run.smithi043.stdout:Install 1 Package 2023-12-08T20:19:48.577 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:48.578 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 3.5 M 2023-12-08T20:19:48.578 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 16 M 2023-12-08T20:19:48.578 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-12-08T20:19:49.243 INFO:teuthology.orchestra.run.smithi043.stdout:rbd-mirror-17.2.7-119.ge2143d99.el8.x86_64.rpm 5.2 MB/s | 3.5 MB 00:00 2023-12-08T20:19:49.244 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:19:49.244 INFO:teuthology.orchestra.run.smithi043.stdout:Total 5.2 MB/s | 3.5 MB 00:00 2023-12-08T20:19:49.245 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-12-08T20:19:49.259 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-12-08T20:19:49.259 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-12-08T20:19:49.333 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-12-08T20:19:49.337 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-12-08T20:19:49.820 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-12-08T20:19:50.044 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-mirror-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:50.503 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: rbd-mirror-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:51.240 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-mirror-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:51.241 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:51.241 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-12-08T20:19:51.241 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:19:51.241 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:51.241 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:19:51.472 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install rbd-nbd 2023-12-08T20:19:52.462 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:03:11 ago on Fri 08 Dec 2023 08:16:41 PM UTC. 2023-12-08T20:19:54.334 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-12-08T20:19:54.334 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:19:54.334 INFO:teuthology.orchestra.run.smithi043.stdout: Package Architecture Version Repository Size 2023-12-08T20:19:54.334 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:19:54.334 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2023-12-08T20:19:54.334 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd x86_64 2:17.2.7-119.ge2143d99.el8 ceph 173 k 2023-12-08T20:19:54.334 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:54.334 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-12-08T20:19:54.334 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2023-12-08T20:19:54.334 INFO:teuthology.orchestra.run.smithi043.stdout:Install 1 Package 2023-12-08T20:19:54.335 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:54.335 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 173 k 2023-12-08T20:19:54.335 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 552 k 2023-12-08T20:19:54.335 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-12-08T20:19:54.521 INFO:teuthology.orchestra.run.smithi043.stdout:rbd-nbd-17.2.7-119.ge2143d99.el8.x86_64.rpm 919 kB/s | 173 kB 00:00 2023-12-08T20:19:54.521 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:19:54.521 INFO:teuthology.orchestra.run.smithi043.stdout:Total 912 kB/s | 173 kB 00:00 2023-12-08T20:19:54.522 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-12-08T20:19:54.538 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-12-08T20:19:54.538 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-12-08T20:19:54.596 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-12-08T20:19:54.599 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-12-08T20:19:54.727 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-12-08T20:19:55.084 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-nbd-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:55.420 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: rbd-nbd-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:56.173 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-nbd-2:17.2.7-119.ge2143d99.el8.x86_64 1/1 2023-12-08T20:19:56.173 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:56.173 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-12-08T20:19:56.173 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd-2:17.2.7-119.ge2143d99.el8.x86_64 2023-12-08T20:19:56.174 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:19:56.174 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-12-08T20:19:56.359 DEBUG:teuthology.parallel:result is None 2023-12-08T20:19:56.359 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-08T20:19:56.359 INFO:teuthology.packaging:ref: None 2023-12-08T20:19:56.359 INFO:teuthology.packaging:tag: None 2023-12-08T20:19:56.359 INFO:teuthology.packaging:branch: quincy 2023-12-08T20:19:56.359 INFO:teuthology.packaging:sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:19:56.360 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-08T20:19:56.768 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-08T20:19:56.796 INFO:teuthology.orchestra.run.smithi043.stdout:17.2.7-119.ge2143d99.el8 2023-12-08T20:19:56.797 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-119.ge2143d99.el8 2023-12-08T20:19:56.797 INFO:teuthology.task.install:The correct ceph version 17.2.7-119.ge2143d99 is installed. 2023-12-08T20:19:56.797 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-08T20:19:56.797 INFO:teuthology.packaging:ref: None 2023-12-08T20:19:56.797 INFO:teuthology.packaging:tag: None 2023-12-08T20:19:56.797 INFO:teuthology.packaging:branch: quincy 2023-12-08T20:19:56.797 INFO:teuthology.packaging:sha1: 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:19:56.797 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-08T20:19:57.136 DEBUG:teuthology.orchestra.run.smithi111:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-08T20:19:57.165 INFO:teuthology.orchestra.run.smithi111.stdout:17.2.7-119.ge2143d99.el8 2023-12-08T20:19:57.166 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-119.ge2143d99.el8 2023-12-08T20:19:57.166 INFO:teuthology.task.install:The correct ceph version 17.2.7-119.ge2143d99 is installed. 2023-12-08T20:19:57.166 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-08T20:19:57.166 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-12-08T20:19:57.166 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-08T20:19:57.202 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-12-08T20:19:57.202 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-08T20:19:57.239 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-08T20:19:57.239 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-12-08T20:19:57.239 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/daemon-helper 2023-12-08T20:19:57.277 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-08T20:19:57.352 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-12-08T20:19:57.352 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/daemon-helper 2023-12-08T20:19:57.383 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-08T20:19:57.452 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-08T20:19:57.452 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-12-08T20:19:57.452 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-08T20:19:57.487 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-08T20:19:57.561 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-12-08T20:19:57.562 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-08T20:19:57.590 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-08T20:19:57.657 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-08T20:19:57.658 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-12-08T20:19:57.658 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/stdin-killer 2023-12-08T20:19:57.692 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-08T20:19:57.767 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-12-08T20:19:57.767 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/stdin-killer 2023-12-08T20:19:57.795 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-08T20:19:57.863 INFO:teuthology.run_tasks:Running task print... 2023-12-08T20:19:57.873 INFO:teuthology.task.print:**** done install task... 2023-12-08T20:19:57.873 INFO:teuthology.run_tasks:Running task cephadm... 2023-12-08T20:19:57.976 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '9dcc13bb80dcc1cdea72b04d80505b4649a2b882'} 2023-12-08T20:19:57.976 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2023-12-08T20:19:57.977 INFO:tasks.cephadm:Cluster fsid is 28476818-9607-11ee-95a3-87774f69a715 2023-12-08T20:19:57.977 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-12-08T20:19:57.977 INFO:tasks.cephadm:No mon roles; fabricating mons 2023-12-08T20:19:57.977 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi043': '172.21.15.43', 'mon.smithi111': '172.21.15.111'} 2023-12-08T20:19:57.977 INFO:tasks.cephadm:Normalizing hostnames... 2023-12-08T20:19:57.977 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname $(hostname -s) 2023-12-08T20:19:58.014 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname $(hostname -s) 2023-12-08T20:19:58.043 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2023-12-08T20:19:58.043 DEBUG:teuthology.orchestra.run.smithi043:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-08T20:19:58.290 INFO:teuthology.orchestra.run.smithi043.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 8 20:19 /home/ubuntu/cephtest/cephadm 2023-12-08T20:19:58.291 DEBUG:teuthology.orchestra.run.smithi111:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-08T20:19:58.433 INFO:teuthology.orchestra.run.smithi111.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 8 20:19 /home/ubuntu/cephtest/cephadm 2023-12-08T20:19:58.433 DEBUG:teuthology.orchestra.run.smithi043:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-08T20:19:58.457 DEBUG:teuthology.orchestra.run.smithi111:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-08T20:19:58.488 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2023-12-08T20:19:58.488 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-08T20:19:58.500 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-08T20:19:59.400 INFO:teuthology.orchestra.run.smithi111.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-08T20:19:59.641 INFO:teuthology.orchestra.run.smithi043.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-08T20:20:24.480 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2023-12-08T20:20:24.480 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_version": "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)", 2023-12-08T20:20:24.480 INFO:teuthology.orchestra.run.smithi111.stdout: "image_id": "f761b6e422251eea7fff74ec4b7850c096513f0210a849805d791713a829673e", 2023-12-08T20:20:24.480 INFO:teuthology.orchestra.run.smithi111.stdout: "repo_digests": [ 2023-12-08T20:20:24.480 INFO:teuthology.orchestra.run.smithi111.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:761f3c6f44623fd2c1430ebbec30d9f81f7c9c291acc5201254b0c2b1b1e9938" 2023-12-08T20:20:24.480 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2023-12-08T20:20:24.480 INFO:teuthology.orchestra.run.smithi111.stdout:} 2023-12-08T20:20:24.845 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:20:24.846 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_version": "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)", 2023-12-08T20:20:24.846 INFO:teuthology.orchestra.run.smithi043.stdout: "image_id": "f761b6e422251eea7fff74ec4b7850c096513f0210a849805d791713a829673e", 2023-12-08T20:20:24.846 INFO:teuthology.orchestra.run.smithi043.stdout: "repo_digests": [ 2023-12-08T20:20:24.846 INFO:teuthology.orchestra.run.smithi043.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:761f3c6f44623fd2c1430ebbec30d9f81f7c9c291acc5201254b0c2b1b1e9938" 2023-12-08T20:20:24.846 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2023-12-08T20:20:24.846 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:20:24.873 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph 2023-12-08T20:20:24.911 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /etc/ceph 2023-12-08T20:20:24.943 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 777 /etc/ceph 2023-12-08T20:20:24.986 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 777 /etc/ceph 2023-12-08T20:20:25.014 INFO:tasks.cephadm:Writing seed config... 2023-12-08T20:20:25.015 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2023-12-08T20:20:25.015 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2023-12-08T20:20:25.015 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-12-08T20:20:25.015 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-12-08T20:20:25.015 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-12-08T20:20:25.015 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-12-08T20:20:25.015 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-12-08T20:20:25.015 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-12-08T20:20:25.015 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-12-08T20:20:25.015 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-12-08T20:20:25.015 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-12-08T20:20:25.016 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-12-08T20:20:25.016 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-12-08T20:20:25.016 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-12-08T20:20:25.016 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-12-08T20:20:25.016 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-12-08T20:20:25.016 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-12-08T20:20:25.016 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-12-08T20:20:25.016 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-12-08T20:20:25.016 INFO:tasks.cephadm: override: [client] debug client = 20 2023-12-08T20:20:25.016 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-12-08T20:20:25.016 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-12-08T20:20:25.016 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-12-08T20:20:25.016 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2023-12-08T20:20:25.017 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-12-08T20:20:25.017 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-12-08T20:20:25.017 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-12-08T20:20:25.017 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-12-08T20:20:25.017 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-12-08T20:20:25.017 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-12-08T20:20:25.017 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-12-08T20:20:25.017 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-12-08T20:20:25.017 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-12-08T20:20:25.017 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-12-08T20:20:25.017 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-12-08T20:20:25.017 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-12-08T20:20:25.017 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-12-08T20:20:25.017 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-12-08T20:20:25.017 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-12-08T20:20:25.017 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-12-08T20:20:25.018 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-12-08T20:20:25.018 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-12-08T20:20:25.050 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 28476818-9607-11ee-95a3-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-12-08T20:20:25.050 DEBUG:teuthology.orchestra.run.smithi043:mon.smithi043> sudo journalctl -f -n 0 -u ceph-28476818-9607-11ee-95a3-87774f69a715@mon.smithi043.service 2023-12-08T20:20:25.092 INFO:tasks.cephadm:Bootstrapping... 2023-12-08T20:20:25.092 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 28476818-9607-11ee-95a3-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.43 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-12-08T20:20:25.126 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:-- Logs begin at Fri 2023-12-08 20:06:41 UTC. -- 2023-12-08T20:20:25.328 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-12-08T20:20:25.328 INFO:teuthology.orchestra.run.smithi043.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '28476818-9607-11ee-95a3-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.43', '--skip-admin-label'] 2023-12-08T20:20:25.369 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stdout 4.6.1 2023-12-08T20:20:25.369 INFO:teuthology.orchestra.run.smithi043.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-12-08T20:20:25.370 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying podman|docker is present... 2023-12-08T20:20:25.404 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stdout 4.6.1 2023-12-08T20:20:25.405 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying lvm2 is present... 2023-12-08T20:20:25.405 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying time synchronization is in place... 2023-12-08T20:20:25.413 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-08T20:20:25.413 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-08T20:20:25.420 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-08T20:20:25.420 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2023-12-08T20:20:25.426 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout enabled 2023-12-08T20:20:25.433 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout active 2023-12-08T20:20:25.433 INFO:teuthology.orchestra.run.smithi043.stdout:Unit chronyd.service is enabled and running 2023-12-08T20:20:25.433 INFO:teuthology.orchestra.run.smithi043.stdout:Repeating the final host check... 2023-12-08T20:20:25.466 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stdout 4.6.1 2023-12-08T20:20:25.466 INFO:teuthology.orchestra.run.smithi043.stdout:podman (/bin/podman) version 4.6.1 is present 2023-12-08T20:20:25.466 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl is present 2023-12-08T20:20:25.467 INFO:teuthology.orchestra.run.smithi043.stdout:lvcreate is present 2023-12-08T20:20:25.473 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-08T20:20:25.473 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-08T20:20:25.479 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-08T20:20:25.479 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2023-12-08T20:20:25.486 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout enabled 2023-12-08T20:20:25.492 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout active 2023-12-08T20:20:25.492 INFO:teuthology.orchestra.run.smithi043.stdout:Unit chronyd.service is enabled and running 2023-12-08T20:20:25.493 INFO:teuthology.orchestra.run.smithi043.stdout:Host looks OK 2023-12-08T20:20:25.493 INFO:teuthology.orchestra.run.smithi043.stdout:Cluster fsid: 28476818-9607-11ee-95a3-87774f69a715 2023-12-08T20:20:25.494 INFO:teuthology.orchestra.run.smithi043.stdout:Acquiring lock 140165380004328 on /run/cephadm/28476818-9607-11ee-95a3-87774f69a715.lock 2023-12-08T20:20:25.494 INFO:teuthology.orchestra.run.smithi043.stdout:Lock 140165380004328 acquired on /run/cephadm/28476818-9607-11ee-95a3-87774f69a715.lock 2023-12-08T20:20:25.494 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying IP 172.21.15.43 port 3300 ... 2023-12-08T20:20:25.494 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying IP 172.21.15.43 port 6789 ... 2023-12-08T20:20:25.494 INFO:teuthology.orchestra.run.smithi043.stdout:Base mon IP(s) is [172.21.15.43:3300, 172.21.15.43:6789], mon addrv is [v2:172.21.15.43:3300,v1:172.21.15.43:6789] 2023-12-08T20:20:25.498 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.43 metric 100 2023-12-08T20:20:25.498 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.43 metric 100 2023-12-08T20:20:25.501 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-12-08T20:20:25.501 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-12-08T20:20:25.501 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1791sec hoplimit 64 pref medium 2023-12-08T20:20:25.506 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-12-08T20:20:25.506 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-12-08T20:20:25.506 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-08T20:20:25.506 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-12-08T20:20:25.506 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1358/64 scope link 2023-12-08T20:20:25.506 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-08T20:20:25.507 INFO:teuthology.orchestra.run.smithi043.stdout:Mon IP `172.21.15.43` is in CIDR network `172.21.0.0/20` 2023-12-08T20:20:25.507 INFO:teuthology.orchestra.run.smithi043.stdout:Mon IP `172.21.15.43` is in CIDR network `172.21.0.0/20` 2023-12-08T20:20:25.507 INFO:teuthology.orchestra.run.smithi043.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-12-08T20:20:25.508 INFO:teuthology.orchestra.run.smithi043.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-12-08T20:20:25.508 INFO:teuthology.orchestra.run.smithi043.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-08T20:20:25.883 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stdout f761b6e422251eea7fff74ec4b7850c096513f0210a849805d791713a829673e 2023-12-08T20:20:25.883 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-08T20:20:25.884 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Getting image source signatures 2023-12-08T20:20:25.884 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Copying blob sha256:b758150e9e8f18a6e73c4c5d80e3aa4f29a202640b61c9860fcf5acf017f13c3 2023-12-08T20:20:25.884 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Copying blob sha256:d3e436ac93e4b5a6d94c7ac8024df331e66e67275836276615dc044fd3cbf83a 2023-12-08T20:20:25.884 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Copying config sha256:f761b6e422251eea7fff74ec4b7850c096513f0210a849805d791713a829673e 2023-12-08T20:20:25.884 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Writing manifest to image destination 2023-12-08T20:20:26.634 INFO:teuthology.orchestra.run.smithi043.stdout:ceph: stdout ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable) 2023-12-08T20:20:26.635 INFO:teuthology.orchestra.run.smithi043.stdout:Ceph version: ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable) 2023-12-08T20:20:26.635 INFO:teuthology.orchestra.run.smithi043.stdout:Extracting ceph user uid/gid from container image... 2023-12-08T20:20:27.296 INFO:teuthology.orchestra.run.smithi043.stdout:stat: stdout 167 167 2023-12-08T20:20:27.296 INFO:teuthology.orchestra.run.smithi043.stdout:Creating initial keys... 2023-12-08T20:20:27.988 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph-authtool: stdout AQCLenNl0jN8IxAA5TvizDKi16B/zltZEkjNhg== 2023-12-08T20:20:28.637 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph-authtool: stdout AQCMenNlFB0IERAAU7X3sxEBhcjMTiSsIcFw/Q== 2023-12-08T20:20:29.269 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph-authtool: stdout AQCMenNly7cBNxAAZhtLkgCj0bCNklFFKLepGg== 2023-12-08T20:20:29.270 INFO:teuthology.orchestra.run.smithi043.stdout:Creating initial monmap... 2023-12-08T20:20:29.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-08T20:20:29.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2023-12-08T20:20:29.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 28476818-9607-11ee-95a3-87774f69a715 2023-12-08T20:20:29.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-08T20:20:29.962 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool for smithi043 [v2:172.21.15.43:3300,v1:172.21.15.43:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-08T20:20:29.962 INFO:teuthology.orchestra.run.smithi043.stdout:setting min_mon_release = octopus 2023-12-08T20:20:29.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: set fsid to 28476818-9607-11ee-95a3-87774f69a715 2023-12-08T20:20:29.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-08T20:20:29.962 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:20:29.962 INFO:teuthology.orchestra.run.smithi043.stdout:Creating mon... 2023-12-08T20:20:30.628 INFO:teuthology.orchestra.run.smithi043.stdout:create mon.smithi043 on 2023-12-08T20:20:30.745 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-12-08T20:20:30.845 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-12-08T20:20:30.951 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-28476818-9607-11ee-95a3-87774f69a715.target → /etc/systemd/system/ceph-28476818-9607-11ee-95a3-87774f69a715.target. 2023-12-08T20:20:30.951 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-28476818-9607-11ee-95a3-87774f69a715.target → /etc/systemd/system/ceph-28476818-9607-11ee-95a3-87774f69a715.target. 2023-12-08T20:20:31.088 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-28476818-9607-11ee-95a3-87774f69a715@mon.smithi043 2023-12-08T20:20:31.088 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Failed to reset failed state of unit ceph-28476818-9607-11ee-95a3-87774f69a715@mon.smithi043.service: Unit ceph-28476818-9607-11ee-95a3-87774f69a715@mon.smithi043.service not loaded. 2023-12-08T20:20:31.189 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-28476818-9607-11ee-95a3-87774f69a715.target.wants/ceph-28476818-9607-11ee-95a3-87774f69a715@mon.smithi043.service → /etc/systemd/system/ceph-28476818-9607-11ee-95a3-87774f69a715@.service. 2023-12-08T20:20:31.658 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-08T20:20:31.658 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout disabled 2023-12-08T20:20:31.667 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-08T20:20:31.667 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2023-12-08T20:20:31.667 INFO:teuthology.orchestra.run.smithi043.stdout:firewalld.service is not enabled 2023-12-08T20:20:31.667 INFO:teuthology.orchestra.run.smithi043.stdout:Not possible to enable service . firewalld.service is not available 2023-12-08T20:20:31.668 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mon to start... 2023-12-08T20:20:31.668 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mon... 2023-12-08T20:20:32.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:31 smithi043 ceph-mon[111480]: mon.smithi043 is new leader, mons smithi043 in quorum (ranks 0) 2023-12-08T20:20:32.585 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout cluster: 2023-12-08T20:20:32.591 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout id: 28476818-9607-11ee-95a3-87774f69a715 2023-12-08T20:20:32.592 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-12-08T20:20:32.592 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2023-12-08T20:20:32.592 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout services: 2023-12-08T20:20:32.592 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi043 (age 0.506766s) 2023-12-08T20:20:32.592 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-12-08T20:20:32.592 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-12-08T20:20:32.592 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2023-12-08T20:20:32.592 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout data: 2023-12-08T20:20:32.592 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-12-08T20:20:32.592 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-12-08T20:20:32.592 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-12-08T20:20:32.592 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout pgs: 2023-12-08T20:20:32.592 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2023-12-08T20:20:32.592 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.091+0000 7fc7afd52700 1 Processor -- start 2023-12-08T20:20:32.592 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.091+0000 7fc7afd52700 1 -- start start 2023-12-08T20:20:32.593 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.091+0000 7fc7afd52700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7a81038f0 0x7fc7a8103d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:32.593 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.091+0000 7fc7afd52700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a8104240 con 0x7fc7a81038f0 2023-12-08T20:20:32.593 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.091+0000 7fc7adaee700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7a81038f0 0x7fc7a8103d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:32.593 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.091+0000 7fc7adaee700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7a81038f0 0x7fc7a8103d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33898/0 (socket says 172.21.15.43:33898) 2023-12-08T20:20:32.593 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.092+0000 7fc7adaee700 1 -- 172.21.15.43:0/1349515412 learned_addr learned my addr 172.21.15.43:0/1349515412 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:32.593 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.092+0000 7fc7adaee700 1 -- 172.21.15.43:0/1349515412 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a8104380 con 0x7fc7a81038f0 2023-12-08T20:20:32.593 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.092+0000 7fc7adaee700 1 --2- 172.21.15.43:0/1349515412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7a81038f0 0x7fc7a8103d00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40098e0 tx=0x7fc7a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfcb3cd8711e61a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:32.593 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.092+0000 7fc7acaec700 1 -- 172.21.15.43:0/1349515412 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7a400b860 con 0x7fc7a81038f0 2023-12-08T20:20:32.593 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.092+0000 7fc7acaec700 1 -- 172.21.15.43:0/1349515412 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a400b9c0 con 0x7fc7a81038f0 2023-12-08T20:20:32.593 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.092+0000 7fc7acaec700 1 -- 172.21.15.43:0/1349515412 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7a400bc90 con 0x7fc7a81038f0 2023-12-08T20:20:32.593 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.093+0000 7fc7afd52700 1 -- 172.21.15.43:0/1349515412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7a81038f0 msgr2=0x7fc7a8103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:32.593 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.093+0000 7fc7afd52700 1 --2- 172.21.15.43:0/1349515412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7a81038f0 0x7fc7a8103d00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40098e0 tx=0x7fc7a4009250 comp rx=0 tx=0).stop 2023-12-08T20:20:32.593 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.093+0000 7fc7afd52700 1 -- 172.21.15.43:0/1349515412 shutdown_connections 2023-12-08T20:20:32.593 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.093+0000 7fc7afd52700 1 --2- 172.21.15.43:0/1349515412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7a81038f0 0x7fc7a8103d00 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:32.594 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.093+0000 7fc7afd52700 1 -- 172.21.15.43:0/1349515412 >> 172.21.15.43:0/1349515412 conn(0x7fc7a80fc0b0 msgr2=0x7fc7a80fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:32.594 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.093+0000 7fc7afd52700 1 -- 172.21.15.43:0/1349515412 shutdown_connections 2023-12-08T20:20:32.594 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.093+0000 7fc7afd52700 1 -- 172.21.15.43:0/1349515412 wait complete. 2023-12-08T20:20:32.594 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.094+0000 7fc7afd52700 1 Processor -- start 2023-12-08T20:20:32.594 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.094+0000 7fc7afd52700 1 -- start start 2023-12-08T20:20:32.594 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.094+0000 7fc7afd52700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7a81038f0 0x7fc7a8103130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:32.594 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.094+0000 7fc7afd52700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a81015b0 con 0x7fc7a81038f0 2023-12-08T20:20:32.594 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.094+0000 7fc7adaee700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7a81038f0 0x7fc7a8103130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:32.594 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.094+0000 7fc7adaee700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7a81038f0 0x7fc7a8103130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33912/0 (socket says 172.21.15.43:33912) 2023-12-08T20:20:32.594 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.094+0000 7fc7adaee700 1 -- 172.21.15.43:0/815537986 learned_addr learned my addr 172.21.15.43:0/815537986 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:32.594 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.094+0000 7fc7adaee700 1 -- 172.21.15.43:0/815537986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a40094f0 con 0x7fc7a81038f0 2023-12-08T20:20:32.594 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.094+0000 7fc7adaee700 1 --2- 172.21.15.43:0/815537986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7a81038f0 0x7fc7a8103130 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4003080 tx=0x7fc7a4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:32.594 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.095+0000 7fc79e7fc700 1 -- 172.21.15.43:0/815537986 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7a401c5c0 con 0x7fc7a81038f0 2023-12-08T20:20:32.594 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.095+0000 7fc79e7fc700 1 -- 172.21.15.43:0/815537986 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a401c720 con 0x7fc7a81038f0 2023-12-08T20:20:32.594 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.095+0000 7fc7afd52700 1 -- 172.21.15.43:0/815537986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a81017b0 con 0x7fc7a81038f0 2023-12-08T20:20:32.594 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.095+0000 7fc79e7fc700 1 -- 172.21.15.43:0/815537986 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7a401ca30 con 0x7fc7a81038f0 2023-12-08T20:20:32.595 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.095+0000 7fc7afd52700 1 -- 172.21.15.43:0/815537986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a8101bc0 con 0x7fc7a81038f0 2023-12-08T20:20:32.595 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.095+0000 7fc79e7fc700 1 -- 172.21.15.43:0/815537986 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc7a401a450 con 0x7fc7a81038f0 2023-12-08T20:20:32.595 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.095+0000 7fc79e7fc700 1 -- 172.21.15.43:0/815537986 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc7a402e790 con 0x7fc7a81038f0 2023-12-08T20:20:32.595 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.096+0000 7fc7afd52700 1 -- 172.21.15.43:0/815537986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a804bb80 con 0x7fc7a81038f0 2023-12-08T20:20:32.595 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.098+0000 7fc79e7fc700 1 -- 172.21.15.43:0/815537986 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc7a401a890 con 0x7fc7a81038f0 2023-12-08T20:20:32.595 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.174+0000 7fc7afd52700 1 -- 172.21.15.43:0/815537986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fc7a8109c90 con 0x7fc7a81038f0 2023-12-08T20:20:32.595 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.174+0000 7fc79e7fc700 1 -- 172.21.15.43:0/815537986 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7fc7a401aa30 con 0x7fc7a81038f0 2023-12-08T20:20:32.595 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.175+0000 7fc7afd52700 1 -- 172.21.15.43:0/815537986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7a81038f0 msgr2=0x7fc7a8103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:32.595 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.175+0000 7fc7afd52700 1 --2- 172.21.15.43:0/815537986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7a81038f0 0x7fc7a8103130 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4003080 tx=0x7fc7a4016000 comp rx=0 tx=0).stop 2023-12-08T20:20:32.595 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.175+0000 7fc7afd52700 1 -- 172.21.15.43:0/815537986 shutdown_connections 2023-12-08T20:20:32.595 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.175+0000 7fc7afd52700 1 --2- 172.21.15.43:0/815537986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7a81038f0 0x7fc7a8103130 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:32.595 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.175+0000 7fc7afd52700 1 -- 172.21.15.43:0/815537986 >> 172.21.15.43:0/815537986 conn(0x7fc7a80fc0b0 msgr2=0x7fc7a8105150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:32.595 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.175+0000 7fc7afd52700 1 -- 172.21.15.43:0/815537986 shutdown_connections 2023-12-08T20:20:32.595 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:32.175+0000 7fc7afd52700 1 -- 172.21.15.43:0/815537986 wait complete. 2023-12-08T20:20:32.595 INFO:teuthology.orchestra.run.smithi043.stdout:mon is available 2023-12-08T20:20:32.596 INFO:teuthology.orchestra.run.smithi043.stdout:Assimilating anything we can from ceph.conf... 2023-12-08T20:20:32.804 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:32 smithi043 ceph-mon[111480]: mon.smithi043 is new leader, mons smithi043 in quorum (ranks 0) 2023-12-08T20:20:32.804 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:32 smithi043 ceph-mon[111480]: monmap e1: 1 mons at {smithi043=[v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-08T20:20:32.804 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:32 smithi043 ceph-mon[111480]: fsmap 2023-12-08T20:20:32.804 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:32 smithi043 ceph-mon[111480]: osdmap e1: 0 total, 0 up, 0 in 2023-12-08T20:20:32.804 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:32 smithi043 ceph-mon[111480]: mgrmap e1: no daemons active 2023-12-08T20:20:32.804 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:32 smithi043 ceph-mon[111480]: from='client.? 172.21.15.43:0/815537986' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-12-08T20:20:33.459 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2023-12-08T20:20:33.459 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [global] 2023-12-08T20:20:33.459 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout fsid = 28476818-9607-11ee-95a3-87774f69a715 2023-12-08T20:20:33.459 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.43:3300,v1:172.21.15.43:6789] 2023-12-08T20:20:33.459 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-08T20:20:33.459 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-08T20:20:33.459 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-08T20:20:33.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-08T20:20:33.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2023-12-08T20:20:33.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-08T20:20:33.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-08T20:20:33.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2023-12-08T20:20:33.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [osd] 2023-12-08T20:20:33.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-08T20:20:33.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-08T20:20:33.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-08T20:20:33.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-08T20:20:33.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-08T20:20:33.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.014+0000 7fdb0f4ac700 1 Processor -- start 2023-12-08T20:20:33.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.015+0000 7fdb0f4ac700 1 -- start start 2023-12-08T20:20:33.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.015+0000 7fdb0f4ac700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb08100710 0x7fdb08100b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:33.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.015+0000 7fdb0f4ac700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb08101060 con 0x7fdb08100710 2023-12-08T20:20:33.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.015+0000 7fdb0d248700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb08100710 0x7fdb08100b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:33.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.015+0000 7fdb0d248700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb08100710 0x7fdb08100b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33922/0 (socket says 172.21.15.43:33922) 2023-12-08T20:20:33.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.015+0000 7fdb0d248700 1 -- 172.21.15.43:0/1069373688 learned_addr learned my addr 172.21.15.43:0/1069373688 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:33.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.015+0000 7fdb0d248700 1 -- 172.21.15.43:0/1069373688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb081011a0 con 0x7fdb08100710 2023-12-08T20:20:33.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.016+0000 7fdb0d248700 1 --2- 172.21.15.43:0/1069373688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb08100710 0x7fdb08100b20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fdb040098e0 tx=0x7fdb04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861dfd5a1d529f21 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:33.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.016+0000 7fdafffff700 1 -- 172.21.15.43:0/1069373688 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb0400b860 con 0x7fdb08100710 2023-12-08T20:20:33.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.016+0000 7fdafffff700 1 -- 172.21.15.43:0/1069373688 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0400b9c0 con 0x7fdb08100710 2023-12-08T20:20:33.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.016+0000 7fdafffff700 1 -- 172.21.15.43:0/1069373688 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb0400bc90 con 0x7fdb08100710 2023-12-08T20:20:33.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.016+0000 7fdb0f4ac700 1 -- 172.21.15.43:0/1069373688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb08100710 msgr2=0x7fdb08100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:33.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.016+0000 7fdb0f4ac700 1 --2- 172.21.15.43:0/1069373688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb08100710 0x7fdb08100b20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fdb040098e0 tx=0x7fdb04009250 comp rx=0 tx=0).stop 2023-12-08T20:20:33.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.016+0000 7fdb0f4ac700 1 -- 172.21.15.43:0/1069373688 shutdown_connections 2023-12-08T20:20:33.462 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.016+0000 7fdb0f4ac700 1 --2- 172.21.15.43:0/1069373688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb08100710 0x7fdb08100b20 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:33.462 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.016+0000 7fdb0f4ac700 1 -- 172.21.15.43:0/1069373688 >> 172.21.15.43:0/1069373688 conn(0x7fdb080fc0b0 msgr2=0x7fdb080fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:33.462 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.016+0000 7fdb0f4ac700 1 -- 172.21.15.43:0/1069373688 shutdown_connections 2023-12-08T20:20:33.462 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.016+0000 7fdb0f4ac700 1 -- 172.21.15.43:0/1069373688 wait complete. 2023-12-08T20:20:33.462 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.017+0000 7fdb0f4ac700 1 Processor -- start 2023-12-08T20:20:33.462 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.017+0000 7fdb0f4ac700 1 -- start start 2023-12-08T20:20:33.462 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.017+0000 7fdb0f4ac700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb08100710 0x7fdb08110980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:33.462 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.017+0000 7fdb0f4ac700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb08110ec0 con 0x7fdb08100710 2023-12-08T20:20:33.462 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.017+0000 7fdb0d248700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb08100710 0x7fdb08110980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:33.462 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.017+0000 7fdb0d248700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb08100710 0x7fdb08110980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33932/0 (socket says 172.21.15.43:33932) 2023-12-08T20:20:33.462 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.017+0000 7fdb0d248700 1 -- 172.21.15.43:0/2554110978 learned_addr learned my addr 172.21.15.43:0/2554110978 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:33.462 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.018+0000 7fdb0d248700 1 -- 172.21.15.43:0/2554110978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb040094f0 con 0x7fdb08100710 2023-12-08T20:20:33.462 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.018+0000 7fdb0d248700 1 --2- 172.21.15.43:0/2554110978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb08100710 0x7fdb08110980 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdb04003080 tx=0x7fdb04016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:33.462 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.018+0000 7fdafdffb700 1 -- 172.21.15.43:0/2554110978 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb0401c5c0 con 0x7fdb08100710 2023-12-08T20:20:33.462 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.018+0000 7fdafdffb700 1 -- 172.21.15.43:0/2554110978 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0401c720 con 0x7fdb08100710 2023-12-08T20:20:33.463 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.018+0000 7fdb0f4ac700 1 -- 172.21.15.43:0/2554110978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb081110c0 con 0x7fdb08100710 2023-12-08T20:20:33.463 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.018+0000 7fdafdffb700 1 -- 172.21.15.43:0/2554110978 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb0401ca30 con 0x7fdb08100710 2023-12-08T20:20:33.463 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.018+0000 7fdb0f4ac700 1 -- 172.21.15.43:0/2554110978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb081114d0 con 0x7fdb08100710 2023-12-08T20:20:33.463 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.018+0000 7fdafdffb700 1 -- 172.21.15.43:0/2554110978 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fdb0401a450 con 0x7fdb08100710 2023-12-08T20:20:33.463 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.018+0000 7fdafdffb700 1 -- 172.21.15.43:0/2554110978 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fdb0402e790 con 0x7fdb08100710 2023-12-08T20:20:33.463 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.019+0000 7fdb0f4ac700 1 -- 172.21.15.43:0/2554110978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0804bb80 con 0x7fdb08100710 2023-12-08T20:20:33.463 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.022+0000 7fdafdffb700 1 -- 172.21.15.43:0/2554110978 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fdb0401a890 con 0x7fdb08100710 2023-12-08T20:20:33.463 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.094+0000 7fdb0f4ac700 1 -- 172.21.15.43:0/2554110978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fdb0810a0d0 con 0x7fdb08100710 2023-12-08T20:20:33.463 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.097+0000 7fdafdffb700 1 -- 172.21.15.43:0/2554110978 <== mon.0 v2:172.21.15.43:3300/0 7 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fdb0402ee60 con 0x7fdb08100710 2023-12-08T20:20:33.463 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.097+0000 7fdafdffb700 1 -- 172.21.15.43:0/2554110978 <== mon.0 v2:172.21.15.43:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7fdb04024720 con 0x7fdb08100710 2023-12-08T20:20:33.463 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.098+0000 7fdb0f4ac700 1 -- 172.21.15.43:0/2554110978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb08100710 msgr2=0x7fdb08110980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:33.463 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.098+0000 7fdb0f4ac700 1 --2- 172.21.15.43:0/2554110978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb08100710 0x7fdb08110980 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdb04003080 tx=0x7fdb04016000 comp rx=0 tx=0).stop 2023-12-08T20:20:33.463 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.098+0000 7fdb0f4ac700 1 -- 172.21.15.43:0/2554110978 shutdown_connections 2023-12-08T20:20:33.463 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.098+0000 7fdb0f4ac700 1 --2- 172.21.15.43:0/2554110978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb08100710 0x7fdb08110980 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:33.463 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.098+0000 7fdb0f4ac700 1 -- 172.21.15.43:0/2554110978 >> 172.21.15.43:0/2554110978 conn(0x7fdb080fc0b0 msgr2=0x7fdb080fdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:33.464 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.099+0000 7fdb0f4ac700 1 -- 172.21.15.43:0/2554110978 shutdown_connections 2023-12-08T20:20:33.464 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.099+0000 7fdb0f4ac700 1 -- 172.21.15.43:0/2554110978 wait complete. 2023-12-08T20:20:33.464 INFO:teuthology.orchestra.run.smithi043.stdout:Generating new minimal ceph.conf... 2023-12-08T20:20:33.948 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:33 smithi043 ceph-mon[111480]: from='client.? 172.21.15.43:0/2554110978' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-08T20:20:33.948 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:33 smithi043 ceph-mon[111480]: from='client.? 172.21.15.43:0/2554110978' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-12-08T20:20:34.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.845+0000 7f120db37700 1 Processor -- start 2023-12-08T20:20:34.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.845+0000 7f120db37700 1 -- start start 2023-12-08T20:20:34.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.845+0000 7f120db37700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1208071000 0x7f1208104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:34.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.845+0000 7f120db37700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12081053e0 con 0x7f1208071000 2023-12-08T20:20:34.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.845+0000 7f12077fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1208071000 0x7f1208104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:34.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.846+0000 7f12077fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1208071000 0x7f1208104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33938/0 (socket says 172.21.15.43:33938) 2023-12-08T20:20:34.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.846+0000 7f12077fe700 1 -- 172.21.15.43:0/2179037853 learned_addr learned my addr 172.21.15.43:0/2179037853 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:34.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.846+0000 7f12077fe700 1 -- 172.21.15.43:0/2179037853 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1208105520 con 0x7f1208071000 2023-12-08T20:20:34.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.846+0000 7f12077fe700 1 --2- 172.21.15.43:0/2179037853 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1208071000 0x7f1208104ea0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f11f80098e0 tx=0x7f11f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348c6c6e0c145aff server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:34.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.846+0000 7f12067fc700 1 -- 172.21.15.43:0/2179037853 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11f800b860 con 0x7f1208071000 2023-12-08T20:20:34.291 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.846+0000 7f12067fc700 1 -- 172.21.15.43:0/2179037853 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f11f800be30 con 0x7f1208071000 2023-12-08T20:20:34.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.846+0000 7f12067fc700 1 -- 172.21.15.43:0/2179037853 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11f8010380 con 0x7f1208071000 2023-12-08T20:20:34.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.847+0000 7f120db37700 1 -- 172.21.15.43:0/2179037853 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1208071000 msgr2=0x7f1208104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:34.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.847+0000 7f120db37700 1 --2- 172.21.15.43:0/2179037853 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1208071000 0x7f1208104ea0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f11f80098e0 tx=0x7f11f8009250 comp rx=0 tx=0).stop 2023-12-08T20:20:34.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.847+0000 7f120db37700 1 -- 172.21.15.43:0/2179037853 shutdown_connections 2023-12-08T20:20:34.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.847+0000 7f120db37700 1 --2- 172.21.15.43:0/2179037853 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1208071000 0x7f1208104ea0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:34.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.847+0000 7f120db37700 1 -- 172.21.15.43:0/2179037853 >> 172.21.15.43:0/2179037853 conn(0x7f12080fc970 msgr2=0x7f12080fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:34.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.847+0000 7f120db37700 1 -- 172.21.15.43:0/2179037853 shutdown_connections 2023-12-08T20:20:34.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.847+0000 7f120db37700 1 -- 172.21.15.43:0/2179037853 wait complete. 2023-12-08T20:20:34.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.847+0000 7f120db37700 1 Processor -- start 2023-12-08T20:20:34.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.848+0000 7f120db37700 1 -- start start 2023-12-08T20:20:34.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.848+0000 7f120db37700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1208071000 0x7f1208111160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:34.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.848+0000 7f120db37700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12081116a0 con 0x7f1208071000 2023-12-08T20:20:34.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.848+0000 7f12077fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1208071000 0x7f1208111160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:34.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.848+0000 7f12077fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1208071000 0x7f1208111160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33942/0 (socket says 172.21.15.43:33942) 2023-12-08T20:20:34.292 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.848+0000 7f12077fe700 1 -- 172.21.15.43:0/2067492181 learned_addr learned my addr 172.21.15.43:0/2067492181 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:34.293 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.848+0000 7f12077fe700 1 -- 172.21.15.43:0/2067492181 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f80094f0 con 0x7f1208071000 2023-12-08T20:20:34.293 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.848+0000 7f12077fe700 1 --2- 172.21.15.43:0/2067492181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1208071000 0x7f1208111160 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f11f8006b00 tx=0x7f11f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:34.293 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.849+0000 7f11effff700 1 -- 172.21.15.43:0/2067492181 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11f8010a80 con 0x7f1208071000 2023-12-08T20:20:34.293 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.849+0000 7f120db37700 1 -- 172.21.15.43:0/2067492181 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12081118a0 con 0x7f1208071000 2023-12-08T20:20:34.293 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.849+0000 7f11effff700 1 -- 172.21.15.43:0/2067492181 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f11f801a430 con 0x7f1208071000 2023-12-08T20:20:34.293 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.849+0000 7f11effff700 1 -- 172.21.15.43:0/2067492181 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11f80245b0 con 0x7f1208071000 2023-12-08T20:20:34.293 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.849+0000 7f120db37700 1 -- 172.21.15.43:0/2067492181 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1208111cb0 con 0x7f1208071000 2023-12-08T20:20:34.293 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.849+0000 7f11effff700 1 -- 172.21.15.43:0/2067492181 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f11f8024ab0 con 0x7f1208071000 2023-12-08T20:20:34.293 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.849+0000 7f11effff700 1 -- 172.21.15.43:0/2067492181 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f11f802eb00 con 0x7f1208071000 2023-12-08T20:20:34.293 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.850+0000 7f120db37700 1 -- 172.21.15.43:0/2067492181 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120804bb80 con 0x7f1208071000 2023-12-08T20:20:34.293 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.852+0000 7f11effff700 1 -- 172.21.15.43:0/2067492181 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f11f802ed10 con 0x7f1208071000 2023-12-08T20:20:34.293 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.926+0000 7f120db37700 1 -- 172.21.15.43:0/2067492181 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f1208106300 con 0x7f1208071000 2023-12-08T20:20:34.293 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.926+0000 7f11effff700 1 -- 172.21.15.43:0/2067492181 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f1208106300 con 0x7f1208071000 2023-12-08T20:20:34.293 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.927+0000 7f120db37700 1 -- 172.21.15.43:0/2067492181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1208071000 msgr2=0x7f1208111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:34.293 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.927+0000 7f120db37700 1 --2- 172.21.15.43:0/2067492181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1208071000 0x7f1208111160 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f11f8006b00 tx=0x7f11f8009250 comp rx=0 tx=0).stop 2023-12-08T20:20:34.294 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.927+0000 7f120db37700 1 -- 172.21.15.43:0/2067492181 shutdown_connections 2023-12-08T20:20:34.294 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.927+0000 7f120db37700 1 --2- 172.21.15.43:0/2067492181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1208071000 0x7f1208111160 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:34.294 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.927+0000 7f120db37700 1 -- 172.21.15.43:0/2067492181 >> 172.21.15.43:0/2067492181 conn(0x7f12080fc970 msgr2=0x7f12080fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:34.294 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.927+0000 7f120db37700 1 -- 172.21.15.43:0/2067492181 shutdown_connections 2023-12-08T20:20:34.294 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:33.927+0000 7f120db37700 1 -- 172.21.15.43:0/2067492181 wait complete. 2023-12-08T20:20:34.294 INFO:teuthology.orchestra.run.smithi043.stdout:Restarting the monitor... 2023-12-08T20:20:34.494 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:34 smithi043 systemd[1]: Stopping Ceph mon.smithi043 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:20:34.749 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:34 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-mon-smithi043[111457]: 2023-12-08T20:20:34.492+0000 7f4b0bbb9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi043 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-08T20:20:34.749 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:34 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-mon-smithi043[111457]: 2023-12-08T20:20:34.492+0000 7f4b0bbb9700 -1 mon.smithi043@0(leader) e1 *** Got Signal Terminated *** 2023-12-08T20:20:35.006 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:34 smithi043 bash[111809]: ceph-28476818-9607-11ee-95a3-87774f69a715-mon-smithi043 2023-12-08T20:20:35.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 systemd[1]: ceph-28476818-9607-11ee-95a3-87774f69a715@mon.smithi043.service: Succeeded. 2023-12-08T20:20:35.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 systemd[1]: Stopped Ceph mon.smithi043 for 28476818-9607-11ee-95a3-87774f69a715. 2023-12-08T20:20:35.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 systemd[1]: Starting Ceph mon.smithi043 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:20:35.361 INFO:teuthology.orchestra.run.smithi043.stdout:Setting mon public_network to 172.21.0.0/20 2023-12-08T20:20:35.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: set uid:gid to 167:167 (ceph:ceph) 2023-12-08T20:20:35.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable), process ceph-mon, pid 7 2023-12-08T20:20:35.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: pidfile_write: ignore empty --pid-file 2023-12-08T20:20:35.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 bash[111928]: fe2a56effef3ac13c9dafc2bef8a7056413555b1cd4d7808673022932e7043bd 2023-12-08T20:20:35.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 systemd[1]: Started Ceph mon.smithi043 for 28476818-9607-11ee-95a3-87774f69a715. 2023-12-08T20:20:35.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: load: jerasure load: lrc 2023-12-08T20:20:35.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: RocksDB version: 6.15.5 2023-12-08T20:20:35.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-08T20:20:35.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Compile date Dec 8 2023 2023-12-08T20:20:35.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: DB SUMMARY 2023-12-08T20:20:35.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: DB Session ID: XY6YDETEML26WZAKE8RE 2023-12-08T20:20:35.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: CURRENT file: CURRENT 2023-12-08T20:20:35.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: IDENTITY file: IDENTITY 2023-12-08T20:20:35.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2023-12-08T20:20:35.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi043/store.db dir, Total Num: 1, files: 000008.sst 2023-12-08T20:20:35.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi043/store.db: 000010.log size: 95330 ; 2023-12-08T20:20:35.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.error_if_exists: 0 2023-12-08T20:20:35.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.create_if_missing: 0 2023-12-08T20:20:35.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.paranoid_checks: 1 2023-12-08T20:20:35.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-08T20:20:35.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.env: 0x5562f3bcca80 2023-12-08T20:20:35.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.fs: Posix File System 2023-12-08T20:20:35.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.info_log: 0x5562f49f0780 2023-12-08T20:20:35.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_file_opening_threads: 16 2023-12-08T20:20:35.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.statistics: (nil) 2023-12-08T20:20:35.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.use_fsync: 0 2023-12-08T20:20:35.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_log_file_size: 0 2023-12-08T20:20:35.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-08T20:20:35.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-08T20:20:35.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.keep_log_file_num: 1000 2023-12-08T20:20:35.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.recycle_log_file_num: 0 2023-12-08T20:20:35.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.allow_fallocate: 1 2023-12-08T20:20:35.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.allow_mmap_reads: 0 2023-12-08T20:20:35.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.allow_mmap_writes: 0 2023-12-08T20:20:35.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.use_direct_reads: 0 2023-12-08T20:20:35.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-08T20:20:35.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.create_missing_column_families: 0 2023-12-08T20:20:35.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.db_log_dir: 2023-12-08T20:20:35.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi043/store.db 2023-12-08T20:20:35.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-08T20:20:35.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-08T20:20:35.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-08T20:20:35.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-08T20:20:35.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-08T20:20:35.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-08T20:20:35.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.advise_random_on_open: 1 2023-12-08T20:20:35.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.db_write_buffer_size: 0 2023-12-08T20:20:35.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.write_buffer_manager: 0x5562f57609f0 2023-12-08T20:20:35.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-08T20:20:35.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-08T20:20:35.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-08T20:20:35.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-08T20:20:35.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.rate_limiter: (nil) 2023-12-08T20:20:35.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-08T20:20:35.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.wal_recovery_mode: 2 2023-12-08T20:20:35.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.enable_thread_tracking: 0 2023-12-08T20:20:35.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.enable_pipelined_write: 0 2023-12-08T20:20:35.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.unordered_write: 0 2023-12-08T20:20:35.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-08T20:20:35.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-08T20:20:35.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-08T20:20:35.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-08T20:20:35.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.row_cache: None 2023-12-08T20:20:35.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.wal_filter: None 2023-12-08T20:20:35.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-08T20:20:35.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.allow_ingest_behind: 0 2023-12-08T20:20:35.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.preserve_deletes: 0 2023-12-08T20:20:35.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.two_write_queues: 0 2023-12-08T20:20:35.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.manual_wal_flush: 0 2023-12-08T20:20:35.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.atomic_flush: 0 2023-12-08T20:20:35.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-08T20:20:35.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-08T20:20:35.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-08T20:20:35.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.log_readahead_size: 0 2023-12-08T20:20:35.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-08T20:20:35.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.best_efforts_recovery: 0 2023-12-08T20:20:35.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-08T20:20:35.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-08T20:20:35.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.allow_data_in_errors: 0 2023-12-08T20:20:35.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.db_host_id: __hostname__ 2023-12-08T20:20:35.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_background_jobs: 2 2023-12-08T20:20:35.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_background_compactions: -1 2023-12-08T20:20:35.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_subcompactions: 1 2023-12-08T20:20:35.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-08T20:20:35.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-08T20:20:35.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-08T20:20:35.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_total_wal_size: 0 2023-12-08T20:20:35.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-08T20:20:35.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-08T20:20:35.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-08T20:20:35.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-08T20:20:35.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_open_files: -1 2023-12-08T20:20:35.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.bytes_per_sync: 0 2023-12-08T20:20:35.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-08T20:20:35.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-08T20:20:35.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compaction_readahead_size: 0 2023-12-08T20:20:35.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_background_flushes: -1 2023-12-08T20:20:35.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Compression algorithms supported: 2023-12-08T20:20:35.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-08T20:20:35.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: kZSTD supported: 0 2023-12-08T20:20:35.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: kXpressCompression supported: 0 2023-12-08T20:20:35.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: kLZ4HCCompression supported: 1 2023-12-08T20:20:35.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: kZlibCompression supported: 1 2023-12-08T20:20:35.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: kSnappyCompression supported: 1 2023-12-08T20:20:35.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: kLZ4Compression supported: 1 2023-12-08T20:20:35.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: kBZip2Compression supported: 0 2023-12-08T20:20:35.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-08T20:20:35.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi043/store.db/MANIFEST-000009 2023-12-08T20:20:35.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-08T20:20:35.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-08T20:20:35.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.merge_operator: 2023-12-08T20:20:35.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compaction_filter: None 2023-12-08T20:20:35.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compaction_filter_factory: None 2023-12-08T20:20:35.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.sst_partitioner_factory: None 2023-12-08T20:20:35.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-08T20:20:35.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-08T20:20:35.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5562f4a40f90) 2023-12-08T20:20:35.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: cache_index_and_filter_blocks: 1 2023-12-08T20:20:35.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-08T20:20:35.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-08T20:20:35.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: pin_top_level_index_and_filter: 1 2023-12-08T20:20:35.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: index_type: 0 2023-12-08T20:20:35.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: data_block_index_type: 0 2023-12-08T20:20:35.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: index_shortening: 1 2023-12-08T20:20:35.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-08T20:20:35.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: hash_index_allow_collision: 1 2023-12-08T20:20:35.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: checksum: 1 2023-12-08T20:20:35.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: no_block_cache: 0 2023-12-08T20:20:35.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: block_cache: 0x5562f4a73090 2023-12-08T20:20:35.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: block_cache_name: BinnedLRUCache 2023-12-08T20:20:35.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: block_cache_options: 2023-12-08T20:20:35.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: capacity : 536870912 2023-12-08T20:20:35.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: num_shard_bits : 4 2023-12-08T20:20:35.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: strict_capacity_limit : 0 2023-12-08T20:20:35.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: high_pri_pool_ratio: 0.000 2023-12-08T20:20:35.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: block_cache_compressed: (nil) 2023-12-08T20:20:35.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: persistent_cache: (nil) 2023-12-08T20:20:35.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: block_size: 4096 2023-12-08T20:20:35.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: block_size_deviation: 10 2023-12-08T20:20:35.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: block_restart_interval: 16 2023-12-08T20:20:35.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: index_block_restart_interval: 1 2023-12-08T20:20:35.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: metadata_block_size: 4096 2023-12-08T20:20:35.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: partition_filters: 0 2023-12-08T20:20:35.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: use_delta_encoding: 1 2023-12-08T20:20:35.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-08T20:20:35.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: whole_key_filtering: 1 2023-12-08T20:20:35.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: verify_compression: 0 2023-12-08T20:20:35.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: read_amp_bytes_per_bit: 0 2023-12-08T20:20:35.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: format_version: 4 2023-12-08T20:20:35.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: enable_index_compression: 1 2023-12-08T20:20:35.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: block_align: 0 2023-12-08T20:20:35.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.write_buffer_size: 33554432 2023-12-08T20:20:35.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_write_buffer_number: 2 2023-12-08T20:20:35.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compression: NoCompression 2023-12-08T20:20:35.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.bottommost_compression: Disabled 2023-12-08T20:20:35.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.prefix_extractor: nullptr 2023-12-08T20:20:35.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-08T20:20:35.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.num_levels: 7 2023-12-08T20:20:35.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-08T20:20:35.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-08T20:20:35.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-08T20:20:35.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-08T20:20:35.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-08T20:20:35.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-08T20:20:35.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-08T20:20:35.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-08T20:20:35.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-08T20:20:35.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-08T20:20:35.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-08T20:20:35.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compression_opts.level: 32767 2023-12-08T20:20:35.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compression_opts.strategy: 0 2023-12-08T20:20:35.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-08T20:20:35.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-08T20:20:35.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-08T20:20:35.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compression_opts.enabled: false 2023-12-08T20:20:35.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-08T20:20:35.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-08T20:20:35.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-08T20:20:35.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.target_file_size_base: 67108864 2023-12-08T20:20:35.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-08T20:20:35.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-08T20:20:35.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-08T20:20:35.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-08T20:20:35.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-08T20:20:35.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-08T20:20:35.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-08T20:20:35.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-08T20:20:35.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-08T20:20:35.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-08T20:20:35.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-08T20:20:35.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-08T20:20:35.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-08T20:20:35.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.arena_block_size: 4194304 2023-12-08T20:20:35.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-08T20:20:35.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-08T20:20:35.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-08T20:20:35.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.disable_auto_compactions: 0 2023-12-08T20:20:35.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-08T20:20:35.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-08T20:20:35.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-08T20:20:35.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-08T20:20:35.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-08T20:20:35.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-08T20:20:35.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-08T20:20:35.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-08T20:20:35.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-08T20:20:35.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-08T20:20:35.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.table_properties_collectors: 2023-12-08T20:20:35.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.inplace_update_support: 0 2023-12-08T20:20:35.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-08T20:20:35.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-08T20:20:35.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-08T20:20:35.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-08T20:20:35.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.bloom_locality: 0 2023-12-08T20:20:35.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.max_successive_merges: 0 2023-12-08T20:20:35.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-08T20:20:35.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.paranoid_file_checks: 0 2023-12-08T20:20:35.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.force_consistency_checks: 1 2023-12-08T20:20:35.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.report_bg_io_stats: 0 2023-12-08T20:20:35.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.ttl: 2592000 2023-12-08T20:20:35.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-08T20:20:35.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.enable_blob_files: false 2023-12-08T20:20:35.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.min_blob_size: 0 2023-12-08T20:20:35.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.blob_file_size: 268435456 2023-12-08T20:20:35.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-08T20:20:35.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-08T20:20:35.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-08T20:20:35.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi043/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-08T20:20:35.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2023-12-08T20:20:35.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2023-12-08T20:20:35.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702066835363582, "job": 1, "event": "recovery_started", "wal_files": [10]} 2023-12-08T20:20:35.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2023-12-08T20:20:35.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-08T20:20:35.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702066835364474, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 90856, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 88951, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13169, "raw_average_key_size": 49, "raw_value_size": 81729, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 264, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1702066835, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "566da84b-9dcc-4abc-9859-d2ca306baf63", "db_session_id": "XY6YDETEML26WZAKE8RE"}} 2023-12-08T20:20:35.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2023-12-08T20:20:35.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702066835364897, "job": 1, "event": "recovery_finished"} 2023-12-08T20:20:35.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi043/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-08T20:20:35.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x5562f4a07180 2023-12-08T20:20:35.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: DB pointer 0x5562f4adc000 2023-12-08T20:20:35.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-08T20:20:35.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-08T20:20:35.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: ** DB Stats ** 2023-12-08T20:20:35.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-08T20:20:35.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-08T20:20:35.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-08T20:20:35.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-08T20:20:35.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-08T20:20:35.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-08T20:20:35.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-08T20:20:35.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: 2023-12-08T20:20:35.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: ** Compaction Stats [default] ** 2023-12-08T20:20:35.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-08T20:20:35.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-08T20:20:35.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: L0 2/0 90.52 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 154.2 0.00 0.00 1 0.001 0 0 2023-12-08T20:20:35.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Sum 2/0 90.52 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 154.2 0.00 0.00 1 0.001 0 0 2023-12-08T20:20:35.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 154.2 0.00 0.00 1 0.001 0 0 2023-12-08T20:20:35.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: 2023-12-08T20:20:35.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: ** Compaction Stats [default] ** 2023-12-08T20:20:35.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-08T20:20:35.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-08T20:20:35.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 154.2 0.00 0.00 1 0.001 0 0 2023-12-08T20:20:35.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-08T20:20:35.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-08T20:20:35.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-08T20:20:35.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-08T20:20:35.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-08T20:20:35.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-08T20:20:35.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Cumulative compaction: 0.00 GB write, 23.84 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-08T20:20:35.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Interval compaction: 0.00 GB write, 23.84 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-08T20:20:35.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-08T20:20:35.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: 2023-12-08T20:20:35.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-08T20:20:35.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: 2023-12-08T20:20:35.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: ** Compaction Stats [default] ** 2023-12-08T20:20:35.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-08T20:20:35.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-08T20:20:35.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: L0 2/0 90.52 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 154.2 0.00 0.00 1 0.001 0 0 2023-12-08T20:20:35.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Sum 2/0 90.52 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 154.2 0.00 0.00 1 0.001 0 0 2023-12-08T20:20:35.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-08T20:20:35.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: 2023-12-08T20:20:35.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: ** Compaction Stats [default] ** 2023-12-08T20:20:35.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-08T20:20:35.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-08T20:20:35.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 154.2 0.00 0.00 1 0.001 0 0 2023-12-08T20:20:35.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-08T20:20:35.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-08T20:20:35.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-08T20:20:35.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-08T20:20:35.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-08T20:20:35.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-08T20:20:35.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Cumulative compaction: 0.00 GB write, 23.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-08T20:20:35.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-08T20:20:35.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-08T20:20:35.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: 2023-12-08T20:20:35.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-08T20:20:35.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: starting mon.smithi043 rank 0 at public addrs [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] at bind addrs [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi043 fsid 28476818-9607-11ee-95a3-87774f69a715 2023-12-08T20:20:35.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: mon.smithi043@-1(???) e1 preinit fsid 28476818-9607-11ee-95a3-87774f69a715 2023-12-08T20:20:35.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: mon.smithi043@-1(???).mds e1 new map 2023-12-08T20:20:35.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: mon.smithi043@-1(???).mds e1 print_map 2023-12-08T20:20:35.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: e1 2023-12-08T20:20:35.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-08T20:20:35.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:20:35.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: legacy client fscid: -1 2023-12-08T20:20:35.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: 2023-12-08T20:20:35.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: No filesystems configured 2023-12-08T20:20:35.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: mon.smithi043@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-08T20:20:35.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: mon.smithi043@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-08T20:20:35.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: mon.smithi043@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-08T20:20:35.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: mon.smithi043@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-08T20:20:35.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: mon.smithi043@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-12-08T20:20:35.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: mon.smithi043 is new leader, mons smithi043 in quorum (ranks 0) 2023-12-08T20:20:35.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: monmap e1: 1 mons at {smithi043=[v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-08T20:20:35.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: fsmap 2023-12-08T20:20:35.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: osdmap e1: 0 total, 0 up, 0 in 2023-12-08T20:20:35.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:35 smithi043 ceph-mon[111966]: mgrmap e1: no daemons active 2023-12-08T20:20:37.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:36 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/4270935547' entity='client.admin' 2023-12-08T20:20:37.313 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.772+0000 7f37dfe01700 1 Processor -- start 2023-12-08T20:20:37.313 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.772+0000 7f37dfe01700 1 -- start start 2023-12-08T20:20:37.314 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.772+0000 7f37dfe01700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d8076c60 0x7f37d8104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:37.314 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.772+0000 7f37dfe01700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d81053d0 con 0x7f37d8076c60 2023-12-08T20:20:37.314 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.773+0000 7f37ddb9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d8076c60 0x7f37d8104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:37.314 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.773+0000 7f37ddb9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d8076c60 0x7f37d8104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33956/0 (socket says 172.21.15.43:33956) 2023-12-08T20:20:37.314 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.773+0000 7f37ddb9d700 1 -- 172.21.15.43:0/1683394771 learned_addr learned my addr 172.21.15.43:0/1683394771 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:37.314 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.773+0000 7f37ddb9d700 1 -- 172.21.15.43:0/1683394771 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d8105510 con 0x7f37d8076c60 2023-12-08T20:20:37.314 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.773+0000 7f37ddb9d700 1 --2- 172.21.15.43:0/1683394771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d8076c60 0x7f37d8104e90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f37d40098e0 tx=0x7f37d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e16b74372668c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:37.314 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.773+0000 7f37dcb9b700 1 -- 172.21.15.43:0/1683394771 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37d400b860 con 0x7f37d8076c60 2023-12-08T20:20:37.314 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.773+0000 7f37dcb9b700 1 -- 172.21.15.43:0/1683394771 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f37d400be30 con 0x7f37d8076c60 2023-12-08T20:20:37.314 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.773+0000 7f37dcb9b700 1 -- 172.21.15.43:0/1683394771 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37d4010380 con 0x7f37d8076c60 2023-12-08T20:20:37.314 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.774+0000 7f37dfe01700 1 -- 172.21.15.43:0/1683394771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d8076c60 msgr2=0x7f37d8104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:37.314 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.774+0000 7f37dfe01700 1 --2- 172.21.15.43:0/1683394771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d8076c60 0x7f37d8104e90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f37d40098e0 tx=0x7f37d4009250 comp rx=0 tx=0).stop 2023-12-08T20:20:37.314 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.774+0000 7f37dfe01700 1 -- 172.21.15.43:0/1683394771 shutdown_connections 2023-12-08T20:20:37.315 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.774+0000 7f37dfe01700 1 --2- 172.21.15.43:0/1683394771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d8076c60 0x7f37d8104e90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:37.318 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.774+0000 7f37dfe01700 1 -- 172.21.15.43:0/1683394771 >> 172.21.15.43:0/1683394771 conn(0x7f37d80fc980 msgr2=0x7f37d80fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:37.318 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.774+0000 7f37dfe01700 1 -- 172.21.15.43:0/1683394771 shutdown_connections 2023-12-08T20:20:37.318 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.774+0000 7f37dfe01700 1 -- 172.21.15.43:0/1683394771 wait complete. 2023-12-08T20:20:37.318 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.775+0000 7f37dfe01700 1 Processor -- start 2023-12-08T20:20:37.318 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.775+0000 7f37dfe01700 1 -- start start 2023-12-08T20:20:37.318 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.775+0000 7f37dfe01700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d8076c60 0x7f37d8111120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:37.318 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.775+0000 7f37dfe01700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d8111660 con 0x7f37d8076c60 2023-12-08T20:20:37.319 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.775+0000 7f37ddb9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d8076c60 0x7f37d8111120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:37.319 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.775+0000 7f37ddb9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d8076c60 0x7f37d8111120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33970/0 (socket says 172.21.15.43:33970) 2023-12-08T20:20:37.319 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.775+0000 7f37ddb9d700 1 -- 172.21.15.43:0/4270935547 learned_addr learned my addr 172.21.15.43:0/4270935547 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:37.319 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.776+0000 7f37ddb9d700 1 -- 172.21.15.43:0/4270935547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d40094f0 con 0x7f37d8076c60 2023-12-08T20:20:37.319 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.776+0000 7f37ddb9d700 1 --2- 172.21.15.43:0/4270935547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d8076c60 0x7f37d8111120 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f37d4006d40 tx=0x7f37d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:37.319 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.776+0000 7f37ce7fc700 1 -- 172.21.15.43:0/4270935547 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37d40109b0 con 0x7f37d8076c60 2023-12-08T20:20:37.319 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.776+0000 7f37ce7fc700 1 -- 172.21.15.43:0/4270935547 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f37d4024440 con 0x7f37d8076c60 2023-12-08T20:20:37.319 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.776+0000 7f37dfe01700 1 -- 172.21.15.43:0/4270935547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d8111860 con 0x7f37d8076c60 2023-12-08T20:20:37.319 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.776+0000 7f37ce7fc700 1 -- 172.21.15.43:0/4270935547 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37d401a5f0 con 0x7f37d8076c60 2023-12-08T20:20:37.319 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.776+0000 7f37dfe01700 1 -- 172.21.15.43:0/4270935547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d8111c70 con 0x7f37d8076c60 2023-12-08T20:20:37.320 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.776+0000 7f37ce7fc700 1 -- 172.21.15.43:0/4270935547 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f37d401aaa0 con 0x7f37d8076c60 2023-12-08T20:20:37.320 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.776+0000 7f37ce7fc700 1 -- 172.21.15.43:0/4270935547 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f37d402da40 con 0x7f37d8076c60 2023-12-08T20:20:37.320 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.777+0000 7f37dfe01700 1 -- 172.21.15.43:0/4270935547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d804bb80 con 0x7f37d8076c60 2023-12-08T20:20:37.320 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.779+0000 7f37ce7fc700 1 -- 172.21.15.43:0/4270935547 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f37d4024970 con 0x7f37d8076c60 2023-12-08T20:20:37.320 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.852+0000 7f37dfe01700 1 -- 172.21.15.43:0/4270935547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f37d81062f0 con 0x7f37d8076c60 2023-12-08T20:20:37.320 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.855+0000 7f37ce7fc700 1 -- 172.21.15.43:0/4270935547 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f37d81062f0 con 0x7f37d8076c60 2023-12-08T20:20:37.320 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.856+0000 7f37dfe01700 1 -- 172.21.15.43:0/4270935547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d8076c60 msgr2=0x7f37d8111120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:37.320 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.856+0000 7f37dfe01700 1 --2- 172.21.15.43:0/4270935547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d8076c60 0x7f37d8111120 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f37d4006d40 tx=0x7f37d4009250 comp rx=0 tx=0).stop 2023-12-08T20:20:37.320 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.856+0000 7f37dfe01700 1 -- 172.21.15.43:0/4270935547 shutdown_connections 2023-12-08T20:20:37.320 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.856+0000 7f37dfe01700 1 --2- 172.21.15.43:0/4270935547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d8076c60 0x7f37d8111120 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:37.320 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.856+0000 7f37dfe01700 1 -- 172.21.15.43:0/4270935547 >> 172.21.15.43:0/4270935547 conn(0x7f37d80fc980 msgr2=0x7f37d80fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:37.320 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.856+0000 7f37dfe01700 1 -- 172.21.15.43:0/4270935547 shutdown_connections 2023-12-08T20:20:37.320 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:35.856+0000 7f37dfe01700 1 -- 172.21.15.43:0/4270935547 wait complete. 2023-12-08T20:20:37.320 INFO:teuthology.orchestra.run.smithi043.stdout:Wrote config to /etc/ceph/ceph.conf 2023-12-08T20:20:37.321 INFO:teuthology.orchestra.run.smithi043.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-12-08T20:20:37.321 INFO:teuthology.orchestra.run.smithi043.stdout:Creating mgr... 2023-12-08T20:20:37.321 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying port 9283 ... 2023-12-08T20:20:37.469 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-28476818-9607-11ee-95a3-87774f69a715@mgr.smithi043.hqcdcm 2023-12-08T20:20:37.469 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Failed to reset failed state of unit ceph-28476818-9607-11ee-95a3-87774f69a715@mgr.smithi043.hqcdcm.service: Unit ceph-28476818-9607-11ee-95a3-87774f69a715@mgr.smithi043.hqcdcm.service not loaded. 2023-12-08T20:20:37.573 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-28476818-9607-11ee-95a3-87774f69a715.target.wants/ceph-28476818-9607-11ee-95a3-87774f69a715@mgr.smithi043.hqcdcm.service → /etc/systemd/system/ceph-28476818-9607-11ee-95a3-87774f69a715@.service. 2023-12-08T20:20:38.606 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-08T20:20:38.606 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout disabled 2023-12-08T20:20:38.616 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-08T20:20:38.616 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2023-12-08T20:20:38.616 INFO:teuthology.orchestra.run.smithi043.stdout:firewalld.service is not enabled 2023-12-08T20:20:38.617 INFO:teuthology.orchestra.run.smithi043.stdout:Not possible to enable service . firewalld.service is not available 2023-12-08T20:20:38.626 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-08T20:20:38.626 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout disabled 2023-12-08T20:20:38.636 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-08T20:20:38.636 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2023-12-08T20:20:38.636 INFO:teuthology.orchestra.run.smithi043.stdout:firewalld.service is not enabled 2023-12-08T20:20:38.636 INFO:teuthology.orchestra.run.smithi043.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2023-12-08T20:20:38.636 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mgr to start... 2023-12-08T20:20:38.636 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mgr... 2023-12-08T20:20:39.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:39 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/563866204' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-08T20:20:39.475 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2023-12-08T20:20:39.478 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2023-12-08T20:20:39.478 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsid": "28476818-9607-11ee-95a3-87774f69a715", 2023-12-08T20:20:39.478 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "health": { 2023-12-08T20:20:39.478 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-08T20:20:39.478 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-08T20:20:39.478 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-08T20:20:39.478 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:39.478 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-08T20:20:39.478 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-08T20:20:39.478 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 0 2023-12-08T20:20:39.478 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2023-12-08T20:20:39.478 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-08T20:20:39.478 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "smithi043" 2023-12-08T20:20:39.479 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2023-12-08T20:20:39.479 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2023-12-08T20:20:39.479 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-08T20:20:39.479 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-08T20:20:39.479 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-08T20:20:39.479 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-08T20:20:39.479 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:39.479 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-08T20:20:39.479 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-08T20:20:39.479 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-08T20:20:39.479 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-08T20:20:39.479 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-08T20:20:39.486 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-08T20:20:39.486 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-08T20:20:39.486 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-08T20:20:39.487 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:39.487 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-08T20:20:39.487 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-08T20:20:39.487 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-08T20:20:39.487 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-08T20:20:39.487 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-08T20:20:39.487 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-08T20:20:39.487 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-08T20:20:39.487 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-08T20:20:39.487 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-08T20:20:39.487 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:39.487 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-08T20:20:39.487 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-08T20:20:39.487 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-08T20:20:39.487 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-08T20:20:39.488 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:39.488 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-08T20:20:39.488 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-08T20:20:39.488 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-08T20:20:39.488 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-08T20:20:39.488 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-08T20:20:39.488 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-08T20:20:39.488 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "restful" 2023-12-08T20:20:39.488 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2023-12-08T20:20:39.488 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-08T20:20:39.488 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:39.488 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-08T20:20:39.488 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-08T20:20:39.488 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modified": "2023-12-08T20:20:31.669954+0000", 2023-12-08T20:20:39.488 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-08T20:20:39.488 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:39.489 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-08T20:20:39.489 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2023-12-08T20:20:39.489 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.043+0000 7fddd53b1700 1 Processor -- start 2023-12-08T20:20:39.489 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.043+0000 7fddd53b1700 1 -- start start 2023-12-08T20:20:39.489 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.043+0000 7fddd53b1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddd0076c00 0x7fddd0104ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:39.489 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.043+0000 7fddd53b1700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd0105430 con 0x7fddd0076c00 2023-12-08T20:20:39.489 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.044+0000 7fddceffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddd0076c00 0x7fddd0104ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:39.489 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.044+0000 7fddceffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddd0076c00 0x7fddd0104ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33996/0 (socket says 172.21.15.43:33996) 2023-12-08T20:20:39.489 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.044+0000 7fddceffd700 1 -- 172.21.15.43:0/2671413757 learned_addr learned my addr 172.21.15.43:0/2671413757 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:39.489 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.044+0000 7fddceffd700 1 -- 172.21.15.43:0/2671413757 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd0105570 con 0x7fddd0076c00 2023-12-08T20:20:39.489 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.044+0000 7fddceffd700 1 --2- 172.21.15.43:0/2671413757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddd0076c00 0x7fddd0104ef0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fddc00098e0 tx=0x7fddc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506794743ee9e040 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:39.489 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.044+0000 7fddcdffb700 1 -- 172.21.15.43:0/2671413757 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fddc000b860 con 0x7fddd0076c00 2023-12-08T20:20:39.489 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.045+0000 7fddcdffb700 1 -- 172.21.15.43:0/2671413757 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fddc000be30 con 0x7fddd0076c00 2023-12-08T20:20:39.489 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.045+0000 7fddcdffb700 1 -- 172.21.15.43:0/2671413757 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fddc0010380 con 0x7fddd0076c00 2023-12-08T20:20:39.489 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.045+0000 7fddd53b1700 1 -- 172.21.15.43:0/2671413757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddd0076c00 msgr2=0x7fddd0104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:39.489 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.045+0000 7fddd53b1700 1 --2- 172.21.15.43:0/2671413757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddd0076c00 0x7fddd0104ef0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fddc00098e0 tx=0x7fddc0009250 comp rx=0 tx=0).stop 2023-12-08T20:20:39.490 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.045+0000 7fddd53b1700 1 -- 172.21.15.43:0/2671413757 shutdown_connections 2023-12-08T20:20:39.490 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.045+0000 7fddd53b1700 1 --2- 172.21.15.43:0/2671413757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddd0076c00 0x7fddd0104ef0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:39.490 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.045+0000 7fddd53b1700 1 -- 172.21.15.43:0/2671413757 >> 172.21.15.43:0/2671413757 conn(0x7fddd00fc980 msgr2=0x7fddd00fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:39.490 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.046+0000 7fddd53b1700 1 -- 172.21.15.43:0/2671413757 shutdown_connections 2023-12-08T20:20:39.490 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.046+0000 7fddd53b1700 1 -- 172.21.15.43:0/2671413757 wait complete. 2023-12-08T20:20:39.490 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.047+0000 7fddd53b1700 1 Processor -- start 2023-12-08T20:20:39.490 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.047+0000 7fddd53b1700 1 -- start start 2023-12-08T20:20:39.490 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.047+0000 7fddd53b1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddd0076c00 0x7fddd0111190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:39.490 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.047+0000 7fddd53b1700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd01116d0 con 0x7fddd0076c00 2023-12-08T20:20:39.490 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.047+0000 7fddceffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddd0076c00 0x7fddd0111190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:39.490 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.047+0000 7fddceffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddd0076c00 0x7fddd0111190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34006/0 (socket says 172.21.15.43:34006) 2023-12-08T20:20:39.490 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.047+0000 7fddceffd700 1 -- 172.21.15.43:0/563866204 learned_addr learned my addr 172.21.15.43:0/563866204 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:39.490 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.047+0000 7fddceffd700 1 -- 172.21.15.43:0/563866204 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc00094f0 con 0x7fddd0076c00 2023-12-08T20:20:39.490 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.048+0000 7fddceffd700 1 --2- 172.21.15.43:0/563866204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddd0076c00 0x7fddd0111190 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fddc000ba90 tx=0x7fddc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:39.490 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.048+0000 7fddc77fe700 1 -- 172.21.15.43:0/563866204 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fddc0010ad0 con 0x7fddd0076c00 2023-12-08T20:20:39.491 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.048+0000 7fddc77fe700 1 -- 172.21.15.43:0/563866204 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fddc0010c30 con 0x7fddd0076c00 2023-12-08T20:20:39.491 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.048+0000 7fddd53b1700 1 -- 172.21.15.43:0/563866204 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd01118d0 con 0x7fddd0076c00 2023-12-08T20:20:39.491 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.048+0000 7fddc77fe700 1 -- 172.21.15.43:0/563866204 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fddc001a430 con 0x7fddd0076c00 2023-12-08T20:20:39.491 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.048+0000 7fddd53b1700 1 -- 172.21.15.43:0/563866204 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd0111ce0 con 0x7fddd0076c00 2023-12-08T20:20:39.491 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.049+0000 7fddc77fe700 1 -- 172.21.15.43:0/563866204 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fddc001a6f0 con 0x7fddd0076c00 2023-12-08T20:20:39.491 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.049+0000 7fddc77fe700 1 -- 172.21.15.43:0/563866204 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fddc002d740 con 0x7fddd0076c00 2023-12-08T20:20:39.491 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.049+0000 7fddd53b1700 1 -- 172.21.15.43:0/563866204 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd004bb80 con 0x7fddd0076c00 2023-12-08T20:20:39.491 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.052+0000 7fddc77fe700 1 -- 172.21.15.43:0/563866204 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fddc0029070 con 0x7fddd0076c00 2023-12-08T20:20:39.491 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.127+0000 7fddd53b1700 1 -- 172.21.15.43:0/563866204 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fddd01062f0 con 0x7fddd0076c00 2023-12-08T20:20:39.491 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.128+0000 7fddc77fe700 1 -- 172.21.15.43:0/563866204 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fddc0024830 con 0x7fddd0076c00 2023-12-08T20:20:39.491 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.129+0000 7fddd53b1700 1 -- 172.21.15.43:0/563866204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddd0076c00 msgr2=0x7fddd0111190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:39.491 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.129+0000 7fddd53b1700 1 --2- 172.21.15.43:0/563866204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddd0076c00 0x7fddd0111190 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fddc000ba90 tx=0x7fddc0009250 comp rx=0 tx=0).stop 2023-12-08T20:20:39.491 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.129+0000 7fddd53b1700 1 -- 172.21.15.43:0/563866204 shutdown_connections 2023-12-08T20:20:39.491 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.129+0000 7fddd53b1700 1 --2- 172.21.15.43:0/563866204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddd0076c00 0x7fddd0111190 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:39.491 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.129+0000 7fddd53b1700 1 -- 172.21.15.43:0/563866204 >> 172.21.15.43:0/563866204 conn(0x7fddd00fc980 msgr2=0x7fddd00fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:39.492 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.129+0000 7fddd53b1700 1 -- 172.21.15.43:0/563866204 shutdown_connections 2023-12-08T20:20:39.492 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:39.129+0000 7fddd53b1700 1 -- 172.21.15.43:0/563866204 wait complete. 2023-12-08T20:20:39.492 INFO:teuthology.orchestra.run.smithi043.stdout:mgr not available, waiting (1/15)... 2023-12-08T20:20:42.318 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:42 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3188590447' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-08T20:20:42.411 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2023-12-08T20:20:42.411 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2023-12-08T20:20:42.411 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsid": "28476818-9607-11ee-95a3-87774f69a715", 2023-12-08T20:20:42.411 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "health": { 2023-12-08T20:20:42.411 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-08T20:20:42.411 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-08T20:20:42.411 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-08T20:20:42.411 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:42.411 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-08T20:20:42.411 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-08T20:20:42.411 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 0 2023-12-08T20:20:42.411 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2023-12-08T20:20:42.412 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-08T20:20:42.412 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "smithi043" 2023-12-08T20:20:42.412 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2023-12-08T20:20:42.412 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2023-12-08T20:20:42.412 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-08T20:20:42.412 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-08T20:20:42.412 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-08T20:20:42.412 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-08T20:20:42.413 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:42.413 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-08T20:20:42.413 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-08T20:20:42.413 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-08T20:20:42.413 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-08T20:20:42.413 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-08T20:20:42.413 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-08T20:20:42.413 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-08T20:20:42.414 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-08T20:20:42.414 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:42.414 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-08T20:20:42.414 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-08T20:20:42.414 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-08T20:20:42.414 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-08T20:20:42.414 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-08T20:20:42.414 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-08T20:20:42.414 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-08T20:20:42.414 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-08T20:20:42.415 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-08T20:20:42.415 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:42.415 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-08T20:20:42.415 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-08T20:20:42.415 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-08T20:20:42.415 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-08T20:20:42.415 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:42.415 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-08T20:20:42.415 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-08T20:20:42.415 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-08T20:20:42.415 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-08T20:20:42.415 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-08T20:20:42.416 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-08T20:20:42.416 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "restful" 2023-12-08T20:20:42.416 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2023-12-08T20:20:42.416 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-08T20:20:42.416 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:42.416 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-08T20:20:42.416 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-08T20:20:42.416 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modified": "2023-12-08T20:20:31.669954+0000", 2023-12-08T20:20:42.416 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-08T20:20:42.416 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:42.416 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-08T20:20:42.416 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2023-12-08T20:20:42.416 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.954+0000 7fb5b3474700 1 Processor -- start 2023-12-08T20:20:42.416 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.955+0000 7fb5b3474700 1 -- start start 2023-12-08T20:20:42.417 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.955+0000 7fb5b3474700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5ac1011d0 0x7fb5ac1015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:42.417 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.955+0000 7fb5b3474700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac101b20 con 0x7fb5ac1011d0 2023-12-08T20:20:42.417 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.955+0000 7fb5b1210700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5ac1011d0 0x7fb5ac1015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:42.417 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.955+0000 7fb5b1210700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5ac1011d0 0x7fb5ac1015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52548/0 (socket says 172.21.15.43:52548) 2023-12-08T20:20:42.417 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.955+0000 7fb5b1210700 1 -- 172.21.15.43:0/3888244511 learned_addr learned my addr 172.21.15.43:0/3888244511 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:42.417 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.955+0000 7fb5b1210700 1 -- 172.21.15.43:0/3888244511 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac101c60 con 0x7fb5ac1011d0 2023-12-08T20:20:42.417 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.955+0000 7fb5b1210700 1 --2- 172.21.15.43:0/3888244511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5ac1011d0 0x7fb5ac1015e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb5a800bb80 tx=0x7fb5a800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2806a5f0f8d6f705 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:42.418 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.956+0000 7fb5a3fff700 1 -- 172.21.15.43:0/3888244511 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5a800dd00 con 0x7fb5ac1011d0 2023-12-08T20:20:42.418 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.956+0000 7fb5a3fff700 1 -- 172.21.15.43:0/3888244511 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fb5a800de60 con 0x7fb5ac1011d0 2023-12-08T20:20:42.418 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.956+0000 7fb5a3fff700 1 -- 172.21.15.43:0/3888244511 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5a8018840 con 0x7fb5ac1011d0 2023-12-08T20:20:42.418 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.956+0000 7fb5b3474700 1 -- 172.21.15.43:0/3888244511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5ac1011d0 msgr2=0x7fb5ac1015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:42.418 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.956+0000 7fb5b3474700 1 --2- 172.21.15.43:0/3888244511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5ac1011d0 0x7fb5ac1015e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb5a800bb80 tx=0x7fb5a800b4f0 comp rx=0 tx=0).stop 2023-12-08T20:20:42.418 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.956+0000 7fb5b3474700 1 -- 172.21.15.43:0/3888244511 shutdown_connections 2023-12-08T20:20:42.418 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.956+0000 7fb5b3474700 1 --2- 172.21.15.43:0/3888244511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5ac1011d0 0x7fb5ac1015e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:42.418 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.956+0000 7fb5b3474700 1 -- 172.21.15.43:0/3888244511 >> 172.21.15.43:0/3888244511 conn(0x7fb5ac0fc970 msgr2=0x7fb5ac0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:42.418 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.957+0000 7fb5b3474700 1 -- 172.21.15.43:0/3888244511 shutdown_connections 2023-12-08T20:20:42.418 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.957+0000 7fb5b3474700 1 -- 172.21.15.43:0/3888244511 wait complete. 2023-12-08T20:20:42.418 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.957+0000 7fb5b3474700 1 Processor -- start 2023-12-08T20:20:42.418 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.957+0000 7fb5b3474700 1 -- start start 2023-12-08T20:20:42.419 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.957+0000 7fb5b3474700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5ac1011d0 0x7fb5ac10ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:42.419 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.957+0000 7fb5b3474700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac10f450 con 0x7fb5ac1011d0 2023-12-08T20:20:42.419 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.957+0000 7fb5b1210700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5ac1011d0 0x7fb5ac10ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:42.419 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.957+0000 7fb5b1210700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5ac1011d0 0x7fb5ac10ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52558/0 (socket says 172.21.15.43:52558) 2023-12-08T20:20:42.419 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.957+0000 7fb5b1210700 1 -- 172.21.15.43:0/3188590447 learned_addr learned my addr 172.21.15.43:0/3188590447 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:42.419 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.958+0000 7fb5b1210700 1 -- 172.21.15.43:0/3188590447 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a800b790 con 0x7fb5ac1011d0 2023-12-08T20:20:42.419 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.958+0000 7fb5b1210700 1 --2- 172.21.15.43:0/3188590447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5ac1011d0 0x7fb5ac10ef10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8006d40 tx=0x7fb5a800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:42.419 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.958+0000 7fb5a1ffb700 1 -- 172.21.15.43:0/3188590447 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5a8010a00 con 0x7fb5ac1011d0 2023-12-08T20:20:42.419 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.958+0000 7fb5a1ffb700 1 -- 172.21.15.43:0/3188590447 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fb5a801d050 con 0x7fb5ac1011d0 2023-12-08T20:20:42.419 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.958+0000 7fb5b3474700 1 -- 172.21.15.43:0/3188590447 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ac10f650 con 0x7fb5ac1011d0 2023-12-08T20:20:42.419 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.958+0000 7fb5a1ffb700 1 -- 172.21.15.43:0/3188590447 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5a8022590 con 0x7fb5ac1011d0 2023-12-08T20:20:42.420 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.958+0000 7fb5b3474700 1 -- 172.21.15.43:0/3188590447 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ac10fa60 con 0x7fb5ac1011d0 2023-12-08T20:20:42.420 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.959+0000 7fb5a1ffb700 1 -- 172.21.15.43:0/3188590447 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb5a8022740 con 0x7fb5ac1011d0 2023-12-08T20:20:42.420 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.959+0000 7fb5a1ffb700 1 -- 172.21.15.43:0/3188590447 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb5a8014070 con 0x7fb5ac1011d0 2023-12-08T20:20:42.420 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.959+0000 7fb5b3474700 1 -- 172.21.15.43:0/3188590447 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ac04bb80 con 0x7fb5ac1011d0 2023-12-08T20:20:42.420 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:41.962+0000 7fb5a1ffb700 1 -- 172.21.15.43:0/3188590447 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb5a8010b60 con 0x7fb5ac1011d0 2023-12-08T20:20:42.420 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:42.039+0000 7fb5b3474700 1 -- 172.21.15.43:0/3188590447 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb5ac102fe0 con 0x7fb5ac1011d0 2023-12-08T20:20:42.420 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:42.039+0000 7fb5a1ffb700 1 -- 172.21.15.43:0/3188590447 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fb5a8022b80 con 0x7fb5ac1011d0 2023-12-08T20:20:42.420 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:42.040+0000 7fb5b3474700 1 -- 172.21.15.43:0/3188590447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5ac1011d0 msgr2=0x7fb5ac10ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:42.420 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:42.040+0000 7fb5b3474700 1 --2- 172.21.15.43:0/3188590447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5ac1011d0 0x7fb5ac10ef10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8006d40 tx=0x7fb5a800b4f0 comp rx=0 tx=0).stop 2023-12-08T20:20:42.420 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:42.040+0000 7fb5b3474700 1 -- 172.21.15.43:0/3188590447 shutdown_connections 2023-12-08T20:20:42.420 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:42.040+0000 7fb5b3474700 1 --2- 172.21.15.43:0/3188590447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5ac1011d0 0x7fb5ac10ef10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:42.421 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:42.040+0000 7fb5b3474700 1 -- 172.21.15.43:0/3188590447 >> 172.21.15.43:0/3188590447 conn(0x7fb5ac0fc970 msgr2=0x7fb5ac105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:42.421 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:42.040+0000 7fb5b3474700 1 -- 172.21.15.43:0/3188590447 shutdown_connections 2023-12-08T20:20:42.421 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:42.040+0000 7fb5b3474700 1 -- 172.21.15.43:0/3188590447 wait complete. 2023-12-08T20:20:42.421 INFO:teuthology.orchestra.run.smithi043.stdout:mgr not available, waiting (2/15)... 2023-12-08T20:20:45.081 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:44 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/2465650887' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-08T20:20:45.267 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2023-12-08T20:20:45.267 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2023-12-08T20:20:45.268 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsid": "28476818-9607-11ee-95a3-87774f69a715", 2023-12-08T20:20:45.268 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "health": { 2023-12-08T20:20:45.268 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-08T20:20:45.268 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-08T20:20:45.268 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-08T20:20:45.268 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:45.268 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-08T20:20:45.268 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-08T20:20:45.268 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 0 2023-12-08T20:20:45.268 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2023-12-08T20:20:45.268 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-08T20:20:45.268 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "smithi043" 2023-12-08T20:20:45.268 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2023-12-08T20:20:45.268 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2023-12-08T20:20:45.268 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-08T20:20:45.268 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-08T20:20:45.268 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-08T20:20:45.269 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-08T20:20:45.269 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:45.269 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-08T20:20:45.269 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-08T20:20:45.269 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-08T20:20:45.269 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-08T20:20:45.269 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-08T20:20:45.269 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-08T20:20:45.269 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-08T20:20:45.269 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-08T20:20:45.269 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:45.269 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-08T20:20:45.269 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-08T20:20:45.269 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-08T20:20:45.269 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-08T20:20:45.270 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-08T20:20:45.270 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-08T20:20:45.270 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-08T20:20:45.270 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-08T20:20:45.270 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-08T20:20:45.270 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:45.270 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-08T20:20:45.270 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-08T20:20:45.270 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-08T20:20:45.270 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-08T20:20:45.270 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:45.270 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-08T20:20:45.270 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-08T20:20:45.270 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-08T20:20:45.270 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-08T20:20:45.270 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-08T20:20:45.271 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-08T20:20:45.271 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "restful" 2023-12-08T20:20:45.271 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2023-12-08T20:20:45.271 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-08T20:20:45.271 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:45.271 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-08T20:20:45.271 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-08T20:20:45.271 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modified": "2023-12-08T20:20:31.669954+0000", 2023-12-08T20:20:45.271 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-08T20:20:45.271 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:45.271 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-08T20:20:45.271 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2023-12-08T20:20:45.271 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.810+0000 7fa85aac0700 1 Processor -- start 2023-12-08T20:20:45.271 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.811+0000 7fa85aac0700 1 -- start start 2023-12-08T20:20:45.271 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.811+0000 7fa85aac0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa854071000 0x7fa854104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:45.271 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.811+0000 7fa85aac0700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8541053e0 con 0x7fa854071000 2023-12-08T20:20:45.272 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.811+0000 7fa85885c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa854071000 0x7fa854104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:45.272 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.811+0000 7fa85885c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa854071000 0x7fa854104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52562/0 (socket says 172.21.15.43:52562) 2023-12-08T20:20:45.272 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.811+0000 7fa85885c700 1 -- 172.21.15.43:0/4169303763 learned_addr learned my addr 172.21.15.43:0/4169303763 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:45.272 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.811+0000 7fa85885c700 1 -- 172.21.15.43:0/4169303763 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa854105520 con 0x7fa854071000 2023-12-08T20:20:45.272 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.811+0000 7fa85885c700 1 --2- 172.21.15.43:0/4169303763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa854071000 0x7fa854104ea0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa8480098e0 tx=0x7fa848009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3116d82ae173aaf server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:45.272 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.812+0000 7fa8537fe700 1 -- 172.21.15.43:0/4169303763 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa84800b860 con 0x7fa854071000 2023-12-08T20:20:45.272 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.812+0000 7fa8537fe700 1 -- 172.21.15.43:0/4169303763 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa84800be30 con 0x7fa854071000 2023-12-08T20:20:45.272 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.812+0000 7fa8537fe700 1 -- 172.21.15.43:0/4169303763 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa848010380 con 0x7fa854071000 2023-12-08T20:20:45.272 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.812+0000 7fa85aac0700 1 -- 172.21.15.43:0/4169303763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa854071000 msgr2=0x7fa854104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:45.272 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.812+0000 7fa85aac0700 1 --2- 172.21.15.43:0/4169303763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa854071000 0x7fa854104ea0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa8480098e0 tx=0x7fa848009250 comp rx=0 tx=0).stop 2023-12-08T20:20:45.272 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.812+0000 7fa85aac0700 1 -- 172.21.15.43:0/4169303763 shutdown_connections 2023-12-08T20:20:45.272 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.812+0000 7fa85aac0700 1 --2- 172.21.15.43:0/4169303763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa854071000 0x7fa854104ea0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:45.272 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.812+0000 7fa85aac0700 1 -- 172.21.15.43:0/4169303763 >> 172.21.15.43:0/4169303763 conn(0x7fa8540fc970 msgr2=0x7fa8540fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:45.272 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.812+0000 7fa85aac0700 1 -- 172.21.15.43:0/4169303763 shutdown_connections 2023-12-08T20:20:45.272 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.812+0000 7fa85aac0700 1 -- 172.21.15.43:0/4169303763 wait complete. 2023-12-08T20:20:45.273 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.813+0000 7fa85aac0700 1 Processor -- start 2023-12-08T20:20:45.273 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.813+0000 7fa85aac0700 1 -- start start 2023-12-08T20:20:45.273 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.814+0000 7fa85aac0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa854071000 0x7fa854111160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:45.273 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.814+0000 7fa85aac0700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8541116a0 con 0x7fa854071000 2023-12-08T20:20:45.273 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.814+0000 7fa85885c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa854071000 0x7fa854111160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:45.273 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.814+0000 7fa85885c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa854071000 0x7fa854111160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52570/0 (socket says 172.21.15.43:52570) 2023-12-08T20:20:45.273 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.814+0000 7fa85885c700 1 -- 172.21.15.43:0/2465650887 learned_addr learned my addr 172.21.15.43:0/2465650887 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:45.273 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.814+0000 7fa85885c700 1 -- 172.21.15.43:0/2465650887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8480094f0 con 0x7fa854071000 2023-12-08T20:20:45.273 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.814+0000 7fa85885c700 1 --2- 172.21.15.43:0/2465650887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa854071000 0x7fa854111160 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa848006d40 tx=0x7fa848009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:45.273 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.815+0000 7fa8517fa700 1 -- 172.21.15.43:0/2465650887 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8480109b0 con 0x7fa854071000 2023-12-08T20:20:45.273 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.815+0000 7fa8517fa700 1 -- 172.21.15.43:0/2465650887 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa848024440 con 0x7fa854071000 2023-12-08T20:20:45.273 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.815+0000 7fa85aac0700 1 -- 172.21.15.43:0/2465650887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8541118a0 con 0x7fa854071000 2023-12-08T20:20:45.273 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.815+0000 7fa8517fa700 1 -- 172.21.15.43:0/2465650887 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa84801a5f0 con 0x7fa854071000 2023-12-08T20:20:45.273 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.815+0000 7fa85aac0700 1 -- 172.21.15.43:0/2465650887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa854111cb0 con 0x7fa854071000 2023-12-08T20:20:45.273 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.815+0000 7fa8517fa700 1 -- 172.21.15.43:0/2465650887 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa84801aaa0 con 0x7fa854071000 2023-12-08T20:20:45.273 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.815+0000 7fa8517fa700 1 -- 172.21.15.43:0/2465650887 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa84802da40 con 0x7fa854071000 2023-12-08T20:20:45.274 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.816+0000 7fa85aac0700 1 -- 172.21.15.43:0/2465650887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85404bb80 con 0x7fa854071000 2023-12-08T20:20:45.274 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.818+0000 7fa8517fa700 1 -- 172.21.15.43:0/2465650887 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fa848024970 con 0x7fa854071000 2023-12-08T20:20:45.274 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.895+0000 7fa85aac0700 1 -- 172.21.15.43:0/2465650887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa854106300 con 0x7fa854071000 2023-12-08T20:20:45.274 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.896+0000 7fa8517fa700 1 -- 172.21.15.43:0/2465650887 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fa854106300 con 0x7fa854071000 2023-12-08T20:20:45.274 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.897+0000 7fa85aac0700 1 -- 172.21.15.43:0/2465650887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa854071000 msgr2=0x7fa854111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:45.274 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.897+0000 7fa85aac0700 1 --2- 172.21.15.43:0/2465650887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa854071000 0x7fa854111160 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa848006d40 tx=0x7fa848009250 comp rx=0 tx=0).stop 2023-12-08T20:20:45.274 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.897+0000 7fa85aac0700 1 -- 172.21.15.43:0/2465650887 shutdown_connections 2023-12-08T20:20:45.274 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.897+0000 7fa85aac0700 1 --2- 172.21.15.43:0/2465650887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa854071000 0x7fa854111160 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:45.274 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.897+0000 7fa85aac0700 1 -- 172.21.15.43:0/2465650887 >> 172.21.15.43:0/2465650887 conn(0x7fa8540fc970 msgr2=0x7fa8540fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:45.274 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.897+0000 7fa85aac0700 1 -- 172.21.15.43:0/2465650887 shutdown_connections 2023-12-08T20:20:45.274 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:44.897+0000 7fa85aac0700 1 -- 172.21.15.43:0/2465650887 wait complete. 2023-12-08T20:20:45.275 INFO:teuthology.orchestra.run.smithi043.stdout:mgr not available, waiting (3/15)... 2023-12-08T20:20:46.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:46 smithi043 ceph-mon[111966]: Activating manager daemon smithi043.hqcdcm 2023-12-08T20:20:46.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:46 smithi043 ceph-mon[111966]: mgrmap e2: smithi043.hqcdcm(active, starting, since 0.00314229s) 2023-12-08T20:20:46.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:46 smithi043 ceph-mon[111966]: from='mgr.14100 172.21.15.43:0/1257760532' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-08T20:20:46.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:46 smithi043 ceph-mon[111966]: from='mgr.14100 172.21.15.43:0/1257760532' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-08T20:20:46.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:46 smithi043 ceph-mon[111966]: from='mgr.14100 172.21.15.43:0/1257760532' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-08T20:20:46.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:46 smithi043 ceph-mon[111966]: from='mgr.14100 172.21.15.43:0/1257760532' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:20:46.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:46 smithi043 ceph-mon[111966]: from='mgr.14100 172.21.15.43:0/1257760532' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr metadata", "who": "smithi043.hqcdcm", "id": "smithi043.hqcdcm"}]: dispatch 2023-12-08T20:20:46.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:46 smithi043 ceph-mon[111966]: Manager daemon smithi043.hqcdcm is now available 2023-12-08T20:20:46.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:46 smithi043 ceph-mon[111966]: from='mgr.14100 172.21.15.43:0/1257760532' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi043.hqcdcm/mirror_snapshot_schedule"}]: dispatch 2023-12-08T20:20:46.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:46 smithi043 ceph-mon[111966]: from='mgr.14100 172.21.15.43:0/1257760532' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi043.hqcdcm/trash_purge_schedule"}]: dispatch 2023-12-08T20:20:46.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:46 smithi043 ceph-mon[111966]: from='mgr.14100 172.21.15.43:0/1257760532' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:20:46.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:46 smithi043 ceph-mon[111966]: from='mgr.14100 172.21.15.43:0/1257760532' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:20:46.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:46 smithi043 ceph-mon[111966]: from='mgr.14100 172.21.15.43:0/1257760532' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:20:48.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:47 smithi043 ceph-mon[111966]: mgrmap e3: smithi043.hqcdcm(active, since 1.00674s) 2023-12-08T20:20:48.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:47 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/333073556' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-08T20:20:49.466 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2023-12-08T20:20:49.467 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2023-12-08T20:20:49.467 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsid": "28476818-9607-11ee-95a3-87774f69a715", 2023-12-08T20:20:49.467 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "health": { 2023-12-08T20:20:49.467 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-08T20:20:49.467 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-08T20:20:49.467 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-08T20:20:49.467 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:49.467 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-08T20:20:49.468 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-08T20:20:49.468 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 0 2023-12-08T20:20:49.468 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2023-12-08T20:20:49.468 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-08T20:20:49.468 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "smithi043" 2023-12-08T20:20:49.468 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2023-12-08T20:20:49.468 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2023-12-08T20:20:49.468 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-08T20:20:49.468 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-08T20:20:49.469 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-08T20:20:49.469 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-08T20:20:49.469 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:49.469 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-08T20:20:49.469 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-08T20:20:49.469 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-08T20:20:49.469 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-08T20:20:49.469 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-08T20:20:49.469 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-08T20:20:49.470 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-08T20:20:49.470 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-08T20:20:49.470 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:49.470 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-08T20:20:49.470 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-08T20:20:49.470 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-08T20:20:49.470 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-08T20:20:49.471 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-08T20:20:49.471 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-08T20:20:49.471 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-08T20:20:49.471 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-08T20:20:49.471 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-08T20:20:49.471 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:49.471 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-08T20:20:49.471 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-08T20:20:49.471 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-08T20:20:49.471 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-08T20:20:49.471 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:49.471 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-08T20:20:49.471 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-08T20:20:49.472 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-08T20:20:49.472 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-08T20:20:49.472 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-08T20:20:49.472 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-08T20:20:49.472 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "restful" 2023-12-08T20:20:49.472 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2023-12-08T20:20:49.472 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-08T20:20:49.472 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:49.472 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-08T20:20:49.472 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-08T20:20:49.473 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modified": "2023-12-08T20:20:31.669954+0000", 2023-12-08T20:20:49.473 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-08T20:20:49.473 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2023-12-08T20:20:49.473 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-08T20:20:49.473 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2023-12-08T20:20:49.473 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.661+0000 7ff0b9540700 1 Processor -- start 2023-12-08T20:20:49.473 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.661+0000 7ff0b9540700 1 -- start start 2023-12-08T20:20:49.473 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.661+0000 7ff0b9540700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b4076c20 0x7ff0b4104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:49.473 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.661+0000 7ff0b9540700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b4105420 con 0x7ff0b4076c20 2023-12-08T20:20:49.473 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.661+0000 7ff0b2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b4076c20 0x7ff0b4104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:49.473 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.661+0000 7ff0b2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b4076c20 0x7ff0b4104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52658/0 (socket says 172.21.15.43:52658) 2023-12-08T20:20:49.474 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.661+0000 7ff0b2ffd700 1 -- 172.21.15.43:0/1485449351 learned_addr learned my addr 172.21.15.43:0/1485449351 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:49.474 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.662+0000 7ff0b2ffd700 1 -- 172.21.15.43:0/1485449351 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b4105560 con 0x7ff0b4076c20 2023-12-08T20:20:49.474 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.662+0000 7ff0b2ffd700 1 --2- 172.21.15.43:0/1485449351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b4076c20 0x7ff0b4104ee0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80098e0 tx=0x7ff0a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e5c19d507df994 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:49.474 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.662+0000 7ff0b1ffb700 1 -- 172.21.15.43:0/1485449351 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0a800b860 con 0x7ff0b4076c20 2023-12-08T20:20:49.475 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.662+0000 7ff0b1ffb700 1 -- 172.21.15.43:0/1485449351 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7ff0a800be30 con 0x7ff0b4076c20 2023-12-08T20:20:49.475 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.662+0000 7ff0b1ffb700 1 -- 172.21.15.43:0/1485449351 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0a8010380 con 0x7ff0b4076c20 2023-12-08T20:20:49.475 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.663+0000 7ff0b9540700 1 -- 172.21.15.43:0/1485449351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b4076c20 msgr2=0x7ff0b4104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:49.475 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.663+0000 7ff0b9540700 1 --2- 172.21.15.43:0/1485449351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b4076c20 0x7ff0b4104ee0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80098e0 tx=0x7ff0a8009250 comp rx=0 tx=0).stop 2023-12-08T20:20:49.475 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.663+0000 7ff0b9540700 1 -- 172.21.15.43:0/1485449351 shutdown_connections 2023-12-08T20:20:49.475 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.663+0000 7ff0b9540700 1 --2- 172.21.15.43:0/1485449351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b4076c20 0x7ff0b4104ee0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:49.475 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.663+0000 7ff0b9540700 1 -- 172.21.15.43:0/1485449351 >> 172.21.15.43:0/1485449351 conn(0x7ff0b40fc950 msgr2=0x7ff0b40fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:49.475 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.663+0000 7ff0b9540700 1 -- 172.21.15.43:0/1485449351 shutdown_connections 2023-12-08T20:20:49.475 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.663+0000 7ff0b9540700 1 -- 172.21.15.43:0/1485449351 wait complete. 2023-12-08T20:20:49.475 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.664+0000 7ff0b9540700 1 Processor -- start 2023-12-08T20:20:49.475 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.664+0000 7ff0b9540700 1 -- start start 2023-12-08T20:20:49.475 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.664+0000 7ff0b9540700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b4076c20 0x7ff0b4111160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:49.475 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.664+0000 7ff0b9540700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b41116a0 con 0x7ff0b4076c20 2023-12-08T20:20:49.475 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.664+0000 7ff0b2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b4076c20 0x7ff0b4111160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:49.476 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.664+0000 7ff0b2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b4076c20 0x7ff0b4111160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52672/0 (socket says 172.21.15.43:52672) 2023-12-08T20:20:49.476 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.664+0000 7ff0b2ffd700 1 -- 172.21.15.43:0/333073556 learned_addr learned my addr 172.21.15.43:0/333073556 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:49.476 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.664+0000 7ff0b2ffd700 1 -- 172.21.15.43:0/333073556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a80094f0 con 0x7ff0b4076c20 2023-12-08T20:20:49.476 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.665+0000 7ff0b2ffd700 1 --2- 172.21.15.43:0/333073556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b4076c20 0x7ff0b4111160 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800ba90 tx=0x7ff0a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:49.476 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.665+0000 7ff09b7fe700 1 -- 172.21.15.43:0/333073556 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0a8010ad0 con 0x7ff0b4076c20 2023-12-08T20:20:49.476 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.665+0000 7ff09b7fe700 1 -- 172.21.15.43:0/333073556 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7ff0a8010c30 con 0x7ff0b4076c20 2023-12-08T20:20:49.476 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.665+0000 7ff0b9540700 1 -- 172.21.15.43:0/333073556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b41118a0 con 0x7ff0b4076c20 2023-12-08T20:20:49.476 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.665+0000 7ff09b7fe700 1 -- 172.21.15.43:0/333073556 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0a801a430 con 0x7ff0b4076c20 2023-12-08T20:20:49.476 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.665+0000 7ff0b9540700 1 -- 172.21.15.43:0/333073556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b4111cb0 con 0x7ff0b4076c20 2023-12-08T20:20:49.476 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.666+0000 7ff09b7fe700 1 -- 172.21.15.43:0/333073556 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 3) v1 ==== 43164+0+0 (secure 0 0 0) 0x7ff0a8024430 con 0x7ff0b4076c20 2023-12-08T20:20:49.477 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.666+0000 7ff0b9540700 1 -- 172.21.15.43:0/333073556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b404bb80 con 0x7ff0b4076c20 2023-12-08T20:20:49.477 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.666+0000 7ff09b7fe700 1 --2- 172.21.15.43:0/333073556 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7ff09c0364c0 0x7ff09c038970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:49.477 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.666+0000 7ff09b7fe700 1 -- 172.21.15.43:0/333073556 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff0a804a150 con 0x7ff0b4076c20 2023-12-08T20:20:49.477 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.666+0000 7ff0b27fc700 1 --2- 172.21.15.43:0/333073556 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7ff09c0364c0 0x7ff09c038970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:49.477 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.667+0000 7ff0b27fc700 1 --2- 172.21.15.43:0/333073556 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7ff09c0364c0 0x7ff09c038970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4009990 tx=0x7ff0a4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:49.477 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.672+0000 7ff09b7fe700 1 -- 172.21.15.43:0/333073556 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff0a8023570 con 0x7ff0b4076c20 2023-12-08T20:20:49.477 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.955+0000 7ff0b9540700 1 -- 172.21.15.43:0/333073556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff0b410af40 con 0x7ff0b4076c20 2023-12-08T20:20:49.477 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.956+0000 7ff09b7fe700 1 -- 172.21.15.43:0/333073556 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7ff0a8023390 con 0x7ff0b4076c20 2023-12-08T20:20:49.477 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.958+0000 7ff0b9540700 1 -- 172.21.15.43:0/333073556 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7ff09c0364c0 msgr2=0x7ff09c038970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:49.477 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.958+0000 7ff0b9540700 1 --2- 172.21.15.43:0/333073556 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7ff09c0364c0 0x7ff09c038970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4009990 tx=0x7ff0a4006e40 comp rx=0 tx=0).stop 2023-12-08T20:20:49.477 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.958+0000 7ff0b9540700 1 -- 172.21.15.43:0/333073556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b4076c20 msgr2=0x7ff0b4111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:49.477 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.958+0000 7ff0b9540700 1 --2- 172.21.15.43:0/333073556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b4076c20 0x7ff0b4111160 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800ba90 tx=0x7ff0a8009250 comp rx=0 tx=0).stop 2023-12-08T20:20:49.478 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.958+0000 7ff0b9540700 1 -- 172.21.15.43:0/333073556 shutdown_connections 2023-12-08T20:20:49.478 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.958+0000 7ff0b9540700 1 --2- 172.21.15.43:0/333073556 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7ff09c0364c0 0x7ff09c038970 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:49.478 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.958+0000 7ff0b9540700 1 --2- 172.21.15.43:0/333073556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0b4076c20 0x7ff0b4111160 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:49.478 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.958+0000 7ff0b9540700 1 -- 172.21.15.43:0/333073556 >> 172.21.15.43:0/333073556 conn(0x7ff0b40fc950 msgr2=0x7ff0b40fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:49.478 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.958+0000 7ff0b9540700 1 -- 172.21.15.43:0/333073556 shutdown_connections 2023-12-08T20:20:49.478 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:47.958+0000 7ff0b9540700 1 -- 172.21.15.43:0/333073556 wait complete. 2023-12-08T20:20:49.478 INFO:teuthology.orchestra.run.smithi043.stdout:mgr is available 2023-12-08T20:20:50.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:49 smithi043 ceph-mon[111966]: mgrmap e4: smithi043.hqcdcm(active, since 3s) 2023-12-08T20:20:51.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:51 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/1517275262' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-08T20:20:52.455 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2023-12-08T20:20:52.455 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [global] 2023-12-08T20:20:52.455 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout fsid = 28476818-9607-11ee-95a3-87774f69a715 2023-12-08T20:20:52.455 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-08T20:20:52.455 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-08T20:20:52.456 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-08T20:20:52.456 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-08T20:20:52.456 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2023-12-08T20:20:52.456 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-08T20:20:52.456 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-08T20:20:52.456 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2023-12-08T20:20:52.456 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [osd] 2023-12-08T20:20:52.456 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-08T20:20:52.456 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-08T20:20:52.456 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-08T20:20:52.457 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-08T20:20:52.457 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-08T20:20:52.457 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.604+0000 7fa2b5e3a700 1 Processor -- start 2023-12-08T20:20:52.457 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.604+0000 7fa2b5e3a700 1 -- start start 2023-12-08T20:20:52.457 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.605+0000 7fa2b5e3a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2b01022b0 0x7fa2b01026c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:52.457 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.605+0000 7fa2b5e3a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b0102c00 con 0x7fa2b01022b0 2023-12-08T20:20:52.457 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.605+0000 7fa2af7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2b01022b0 0x7fa2b01026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:52.457 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.605+0000 7fa2af7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2b01022b0 0x7fa2b01026c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55192/0 (socket says 172.21.15.43:55192) 2023-12-08T20:20:52.457 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.605+0000 7fa2af7fe700 1 -- 172.21.15.43:0/3208084721 learned_addr learned my addr 172.21.15.43:0/3208084721 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:52.457 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.605+0000 7fa2af7fe700 1 -- 172.21.15.43:0/3208084721 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b0102d40 con 0x7fa2b01022b0 2023-12-08T20:20:52.457 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.605+0000 7fa2af7fe700 1 --2- 172.21.15.43:0/3208084721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2b01022b0 0x7fa2b01026c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa2a00098e0 tx=0x7fa2a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad209203b64af3f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:52.457 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.606+0000 7fa2ae7fc700 1 -- 172.21.15.43:0/3208084721 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa2a000b860 con 0x7fa2b01022b0 2023-12-08T20:20:52.457 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.606+0000 7fa2ae7fc700 1 -- 172.21.15.43:0/3208084721 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa2a000be30 con 0x7fa2b01022b0 2023-12-08T20:20:52.457 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.606+0000 7fa2ae7fc700 1 -- 172.21.15.43:0/3208084721 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa2a0010380 con 0x7fa2b01022b0 2023-12-08T20:20:52.457 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.606+0000 7fa2b5e3a700 1 -- 172.21.15.43:0/3208084721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2b01022b0 msgr2=0x7fa2b01026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:52.458 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.606+0000 7fa2b5e3a700 1 --2- 172.21.15.43:0/3208084721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2b01022b0 0x7fa2b01026c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa2a00098e0 tx=0x7fa2a0009250 comp rx=0 tx=0).stop 2023-12-08T20:20:52.458 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.606+0000 7fa2b5e3a700 1 -- 172.21.15.43:0/3208084721 shutdown_connections 2023-12-08T20:20:52.458 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.606+0000 7fa2b5e3a700 1 --2- 172.21.15.43:0/3208084721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2b01022b0 0x7fa2b01026c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:52.458 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.606+0000 7fa2b5e3a700 1 -- 172.21.15.43:0/3208084721 >> 172.21.15.43:0/3208084721 conn(0x7fa2b00fda10 msgr2=0x7fa2b00ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:52.458 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.606+0000 7fa2b5e3a700 1 -- 172.21.15.43:0/3208084721 shutdown_connections 2023-12-08T20:20:52.458 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.606+0000 7fa2b5e3a700 1 -- 172.21.15.43:0/3208084721 wait complete. 2023-12-08T20:20:52.458 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.607+0000 7fa2b5e3a700 1 Processor -- start 2023-12-08T20:20:52.458 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.607+0000 7fa2b5e3a700 1 -- start start 2023-12-08T20:20:52.458 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.607+0000 7fa2b5e3a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2b01022b0 0x7fa2b0111150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:52.459 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.607+0000 7fa2b5e3a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b0111690 con 0x7fa2b01022b0 2023-12-08T20:20:52.459 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.608+0000 7fa2af7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2b01022b0 0x7fa2b0111150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:52.459 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.608+0000 7fa2af7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2b01022b0 0x7fa2b0111150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55198/0 (socket says 172.21.15.43:55198) 2023-12-08T20:20:52.459 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.608+0000 7fa2af7fe700 1 -- 172.21.15.43:0/1517275262 learned_addr learned my addr 172.21.15.43:0/1517275262 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:52.459 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.608+0000 7fa2af7fe700 1 -- 172.21.15.43:0/1517275262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a00094f0 con 0x7fa2b01022b0 2023-12-08T20:20:52.459 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.608+0000 7fa2af7fe700 1 --2- 172.21.15.43:0/1517275262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2b01022b0 0x7fa2b0111150 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0000c00 tx=0x7fa2a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:52.459 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.608+0000 7fa297fff700 1 -- 172.21.15.43:0/1517275262 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa2a0010a80 con 0x7fa2b01022b0 2023-12-08T20:20:52.459 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.608+0000 7fa2b5e3a700 1 -- 172.21.15.43:0/1517275262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b0111890 con 0x7fa2b01022b0 2023-12-08T20:20:52.459 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.608+0000 7fa297fff700 1 -- 172.21.15.43:0/1517275262 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa2a001a430 con 0x7fa2b01022b0 2023-12-08T20:20:52.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.608+0000 7fa297fff700 1 -- 172.21.15.43:0/1517275262 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa2a00245b0 con 0x7fa2b01022b0 2023-12-08T20:20:52.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.608+0000 7fa2b5e3a700 1 -- 172.21.15.43:0/1517275262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b0111ca0 con 0x7fa2b01022b0 2023-12-08T20:20:52.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.609+0000 7fa297fff700 1 -- 172.21.15.43:0/1517275262 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7fa2a00247f0 con 0x7fa2b01022b0 2023-12-08T20:20:52.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.609+0000 7fa297fff700 1 --2- 172.21.15.43:0/1517275262 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fa2980365a0 0x7fa298038a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:52.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.609+0000 7fa297fff700 1 -- 172.21.15.43:0/1517275262 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa2a004ab90 con 0x7fa2b01022b0 2023-12-08T20:20:52.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.609+0000 7fa2b5e3a700 1 -- 172.21.15.43:0/1517275262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b004bb80 con 0x7fa2b01022b0 2023-12-08T20:20:52.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.609+0000 7fa2aeffd700 1 --2- 172.21.15.43:0/1517275262 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fa2980365a0 0x7fa298038a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:52.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.610+0000 7fa2aeffd700 1 --2- 172.21.15.43:0/1517275262 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fa2980365a0 0x7fa298038a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009990 tx=0x7fa2a4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:52.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.614+0000 7fa297fff700 1 -- 172.21.15.43:0/1517275262 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa2a0018350 con 0x7fa2b01022b0 2023-12-08T20:20:52.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.824+0000 7fa2b5e3a700 1 -- 172.21.15.43:0/1517275262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fa2b01040c0 con 0x7fa2b01022b0 2023-12-08T20:20:52.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.825+0000 7fa297fff700 1 -- 172.21.15.43:0/1517275262 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fa2a0023b80 con 0x7fa2b01022b0 2023-12-08T20:20:52.460 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.827+0000 7fa2b5e3a700 1 -- 172.21.15.43:0/1517275262 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fa2980365a0 msgr2=0x7fa298038a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:52.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.828+0000 7fa2b5e3a700 1 --2- 172.21.15.43:0/1517275262 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fa2980365a0 0x7fa298038a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009990 tx=0x7fa2a4006e40 comp rx=0 tx=0).stop 2023-12-08T20:20:52.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.828+0000 7fa2b5e3a700 1 -- 172.21.15.43:0/1517275262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2b01022b0 msgr2=0x7fa2b0111150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:52.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.828+0000 7fa2b5e3a700 1 --2- 172.21.15.43:0/1517275262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2b01022b0 0x7fa2b0111150 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0000c00 tx=0x7fa2a0009250 comp rx=0 tx=0).stop 2023-12-08T20:20:52.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.828+0000 7fa2b5e3a700 1 -- 172.21.15.43:0/1517275262 shutdown_connections 2023-12-08T20:20:52.461 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.828+0000 7fa2b5e3a700 1 --2- 172.21.15.43:0/1517275262 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fa2980365a0 0x7fa298038a50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:52.462 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.828+0000 7fa2b5e3a700 1 --2- 172.21.15.43:0/1517275262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2b01022b0 0x7fa2b0111150 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:52.462 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.828+0000 7fa2b5e3a700 1 -- 172.21.15.43:0/1517275262 >> 172.21.15.43:0/1517275262 conn(0x7fa2b00fda10 msgr2=0x7fa2b00ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:52.462 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.828+0000 7fa2b5e3a700 1 -- 172.21.15.43:0/1517275262 shutdown_connections 2023-12-08T20:20:52.462 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:50.828+0000 7fa2b5e3a700 1 -- 172.21.15.43:0/1517275262 wait complete. 2023-12-08T20:20:52.462 INFO:teuthology.orchestra.run.smithi043.stdout:Enabling cephadm module... 2023-12-08T20:20:54.627 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:54 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/2930238930' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-12-08T20:20:55.552 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:55 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/2930238930' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-12-08T20:20:55.553 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:55 smithi043 ceph-mon[111966]: mgrmap e5: smithi043.hqcdcm(active, since 8s) 2023-12-08T20:20:56.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.939+0000 7efd8deb7700 1 Processor -- start 2023-12-08T20:20:56.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.939+0000 7efd8deb7700 1 -- start start 2023-12-08T20:20:56.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.939+0000 7efd8deb7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd88070fc0 0x7efd88104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:56.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.939+0000 7efd8deb7700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd88105420 con 0x7efd88070fc0 2023-12-08T20:20:56.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.939+0000 7efd877fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd88070fc0 0x7efd88104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:56.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.939+0000 7efd877fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd88070fc0 0x7efd88104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55214/0 (socket says 172.21.15.43:55214) 2023-12-08T20:20:56.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.939+0000 7efd877fe700 1 -- 172.21.15.43:0/1325896877 learned_addr learned my addr 172.21.15.43:0/1325896877 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:56.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.940+0000 7efd877fe700 1 -- 172.21.15.43:0/1325896877 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd88105560 con 0x7efd88070fc0 2023-12-08T20:20:56.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.940+0000 7efd877fe700 1 --2- 172.21.15.43:0/1325896877 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd88070fc0 0x7efd88104ee0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efd780098e0 tx=0x7efd78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a004b5abaa55f767 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:56.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.940+0000 7efd867fc700 1 -- 172.21.15.43:0/1325896877 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd7800b860 con 0x7efd88070fc0 2023-12-08T20:20:56.677 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.940+0000 7efd867fc700 1 -- 172.21.15.43:0/1325896877 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7efd7800be30 con 0x7efd88070fc0 2023-12-08T20:20:56.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.940+0000 7efd867fc700 1 -- 172.21.15.43:0/1325896877 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd78010380 con 0x7efd88070fc0 2023-12-08T20:20:56.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.940+0000 7efd8deb7700 1 -- 172.21.15.43:0/1325896877 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd88070fc0 msgr2=0x7efd88104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:56.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.941+0000 7efd8deb7700 1 --2- 172.21.15.43:0/1325896877 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd88070fc0 0x7efd88104ee0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efd780098e0 tx=0x7efd78009250 comp rx=0 tx=0).stop 2023-12-08T20:20:56.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.941+0000 7efd8deb7700 1 -- 172.21.15.43:0/1325896877 shutdown_connections 2023-12-08T20:20:56.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.941+0000 7efd8deb7700 1 --2- 172.21.15.43:0/1325896877 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd88070fc0 0x7efd88104ee0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:56.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.941+0000 7efd8deb7700 1 -- 172.21.15.43:0/1325896877 >> 172.21.15.43:0/1325896877 conn(0x7efd880fc970 msgr2=0x7efd880fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:56.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.941+0000 7efd8deb7700 1 -- 172.21.15.43:0/1325896877 shutdown_connections 2023-12-08T20:20:56.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.941+0000 7efd8deb7700 1 -- 172.21.15.43:0/1325896877 wait complete. 2023-12-08T20:20:56.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.941+0000 7efd8deb7700 1 Processor -- start 2023-12-08T20:20:56.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.941+0000 7efd8deb7700 1 -- start start 2023-12-08T20:20:56.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.942+0000 7efd8deb7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd88070fc0 0x7efd88111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:56.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.942+0000 7efd8deb7700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd881116c0 con 0x7efd88070fc0 2023-12-08T20:20:56.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.942+0000 7efd877fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd88070fc0 0x7efd88111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:56.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.942+0000 7efd877fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd88070fc0 0x7efd88111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55220/0 (socket says 172.21.15.43:55220) 2023-12-08T20:20:56.678 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.942+0000 7efd877fe700 1 -- 172.21.15.43:0/2930238930 learned_addr learned my addr 172.21.15.43:0/2930238930 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:56.679 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.942+0000 7efd877fe700 1 -- 172.21.15.43:0/2930238930 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd780094f0 con 0x7efd88070fc0 2023-12-08T20:20:56.679 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.942+0000 7efd877fe700 1 --2- 172.21.15.43:0/2930238930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd88070fc0 0x7efd88111180 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efd78006b00 tx=0x7efd78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:56.679 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.942+0000 7efd7ffff700 1 -- 172.21.15.43:0/2930238930 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd78010a80 con 0x7efd88070fc0 2023-12-08T20:20:56.679 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.942+0000 7efd7ffff700 1 -- 172.21.15.43:0/2930238930 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7efd7801a430 con 0x7efd88070fc0 2023-12-08T20:20:56.679 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.942+0000 7efd7ffff700 1 -- 172.21.15.43:0/2930238930 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd780245b0 con 0x7efd88070fc0 2023-12-08T20:20:56.679 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.942+0000 7efd8deb7700 1 -- 172.21.15.43:0/2930238930 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd881118c0 con 0x7efd88070fc0 2023-12-08T20:20:56.679 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.942+0000 7efd8deb7700 1 -- 172.21.15.43:0/2930238930 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd88111cd0 con 0x7efd88070fc0 2023-12-08T20:20:56.679 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.943+0000 7efd7ffff700 1 -- 172.21.15.43:0/2930238930 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7efd78010be0 con 0x7efd88070fc0 2023-12-08T20:20:56.679 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.943+0000 7efd7ffff700 1 --2- 172.21.15.43:0/2930238930 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7efd740365a0 0x7efd74038a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:56.679 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.943+0000 7efd7ffff700 1 -- 172.21.15.43:0/2930238930 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7efd7804aaa0 con 0x7efd88070fc0 2023-12-08T20:20:56.680 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.944+0000 7efd86ffd700 1 --2- 172.21.15.43:0/2930238930 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7efd740365a0 0x7efd74038a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:56.680 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.944+0000 7efd8deb7700 1 -- 172.21.15.43:0/2930238930 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8804bb80 con 0x7efd88070fc0 2023-12-08T20:20:56.680 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.944+0000 7efd86ffd700 1 --2- 172.21.15.43:0/2930238930 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7efd740365a0 0x7efd74038a50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd70009990 tx=0x7efd70006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:56.680 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:53.949+0000 7efd7ffff700 1 -- 172.21.15.43:0/2930238930 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7efd7802e440 con 0x7efd88070fc0 2023-12-08T20:20:56.680 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:54.209+0000 7efd8deb7700 1 -- 172.21.15.43:0/2930238930 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7efd8810ac60 con 0x7efd88070fc0 2023-12-08T20:20:56.680 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:54.262+0000 7efd7ffff700 1 -- 172.21.15.43:0/2930238930 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7efd7800fd90 con 0x7efd88070fc0 2023-12-08T20:20:56.680 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:54.264+0000 7efd7ffff700 1 -- 172.21.15.43:0/2930238930 <== mon.0 v2:172.21.15.43:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7efd7800f510 con 0x7efd88070fc0 2023-12-08T20:20:56.680 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:54.267+0000 7efd8deb7700 1 -- 172.21.15.43:0/2930238930 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7efd740365a0 msgr2=0x7efd74038a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:56.680 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:54.267+0000 7efd8deb7700 1 --2- 172.21.15.43:0/2930238930 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7efd740365a0 0x7efd74038a50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd70009990 tx=0x7efd70006e40 comp rx=0 tx=0).stop 2023-12-08T20:20:56.680 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:54.267+0000 7efd8deb7700 1 -- 172.21.15.43:0/2930238930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd88070fc0 msgr2=0x7efd88111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:56.680 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:54.267+0000 7efd8deb7700 1 --2- 172.21.15.43:0/2930238930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd88070fc0 0x7efd88111180 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efd78006b00 tx=0x7efd78009250 comp rx=0 tx=0).stop 2023-12-08T20:20:56.680 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:54.267+0000 7efd8deb7700 1 -- 172.21.15.43:0/2930238930 shutdown_connections 2023-12-08T20:20:56.680 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:54.267+0000 7efd8deb7700 1 --2- 172.21.15.43:0/2930238930 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7efd740365a0 0x7efd74038a50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:56.680 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:54.267+0000 7efd8deb7700 1 --2- 172.21.15.43:0/2930238930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd88070fc0 0x7efd88111180 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:56.681 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:54.267+0000 7efd8deb7700 1 -- 172.21.15.43:0/2930238930 >> 172.21.15.43:0/2930238930 conn(0x7efd880fc970 msgr2=0x7efd880fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:56.681 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:54.267+0000 7efd8deb7700 1 -- 172.21.15.43:0/2930238930 shutdown_connections 2023-12-08T20:20:56.681 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:54.267+0000 7efd8deb7700 1 -- 172.21.15.43:0/2930238930 wait complete. 2023-12-08T20:20:57.816 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:20:57 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3441791391' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-08T20:20:57.878 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2023-12-08T20:20:57.878 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-12-08T20:20:57.878 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-08T20:20:57.878 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "active_name": "smithi043.hqcdcm", 2023-12-08T20:20:57.878 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-08T20:20:57.879 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2023-12-08T20:20:57.879 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.242+0000 7f906f3d4700 1 Processor -- start 2023-12-08T20:20:57.879 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.242+0000 7f906f3d4700 1 -- start start 2023-12-08T20:20:57.879 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.242+0000 7f906f3d4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9068071000 0x7f9068104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:57.879 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.242+0000 7f906f3d4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90681053e0 con 0x7f9068071000 2023-12-08T20:20:57.879 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.242+0000 7f906d170700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9068071000 0x7f9068104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:57.879 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.242+0000 7f906d170700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9068071000 0x7f9068104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55248/0 (socket says 172.21.15.43:55248) 2023-12-08T20:20:57.879 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.242+0000 7f906d170700 1 -- 172.21.15.43:0/1638042937 learned_addr learned my addr 172.21.15.43:0/1638042937 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:57.879 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.243+0000 7f906d170700 1 -- 172.21.15.43:0/1638042937 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9068105520 con 0x7f9068071000 2023-12-08T20:20:57.879 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.243+0000 7f906d170700 1 --2- 172.21.15.43:0/1638042937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9068071000 0x7f9068104ea0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f90640098e0 tx=0x7f9064009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958d073ee57bba28 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:57.879 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.243+0000 7f905ffff700 1 -- 172.21.15.43:0/1638042937 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f906400b860 con 0x7f9068071000 2023-12-08T20:20:57.879 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.243+0000 7f905ffff700 1 -- 172.21.15.43:0/1638042937 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f906400be30 con 0x7f9068071000 2023-12-08T20:20:57.879 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.243+0000 7f905ffff700 1 -- 172.21.15.43:0/1638042937 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9064010380 con 0x7f9068071000 2023-12-08T20:20:57.879 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.244+0000 7f906f3d4700 1 -- 172.21.15.43:0/1638042937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9068071000 msgr2=0x7f9068104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:57.879 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.244+0000 7f906f3d4700 1 --2- 172.21.15.43:0/1638042937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9068071000 0x7f9068104ea0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f90640098e0 tx=0x7f9064009250 comp rx=0 tx=0).stop 2023-12-08T20:20:57.879 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.244+0000 7f906f3d4700 1 -- 172.21.15.43:0/1638042937 shutdown_connections 2023-12-08T20:20:57.880 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.244+0000 7f906f3d4700 1 --2- 172.21.15.43:0/1638042937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9068071000 0x7f9068104ea0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:57.880 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.244+0000 7f906f3d4700 1 -- 172.21.15.43:0/1638042937 >> 172.21.15.43:0/1638042937 conn(0x7f90680fc970 msgr2=0x7f90680fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:57.880 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.244+0000 7f906f3d4700 1 -- 172.21.15.43:0/1638042937 shutdown_connections 2023-12-08T20:20:57.880 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.244+0000 7f906f3d4700 1 -- 172.21.15.43:0/1638042937 wait complete. 2023-12-08T20:20:57.880 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.244+0000 7f906f3d4700 1 Processor -- start 2023-12-08T20:20:57.880 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.244+0000 7f906f3d4700 1 -- start start 2023-12-08T20:20:57.880 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.245+0000 7f906f3d4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9068071000 0x7f9068102920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:57.880 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.245+0000 7f906f3d4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9068100da0 con 0x7f9068071000 2023-12-08T20:20:57.880 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.245+0000 7f906d170700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9068071000 0x7f9068102920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:20:57.880 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.245+0000 7f906d170700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9068071000 0x7f9068102920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55256/0 (socket says 172.21.15.43:55256) 2023-12-08T20:20:57.880 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.245+0000 7f906d170700 1 -- 172.21.15.43:0/3441791391 learned_addr learned my addr 172.21.15.43:0/3441791391 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:20:57.880 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.245+0000 7f906d170700 1 -- 172.21.15.43:0/3441791391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90640094f0 con 0x7f9068071000 2023-12-08T20:20:57.880 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.245+0000 7f906d170700 1 --2- 172.21.15.43:0/3441791391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9068071000 0x7f9068102920 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9064006b00 tx=0x7f9064009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:20:57.880 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.245+0000 7f905dffb700 1 -- 172.21.15.43:0/3441791391 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9064010a80 con 0x7f9068071000 2023-12-08T20:20:57.880 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.245+0000 7f905dffb700 1 -- 172.21.15.43:0/3441791391 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f906401a430 con 0x7f9068071000 2023-12-08T20:20:57.881 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.245+0000 7f906f3d4700 1 -- 172.21.15.43:0/3441791391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9068100fa0 con 0x7f9068071000 2023-12-08T20:20:57.881 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.246+0000 7f905dffb700 1 -- 172.21.15.43:0/3441791391 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90640245b0 con 0x7f9068071000 2023-12-08T20:20:57.881 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.246+0000 7f906f3d4700 1 -- 172.21.15.43:0/3441791391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90681013b0 con 0x7f9068071000 2023-12-08T20:20:57.881 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.247+0000 7f905dffb700 1 -- 172.21.15.43:0/3441791391 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f9064024830 con 0x7f9068071000 2023-12-08T20:20:57.881 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.247+0000 7f905dffb700 1 --2- 172.21.15.43:0/3441791391 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7f90540365f0 0x7f9054038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:20:57.881 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.247+0000 7f906f3d4700 1 -- 172.21.15.43:0/3441791391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f906804bb80 con 0x7f9068071000 2023-12-08T20:20:57.881 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.247+0000 7f906c96f700 1 -- 172.21.15.43:0/3441791391 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7f90540365f0 msgr2=0x7f9054038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2195776328 2023-12-08T20:20:57.881 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.247+0000 7f905dffb700 1 -- 172.21.15.43:0/3441791391 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f906404ab60 con 0x7f9068071000 2023-12-08T20:20:57.881 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.247+0000 7f906c96f700 1 --2- 172.21.15.43:0/3441791391 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7f90540365f0 0x7f9054038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:20:57.881 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.252+0000 7f905dffb700 1 -- 172.21.15.43:0/3441791391 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f906402cd60 con 0x7f9068071000 2023-12-08T20:20:57.881 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.448+0000 7f906c96f700 1 -- 172.21.15.43:0/3441791391 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7f90540365f0 msgr2=0x7f9054038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2195776328 2023-12-08T20:20:57.881 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.448+0000 7f906c96f700 1 --2- 172.21.15.43:0/3441791391 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7f90540365f0 0x7f9054038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T20:20:57.881 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.511+0000 7f906f3d4700 1 -- 172.21.15.43:0/3441791391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f906810ad40 con 0x7f9068071000 2023-12-08T20:20:57.881 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.511+0000 7f905dffb700 1 -- 172.21.15.43:0/3441791391 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f906402cb80 con 0x7f9068071000 2023-12-08T20:20:57.881 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.513+0000 7f906f3d4700 1 -- 172.21.15.43:0/3441791391 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7f90540365f0 msgr2=0x7f9054038aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-08T20:20:57.882 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.513+0000 7f906f3d4700 1 --2- 172.21.15.43:0/3441791391 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7f90540365f0 0x7f9054038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:57.882 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.513+0000 7f906f3d4700 1 -- 172.21.15.43:0/3441791391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9068071000 msgr2=0x7f9068102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:20:57.882 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.513+0000 7f906f3d4700 1 --2- 172.21.15.43:0/3441791391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9068071000 0x7f9068102920 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9064006b00 tx=0x7f9064009250 comp rx=0 tx=0).stop 2023-12-08T20:20:57.882 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.513+0000 7f906f3d4700 1 -- 172.21.15.43:0/3441791391 shutdown_connections 2023-12-08T20:20:57.882 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.513+0000 7f906f3d4700 1 --2- 172.21.15.43:0/3441791391 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7f90540365f0 0x7f9054038aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:57.882 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.513+0000 7f906f3d4700 1 --2- 172.21.15.43:0/3441791391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9068071000 0x7f9068102920 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:20:57.882 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.513+0000 7f906f3d4700 1 -- 172.21.15.43:0/3441791391 >> 172.21.15.43:0/3441791391 conn(0x7f90680fc970 msgr2=0x7f90680fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:20:57.882 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.514+0000 7f906f3d4700 1 -- 172.21.15.43:0/3441791391 shutdown_connections 2023-12-08T20:20:57.882 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:57.514+0000 7f906f3d4700 1 -- 172.21.15.43:0/3441791391 wait complete. 2023-12-08T20:20:57.882 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for the mgr to restart... 2023-12-08T20:20:57.882 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mgr epoch 5... 2023-12-08T20:21:01.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:01 smithi043 ceph-mon[111966]: Active manager daemon smithi043.hqcdcm restarted 2023-12-08T20:21:01.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:01 smithi043 ceph-mon[111966]: Activating manager daemon smithi043.hqcdcm 2023-12-08T20:21:01.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:01 smithi043 ceph-mon[111966]: osdmap e2: 0 total, 0 up, 0 in 2023-12-08T20:21:01.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:01 smithi043 ceph-mon[111966]: mgrmap e6: smithi043.hqcdcm(active, starting, since 0.00349304s) 2023-12-08T20:21:01.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:01 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:21:01.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:01 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr metadata", "who": "smithi043.hqcdcm", "id": "smithi043.hqcdcm"}]: dispatch 2023-12-08T20:21:01.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:01 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-08T20:21:01.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:01 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-08T20:21:01.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:01 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-08T20:21:01.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:01 smithi043 ceph-mon[111966]: Manager daemon smithi043.hqcdcm is now available 2023-12-08T20:21:01.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:01 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:01.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:01 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:01.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:01 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:21:02.907 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:02 smithi043 ceph-mon[111966]: Found migration_current of "None". Setting to last migration. 2023-12-08T20:21:02.908 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:02 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:21:02.908 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:02 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:21:02.908 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:02 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi043.hqcdcm/mirror_snapshot_schedule"}]: dispatch 2023-12-08T20:21:02.908 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:02 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi043.hqcdcm/trash_purge_schedule"}]: dispatch 2023-12-08T20:21:02.908 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:02 smithi043 ceph-mon[111966]: mgrmap e7: smithi043.hqcdcm(active, since 1.00566s) 2023-12-08T20:21:02.989 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2023-12-08T20:21:02.990 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-12-08T20:21:02.990 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-08T20:21:02.990 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2023-12-08T20:21:02.990 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.317+0000 7fd25d8e5700 1 Processor -- start 2023-12-08T20:21:02.990 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.317+0000 7fd25d8e5700 1 -- start start 2023-12-08T20:21:02.990 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.317+0000 7fd25d8e5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd258076bc0 0x7fd258107340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:02.990 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.317+0000 7fd25d8e5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd258102d30 con 0x7fd258076bc0 2023-12-08T20:21:02.990 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.317+0000 7fd256ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd258076bc0 0x7fd258107340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:02.990 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.317+0000 7fd256ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd258076bc0 0x7fd258107340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55260/0 (socket says 172.21.15.43:55260) 2023-12-08T20:21:02.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.317+0000 7fd256ffd700 1 -- 172.21.15.43:0/3005634909 learned_addr learned my addr 172.21.15.43:0/3005634909 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:02.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.318+0000 7fd256ffd700 1 -- 172.21.15.43:0/3005634909 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd258107880 con 0x7fd258076bc0 2023-12-08T20:21:02.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.318+0000 7fd256ffd700 1 --2- 172.21.15.43:0/3005634909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd258076bc0 0x7fd258107340 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd2480098e0 tx=0x7fd248009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dedf08d08dfef484 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:02.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.318+0000 7fd255ffb700 1 -- 172.21.15.43:0/3005634909 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd24800b860 con 0x7fd258076bc0 2023-12-08T20:21:02.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.318+0000 7fd255ffb700 1 -- 172.21.15.43:0/3005634909 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fd24800be30 con 0x7fd258076bc0 2023-12-08T20:21:02.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.318+0000 7fd255ffb700 1 -- 172.21.15.43:0/3005634909 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd248010380 con 0x7fd258076bc0 2023-12-08T20:21:02.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.319+0000 7fd25d8e5700 1 -- 172.21.15.43:0/3005634909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd258076bc0 msgr2=0x7fd258107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:02.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.319+0000 7fd25d8e5700 1 --2- 172.21.15.43:0/3005634909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd258076bc0 0x7fd258107340 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd2480098e0 tx=0x7fd248009250 comp rx=0 tx=0).stop 2023-12-08T20:21:02.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.319+0000 7fd25d8e5700 1 -- 172.21.15.43:0/3005634909 shutdown_connections 2023-12-08T20:21:02.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.319+0000 7fd25d8e5700 1 --2- 172.21.15.43:0/3005634909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd258076bc0 0x7fd258107340 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:02.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.319+0000 7fd25d8e5700 1 -- 172.21.15.43:0/3005634909 >> 172.21.15.43:0/3005634909 conn(0x7fd2580fc950 msgr2=0x7fd2580fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:02.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.319+0000 7fd25d8e5700 1 -- 172.21.15.43:0/3005634909 shutdown_connections 2023-12-08T20:21:02.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.319+0000 7fd25d8e5700 1 -- 172.21.15.43:0/3005634909 wait complete. 2023-12-08T20:21:02.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.320+0000 7fd25d8e5700 1 Processor -- start 2023-12-08T20:21:02.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.320+0000 7fd25d8e5700 1 -- start start 2023-12-08T20:21:02.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.320+0000 7fd25d8e5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd258076bc0 0x7fd258113360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:02.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.320+0000 7fd25d8e5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2581138a0 con 0x7fd258076bc0 2023-12-08T20:21:02.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.320+0000 7fd256ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd258076bc0 0x7fd258113360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:02.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.320+0000 7fd256ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd258076bc0 0x7fd258113360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55276/0 (socket says 172.21.15.43:55276) 2023-12-08T20:21:02.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.320+0000 7fd256ffd700 1 -- 172.21.15.43:0/1082172484 learned_addr learned my addr 172.21.15.43:0/1082172484 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:02.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.320+0000 7fd256ffd700 1 -- 172.21.15.43:0/1082172484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2480094f0 con 0x7fd258076bc0 2023-12-08T20:21:02.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.321+0000 7fd256ffd700 1 --2- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd258076bc0 0x7fd258113360 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd248006d40 tx=0x7fd248009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:02.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.321+0000 7fd23f7fe700 1 -- 172.21.15.43:0/1082172484 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd2480109b0 con 0x7fd258076bc0 2023-12-08T20:21:02.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.321+0000 7fd23f7fe700 1 -- 172.21.15.43:0/1082172484 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fd248024440 con 0x7fd258076bc0 2023-12-08T20:21:02.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.321+0000 7fd25d8e5700 1 -- 172.21.15.43:0/1082172484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd258113aa0 con 0x7fd258076bc0 2023-12-08T20:21:02.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.321+0000 7fd23f7fe700 1 -- 172.21.15.43:0/1082172484 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd24801a5f0 con 0x7fd258076bc0 2023-12-08T20:21:02.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.321+0000 7fd25d8e5700 1 -- 172.21.15.43:0/1082172484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd258113eb0 con 0x7fd258076bc0 2023-12-08T20:21:02.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.322+0000 7fd23f7fe700 1 -- 172.21.15.43:0/1082172484 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fd24801a820 con 0x7fd258076bc0 2023-12-08T20:21:02.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.322+0000 7fd23f7fe700 1 --2- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fd240036640 0x7fd240038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:02.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.322+0000 7fd23f7fe700 1 -- 172.21.15.43:0/1082172484 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd24804b2e0 con 0x7fd258076bc0 2023-12-08T20:21:02.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.322+0000 7fd2567fc700 1 -- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fd240036640 msgr2=0x7fd240038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2195776328 2023-12-08T20:21:02.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.322+0000 7fd2567fc700 1 --2- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fd240036640 0x7fd240038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:21:02.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.322+0000 7fd25d8e5700 1 -- 172.21.15.43:0/1082172484 --> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd25804bb80 con 0x7fd240036640 2023-12-08T20:21:02.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.523+0000 7fd2567fc700 1 -- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fd240036640 msgr2=0x7fd240038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2195776328 2023-12-08T20:21:02.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.523+0000 7fd2567fc700 1 --2- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fd240036640 0x7fd240038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T20:21:02.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.924+0000 7fd2567fc700 1 -- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fd240036640 msgr2=0x7fd240038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2195776328 2023-12-08T20:21:02.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:58.924+0000 7fd2567fc700 1 --2- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fd240036640 0x7fd240038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-08T20:21:02.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:59.725+0000 7fd2567fc700 1 -- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fd240036640 msgr2=0x7fd240038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2195776328 2023-12-08T20:21:02.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:20:59.725+0000 7fd2567fc700 1 --2- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fd240036640 0x7fd240038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-08T20:21:02.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:01.326+0000 7fd2567fc700 1 -- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fd240036640 msgr2=0x7fd240038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2195776328 2023-12-08T20:21:02.995 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:01.326+0000 7fd2567fc700 1 --2- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fd240036640 0x7fd240038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-08T20:21:02.995 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:01.602+0000 7fd23f7fe700 1 -- 172.21.15.43:0/1082172484 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mgrmap(e 6) v1 ==== 43048+0+0 (secure 0 0 0) 0x7fd24800fdc0 con 0x7fd258076bc0 2023-12-08T20:21:02.995 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:01.602+0000 7fd23f7fe700 1 -- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fd240036640 msgr2=0x7fd240038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-08T20:21:02.995 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:01.602+0000 7fd23f7fe700 1 --2- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fd240036640 0x7fd240038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:02.995 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:02.603+0000 7fd23f7fe700 1 -- 172.21.15.43:0/1082172484 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7fd248024970 con 0x7fd258076bc0 2023-12-08T20:21:02.995 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:02.603+0000 7fd23f7fe700 1 --2- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fd240039db0 0x7fd24003c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:02.995 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:02.603+0000 7fd23f7fe700 1 -- 172.21.15.43:0/1082172484 --> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd25804bb80 con 0x7fd240039db0 2023-12-08T20:21:02.995 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:02.604+0000 7fd2567fc700 1 --2- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fd240039db0 0x7fd24003c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:02.995 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:02.605+0000 7fd2567fc700 1 --2- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fd240039db0 0x7fd24003c190 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0039d0 tx=0x7fd24c009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:02.996 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:02.605+0000 7fd23f7fe700 1 -- 172.21.15.43:0/1082172484 <== mgr.14120 v2:172.21.15.43:6800/1561199606 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fd25804bb80 con 0x7fd240039db0 2023-12-08T20:21:02.996 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:02.612+0000 7fd25d8e5700 1 -- 172.21.15.43:0/1082172484 --> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fd258108510 con 0x7fd240039db0 2023-12-08T20:21:02.996 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:02.612+0000 7fd23f7fe700 1 -- 172.21.15.43:0/1082172484 <== mgr.14120 v2:172.21.15.43:6800/1561199606 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fd258108510 con 0x7fd240039db0 2023-12-08T20:21:02.996 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:02.612+0000 7fd25d8e5700 1 -- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fd240039db0 msgr2=0x7fd24003c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:02.996 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:02.612+0000 7fd25d8e5700 1 --2- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fd240039db0 0x7fd24003c190 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0039d0 tx=0x7fd24c009350 comp rx=0 tx=0).stop 2023-12-08T20:21:02.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:02.612+0000 7fd25d8e5700 1 -- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd258076bc0 msgr2=0x7fd258113360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:02.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:02.612+0000 7fd25d8e5700 1 --2- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd258076bc0 0x7fd258113360 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd248006d40 tx=0x7fd248009250 comp rx=0 tx=0).stop 2023-12-08T20:21:02.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:02.612+0000 7fd25d8e5700 1 -- 172.21.15.43:0/1082172484 shutdown_connections 2023-12-08T20:21:02.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:02.612+0000 7fd25d8e5700 1 --2- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fd240039db0 0x7fd24003c190 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:02.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:02.612+0000 7fd25d8e5700 1 --2- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd258076bc0 0x7fd258113360 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:02.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:02.612+0000 7fd25d8e5700 1 --2- 172.21.15.43:0/1082172484 >> [v2:172.21.15.43:6800/2195776328,v1:172.21.15.43:6801/2195776328] conn(0x7fd240036640 0x7fd240038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:02.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:02.612+0000 7fd25d8e5700 1 -- 172.21.15.43:0/1082172484 >> 172.21.15.43:0/1082172484 conn(0x7fd2580fc950 msgr2=0x7fd2580fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:02.998 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:02.612+0000 7fd25d8e5700 1 -- 172.21.15.43:0/1082172484 shutdown_connections 2023-12-08T20:21:02.998 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:02.612+0000 7fd25d8e5700 1 -- 172.21.15.43:0/1082172484 wait complete. 2023-12-08T20:21:02.998 INFO:teuthology.orchestra.run.smithi043.stdout:mgr epoch 5 is available 2023-12-08T20:21:02.998 INFO:teuthology.orchestra.run.smithi043.stdout:Setting orchestrator backend to cephadm... 2023-12-08T20:21:03.866 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:03 smithi043 ceph-mon[111966]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-08T20:21:03.867 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:03 smithi043 ceph-mon[111966]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-08T20:21:03.867 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:03 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:03.867 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:03 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:21:03.867 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:03 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:03.867 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:03 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:21:03.935 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.332+0000 7f2be10a6700 1 Processor -- start 2023-12-08T20:21:03.935 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.332+0000 7f2be10a6700 1 -- start start 2023-12-08T20:21:03.935 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.332+0000 7f2be10a6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bdc1022d0 0x7f2bdc1026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:03.935 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.332+0000 7f2be10a6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc102c20 con 0x7f2bdc1022d0 2023-12-08T20:21:03.935 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.333+0000 7f2bdad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bdc1022d0 0x7f2bdc1026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:03.935 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.333+0000 7f2bdad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bdc1022d0 0x7f2bdc1026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42048/0 (socket says 172.21.15.43:42048) 2023-12-08T20:21:03.935 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.333+0000 7f2bdad9d700 1 -- 172.21.15.43:0/4227085606 learned_addr learned my addr 172.21.15.43:0/4227085606 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:03.935 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.333+0000 7f2bdad9d700 1 -- 172.21.15.43:0/4227085606 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc102d60 con 0x7f2bdc1022d0 2023-12-08T20:21:03.936 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.333+0000 7f2bdad9d700 1 --2- 172.21.15.43:0/4227085606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bdc1022d0 0x7f2bdc1026e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0098e0 tx=0x7f2bcc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6527f1242df2d069 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:03.936 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.333+0000 7f2bd9d9b700 1 -- 172.21.15.43:0/4227085606 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2bcc00b860 con 0x7f2bdc1022d0 2023-12-08T20:21:03.936 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.333+0000 7f2bd9d9b700 1 -- 172.21.15.43:0/4227085606 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f2bcc00be30 con 0x7f2bdc1022d0 2023-12-08T20:21:03.936 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.333+0000 7f2bd9d9b700 1 -- 172.21.15.43:0/4227085606 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2bcc010380 con 0x7f2bdc1022d0 2023-12-08T20:21:03.936 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.334+0000 7f2be10a6700 1 -- 172.21.15.43:0/4227085606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bdc1022d0 msgr2=0x7f2bdc1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:03.936 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.334+0000 7f2be10a6700 1 --2- 172.21.15.43:0/4227085606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bdc1022d0 0x7f2bdc1026e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0098e0 tx=0x7f2bcc009250 comp rx=0 tx=0).stop 2023-12-08T20:21:03.936 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.334+0000 7f2be10a6700 1 -- 172.21.15.43:0/4227085606 shutdown_connections 2023-12-08T20:21:03.936 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.334+0000 7f2be10a6700 1 --2- 172.21.15.43:0/4227085606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bdc1022d0 0x7f2bdc1026e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:03.936 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.334+0000 7f2be10a6700 1 -- 172.21.15.43:0/4227085606 >> 172.21.15.43:0/4227085606 conn(0x7f2bdc0fda50 msgr2=0x7f2bdc0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:03.936 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.334+0000 7f2be10a6700 1 -- 172.21.15.43:0/4227085606 shutdown_connections 2023-12-08T20:21:03.936 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.334+0000 7f2be10a6700 1 -- 172.21.15.43:0/4227085606 wait complete. 2023-12-08T20:21:03.936 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.335+0000 7f2be10a6700 1 Processor -- start 2023-12-08T20:21:03.936 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.335+0000 7f2be10a6700 1 -- start start 2023-12-08T20:21:03.936 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.335+0000 7f2be10a6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bdc1022d0 0x7f2bdc111130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:03.936 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.335+0000 7f2be10a6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc111670 con 0x7f2bdc1022d0 2023-12-08T20:21:03.937 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.335+0000 7f2bdad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bdc1022d0 0x7f2bdc111130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:03.937 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.335+0000 7f2bdad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bdc1022d0 0x7f2bdc111130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42056/0 (socket says 172.21.15.43:42056) 2023-12-08T20:21:03.937 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.335+0000 7f2bdad9d700 1 -- 172.21.15.43:0/2149204459 learned_addr learned my addr 172.21.15.43:0/2149204459 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:03.937 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.336+0000 7f2bdad9d700 1 -- 172.21.15.43:0/2149204459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bcc0094f0 con 0x7f2bdc1022d0 2023-12-08T20:21:03.937 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.336+0000 7f2bdad9d700 1 --2- 172.21.15.43:0/2149204459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bdc1022d0 0x7f2bdc111130 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc006b00 tx=0x7f2bcc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:03.937 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.336+0000 7f2bc37fe700 1 -- 172.21.15.43:0/2149204459 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2bcc0109b0 con 0x7f2bdc1022d0 2023-12-08T20:21:03.937 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.336+0000 7f2bc37fe700 1 -- 172.21.15.43:0/2149204459 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f2bcc024440 con 0x7f2bdc1022d0 2023-12-08T20:21:03.937 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.336+0000 7f2be10a6700 1 -- 172.21.15.43:0/2149204459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bdc111870 con 0x7f2bdc1022d0 2023-12-08T20:21:03.937 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.336+0000 7f2bc37fe700 1 -- 172.21.15.43:0/2149204459 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2bcc01a5f0 con 0x7f2bdc1022d0 2023-12-08T20:21:03.937 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.336+0000 7f2be10a6700 1 -- 172.21.15.43:0/2149204459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bdc111c80 con 0x7f2bdc1022d0 2023-12-08T20:21:03.937 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.337+0000 7f2be10a6700 1 -- 172.21.15.43:0/2149204459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bdc04bb80 con 0x7f2bdc1022d0 2023-12-08T20:21:03.937 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.337+0000 7f2bc37fe700 1 -- 172.21.15.43:0/2149204459 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7f2bcc024990 con 0x7f2bdc1022d0 2023-12-08T20:21:03.937 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.338+0000 7f2bc37fe700 1 --2- 172.21.15.43:0/2149204459 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f2bc4036510 0x7f2bc40389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:03.937 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.338+0000 7f2bc37fe700 1 -- 172.21.15.43:0/2149204459 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f2bcc04a3a0 con 0x7f2bdc1022d0 2023-12-08T20:21:03.938 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.338+0000 7f2bda59c700 1 --2- 172.21.15.43:0/2149204459 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f2bc4036510 0x7f2bc40389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:03.938 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.338+0000 7f2bda59c700 1 --2- 172.21.15.43:0/2149204459 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f2bc4036510 0x7f2bc40389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009990 tx=0x7f2bd0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:03.938 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.342+0000 7f2bc37fe700 1 -- 172.21.15.43:0/2149204459 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2bcc006d70 con 0x7f2bdc1022d0 2023-12-08T20:21:03.938 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.560+0000 7f2be10a6700 1 -- 172.21.15.43:0/2149204459 --> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bdc10afc0 con 0x7f2bc4036510 2023-12-08T20:21:03.938 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.566+0000 7f2bc37fe700 1 -- 172.21.15.43:0/2149204459 <== mgr.14120 v2:172.21.15.43:6800/1561199606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2bdc10afc0 con 0x7f2bc4036510 2023-12-08T20:21:03.938 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.568+0000 7f2be10a6700 1 -- 172.21.15.43:0/2149204459 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f2bc4036510 msgr2=0x7f2bc40389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:03.938 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.568+0000 7f2be10a6700 1 --2- 172.21.15.43:0/2149204459 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f2bc4036510 0x7f2bc40389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009990 tx=0x7f2bd0006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:03.938 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.568+0000 7f2be10a6700 1 -- 172.21.15.43:0/2149204459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bdc1022d0 msgr2=0x7f2bdc111130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:03.938 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.568+0000 7f2be10a6700 1 --2- 172.21.15.43:0/2149204459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bdc1022d0 0x7f2bdc111130 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc006b00 tx=0x7f2bcc009250 comp rx=0 tx=0).stop 2023-12-08T20:21:03.938 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.568+0000 7f2be10a6700 1 -- 172.21.15.43:0/2149204459 shutdown_connections 2023-12-08T20:21:03.938 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.568+0000 7f2be10a6700 1 --2- 172.21.15.43:0/2149204459 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f2bc4036510 0x7f2bc40389c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:03.938 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.568+0000 7f2be10a6700 1 --2- 172.21.15.43:0/2149204459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bdc1022d0 0x7f2bdc111130 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:03.938 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.568+0000 7f2be10a6700 1 -- 172.21.15.43:0/2149204459 >> 172.21.15.43:0/2149204459 conn(0x7f2bdc0fda50 msgr2=0x7f2bdc0ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:03.938 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.568+0000 7f2be10a6700 1 -- 172.21.15.43:0/2149204459 shutdown_connections 2023-12-08T20:21:03.938 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:03.568+0000 7f2be10a6700 1 -- 172.21.15.43:0/2149204459 wait complete. 2023-12-08T20:21:04.904 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:04 smithi043 ceph-mon[111966]: [08/Dec/2023:20:21:03] ENGINE Bus STARTING 2023-12-08T20:21:04.904 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:04 smithi043 ceph-mon[111966]: [08/Dec/2023:20:21:03] ENGINE Serving on https://172.21.15.43:7150 2023-12-08T20:21:04.904 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:04 smithi043 ceph-mon[111966]: [08/Dec/2023:20:21:03] ENGINE Bus STARTED 2023-12-08T20:21:04.904 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:04 smithi043 ceph-mon[111966]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:21:04.904 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:04 smithi043 ceph-mon[111966]: mgrmap e8: smithi043.hqcdcm(active, since 2s) 2023-12-08T20:21:05.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout value unchanged 2023-12-08T20:21:05.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.509+0000 7fcda8054700 1 Processor -- start 2023-12-08T20:21:05.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.509+0000 7fcda8054700 1 -- start start 2023-12-08T20:21:05.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.509+0000 7fcda8054700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcda01022d0 0x7fcda01026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:05.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.509+0000 7fcda8054700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda0102c20 con 0x7fcda01022d0 2023-12-08T20:21:05.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.510+0000 7fcda5df0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcda01022d0 0x7fcda01026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:05.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.510+0000 7fcda5df0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcda01022d0 0x7fcda01026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42060/0 (socket says 172.21.15.43:42060) 2023-12-08T20:21:05.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.510+0000 7fcda5df0700 1 -- 172.21.15.43:0/99815432 learned_addr learned my addr 172.21.15.43:0/99815432 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:05.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.510+0000 7fcda5df0700 1 -- 172.21.15.43:0/99815432 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda0102d60 con 0x7fcda01022d0 2023-12-08T20:21:05.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.510+0000 7fcda5df0700 1 --2- 172.21.15.43:0/99815432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcda01022d0 0x7fcda01026e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0098e0 tx=0x7fcd9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d33d71bf8480ac server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:05.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.510+0000 7fcda4dee700 1 -- 172.21.15.43:0/99815432 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd9c00b860 con 0x7fcda01022d0 2023-12-08T20:21:05.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.510+0000 7fcda4dee700 1 -- 172.21.15.43:0/99815432 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fcd9c00be30 con 0x7fcda01022d0 2023-12-08T20:21:05.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.510+0000 7fcda4dee700 1 -- 172.21.15.43:0/99815432 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd9c010380 con 0x7fcda01022d0 2023-12-08T20:21:05.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.511+0000 7fcda8054700 1 -- 172.21.15.43:0/99815432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcda01022d0 msgr2=0x7fcda01026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:05.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.511+0000 7fcda8054700 1 --2- 172.21.15.43:0/99815432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcda01022d0 0x7fcda01026e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0098e0 tx=0x7fcd9c009250 comp rx=0 tx=0).stop 2023-12-08T20:21:05.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.511+0000 7fcda8054700 1 -- 172.21.15.43:0/99815432 shutdown_connections 2023-12-08T20:21:05.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.511+0000 7fcda8054700 1 --2- 172.21.15.43:0/99815432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcda01022d0 0x7fcda01026e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:05.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.511+0000 7fcda8054700 1 -- 172.21.15.43:0/99815432 >> 172.21.15.43:0/99815432 conn(0x7fcda00fda50 msgr2=0x7fcda00ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:05.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.511+0000 7fcda8054700 1 -- 172.21.15.43:0/99815432 shutdown_connections 2023-12-08T20:21:05.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.511+0000 7fcda8054700 1 -- 172.21.15.43:0/99815432 wait complete. 2023-12-08T20:21:05.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.512+0000 7fcda8054700 1 Processor -- start 2023-12-08T20:21:05.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.512+0000 7fcda8054700 1 -- start start 2023-12-08T20:21:05.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.512+0000 7fcda8054700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcda01022d0 0x7fcda0113360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:05.097 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.512+0000 7fcda8054700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda01138a0 con 0x7fcda01022d0 2023-12-08T20:21:05.097 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.512+0000 7fcda5df0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcda01022d0 0x7fcda0113360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:05.097 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.512+0000 7fcda5df0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcda01022d0 0x7fcda0113360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42072/0 (socket says 172.21.15.43:42072) 2023-12-08T20:21:05.097 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.512+0000 7fcda5df0700 1 -- 172.21.15.43:0/263634754 learned_addr learned my addr 172.21.15.43:0/263634754 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:05.097 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.512+0000 7fcda5df0700 1 -- 172.21.15.43:0/263634754 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c0094f0 con 0x7fcda01022d0 2023-12-08T20:21:05.097 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.512+0000 7fcda5df0700 1 --2- 172.21.15.43:0/263634754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcda01022d0 0x7fcda0113360 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c000c00 tx=0x7fcd9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:05.097 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.513+0000 7fcd967fc700 1 -- 172.21.15.43:0/263634754 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd9c010a80 con 0x7fcda01022d0 2023-12-08T20:21:05.097 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.513+0000 7fcd967fc700 1 -- 172.21.15.43:0/263634754 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fcd9c01a430 con 0x7fcda01022d0 2023-12-08T20:21:05.097 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.513+0000 7fcda8054700 1 -- 172.21.15.43:0/263634754 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda0113aa0 con 0x7fcda01022d0 2023-12-08T20:21:05.097 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.513+0000 7fcd967fc700 1 -- 172.21.15.43:0/263634754 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd9c0245b0 con 0x7fcda01022d0 2023-12-08T20:21:05.097 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.513+0000 7fcda8054700 1 -- 172.21.15.43:0/263634754 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda0113eb0 con 0x7fcda01022d0 2023-12-08T20:21:05.097 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.514+0000 7fcd967fc700 1 -- 172.21.15.43:0/263634754 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7fcd9c0247a0 con 0x7fcda01022d0 2023-12-08T20:21:05.097 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.514+0000 7fcda8054700 1 -- 172.21.15.43:0/263634754 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda004bb80 con 0x7fcda01022d0 2023-12-08T20:21:05.097 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.514+0000 7fcd967fc700 1 --2- 172.21.15.43:0/263634754 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fcd8c036510 0x7fcd8c0389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:05.097 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.514+0000 7fcd967fc700 1 -- 172.21.15.43:0/263634754 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fcd9c04aad0 con 0x7fcda01022d0 2023-12-08T20:21:05.097 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.514+0000 7fcda55ef700 1 --2- 172.21.15.43:0/263634754 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fcd8c036510 0x7fcd8c0389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:05.098 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.514+0000 7fcda55ef700 1 --2- 172.21.15.43:0/263634754 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fcd8c036510 0x7fcd8c0389c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcd90009990 tx=0x7fcd90006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:05.098 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.519+0000 7fcd967fc700 1 -- 172.21.15.43:0/263634754 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcd9c023570 con 0x7fcda01022d0 2023-12-08T20:21:05.098 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.565+0000 7fcd967fc700 1 -- 172.21.15.43:0/263634754 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fcd9c02e960 con 0x7fcda01022d0 2023-12-08T20:21:05.098 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.726+0000 7fcda8054700 1 -- 172.21.15.43:0/263634754 --> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fcda010d3c0 con 0x7fcd8c036510 2023-12-08T20:21:05.098 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.726+0000 7fcd967fc700 1 -- 172.21.15.43:0/263634754 <== mgr.14120 v2:172.21.15.43:6800/1561199606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fcda010d3c0 con 0x7fcd8c036510 2023-12-08T20:21:05.098 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.728+0000 7fcda8054700 1 -- 172.21.15.43:0/263634754 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fcd8c036510 msgr2=0x7fcd8c0389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:05.098 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.728+0000 7fcda8054700 1 --2- 172.21.15.43:0/263634754 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fcd8c036510 0x7fcd8c0389c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcd90009990 tx=0x7fcd90006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:05.098 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.728+0000 7fcda8054700 1 -- 172.21.15.43:0/263634754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcda01022d0 msgr2=0x7fcda0113360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:05.098 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.728+0000 7fcda8054700 1 --2- 172.21.15.43:0/263634754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcda01022d0 0x7fcda0113360 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c000c00 tx=0x7fcd9c009250 comp rx=0 tx=0).stop 2023-12-08T20:21:05.098 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.728+0000 7fcda8054700 1 -- 172.21.15.43:0/263634754 shutdown_connections 2023-12-08T20:21:05.098 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.728+0000 7fcda8054700 1 --2- 172.21.15.43:0/263634754 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fcd8c036510 0x7fcd8c0389c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:05.098 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.728+0000 7fcda8054700 1 --2- 172.21.15.43:0/263634754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcda01022d0 0x7fcda0113360 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:05.098 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.728+0000 7fcda8054700 1 -- 172.21.15.43:0/263634754 >> 172.21.15.43:0/263634754 conn(0x7fcda00fda50 msgr2=0x7fcda00ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:05.098 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.729+0000 7fcda8054700 1 -- 172.21.15.43:0/263634754 shutdown_connections 2023-12-08T20:21:05.099 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:04.729+0000 7fcda8054700 1 -- 172.21.15.43:0/263634754 wait complete. 2023-12-08T20:21:05.099 INFO:teuthology.orchestra.run.smithi043.stdout:Generating ssh key... 2023-12-08T20:21:06.001 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:05 smithi043 ceph-mon[111966]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:21:06.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.471+0000 7fe62d8b4700 1 Processor -- start 2023-12-08T20:21:06.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.471+0000 7fe62d8b4700 1 -- start start 2023-12-08T20:21:06.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.471+0000 7fe62d8b4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6281011d0 0x7fe6281015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:06.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.471+0000 7fe62d8b4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe628101b20 con 0x7fe6281011d0 2023-12-08T20:21:06.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.472+0000 7fe626ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6281011d0 0x7fe6281015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:06.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.472+0000 7fe626ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6281011d0 0x7fe6281015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42076/0 (socket says 172.21.15.43:42076) 2023-12-08T20:21:06.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.472+0000 7fe626ffd700 1 -- 172.21.15.43:0/1253152315 learned_addr learned my addr 172.21.15.43:0/1253152315 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:06.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.472+0000 7fe626ffd700 1 -- 172.21.15.43:0/1253152315 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe628101c60 con 0x7fe6281011d0 2023-12-08T20:21:06.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.472+0000 7fe626ffd700 1 --2- 172.21.15.43:0/1253152315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6281011d0 0x7fe6281015e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe6180098e0 tx=0x7fe618009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f874fcf72f479709 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:06.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.472+0000 7fe625ffb700 1 -- 172.21.15.43:0/1253152315 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe61800b860 con 0x7fe6281011d0 2023-12-08T20:21:06.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.472+0000 7fe625ffb700 1 -- 172.21.15.43:0/1253152315 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe61800be30 con 0x7fe6281011d0 2023-12-08T20:21:06.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.472+0000 7fe625ffb700 1 -- 172.21.15.43:0/1253152315 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe618010380 con 0x7fe6281011d0 2023-12-08T20:21:06.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.473+0000 7fe62d8b4700 1 -- 172.21.15.43:0/1253152315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6281011d0 msgr2=0x7fe6281015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:06.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.473+0000 7fe62d8b4700 1 --2- 172.21.15.43:0/1253152315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6281011d0 0x7fe6281015e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe6180098e0 tx=0x7fe618009250 comp rx=0 tx=0).stop 2023-12-08T20:21:06.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.473+0000 7fe62d8b4700 1 -- 172.21.15.43:0/1253152315 shutdown_connections 2023-12-08T20:21:06.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.473+0000 7fe62d8b4700 1 --2- 172.21.15.43:0/1253152315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6281011d0 0x7fe6281015e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:06.162 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.473+0000 7fe62d8b4700 1 -- 172.21.15.43:0/1253152315 >> 172.21.15.43:0/1253152315 conn(0x7fe6280fc970 msgr2=0x7fe6280fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:06.162 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.473+0000 7fe62d8b4700 1 -- 172.21.15.43:0/1253152315 shutdown_connections 2023-12-08T20:21:06.162 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.473+0000 7fe62d8b4700 1 -- 172.21.15.43:0/1253152315 wait complete. 2023-12-08T20:21:06.162 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.474+0000 7fe62d8b4700 1 Processor -- start 2023-12-08T20:21:06.162 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.474+0000 7fe62d8b4700 1 -- start start 2023-12-08T20:21:06.162 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.474+0000 7fe62d8b4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6281011d0 0x7fe628111150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:06.162 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.474+0000 7fe62d8b4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe628111690 con 0x7fe6281011d0 2023-12-08T20:21:06.162 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.474+0000 7fe626ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6281011d0 0x7fe628111150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:06.162 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.474+0000 7fe626ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6281011d0 0x7fe628111150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42086/0 (socket says 172.21.15.43:42086) 2023-12-08T20:21:06.162 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.474+0000 7fe626ffd700 1 -- 172.21.15.43:0/3104809344 learned_addr learned my addr 172.21.15.43:0/3104809344 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:06.162 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.474+0000 7fe626ffd700 1 -- 172.21.15.43:0/3104809344 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6180094f0 con 0x7fe6281011d0 2023-12-08T20:21:06.162 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.475+0000 7fe626ffd700 1 --2- 172.21.15.43:0/3104809344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6281011d0 0x7fe628111150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe618000c00 tx=0x7fe618009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:06.162 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.475+0000 7fe60f7fe700 1 -- 172.21.15.43:0/3104809344 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe618010a80 con 0x7fe6281011d0 2023-12-08T20:21:06.162 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.475+0000 7fe62d8b4700 1 -- 172.21.15.43:0/3104809344 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe628111890 con 0x7fe6281011d0 2023-12-08T20:21:06.163 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.475+0000 7fe60f7fe700 1 -- 172.21.15.43:0/3104809344 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe61801a430 con 0x7fe6281011d0 2023-12-08T20:21:06.163 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.475+0000 7fe60f7fe700 1 -- 172.21.15.43:0/3104809344 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6180245b0 con 0x7fe6281011d0 2023-12-08T20:21:06.163 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.475+0000 7fe62d8b4700 1 -- 172.21.15.43:0/3104809344 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe628111ca0 con 0x7fe6281011d0 2023-12-08T20:21:06.163 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.476+0000 7fe60f7fe700 1 -- 172.21.15.43:0/3104809344 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fe6180247f0 con 0x7fe6281011d0 2023-12-08T20:21:06.163 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.476+0000 7fe62d8b4700 1 -- 172.21.15.43:0/3104809344 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62804bb80 con 0x7fe6281011d0 2023-12-08T20:21:06.163 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.476+0000 7fe60f7fe700 1 --2- 172.21.15.43:0/3104809344 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fe6100365f0 0x7fe610038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:06.163 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.476+0000 7fe60f7fe700 1 -- 172.21.15.43:0/3104809344 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe61804acb0 con 0x7fe6281011d0 2023-12-08T20:21:06.163 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.476+0000 7fe6267fc700 1 --2- 172.21.15.43:0/3104809344 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fe6100365f0 0x7fe610038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:06.163 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.477+0000 7fe6267fc700 1 --2- 172.21.15.43:0/3104809344 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fe6100365f0 0x7fe610038aa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009990 tx=0x7fe61c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:06.163 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.481+0000 7fe60f7fe700 1 -- 172.21.15.43:0/3104809344 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe618023b80 con 0x7fe6281011d0 2023-12-08T20:21:06.163 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.686+0000 7fe62d8b4700 1 -- 172.21.15.43:0/3104809344 --> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6280fec20 con 0x7fe6100365f0 2023-12-08T20:21:06.163 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.801+0000 7fe60f7fe700 1 -- 172.21.15.43:0/3104809344 <== mgr.14120 v2:172.21.15.43:6800/1561199606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe6280fec20 con 0x7fe6100365f0 2023-12-08T20:21:06.164 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.803+0000 7fe62d8b4700 1 -- 172.21.15.43:0/3104809344 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fe6100365f0 msgr2=0x7fe610038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:06.164 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.803+0000 7fe62d8b4700 1 --2- 172.21.15.43:0/3104809344 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fe6100365f0 0x7fe610038aa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009990 tx=0x7fe61c006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:06.164 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.803+0000 7fe62d8b4700 1 -- 172.21.15.43:0/3104809344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6281011d0 msgr2=0x7fe628111150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:06.164 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.803+0000 7fe62d8b4700 1 --2- 172.21.15.43:0/3104809344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6281011d0 0x7fe628111150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe618000c00 tx=0x7fe618009250 comp rx=0 tx=0).stop 2023-12-08T20:21:06.164 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.803+0000 7fe62d8b4700 1 -- 172.21.15.43:0/3104809344 shutdown_connections 2023-12-08T20:21:06.164 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.803+0000 7fe62d8b4700 1 --2- 172.21.15.43:0/3104809344 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fe6100365f0 0x7fe610038aa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:06.164 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.803+0000 7fe62d8b4700 1 --2- 172.21.15.43:0/3104809344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6281011d0 0x7fe628111150 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:06.164 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.803+0000 7fe62d8b4700 1 -- 172.21.15.43:0/3104809344 >> 172.21.15.43:0/3104809344 conn(0x7fe6280fc970 msgr2=0x7fe628070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:06.164 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.803+0000 7fe62d8b4700 1 -- 172.21.15.43:0/3104809344 shutdown_connections 2023-12-08T20:21:06.164 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:05.803+0000 7fe62d8b4700 1 -- 172.21.15.43:0/3104809344 wait complete. 2023-12-08T20:21:07.182 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:06 smithi043 ceph-mon[111966]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:21:07.183 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:06 smithi043 ceph-mon[111966]: Generating ssh key... 2023-12-08T20:21:07.183 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:06 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:07.183 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:06 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:07.207 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4bVW6YCZf5u0V+C1p4sua3YFCoDBoUwLmB6JuWJlu8TcZp6Bdz21ZvKMEE0St5OBbkt5zagqVgieLMQ3r/ddTENTooOQcbSaun71sLlTnbWHPrPFhvWkINDAbU+vusPzqS9DATpt6/vAap/aSsFPtLx7gHNAQJW2spcyDTQKjjd+9E4wkTn/4+TJFpsQcBck60aX1ACFNq13h72tKzZSAoHVXTr9hCbyeVBNuQzUGbbP1Si7IMiGjneiRpWWEt3rZGgYM3eo3IKIe5vh0xsGDiy1VT8qm0UWqBK9BtXJ9nVBeOC4x4FblGJ2lYAUmmJ6IzJfp5rwWTLjqK7a5PRODRVHm7/1sBkZ0IQVvujH2B37mW7n7GTo3oLRoM2qlxYs3OErTU607eRssT+la3HAg4Iz9q7wWN5YavCy20s9xstkTNMZ6Yzmh8IGL4fNPAyupsKXNIRKqLuFtWXBgoW/BKZcxXH3+br36oBFCqPbWxpFwYrZWYppyBm4/U0V4CSk= ceph-28476818-9607-11ee-95a3-87774f69a715 2023-12-08T20:21:07.207 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.605+0000 7fc9f1655700 1 Processor -- start 2023-12-08T20:21:07.208 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.605+0000 7fc9f1655700 1 -- start start 2023-12-08T20:21:07.208 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.606+0000 7fc9f1655700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9ec070f80 0x7fc9ec107320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:07.208 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.606+0000 7fc9f1655700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec102d10 con 0x7fc9ec070f80 2023-12-08T20:21:07.208 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.606+0000 7fc9eaffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9ec070f80 0x7fc9ec107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:07.208 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.606+0000 7fc9eaffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9ec070f80 0x7fc9ec107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42090/0 (socket says 172.21.15.43:42090) 2023-12-08T20:21:07.208 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.606+0000 7fc9eaffd700 1 -- 172.21.15.43:0/2665429965 learned_addr learned my addr 172.21.15.43:0/2665429965 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:07.208 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.606+0000 7fc9eaffd700 1 -- 172.21.15.43:0/2665429965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec107860 con 0x7fc9ec070f80 2023-12-08T20:21:07.208 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.606+0000 7fc9eaffd700 1 --2- 172.21.15.43:0/2665429965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9ec070f80 0x7fc9ec107320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009e50 tx=0x7fc9dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a860cb58368054 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:07.208 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.607+0000 7fc9e9ffb700 1 -- 172.21.15.43:0/2665429965 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc9dc0092e0 con 0x7fc9ec070f80 2023-12-08T20:21:07.208 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.607+0000 7fc9e9ffb700 1 -- 172.21.15.43:0/2665429965 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc9dc00be90 con 0x7fc9ec070f80 2023-12-08T20:21:07.208 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.607+0000 7fc9e9ffb700 1 -- 172.21.15.43:0/2665429965 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc9dc007400 con 0x7fc9ec070f80 2023-12-08T20:21:07.208 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.607+0000 7fc9f1655700 1 -- 172.21.15.43:0/2665429965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9ec070f80 msgr2=0x7fc9ec107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:07.208 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.607+0000 7fc9f1655700 1 --2- 172.21.15.43:0/2665429965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9ec070f80 0x7fc9ec107320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009e50 tx=0x7fc9dc009840 comp rx=0 tx=0).stop 2023-12-08T20:21:07.208 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.607+0000 7fc9f1655700 1 -- 172.21.15.43:0/2665429965 shutdown_connections 2023-12-08T20:21:07.209 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.607+0000 7fc9f1655700 1 --2- 172.21.15.43:0/2665429965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9ec070f80 0x7fc9ec107320 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:07.209 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.607+0000 7fc9f1655700 1 -- 172.21.15.43:0/2665429965 >> 172.21.15.43:0/2665429965 conn(0x7fc9ec0fc970 msgr2=0x7fc9ec0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:07.209 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.608+0000 7fc9f1655700 1 -- 172.21.15.43:0/2665429965 shutdown_connections 2023-12-08T20:21:07.209 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.608+0000 7fc9f1655700 1 -- 172.21.15.43:0/2665429965 wait complete. 2023-12-08T20:21:07.209 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.608+0000 7fc9f1655700 1 Processor -- start 2023-12-08T20:21:07.209 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.609+0000 7fc9f1655700 1 -- start start 2023-12-08T20:21:07.209 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.609+0000 7fc9f1655700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9ec070f80 0x7fc9ec1133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:07.209 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.609+0000 7fc9f1655700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec1138e0 con 0x7fc9ec070f80 2023-12-08T20:21:07.209 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.609+0000 7fc9eaffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9ec070f80 0x7fc9ec1133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:07.209 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.609+0000 7fc9eaffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9ec070f80 0x7fc9ec1133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42092/0 (socket says 172.21.15.43:42092) 2023-12-08T20:21:07.209 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.609+0000 7fc9eaffd700 1 -- 172.21.15.43:0/3059857693 learned_addr learned my addr 172.21.15.43:0/3059857693 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:07.209 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.609+0000 7fc9eaffd700 1 -- 172.21.15.43:0/3059857693 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc009ae0 con 0x7fc9ec070f80 2023-12-08T20:21:07.209 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.609+0000 7fc9eaffd700 1 --2- 172.21.15.43:0/3059857693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9ec070f80 0x7fc9ec1133a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc000f80 tx=0x7fc9dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:07.209 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.610+0000 7fc9e37fe700 1 -- 172.21.15.43:0/3059857693 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc9dc01c620 con 0x7fc9ec070f80 2023-12-08T20:21:07.209 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.610+0000 7fc9e37fe700 1 -- 172.21.15.43:0/3059857693 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc9dc01cbf0 con 0x7fc9ec070f80 2023-12-08T20:21:07.210 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.610+0000 7fc9f1655700 1 -- 172.21.15.43:0/3059857693 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ec113ae0 con 0x7fc9ec070f80 2023-12-08T20:21:07.210 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.610+0000 7fc9e37fe700 1 -- 172.21.15.43:0/3059857693 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc9dc007b40 con 0x7fc9ec070f80 2023-12-08T20:21:07.210 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.610+0000 7fc9f1655700 1 -- 172.21.15.43:0/3059857693 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ec114780 con 0x7fc9ec070f80 2023-12-08T20:21:07.210 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.611+0000 7fc9e37fe700 1 -- 172.21.15.43:0/3059857693 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fc9dc019070 con 0x7fc9ec070f80 2023-12-08T20:21:07.210 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.611+0000 7fc9f1655700 1 -- 172.21.15.43:0/3059857693 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ec113f50 con 0x7fc9ec070f80 2023-12-08T20:21:07.210 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.611+0000 7fc9e37fe700 1 --2- 172.21.15.43:0/3059857693 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fc9d8036640 0x7fc9d8038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:07.210 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.611+0000 7fc9e37fe700 1 -- 172.21.15.43:0/3059857693 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc9dc04a220 con 0x7fc9ec070f80 2023-12-08T20:21:07.210 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.611+0000 7fc9ea7fc700 1 --2- 172.21.15.43:0/3059857693 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fc9d8036640 0x7fc9d8038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:07.210 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.611+0000 7fc9ea7fc700 1 --2- 172.21.15.43:0/3059857693 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fc9d8036640 0x7fc9d8038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009990 tx=0x7fc9d4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:07.210 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.616+0000 7fc9e37fe700 1 -- 172.21.15.43:0/3059857693 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc9dc019910 con 0x7fc9ec070f80 2023-12-08T20:21:07.210 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.817+0000 7fc9f1655700 1 -- 172.21.15.43:0/3059857693 --> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9ec114a80 con 0x7fc9d8036640 2023-12-08T20:21:07.210 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.818+0000 7fc9e37fe700 1 -- 172.21.15.43:0/3059857693 <== mgr.14120 v2:172.21.15.43:6800/1561199606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fc9ec114a80 con 0x7fc9d8036640 2023-12-08T20:21:07.210 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.820+0000 7fc9f1655700 1 -- 172.21.15.43:0/3059857693 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fc9d8036640 msgr2=0x7fc9d8038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:07.210 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.820+0000 7fc9f1655700 1 --2- 172.21.15.43:0/3059857693 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fc9d8036640 0x7fc9d8038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009990 tx=0x7fc9d4006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:07.211 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.820+0000 7fc9f1655700 1 -- 172.21.15.43:0/3059857693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9ec070f80 msgr2=0x7fc9ec1133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:07.211 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.820+0000 7fc9f1655700 1 --2- 172.21.15.43:0/3059857693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9ec070f80 0x7fc9ec1133a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc000f80 tx=0x7fc9dc009840 comp rx=0 tx=0).stop 2023-12-08T20:21:07.211 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.820+0000 7fc9f1655700 1 -- 172.21.15.43:0/3059857693 shutdown_connections 2023-12-08T20:21:07.211 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.820+0000 7fc9f1655700 1 --2- 172.21.15.43:0/3059857693 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fc9d8036640 0x7fc9d8038af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:07.211 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.820+0000 7fc9f1655700 1 --2- 172.21.15.43:0/3059857693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9ec070f80 0x7fc9ec1133a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:07.211 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.820+0000 7fc9f1655700 1 -- 172.21.15.43:0/3059857693 >> 172.21.15.43:0/3059857693 conn(0x7fc9ec0fc970 msgr2=0x7fc9ec0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:07.211 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.820+0000 7fc9f1655700 1 -- 172.21.15.43:0/3059857693 shutdown_connections 2023-12-08T20:21:07.211 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:06.820+0000 7fc9f1655700 1 -- 172.21.15.43:0/3059857693 wait complete. 2023-12-08T20:21:07.211 INFO:teuthology.orchestra.run.smithi043.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-12-08T20:21:07.211 INFO:teuthology.orchestra.run.smithi043.stdout:Adding key to root@localhost authorized_keys... 2023-12-08T20:21:07.212 INFO:teuthology.orchestra.run.smithi043.stdout:Adding host smithi043... 2023-12-08T20:21:08.051 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:07 smithi043 ceph-mon[111966]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:21:09.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:08 smithi043 ceph-mon[111966]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi043", "addr": "172.21.15.43", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:21:09.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Added host 'smithi043' with addr '172.21.15.43' 2023-12-08T20:21:09.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.582+0000 7f6ec0008700 1 Processor -- start 2023-12-08T20:21:09.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.582+0000 7f6ec0008700 1 -- start start 2023-12-08T20:21:09.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.582+0000 7f6ec0008700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb8102900 0x7f6eb8102d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:09.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.582+0000 7f6ec0008700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8103250 con 0x7f6eb8102900 2023-12-08T20:21:09.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.583+0000 7f6ebdda4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb8102900 0x7f6eb8102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:09.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.583+0000 7f6ebdda4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb8102900 0x7f6eb8102d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42108/0 (socket says 172.21.15.43:42108) 2023-12-08T20:21:09.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.583+0000 7f6ebdda4700 1 -- 172.21.15.43:0/2004862041 learned_addr learned my addr 172.21.15.43:0/2004862041 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:09.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.583+0000 7f6ebdda4700 1 -- 172.21.15.43:0/2004862041 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb8103390 con 0x7f6eb8102900 2023-12-08T20:21:09.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.583+0000 7f6ebdda4700 1 --2- 172.21.15.43:0/2004862041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb8102900 0x7f6eb8102d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40098e0 tx=0x7f6eb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920b394af5925207 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:09.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.584+0000 7f6ebcda2700 1 -- 172.21.15.43:0/2004862041 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6eb400b860 con 0x7f6eb8102900 2023-12-08T20:21:09.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.584+0000 7f6ebcda2700 1 -- 172.21.15.43:0/2004862041 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f6eb400be30 con 0x7f6eb8102900 2023-12-08T20:21:09.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.584+0000 7f6ebcda2700 1 -- 172.21.15.43:0/2004862041 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6eb4010380 con 0x7f6eb8102900 2023-12-08T20:21:09.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.584+0000 7f6ec0008700 1 -- 172.21.15.43:0/2004862041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb8102900 msgr2=0x7f6eb8102d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:09.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.584+0000 7f6ec0008700 1 --2- 172.21.15.43:0/2004862041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb8102900 0x7f6eb8102d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40098e0 tx=0x7f6eb4009250 comp rx=0 tx=0).stop 2023-12-08T20:21:09.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.584+0000 7f6ec0008700 1 -- 172.21.15.43:0/2004862041 shutdown_connections 2023-12-08T20:21:09.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.584+0000 7f6ec0008700 1 --2- 172.21.15.43:0/2004862041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb8102900 0x7f6eb8102d10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:09.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.584+0000 7f6ec0008700 1 -- 172.21.15.43:0/2004862041 >> 172.21.15.43:0/2004862041 conn(0x7f6eb80fc0b0 msgr2=0x7f6eb80fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:09.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.584+0000 7f6ec0008700 1 -- 172.21.15.43:0/2004862041 shutdown_connections 2023-12-08T20:21:09.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.584+0000 7f6ec0008700 1 -- 172.21.15.43:0/2004862041 wait complete. 2023-12-08T20:21:09.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.585+0000 7f6ec0008700 1 Processor -- start 2023-12-08T20:21:09.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.585+0000 7f6ec0008700 1 -- start start 2023-12-08T20:21:09.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.585+0000 7f6ec0008700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb8102900 0x7f6eb8113360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:09.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.585+0000 7f6ec0008700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb81138a0 con 0x7f6eb8102900 2023-12-08T20:21:09.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.586+0000 7f6ebdda4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb8102900 0x7f6eb8113360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:09.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.586+0000 7f6ebdda4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb8102900 0x7f6eb8113360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42124/0 (socket says 172.21.15.43:42124) 2023-12-08T20:21:09.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.586+0000 7f6ebdda4700 1 -- 172.21.15.43:0/385647158 learned_addr learned my addr 172.21.15.43:0/385647158 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:09.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.586+0000 7f6ebdda4700 1 -- 172.21.15.43:0/385647158 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb40094f0 con 0x7f6eb8102900 2023-12-08T20:21:09.964 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.586+0000 7f6ebdda4700 1 --2- 172.21.15.43:0/385647158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb8102900 0x7f6eb8113360 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4006b00 tx=0x7f6eb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:09.964 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.586+0000 7f6eae7fc700 1 -- 172.21.15.43:0/385647158 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6eb40109b0 con 0x7f6eb8102900 2023-12-08T20:21:09.964 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.586+0000 7f6eae7fc700 1 -- 172.21.15.43:0/385647158 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f6eb4024440 con 0x7f6eb8102900 2023-12-08T20:21:09.964 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.586+0000 7f6ec0008700 1 -- 172.21.15.43:0/385647158 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb8113aa0 con 0x7f6eb8102900 2023-12-08T20:21:09.964 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.586+0000 7f6eae7fc700 1 -- 172.21.15.43:0/385647158 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6eb401a5f0 con 0x7f6eb8102900 2023-12-08T20:21:09.964 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.586+0000 7f6ec0008700 1 -- 172.21.15.43:0/385647158 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb8113eb0 con 0x7f6eb8102900 2023-12-08T20:21:09.964 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.587+0000 7f6eae7fc700 1 -- 172.21.15.43:0/385647158 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f6eb4010b10 con 0x7f6eb8102900 2023-12-08T20:21:09.964 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.587+0000 7f6ec0008700 1 -- 172.21.15.43:0/385647158 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb804bb80 con 0x7f6eb8102900 2023-12-08T20:21:09.964 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.587+0000 7f6eae7fc700 1 --2- 172.21.15.43:0/385647158 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f6ea40365f0 0x7f6ea4038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:09.964 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.588+0000 7f6eae7fc700 1 -- 172.21.15.43:0/385647158 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6eb404a5e0 con 0x7f6eb8102900 2023-12-08T20:21:09.964 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.588+0000 7f6ebd5a3700 1 --2- 172.21.15.43:0/385647158 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f6ea40365f0 0x7f6ea4038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:09.964 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.588+0000 7f6ebd5a3700 1 --2- 172.21.15.43:0/385647158 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f6ea40365f0 0x7f6ea4038aa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8009990 tx=0x7f6ea8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:09.964 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.592+0000 7f6eae7fc700 1 -- 172.21.15.43:0/385647158 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6eb40239f0 con 0x7f6eb8102900 2023-12-08T20:21:09.964 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:07.800+0000 7f6ec0008700 1 -- 172.21.15.43:0/385647158 --> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi043", "addr": "172.21.15.43", "target": ["mon-mgr", ""]}) v1 -- 0x7f6eb810d1d0 con 0x7f6ea40365f0 2023-12-08T20:21:09.965 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:09.638+0000 7f6eae7fc700 1 -- 172.21.15.43:0/385647158 <== mgr.14120 v2:172.21.15.43:6800/1561199606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f6eb810d1d0 con 0x7f6ea40365f0 2023-12-08T20:21:09.965 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:09.640+0000 7f6ec0008700 1 -- 172.21.15.43:0/385647158 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f6ea40365f0 msgr2=0x7f6ea4038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:09.965 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:09.640+0000 7f6ec0008700 1 --2- 172.21.15.43:0/385647158 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f6ea40365f0 0x7f6ea4038aa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8009990 tx=0x7f6ea8006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:09.965 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:09.641+0000 7f6ec0008700 1 -- 172.21.15.43:0/385647158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb8102900 msgr2=0x7f6eb8113360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:09.965 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:09.641+0000 7f6ec0008700 1 --2- 172.21.15.43:0/385647158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb8102900 0x7f6eb8113360 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4006b00 tx=0x7f6eb4009250 comp rx=0 tx=0).stop 2023-12-08T20:21:09.965 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:09.641+0000 7f6ec0008700 1 -- 172.21.15.43:0/385647158 shutdown_connections 2023-12-08T20:21:09.965 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:09.641+0000 7f6ec0008700 1 --2- 172.21.15.43:0/385647158 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f6ea40365f0 0x7f6ea4038aa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:09.965 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:09.641+0000 7f6ec0008700 1 --2- 172.21.15.43:0/385647158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb8102900 0x7f6eb8113360 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:09.965 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:09.641+0000 7f6ec0008700 1 -- 172.21.15.43:0/385647158 >> 172.21.15.43:0/385647158 conn(0x7f6eb80fc0b0 msgr2=0x7f6eb80fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:09.965 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:09.641+0000 7f6ec0008700 1 -- 172.21.15.43:0/385647158 shutdown_connections 2023-12-08T20:21:09.965 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:09.641+0000 7f6ec0008700 1 -- 172.21.15.43:0/385647158 wait complete. 2023-12-08T20:21:09.965 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:09 smithi043 ceph-mon[111966]: Deploying cephadm binary to smithi043 2023-12-08T20:21:09.966 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:09 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:09.966 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:09 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:21:09.966 INFO:teuthology.orchestra.run.smithi043.stdout:Deploying mon service with default placement... 2023-12-08T20:21:10.924 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:10 smithi043 ceph-mon[111966]: Added host smithi043 2023-12-08T20:21:10.924 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:10 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:11.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-12-08T20:21:11.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.360+0000 7f9e4785c700 1 Processor -- start 2023-12-08T20:21:11.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.360+0000 7f9e4785c700 1 -- start start 2023-12-08T20:21:11.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.360+0000 7f9e4785c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e401022d0 0x7f9e401026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:11.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.360+0000 7f9e4785c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e40102c20 con 0x7f9e401022d0 2023-12-08T20:21:11.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.360+0000 7f9e455f8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e401022d0 0x7f9e401026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:11.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.360+0000 7f9e455f8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e401022d0 0x7f9e401026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42140/0 (socket says 172.21.15.43:42140) 2023-12-08T20:21:11.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.360+0000 7f9e455f8700 1 -- 172.21.15.43:0/1630636585 learned_addr learned my addr 172.21.15.43:0/1630636585 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:11.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.361+0000 7f9e455f8700 1 -- 172.21.15.43:0/1630636585 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e40102d60 con 0x7f9e401022d0 2023-12-08T20:21:11.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.361+0000 7f9e455f8700 1 --2- 172.21.15.43:0/1630636585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e401022d0 0x7f9e401026e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0098e0 tx=0x7f9e3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d526d9e9fec126c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:11.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.361+0000 7f9e33fff700 1 -- 172.21.15.43:0/1630636585 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e3c00b860 con 0x7f9e401022d0 2023-12-08T20:21:11.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.361+0000 7f9e33fff700 1 -- 172.21.15.43:0/1630636585 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f9e3c00be30 con 0x7f9e401022d0 2023-12-08T20:21:11.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.361+0000 7f9e33fff700 1 -- 172.21.15.43:0/1630636585 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e3c010380 con 0x7f9e401022d0 2023-12-08T20:21:11.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.362+0000 7f9e4785c700 1 -- 172.21.15.43:0/1630636585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e401022d0 msgr2=0x7f9e401026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:11.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.362+0000 7f9e4785c700 1 --2- 172.21.15.43:0/1630636585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e401022d0 0x7f9e401026e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0098e0 tx=0x7f9e3c009250 comp rx=0 tx=0).stop 2023-12-08T20:21:11.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.362+0000 7f9e4785c700 1 -- 172.21.15.43:0/1630636585 shutdown_connections 2023-12-08T20:21:11.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.362+0000 7f9e4785c700 1 --2- 172.21.15.43:0/1630636585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e401022d0 0x7f9e401026e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:11.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.362+0000 7f9e4785c700 1 -- 172.21.15.43:0/1630636585 >> 172.21.15.43:0/1630636585 conn(0x7f9e400fda50 msgr2=0x7f9e400ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:11.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.362+0000 7f9e4785c700 1 -- 172.21.15.43:0/1630636585 shutdown_connections 2023-12-08T20:21:11.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.362+0000 7f9e4785c700 1 -- 172.21.15.43:0/1630636585 wait complete. 2023-12-08T20:21:11.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.362+0000 7f9e4785c700 1 Processor -- start 2023-12-08T20:21:11.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.363+0000 7f9e4785c700 1 -- start start 2023-12-08T20:21:11.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.363+0000 7f9e4785c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e401022d0 0x7f9e40111140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:11.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.363+0000 7f9e4785c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e40111680 con 0x7f9e401022d0 2023-12-08T20:21:11.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.363+0000 7f9e455f8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e401022d0 0x7f9e40111140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:11.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.363+0000 7f9e455f8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e401022d0 0x7f9e40111140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42156/0 (socket says 172.21.15.43:42156) 2023-12-08T20:21:11.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.363+0000 7f9e455f8700 1 -- 172.21.15.43:0/1461841604 learned_addr learned my addr 172.21.15.43:0/1461841604 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:11.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.363+0000 7f9e455f8700 1 -- 172.21.15.43:0/1461841604 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c0094f0 con 0x7f9e401022d0 2023-12-08T20:21:11.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.363+0000 7f9e455f8700 1 --2- 172.21.15.43:0/1461841604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e401022d0 0x7f9e40111140 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c006b00 tx=0x7f9e3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:11.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.363+0000 7f9e31ffb700 1 -- 172.21.15.43:0/1461841604 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e3c0109b0 con 0x7f9e401022d0 2023-12-08T20:21:11.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.363+0000 7f9e4785c700 1 -- 172.21.15.43:0/1461841604 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e40111880 con 0x7f9e401022d0 2023-12-08T20:21:11.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.363+0000 7f9e31ffb700 1 -- 172.21.15.43:0/1461841604 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f9e3c024440 con 0x7f9e401022d0 2023-12-08T20:21:11.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.364+0000 7f9e31ffb700 1 -- 172.21.15.43:0/1461841604 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e3c01a5f0 con 0x7f9e401022d0 2023-12-08T20:21:11.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.364+0000 7f9e4785c700 1 -- 172.21.15.43:0/1461841604 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e40111c90 con 0x7f9e401022d0 2023-12-08T20:21:11.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.364+0000 7f9e31ffb700 1 -- 172.21.15.43:0/1461841604 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f9e3c01a8b0 con 0x7f9e401022d0 2023-12-08T20:21:11.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.365+0000 7f9e31ffb700 1 --2- 172.21.15.43:0/1461841604 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9e2c0365f0 0x7f9e2c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:11.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.365+0000 7f9e4785c700 1 -- 172.21.15.43:0/1461841604 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e4004bb80 con 0x7f9e401022d0 2023-12-08T20:21:11.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.365+0000 7f9e31ffb700 1 -- 172.21.15.43:0/1461841604 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9e3c04a6a0 con 0x7f9e401022d0 2023-12-08T20:21:11.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.365+0000 7f9e44df7700 1 --2- 172.21.15.43:0/1461841604 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9e2c0365f0 0x7f9e2c038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:11.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.365+0000 7f9e44df7700 1 --2- 172.21.15.43:0/1461841604 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9e2c0365f0 0x7f9e2c038aa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009990 tx=0x7f9e34006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:11.005 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.370+0000 7f9e31ffb700 1 -- 172.21.15.43:0/1461841604 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9e3c022340 con 0x7f9e401022d0 2023-12-08T20:21:11.005 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.603+0000 7f9e4785c700 1 -- 172.21.15.43:0/1461841604 --> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e4010afc0 con 0x7f9e2c0365f0 2023-12-08T20:21:11.005 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.608+0000 7f9e31ffb700 1 -- 172.21.15.43:0/1461841604 <== mgr.14120 v2:172.21.15.43:6800/1561199606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9e4010afc0 con 0x7f9e2c0365f0 2023-12-08T20:21:11.005 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.610+0000 7f9e4785c700 1 -- 172.21.15.43:0/1461841604 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9e2c0365f0 msgr2=0x7f9e2c038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:11.005 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.610+0000 7f9e4785c700 1 --2- 172.21.15.43:0/1461841604 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9e2c0365f0 0x7f9e2c038aa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009990 tx=0x7f9e34006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:11.005 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.610+0000 7f9e4785c700 1 -- 172.21.15.43:0/1461841604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e401022d0 msgr2=0x7f9e40111140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:11.005 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.610+0000 7f9e4785c700 1 --2- 172.21.15.43:0/1461841604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e401022d0 0x7f9e40111140 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c006b00 tx=0x7f9e3c009250 comp rx=0 tx=0).stop 2023-12-08T20:21:11.005 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.610+0000 7f9e4785c700 1 -- 172.21.15.43:0/1461841604 shutdown_connections 2023-12-08T20:21:11.005 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.610+0000 7f9e4785c700 1 --2- 172.21.15.43:0/1461841604 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9e2c0365f0 0x7f9e2c038aa0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:11.005 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.610+0000 7f9e4785c700 1 --2- 172.21.15.43:0/1461841604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e401022d0 0x7f9e40111140 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:11.006 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.610+0000 7f9e4785c700 1 -- 172.21.15.43:0/1461841604 >> 172.21.15.43:0/1461841604 conn(0x7f9e400fda50 msgr2=0x7f9e400ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:11.006 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.610+0000 7f9e4785c700 1 -- 172.21.15.43:0/1461841604 shutdown_connections 2023-12-08T20:21:11.006 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:10.610+0000 7f9e4785c700 1 -- 172.21.15.43:0/1461841604 wait complete. 2023-12-08T20:21:11.006 INFO:teuthology.orchestra.run.smithi043.stdout:Deploying mgr service with default placement... 2023-12-08T20:21:11.924 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:11 smithi043 ceph-mon[111966]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:21:11.924 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:11 smithi043 ceph-mon[111966]: Saving service mon spec with placement count:5 2023-12-08T20:21:11.924 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:11 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:11.924 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:11 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:11.959 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-12-08T20:21:11.959 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.362+0000 7fdff5fa3700 1 Processor -- start 2023-12-08T20:21:11.959 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.363+0000 7fdff5fa3700 1 -- start start 2023-12-08T20:21:11.959 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.363+0000 7fdff5fa3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdff0071000 0x7fdff0104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:11.959 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.363+0000 7fdff5fa3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff01053e0 con 0x7fdff0071000 2023-12-08T20:21:11.959 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.363+0000 7fdfef7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdff0071000 0x7fdff0104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:11.959 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.363+0000 7fdfef7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdff0071000 0x7fdff0104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39534/0 (socket says 172.21.15.43:39534) 2023-12-08T20:21:11.960 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.363+0000 7fdfef7fe700 1 -- 172.21.15.43:0/3334905330 learned_addr learned my addr 172.21.15.43:0/3334905330 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:11.960 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.363+0000 7fdfef7fe700 1 -- 172.21.15.43:0/3334905330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff0105520 con 0x7fdff0071000 2023-12-08T20:21:11.960 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.363+0000 7fdfef7fe700 1 --2- 172.21.15.43:0/3334905330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdff0071000 0x7fdff0104ea0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdfe00098e0 tx=0x7fdfe0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5215376c95b80eb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:11.960 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.364+0000 7fdfee7fc700 1 -- 172.21.15.43:0/3334905330 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdfe000b860 con 0x7fdff0071000 2023-12-08T20:21:11.960 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.364+0000 7fdfee7fc700 1 -- 172.21.15.43:0/3334905330 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fdfe000be30 con 0x7fdff0071000 2023-12-08T20:21:11.960 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.364+0000 7fdfee7fc700 1 -- 172.21.15.43:0/3334905330 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdfe0010380 con 0x7fdff0071000 2023-12-08T20:21:11.960 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.364+0000 7fdff5fa3700 1 -- 172.21.15.43:0/3334905330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdff0071000 msgr2=0x7fdff0104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:11.960 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.364+0000 7fdff5fa3700 1 --2- 172.21.15.43:0/3334905330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdff0071000 0x7fdff0104ea0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdfe00098e0 tx=0x7fdfe0009250 comp rx=0 tx=0).stop 2023-12-08T20:21:11.960 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.364+0000 7fdff5fa3700 1 -- 172.21.15.43:0/3334905330 shutdown_connections 2023-12-08T20:21:11.960 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.364+0000 7fdff5fa3700 1 --2- 172.21.15.43:0/3334905330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdff0071000 0x7fdff0104ea0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:11.960 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.364+0000 7fdff5fa3700 1 -- 172.21.15.43:0/3334905330 >> 172.21.15.43:0/3334905330 conn(0x7fdff00fc970 msgr2=0x7fdff00fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:11.960 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.364+0000 7fdff5fa3700 1 -- 172.21.15.43:0/3334905330 shutdown_connections 2023-12-08T20:21:11.960 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.365+0000 7fdff5fa3700 1 -- 172.21.15.43:0/3334905330 wait complete. 2023-12-08T20:21:11.960 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.365+0000 7fdff5fa3700 1 Processor -- start 2023-12-08T20:21:11.960 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.366+0000 7fdff5fa3700 1 -- start start 2023-12-08T20:21:11.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.366+0000 7fdff5fa3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdff0071000 0x7fdff0111160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:11.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.366+0000 7fdff5fa3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff01116a0 con 0x7fdff0071000 2023-12-08T20:21:11.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.366+0000 7fdfef7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdff0071000 0x7fdff0111160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:11.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.366+0000 7fdfef7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdff0071000 0x7fdff0111160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39548/0 (socket says 172.21.15.43:39548) 2023-12-08T20:21:11.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.366+0000 7fdfef7fe700 1 -- 172.21.15.43:0/1784455137 learned_addr learned my addr 172.21.15.43:0/1784455137 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:11.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.366+0000 7fdfef7fe700 1 -- 172.21.15.43:0/1784455137 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe00094f0 con 0x7fdff0071000 2023-12-08T20:21:11.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.366+0000 7fdfef7fe700 1 --2- 172.21.15.43:0/1784455137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdff0071000 0x7fdff0111160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0006d40 tx=0x7fdfe0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:11.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.367+0000 7fdfd7fff700 1 -- 172.21.15.43:0/1784455137 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdfe00109b0 con 0x7fdff0071000 2023-12-08T20:21:11.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.367+0000 7fdfd7fff700 1 -- 172.21.15.43:0/1784455137 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fdfe0024440 con 0x7fdff0071000 2023-12-08T20:21:11.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.367+0000 7fdff5fa3700 1 -- 172.21.15.43:0/1784455137 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff01118a0 con 0x7fdff0071000 2023-12-08T20:21:11.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.367+0000 7fdfd7fff700 1 -- 172.21.15.43:0/1784455137 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdfe001a5f0 con 0x7fdff0071000 2023-12-08T20:21:11.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.367+0000 7fdff5fa3700 1 -- 172.21.15.43:0/1784455137 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff0111cb0 con 0x7fdff0071000 2023-12-08T20:21:11.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.367+0000 7fdfd7fff700 1 -- 172.21.15.43:0/1784455137 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fdfe001a820 con 0x7fdff0071000 2023-12-08T20:21:11.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.368+0000 7fdff5fa3700 1 -- 172.21.15.43:0/1784455137 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff004bb80 con 0x7fdff0071000 2023-12-08T20:21:11.961 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.368+0000 7fdfd7fff700 1 --2- 172.21.15.43:0/1784455137 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fdfd8036640 0x7fdfd8038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:11.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.368+0000 7fdfd7fff700 1 -- 172.21.15.43:0/1784455137 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fdfe004a720 con 0x7fdff0071000 2023-12-08T20:21:11.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.368+0000 7fdfeeffd700 1 --2- 172.21.15.43:0/1784455137 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fdfd8036640 0x7fdfd8038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:11.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.368+0000 7fdfeeffd700 1 --2- 172.21.15.43:0/1784455137 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fdfd8036640 0x7fdfd8038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009990 tx=0x7fdfe4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:11.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.373+0000 7fdfd7fff700 1 -- 172.21.15.43:0/1784455137 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdfe001aad0 con 0x7fdff0071000 2023-12-08T20:21:11.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.510+0000 7fdfd7fff700 1 -- 172.21.15.43:0/1784455137 <== mon.0 v2:172.21.15.43:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdfe001aad0 con 0x7fdff0071000 2023-12-08T20:21:11.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.595+0000 7fdff5fa3700 1 -- 172.21.15.43:0/1784455137 --> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fdff010afb0 con 0x7fdfd8036640 2023-12-08T20:21:11.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.599+0000 7fdfd7fff700 1 -- 172.21.15.43:0/1784455137 <== mgr.14120 v2:172.21.15.43:6800/1561199606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fdff010afb0 con 0x7fdfd8036640 2023-12-08T20:21:11.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.602+0000 7fdff5fa3700 1 -- 172.21.15.43:0/1784455137 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fdfd8036640 msgr2=0x7fdfd8038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:11.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.602+0000 7fdff5fa3700 1 --2- 172.21.15.43:0/1784455137 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fdfd8036640 0x7fdfd8038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009990 tx=0x7fdfe4006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:11.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.602+0000 7fdff5fa3700 1 -- 172.21.15.43:0/1784455137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdff0071000 msgr2=0x7fdff0111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:11.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.602+0000 7fdff5fa3700 1 --2- 172.21.15.43:0/1784455137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdff0071000 0x7fdff0111160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0006d40 tx=0x7fdfe0009250 comp rx=0 tx=0).stop 2023-12-08T20:21:11.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.602+0000 7fdff5fa3700 1 -- 172.21.15.43:0/1784455137 shutdown_connections 2023-12-08T20:21:11.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.602+0000 7fdff5fa3700 1 --2- 172.21.15.43:0/1784455137 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fdfd8036640 0x7fdfd8038af0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:11.962 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.602+0000 7fdff5fa3700 1 --2- 172.21.15.43:0/1784455137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdff0071000 0x7fdff0111160 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:11.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.602+0000 7fdff5fa3700 1 -- 172.21.15.43:0/1784455137 >> 172.21.15.43:0/1784455137 conn(0x7fdff00fc970 msgr2=0x7fdff00fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:11.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.602+0000 7fdff5fa3700 1 -- 172.21.15.43:0/1784455137 shutdown_connections 2023-12-08T20:21:11.963 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:11.602+0000 7fdff5fa3700 1 -- 172.21.15.43:0/1784455137 wait complete. 2023-12-08T20:21:11.963 INFO:teuthology.orchestra.run.smithi043.stdout:Deploying crash service with default placement... 2023-12-08T20:21:13.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:12 smithi043 ceph-mon[111966]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:21:13.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:12 smithi043 ceph-mon[111966]: Saving service mgr spec with placement count:2 2023-12-08T20:21:13.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:12 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:13.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:12 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:13.076 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2023-12-08T20:21:13.076 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.407+0000 7eff6666a700 1 Processor -- start 2023-12-08T20:21:13.076 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.408+0000 7eff6666a700 1 -- start start 2023-12-08T20:21:13.076 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.408+0000 7eff6666a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff60078ce0 0x7eff600771f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:13.076 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.408+0000 7eff6666a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff600790f0 con 0x7eff60078ce0 2023-12-08T20:21:13.076 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.408+0000 7eff5ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff60078ce0 0x7eff600771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:13.076 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.408+0000 7eff5ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff60078ce0 0x7eff600771f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39560/0 (socket says 172.21.15.43:39560) 2023-12-08T20:21:13.076 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.408+0000 7eff5ffff700 1 -- 172.21.15.43:0/3100423783 learned_addr learned my addr 172.21.15.43:0/3100423783 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:13.076 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.408+0000 7eff5ffff700 1 -- 172.21.15.43:0/3100423783 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff60077730 con 0x7eff60078ce0 2023-12-08T20:21:13.076 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.409+0000 7eff5ffff700 1 --2- 172.21.15.43:0/3100423783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff60078ce0 0x7eff600771f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7eff500098e0 tx=0x7eff50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd615369cbd4ce36 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:13.077 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.409+0000 7eff5effd700 1 -- 172.21.15.43:0/3100423783 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff5000b860 con 0x7eff60078ce0 2023-12-08T20:21:13.077 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.409+0000 7eff5effd700 1 -- 172.21.15.43:0/3100423783 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7eff5000be70 con 0x7eff60078ce0 2023-12-08T20:21:13.077 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.409+0000 7eff5effd700 1 -- 172.21.15.43:0/3100423783 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff50010380 con 0x7eff60078ce0 2023-12-08T20:21:13.077 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.410+0000 7eff6666a700 1 -- 172.21.15.43:0/3100423783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff60078ce0 msgr2=0x7eff600771f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:13.077 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.410+0000 7eff6666a700 1 --2- 172.21.15.43:0/3100423783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff60078ce0 0x7eff600771f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7eff500098e0 tx=0x7eff50009250 comp rx=0 tx=0).stop 2023-12-08T20:21:13.077 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.410+0000 7eff6666a700 1 -- 172.21.15.43:0/3100423783 shutdown_connections 2023-12-08T20:21:13.077 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.410+0000 7eff6666a700 1 --2- 172.21.15.43:0/3100423783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff60078ce0 0x7eff600771f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:13.077 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.410+0000 7eff6666a700 1 -- 172.21.15.43:0/3100423783 >> 172.21.15.43:0/3100423783 conn(0x7eff600fda10 msgr2=0x7eff600ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:13.077 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.410+0000 7eff6666a700 1 -- 172.21.15.43:0/3100423783 shutdown_connections 2023-12-08T20:21:13.077 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.410+0000 7eff6666a700 1 -- 172.21.15.43:0/3100423783 wait complete. 2023-12-08T20:21:13.077 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.410+0000 7eff6666a700 1 Processor -- start 2023-12-08T20:21:13.077 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.411+0000 7eff6666a700 1 -- start start 2023-12-08T20:21:13.077 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.411+0000 7eff6666a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff60078ce0 0x7eff60113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:13.077 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.411+0000 7eff6666a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff60113870 con 0x7eff60078ce0 2023-12-08T20:21:13.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.411+0000 7eff5ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff60078ce0 0x7eff60113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:13.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.411+0000 7eff5ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff60078ce0 0x7eff60113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39574/0 (socket says 172.21.15.43:39574) 2023-12-08T20:21:13.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.411+0000 7eff5ffff700 1 -- 172.21.15.43:0/441568876 learned_addr learned my addr 172.21.15.43:0/441568876 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:13.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.411+0000 7eff5ffff700 1 -- 172.21.15.43:0/441568876 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff500094f0 con 0x7eff60078ce0 2023-12-08T20:21:13.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.412+0000 7eff5ffff700 1 --2- 172.21.15.43:0/441568876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff60078ce0 0x7eff60113330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7eff5000ba70 tx=0x7eff50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:13.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.412+0000 7eff5cff9700 1 -- 172.21.15.43:0/441568876 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff50010960 con 0x7eff60078ce0 2023-12-08T20:21:13.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.412+0000 7eff5cff9700 1 -- 172.21.15.43:0/441568876 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7eff50024430 con 0x7eff60078ce0 2023-12-08T20:21:13.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.412+0000 7eff6666a700 1 -- 172.21.15.43:0/441568876 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff60113a70 con 0x7eff60078ce0 2023-12-08T20:21:13.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.412+0000 7eff5cff9700 1 -- 172.21.15.43:0/441568876 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff5001a5f0 con 0x7eff60078ce0 2023-12-08T20:21:13.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.412+0000 7eff6666a700 1 -- 172.21.15.43:0/441568876 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff60113e80 con 0x7eff60078ce0 2023-12-08T20:21:13.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.413+0000 7eff6666a700 1 -- 172.21.15.43:0/441568876 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6004bb80 con 0x7eff60078ce0 2023-12-08T20:21:13.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.413+0000 7eff5cff9700 1 -- 172.21.15.43:0/441568876 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7eff5001a860 con 0x7eff60078ce0 2023-12-08T20:21:13.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.413+0000 7eff5cff9700 1 --2- 172.21.15.43:0/441568876 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7eff48036640 0x7eff48038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:13.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.413+0000 7eff5cff9700 1 -- 172.21.15.43:0/441568876 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7eff5004a250 con 0x7eff60078ce0 2023-12-08T20:21:13.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.413+0000 7eff5f7fe700 1 --2- 172.21.15.43:0/441568876 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7eff48036640 0x7eff48038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:13.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.414+0000 7eff5f7fe700 1 --2- 172.21.15.43:0/441568876 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7eff48036640 0x7eff48038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7eff54009990 tx=0x7eff54006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:13.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.419+0000 7eff5cff9700 1 -- 172.21.15.43:0/441568876 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7eff50018db0 con 0x7eff60078ce0 2023-12-08T20:21:13.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.635+0000 7eff6666a700 1 -- 172.21.15.43:0/441568876 --> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7eff6010d1d0 con 0x7eff48036640 2023-12-08T20:21:13.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.640+0000 7eff5cff9700 1 -- 172.21.15.43:0/441568876 <== mgr.14120 v2:172.21.15.43:6800/1561199606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7eff6010d1d0 con 0x7eff48036640 2023-12-08T20:21:13.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.642+0000 7eff6666a700 1 -- 172.21.15.43:0/441568876 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7eff48036640 msgr2=0x7eff48038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:13.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.642+0000 7eff6666a700 1 --2- 172.21.15.43:0/441568876 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7eff48036640 0x7eff48038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7eff54009990 tx=0x7eff54006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:13.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.642+0000 7eff6666a700 1 -- 172.21.15.43:0/441568876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff60078ce0 msgr2=0x7eff60113330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:13.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.642+0000 7eff6666a700 1 --2- 172.21.15.43:0/441568876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff60078ce0 0x7eff60113330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7eff5000ba70 tx=0x7eff50009250 comp rx=0 tx=0).stop 2023-12-08T20:21:13.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.642+0000 7eff6666a700 1 -- 172.21.15.43:0/441568876 shutdown_connections 2023-12-08T20:21:13.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.642+0000 7eff6666a700 1 --2- 172.21.15.43:0/441568876 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7eff48036640 0x7eff48038af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:13.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.642+0000 7eff6666a700 1 --2- 172.21.15.43:0/441568876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff60078ce0 0x7eff60113330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:13.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.642+0000 7eff6666a700 1 -- 172.21.15.43:0/441568876 >> 172.21.15.43:0/441568876 conn(0x7eff600fda10 msgr2=0x7eff600ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:13.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.642+0000 7eff6666a700 1 -- 172.21.15.43:0/441568876 shutdown_connections 2023-12-08T20:21:13.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:12.642+0000 7eff6666a700 1 -- 172.21.15.43:0/441568876 wait complete. 2023-12-08T20:21:13.080 INFO:teuthology.orchestra.run.smithi043.stdout:Deploying prometheus service with default placement... 2023-12-08T20:21:14.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:13 smithi043 ceph-mon[111966]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:21:14.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:13 smithi043 ceph-mon[111966]: Saving service crash spec with placement * 2023-12-08T20:21:14.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:13 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:14.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:13 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:14.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:13 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:14.083 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2023-12-08T20:21:14.083 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.480+0000 7f20ce181700 1 Processor -- start 2023-12-08T20:21:14.084 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.480+0000 7f20ce181700 1 -- start start 2023-12-08T20:21:14.084 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.480+0000 7f20ce181700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20c8076c20 0x7f20c8104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:14.084 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.480+0000 7f20ce181700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c8105420 con 0x7f20c8076c20 2023-12-08T20:21:14.084 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.480+0000 7f20c77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20c8076c20 0x7f20c8104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:14.084 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.480+0000 7f20c77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20c8076c20 0x7f20c8104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39580/0 (socket says 172.21.15.43:39580) 2023-12-08T20:21:14.084 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.480+0000 7f20c77fe700 1 -- 172.21.15.43:0/1058350642 learned_addr learned my addr 172.21.15.43:0/1058350642 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:14.084 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.481+0000 7f20c77fe700 1 -- 172.21.15.43:0/1058350642 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c8105560 con 0x7f20c8076c20 2023-12-08T20:21:14.084 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.481+0000 7f20c77fe700 1 --2- 172.21.15.43:0/1058350642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20c8076c20 0x7f20c8104ee0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f20b80098e0 tx=0x7f20b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34060fc723d41d2f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:14.084 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.481+0000 7f20c67fc700 1 -- 172.21.15.43:0/1058350642 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20b800b860 con 0x7f20c8076c20 2023-12-08T20:21:14.084 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.481+0000 7f20c67fc700 1 -- 172.21.15.43:0/1058350642 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f20b800be70 con 0x7f20c8076c20 2023-12-08T20:21:14.084 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.481+0000 7f20c67fc700 1 -- 172.21.15.43:0/1058350642 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20b8010380 con 0x7f20c8076c20 2023-12-08T20:21:14.084 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.482+0000 7f20ce181700 1 -- 172.21.15.43:0/1058350642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20c8076c20 msgr2=0x7f20c8104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:14.088 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.482+0000 7f20ce181700 1 --2- 172.21.15.43:0/1058350642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20c8076c20 0x7f20c8104ee0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f20b80098e0 tx=0x7f20b8009250 comp rx=0 tx=0).stop 2023-12-08T20:21:14.089 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.482+0000 7f20ce181700 1 -- 172.21.15.43:0/1058350642 shutdown_connections 2023-12-08T20:21:14.089 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.482+0000 7f20ce181700 1 --2- 172.21.15.43:0/1058350642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20c8076c20 0x7f20c8104ee0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:14.089 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.482+0000 7f20ce181700 1 -- 172.21.15.43:0/1058350642 >> 172.21.15.43:0/1058350642 conn(0x7f20c80fc950 msgr2=0x7f20c80fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:14.089 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.482+0000 7f20ce181700 1 -- 172.21.15.43:0/1058350642 shutdown_connections 2023-12-08T20:21:14.089 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.482+0000 7f20ce181700 1 -- 172.21.15.43:0/1058350642 wait complete. 2023-12-08T20:21:14.089 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.483+0000 7f20ce181700 1 Processor -- start 2023-12-08T20:21:14.089 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.483+0000 7f20ce181700 1 -- start start 2023-12-08T20:21:14.089 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.483+0000 7f20ce181700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20c8076c20 0x7f20c8102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:14.089 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.483+0000 7f20ce181700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c8100de0 con 0x7f20c8076c20 2023-12-08T20:21:14.089 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.483+0000 7f20c77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20c8076c20 0x7f20c8102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:14.089 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.483+0000 7f20c77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20c8076c20 0x7f20c8102960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39592/0 (socket says 172.21.15.43:39592) 2023-12-08T20:21:14.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.483+0000 7f20c77fe700 1 -- 172.21.15.43:0/4202261675 learned_addr learned my addr 172.21.15.43:0/4202261675 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:14.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.484+0000 7f20c77fe700 1 -- 172.21.15.43:0/4202261675 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b80094f0 con 0x7f20c8076c20 2023-12-08T20:21:14.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.484+0000 7f20c77fe700 1 --2- 172.21.15.43:0/4202261675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20c8076c20 0x7f20c8102960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f20b8006d40 tx=0x7f20b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:14.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.484+0000 7f20affff700 1 -- 172.21.15.43:0/4202261675 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20b8010960 con 0x7f20c8076c20 2023-12-08T20:21:14.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.484+0000 7f20affff700 1 -- 172.21.15.43:0/4202261675 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f20b801a430 con 0x7f20c8076c20 2023-12-08T20:21:14.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.484+0000 7f20ce181700 1 -- 172.21.15.43:0/4202261675 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c8100fe0 con 0x7f20c8076c20 2023-12-08T20:21:14.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.484+0000 7f20affff700 1 -- 172.21.15.43:0/4202261675 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20b80245b0 con 0x7f20c8076c20 2023-12-08T20:21:14.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.484+0000 7f20ce181700 1 -- 172.21.15.43:0/4202261675 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c81013f0 con 0x7f20c8076c20 2023-12-08T20:21:14.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.485+0000 7f20ce181700 1 -- 172.21.15.43:0/4202261675 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c804bb80 con 0x7f20c8076c20 2023-12-08T20:21:14.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.486+0000 7f20affff700 1 -- 172.21.15.43:0/4202261675 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f20b801a9f0 con 0x7f20c8076c20 2023-12-08T20:21:14.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.486+0000 7f20affff700 1 --2- 172.21.15.43:0/4202261675 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f20b00365f0 0x7f20b0038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:14.090 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.486+0000 7f20affff700 1 -- 172.21.15.43:0/4202261675 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f20b804a450 con 0x7f20c8076c20 2023-12-08T20:21:14.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.486+0000 7f20c6ffd700 1 --2- 172.21.15.43:0/4202261675 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f20b00365f0 0x7f20b0038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:14.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.487+0000 7f20c6ffd700 1 --2- 172.21.15.43:0/4202261675 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f20b00365f0 0x7f20b0038aa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009990 tx=0x7f20bc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:14.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.491+0000 7f20affff700 1 -- 172.21.15.43:0/4202261675 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f20b8018d90 con 0x7f20c8076c20 2023-12-08T20:21:14.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.707+0000 7f20ce181700 1 -- 172.21.15.43:0/4202261675 --> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f20c810adf0 con 0x7f20b00365f0 2023-12-08T20:21:14.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.711+0000 7f20affff700 1 -- 172.21.15.43:0/4202261675 <== mgr.14120 v2:172.21.15.43:6800/1561199606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f20c810adf0 con 0x7f20b00365f0 2023-12-08T20:21:14.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.714+0000 7f20ce181700 1 -- 172.21.15.43:0/4202261675 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f20b00365f0 msgr2=0x7f20b0038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:14.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.714+0000 7f20ce181700 1 --2- 172.21.15.43:0/4202261675 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f20b00365f0 0x7f20b0038aa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009990 tx=0x7f20bc006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:14.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.714+0000 7f20ce181700 1 -- 172.21.15.43:0/4202261675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20c8076c20 msgr2=0x7f20c8102960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:14.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.714+0000 7f20ce181700 1 --2- 172.21.15.43:0/4202261675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20c8076c20 0x7f20c8102960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f20b8006d40 tx=0x7f20b8009250 comp rx=0 tx=0).stop 2023-12-08T20:21:14.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.714+0000 7f20ce181700 1 -- 172.21.15.43:0/4202261675 shutdown_connections 2023-12-08T20:21:14.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.714+0000 7f20ce181700 1 --2- 172.21.15.43:0/4202261675 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f20b00365f0 0x7f20b0038aa0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:14.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.714+0000 7f20ce181700 1 --2- 172.21.15.43:0/4202261675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20c8076c20 0x7f20c8102960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:14.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.714+0000 7f20ce181700 1 -- 172.21.15.43:0/4202261675 >> 172.21.15.43:0/4202261675 conn(0x7f20c80fc950 msgr2=0x7f20c80fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:14.091 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.714+0000 7f20ce181700 1 -- 172.21.15.43:0/4202261675 shutdown_connections 2023-12-08T20:21:14.092 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:13.714+0000 7f20ce181700 1 -- 172.21.15.43:0/4202261675 wait complete. 2023-12-08T20:21:14.092 INFO:teuthology.orchestra.run.smithi043.stdout:Deploying grafana service with default placement... 2023-12-08T20:21:15.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:14 smithi043 ceph-mon[111966]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:21:15.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:14 smithi043 ceph-mon[111966]: Saving service prometheus spec with placement count:1 2023-12-08T20:21:15.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:14 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:15.343 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2023-12-08T20:21:15.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.456+0000 7f9fa24a9700 1 Processor -- start 2023-12-08T20:21:15.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.456+0000 7f9fa24a9700 1 -- start start 2023-12-08T20:21:15.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.457+0000 7f9fa24a9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c070fa0 0x7f9f9c104f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:15.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.457+0000 7f9fa24a9700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c105440 con 0x7f9f9c070fa0 2023-12-08T20:21:15.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.457+0000 7f9f9bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c070fa0 0x7f9f9c104f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:15.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.457+0000 7f9f9bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c070fa0 0x7f9f9c104f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39600/0 (socket says 172.21.15.43:39600) 2023-12-08T20:21:15.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.457+0000 7f9f9bfff700 1 -- 172.21.15.43:0/4085367033 learned_addr learned my addr 172.21.15.43:0/4085367033 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:15.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.457+0000 7f9f9bfff700 1 -- 172.21.15.43:0/4085367033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c105580 con 0x7f9f9c070fa0 2023-12-08T20:21:15.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.457+0000 7f9f9bfff700 1 --2- 172.21.15.43:0/4085367033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c070fa0 0x7f9f9c104f00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0098e0 tx=0x7f9f8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdc680736f40207 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:15.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.457+0000 7f9f9affd700 1 -- 172.21.15.43:0/4085367033 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f8c00b860 con 0x7f9f9c070fa0 2023-12-08T20:21:15.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.458+0000 7f9f9affd700 1 -- 172.21.15.43:0/4085367033 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9f8c00be70 con 0x7f9f9c070fa0 2023-12-08T20:21:15.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.458+0000 7f9f9affd700 1 -- 172.21.15.43:0/4085367033 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f8c010380 con 0x7f9f9c070fa0 2023-12-08T20:21:15.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.458+0000 7f9fa24a9700 1 -- 172.21.15.43:0/4085367033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c070fa0 msgr2=0x7f9f9c104f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:15.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.458+0000 7f9fa24a9700 1 --2- 172.21.15.43:0/4085367033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c070fa0 0x7f9f9c104f00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0098e0 tx=0x7f9f8c009250 comp rx=0 tx=0).stop 2023-12-08T20:21:15.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.458+0000 7f9fa24a9700 1 -- 172.21.15.43:0/4085367033 shutdown_connections 2023-12-08T20:21:15.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.458+0000 7f9fa24a9700 1 --2- 172.21.15.43:0/4085367033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c070fa0 0x7f9f9c104f00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:15.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.458+0000 7f9fa24a9700 1 -- 172.21.15.43:0/4085367033 >> 172.21.15.43:0/4085367033 conn(0x7f9f9c0fc970 msgr2=0x7f9f9c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:15.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.458+0000 7f9fa24a9700 1 -- 172.21.15.43:0/4085367033 shutdown_connections 2023-12-08T20:21:15.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.458+0000 7f9fa24a9700 1 -- 172.21.15.43:0/4085367033 wait complete. 2023-12-08T20:21:15.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.459+0000 7f9fa24a9700 1 Processor -- start 2023-12-08T20:21:15.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.459+0000 7f9fa24a9700 1 -- start start 2023-12-08T20:21:15.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.460+0000 7f9fa24a9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c070fa0 0x7f9f9c1111e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:15.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.460+0000 7f9fa24a9700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c111720 con 0x7f9f9c070fa0 2023-12-08T20:21:15.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.460+0000 7f9f9bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c070fa0 0x7f9f9c1111e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:15.346 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.460+0000 7f9f9bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c070fa0 0x7f9f9c1111e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39610/0 (socket says 172.21.15.43:39610) 2023-12-08T20:21:15.346 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.460+0000 7f9f9bfff700 1 -- 172.21.15.43:0/4221297207 learned_addr learned my addr 172.21.15.43:0/4221297207 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:15.346 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.460+0000 7f9f9bfff700 1 -- 172.21.15.43:0/4221297207 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c0094f0 con 0x7f9f9c070fa0 2023-12-08T20:21:15.346 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.460+0000 7f9f9bfff700 1 --2- 172.21.15.43:0/4221297207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c070fa0 0x7f9f9c1111e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0094c0 tx=0x7f9f8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:15.346 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.460+0000 7f9f98ff9700 1 -- 172.21.15.43:0/4221297207 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f8c010850 con 0x7f9f9c070fa0 2023-12-08T20:21:15.346 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.460+0000 7f9f98ff9700 1 -- 172.21.15.43:0/4221297207 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9f8c010e60 con 0x7f9f9c070fa0 2023-12-08T20:21:15.346 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.460+0000 7f9fa24a9700 1 -- 172.21.15.43:0/4221297207 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9c111920 con 0x7f9f9c070fa0 2023-12-08T20:21:15.346 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.460+0000 7f9f98ff9700 1 -- 172.21.15.43:0/4221297207 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f8c01a430 con 0x7f9f9c070fa0 2023-12-08T20:21:15.346 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.460+0000 7f9fa24a9700 1 -- 172.21.15.43:0/4221297207 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c111d30 con 0x7f9f9c070fa0 2023-12-08T20:21:15.346 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.461+0000 7f9f98ff9700 1 -- 172.21.15.43:0/4221297207 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f9f8c0109b0 con 0x7f9f9c070fa0 2023-12-08T20:21:15.346 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.461+0000 7f9fa24a9700 1 -- 172.21.15.43:0/4221297207 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9c04bb80 con 0x7f9f9c070fa0 2023-12-08T20:21:15.346 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.462+0000 7f9f98ff9700 1 --2- 172.21.15.43:0/4221297207 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9f840365f0 0x7f9f84038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:15.347 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.462+0000 7f9f98ff9700 1 -- 172.21.15.43:0/4221297207 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9f8c04a570 con 0x7f9f9c070fa0 2023-12-08T20:21:15.347 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.462+0000 7f9f9b7fe700 1 --2- 172.21.15.43:0/4221297207 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9f840365f0 0x7f9f84038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:15.347 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.462+0000 7f9f9b7fe700 1 --2- 172.21.15.43:0/4221297207 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9f840365f0 0x7f9f84038aa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009990 tx=0x7f9f90006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:15.347 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.466+0000 7f9f98ff9700 1 -- 172.21.15.43:0/4221297207 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9f8c0239f0 con 0x7f9f9c070fa0 2023-12-08T20:21:15.347 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.706+0000 7f9fa24a9700 1 -- 172.21.15.43:0/4221297207 --> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f9c10aff0 con 0x7f9f840365f0 2023-12-08T20:21:15.347 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.711+0000 7f9f98ff9700 1 -- 172.21.15.43:0/4221297207 <== mgr.14120 v2:172.21.15.43:6800/1561199606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f9f9c10aff0 con 0x7f9f840365f0 2023-12-08T20:21:15.347 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.713+0000 7f9fa24a9700 1 -- 172.21.15.43:0/4221297207 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9f840365f0 msgr2=0x7f9f84038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:15.347 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.713+0000 7f9fa24a9700 1 --2- 172.21.15.43:0/4221297207 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9f840365f0 0x7f9f84038aa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009990 tx=0x7f9f90006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:15.347 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.713+0000 7f9fa24a9700 1 -- 172.21.15.43:0/4221297207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c070fa0 msgr2=0x7f9f9c1111e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:15.347 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.713+0000 7f9fa24a9700 1 --2- 172.21.15.43:0/4221297207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c070fa0 0x7f9f9c1111e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0094c0 tx=0x7f9f8c009250 comp rx=0 tx=0).stop 2023-12-08T20:21:15.347 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.713+0000 7f9fa24a9700 1 -- 172.21.15.43:0/4221297207 shutdown_connections 2023-12-08T20:21:15.347 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.713+0000 7f9fa24a9700 1 --2- 172.21.15.43:0/4221297207 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9f840365f0 0x7f9f84038aa0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:15.348 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.713+0000 7f9fa24a9700 1 --2- 172.21.15.43:0/4221297207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f9c070fa0 0x7f9f9c1111e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:15.348 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.713+0000 7f9fa24a9700 1 -- 172.21.15.43:0/4221297207 >> 172.21.15.43:0/4221297207 conn(0x7f9f9c0fc970 msgr2=0x7f9f9c0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:15.348 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.713+0000 7f9fa24a9700 1 -- 172.21.15.43:0/4221297207 shutdown_connections 2023-12-08T20:21:15.348 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:14.713+0000 7f9fa24a9700 1 -- 172.21.15.43:0/4221297207 wait complete. 2023-12-08T20:21:15.348 INFO:teuthology.orchestra.run.smithi043.stdout:Deploying node-exporter service with default placement... 2023-12-08T20:21:16.231 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:15 smithi043 ceph-mon[111966]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:21:16.231 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:15 smithi043 ceph-mon[111966]: Saving service grafana spec with placement count:1 2023-12-08T20:21:16.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2023-12-08T20:21:16.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.733+0000 7f7be7d9b700 1 Processor -- start 2023-12-08T20:21:16.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.734+0000 7f7be7d9b700 1 -- start start 2023-12-08T20:21:16.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.734+0000 7f7be7d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be01011c0 0x7f7be01015d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:16.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.734+0000 7f7be7d9b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be0101b10 con 0x7f7be01011c0 2023-12-08T20:21:16.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.734+0000 7f7be5b37700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be01011c0 0x7f7be01015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:16.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.734+0000 7f7be5b37700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be01011c0 0x7f7be01015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39612/0 (socket says 172.21.15.43:39612) 2023-12-08T20:21:16.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.734+0000 7f7be5b37700 1 -- 172.21.15.43:0/306625685 learned_addr learned my addr 172.21.15.43:0/306625685 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:16.335 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.734+0000 7f7be5b37700 1 -- 172.21.15.43:0/306625685 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be0101c50 con 0x7f7be01011c0 2023-12-08T20:21:16.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.735+0000 7f7be5b37700 1 --2- 172.21.15.43:0/306625685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be01011c0 0x7f7be01015d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0098e0 tx=0x7f7bdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15f51598c321a18 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:16.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.735+0000 7f7be4b35700 1 -- 172.21.15.43:0/306625685 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bdc00b860 con 0x7f7be01011c0 2023-12-08T20:21:16.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.735+0000 7f7be4b35700 1 -- 172.21.15.43:0/306625685 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7bdc00be70 con 0x7f7be01011c0 2023-12-08T20:21:16.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.735+0000 7f7be4b35700 1 -- 172.21.15.43:0/306625685 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bdc010380 con 0x7f7be01011c0 2023-12-08T20:21:16.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.735+0000 7f7be7d9b700 1 -- 172.21.15.43:0/306625685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be01011c0 msgr2=0x7f7be01015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:16.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.735+0000 7f7be7d9b700 1 --2- 172.21.15.43:0/306625685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be01011c0 0x7f7be01015d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0098e0 tx=0x7f7bdc009250 comp rx=0 tx=0).stop 2023-12-08T20:21:16.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.735+0000 7f7be7d9b700 1 -- 172.21.15.43:0/306625685 shutdown_connections 2023-12-08T20:21:16.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.735+0000 7f7be7d9b700 1 --2- 172.21.15.43:0/306625685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be01011c0 0x7f7be01015d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:16.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.735+0000 7f7be7d9b700 1 -- 172.21.15.43:0/306625685 >> 172.21.15.43:0/306625685 conn(0x7f7be00fc980 msgr2=0x7f7be00fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:16.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.736+0000 7f7be7d9b700 1 -- 172.21.15.43:0/306625685 shutdown_connections 2023-12-08T20:21:16.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.736+0000 7f7be7d9b700 1 -- 172.21.15.43:0/306625685 wait complete. 2023-12-08T20:21:16.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.736+0000 7f7be7d9b700 1 Processor -- start 2023-12-08T20:21:16.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.736+0000 7f7be7d9b700 1 -- start start 2023-12-08T20:21:16.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.736+0000 7f7be7d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be01011c0 0x7f7be01111a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:16.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.736+0000 7f7be7d9b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be01116e0 con 0x7f7be01011c0 2023-12-08T20:21:16.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.736+0000 7f7be5b37700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be01011c0 0x7f7be01111a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:16.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.736+0000 7f7be5b37700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be01011c0 0x7f7be01111a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39620/0 (socket says 172.21.15.43:39620) 2023-12-08T20:21:16.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.736+0000 7f7be5b37700 1 -- 172.21.15.43:0/1995491754 learned_addr learned my addr 172.21.15.43:0/1995491754 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:16.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.737+0000 7f7be5b37700 1 -- 172.21.15.43:0/1995491754 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc0094f0 con 0x7f7be01011c0 2023-12-08T20:21:16.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.737+0000 7f7be5b37700 1 --2- 172.21.15.43:0/1995491754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be01011c0 0x7f7be01111a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00c010 tx=0x7f7bdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:16.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.737+0000 7f7bd67fc700 1 -- 172.21.15.43:0/1995491754 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bdc010960 con 0x7f7be01011c0 2023-12-08T20:21:16.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.737+0000 7f7bd67fc700 1 -- 172.21.15.43:0/1995491754 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7bdc01a430 con 0x7f7be01011c0 2023-12-08T20:21:16.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.737+0000 7f7be7d9b700 1 -- 172.21.15.43:0/1995491754 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be01118e0 con 0x7f7be01011c0 2023-12-08T20:21:16.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.737+0000 7f7bd67fc700 1 -- 172.21.15.43:0/1995491754 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bdc019580 con 0x7f7be01011c0 2023-12-08T20:21:16.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.737+0000 7f7be7d9b700 1 -- 172.21.15.43:0/1995491754 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be0111cf0 con 0x7f7be01011c0 2023-12-08T20:21:16.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.738+0000 7f7bd67fc700 1 -- 172.21.15.43:0/1995491754 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f7bdc019800 con 0x7f7be01011c0 2023-12-08T20:21:16.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.738+0000 7f7be7d9b700 1 -- 172.21.15.43:0/1995491754 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be004bb80 con 0x7f7be01011c0 2023-12-08T20:21:16.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.738+0000 7f7bd67fc700 1 --2- 172.21.15.43:0/1995491754 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7bcc0365f0 0x7f7bcc038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:16.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.738+0000 7f7bd67fc700 1 -- 172.21.15.43:0/1995491754 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f7bdc04a4f0 con 0x7f7be01011c0 2023-12-08T20:21:16.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.739+0000 7f7be5336700 1 --2- 172.21.15.43:0/1995491754 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7bcc0365f0 0x7f7bcc038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:16.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.739+0000 7f7be5336700 1 --2- 172.21.15.43:0/1995491754 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7bcc0365f0 0x7f7bcc038aa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0009990 tx=0x7f7bd0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:16.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.744+0000 7f7bd67fc700 1 -- 172.21.15.43:0/1995491754 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7bdc02b4e0 con 0x7f7be01011c0 2023-12-08T20:21:16.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.957+0000 7f7be7d9b700 1 -- 172.21.15.43:0/1995491754 --> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f7be00fec10 con 0x7f7bcc0365f0 2023-12-08T20:21:16.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.961+0000 7f7bd67fc700 1 -- 172.21.15.43:0/1995491754 <== mgr.14120 v2:172.21.15.43:6800/1561199606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f7be00fec10 con 0x7f7bcc0365f0 2023-12-08T20:21:16.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.963+0000 7f7be7d9b700 1 -- 172.21.15.43:0/1995491754 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7bcc0365f0 msgr2=0x7f7bcc038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:16.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.963+0000 7f7be7d9b700 1 --2- 172.21.15.43:0/1995491754 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7bcc0365f0 0x7f7bcc038aa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0009990 tx=0x7f7bd0006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:16.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.963+0000 7f7be7d9b700 1 -- 172.21.15.43:0/1995491754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be01011c0 msgr2=0x7f7be01111a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:16.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.963+0000 7f7be7d9b700 1 --2- 172.21.15.43:0/1995491754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be01011c0 0x7f7be01111a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00c010 tx=0x7f7bdc009250 comp rx=0 tx=0).stop 2023-12-08T20:21:16.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.963+0000 7f7be7d9b700 1 -- 172.21.15.43:0/1995491754 shutdown_connections 2023-12-08T20:21:16.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.963+0000 7f7be7d9b700 1 --2- 172.21.15.43:0/1995491754 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7bcc0365f0 0x7f7bcc038aa0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:16.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.963+0000 7f7be7d9b700 1 --2- 172.21.15.43:0/1995491754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7be01011c0 0x7f7be01111a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:16.339 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.963+0000 7f7be7d9b700 1 -- 172.21.15.43:0/1995491754 >> 172.21.15.43:0/1995491754 conn(0x7f7be00fc980 msgr2=0x7f7be00767f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:16.339 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.963+0000 7f7be7d9b700 1 -- 172.21.15.43:0/1995491754 shutdown_connections 2023-12-08T20:21:16.339 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:15.963+0000 7f7be7d9b700 1 -- 172.21.15.43:0/1995491754 wait complete. 2023-12-08T20:21:16.339 INFO:teuthology.orchestra.run.smithi043.stdout:Deploying alertmanager service with default placement... 2023-12-08T20:21:17.239 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:16 smithi043 ceph-mon[111966]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:21:17.240 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:16 smithi043 ceph-mon[111966]: Saving service node-exporter spec with placement * 2023-12-08T20:21:17.240 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:16 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:17.240 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:16 smithi043 ceph-mon[111966]: from='mgr.14120 172.21.15.43:0/2678056026' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:17.274 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2023-12-08T20:21:17.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.688+0000 7f57aff86700 1 Processor -- start 2023-12-08T20:21:17.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.688+0000 7f57aff86700 1 -- start start 2023-12-08T20:21:17.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.689+0000 7f57aff86700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57a8071000 0x7f57a81072a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:17.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.689+0000 7f57aff86700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a8102c90 con 0x7f57a8071000 2023-12-08T20:21:17.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.689+0000 7f57add22700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57a8071000 0x7f57a81072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:17.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.689+0000 7f57add22700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57a8071000 0x7f57a81072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39636/0 (socket says 172.21.15.43:39636) 2023-12-08T20:21:17.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.689+0000 7f57add22700 1 -- 172.21.15.43:0/3167096696 learned_addr learned my addr 172.21.15.43:0/3167096696 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:17.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.689+0000 7f57add22700 1 -- 172.21.15.43:0/3167096696 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a81077e0 con 0x7f57a8071000 2023-12-08T20:21:17.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.689+0000 7f57add22700 1 --2- 172.21.15.43:0/3167096696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57a8071000 0x7f57a81072a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f57a40098e0 tx=0x7f57a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972aecd2299a92f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:17.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.690+0000 7f57acd20700 1 -- 172.21.15.43:0/3167096696 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57a400b860 con 0x7f57a8071000 2023-12-08T20:21:17.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.690+0000 7f57acd20700 1 -- 172.21.15.43:0/3167096696 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f57a400be70 con 0x7f57a8071000 2023-12-08T20:21:17.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.690+0000 7f57acd20700 1 -- 172.21.15.43:0/3167096696 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57a4010380 con 0x7f57a8071000 2023-12-08T20:21:17.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.690+0000 7f57aff86700 1 -- 172.21.15.43:0/3167096696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57a8071000 msgr2=0x7f57a81072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:17.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.690+0000 7f57aff86700 1 --2- 172.21.15.43:0/3167096696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57a8071000 0x7f57a81072a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f57a40098e0 tx=0x7f57a4009250 comp rx=0 tx=0).stop 2023-12-08T20:21:17.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.690+0000 7f57aff86700 1 -- 172.21.15.43:0/3167096696 shutdown_connections 2023-12-08T20:21:17.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.690+0000 7f57aff86700 1 --2- 172.21.15.43:0/3167096696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57a8071000 0x7f57a81072a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:17.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.690+0000 7f57aff86700 1 -- 172.21.15.43:0/3167096696 >> 172.21.15.43:0/3167096696 conn(0x7f57a80fc970 msgr2=0x7f57a80fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:17.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.690+0000 7f57aff86700 1 -- 172.21.15.43:0/3167096696 shutdown_connections 2023-12-08T20:21:17.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.690+0000 7f57aff86700 1 -- 172.21.15.43:0/3167096696 wait complete. 2023-12-08T20:21:17.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.691+0000 7f57aff86700 1 Processor -- start 2023-12-08T20:21:17.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.691+0000 7f57aff86700 1 -- start start 2023-12-08T20:21:17.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.691+0000 7f57aff86700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57a8071000 0x7f57a81133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:17.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.691+0000 7f57aff86700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a81138e0 con 0x7f57a8071000 2023-12-08T20:21:17.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.691+0000 7f57add22700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57a8071000 0x7f57a81133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:17.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.691+0000 7f57add22700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57a8071000 0x7f57a81133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39638/0 (socket says 172.21.15.43:39638) 2023-12-08T20:21:17.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.691+0000 7f57add22700 1 -- 172.21.15.43:0/3751282464 learned_addr learned my addr 172.21.15.43:0/3751282464 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:17.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.692+0000 7f57add22700 1 -- 172.21.15.43:0/3751282464 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a40094f0 con 0x7f57a8071000 2023-12-08T20:21:17.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.692+0000 7f57add22700 1 --2- 172.21.15.43:0/3751282464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57a8071000 0x7f57a81133a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f57a4006d40 tx=0x7f57a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:17.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.692+0000 7f579e7fc700 1 -- 172.21.15.43:0/3751282464 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57a4010960 con 0x7f57a8071000 2023-12-08T20:21:17.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.692+0000 7f57aff86700 1 -- 172.21.15.43:0/3751282464 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a8113ae0 con 0x7f57a8071000 2023-12-08T20:21:17.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.692+0000 7f579e7fc700 1 -- 172.21.15.43:0/3751282464 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f57a401a430 con 0x7f57a8071000 2023-12-08T20:21:17.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.692+0000 7f579e7fc700 1 -- 172.21.15.43:0/3751282464 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57a40245b0 con 0x7f57a8071000 2023-12-08T20:21:17.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.692+0000 7f57aff86700 1 -- 172.21.15.43:0/3751282464 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a8113ef0 con 0x7f57a8071000 2023-12-08T20:21:17.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.693+0000 7f579e7fc700 1 -- 172.21.15.43:0/3751282464 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f57a401a9f0 con 0x7f57a8071000 2023-12-08T20:21:17.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.693+0000 7f57aff86700 1 -- 172.21.15.43:0/3751282464 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a804bb80 con 0x7f57a8071000 2023-12-08T20:21:17.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.693+0000 7f579e7fc700 1 --2- 172.21.15.43:0/3751282464 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f57940365f0 0x7f5794038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:17.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.693+0000 7f579e7fc700 1 -- 172.21.15.43:0/3751282464 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f57a404a160 con 0x7f57a8071000 2023-12-08T20:21:17.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.693+0000 7f57ad521700 1 --2- 172.21.15.43:0/3751282464 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f57940365f0 0x7f5794038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:17.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.694+0000 7f57ad521700 1 --2- 172.21.15.43:0/3751282464 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f57940365f0 0x7f5794038aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5798009990 tx=0x7f5798006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:17.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.698+0000 7f579e7fc700 1 -- 172.21.15.43:0/3751282464 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f57a402b8e0 con 0x7f57a8071000 2023-12-08T20:21:17.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.909+0000 7f57aff86700 1 -- 172.21.15.43:0/3751282464 --> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f57a810d1f0 con 0x7f57940365f0 2023-12-08T20:21:17.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.913+0000 7f579e7fc700 1 -- 172.21.15.43:0/3751282464 <== mgr.14120 v2:172.21.15.43:6800/1561199606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f57a810d1f0 con 0x7f57940365f0 2023-12-08T20:21:17.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.916+0000 7f57aff86700 1 -- 172.21.15.43:0/3751282464 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f57940365f0 msgr2=0x7f5794038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:17.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.916+0000 7f57aff86700 1 --2- 172.21.15.43:0/3751282464 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f57940365f0 0x7f5794038aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5798009990 tx=0x7f5798006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:17.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.916+0000 7f57aff86700 1 -- 172.21.15.43:0/3751282464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57a8071000 msgr2=0x7f57a81133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:17.278 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.916+0000 7f57aff86700 1 --2- 172.21.15.43:0/3751282464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57a8071000 0x7f57a81133a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f57a4006d40 tx=0x7f57a4009250 comp rx=0 tx=0).stop 2023-12-08T20:21:17.278 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.916+0000 7f57aff86700 1 -- 172.21.15.43:0/3751282464 shutdown_connections 2023-12-08T20:21:17.278 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.916+0000 7f57aff86700 1 --2- 172.21.15.43:0/3751282464 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f57940365f0 0x7f5794038aa0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:17.278 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.916+0000 7f57aff86700 1 --2- 172.21.15.43:0/3751282464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57a8071000 0x7f57a81133a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:17.278 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.916+0000 7f57aff86700 1 -- 172.21.15.43:0/3751282464 >> 172.21.15.43:0/3751282464 conn(0x7f57a80fc970 msgr2=0x7f57a80fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:17.278 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.916+0000 7f57aff86700 1 -- 172.21.15.43:0/3751282464 shutdown_connections 2023-12-08T20:21:17.278 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:16.916+0000 7f57aff86700 1 -- 172.21.15.43:0/3751282464 wait complete. 2023-12-08T20:21:18.239 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:17 smithi043 ceph-mon[111966]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:21:18.239 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:17 smithi043 ceph-mon[111966]: Saving service alertmanager spec with placement count:1 2023-12-08T20:21:18.240 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:17 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/1527770402' entity='client.admin' 2023-12-08T20:21:18.274 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.696+0000 7fa4f1117700 1 Processor -- start 2023-12-08T20:21:18.274 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.696+0000 7fa4f1117700 1 -- start start 2023-12-08T20:21:18.274 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.696+0000 7fa4f1117700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4ec071000 0x7fa4ec104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:18.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.696+0000 7fa4f1117700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec1053e0 con 0x7fa4ec071000 2023-12-08T20:21:18.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.697+0000 7fa4ead9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4ec071000 0x7fa4ec104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:18.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.697+0000 7fa4ead9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4ec071000 0x7fa4ec104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39648/0 (socket says 172.21.15.43:39648) 2023-12-08T20:21:18.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.697+0000 7fa4ead9d700 1 -- 172.21.15.43:0/1377765967 learned_addr learned my addr 172.21.15.43:0/1377765967 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:18.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.697+0000 7fa4ead9d700 1 -- 172.21.15.43:0/1377765967 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec105520 con 0x7fa4ec071000 2023-12-08T20:21:18.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.697+0000 7fa4ead9d700 1 --2- 172.21.15.43:0/1377765967 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4ec071000 0x7fa4ec104ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00098e0 tx=0x7fa4e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9bccc598d284e34 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:18.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.697+0000 7fa4e9d9b700 1 -- 172.21.15.43:0/1377765967 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4e000b860 con 0x7fa4ec071000 2023-12-08T20:21:18.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.697+0000 7fa4e9d9b700 1 -- 172.21.15.43:0/1377765967 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa4e000be70 con 0x7fa4ec071000 2023-12-08T20:21:18.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.697+0000 7fa4e9d9b700 1 -- 172.21.15.43:0/1377765967 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4e0010380 con 0x7fa4ec071000 2023-12-08T20:21:18.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.698+0000 7fa4f1117700 1 -- 172.21.15.43:0/1377765967 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4ec071000 msgr2=0x7fa4ec104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:18.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.698+0000 7fa4f1117700 1 --2- 172.21.15.43:0/1377765967 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4ec071000 0x7fa4ec104ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00098e0 tx=0x7fa4e0009250 comp rx=0 tx=0).stop 2023-12-08T20:21:18.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.698+0000 7fa4f1117700 1 -- 172.21.15.43:0/1377765967 shutdown_connections 2023-12-08T20:21:18.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.698+0000 7fa4f1117700 1 --2- 172.21.15.43:0/1377765967 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4ec071000 0x7fa4ec104ea0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:18.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.698+0000 7fa4f1117700 1 -- 172.21.15.43:0/1377765967 >> 172.21.15.43:0/1377765967 conn(0x7fa4ec0fc970 msgr2=0x7fa4ec0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:18.275 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.698+0000 7fa4f1117700 1 -- 172.21.15.43:0/1377765967 shutdown_connections 2023-12-08T20:21:18.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.698+0000 7fa4f1117700 1 -- 172.21.15.43:0/1377765967 wait complete. 2023-12-08T20:21:18.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.699+0000 7fa4f1117700 1 Processor -- start 2023-12-08T20:21:18.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.699+0000 7fa4f1117700 1 -- start start 2023-12-08T20:21:18.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.699+0000 7fa4f1117700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4ec071000 0x7fa4ec1111c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:18.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.699+0000 7fa4f1117700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec111700 con 0x7fa4ec071000 2023-12-08T20:21:18.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.699+0000 7fa4ead9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4ec071000 0x7fa4ec1111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:18.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.699+0000 7fa4ead9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4ec071000 0x7fa4ec1111c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39658/0 (socket says 172.21.15.43:39658) 2023-12-08T20:21:18.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.699+0000 7fa4ead9d700 1 -- 172.21.15.43:0/1527770402 learned_addr learned my addr 172.21.15.43:0/1527770402 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:18.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.699+0000 7fa4ead9d700 1 -- 172.21.15.43:0/1527770402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e00094f0 con 0x7fa4ec071000 2023-12-08T20:21:18.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.700+0000 7fa4ead9d700 1 --2- 172.21.15.43:0/1527770402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4ec071000 0x7fa4ec1111c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0006d40 tx=0x7fa4e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:18.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.700+0000 7fa4d37fe700 1 -- 172.21.15.43:0/1527770402 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4e0010960 con 0x7fa4ec071000 2023-12-08T20:21:18.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.700+0000 7fa4d37fe700 1 -- 172.21.15.43:0/1527770402 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa4e001a430 con 0x7fa4ec071000 2023-12-08T20:21:18.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.700+0000 7fa4f1117700 1 -- 172.21.15.43:0/1527770402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ec111900 con 0x7fa4ec071000 2023-12-08T20:21:18.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.700+0000 7fa4d37fe700 1 -- 172.21.15.43:0/1527770402 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4e00245b0 con 0x7fa4ec071000 2023-12-08T20:21:18.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.700+0000 7fa4f1117700 1 -- 172.21.15.43:0/1527770402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ec111d10 con 0x7fa4ec071000 2023-12-08T20:21:18.276 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.701+0000 7fa4f1117700 1 -- 172.21.15.43:0/1527770402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ec04bb80 con 0x7fa4ec071000 2023-12-08T20:21:18.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.701+0000 7fa4d37fe700 1 -- 172.21.15.43:0/1527770402 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fa4e001a9f0 con 0x7fa4ec071000 2023-12-08T20:21:18.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.701+0000 7fa4d37fe700 1 --2- 172.21.15.43:0/1527770402 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fa4d4036640 0x7fa4d4038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:18.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.701+0000 7fa4d37fe700 1 -- 172.21.15.43:0/1527770402 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa4e004a090 con 0x7fa4ec071000 2023-12-08T20:21:18.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.702+0000 7fa4ea59c700 1 --2- 172.21.15.43:0/1527770402 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fa4d4036640 0x7fa4d4038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:18.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.702+0000 7fa4ea59c700 1 --2- 172.21.15.43:0/1527770402 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fa4d4036640 0x7fa4d4038af0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009990 tx=0x7fa4dc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:18.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.706+0000 7fa4d37fe700 1 -- 172.21.15.43:0/1527770402 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa4e002b8c0 con 0x7fa4ec071000 2023-12-08T20:21:18.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.906+0000 7fa4f1117700 1 -- 172.21.15.43:0/1527770402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fa4ec106300 con 0x7fa4ec071000 2023-12-08T20:21:18.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.910+0000 7fa4d37fe700 1 -- 172.21.15.43:0/1527770402 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fa4e002b2f0 con 0x7fa4ec071000 2023-12-08T20:21:18.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.912+0000 7fa4f1117700 1 -- 172.21.15.43:0/1527770402 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fa4d4036640 msgr2=0x7fa4d4038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:18.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.912+0000 7fa4f1117700 1 --2- 172.21.15.43:0/1527770402 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fa4d4036640 0x7fa4d4038af0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009990 tx=0x7fa4dc006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:18.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.912+0000 7fa4f1117700 1 -- 172.21.15.43:0/1527770402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4ec071000 msgr2=0x7fa4ec1111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:18.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.912+0000 7fa4f1117700 1 --2- 172.21.15.43:0/1527770402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4ec071000 0x7fa4ec1111c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0006d40 tx=0x7fa4e0009250 comp rx=0 tx=0).stop 2023-12-08T20:21:18.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.912+0000 7fa4f1117700 1 -- 172.21.15.43:0/1527770402 shutdown_connections 2023-12-08T20:21:18.277 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.912+0000 7fa4f1117700 1 --2- 172.21.15.43:0/1527770402 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fa4d4036640 0x7fa4d4038af0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:18.278 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.912+0000 7fa4f1117700 1 --2- 172.21.15.43:0/1527770402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4ec071000 0x7fa4ec1111c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:18.278 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.912+0000 7fa4f1117700 1 -- 172.21.15.43:0/1527770402 >> 172.21.15.43:0/1527770402 conn(0x7fa4ec0fc970 msgr2=0x7fa4ec0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:18.278 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.912+0000 7fa4f1117700 1 -- 172.21.15.43:0/1527770402 shutdown_connections 2023-12-08T20:21:18.278 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:17.912+0000 7fa4f1117700 1 -- 172.21.15.43:0/1527770402 wait complete. 2023-12-08T20:21:19.224 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.656+0000 7fdb7321a700 1 Processor -- start 2023-12-08T20:21:19.224 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.657+0000 7fdb7321a700 1 -- start start 2023-12-08T20:21:19.224 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.657+0000 7fdb7321a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c1022b0 0x7fdb6c1026c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:19.224 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.657+0000 7fdb7321a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c102c00 con 0x7fdb6c1022b0 2023-12-08T20:21:19.224 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.657+0000 7fdb70fb6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c1022b0 0x7fdb6c1026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:19.224 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.657+0000 7fdb70fb6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c1022b0 0x7fdb6c1026c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39662/0 (socket says 172.21.15.43:39662) 2023-12-08T20:21:19.225 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.657+0000 7fdb70fb6700 1 -- 172.21.15.43:0/1104114993 learned_addr learned my addr 172.21.15.43:0/1104114993 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:19.225 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.657+0000 7fdb70fb6700 1 -- 172.21.15.43:0/1104114993 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c102d40 con 0x7fdb6c1022b0 2023-12-08T20:21:19.225 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.657+0000 7fdb70fb6700 1 --2- 172.21.15.43:0/1104114993 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c1022b0 0x7fdb6c1026c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdb600098e0 tx=0x7fdb60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e69012e45f6ecda server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:19.225 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.658+0000 7fdb6b7fe700 1 -- 172.21.15.43:0/1104114993 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb6000b860 con 0x7fdb6c1022b0 2023-12-08T20:21:19.225 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.658+0000 7fdb6b7fe700 1 -- 172.21.15.43:0/1104114993 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdb6000be70 con 0x7fdb6c1022b0 2023-12-08T20:21:19.225 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.658+0000 7fdb6b7fe700 1 -- 172.21.15.43:0/1104114993 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb60010380 con 0x7fdb6c1022b0 2023-12-08T20:21:19.225 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.658+0000 7fdb7321a700 1 -- 172.21.15.43:0/1104114993 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c1022b0 msgr2=0x7fdb6c1026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:19.225 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.658+0000 7fdb7321a700 1 --2- 172.21.15.43:0/1104114993 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c1022b0 0x7fdb6c1026c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdb600098e0 tx=0x7fdb60009250 comp rx=0 tx=0).stop 2023-12-08T20:21:19.225 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.658+0000 7fdb7321a700 1 -- 172.21.15.43:0/1104114993 shutdown_connections 2023-12-08T20:21:19.225 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.658+0000 7fdb7321a700 1 --2- 172.21.15.43:0/1104114993 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c1022b0 0x7fdb6c1026c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:19.225 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.658+0000 7fdb7321a700 1 -- 172.21.15.43:0/1104114993 >> 172.21.15.43:0/1104114993 conn(0x7fdb6c0fda10 msgr2=0x7fdb6c0ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:19.225 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.658+0000 7fdb7321a700 1 -- 172.21.15.43:0/1104114993 shutdown_connections 2023-12-08T20:21:19.225 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.658+0000 7fdb7321a700 1 -- 172.21.15.43:0/1104114993 wait complete. 2023-12-08T20:21:19.225 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.659+0000 7fdb7321a700 1 Processor -- start 2023-12-08T20:21:19.226 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.659+0000 7fdb7321a700 1 -- start start 2023-12-08T20:21:19.226 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.659+0000 7fdb7321a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c1022b0 0x7fdb6c078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:19.226 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.659+0000 7fdb7321a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c077190 con 0x7fdb6c1022b0 2023-12-08T20:21:19.226 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.659+0000 7fdb70fb6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c1022b0 0x7fdb6c078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:19.226 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.659+0000 7fdb70fb6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c1022b0 0x7fdb6c078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39674/0 (socket says 172.21.15.43:39674) 2023-12-08T20:21:19.226 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.660+0000 7fdb70fb6700 1 -- 172.21.15.43:0/1057635537 learned_addr learned my addr 172.21.15.43:0/1057635537 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:19.226 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.660+0000 7fdb70fb6700 1 -- 172.21.15.43:0/1057635537 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb600094f0 con 0x7fdb6c1022b0 2023-12-08T20:21:19.226 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.660+0000 7fdb70fb6700 1 --2- 172.21.15.43:0/1057635537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c1022b0 0x7fdb6c078d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000c010 tx=0x7fdb60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:19.226 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.660+0000 7fdb697fa700 1 -- 172.21.15.43:0/1057635537 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb60010960 con 0x7fdb6c1022b0 2023-12-08T20:21:19.226 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.660+0000 7fdb697fa700 1 -- 172.21.15.43:0/1057635537 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdb6001a430 con 0x7fdb6c1022b0 2023-12-08T20:21:19.226 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.660+0000 7fdb7321a700 1 -- 172.21.15.43:0/1057635537 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6c077390 con 0x7fdb6c1022b0 2023-12-08T20:21:19.226 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.660+0000 7fdb697fa700 1 -- 172.21.15.43:0/1057635537 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb60019580 con 0x7fdb6c1022b0 2023-12-08T20:21:19.226 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.660+0000 7fdb7321a700 1 -- 172.21.15.43:0/1057635537 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6c0777a0 con 0x7fdb6c1022b0 2023-12-08T20:21:19.226 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.661+0000 7fdb697fa700 1 -- 172.21.15.43:0/1057635537 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fdb60010ac0 con 0x7fdb6c1022b0 2023-12-08T20:21:19.226 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.661+0000 7fdb7321a700 1 -- 172.21.15.43:0/1057635537 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6c04bb80 con 0x7fdb6c1022b0 2023-12-08T20:21:19.226 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.661+0000 7fdb697fa700 1 --2- 172.21.15.43:0/1057635537 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fdb5c036640 0x7fdb5c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:19.227 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.661+0000 7fdb697fa700 1 -- 172.21.15.43:0/1057635537 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fdb6004a380 con 0x7fdb6c1022b0 2023-12-08T20:21:19.227 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.661+0000 7fdb6bfff700 1 --2- 172.21.15.43:0/1057635537 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fdb5c036640 0x7fdb5c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:19.227 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.662+0000 7fdb6bfff700 1 --2- 172.21.15.43:0/1057635537 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fdb5c036640 0x7fdb5c038af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009990 tx=0x7fdb58006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:19.227 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.666+0000 7fdb697fa700 1 -- 172.21.15.43:0/1057635537 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdb600222f0 con 0x7fdb6c1022b0 2023-12-08T20:21:19.227 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.868+0000 7fdb7321a700 1 -- 172.21.15.43:0/1057635537 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fdb6c104090 con 0x7fdb6c1022b0 2023-12-08T20:21:19.227 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.872+0000 7fdb697fa700 1 -- 172.21.15.43:0/1057635537 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fdb600222f0 con 0x7fdb6c1022b0 2023-12-08T20:21:19.227 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.874+0000 7fdb7321a700 1 -- 172.21.15.43:0/1057635537 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fdb5c036640 msgr2=0x7fdb5c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:19.227 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.874+0000 7fdb7321a700 1 --2- 172.21.15.43:0/1057635537 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fdb5c036640 0x7fdb5c038af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009990 tx=0x7fdb58006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:19.227 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.874+0000 7fdb7321a700 1 -- 172.21.15.43:0/1057635537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c1022b0 msgr2=0x7fdb6c078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:19.227 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.874+0000 7fdb7321a700 1 --2- 172.21.15.43:0/1057635537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c1022b0 0x7fdb6c078d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000c010 tx=0x7fdb60009250 comp rx=0 tx=0).stop 2023-12-08T20:21:19.227 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.874+0000 7fdb7321a700 1 -- 172.21.15.43:0/1057635537 shutdown_connections 2023-12-08T20:21:19.227 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.874+0000 7fdb7321a700 1 --2- 172.21.15.43:0/1057635537 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7fdb5c036640 0x7fdb5c038af0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:19.227 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.874+0000 7fdb7321a700 1 --2- 172.21.15.43:0/1057635537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb6c1022b0 0x7fdb6c078d10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:19.227 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.874+0000 7fdb7321a700 1 -- 172.21.15.43:0/1057635537 >> 172.21.15.43:0/1057635537 conn(0x7fdb6c0fda10 msgr2=0x7fdb6c0ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:19.227 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.875+0000 7fdb7321a700 1 -- 172.21.15.43:0/1057635537 shutdown_connections 2023-12-08T20:21:19.228 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:18.875+0000 7fdb7321a700 1 -- 172.21.15.43:0/1057635537 wait complete. 2023-12-08T20:21:19.228 INFO:teuthology.orchestra.run.smithi043.stdout:Enabling the dashboard module... 2023-12-08T20:21:20.143 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:19 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/1057635537' entity='client.admin' 2023-12-08T20:21:20.144 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:19 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3276640226' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-12-08T20:21:20.316 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.601+0000 7f4aa7bc6700 1 Processor -- start 2023-12-08T20:21:20.317 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.601+0000 7f4aa7bc6700 1 -- start start 2023-12-08T20:21:20.317 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.601+0000 7f4aa7bc6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa0070f40 0x7f4aa0104f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:20.317 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.601+0000 7f4aa7bc6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa01054a0 con 0x7f4aa0070f40 2023-12-08T20:21:20.317 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.601+0000 7f4aa5962700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa0070f40 0x7f4aa0104f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:20.317 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.601+0000 7f4aa5962700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa0070f40 0x7f4aa0104f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39690/0 (socket says 172.21.15.43:39690) 2023-12-08T20:21:20.317 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.601+0000 7f4aa5962700 1 -- 172.21.15.43:0/3725996534 learned_addr learned my addr 172.21.15.43:0/3725996534 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:20.318 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.602+0000 7f4aa5962700 1 -- 172.21.15.43:0/3725996534 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa01055e0 con 0x7f4aa0070f40 2023-12-08T20:21:20.318 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.602+0000 7f4aa5962700 1 --2- 172.21.15.43:0/3725996534 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa0070f40 0x7f4aa0104f60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0098e0 tx=0x7f4a9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8041707a8f7b8203 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:20.318 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.602+0000 7f4aa4960700 1 -- 172.21.15.43:0/3725996534 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a9c00b8f0 con 0x7f4aa0070f40 2023-12-08T20:21:20.319 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.602+0000 7f4aa4960700 1 -- 172.21.15.43:0/3725996534 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a9c011420 con 0x7f4aa0070f40 2023-12-08T20:21:20.319 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.602+0000 7f4aa4960700 1 -- 172.21.15.43:0/3725996534 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a9c010540 con 0x7f4aa0070f40 2023-12-08T20:21:20.319 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.603+0000 7f4aa7bc6700 1 -- 172.21.15.43:0/3725996534 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa0070f40 msgr2=0x7f4aa0104f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:20.319 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.603+0000 7f4aa7bc6700 1 --2- 172.21.15.43:0/3725996534 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa0070f40 0x7f4aa0104f60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0098e0 tx=0x7f4a9c009250 comp rx=0 tx=0).stop 2023-12-08T20:21:20.320 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.603+0000 7f4aa7bc6700 1 -- 172.21.15.43:0/3725996534 shutdown_connections 2023-12-08T20:21:20.320 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.603+0000 7f4aa7bc6700 1 --2- 172.21.15.43:0/3725996534 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa0070f40 0x7f4aa0104f60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:20.320 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.603+0000 7f4aa7bc6700 1 -- 172.21.15.43:0/3725996534 >> 172.21.15.43:0/3725996534 conn(0x7f4aa00fc970 msgr2=0x7f4aa00fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:20.320 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.603+0000 7f4aa7bc6700 1 -- 172.21.15.43:0/3725996534 shutdown_connections 2023-12-08T20:21:20.320 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.603+0000 7f4aa7bc6700 1 -- 172.21.15.43:0/3725996534 wait complete. 2023-12-08T20:21:20.321 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.603+0000 7f4aa7bc6700 1 Processor -- start 2023-12-08T20:21:20.321 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.603+0000 7f4aa7bc6700 1 -- start start 2023-12-08T20:21:20.321 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.604+0000 7f4aa7bc6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa0070f40 0x7f4aa01029e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:20.321 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.604+0000 7f4aa7bc6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa0100e60 con 0x7f4aa0070f40 2023-12-08T20:21:20.321 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.604+0000 7f4aa5962700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa0070f40 0x7f4aa01029e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:20.321 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.604+0000 7f4aa5962700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa0070f40 0x7f4aa01029e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39706/0 (socket says 172.21.15.43:39706) 2023-12-08T20:21:20.321 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.604+0000 7f4aa5962700 1 -- 172.21.15.43:0/3276640226 learned_addr learned my addr 172.21.15.43:0/3276640226 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:20.321 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.604+0000 7f4aa5962700 1 -- 172.21.15.43:0/3276640226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c0094f0 con 0x7f4aa0070f40 2023-12-08T20:21:20.321 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.604+0000 7f4aa5962700 1 --2- 172.21.15.43:0/3276640226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa0070f40 0x7f4aa01029e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c003080 tx=0x7f4a9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:20.321 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.604+0000 7f4a967fc700 1 -- 172.21.15.43:0/3276640226 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a9c00beb0 con 0x7f4aa0070f40 2023-12-08T20:21:20.321 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.604+0000 7f4aa7bc6700 1 -- 172.21.15.43:0/3276640226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa0101060 con 0x7f4aa0070f40 2023-12-08T20:21:20.321 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.604+0000 7f4a967fc700 1 -- 172.21.15.43:0/3276640226 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a9c010cb0 con 0x7f4aa0070f40 2023-12-08T20:21:20.322 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.604+0000 7f4a967fc700 1 -- 172.21.15.43:0/3276640226 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a9c01ae20 con 0x7f4aa0070f40 2023-12-08T20:21:20.322 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.604+0000 7f4aa7bc6700 1 -- 172.21.15.43:0/3276640226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa0101470 con 0x7f4aa0070f40 2023-12-08T20:21:20.322 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.605+0000 7f4a967fc700 1 -- 172.21.15.43:0/3276640226 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f4a9c010800 con 0x7f4aa0070f40 2023-12-08T20:21:20.322 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.605+0000 7f4aa7bc6700 1 -- 172.21.15.43:0/3276640226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa004bb80 con 0x7f4aa0070f40 2023-12-08T20:21:20.323 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.605+0000 7f4a967fc700 1 --2- 172.21.15.43:0/3276640226 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f4a8c0365f0 0x7f4a8c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:20.323 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.606+0000 7f4a967fc700 1 -- 172.21.15.43:0/3276640226 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f4a9c04a2b0 con 0x7f4aa0070f40 2023-12-08T20:21:20.323 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.606+0000 7f4aa5161700 1 --2- 172.21.15.43:0/3276640226 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f4a8c0365f0 0x7f4a8c038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:20.323 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.606+0000 7f4aa5161700 1 --2- 172.21.15.43:0/3276640226 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f4a8c0365f0 0x7f4a8c038aa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4a90009990 tx=0x7f4a90006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:20.323 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.610+0000 7f4a967fc700 1 -- 172.21.15.43:0/3276640226 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4a9c02e440 con 0x7f4aa0070f40 2023-12-08T20:21:20.323 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.865+0000 7f4aa7bc6700 1 -- 172.21.15.43:0/3276640226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f4aa0106300 con 0x7f4aa0070f40 2023-12-08T20:21:20.323 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.872+0000 7f4a967fc700 1 -- 172.21.15.43:0/3276640226 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f4a9c006d50 con 0x7f4aa0070f40 2023-12-08T20:21:20.323 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.873+0000 7f4a967fc700 1 -- 172.21.15.43:0/3276640226 <== mon.0 v2:172.21.15.43:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f4a9c02b2f0 con 0x7f4aa0070f40 2023-12-08T20:21:20.323 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.875+0000 7f4aa7bc6700 1 -- 172.21.15.43:0/3276640226 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f4a8c0365f0 msgr2=0x7f4a8c038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:20.323 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.875+0000 7f4aa7bc6700 1 --2- 172.21.15.43:0/3276640226 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f4a8c0365f0 0x7f4a8c038aa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4a90009990 tx=0x7f4a90006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:20.323 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.875+0000 7f4aa7bc6700 1 -- 172.21.15.43:0/3276640226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa0070f40 msgr2=0x7f4aa01029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:20.323 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.875+0000 7f4aa7bc6700 1 --2- 172.21.15.43:0/3276640226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa0070f40 0x7f4aa01029e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c003080 tx=0x7f4a9c009250 comp rx=0 tx=0).stop 2023-12-08T20:21:20.323 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.875+0000 7f4aa7bc6700 1 -- 172.21.15.43:0/3276640226 shutdown_connections 2023-12-08T20:21:20.323 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.875+0000 7f4aa7bc6700 1 --2- 172.21.15.43:0/3276640226 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f4a8c0365f0 0x7f4a8c038aa0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:20.323 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.876+0000 7f4aa7bc6700 1 --2- 172.21.15.43:0/3276640226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa0070f40 0x7f4aa01029e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:20.324 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.876+0000 7f4aa7bc6700 1 -- 172.21.15.43:0/3276640226 >> 172.21.15.43:0/3276640226 conn(0x7f4aa00fc970 msgr2=0x7f4aa00fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:20.324 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.876+0000 7f4aa7bc6700 1 -- 172.21.15.43:0/3276640226 shutdown_connections 2023-12-08T20:21:20.324 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:19.876+0000 7f4aa7bc6700 1 -- 172.21.15.43:0/3276640226 wait complete. 2023-12-08T20:21:21.167 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:20 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3276640226' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-12-08T20:21:21.168 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:20 smithi043 ceph-mon[111966]: mgrmap e9: smithi043.hqcdcm(active, since 18s) 2023-12-08T20:21:21.336 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2023-12-08T20:21:21.342 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-12-08T20:21:21.342 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-08T20:21:21.342 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "active_name": "smithi043.hqcdcm", 2023-12-08T20:21:21.342 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-08T20:21:21.342 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2023-12-08T20:21:21.342 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.698+0000 7f9e52bc9700 1 Processor -- start 2023-12-08T20:21:21.342 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.699+0000 7f9e52bc9700 1 -- start start 2023-12-08T20:21:21.343 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.699+0000 7f9e52bc9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e4c1011c0 0x7f9e4c1015d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:21.343 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.699+0000 7f9e52bc9700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c101b10 con 0x7f9e4c1011c0 2023-12-08T20:21:21.343 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.699+0000 7f9e50965700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e4c1011c0 0x7f9e4c1015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:21.343 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.699+0000 7f9e50965700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e4c1011c0 0x7f9e4c1015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48196/0 (socket says 172.21.15.43:48196) 2023-12-08T20:21:21.343 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.699+0000 7f9e50965700 1 -- 172.21.15.43:0/1942852989 learned_addr learned my addr 172.21.15.43:0/1942852989 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:21.343 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.699+0000 7f9e50965700 1 -- 172.21.15.43:0/1942852989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4c101c50 con 0x7f9e4c1011c0 2023-12-08T20:21:21.343 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.699+0000 7f9e50965700 1 --2- 172.21.15.43:0/1942852989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e4c1011c0 0x7f9e4c1015d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9e400098e0 tx=0x7f9e40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502f5993e887f9a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:21.343 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.700+0000 7f9e4b7fe700 1 -- 172.21.15.43:0/1942852989 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e4000b860 con 0x7f9e4c1011c0 2023-12-08T20:21:21.343 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.700+0000 7f9e4b7fe700 1 -- 172.21.15.43:0/1942852989 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e4000be70 con 0x7f9e4c1011c0 2023-12-08T20:21:21.343 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.700+0000 7f9e4b7fe700 1 -- 172.21.15.43:0/1942852989 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e40010380 con 0x7f9e4c1011c0 2023-12-08T20:21:21.343 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.700+0000 7f9e52bc9700 1 -- 172.21.15.43:0/1942852989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e4c1011c0 msgr2=0x7f9e4c1015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:21.343 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.700+0000 7f9e52bc9700 1 --2- 172.21.15.43:0/1942852989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e4c1011c0 0x7f9e4c1015d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9e400098e0 tx=0x7f9e40009250 comp rx=0 tx=0).stop 2023-12-08T20:21:21.343 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.701+0000 7f9e52bc9700 1 -- 172.21.15.43:0/1942852989 shutdown_connections 2023-12-08T20:21:21.343 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.701+0000 7f9e52bc9700 1 --2- 172.21.15.43:0/1942852989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e4c1011c0 0x7f9e4c1015d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:21.343 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.701+0000 7f9e52bc9700 1 -- 172.21.15.43:0/1942852989 >> 172.21.15.43:0/1942852989 conn(0x7f9e4c0fc980 msgr2=0x7f9e4c0fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:21.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.701+0000 7f9e52bc9700 1 -- 172.21.15.43:0/1942852989 shutdown_connections 2023-12-08T20:21:21.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.701+0000 7f9e52bc9700 1 -- 172.21.15.43:0/1942852989 wait complete. 2023-12-08T20:21:21.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.701+0000 7f9e52bc9700 1 Processor -- start 2023-12-08T20:21:21.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.701+0000 7f9e52bc9700 1 -- start start 2023-12-08T20:21:21.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.702+0000 7f9e52bc9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e4c1011c0 0x7f9e4c113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:21.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.702+0000 7f9e52bc9700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c076bf0 con 0x7f9e4c1011c0 2023-12-08T20:21:21.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.702+0000 7f9e50965700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e4c1011c0 0x7f9e4c113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:21.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.702+0000 7f9e50965700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e4c1011c0 0x7f9e4c113ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48208/0 (socket says 172.21.15.43:48208) 2023-12-08T20:21:21.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.702+0000 7f9e50965700 1 -- 172.21.15.43:0/1690211344 learned_addr learned my addr 172.21.15.43:0/1690211344 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:21.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.702+0000 7f9e50965700 1 -- 172.21.15.43:0/1690211344 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e400094f0 con 0x7f9e4c1011c0 2023-12-08T20:21:21.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.703+0000 7f9e50965700 1 --2- 172.21.15.43:0/1690211344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e4c1011c0 0x7f9e4c113ea0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9e40011b60 tx=0x7f9e40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:21.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.703+0000 7f9e497fa700 1 -- 172.21.15.43:0/1690211344 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e40010850 con 0x7f9e4c1011c0 2023-12-08T20:21:21.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.703+0000 7f9e497fa700 1 -- 172.21.15.43:0/1690211344 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e40010e60 con 0x7f9e4c1011c0 2023-12-08T20:21:21.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.703+0000 7f9e52bc9700 1 -- 172.21.15.43:0/1690211344 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e4c076df0 con 0x7f9e4c1011c0 2023-12-08T20:21:21.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.703+0000 7f9e497fa700 1 -- 172.21.15.43:0/1690211344 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e4001ae20 con 0x7f9e4c1011c0 2023-12-08T20:21:21.344 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.703+0000 7f9e52bc9700 1 -- 172.21.15.43:0/1690211344 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4c1145a0 con 0x7f9e4c1011c0 2023-12-08T20:21:21.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.704+0000 7f9e497fa700 1 -- 172.21.15.43:0/1690211344 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f9e4002d3f0 con 0x7f9e4c1011c0 2023-12-08T20:21:21.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.704+0000 7f9e497fa700 1 --2- 172.21.15.43:0/1690211344 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9e3c036690 0x7f9e3c038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:21.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.704+0000 7f9e497fa700 1 -- 172.21.15.43:0/1690211344 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9e4004a210 con 0x7f9e4c1011c0 2023-12-08T20:21:21.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.704+0000 7f9e4bfff700 1 -- 172.21.15.43:0/1690211344 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9e3c036690 msgr2=0x7f9e3c038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1561199606 2023-12-08T20:21:21.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.704+0000 7f9e4bfff700 1 --2- 172.21.15.43:0/1690211344 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9e3c036690 0x7f9e3c038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:21:21.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.704+0000 7f9e52bc9700 1 -- 172.21.15.43:0/1690211344 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e4c10a080 con 0x7f9e4c1011c0 2023-12-08T20:21:21.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.709+0000 7f9e497fa700 1 -- 172.21.15.43:0/1690211344 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9e4002b8e0 con 0x7f9e4c1011c0 2023-12-08T20:21:21.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.905+0000 7f9e4bfff700 1 -- 172.21.15.43:0/1690211344 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9e3c036690 msgr2=0x7f9e3c038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1561199606 2023-12-08T20:21:21.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.905+0000 7f9e4bfff700 1 --2- 172.21.15.43:0/1690211344 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9e3c036690 0x7f9e3c038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T20:21:21.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.984+0000 7f9e52bc9700 1 -- 172.21.15.43:0/1690211344 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f9e4c109aa0 con 0x7f9e4c1011c0 2023-12-08T20:21:21.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.984+0000 7f9e497fa700 1 -- 172.21.15.43:0/1690211344 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f9e4002b2f0 con 0x7f9e4c1011c0 2023-12-08T20:21:21.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.987+0000 7f9e52bc9700 1 -- 172.21.15.43:0/1690211344 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9e3c036690 msgr2=0x7f9e3c038b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-08T20:21:21.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.987+0000 7f9e52bc9700 1 --2- 172.21.15.43:0/1690211344 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9e3c036690 0x7f9e3c038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:21.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.987+0000 7f9e52bc9700 1 -- 172.21.15.43:0/1690211344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e4c1011c0 msgr2=0x7f9e4c113ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:21.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.987+0000 7f9e52bc9700 1 --2- 172.21.15.43:0/1690211344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e4c1011c0 0x7f9e4c113ea0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9e40011b60 tx=0x7f9e40009250 comp rx=0 tx=0).stop 2023-12-08T20:21:21.346 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.987+0000 7f9e52bc9700 1 -- 172.21.15.43:0/1690211344 shutdown_connections 2023-12-08T20:21:21.346 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.987+0000 7f9e52bc9700 1 --2- 172.21.15.43:0/1690211344 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f9e3c036690 0x7f9e3c038b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:21.346 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.987+0000 7f9e52bc9700 1 --2- 172.21.15.43:0/1690211344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e4c1011c0 0x7f9e4c113ea0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:21.346 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.987+0000 7f9e52bc9700 1 -- 172.21.15.43:0/1690211344 >> 172.21.15.43:0/1690211344 conn(0x7f9e4c0fc980 msgr2=0x7f9e4c0fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:21.346 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.987+0000 7f9e52bc9700 1 -- 172.21.15.43:0/1690211344 shutdown_connections 2023-12-08T20:21:21.346 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:20.987+0000 7f9e52bc9700 1 -- 172.21.15.43:0/1690211344 wait complete. 2023-12-08T20:21:21.346 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for the mgr to restart... 2023-12-08T20:21:21.346 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mgr epoch 9... 2023-12-08T20:21:22.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:21 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/1690211344' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-08T20:21:27.456 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:27 smithi043 ceph-mon[111966]: Active manager daemon smithi043.hqcdcm restarted 2023-12-08T20:21:27.456 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:27 smithi043 ceph-mon[111966]: Activating manager daemon smithi043.hqcdcm 2023-12-08T20:21:27.456 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:27 smithi043 ceph-mon[111966]: osdmap e3: 0 total, 0 up, 0 in 2023-12-08T20:21:27.456 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:27 smithi043 ceph-mon[111966]: mgrmap e10: smithi043.hqcdcm(active, starting, since 0.00350662s) 2023-12-08T20:21:27.456 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:27 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:21:27.457 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:27 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr metadata", "who": "smithi043.hqcdcm", "id": "smithi043.hqcdcm"}]: dispatch 2023-12-08T20:21:27.457 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:27 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-08T20:21:27.457 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:27 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-08T20:21:27.457 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:27 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-08T20:21:27.457 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:27 smithi043 ceph-mon[111966]: Manager daemon smithi043.hqcdcm is now available 2023-12-08T20:21:27.457 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:27 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:21:28.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:28 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:21:28.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:28 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi043.hqcdcm/mirror_snapshot_schedule"}]: dispatch 2023-12-08T20:21:28.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:28 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi043.hqcdcm/trash_purge_schedule"}]: dispatch 2023-12-08T20:21:28.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:28 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:28.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:28 smithi043 ceph-mon[111966]: mgrmap e11: smithi043.hqcdcm(active, since 1.00645s) 2023-12-08T20:21:29.510 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2023-12-08T20:21:29.511 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-12-08T20:21:29.511 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-08T20:21:29.511 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2023-12-08T20:21:29.511 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.780+0000 7f7224fe3700 1 Processor -- start 2023-12-08T20:21:29.511 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.780+0000 7f7224fe3700 1 -- start start 2023-12-08T20:21:29.511 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.780+0000 7f7224fe3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7220102900 0x7f7220102d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:29.511 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.781+0000 7f7224fe3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7220103250 con 0x7f7220102900 2023-12-08T20:21:29.511 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.781+0000 7f721e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7220102900 0x7f7220102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:29.511 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.781+0000 7f721e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7220102900 0x7f7220102d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48224/0 (socket says 172.21.15.43:48224) 2023-12-08T20:21:29.511 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.781+0000 7f721e59c700 1 -- 172.21.15.43:0/2530921758 learned_addr learned my addr 172.21.15.43:0/2530921758 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:29.511 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.781+0000 7f721e59c700 1 -- 172.21.15.43:0/2530921758 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7220103390 con 0x7f7220102900 2023-12-08T20:21:29.517 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.781+0000 7f721e59c700 1 --2- 172.21.15.43:0/2530921758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7220102900 0x7f7220102d10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f72100098e0 tx=0x7f7210009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520fd57052cd9ecb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:29.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.781+0000 7f721d59a700 1 -- 172.21.15.43:0/2530921758 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f721000b860 con 0x7f7220102900 2023-12-08T20:21:29.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.781+0000 7f721d59a700 1 -- 172.21.15.43:0/2530921758 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f721000be70 con 0x7f7220102900 2023-12-08T20:21:29.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.781+0000 7f721d59a700 1 -- 172.21.15.43:0/2530921758 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7210010380 con 0x7f7220102900 2023-12-08T20:21:29.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.782+0000 7f7224fe3700 1 -- 172.21.15.43:0/2530921758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7220102900 msgr2=0x7f7220102d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:29.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.782+0000 7f7224fe3700 1 --2- 172.21.15.43:0/2530921758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7220102900 0x7f7220102d10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f72100098e0 tx=0x7f7210009250 comp rx=0 tx=0).stop 2023-12-08T20:21:29.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.782+0000 7f7224fe3700 1 -- 172.21.15.43:0/2530921758 shutdown_connections 2023-12-08T20:21:29.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.782+0000 7f7224fe3700 1 --2- 172.21.15.43:0/2530921758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7220102900 0x7f7220102d10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:29.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.782+0000 7f7224fe3700 1 -- 172.21.15.43:0/2530921758 >> 172.21.15.43:0/2530921758 conn(0x7f72200fc0b0 msgr2=0x7f72200fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:29.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.782+0000 7f7224fe3700 1 -- 172.21.15.43:0/2530921758 shutdown_connections 2023-12-08T20:21:29.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.782+0000 7f7224fe3700 1 -- 172.21.15.43:0/2530921758 wait complete. 2023-12-08T20:21:29.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.783+0000 7f7224fe3700 1 Processor -- start 2023-12-08T20:21:29.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.783+0000 7f7224fe3700 1 -- start start 2023-12-08T20:21:29.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.783+0000 7f7224fe3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7220102900 0x7f72201133b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:29.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.783+0000 7f7224fe3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72201138f0 con 0x7f7220102900 2023-12-08T20:21:29.518 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.783+0000 7f721e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7220102900 0x7f72201133b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:29.519 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.783+0000 7f721e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7220102900 0x7f72201133b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48236/0 (socket says 172.21.15.43:48236) 2023-12-08T20:21:29.519 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.783+0000 7f721e59c700 1 -- 172.21.15.43:0/150173720 learned_addr learned my addr 172.21.15.43:0/150173720 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:29.519 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.784+0000 7f721e59c700 1 -- 172.21.15.43:0/150173720 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72100094f0 con 0x7f7220102900 2023-12-08T20:21:29.519 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.784+0000 7f721e59c700 1 --2- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7220102900 0x7f72201133b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7210011b60 tx=0x7f7210009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:29.519 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.784+0000 7f720effd700 1 -- 172.21.15.43:0/150173720 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7210010850 con 0x7f7220102900 2023-12-08T20:21:29.519 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.784+0000 7f720effd700 1 -- 172.21.15.43:0/150173720 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7210010e60 con 0x7f7220102900 2023-12-08T20:21:29.519 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.784+0000 7f7224fe3700 1 -- 172.21.15.43:0/150173720 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7220113af0 con 0x7f7220102900 2023-12-08T20:21:29.519 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.784+0000 7f720effd700 1 -- 172.21.15.43:0/150173720 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f721001ae20 con 0x7f7220102900 2023-12-08T20:21:29.519 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.784+0000 7f7224fe3700 1 -- 172.21.15.43:0/150173720 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7220113f00 con 0x7f7220102900 2023-12-08T20:21:29.519 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.785+0000 7f720effd700 1 -- 172.21.15.43:0/150173720 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f721002d3f0 con 0x7f7220102900 2023-12-08T20:21:29.519 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.785+0000 7f720effd700 1 --2- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7208036690 0x7f7208038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:29.519 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.785+0000 7f720effd700 1 -- 172.21.15.43:0/150173720 --> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7208039250 con 0x7f7208036690 2023-12-08T20:21:29.519 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.785+0000 7f720effd700 1 -- 172.21.15.43:0/150173720 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f721004a250 con 0x7f7220102900 2023-12-08T20:21:29.519 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.785+0000 7f721dd9b700 1 -- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7208036690 msgr2=0x7f7208038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1561199606 2023-12-08T20:21:29.519 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.785+0000 7f721dd9b700 1 --2- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7208036690 0x7f7208038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:21:29.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.986+0000 7f721dd9b700 1 -- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7208036690 msgr2=0x7f7208038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1561199606 2023-12-08T20:21:29.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:21.986+0000 7f721dd9b700 1 --2- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7208036690 0x7f7208038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T20:21:29.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:22.387+0000 7f721dd9b700 1 -- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7208036690 msgr2=0x7f7208038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1561199606 2023-12-08T20:21:29.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:22.387+0000 7f721dd9b700 1 --2- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7208036690 0x7f7208038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-08T20:21:29.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:23.188+0000 7f721dd9b700 1 -- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7208036690 msgr2=0x7f7208038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1561199606 2023-12-08T20:21:29.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:23.188+0000 7f721dd9b700 1 --2- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7208036690 0x7f7208038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-08T20:21:29.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:24.789+0000 7f721dd9b700 1 -- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7208036690 msgr2=0x7f7208038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1561199606 2023-12-08T20:21:29.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:24.789+0000 7f721dd9b700 1 --2- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7208036690 0x7f7208038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-08T20:21:29.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:27.335+0000 7f720effd700 1 -- 172.21.15.43:0/150173720 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mgrmap(e 10) v1 ==== 43061+0+0 (secure 0 0 0) 0x7f721002d740 con 0x7f7220102900 2023-12-08T20:21:29.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:27.335+0000 7f720effd700 1 -- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7208036690 msgr2=0x7f7208038b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-08T20:21:29.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:27.335+0000 7f720effd700 1 --2- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7208036690 0x7f7208038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:29.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:28.337+0000 7f720effd700 1 -- 172.21.15.43:0/150173720 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7f721004b910 con 0x7f7220102900 2023-12-08T20:21:29.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:28.337+0000 7f720effd700 1 --2- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f7208039fb0 0x7f720803c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:29.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:28.337+0000 7f720effd700 1 -- 172.21.15.43:0/150173720 --> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7208039250 con 0x7f7208039fb0 2023-12-08T20:21:29.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:28.337+0000 7f721dd9b700 1 --2- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f7208039fb0 0x7f720803c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:29.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:28.338+0000 7f721dd9b700 1 --2- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f7208039fb0 0x7f720803c390 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f72140039d0 tx=0x7f7214009350 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:29.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:28.339+0000 7f720effd700 1 -- 172.21.15.43:0/150173720 <== mgr.14162 v2:172.21.15.43:6800/2315465125 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f7208039250 con 0x7f7208039fb0 2023-12-08T20:21:29.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:28.345+0000 7f7224fe3700 1 -- 172.21.15.43:0/150173720 --> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f722004bb80 con 0x7f7208039fb0 2023-12-08T20:21:29.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:28.346+0000 7f720effd700 1 -- 172.21.15.43:0/150173720 <== mgr.14162 v2:172.21.15.43:6800/2315465125 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f722004bb80 con 0x7f7208039fb0 2023-12-08T20:21:29.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:28.346+0000 7f7224fe3700 1 -- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f7208039fb0 msgr2=0x7f720803c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:29.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:28.346+0000 7f7224fe3700 1 --2- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f7208039fb0 0x7f720803c390 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f72140039d0 tx=0x7f7214009350 comp rx=0 tx=0).stop 2023-12-08T20:21:29.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:28.346+0000 7f7224fe3700 1 -- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7220102900 msgr2=0x7f72201133b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:29.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:28.346+0000 7f7224fe3700 1 --2- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7220102900 0x7f72201133b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7210011b60 tx=0x7f7210009250 comp rx=0 tx=0).stop 2023-12-08T20:21:29.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:28.346+0000 7f7224fe3700 1 -- 172.21.15.43:0/150173720 shutdown_connections 2023-12-08T20:21:29.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:28.346+0000 7f7224fe3700 1 --2- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f7208039fb0 0x7f720803c390 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:29.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:28.346+0000 7f7224fe3700 1 --2- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7220102900 0x7f72201133b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:29.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:28.346+0000 7f7224fe3700 1 --2- 172.21.15.43:0/150173720 >> [v2:172.21.15.43:6800/1561199606,v1:172.21.15.43:6801/1561199606] conn(0x7f7208036690 0x7f7208038b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:29.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:28.346+0000 7f7224fe3700 1 -- 172.21.15.43:0/150173720 >> 172.21.15.43:0/150173720 conn(0x7f72200fc0b0 msgr2=0x7f72200fe490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:29.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:28.346+0000 7f7224fe3700 1 -- 172.21.15.43:0/150173720 shutdown_connections 2023-12-08T20:21:29.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:28.346+0000 7f7224fe3700 1 -- 172.21.15.43:0/150173720 wait complete. 2023-12-08T20:21:29.521 INFO:teuthology.orchestra.run.smithi043.stdout:mgr epoch 9 is available 2023-12-08T20:21:29.522 INFO:teuthology.orchestra.run.smithi043.stdout:Generating a dashboard self-signed certificate... 2023-12-08T20:21:29.625 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:29 smithi043 ceph-mon[111966]: [08/Dec/2023:20:21:28] ENGINE Bus STARTING 2023-12-08T20:21:29.625 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:29 smithi043 ceph-mon[111966]: [08/Dec/2023:20:21:28] ENGINE Serving on https://172.21.15.43:7150 2023-12-08T20:21:29.626 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:29 smithi043 ceph-mon[111966]: [08/Dec/2023:20:21:28] ENGINE Bus STARTED 2023-12-08T20:21:29.626 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:29 smithi043 ceph-mon[111966]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-08T20:21:29.626 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:29 smithi043 ceph-mon[111966]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-08T20:21:29.626 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:29 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:30.564 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-12-08T20:21:30.564 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.907+0000 7fccc1d4c700 1 Processor -- start 2023-12-08T20:21:30.564 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.907+0000 7fccc1d4c700 1 -- start start 2023-12-08T20:21:30.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.907+0000 7fccc1d4c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccbc100950 0x7fccbc100d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:30.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.907+0000 7fccc1d4c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc1012a0 con 0x7fccbc100950 2023-12-08T20:21:30.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.908+0000 7fccbb7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccbc100950 0x7fccbc100d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:30.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.908+0000 7fccbb7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccbc100950 0x7fccbc100d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48330/0 (socket says 172.21.15.43:48330) 2023-12-08T20:21:30.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.908+0000 7fccbb7fe700 1 -- 172.21.15.43:0/3948376806 learned_addr learned my addr 172.21.15.43:0/3948376806 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:30.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.908+0000 7fccbb7fe700 1 -- 172.21.15.43:0/3948376806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccbc1013e0 con 0x7fccbc100950 2023-12-08T20:21:30.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.908+0000 7fccbb7fe700 1 --2- 172.21.15.43:0/3948376806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccbc100950 0x7fccbc100d60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fccac00aa80 tx=0x7fccac00a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fb7d8ec3f33f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:30.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.908+0000 7fccba7fc700 1 -- 172.21.15.43:0/3948376806 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fccac00cba0 con 0x7fccbc100950 2023-12-08T20:21:30.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.908+0000 7fccba7fc700 1 -- 172.21.15.43:0/3948376806 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fccac00cd00 con 0x7fccbc100950 2023-12-08T20:21:30.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.908+0000 7fccba7fc700 1 -- 172.21.15.43:0/3948376806 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fccac010640 con 0x7fccbc100950 2023-12-08T20:21:30.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.909+0000 7fccc1d4c700 1 -- 172.21.15.43:0/3948376806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccbc100950 msgr2=0x7fccbc100d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:30.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.909+0000 7fccc1d4c700 1 --2- 172.21.15.43:0/3948376806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccbc100950 0x7fccbc100d60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fccac00aa80 tx=0x7fccac00a3f0 comp rx=0 tx=0).stop 2023-12-08T20:21:30.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.909+0000 7fccc1d4c700 1 -- 172.21.15.43:0/3948376806 shutdown_connections 2023-12-08T20:21:30.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.909+0000 7fccc1d4c700 1 --2- 172.21.15.43:0/3948376806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccbc100950 0x7fccbc100d60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:30.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.909+0000 7fccc1d4c700 1 -- 172.21.15.43:0/3948376806 >> 172.21.15.43:0/3948376806 conn(0x7fccbc0fc0b0 msgr2=0x7fccbc0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:30.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.909+0000 7fccc1d4c700 1 -- 172.21.15.43:0/3948376806 shutdown_connections 2023-12-08T20:21:30.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.909+0000 7fccc1d4c700 1 -- 172.21.15.43:0/3948376806 wait complete. 2023-12-08T20:21:30.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.910+0000 7fccc1d4c700 1 Processor -- start 2023-12-08T20:21:30.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.910+0000 7fccc1d4c700 1 -- start start 2023-12-08T20:21:30.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.911+0000 7fccc1d4c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccbc100950 0x7fccbc1133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:30.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.911+0000 7fccc1d4c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc1138e0 con 0x7fccbc100950 2023-12-08T20:21:30.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.911+0000 7fccbb7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccbc100950 0x7fccbc1133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:30.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.911+0000 7fccbb7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccbc100950 0x7fccbc1133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48346/0 (socket says 172.21.15.43:48346) 2023-12-08T20:21:30.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.911+0000 7fccbb7fe700 1 -- 172.21.15.43:0/1440163988 learned_addr learned my addr 172.21.15.43:0/1440163988 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:30.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.911+0000 7fccbb7fe700 1 -- 172.21.15.43:0/1440163988 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac00a690 con 0x7fccbc100950 2023-12-08T20:21:30.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.911+0000 7fccbb7fe700 1 --2- 172.21.15.43:0/1440163988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccbc100950 0x7fccbc1133a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fccac010af0 tx=0x7fccac01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:30.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.911+0000 7fcca3fff700 1 -- 172.21.15.43:0/1440163988 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fccac018760 con 0x7fccbc100950 2023-12-08T20:21:30.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.911+0000 7fcca3fff700 1 -- 172.21.15.43:0/1440163988 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fccac0188c0 con 0x7fccbc100950 2023-12-08T20:21:30.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.911+0000 7fccc1d4c700 1 -- 172.21.15.43:0/1440163988 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccbc113ae0 con 0x7fccbc100950 2023-12-08T20:21:30.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.911+0000 7fcca3fff700 1 -- 172.21.15.43:0/1440163988 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fccac0203e0 con 0x7fccbc100950 2023-12-08T20:21:30.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.911+0000 7fccc1d4c700 1 -- 172.21.15.43:0/1440163988 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccbc113ef0 con 0x7fccbc100950 2023-12-08T20:21:30.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.913+0000 7fcca3fff700 1 -- 172.21.15.43:0/1440163988 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7fccac020650 con 0x7fccbc100950 2023-12-08T20:21:30.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.913+0000 7fccc1d4c700 1 -- 172.21.15.43:0/1440163988 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccbc04bb80 con 0x7fccbc100950 2023-12-08T20:21:30.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.913+0000 7fcca3fff700 1 --2- 172.21.15.43:0/1440163988 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fcca4036510 0x7fcca40389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:30.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.913+0000 7fcca3fff700 1 -- 172.21.15.43:0/1440163988 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fccac04a100 con 0x7fccbc100950 2023-12-08T20:21:30.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.913+0000 7fccbaffd700 1 --2- 172.21.15.43:0/1440163988 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fcca4036510 0x7fcca40389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:30.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.913+0000 7fccbaffd700 1 --2- 172.21.15.43:0/1440163988 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fcca4036510 0x7fcca40389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009990 tx=0x7fccb0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:30.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:29.918+0000 7fcca3fff700 1 -- 172.21.15.43:0/1440163988 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fccac020d20 con 0x7fccbc100950 2023-12-08T20:21:30.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.127+0000 7fccc1d4c700 1 -- 172.21.15.43:0/1440163988 --> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fccbc108630 con 0x7fcca4036510 2023-12-08T20:21:30.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.199+0000 7fcca3fff700 1 -- 172.21.15.43:0/1440163988 <== mgr.14162 v2:172.21.15.43:6800/2315465125 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fccbc108630 con 0x7fcca4036510 2023-12-08T20:21:30.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.202+0000 7fccc1d4c700 1 -- 172.21.15.43:0/1440163988 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fcca4036510 msgr2=0x7fcca40389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:30.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.202+0000 7fccc1d4c700 1 --2- 172.21.15.43:0/1440163988 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fcca4036510 0x7fcca40389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009990 tx=0x7fccb0006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:30.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.202+0000 7fccc1d4c700 1 -- 172.21.15.43:0/1440163988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccbc100950 msgr2=0x7fccbc1133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:30.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.202+0000 7fccc1d4c700 1 --2- 172.21.15.43:0/1440163988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccbc100950 0x7fccbc1133a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fccac010af0 tx=0x7fccac01a040 comp rx=0 tx=0).stop 2023-12-08T20:21:30.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.202+0000 7fccc1d4c700 1 -- 172.21.15.43:0/1440163988 shutdown_connections 2023-12-08T20:21:30.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.202+0000 7fccc1d4c700 1 --2- 172.21.15.43:0/1440163988 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fcca4036510 0x7fcca40389c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:30.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.202+0000 7fccc1d4c700 1 --2- 172.21.15.43:0/1440163988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccbc100950 0x7fccbc1133a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:30.568 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.202+0000 7fccc1d4c700 1 -- 172.21.15.43:0/1440163988 >> 172.21.15.43:0/1440163988 conn(0x7fccbc0fc0b0 msgr2=0x7fccbc1036b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:30.568 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.202+0000 7fccc1d4c700 1 -- 172.21.15.43:0/1440163988 shutdown_connections 2023-12-08T20:21:30.568 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.202+0000 7fccc1d4c700 1 -- 172.21.15.43:0/1440163988 wait complete. 2023-12-08T20:21:30.568 INFO:teuthology.orchestra.run.smithi043.stdout:Creating initial admin user... 2023-12-08T20:21:31.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:31 smithi043 ceph-mon[111966]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:21:31.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:31 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:31.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:31 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:31.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:31 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:31.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:31 smithi043 ceph-mon[111966]: mgrmap e12: smithi043.hqcdcm(active, since 2s) 2023-12-08T20:21:31.914 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$kr/zdSiqYNdSfo5E4dtiKO6uC3l7wL2053UF/8NNzoIGrViEoGgW.", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1702066891, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-12-08T20:21:31.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.946+0000 7fab6f3ed700 1 Processor -- start 2023-12-08T20:21:31.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.947+0000 7fab6f3ed700 1 -- start start 2023-12-08T20:21:31.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.947+0000 7fab6f3ed700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab681038f0 0x7fab68103d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:31.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.947+0000 7fab6f3ed700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab68104240 con 0x7fab681038f0 2023-12-08T20:21:31.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.947+0000 7fab6d189700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab681038f0 0x7fab68103d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:31.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.947+0000 7fab6d189700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab681038f0 0x7fab68103d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51100/0 (socket says 172.21.15.43:51100) 2023-12-08T20:21:31.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.947+0000 7fab6d189700 1 -- 172.21.15.43:0/2199774035 learned_addr learned my addr 172.21.15.43:0/2199774035 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:31.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.947+0000 7fab6d189700 1 -- 172.21.15.43:0/2199774035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab68104380 con 0x7fab681038f0 2023-12-08T20:21:31.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.947+0000 7fab6d189700 1 --2- 172.21.15.43:0/2199774035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab681038f0 0x7fab68103d00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fab640098e0 tx=0x7fab64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a947193fd07b85ae server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:31.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.948+0000 7fab5ffff700 1 -- 172.21.15.43:0/2199774035 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab6400b860 con 0x7fab681038f0 2023-12-08T20:21:31.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.948+0000 7fab5ffff700 1 -- 172.21.15.43:0/2199774035 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fab6400be70 con 0x7fab681038f0 2023-12-08T20:21:31.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.948+0000 7fab5ffff700 1 -- 172.21.15.43:0/2199774035 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab64010380 con 0x7fab681038f0 2023-12-08T20:21:31.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.948+0000 7fab6f3ed700 1 -- 172.21.15.43:0/2199774035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab681038f0 msgr2=0x7fab68103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:31.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.948+0000 7fab6f3ed700 1 --2- 172.21.15.43:0/2199774035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab681038f0 0x7fab68103d00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fab640098e0 tx=0x7fab64009250 comp rx=0 tx=0).stop 2023-12-08T20:21:31.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.948+0000 7fab6f3ed700 1 -- 172.21.15.43:0/2199774035 shutdown_connections 2023-12-08T20:21:31.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.948+0000 7fab6f3ed700 1 --2- 172.21.15.43:0/2199774035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab681038f0 0x7fab68103d00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:31.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.948+0000 7fab6f3ed700 1 -- 172.21.15.43:0/2199774035 >> 172.21.15.43:0/2199774035 conn(0x7fab680fc0b0 msgr2=0x7fab680fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:31.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.948+0000 7fab6f3ed700 1 -- 172.21.15.43:0/2199774035 shutdown_connections 2023-12-08T20:21:31.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.948+0000 7fab6f3ed700 1 -- 172.21.15.43:0/2199774035 wait complete. 2023-12-08T20:21:31.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.949+0000 7fab6f3ed700 1 Processor -- start 2023-12-08T20:21:31.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.949+0000 7fab6f3ed700 1 -- start start 2023-12-08T20:21:31.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.949+0000 7fab6f3ed700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab681038f0 0x7fab68103130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:31.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.949+0000 7fab6f3ed700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab681015b0 con 0x7fab681038f0 2023-12-08T20:21:31.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.949+0000 7fab6d189700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab681038f0 0x7fab68103130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:31.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.949+0000 7fab6d189700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab681038f0 0x7fab68103130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51104/0 (socket says 172.21.15.43:51104) 2023-12-08T20:21:31.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.949+0000 7fab6d189700 1 -- 172.21.15.43:0/4211715066 learned_addr learned my addr 172.21.15.43:0/4211715066 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:31.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.950+0000 7fab6d189700 1 -- 172.21.15.43:0/4211715066 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab640094f0 con 0x7fab681038f0 2023-12-08T20:21:31.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.950+0000 7fab6d189700 1 --2- 172.21.15.43:0/4211715066 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab681038f0 0x7fab68103130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fab6400c010 tx=0x7fab64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:31.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.950+0000 7fab5dffb700 1 -- 172.21.15.43:0/4211715066 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab64010960 con 0x7fab681038f0 2023-12-08T20:21:31.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.950+0000 7fab5dffb700 1 -- 172.21.15.43:0/4211715066 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fab6401a430 con 0x7fab681038f0 2023-12-08T20:21:31.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.950+0000 7fab6f3ed700 1 -- 172.21.15.43:0/4211715066 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab681017b0 con 0x7fab681038f0 2023-12-08T20:21:31.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.950+0000 7fab5dffb700 1 -- 172.21.15.43:0/4211715066 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab64019580 con 0x7fab681038f0 2023-12-08T20:21:31.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.950+0000 7fab6f3ed700 1 -- 172.21.15.43:0/4211715066 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab68101bc0 con 0x7fab681038f0 2023-12-08T20:21:31.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.951+0000 7fab5dffb700 1 -- 172.21.15.43:0/4211715066 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fab64019800 con 0x7fab681038f0 2023-12-08T20:21:31.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.951+0000 7fab6f3ed700 1 -- 172.21.15.43:0/4211715066 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6804bb80 con 0x7fab681038f0 2023-12-08T20:21:31.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.951+0000 7fab5dffb700 1 --2- 172.21.15.43:0/4211715066 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fab54036640 0x7fab54038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:31.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.951+0000 7fab5dffb700 1 -- 172.21.15.43:0/4211715066 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fab6404a780 con 0x7fab681038f0 2023-12-08T20:21:31.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.952+0000 7fab6c988700 1 --2- 172.21.15.43:0/4211715066 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fab54036640 0x7fab54038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:31.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.952+0000 7fab6c988700 1 --2- 172.21.15.43:0/4211715066 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fab54036640 0x7fab54038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fab58009990 tx=0x7fab58006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:31.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:30.956+0000 7fab5dffb700 1 -- 172.21.15.43:0/4211715066 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fab6402b950 con 0x7fab681038f0 2023-12-08T20:21:31.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:31.187+0000 7fab6f3ed700 1 -- 172.21.15.43:0/4211715066 --> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fab6805f090 con 0x7fab54036640 2023-12-08T20:21:31.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:31.441+0000 7fab5dffb700 1 -- 172.21.15.43:0/4211715066 <== mgr.14162 v2:172.21.15.43:6800/2315465125 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fab6805f090 con 0x7fab54036640 2023-12-08T20:21:31.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:31.443+0000 7fab6f3ed700 1 -- 172.21.15.43:0/4211715066 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fab54036640 msgr2=0x7fab54038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:31.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:31.443+0000 7fab6f3ed700 1 --2- 172.21.15.43:0/4211715066 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fab54036640 0x7fab54038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fab58009990 tx=0x7fab58006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:31.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:31.444+0000 7fab6f3ed700 1 -- 172.21.15.43:0/4211715066 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab681038f0 msgr2=0x7fab68103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:31.918 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:31.444+0000 7fab6f3ed700 1 --2- 172.21.15.43:0/4211715066 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab681038f0 0x7fab68103130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fab6400c010 tx=0x7fab64009250 comp rx=0 tx=0).stop 2023-12-08T20:21:31.918 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:31.444+0000 7fab6f3ed700 1 -- 172.21.15.43:0/4211715066 shutdown_connections 2023-12-08T20:21:31.918 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:31.444+0000 7fab6f3ed700 1 --2- 172.21.15.43:0/4211715066 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fab54036640 0x7fab54038af0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:31.918 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:31.444+0000 7fab6f3ed700 1 --2- 172.21.15.43:0/4211715066 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab681038f0 0x7fab68103130 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:31.918 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:31.444+0000 7fab6f3ed700 1 -- 172.21.15.43:0/4211715066 >> 172.21.15.43:0/4211715066 conn(0x7fab680fc0b0 msgr2=0x7fab680fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:31.918 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:31.444+0000 7fab6f3ed700 1 -- 172.21.15.43:0/4211715066 shutdown_connections 2023-12-08T20:21:31.918 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:31.444+0000 7fab6f3ed700 1 -- 172.21.15.43:0/4211715066 wait complete. 2023-12-08T20:21:31.918 INFO:teuthology.orchestra.run.smithi043.stdout:Fetching dashboard port number... 2023-12-08T20:21:32.724 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:32 smithi043 ceph-mon[111966]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:21:32.724 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:32 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:32.910 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 8443 2023-12-08T20:21:32.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.315+0000 7f0229f2c700 1 Processor -- start 2023-12-08T20:21:32.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.315+0000 7f0229f2c700 1 -- start start 2023-12-08T20:21:32.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.315+0000 7f0229f2c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0224102780 0x7f0224102b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:32.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.315+0000 7f0229f2c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02241030d0 con 0x7f0224102780 2023-12-08T20:21:32.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.315+0000 7f02237fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0224102780 0x7f0224102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:32.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.315+0000 7f02237fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0224102780 0x7f0224102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51118/0 (socket says 172.21.15.43:51118) 2023-12-08T20:21:32.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.315+0000 7f02237fe700 1 -- 172.21.15.43:0/3710366960 learned_addr learned my addr 172.21.15.43:0/3710366960 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:32.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.316+0000 7f02237fe700 1 -- 172.21.15.43:0/3710366960 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0224103210 con 0x7f0224102780 2023-12-08T20:21:32.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.316+0000 7f02237fe700 1 --2- 172.21.15.43:0/3710366960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0224102780 0x7f0224102b90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f021400bb80 tx=0x7f021400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d1d58462ee45ba server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:32.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.316+0000 7f02227fc700 1 -- 172.21.15.43:0/3710366960 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f021400dd00 con 0x7f0224102780 2023-12-08T20:21:32.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.316+0000 7f02227fc700 1 -- 172.21.15.43:0/3710366960 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f021400de60 con 0x7f0224102780 2023-12-08T20:21:32.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.316+0000 7f02227fc700 1 -- 172.21.15.43:0/3710366960 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02140188d0 con 0x7f0224102780 2023-12-08T20:21:32.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.316+0000 7f0229f2c700 1 -- 172.21.15.43:0/3710366960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0224102780 msgr2=0x7f0224102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:32.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.316+0000 7f0229f2c700 1 --2- 172.21.15.43:0/3710366960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0224102780 0x7f0224102b90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f021400bb80 tx=0x7f021400b4f0 comp rx=0 tx=0).stop 2023-12-08T20:21:32.913 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.317+0000 7f0229f2c700 1 -- 172.21.15.43:0/3710366960 shutdown_connections 2023-12-08T20:21:32.913 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.317+0000 7f0229f2c700 1 --2- 172.21.15.43:0/3710366960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0224102780 0x7f0224102b90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:32.913 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.317+0000 7f0229f2c700 1 -- 172.21.15.43:0/3710366960 >> 172.21.15.43:0/3710366960 conn(0x7f02240fc0b0 msgr2=0x7f02240fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:32.913 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.317+0000 7f0229f2c700 1 -- 172.21.15.43:0/3710366960 shutdown_connections 2023-12-08T20:21:32.913 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.317+0000 7f0229f2c700 1 -- 172.21.15.43:0/3710366960 wait complete. 2023-12-08T20:21:32.913 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.317+0000 7f0229f2c700 1 Processor -- start 2023-12-08T20:21:32.913 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.317+0000 7f0229f2c700 1 -- start start 2023-12-08T20:21:32.913 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.318+0000 7f0229f2c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0224102780 0x7f022410ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:32.914 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.318+0000 7f0229f2c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022410f490 con 0x7f0224102780 2023-12-08T20:21:32.914 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.318+0000 7f02237fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0224102780 0x7f022410ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:32.914 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.318+0000 7f02237fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0224102780 0x7f022410ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51130/0 (socket says 172.21.15.43:51130) 2023-12-08T20:21:32.914 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.318+0000 7f02237fe700 1 -- 172.21.15.43:0/2159917570 learned_addr learned my addr 172.21.15.43:0/2159917570 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:32.914 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.318+0000 7f02237fe700 1 -- 172.21.15.43:0/2159917570 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021400b790 con 0x7f0224102780 2023-12-08T20:21:32.914 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.318+0000 7f02237fe700 1 --2- 172.21.15.43:0/2159917570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0224102780 0x7f022410ef50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0214000c00 tx=0x7f021400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:32.914 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.318+0000 7f020bfff700 1 -- 172.21.15.43:0/2159917570 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0214010b50 con 0x7f0224102780 2023-12-08T20:21:32.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.318+0000 7f020bfff700 1 -- 172.21.15.43:0/2159917570 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f021401d050 con 0x7f0224102780 2023-12-08T20:21:32.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.318+0000 7f0229f2c700 1 -- 172.21.15.43:0/2159917570 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022410f690 con 0x7f0224102780 2023-12-08T20:21:32.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.318+0000 7f020bfff700 1 -- 172.21.15.43:0/2159917570 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02140223d0 con 0x7f0224102780 2023-12-08T20:21:32.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.318+0000 7f0229f2c700 1 -- 172.21.15.43:0/2159917570 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022410faa0 con 0x7f0224102780 2023-12-08T20:21:32.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.319+0000 7f020bfff700 1 -- 172.21.15.43:0/2159917570 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f0214010cb0 con 0x7f0224102780 2023-12-08T20:21:32.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.319+0000 7f0229f2c700 1 -- 172.21.15.43:0/2159917570 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022404bb80 con 0x7f0224102780 2023-12-08T20:21:32.915 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.320+0000 7f020bfff700 1 --2- 172.21.15.43:0/2159917570 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f020c036690 0x7f020c038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:32.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.320+0000 7f020bfff700 1 -- 172.21.15.43:0/2159917570 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0214014070 con 0x7f0224102780 2023-12-08T20:21:32.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.320+0000 7f0222ffd700 1 --2- 172.21.15.43:0/2159917570 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f020c036690 0x7f020c038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:32.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.320+0000 7f0222ffd700 1 --2- 172.21.15.43:0/2159917570 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f020c036690 0x7f020c038b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0218009990 tx=0x7f0218006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:32.916 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.324+0000 7f020bfff700 1 -- 172.21.15.43:0/2159917570 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0214023470 con 0x7f0224102780 2023-12-08T20:21:32.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.527+0000 7f0229f2c700 1 -- 172.21.15.43:0/2159917570 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f0224100ec0 con 0x7f0224102780 2023-12-08T20:21:32.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.527+0000 7f020bfff700 1 -- 172.21.15.43:0/2159917570 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f021400fb70 con 0x7f0224102780 2023-12-08T20:21:32.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.530+0000 7f0229f2c700 1 -- 172.21.15.43:0/2159917570 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f020c036690 msgr2=0x7f020c038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:32.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.530+0000 7f0229f2c700 1 --2- 172.21.15.43:0/2159917570 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f020c036690 0x7f020c038b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0218009990 tx=0x7f0218006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:32.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.530+0000 7f0229f2c700 1 -- 172.21.15.43:0/2159917570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0224102780 msgr2=0x7f022410ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:32.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.530+0000 7f0229f2c700 1 --2- 172.21.15.43:0/2159917570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0224102780 0x7f022410ef50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0214000c00 tx=0x7f021400b4f0 comp rx=0 tx=0).stop 2023-12-08T20:21:32.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.530+0000 7f0229f2c700 1 -- 172.21.15.43:0/2159917570 shutdown_connections 2023-12-08T20:21:32.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.530+0000 7f0229f2c700 1 --2- 172.21.15.43:0/2159917570 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f020c036690 0x7f020c038b40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:32.917 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.530+0000 7f0229f2c700 1 --2- 172.21.15.43:0/2159917570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0224102780 0x7f022410ef50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:32.918 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.530+0000 7f0229f2c700 1 -- 172.21.15.43:0/2159917570 >> 172.21.15.43:0/2159917570 conn(0x7f02240fc0b0 msgr2=0x7f0224105f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:32.918 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.530+0000 7f0229f2c700 1 -- 172.21.15.43:0/2159917570 shutdown_connections 2023-12-08T20:21:32.918 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:32.530+0000 7f0229f2c700 1 -- 172.21.15.43:0/2159917570 wait complete. 2023-12-08T20:21:32.919 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-08T20:21:32.919 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout disabled 2023-12-08T20:21:32.928 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-08T20:21:32.928 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2023-12-08T20:21:32.928 INFO:teuthology.orchestra.run.smithi043.stdout:firewalld.service is not enabled 2023-12-08T20:21:32.928 INFO:teuthology.orchestra.run.smithi043.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-12-08T20:21:32.931 INFO:teuthology.orchestra.run.smithi043.stdout:Ceph Dashboard is now available at: 2023-12-08T20:21:32.931 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:21:32.931 INFO:teuthology.orchestra.run.smithi043.stdout: URL: https://smithi043.front.sepia.ceph.com:8443/ 2023-12-08T20:21:32.931 INFO:teuthology.orchestra.run.smithi043.stdout: User: admin 2023-12-08T20:21:32.931 INFO:teuthology.orchestra.run.smithi043.stdout: Password: nqy213bcbo 2023-12-08T20:21:32.931 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:21:32.931 INFO:teuthology.orchestra.run.smithi043.stdout:Saving cluster configuration to /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config directory 2023-12-08T20:21:32.932 INFO:teuthology.orchestra.run.smithi043.stdout:Enabling autotune for osd_memory_target 2023-12-08T20:21:33.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:33 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/2159917570' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-12-08T20:21:33.855 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.283+0000 7fe72e54c700 1 Processor -- start 2023-12-08T20:21:33.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.283+0000 7fe72e54c700 1 -- start start 2023-12-08T20:21:33.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.283+0000 7fe72e54c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7281011c0 0x7fe7281015d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:33.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.283+0000 7fe72e54c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe728101b10 con 0x7fe7281011c0 2023-12-08T20:21:33.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.283+0000 7fe727fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7281011c0 0x7fe7281015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:33.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.283+0000 7fe727fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7281011c0 0x7fe7281015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51140/0 (socket says 172.21.15.43:51140) 2023-12-08T20:21:33.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.283+0000 7fe727fff700 1 -- 172.21.15.43:0/3458674000 learned_addr learned my addr 172.21.15.43:0/3458674000 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:33.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.283+0000 7fe727fff700 1 -- 172.21.15.43:0/3458674000 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe728101c50 con 0x7fe7281011c0 2023-12-08T20:21:33.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.283+0000 7fe727fff700 1 --2- 172.21.15.43:0/3458674000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7281011c0 0x7fe7281015d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe7180098e0 tx=0x7fe718009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bed44cc3ce8855 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:33.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.284+0000 7fe726ffd700 1 -- 172.21.15.43:0/3458674000 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe71800b860 con 0x7fe7281011c0 2023-12-08T20:21:33.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.284+0000 7fe726ffd700 1 -- 172.21.15.43:0/3458674000 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe71800be70 con 0x7fe7281011c0 2023-12-08T20:21:33.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.284+0000 7fe726ffd700 1 -- 172.21.15.43:0/3458674000 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe718010380 con 0x7fe7281011c0 2023-12-08T20:21:33.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.284+0000 7fe72e54c700 1 -- 172.21.15.43:0/3458674000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7281011c0 msgr2=0x7fe7281015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:33.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.284+0000 7fe72e54c700 1 --2- 172.21.15.43:0/3458674000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7281011c0 0x7fe7281015d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe7180098e0 tx=0x7fe718009250 comp rx=0 tx=0).stop 2023-12-08T20:21:33.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.284+0000 7fe72e54c700 1 -- 172.21.15.43:0/3458674000 shutdown_connections 2023-12-08T20:21:33.856 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.284+0000 7fe72e54c700 1 --2- 172.21.15.43:0/3458674000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7281011c0 0x7fe7281015d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:33.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.284+0000 7fe72e54c700 1 -- 172.21.15.43:0/3458674000 >> 172.21.15.43:0/3458674000 conn(0x7fe7280fc980 msgr2=0x7fe7280fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:33.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.284+0000 7fe72e54c700 1 -- 172.21.15.43:0/3458674000 shutdown_connections 2023-12-08T20:21:33.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.284+0000 7fe72e54c700 1 -- 172.21.15.43:0/3458674000 wait complete. 2023-12-08T20:21:33.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.285+0000 7fe72e54c700 1 Processor -- start 2023-12-08T20:21:33.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.285+0000 7fe72e54c700 1 -- start start 2023-12-08T20:21:33.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.285+0000 7fe72e54c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7281011c0 0x7fe728110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:33.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.285+0000 7fe72e54c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7281105c0 con 0x7fe7281011c0 2023-12-08T20:21:33.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.285+0000 7fe727fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7281011c0 0x7fe728110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:33.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.285+0000 7fe727fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7281011c0 0x7fe728110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51146/0 (socket says 172.21.15.43:51146) 2023-12-08T20:21:33.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.285+0000 7fe727fff700 1 -- 172.21.15.43:0/2357482656 learned_addr learned my addr 172.21.15.43:0/2357482656 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:33.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.286+0000 7fe727fff700 1 -- 172.21.15.43:0/2357482656 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7180094f0 con 0x7fe7281011c0 2023-12-08T20:21:33.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.286+0000 7fe727fff700 1 --2- 172.21.15.43:0/2357482656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7281011c0 0x7fe728110080 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe71800c010 tx=0x7fe718009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:33.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.286+0000 7fe724ff9700 1 -- 172.21.15.43:0/2357482656 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe718010960 con 0x7fe7281011c0 2023-12-08T20:21:33.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.286+0000 7fe724ff9700 1 -- 172.21.15.43:0/2357482656 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe71801a430 con 0x7fe7281011c0 2023-12-08T20:21:33.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.286+0000 7fe72e54c700 1 -- 172.21.15.43:0/2357482656 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7281107c0 con 0x7fe7281011c0 2023-12-08T20:21:33.857 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.286+0000 7fe724ff9700 1 -- 172.21.15.43:0/2357482656 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe718019580 con 0x7fe7281011c0 2023-12-08T20:21:33.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.286+0000 7fe72e54c700 1 -- 172.21.15.43:0/2357482656 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe728110bd0 con 0x7fe7281011c0 2023-12-08T20:21:33.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.287+0000 7fe724ff9700 1 -- 172.21.15.43:0/2357482656 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fe718010ac0 con 0x7fe7281011c0 2023-12-08T20:21:33.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.287+0000 7fe724ff9700 1 --2- 172.21.15.43:0/2357482656 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fe710036640 0x7fe710038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:33.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.287+0000 7fe72e54c700 1 -- 172.21.15.43:0/2357482656 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe72804bb80 con 0x7fe7281011c0 2023-12-08T20:21:33.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.287+0000 7fe724ff9700 1 -- 172.21.15.43:0/2357482656 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe71804a4d0 con 0x7fe7281011c0 2023-12-08T20:21:33.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.287+0000 7fe7277fe700 1 --2- 172.21.15.43:0/2357482656 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fe710036640 0x7fe710038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:33.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.288+0000 7fe7277fe700 1 --2- 172.21.15.43:0/2357482656 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fe710036640 0x7fe710038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009990 tx=0x7fe71c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:33.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.292+0000 7fe724ff9700 1 -- 172.21.15.43:0/2357482656 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe71802bab0 con 0x7fe7281011c0 2023-12-08T20:21:33.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.445+0000 7fe724ff9700 1 -- 172.21.15.43:0/2357482656 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fe71800fdc0 con 0x7fe7281011c0 2023-12-08T20:21:33.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.497+0000 7fe72e54c700 1 -- 172.21.15.43:0/2357482656 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fe728102fa0 con 0x7fe7281011c0 2023-12-08T20:21:33.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.498+0000 7fe724ff9700 1 -- 172.21.15.43:0/2357482656 <== mon.0 v2:172.21.15.43:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fe71802bc90 con 0x7fe7281011c0 2023-12-08T20:21:33.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.500+0000 7fe72e54c700 1 -- 172.21.15.43:0/2357482656 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fe710036640 msgr2=0x7fe710038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:33.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.500+0000 7fe72e54c700 1 --2- 172.21.15.43:0/2357482656 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fe710036640 0x7fe710038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009990 tx=0x7fe71c006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:33.858 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.500+0000 7fe72e54c700 1 -- 172.21.15.43:0/2357482656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7281011c0 msgr2=0x7fe728110080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:33.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.500+0000 7fe72e54c700 1 --2- 172.21.15.43:0/2357482656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7281011c0 0x7fe728110080 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe71800c010 tx=0x7fe718009250 comp rx=0 tx=0).stop 2023-12-08T20:21:33.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.500+0000 7fe72e54c700 1 -- 172.21.15.43:0/2357482656 shutdown_connections 2023-12-08T20:21:33.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.500+0000 7fe72e54c700 1 --2- 172.21.15.43:0/2357482656 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fe710036640 0x7fe710038af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:33.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.500+0000 7fe72e54c700 1 --2- 172.21.15.43:0/2357482656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7281011c0 0x7fe728110080 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:33.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.500+0000 7fe72e54c700 1 -- 172.21.15.43:0/2357482656 >> 172.21.15.43:0/2357482656 conn(0x7fe7280fc980 msgr2=0x7fe7280fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:33.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.500+0000 7fe72e54c700 1 -- 172.21.15.43:0/2357482656 shutdown_connections 2023-12-08T20:21:33.859 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:33.500+0000 7fe72e54c700 1 -- 172.21.15.43:0/2357482656 wait complete. 2023-12-08T20:21:34.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:34 smithi043 ceph-mon[111966]: mgrmap e13: smithi043.hqcdcm(active, since 6s) 2023-12-08T20:21:35.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.292+0000 7f66efa69700 1 Processor -- start 2023-12-08T20:21:35.001 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.293+0000 7f66efa69700 1 -- start start 2023-12-08T20:21:35.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.293+0000 7f66efa69700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66e8078ce0 0x7f66e80771f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:35.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.293+0000 7f66efa69700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e80790f0 con 0x7f66e8078ce0 2023-12-08T20:21:35.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.293+0000 7f66ed805700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66e8078ce0 0x7f66e80771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:35.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.293+0000 7f66ed805700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66e8078ce0 0x7f66e80771f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51148/0 (socket says 172.21.15.43:51148) 2023-12-08T20:21:35.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.293+0000 7f66ed805700 1 -- 172.21.15.43:0/3206085052 learned_addr learned my addr 172.21.15.43:0/3206085052 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:35.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.293+0000 7f66ed805700 1 -- 172.21.15.43:0/3206085052 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e8077730 con 0x7f66e8078ce0 2023-12-08T20:21:35.002 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.293+0000 7f66ed805700 1 --2- 172.21.15.43:0/3206085052 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66e8078ce0 0x7f66e80771f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f66e40098e0 tx=0x7f66e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d52fb5bf0d5456 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:35.003 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.294+0000 7f66ec803700 1 -- 172.21.15.43:0/3206085052 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66e400b860 con 0x7f66e8078ce0 2023-12-08T20:21:35.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.294+0000 7f66ec803700 1 -- 172.21.15.43:0/3206085052 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f66e400be70 con 0x7f66e8078ce0 2023-12-08T20:21:35.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.294+0000 7f66ec803700 1 -- 172.21.15.43:0/3206085052 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66e4010380 con 0x7f66e8078ce0 2023-12-08T20:21:35.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.294+0000 7f66efa69700 1 -- 172.21.15.43:0/3206085052 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66e8078ce0 msgr2=0x7f66e80771f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:35.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.294+0000 7f66efa69700 1 --2- 172.21.15.43:0/3206085052 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66e8078ce0 0x7f66e80771f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f66e40098e0 tx=0x7f66e4009250 comp rx=0 tx=0).stop 2023-12-08T20:21:35.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.294+0000 7f66efa69700 1 -- 172.21.15.43:0/3206085052 shutdown_connections 2023-12-08T20:21:35.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.294+0000 7f66efa69700 1 --2- 172.21.15.43:0/3206085052 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66e8078ce0 0x7f66e80771f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:35.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.294+0000 7f66efa69700 1 -- 172.21.15.43:0/3206085052 >> 172.21.15.43:0/3206085052 conn(0x7f66e80fda10 msgr2=0x7f66e80ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:35.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.294+0000 7f66efa69700 1 -- 172.21.15.43:0/3206085052 shutdown_connections 2023-12-08T20:21:35.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.294+0000 7f66efa69700 1 -- 172.21.15.43:0/3206085052 wait complete. 2023-12-08T20:21:35.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.295+0000 7f66efa69700 1 Processor -- start 2023-12-08T20:21:35.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.295+0000 7f66efa69700 1 -- start start 2023-12-08T20:21:35.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.295+0000 7f66efa69700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66e8078ce0 0x7f66e8113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:35.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.295+0000 7f66efa69700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e8113870 con 0x7f66e8078ce0 2023-12-08T20:21:35.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.295+0000 7f66ed805700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66e8078ce0 0x7f66e8113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:35.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.295+0000 7f66ed805700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66e8078ce0 0x7f66e8113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51164/0 (socket says 172.21.15.43:51164) 2023-12-08T20:21:35.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.295+0000 7f66ed805700 1 -- 172.21.15.43:0/932703466 learned_addr learned my addr 172.21.15.43:0/932703466 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:35.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.296+0000 7f66ed805700 1 -- 172.21.15.43:0/932703466 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e40094f0 con 0x7f66e8078ce0 2023-12-08T20:21:35.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.296+0000 7f66ed805700 1 --2- 172.21.15.43:0/932703466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66e8078ce0 0x7f66e8113330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f66e40094c0 tx=0x7f66e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:35.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.296+0000 7f66da7fc700 1 -- 172.21.15.43:0/932703466 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66e4010850 con 0x7f66e8078ce0 2023-12-08T20:21:35.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.296+0000 7f66da7fc700 1 -- 172.21.15.43:0/932703466 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f66e4010e60 con 0x7f66e8078ce0 2023-12-08T20:21:35.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.296+0000 7f66efa69700 1 -- 172.21.15.43:0/932703466 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e8113a70 con 0x7f66e8078ce0 2023-12-08T20:21:35.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.296+0000 7f66da7fc700 1 -- 172.21.15.43:0/932703466 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66e40243f0 con 0x7f66e8078ce0 2023-12-08T20:21:35.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.296+0000 7f66efa69700 1 -- 172.21.15.43:0/932703466 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e8113e80 con 0x7f66e8078ce0 2023-12-08T20:21:35.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.297+0000 7f66da7fc700 1 -- 172.21.15.43:0/932703466 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f66e4024660 con 0x7f66e8078ce0 2023-12-08T20:21:35.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.297+0000 7f66efa69700 1 -- 172.21.15.43:0/932703466 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e804bb80 con 0x7f66e8078ce0 2023-12-08T20:21:35.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.297+0000 7f66da7fc700 1 --2- 172.21.15.43:0/932703466 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f66d4036730 0x7f66d4038be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:35.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.297+0000 7f66da7fc700 1 -- 172.21.15.43:0/932703466 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f66e404a850 con 0x7f66e8078ce0 2023-12-08T20:21:35.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.297+0000 7f66ed004700 1 --2- 172.21.15.43:0/932703466 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f66d4036730 0x7f66d4038be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:35.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.298+0000 7f66ed004700 1 --2- 172.21.15.43:0/932703466 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f66d4036730 0x7f66d4038be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f66dc009990 tx=0x7f66dc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:35.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.302+0000 7f66da7fc700 1 -- 172.21.15.43:0/932703466 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f66e402e440 con 0x7f66e8078ce0 2023-12-08T20:21:35.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.621+0000 7f66efa69700 1 -- 172.21.15.43:0/932703466 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f66e8108520 con 0x7f66e8078ce0 2023-12-08T20:21:35.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.623+0000 7f66da7fc700 1 -- 172.21.15.43:0/932703466 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f66e40187c0 con 0x7f66e8078ce0 2023-12-08T20:21:35.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.625+0000 7f66efa69700 1 -- 172.21.15.43:0/932703466 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f66d4036730 msgr2=0x7f66d4038be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:35.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.625+0000 7f66efa69700 1 --2- 172.21.15.43:0/932703466 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f66d4036730 0x7f66d4038be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f66dc009990 tx=0x7f66dc006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:35.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.625+0000 7f66efa69700 1 -- 172.21.15.43:0/932703466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66e8078ce0 msgr2=0x7f66e8113330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:35.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.626+0000 7f66efa69700 1 --2- 172.21.15.43:0/932703466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66e8078ce0 0x7f66e8113330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f66e40094c0 tx=0x7f66e4009250 comp rx=0 tx=0).stop 2023-12-08T20:21:35.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.626+0000 7f66efa69700 1 -- 172.21.15.43:0/932703466 shutdown_connections 2023-12-08T20:21:35.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.626+0000 7f66efa69700 1 --2- 172.21.15.43:0/932703466 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f66d4036730 0x7f66d4038be0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:35.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.626+0000 7f66efa69700 1 --2- 172.21.15.43:0/932703466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66e8078ce0 0x7f66e8113330 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:35.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.626+0000 7f66efa69700 1 -- 172.21.15.43:0/932703466 >> 172.21.15.43:0/932703466 conn(0x7f66e80fda10 msgr2=0x7f66e80ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:35.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.626+0000 7f66efa69700 1 -- 172.21.15.43:0/932703466 shutdown_connections 2023-12-08T20:21:35.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2023-12-08T20:21:34.626+0000 7f66efa69700 1 -- 172.21.15.43:0/932703466 wait complete. 2023-12-08T20:21:35.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-12-08T20:21:35.010 INFO:teuthology.orchestra.run.smithi043.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-12-08T20:21:35.010 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:21:35.010 INFO:teuthology.orchestra.run.smithi043.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-12-08T20:21:35.010 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:21:35.010 INFO:teuthology.orchestra.run.smithi043.stdout:Or, if you are only running a single cluster on this host: 2023-12-08T20:21:35.010 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:21:35.010 INFO:teuthology.orchestra.run.smithi043.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-12-08T20:21:35.010 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:21:35.010 INFO:teuthology.orchestra.run.smithi043.stdout:Please consider enabling telemetry to help improve Ceph: 2023-12-08T20:21:35.011 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:21:35.011 INFO:teuthology.orchestra.run.smithi043.stdout: ceph telemetry on 2023-12-08T20:21:35.011 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:21:35.011 INFO:teuthology.orchestra.run.smithi043.stdout:For more information see: 2023-12-08T20:21:35.011 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:21:35.011 INFO:teuthology.orchestra.run.smithi043.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2023-12-08T20:21:35.011 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:21:35.011 INFO:teuthology.orchestra.run.smithi043.stdout:Bootstrap complete. 2023-12-08T20:21:35.049 INFO:tasks.cephadm:Fetching config... 2023-12-08T20:21:35.049 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-12-08T20:21:35.049 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-12-08T20:21:35.075 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-12-08T20:21:35.076 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-12-08T20:21:35.076 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-12-08T20:21:35.143 INFO:tasks.cephadm:Fetching mon keyring... 2023-12-08T20:21:35.143 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-12-08T20:21:35.143 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/keyring of=/dev/stdout 2023-12-08T20:21:35.222 INFO:tasks.cephadm:Fetching pub ssh key... 2023-12-08T20:21:35.222 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-12-08T20:21:35.222 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-12-08T20:21:35.284 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-12-08T20:21:35.284 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4bVW6YCZf5u0V+C1p4sua3YFCoDBoUwLmB6JuWJlu8TcZp6Bdz21ZvKMEE0St5OBbkt5zagqVgieLMQ3r/ddTENTooOQcbSaun71sLlTnbWHPrPFhvWkINDAbU+vusPzqS9DATpt6/vAap/aSsFPtLx7gHNAQJW2spcyDTQKjjd+9E4wkTn/4+TJFpsQcBck60aX1ACFNq13h72tKzZSAoHVXTr9hCbyeVBNuQzUGbbP1Si7IMiGjneiRpWWEt3rZGgYM3eo3IKIe5vh0xsGDiy1VT8qm0UWqBK9BtXJ9nVBeOC4x4FblGJ2lYAUmmJ6IzJfp5rwWTLjqK7a5PRODRVHm7/1sBkZ0IQVvujH2B37mW7n7GTo3oLRoM2qlxYs3OErTU607eRssT+la3HAg4Iz9q7wWN5YavCy20s9xstkTNMZ6Yzmh8IGL4fNPAyupsKXNIRKqLuFtWXBgoW/BKZcxXH3+br36oBFCqPbWxpFwYrZWYppyBm4/U0V4CSk= ceph-28476818-9607-11ee-95a3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-08T20:21:35.369 INFO:teuthology.orchestra.run.smithi043.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4bVW6YCZf5u0V+C1p4sua3YFCoDBoUwLmB6JuWJlu8TcZp6Bdz21ZvKMEE0St5OBbkt5zagqVgieLMQ3r/ddTENTooOQcbSaun71sLlTnbWHPrPFhvWkINDAbU+vusPzqS9DATpt6/vAap/aSsFPtLx7gHNAQJW2spcyDTQKjjd+9E4wkTn/4+TJFpsQcBck60aX1ACFNq13h72tKzZSAoHVXTr9hCbyeVBNuQzUGbbP1Si7IMiGjneiRpWWEt3rZGgYM3eo3IKIe5vh0xsGDiy1VT8qm0UWqBK9BtXJ9nVBeOC4x4FblGJ2lYAUmmJ6IzJfp5rwWTLjqK7a5PRODRVHm7/1sBkZ0IQVvujH2B37mW7n7GTo3oLRoM2qlxYs3OErTU607eRssT+la3HAg4Iz9q7wWN5YavCy20s9xstkTNMZ6Yzmh8IGL4fNPAyupsKXNIRKqLuFtWXBgoW/BKZcxXH3+br36oBFCqPbWxpFwYrZWYppyBm4/U0V4CSk= ceph-28476818-9607-11ee-95a3-87774f69a715 2023-12-08T20:21:35.383 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4bVW6YCZf5u0V+C1p4sua3YFCoDBoUwLmB6JuWJlu8TcZp6Bdz21ZvKMEE0St5OBbkt5zagqVgieLMQ3r/ddTENTooOQcbSaun71sLlTnbWHPrPFhvWkINDAbU+vusPzqS9DATpt6/vAap/aSsFPtLx7gHNAQJW2spcyDTQKjjd+9E4wkTn/4+TJFpsQcBck60aX1ACFNq13h72tKzZSAoHVXTr9hCbyeVBNuQzUGbbP1Si7IMiGjneiRpWWEt3rZGgYM3eo3IKIe5vh0xsGDiy1VT8qm0UWqBK9BtXJ9nVBeOC4x4FblGJ2lYAUmmJ6IzJfp5rwWTLjqK7a5PRODRVHm7/1sBkZ0IQVvujH2B37mW7n7GTo3oLRoM2qlxYs3OErTU607eRssT+la3HAg4Iz9q7wWN5YavCy20s9xstkTNMZ6Yzmh8IGL4fNPAyupsKXNIRKqLuFtWXBgoW/BKZcxXH3+br36oBFCqPbWxpFwYrZWYppyBm4/U0V4CSk= ceph-28476818-9607-11ee-95a3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-08T20:21:35.429 INFO:teuthology.orchestra.run.smithi111.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4bVW6YCZf5u0V+C1p4sua3YFCoDBoUwLmB6JuWJlu8TcZp6Bdz21ZvKMEE0St5OBbkt5zagqVgieLMQ3r/ddTENTooOQcbSaun71sLlTnbWHPrPFhvWkINDAbU+vusPzqS9DATpt6/vAap/aSsFPtLx7gHNAQJW2spcyDTQKjjd+9E4wkTn/4+TJFpsQcBck60aX1ACFNq13h72tKzZSAoHVXTr9hCbyeVBNuQzUGbbP1Si7IMiGjneiRpWWEt3rZGgYM3eo3IKIe5vh0xsGDiy1VT8qm0UWqBK9BtXJ9nVBeOC4x4FblGJ2lYAUmmJ6IzJfp5rwWTLjqK7a5PRODRVHm7/1sBkZ0IQVvujH2B37mW7n7GTo3oLRoM2qlxYs3OErTU607eRssT+la3HAg4Iz9q7wWN5YavCy20s9xstkTNMZ6Yzmh8IGL4fNPAyupsKXNIRKqLuFtWXBgoW/BKZcxXH3+br36oBFCqPbWxpFwYrZWYppyBm4/U0V4CSk= ceph-28476818-9607-11ee-95a3-87774f69a715 2023-12-08T20:21:35.441 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-12-08T20:21:35.734 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:21:35.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:35 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/932703466' entity='client.admin' 2023-12-08T20:21:37.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.110+0000 7f363f1ed700 1 -- 172.21.15.43:0/2379102068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3638066410 msgr2=0x7f36381018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:37.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.110+0000 7f363f1ed700 1 --2- 172.21.15.43:0/2379102068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3638066410 0x7f36381018d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f36280048c0 tx=0x7f3628009e30 comp rx=0 tx=0).stop 2023-12-08T20:21:37.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.110+0000 7f363f1ed700 1 -- 172.21.15.43:0/2379102068 shutdown_connections 2023-12-08T20:21:37.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.110+0000 7f363f1ed700 1 --2- 172.21.15.43:0/2379102068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3638066410 0x7f36381018d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:37.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.110+0000 7f363f1ed700 1 -- 172.21.15.43:0/2379102068 >> 172.21.15.43:0/2379102068 conn(0x7f36380f6ec0 msgr2=0x7f36380f92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:37.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.110+0000 7f363f1ed700 1 -- 172.21.15.43:0/2379102068 shutdown_connections 2023-12-08T20:21:37.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.110+0000 7f363f1ed700 1 -- 172.21.15.43:0/2379102068 wait complete. 2023-12-08T20:21:37.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.110+0000 7f363f1ed700 1 Processor -- start 2023-12-08T20:21:37.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.110+0000 7f363f1ed700 1 -- start start 2023-12-08T20:21:37.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.111+0000 7f363f1ed700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3638066410 0x7f363810ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:37.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.111+0000 7f363f1ed700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363810f280 con 0x7f3638066410 2023-12-08T20:21:37.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.111+0000 7f363cf89700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3638066410 0x7f363810ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:37.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.111+0000 7f363cf89700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3638066410 0x7f363810ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51196/0 (socket says 172.21.15.43:51196) 2023-12-08T20:21:37.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.111+0000 7f363cf89700 1 -- 172.21.15.43:0/150230717 learned_addr learned my addr 172.21.15.43:0/150230717 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:37.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.111+0000 7f363cf89700 1 -- 172.21.15.43:0/150230717 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3628005040 con 0x7f3638066410 2023-12-08T20:21:37.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.111+0000 7f363cf89700 1 --2- 172.21.15.43:0/150230717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3638066410 0x7f363810ed40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f362800b690 tx=0x7f3628009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:37.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.112+0000 7f36357fa700 1 -- 172.21.15.43:0/150230717 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3628009650 con 0x7f3638066410 2023-12-08T20:21:37.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.112+0000 7f36357fa700 1 -- 172.21.15.43:0/150230717 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f36280097b0 con 0x7f3638066410 2023-12-08T20:21:37.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.112+0000 7f363f1ed700 1 -- 172.21.15.43:0/150230717 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363810f480 con 0x7f3638066410 2023-12-08T20:21:37.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.112+0000 7f36357fa700 1 -- 172.21.15.43:0/150230717 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f362801c5d0 con 0x7f3638066410 2023-12-08T20:21:37.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.112+0000 7f363f1ed700 1 -- 172.21.15.43:0/150230717 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363810ffe0 con 0x7f3638066410 2023-12-08T20:21:37.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.113+0000 7f36357fa700 1 -- 172.21.15.43:0/150230717 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f362801c840 con 0x7f3638066410 2023-12-08T20:21:37.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.113+0000 7f36357fa700 1 --2- 172.21.15.43:0/150230717 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f36200366d0 0x7f3620038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:37.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.113+0000 7f36357fa700 1 -- 172.21.15.43:0/150230717 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3628049a40 con 0x7f3638066410 2023-12-08T20:21:37.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.113+0000 7f363f1ed700 1 -- 172.21.15.43:0/150230717 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363804bb80 con 0x7f3638066410 2023-12-08T20:21:37.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.113+0000 7f3637fff700 1 --2- 172.21.15.43:0/150230717 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f36200366d0 0x7f3620038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:37.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.113+0000 7f3637fff700 1 --2- 172.21.15.43:0/150230717 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f36200366d0 0x7f3620038b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f362c009990 tx=0x7f362c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:37.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.118+0000 7f36357fa700 1 -- 172.21.15.43:0/150230717 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3628023300 con 0x7f3638066410 2023-12-08T20:21:37.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.335+0000 7f363f1ed700 1 -- 172.21.15.43:0/150230717 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f3638110ad0 con 0x7f3638066410 2023-12-08T20:21:37.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.338+0000 7f36357fa700 1 -- 172.21.15.43:0/150230717 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f3628011b60 con 0x7f3638066410 2023-12-08T20:21:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.341+0000 7f363f1ed700 1 -- 172.21.15.43:0/150230717 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f36200366d0 msgr2=0x7f3620038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.341+0000 7f363f1ed700 1 --2- 172.21.15.43:0/150230717 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f36200366d0 0x7f3620038b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f362c009990 tx=0x7f362c006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.341+0000 7f363f1ed700 1 -- 172.21.15.43:0/150230717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3638066410 msgr2=0x7f363810ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.341+0000 7f363f1ed700 1 --2- 172.21.15.43:0/150230717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3638066410 0x7f363810ed40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f362800b690 tx=0x7f3628009e30 comp rx=0 tx=0).stop 2023-12-08T20:21:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.341+0000 7f363f1ed700 1 -- 172.21.15.43:0/150230717 shutdown_connections 2023-12-08T20:21:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.341+0000 7f363f1ed700 1 --2- 172.21.15.43:0/150230717 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f36200366d0 0x7f3620038b80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.341+0000 7f363f1ed700 1 --2- 172.21.15.43:0/150230717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3638066410 0x7f363810ed40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.341+0000 7f363f1ed700 1 -- 172.21.15.43:0/150230717 >> 172.21.15.43:0/150230717 conn(0x7f36380f6ec0 msgr2=0x7f36380f7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.341+0000 7f363f1ed700 1 -- 172.21.15.43:0/150230717 shutdown_connections 2023-12-08T20:21:37.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:37.341+0000 7f363f1ed700 1 -- 172.21.15.43:0/150230717 wait complete. 2023-12-08T20:21:37.752 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-12-08T20:21:37.752 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-12-08T20:21:38.065 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:21:38.183 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:37 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:38.184 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:37 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:38.184 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:37 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd/host:smithi043", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:21:38.184 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:37 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:38.184 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:37 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi043", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-08T20:21:38.184 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:37 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi043", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-08T20:21:38.184 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:37 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:21:38.184 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:37 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/150230717' entity='client.admin' 2023-12-08T20:21:39.170 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:38 smithi043 ceph-mon[111966]: Deploying daemon crash.smithi043 on smithi043 2023-12-08T20:21:39.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.754+0000 7f7b46939700 1 -- 172.21.15.43:0/939622388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b400fd3c0 msgr2=0x7f7b400ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:39.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.754+0000 7f7b46939700 1 --2- 172.21.15.43:0/939622388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b400fd3c0 0x7f7b400ff7a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7b300048c0 tx=0x7f7b30009e30 comp rx=0 tx=0).stop 2023-12-08T20:21:39.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.754+0000 7f7b46939700 1 -- 172.21.15.43:0/939622388 shutdown_connections 2023-12-08T20:21:39.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.754+0000 7f7b46939700 1 --2- 172.21.15.43:0/939622388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b400fd3c0 0x7f7b400ff7a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:39.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.754+0000 7f7b46939700 1 -- 172.21.15.43:0/939622388 >> 172.21.15.43:0/939622388 conn(0x7f7b400f6e40 msgr2=0x7f7b400f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:39.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.754+0000 7f7b46939700 1 -- 172.21.15.43:0/939622388 shutdown_connections 2023-12-08T20:21:39.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.754+0000 7f7b46939700 1 -- 172.21.15.43:0/939622388 wait complete. 2023-12-08T20:21:39.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.755+0000 7f7b46939700 1 Processor -- start 2023-12-08T20:21:39.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.755+0000 7f7b46939700 1 -- start start 2023-12-08T20:21:39.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.755+0000 7f7b46939700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b400fd3c0 0x7f7b4010ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:39.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.755+0000 7f7b46939700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4010cf80 con 0x7f7b400fd3c0 2023-12-08T20:21:39.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.755+0000 7f7b3ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b400fd3c0 0x7f7b4010ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:39.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.755+0000 7f7b3ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b400fd3c0 0x7f7b4010ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51204/0 (socket says 172.21.15.43:51204) 2023-12-08T20:21:39.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.755+0000 7f7b3ffff700 1 -- 172.21.15.43:0/873261481 learned_addr learned my addr 172.21.15.43:0/873261481 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:39.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.756+0000 7f7b3ffff700 1 -- 172.21.15.43:0/873261481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b30005040 con 0x7f7b400fd3c0 2023-12-08T20:21:39.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.756+0000 7f7b3ffff700 1 --2- 172.21.15.43:0/873261481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b400fd3c0 0x7f7b4010ca40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009040 tx=0x7f7b30009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:39.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.756+0000 7f7b3cff9700 1 -- 172.21.15.43:0/873261481 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b30009620 con 0x7f7b400fd3c0 2023-12-08T20:21:39.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.756+0000 7f7b3cff9700 1 -- 172.21.15.43:0/873261481 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7b30009780 con 0x7f7b400fd3c0 2023-12-08T20:21:39.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.756+0000 7f7b46939700 1 -- 172.21.15.43:0/873261481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4010d180 con 0x7f7b400fd3c0 2023-12-08T20:21:39.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.756+0000 7f7b3cff9700 1 -- 172.21.15.43:0/873261481 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b3001c5b0 con 0x7f7b400fd3c0 2023-12-08T20:21:39.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.756+0000 7f7b46939700 1 -- 172.21.15.43:0/873261481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4010de20 con 0x7f7b400fd3c0 2023-12-08T20:21:39.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.757+0000 7f7b3cff9700 1 -- 172.21.15.43:0/873261481 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f7b3001c870 con 0x7f7b400fd3c0 2023-12-08T20:21:39.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.757+0000 7f7b46939700 1 -- 172.21.15.43:0/873261481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4005f270 con 0x7f7b400fd3c0 2023-12-08T20:21:39.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.757+0000 7f7b3cff9700 1 --2- 172.21.15.43:0/873261481 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f7b280366d0 0x7f7b28038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:39.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.758+0000 7f7b3cff9700 1 -- 172.21.15.43:0/873261481 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7b30049800 con 0x7f7b400fd3c0 2023-12-08T20:21:39.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.758+0000 7f7b3f7fe700 1 --2- 172.21.15.43:0/873261481 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f7b280366d0 0x7f7b28038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:39.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.758+0000 7f7b3f7fe700 1 --2- 172.21.15.43:0/873261481 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f7b280366d0 0x7f7b28038b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009990 tx=0x7f7b34006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:39.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.763+0000 7f7b3cff9700 1 -- 172.21.15.43:0/873261481 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7b30023300 con 0x7f7b400fd3c0 2023-12-08T20:21:39.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.983+0000 7f7b46939700 1 -- 172.21.15.43:0/873261481 --> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b4010ea00 con 0x7f7b280366d0 2023-12-08T20:21:39.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.987+0000 7f7b3cff9700 1 -- 172.21.15.43:0/873261481 <== mgr.14162 v2:172.21.15.43:6800/2315465125 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7b4010ea00 con 0x7f7b280366d0 2023-12-08T20:21:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.989+0000 7f7b46939700 1 -- 172.21.15.43:0/873261481 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f7b280366d0 msgr2=0x7f7b28038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.989+0000 7f7b46939700 1 --2- 172.21.15.43:0/873261481 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f7b280366d0 0x7f7b28038b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009990 tx=0x7f7b34006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.989+0000 7f7b46939700 1 -- 172.21.15.43:0/873261481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b400fd3c0 msgr2=0x7f7b4010ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.989+0000 7f7b46939700 1 --2- 172.21.15.43:0/873261481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b400fd3c0 0x7f7b4010ca40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009040 tx=0x7f7b30009e30 comp rx=0 tx=0).stop 2023-12-08T20:21:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.989+0000 7f7b46939700 1 -- 172.21.15.43:0/873261481 shutdown_connections 2023-12-08T20:21:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.989+0000 7f7b46939700 1 --2- 172.21.15.43:0/873261481 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f7b280366d0 0x7f7b28038b80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.989+0000 7f7b46939700 1 --2- 172.21.15.43:0/873261481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b400fd3c0 0x7f7b4010ca40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.989+0000 7f7b46939700 1 -- 172.21.15.43:0/873261481 >> 172.21.15.43:0/873261481 conn(0x7f7b400f6e40 msgr2=0x7f7b400f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:39.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.989+0000 7f7b46939700 1 -- 172.21.15.43:0/873261481 shutdown_connections 2023-12-08T20:21:39.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:39.989+0000 7f7b46939700 1 -- 172.21.15.43:0/873261481 wait complete. 2023-12-08T20:21:40.394 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi111 2023-12-08T20:21:40.395 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-12-08T20:21:40.395 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/etc/ceph/ceph.conf 2023-12-08T20:21:40.416 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-12-08T20:21:40.416 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-08T20:21:40.477 INFO:tasks.cephadm:Adding host smithi111 to orchestrator... 2023-12-08T20:21:40.478 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph orch host add smithi111 2023-12-08T20:21:40.810 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:21:41.127 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:40 smithi043 ceph-mon[111966]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:21:41.127 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:40 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:41.127 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:40 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:41.127 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:40 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:41.127 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:40 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:41.127 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:40 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:41.127 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:40 smithi043 ceph-mon[111966]: Deploying daemon node-exporter.smithi043 on smithi043 2023-12-08T20:21:41.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.923+0000 7f36956b3700 1 -- 172.21.15.43:0/2693385798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3690071b60 msgr2=0x7f369006ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:41.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.923+0000 7f36956b3700 1 --2- 172.21.15.43:0/2693385798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3690071b60 0x7f369006ffd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f36800048c0 tx=0x7f3680009e30 comp rx=0 tx=0).stop 2023-12-08T20:21:41.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.923+0000 7f36956b3700 1 -- 172.21.15.43:0/2693385798 shutdown_connections 2023-12-08T20:21:41.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.923+0000 7f36956b3700 1 --2- 172.21.15.43:0/2693385798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3690071b60 0x7f369006ffd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:41.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.923+0000 7f36956b3700 1 -- 172.21.15.43:0/2693385798 >> 172.21.15.43:0/2693385798 conn(0x7f36900f7f40 msgr2=0x7f36900fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:41.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.923+0000 7f36956b3700 1 -- 172.21.15.43:0/2693385798 shutdown_connections 2023-12-08T20:21:41.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.923+0000 7f36956b3700 1 -- 172.21.15.43:0/2693385798 wait complete. 2023-12-08T20:21:41.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.924+0000 7f36956b3700 1 Processor -- start 2023-12-08T20:21:41.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.924+0000 7f36956b3700 1 -- start start 2023-12-08T20:21:41.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.924+0000 7f36956b3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3690071b60 0x7f369010ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:41.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.924+0000 7f36956b3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369010f290 con 0x7f3690071b60 2023-12-08T20:21:41.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.924+0000 7f368effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3690071b60 0x7f369010ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:41.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.924+0000 7f368effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3690071b60 0x7f369010ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49516/0 (socket says 172.21.15.43:49516) 2023-12-08T20:21:41.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.924+0000 7f368effd700 1 -- 172.21.15.43:0/4084921407 learned_addr learned my addr 172.21.15.43:0/4084921407 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:41.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.925+0000 7f368effd700 1 -- 172.21.15.43:0/4084921407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3680005040 con 0x7f3690071b60 2023-12-08T20:21:41.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.925+0000 7f368effd700 1 --2- 172.21.15.43:0/4084921407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3690071b60 0x7f369010ed50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f368000b690 tx=0x7f3680009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:41.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.925+0000 7f36777fe700 1 -- 172.21.15.43:0/4084921407 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3680009650 con 0x7f3690071b60 2023-12-08T20:21:41.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.925+0000 7f36777fe700 1 -- 172.21.15.43:0/4084921407 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f36800097b0 con 0x7f3690071b60 2023-12-08T20:21:41.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.925+0000 7f36956b3700 1 -- 172.21.15.43:0/4084921407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369010f490 con 0x7f3690071b60 2023-12-08T20:21:41.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.925+0000 7f36777fe700 1 -- 172.21.15.43:0/4084921407 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f368001c5b0 con 0x7f3690071b60 2023-12-08T20:21:41.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.925+0000 7f36956b3700 1 -- 172.21.15.43:0/4084921407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369010fff0 con 0x7f3690071b60 2023-12-08T20:21:41.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.926+0000 7f36777fe700 1 -- 172.21.15.43:0/4084921407 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f368001c820 con 0x7f3690071b60 2023-12-08T20:21:41.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.926+0000 7f36777fe700 1 --2- 172.21.15.43:0/4084921407 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f3678036720 0x7f3678038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:41.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.926+0000 7f36777fe700 1 -- 172.21.15.43:0/4084921407 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f36800499d0 con 0x7f3690071b60 2023-12-08T20:21:41.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.926+0000 7f368e7fc700 1 --2- 172.21.15.43:0/4084921407 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f3678036720 0x7f3678038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:41.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.926+0000 7f36757fa700 1 -- 172.21.15.43:0/4084921407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36700052b0 con 0x7f3690071b60 2023-12-08T20:21:41.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.927+0000 7f368e7fc700 1 --2- 172.21.15.43:0/4084921407 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f3678036720 0x7f3678038bd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3684009990 tx=0x7f3684006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:41.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:41.933+0000 7f36777fe700 1 -- 172.21.15.43:0/4084921407 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3680023300 con 0x7f3690071b60 2023-12-08T20:21:42.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:42.142+0000 7f36757fa700 1 -- 172.21.15.43:0/4084921407 --> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi111", "target": ["mon-mgr", ""]}) v1 -- 0x7f3670000bc0 con 0x7f3678036720 2023-12-08T20:21:43.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:43 smithi043 ceph-mon[111966]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi111", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:21:43.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:43 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:43.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:43 smithi043 ceph-mon[111966]: Deploying cephadm binary to smithi111 2023-12-08T20:21:44.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:44.031+0000 7f36777fe700 1 -- 172.21.15.43:0/4084921407 <== mgr.14162 v2:172.21.15.43:6800/2315465125 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f3670000bc0 con 0x7f3678036720 2023-12-08T20:21:44.031 INFO:teuthology.orchestra.run.smithi043.stdout:Added host 'smithi111' with addr '172.21.15.111' 2023-12-08T20:21:44.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:44.034+0000 7f36757fa700 1 -- 172.21.15.43:0/4084921407 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f3678036720 msgr2=0x7f3678038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:44.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:44.034+0000 7f36757fa700 1 --2- 172.21.15.43:0/4084921407 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f3678036720 0x7f3678038bd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3684009990 tx=0x7f3684006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:44.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:44.034+0000 7f36757fa700 1 -- 172.21.15.43:0/4084921407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3690071b60 msgr2=0x7f369010ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:44.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:44.034+0000 7f36757fa700 1 --2- 172.21.15.43:0/4084921407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3690071b60 0x7f369010ed50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f368000b690 tx=0x7f3680009e30 comp rx=0 tx=0).stop 2023-12-08T20:21:44.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:44.034+0000 7f36757fa700 1 -- 172.21.15.43:0/4084921407 shutdown_connections 2023-12-08T20:21:44.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:44.034+0000 7f36757fa700 1 --2- 172.21.15.43:0/4084921407 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f3678036720 0x7f3678038bd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:44.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:44.034+0000 7f36757fa700 1 --2- 172.21.15.43:0/4084921407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3690071b60 0x7f369010ed50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:44.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:44.034+0000 7f36757fa700 1 -- 172.21.15.43:0/4084921407 >> 172.21.15.43:0/4084921407 conn(0x7f36900f7f40 msgr2=0x7f36900f8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:44.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:44.034+0000 7f36757fa700 1 -- 172.21.15.43:0/4084921407 shutdown_connections 2023-12-08T20:21:44.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:44.034+0000 7f36757fa700 1 -- 172.21.15.43:0/4084921407 wait complete. 2023-12-08T20:21:44.491 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph orch host ls --format=json 2023-12-08T20:21:44.791 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:21:45.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:45 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:45.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:45 smithi043 ceph-mon[111966]: Added host smithi111 2023-12-08T20:21:45.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:45 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:45.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:45 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:45.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:45 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:45.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:45 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:45.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:45 smithi043 ceph-mon[111966]: Deploying daemon alertmanager.smithi043 on smithi043 2023-12-08T20:21:47.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.419+0000 7f011fedb700 1 -- 172.21.15.43:0/129106239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01180fb780 msgr2=0x7f01180fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:47.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.419+0000 7f011fedb700 1 --2- 172.21.15.43:0/129106239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01180fb780 0x7f01180fbb90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f01140048c0 tx=0x7f0114009e30 comp rx=0 tx=0).stop 2023-12-08T20:21:47.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.419+0000 7f011fedb700 1 -- 172.21.15.43:0/129106239 shutdown_connections 2023-12-08T20:21:47.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.419+0000 7f011fedb700 1 --2- 172.21.15.43:0/129106239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01180fb780 0x7f01180fbb90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:47.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.419+0000 7f011fedb700 1 -- 172.21.15.43:0/129106239 >> 172.21.15.43:0/129106239 conn(0x7f01180f6e40 msgr2=0x7f01180f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:47.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.419+0000 7f011fedb700 1 -- 172.21.15.43:0/129106239 shutdown_connections 2023-12-08T20:21:47.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.419+0000 7f011fedb700 1 -- 172.21.15.43:0/129106239 wait complete. 2023-12-08T20:21:47.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.419+0000 7f011fedb700 1 Processor -- start 2023-12-08T20:21:47.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.419+0000 7f011fedb700 1 -- start start 2023-12-08T20:21:47.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.420+0000 7f011fedb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01180fb780 0x7f011810cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:47.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.420+0000 7f011fedb700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011810cff0 con 0x7f01180fb780 2023-12-08T20:21:47.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.420+0000 7f011dc77700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01180fb780 0x7f011810cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:47.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.420+0000 7f011dc77700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01180fb780 0x7f011810cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49540/0 (socket says 172.21.15.43:49540) 2023-12-08T20:21:47.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.420+0000 7f011dc77700 1 -- 172.21.15.43:0/1634086337 learned_addr learned my addr 172.21.15.43:0/1634086337 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:47.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.420+0000 7f011dc77700 1 -- 172.21.15.43:0/1634086337 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0114005040 con 0x7f01180fb780 2023-12-08T20:21:47.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.420+0000 7f011dc77700 1 --2- 172.21.15.43:0/1634086337 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01180fb780 0x7f011810cab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0114009330 tx=0x7f0114009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:47.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.420+0000 7f010e7fc700 1 -- 172.21.15.43:0/1634086337 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01140096b0 con 0x7f01180fb780 2023-12-08T20:21:47.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.420+0000 7f011fedb700 1 -- 172.21.15.43:0/1634086337 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011810d1f0 con 0x7f01180fb780 2023-12-08T20:21:47.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.420+0000 7f010e7fc700 1 -- 172.21.15.43:0/1634086337 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0114009810 con 0x7f01180fb780 2023-12-08T20:21:47.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.420+0000 7f010e7fc700 1 -- 172.21.15.43:0/1634086337 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f011401c5b0 con 0x7f01180fb780 2023-12-08T20:21:47.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.421+0000 7f011fedb700 1 -- 172.21.15.43:0/1634086337 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f011810de90 con 0x7f01180fb780 2023-12-08T20:21:47.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.421+0000 7f010e7fc700 1 -- 172.21.15.43:0/1634086337 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f0114013420 con 0x7f01180fb780 2023-12-08T20:21:47.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.421+0000 7f011fedb700 1 -- 172.21.15.43:0/1634086337 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f011805f270 con 0x7f01180fb780 2023-12-08T20:21:47.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.422+0000 7f010e7fc700 1 --2- 172.21.15.43:0/1634086337 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f0104036720 0x7f0104038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:47.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.422+0000 7f010e7fc700 1 -- 172.21.15.43:0/1634086337 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0114049a70 con 0x7f01180fb780 2023-12-08T20:21:47.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.422+0000 7f011d476700 1 --2- 172.21.15.43:0/1634086337 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f0104036720 0x7f0104038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:47.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.422+0000 7f011d476700 1 --2- 172.21.15.43:0/1634086337 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f0104036720 0x7f0104038bd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0108009990 tx=0x7f0108006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:47.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.427+0000 7f010e7fc700 1 -- 172.21.15.43:0/1634086337 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f01140119c0 con 0x7f01180fb780 2023-12-08T20:21:47.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.649+0000 7f011fedb700 1 -- 172.21.15.43:0/1634086337 --> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01180f8820 con 0x7f0104036720 2023-12-08T20:21:47.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.651+0000 7f010e7fc700 1 -- 172.21.15.43:0/1634086337 <== mgr.14162 v2:172.21.15.43:6800/2315465125 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f01180f8820 con 0x7f0104036720 2023-12-08T20:21:47.650 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:21:47.651 INFO:teuthology.orchestra.run.smithi043.stdout:[{"addr": "172.21.15.43", "hostname": "smithi043", "labels": [], "status": ""}, {"addr": "172.21.15.111", "hostname": "smithi111", "labels": [], "status": ""}] 2023-12-08T20:21:47.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.653+0000 7f011fedb700 1 -- 172.21.15.43:0/1634086337 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f0104036720 msgr2=0x7f0104038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:47.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.653+0000 7f011fedb700 1 --2- 172.21.15.43:0/1634086337 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f0104036720 0x7f0104038bd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0108009990 tx=0x7f0108006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:47.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.653+0000 7f011fedb700 1 -- 172.21.15.43:0/1634086337 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01180fb780 msgr2=0x7f011810cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:47.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.653+0000 7f011fedb700 1 --2- 172.21.15.43:0/1634086337 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01180fb780 0x7f011810cab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0114009330 tx=0x7f0114009e30 comp rx=0 tx=0).stop 2023-12-08T20:21:47.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.653+0000 7f011fedb700 1 -- 172.21.15.43:0/1634086337 shutdown_connections 2023-12-08T20:21:47.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.653+0000 7f011fedb700 1 --2- 172.21.15.43:0/1634086337 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f0104036720 0x7f0104038bd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:47.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.653+0000 7f011fedb700 1 --2- 172.21.15.43:0/1634086337 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01180fb780 0x7f011810cab0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:47.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.653+0000 7f011fedb700 1 -- 172.21.15.43:0/1634086337 >> 172.21.15.43:0/1634086337 conn(0x7f01180f6e40 msgr2=0x7f01180f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:47.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.653+0000 7f011fedb700 1 -- 172.21.15.43:0/1634086337 shutdown_connections 2023-12-08T20:21:47.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:47.653+0000 7f011fedb700 1 -- 172.21.15.43:0/1634086337 wait complete. 2023-12-08T20:21:48.422 INFO:tasks.cephadm:Setting crush tunables to default 2023-12-08T20:21:48.422 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph osd crush tunables default 2023-12-08T20:21:48.454 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:48 smithi043 ceph-mon[111966]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:21:48.454 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:48 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:48.454 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:48 smithi043 ceph-mon[111966]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-08T20:21:49.020 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:21:50.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.394+0000 7f6f58fac700 1 -- 172.21.15.43:0/208476188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f540fd3b0 msgr2=0x7f6f540ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:50.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.394+0000 7f6f58fac700 1 --2- 172.21.15.43:0/208476188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f540fd3b0 0x7f6f540ff790 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6f440048c0 tx=0x7f6f44009e30 comp rx=0 tx=0).stop 2023-12-08T20:21:50.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.394+0000 7f6f58fac700 1 -- 172.21.15.43:0/208476188 shutdown_connections 2023-12-08T20:21:50.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.394+0000 7f6f58fac700 1 --2- 172.21.15.43:0/208476188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f540fd3b0 0x7f6f540ff790 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:50.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.394+0000 7f6f58fac700 1 -- 172.21.15.43:0/208476188 >> 172.21.15.43:0/208476188 conn(0x7f6f540f6e50 msgr2=0x7f6f540f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:50.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.394+0000 7f6f58fac700 1 -- 172.21.15.43:0/208476188 shutdown_connections 2023-12-08T20:21:50.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.394+0000 7f6f58fac700 1 -- 172.21.15.43:0/208476188 wait complete. 2023-12-08T20:21:50.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.395+0000 7f6f58fac700 1 Processor -- start 2023-12-08T20:21:50.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.395+0000 7f6f58fac700 1 -- start start 2023-12-08T20:21:50.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.395+0000 7f6f58fac700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f540fd3b0 0x7f6f5410ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:50.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.395+0000 7f6f58fac700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5410cfd0 con 0x7f6f540fd3b0 2023-12-08T20:21:50.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.395+0000 7f6f5259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f540fd3b0 0x7f6f5410ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:50.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.395+0000 7f6f5259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f540fd3b0 0x7f6f5410ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49564/0 (socket says 172.21.15.43:49564) 2023-12-08T20:21:50.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.395+0000 7f6f5259c700 1 -- 172.21.15.43:0/4192048901 learned_addr learned my addr 172.21.15.43:0/4192048901 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:21:50.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.395+0000 7f6f5259c700 1 -- 172.21.15.43:0/4192048901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f44005040 con 0x7f6f540fd3b0 2023-12-08T20:21:50.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.396+0000 7f6f5259c700 1 --2- 172.21.15.43:0/4192048901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f540fd3b0 0x7f6f5410ca90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400b690 tx=0x7f6f44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:50.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.396+0000 7f6f42ffd700 1 -- 172.21.15.43:0/4192048901 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f44009650 con 0x7f6f540fd3b0 2023-12-08T20:21:50.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.396+0000 7f6f42ffd700 1 -- 172.21.15.43:0/4192048901 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6f440097b0 con 0x7f6f540fd3b0 2023-12-08T20:21:50.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.396+0000 7f6f58fac700 1 -- 172.21.15.43:0/4192048901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5410d1d0 con 0x7f6f540fd3b0 2023-12-08T20:21:50.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.396+0000 7f6f42ffd700 1 -- 172.21.15.43:0/4192048901 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f4401c5b0 con 0x7f6f540fd3b0 2023-12-08T20:21:50.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.396+0000 7f6f58fac700 1 -- 172.21.15.43:0/4192048901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5410de70 con 0x7f6f540fd3b0 2023-12-08T20:21:50.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.397+0000 7f6f42ffd700 1 -- 172.21.15.43:0/4192048901 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f6f4401c870 con 0x7f6f540fd3b0 2023-12-08T20:21:50.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.397+0000 7f6f58fac700 1 -- 172.21.15.43:0/4192048901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5405f270 con 0x7f6f540fd3b0 2023-12-08T20:21:50.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.397+0000 7f6f42ffd700 1 --2- 172.21.15.43:0/4192048901 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f6f3c0366d0 0x7f6f3c038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:50.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.397+0000 7f6f42ffd700 1 -- 172.21.15.43:0/4192048901 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6f44049880 con 0x7f6f540fd3b0 2023-12-08T20:21:50.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.397+0000 7f6f51d9b700 1 --2- 172.21.15.43:0/4192048901 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f6f3c0366d0 0x7f6f3c038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:50.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.398+0000 7f6f51d9b700 1 --2- 172.21.15.43:0/4192048901 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f6f3c0366d0 0x7f6f3c038b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009990 tx=0x7f6f48006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:50.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.403+0000 7f6f42ffd700 1 -- 172.21.15.43:0/4192048901 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6f44011db0 con 0x7f6f540fd3b0 2023-12-08T20:21:50.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:50.617+0000 7f6f58fac700 1 -- 172.21.15.43:0/4192048901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f6f5410e9c0 con 0x7f6f540fd3b0 2023-12-08T20:21:50.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:50 smithi043 ceph-mon[111966]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:21:51.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:51.590+0000 7f6f42ffd700 1 -- 172.21.15.43:0/4192048901 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6f44023990 con 0x7f6f540fd3b0 2023-12-08T20:21:51.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:51.593+0000 7f6f58fac700 1 -- 172.21.15.43:0/4192048901 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f6f3c0366d0 msgr2=0x7f6f3c038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:51.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:51.593+0000 7f6f58fac700 1 --2- 172.21.15.43:0/4192048901 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f6f3c0366d0 0x7f6f3c038b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009990 tx=0x7f6f48006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:51.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:51.593+0000 7f6f58fac700 1 -- 172.21.15.43:0/4192048901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f540fd3b0 msgr2=0x7f6f5410ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:51.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:51.593+0000 7f6f58fac700 1 --2- 172.21.15.43:0/4192048901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f540fd3b0 0x7f6f5410ca90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400b690 tx=0x7f6f44009e30 comp rx=0 tx=0).stop 2023-12-08T20:21:51.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:51.593+0000 7f6f58fac700 1 -- 172.21.15.43:0/4192048901 shutdown_connections 2023-12-08T20:21:51.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:51.593+0000 7f6f58fac700 1 --2- 172.21.15.43:0/4192048901 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f6f3c0366d0 0x7f6f3c038b80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:51.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:51.593+0000 7f6f58fac700 1 --2- 172.21.15.43:0/4192048901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f540fd3b0 0x7f6f5410ca90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:51.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:51.593+0000 7f6f58fac700 1 -- 172.21.15.43:0/4192048901 >> 172.21.15.43:0/4192048901 conn(0x7f6f540f6e50 msgr2=0x7f6f540f7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:51.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:51.593+0000 7f6f58fac700 1 -- 172.21.15.43:0/4192048901 shutdown_connections 2023-12-08T20:21:51.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:21:51.593+0000 7f6f58fac700 1 -- 172.21.15.43:0/4192048901 wait complete. 2023-12-08T20:21:51.594 INFO:teuthology.orchestra.run.smithi043.stderr:adjusted tunables profile to default 2023-12-08T20:21:51.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:51 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:51.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:51 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:51.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:51 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:51.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:51 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:51.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:51 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:51.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:51 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:51.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:51 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-08T20:21:51.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:51 smithi043 ceph-mon[111966]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-08T20:21:51.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:51 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:51.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:51 smithi043 ceph-mon[111966]: Deploying daemon grafana.smithi043 on smithi043 2023-12-08T20:21:51.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:51 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/4192048901' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-08T20:21:52.004 INFO:tasks.cephadm:Adding mon.smithi043 on smithi043 2023-12-08T20:21:52.004 INFO:tasks.cephadm:Adding mon.smithi111 on smithi111 2023-12-08T20:21:52.004 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph orch apply mon '2;smithi043:172.21.15.43=smithi043;smithi111:172.21.15.111=smithi111' 2023-12-08T20:21:52.292 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:21:52.349 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:21:52.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:52 smithi043 ceph-mon[111966]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:21:52.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:52 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/4192048901' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-08T20:21:52.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:52 smithi043 ceph-mon[111966]: osdmap e4: 0 total, 0 up, 0 in 2023-12-08T20:21:52.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:52 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:53.578 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.574+0000 7fe3bb227700 1 -- 172.21.15.111:0/690585561 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3b40fb780 msgr2=0x7fe3b40fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:53.579 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.574+0000 7fe3bb227700 1 --2- 172.21.15.111:0/690585561 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3b40fb780 0x7fe3b40fbb90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80048c0 tx=0x7fe3a8009e30 comp rx=0 tx=0).stop 2023-12-08T20:21:53.579 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.574+0000 7fe3bb227700 1 -- 172.21.15.111:0/690585561 shutdown_connections 2023-12-08T20:21:53.579 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.574+0000 7fe3bb227700 1 --2- 172.21.15.111:0/690585561 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3b40fb780 0x7fe3b40fbb90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:53.579 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.574+0000 7fe3bb227700 1 -- 172.21.15.111:0/690585561 >> 172.21.15.111:0/690585561 conn(0x7fe3b40f6e40 msgr2=0x7fe3b40f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:53.579 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.574+0000 7fe3bb227700 1 -- 172.21.15.111:0/690585561 shutdown_connections 2023-12-08T20:21:53.579 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.574+0000 7fe3bb227700 1 -- 172.21.15.111:0/690585561 wait complete. 2023-12-08T20:21:53.579 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.575+0000 7fe3bb227700 1 Processor -- start 2023-12-08T20:21:53.579 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.575+0000 7fe3bb227700 1 -- start start 2023-12-08T20:21:53.579 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.575+0000 7fe3bb227700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3b40fb780 0x7fe3b410cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:53.580 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.575+0000 7fe3bb227700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b410cff0 con 0x7fe3b40fb780 2023-12-08T20:21:53.580 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.575+0000 7fe3b8fc3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3b40fb780 0x7fe3b410cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:53.580 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.575+0000 7fe3b8fc3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3b40fb780 0x7fe3b410cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.111:35208/0 (socket says 172.21.15.111:35208) 2023-12-08T20:21:53.580 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.575+0000 7fe3b8fc3700 1 -- 172.21.15.111:0/3868331900 learned_addr learned my addr 172.21.15.111:0/3868331900 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-12-08T20:21:53.580 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.576+0000 7fe3b8fc3700 1 -- 172.21.15.111:0/3868331900 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a8005040 con 0x7fe3b40fb780 2023-12-08T20:21:53.580 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.576+0000 7fe3b8fc3700 1 --2- 172.21.15.111:0/3868331900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3b40fb780 0x7fe3b410cab0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8009330 tx=0x7fe3a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:53.580 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.576+0000 7fe3b17fa700 1 -- 172.21.15.111:0/3868331900 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe3a80096b0 con 0x7fe3b40fb780 2023-12-08T20:21:53.580 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.576+0000 7fe3bb227700 1 -- 172.21.15.111:0/3868331900 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b410d1f0 con 0x7fe3b40fb780 2023-12-08T20:21:53.580 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.576+0000 7fe3b17fa700 1 -- 172.21.15.111:0/3868331900 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe3a8009810 con 0x7fe3b40fb780 2023-12-08T20:21:53.580 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.576+0000 7fe3b17fa700 1 -- 172.21.15.111:0/3868331900 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe3a801c5b0 con 0x7fe3b40fb780 2023-12-08T20:21:53.580 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.576+0000 7fe3bb227700 1 -- 172.21.15.111:0/3868331900 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b410de90 con 0x7fe3b40fb780 2023-12-08T20:21:53.580 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.577+0000 7fe3b17fa700 1 -- 172.21.15.111:0/3868331900 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fe3a801c870 con 0x7fe3b40fb780 2023-12-08T20:21:53.580 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.577+0000 7fe3bb227700 1 -- 172.21.15.111:0/3868331900 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b405f270 con 0x7fe3b40fb780 2023-12-08T20:21:53.580 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.577+0000 7fe3b17fa700 1 --2- 172.21.15.111:0/3868331900 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fe3a403aae0 0x7fe3a403cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:53.580 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.577+0000 7fe3b17fa700 1 -- 172.21.15.111:0/3868331900 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe3a8049b30 con 0x7fe3b40fb780 2023-12-08T20:21:53.581 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.577+0000 7fe3b3fff700 1 --2- 172.21.15.111:0/3868331900 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fe3a403aae0 0x7fe3a403cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:53.581 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.578+0000 7fe3b3fff700 1 --2- 172.21.15.111:0/3868331900 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fe3a403aae0 0x7fe3a403cf90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009990 tx=0x7fe3a0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:53.583 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.583+0000 7fe3b17fa700 1 -- 172.21.15.111:0/3868331900 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe3a8011dd0 con 0x7fe3b40fb780 2023-12-08T20:21:53.779 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.778+0000 7fe3bb227700 1 -- 172.21.15.111:0/3868331900 --> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi043:172.21.15.43=smithi043;smithi111:172.21.15.111=smithi111", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3b40f88d0 con 0x7fe3a403aae0 2023-12-08T20:21:53.784 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.784+0000 7fe3b17fa700 1 -- 172.21.15.111:0/3868331900 <== mgr.14162 v2:172.21.15.43:6800/2315465125 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fe3b40f88d0 con 0x7fe3a403aae0 2023-12-08T20:21:53.785 INFO:teuthology.orchestra.run.smithi111.stdout:Scheduled mon update... 2023-12-08T20:21:53.787 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.787+0000 7fe3bb227700 1 -- 172.21.15.111:0/3868331900 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fe3a403aae0 msgr2=0x7fe3a403cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:53.787 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.787+0000 7fe3bb227700 1 --2- 172.21.15.111:0/3868331900 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fe3a403aae0 0x7fe3a403cf90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009990 tx=0x7fe3a0006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:53.787 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.787+0000 7fe3bb227700 1 -- 172.21.15.111:0/3868331900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3b40fb780 msgr2=0x7fe3b410cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:53.788 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.787+0000 7fe3bb227700 1 --2- 172.21.15.111:0/3868331900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3b40fb780 0x7fe3b410cab0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8009330 tx=0x7fe3a8009e30 comp rx=0 tx=0).stop 2023-12-08T20:21:53.788 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.787+0000 7fe3bb227700 1 -- 172.21.15.111:0/3868331900 shutdown_connections 2023-12-08T20:21:53.788 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.787+0000 7fe3bb227700 1 --2- 172.21.15.111:0/3868331900 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fe3a403aae0 0x7fe3a403cf90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:53.788 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.787+0000 7fe3bb227700 1 --2- 172.21.15.111:0/3868331900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3b40fb780 0x7fe3b410cab0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:53.788 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.787+0000 7fe3bb227700 1 -- 172.21.15.111:0/3868331900 >> 172.21.15.111:0/3868331900 conn(0x7fe3b40f6e40 msgr2=0x7fe3b40f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:53.788 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.787+0000 7fe3bb227700 1 -- 172.21.15.111:0/3868331900 shutdown_connections 2023-12-08T20:21:53.788 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:53.787+0000 7fe3bb227700 1 -- 172.21.15.111:0/3868331900 wait complete. 2023-12-08T20:21:54.194 DEBUG:teuthology.orchestra.run.smithi111:mon.smithi111> sudo journalctl -f -n 0 -u ceph-28476818-9607-11ee-95a3-87774f69a715@mon.smithi111.service 2023-12-08T20:21:54.196 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-08T20:21:54.196 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-08T20:21:54.226 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:-- Logs begin at Fri 2023-12-08 20:06:57 UTC. -- 2023-12-08T20:21:54.499 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:21:54.561 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:21:55.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:54 smithi043 ceph-mon[111966]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:21:55.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:54 smithi043 ceph-mon[111966]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi043:172.21.15.43=smithi043;smithi111:172.21.15.111=smithi111", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:21:55.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:54 smithi043 ceph-mon[111966]: Saving service mon spec with placement smithi043:172.21.15.43=smithi043;smithi111:172.21.15.111=smithi111;count:2 2023-12-08T20:21:55.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:54 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:21:55.508 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.507+0000 7f55125ec700 1 -- 172.21.15.111:0/2321362559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f550c0fb770 msgr2=0x7f550c0fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:55.508 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.507+0000 7f55125ec700 1 --2- 172.21.15.111:0/2321362559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f550c0fb770 0x7f550c0fbb80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f54fc0048c0 tx=0x7f54fc009e30 comp rx=0 tx=0).stop 2023-12-08T20:21:55.508 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.507+0000 7f55125ec700 1 -- 172.21.15.111:0/2321362559 shutdown_connections 2023-12-08T20:21:55.508 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.507+0000 7f55125ec700 1 --2- 172.21.15.111:0/2321362559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f550c0fb770 0x7f550c0fbb80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:55.508 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.507+0000 7f55125ec700 1 -- 172.21.15.111:0/2321362559 >> 172.21.15.111:0/2321362559 conn(0x7f550c0f6e50 msgr2=0x7f550c0f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:55.508 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.507+0000 7f55125ec700 1 -- 172.21.15.111:0/2321362559 shutdown_connections 2023-12-08T20:21:55.509 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.507+0000 7f55125ec700 1 -- 172.21.15.111:0/2321362559 wait complete. 2023-12-08T20:21:55.509 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.508+0000 7f55125ec700 1 Processor -- start 2023-12-08T20:21:55.510 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.508+0000 7f55125ec700 1 -- start start 2023-12-08T20:21:55.510 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.508+0000 7f55125ec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f550c0fb770 0x7f550c10f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:55.510 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.509+0000 7f55125ec700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0662c0 con 0x7f550c0fb770 2023-12-08T20:21:55.510 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.509+0000 7f550bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f550c0fb770 0x7f550c10f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:55.511 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.509+0000 7f550bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f550c0fb770 0x7f550c10f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.111:35228/0 (socket says 172.21.15.111:35228) 2023-12-08T20:21:55.511 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.509+0000 7f550bfff700 1 -- 172.21.15.111:0/3798101027 learned_addr learned my addr 172.21.15.111:0/3798101027 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-12-08T20:21:55.511 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.509+0000 7f550bfff700 1 -- 172.21.15.111:0/3798101027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc005040 con 0x7f550c0fb770 2023-12-08T20:21:55.511 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.509+0000 7f550bfff700 1 --2- 172.21.15.111:0/3798101027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f550c0fb770 0x7f550c10f780 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f54fc009330 tx=0x7f54fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:55.511 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.509+0000 7f5508ff9700 1 -- 172.21.15.111:0/3798101027 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54fc0096b0 con 0x7f550c0fb770 2023-12-08T20:21:55.511 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.509+0000 7f55125ec700 1 -- 172.21.15.111:0/3798101027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550c0664c0 con 0x7f550c0fb770 2023-12-08T20:21:55.511 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.509+0000 7f5508ff9700 1 -- 172.21.15.111:0/3798101027 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f54fc009810 con 0x7f550c0fb770 2023-12-08T20:21:55.511 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.509+0000 7f5508ff9700 1 -- 172.21.15.111:0/3798101027 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54fc01c5b0 con 0x7f550c0fb770 2023-12-08T20:21:55.511 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.509+0000 7f55125ec700 1 -- 172.21.15.111:0/3798101027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550c10ff00 con 0x7f550c0fb770 2023-12-08T20:21:55.511 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.510+0000 7f5508ff9700 1 -- 172.21.15.111:0/3798101027 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f54fc013420 con 0x7f550c0fb770 2023-12-08T20:21:55.511 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.510+0000 7f55125ec700 1 -- 172.21.15.111:0/3798101027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550c105400 con 0x7f550c0fb770 2023-12-08T20:21:55.511 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.510+0000 7f5508ff9700 1 --2- 172.21.15.111:0/3798101027 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f54f40366d0 0x7f54f4038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:55.511 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.510+0000 7f5508ff9700 1 -- 172.21.15.111:0/3798101027 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f54fc049ad0 con 0x7f550c0fb770 2023-12-08T20:21:55.512 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.511+0000 7f550b7fe700 1 --2- 172.21.15.111:0/3798101027 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f54f40366d0 0x7f54f4038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:55.512 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.511+0000 7f550b7fe700 1 --2- 172.21.15.111:0/3798101027 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f54f40366d0 0x7f54f4038b80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5500009990 tx=0x7f5500006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:55.516 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.516+0000 7f5508ff9700 1 -- 172.21.15.111:0/3798101027 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f54fc0119c0 con 0x7f550c0fb770 2023-12-08T20:21:55.771 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.770+0000 7f55125ec700 1 -- 172.21.15.111:0/3798101027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f550c04bb80 con 0x7f550c0fb770 2023-12-08T20:21:55.771 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.771+0000 7f5508ff9700 1 -- 172.21.15.111:0/3798101027 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f54fc011370 con 0x7f550c0fb770 2023-12-08T20:21:55.771 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:21:55.772 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":1,"fsid":"28476818-9607-11ee-95a3-87774f69a715","modified":"2023-12-08T20:20:29.604120Z","created":"2023-12-08T20:20:29.604120Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi043","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-08T20:21:55.774 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.773+0000 7f55125ec700 1 -- 172.21.15.111:0/3798101027 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f54f40366d0 msgr2=0x7f54f4038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:55.775 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.773+0000 7f55125ec700 1 --2- 172.21.15.111:0/3798101027 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f54f40366d0 0x7f54f4038b80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5500009990 tx=0x7f5500006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:55.775 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.773+0000 7f55125ec700 1 -- 172.21.15.111:0/3798101027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f550c0fb770 msgr2=0x7f550c10f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:55.775 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.773+0000 7f55125ec700 1 --2- 172.21.15.111:0/3798101027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f550c0fb770 0x7f550c10f780 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f54fc009330 tx=0x7f54fc009e30 comp rx=0 tx=0).stop 2023-12-08T20:21:55.775 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.773+0000 7f55125ec700 1 -- 172.21.15.111:0/3798101027 shutdown_connections 2023-12-08T20:21:55.775 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.773+0000 7f55125ec700 1 --2- 172.21.15.111:0/3798101027 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f54f40366d0 0x7f54f4038b80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:55.775 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.773+0000 7f55125ec700 1 --2- 172.21.15.111:0/3798101027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f550c0fb770 0x7f550c10f780 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:55.775 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.773+0000 7f55125ec700 1 -- 172.21.15.111:0/3798101027 >> 172.21.15.111:0/3798101027 conn(0x7f550c0f6e50 msgr2=0x7f550c0f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:55.776 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.773+0000 7f55125ec700 1 -- 172.21.15.111:0/3798101027 shutdown_connections 2023-12-08T20:21:55.776 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:55.773+0000 7f55125ec700 1 -- 172.21.15.111:0/3798101027 wait complete. 2023-12-08T20:21:55.776 INFO:teuthology.orchestra.run.smithi111.stderr:dumped monmap epoch 1 2023-12-08T20:21:56.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:56 smithi043 ceph-mon[111966]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:21:56.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:56 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/3798101027' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:21:57.147 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-08T20:21:57.147 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-08T20:21:57.428 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:21:57.489 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:21:58.434 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.433+0000 7fb1eed64700 1 -- 172.21.15.111:0/3787894916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1e80fb780 msgr2=0x7fb1e80fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:58.434 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.433+0000 7fb1eed64700 1 --2- 172.21.15.111:0/3787894916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1e80fb780 0x7fb1e80fbb90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0048c0 tx=0x7fb1dc009e30 comp rx=0 tx=0).stop 2023-12-08T20:21:58.434 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.433+0000 7fb1eed64700 1 -- 172.21.15.111:0/3787894916 shutdown_connections 2023-12-08T20:21:58.434 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.433+0000 7fb1eed64700 1 --2- 172.21.15.111:0/3787894916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1e80fb780 0x7fb1e80fbb90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:58.434 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.433+0000 7fb1eed64700 1 -- 172.21.15.111:0/3787894916 >> 172.21.15.111:0/3787894916 conn(0x7fb1e80f6e40 msgr2=0x7fb1e80f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:58.434 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.433+0000 7fb1eed64700 1 -- 172.21.15.111:0/3787894916 shutdown_connections 2023-12-08T20:21:58.434 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.433+0000 7fb1eed64700 1 -- 172.21.15.111:0/3787894916 wait complete. 2023-12-08T20:21:58.435 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.434+0000 7fb1eed64700 1 Processor -- start 2023-12-08T20:21:58.435 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.434+0000 7fb1eed64700 1 -- start start 2023-12-08T20:21:58.435 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.434+0000 7fb1eed64700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1e80fb780 0x7fb1e810f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:58.435 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.434+0000 7fb1eed64700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e8065a30 con 0x7fb1e80fb780 2023-12-08T20:21:58.436 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.434+0000 7fb1ecb00700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1e80fb780 0x7fb1e810f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:58.436 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.434+0000 7fb1ecb00700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1e80fb780 0x7fb1e810f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.111:37546/0 (socket says 172.21.15.111:37546) 2023-12-08T20:21:58.436 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.434+0000 7fb1ecb00700 1 -- 172.21.15.111:0/3055197153 learned_addr learned my addr 172.21.15.111:0/3055197153 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-12-08T20:21:58.436 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.435+0000 7fb1ecb00700 1 -- 172.21.15.111:0/3055197153 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1dc005040 con 0x7fb1e80fb780 2023-12-08T20:21:58.436 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.435+0000 7fb1ecb00700 1 --2- 172.21.15.111:0/3055197153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1e80fb780 0x7fb1e810f7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009330 tx=0x7fb1dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:58.436 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.435+0000 7fb1e57fa700 1 -- 172.21.15.111:0/3055197153 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1dc0096b0 con 0x7fb1e80fb780 2023-12-08T20:21:58.436 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.435+0000 7fb1eed64700 1 -- 172.21.15.111:0/3055197153 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e8065c30 con 0x7fb1e80fb780 2023-12-08T20:21:58.436 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.435+0000 7fb1e57fa700 1 -- 172.21.15.111:0/3055197153 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb1dc009810 con 0x7fb1e80fb780 2023-12-08T20:21:58.436 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.435+0000 7fb1e57fa700 1 -- 172.21.15.111:0/3055197153 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1dc01c5b0 con 0x7fb1e80fb780 2023-12-08T20:21:58.436 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.435+0000 7fb1eed64700 1 -- 172.21.15.111:0/3055197153 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e810ff20 con 0x7fb1e80fb780 2023-12-08T20:21:58.436 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.436+0000 7fb1e57fa700 1 -- 172.21.15.111:0/3055197153 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fb1dc01c870 con 0x7fb1e80fb780 2023-12-08T20:21:58.437 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.436+0000 7fb1eed64700 1 -- 172.21.15.111:0/3055197153 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e8105410 con 0x7fb1e80fb780 2023-12-08T20:21:58.437 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.436+0000 7fb1e57fa700 1 --2- 172.21.15.111:0/3055197153 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fb1d80366d0 0x7fb1d8038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:21:58.437 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.436+0000 7fb1e57fa700 1 -- 172.21.15.111:0/3055197153 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb1dc049ac0 con 0x7fb1e80fb780 2023-12-08T20:21:58.437 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.436+0000 7fb1e7fff700 1 --2- 172.21.15.111:0/3055197153 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fb1d80366d0 0x7fb1d8038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:21:58.437 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.437+0000 7fb1e7fff700 1 --2- 172.21.15.111:0/3055197153 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fb1d80366d0 0x7fb1d8038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4009990 tx=0x7fb1d4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:21:58.442 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.442+0000 7fb1e57fa700 1 -- 172.21.15.111:0/3055197153 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb1dc011db0 con 0x7fb1e80fb780 2023-12-08T20:21:58.693 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.692+0000 7fb1eed64700 1 -- 172.21.15.111:0/3055197153 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb1e804bb80 con 0x7fb1e80fb780 2023-12-08T20:21:58.693 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.693+0000 7fb1e57fa700 1 -- 172.21.15.111:0/3055197153 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fb1dc01b390 con 0x7fb1e80fb780 2023-12-08T20:21:58.693 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:21:58.693 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":1,"fsid":"28476818-9607-11ee-95a3-87774f69a715","modified":"2023-12-08T20:20:29.604120Z","created":"2023-12-08T20:20:29.604120Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi043","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-08T20:21:58.695 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.695+0000 7fb1eed64700 1 -- 172.21.15.111:0/3055197153 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fb1d80366d0 msgr2=0x7fb1d8038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:58.695 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.695+0000 7fb1eed64700 1 --2- 172.21.15.111:0/3055197153 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fb1d80366d0 0x7fb1d8038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4009990 tx=0x7fb1d4006e40 comp rx=0 tx=0).stop 2023-12-08T20:21:58.695 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.695+0000 7fb1eed64700 1 -- 172.21.15.111:0/3055197153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1e80fb780 msgr2=0x7fb1e810f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:21:58.695 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.695+0000 7fb1eed64700 1 --2- 172.21.15.111:0/3055197153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1e80fb780 0x7fb1e810f7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009330 tx=0x7fb1dc009e30 comp rx=0 tx=0).stop 2023-12-08T20:21:58.695 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.695+0000 7fb1eed64700 1 -- 172.21.15.111:0/3055197153 shutdown_connections 2023-12-08T20:21:58.695 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.695+0000 7fb1eed64700 1 --2- 172.21.15.111:0/3055197153 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fb1d80366d0 0x7fb1d8038b80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:58.696 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.695+0000 7fb1eed64700 1 --2- 172.21.15.111:0/3055197153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1e80fb780 0x7fb1e810f7a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:21:58.696 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.695+0000 7fb1eed64700 1 -- 172.21.15.111:0/3055197153 >> 172.21.15.111:0/3055197153 conn(0x7fb1e80f6e40 msgr2=0x7fb1e80f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:21:58.696 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.695+0000 7fb1eed64700 1 -- 172.21.15.111:0/3055197153 shutdown_connections 2023-12-08T20:21:58.696 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:21:58.695+0000 7fb1eed64700 1 -- 172.21.15.111:0/3055197153 wait complete. 2023-12-08T20:21:58.696 INFO:teuthology.orchestra.run.smithi111.stderr:dumped monmap epoch 1 2023-12-08T20:21:58.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:58 smithi043 ceph-mon[111966]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:21:59.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:21:59 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/3055197153' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:00.076 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-08T20:22:00.076 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-08T20:22:00.354 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:22:00.417 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:22:00.686 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:00 smithi043 ceph-mon[111966]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:01.339 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.338+0000 7f0401453700 1 -- 172.21.15.111:0/969777242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03fc066530 msgr2=0x7f03fc0ff440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:01.339 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.338+0000 7f0401453700 1 --2- 172.21.15.111:0/969777242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03fc066530 0x7f03fc0ff440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f03ec0048c0 tx=0x7f03ec009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:01.339 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.338+0000 7f0401453700 1 -- 172.21.15.111:0/969777242 shutdown_connections 2023-12-08T20:22:01.339 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.338+0000 7f0401453700 1 --2- 172.21.15.111:0/969777242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03fc066530 0x7f03fc0ff440 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:01.339 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.338+0000 7f0401453700 1 -- 172.21.15.111:0/969777242 >> 172.21.15.111:0/969777242 conn(0x7f03fc0f6e50 msgr2=0x7f03fc0f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:01.339 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.338+0000 7f0401453700 1 -- 172.21.15.111:0/969777242 shutdown_connections 2023-12-08T20:22:01.340 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.338+0000 7f0401453700 1 -- 172.21.15.111:0/969777242 wait complete. 2023-12-08T20:22:01.340 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.338+0000 7f0401453700 1 Processor -- start 2023-12-08T20:22:01.340 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.338+0000 7f0401453700 1 -- start start 2023-12-08T20:22:01.340 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.339+0000 7f0401453700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03fc066530 0x7f03fc10ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:01.340 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.339+0000 7f0401453700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc10cf90 con 0x7f03fc066530 2023-12-08T20:22:01.340 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.339+0000 7f03faffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03fc066530 0x7f03fc10ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:01.340 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.339+0000 7f03faffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03fc066530 0x7f03fc10ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.111:37572/0 (socket says 172.21.15.111:37572) 2023-12-08T20:22:01.340 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.339+0000 7f03faffd700 1 -- 172.21.15.111:0/4053611762 learned_addr learned my addr 172.21.15.111:0/4053611762 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-12-08T20:22:01.342 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.339+0000 7f03faffd700 1 -- 172.21.15.111:0/4053611762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec005040 con 0x7f03fc066530 2023-12-08T20:22:01.342 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.339+0000 7f03faffd700 1 --2- 172.21.15.111:0/4053611762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03fc066530 0x7f03fc10ca50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00b690 tx=0x7f03ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:01.342 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.339+0000 7f03f37fe700 1 -- 172.21.15.111:0/4053611762 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f03ec009650 con 0x7f03fc066530 2023-12-08T20:22:01.342 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.339+0000 7f0401453700 1 -- 172.21.15.111:0/4053611762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03fc10d190 con 0x7f03fc066530 2023-12-08T20:22:01.342 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.339+0000 7f03f37fe700 1 -- 172.21.15.111:0/4053611762 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f03ec0097b0 con 0x7f03fc066530 2023-12-08T20:22:01.342 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.340+0000 7f0401453700 1 -- 172.21.15.111:0/4053611762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03fc10de30 con 0x7f03fc066530 2023-12-08T20:22:01.342 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.340+0000 7f03f37fe700 1 -- 172.21.15.111:0/4053611762 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f03ec025560 con 0x7f03fc066530 2023-12-08T20:22:01.342 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.340+0000 7f03f37fe700 1 -- 172.21.15.111:0/4053611762 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f03ec013a60 con 0x7f03fc066530 2023-12-08T20:22:01.342 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.340+0000 7f0401453700 1 -- 172.21.15.111:0/4053611762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03fc05f270 con 0x7f03fc066530 2023-12-08T20:22:01.343 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.341+0000 7f03f37fe700 1 --2- 172.21.15.111:0/4053611762 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f03e80366d0 0x7f03e8038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:01.343 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.341+0000 7f03f37fe700 1 -- 172.21.15.111:0/4053611762 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f03ec0498f0 con 0x7f03fc066530 2023-12-08T20:22:01.343 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.341+0000 7f03fa7fc700 1 --2- 172.21.15.111:0/4053611762 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f03e80366d0 0x7f03e8038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:01.343 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.341+0000 7f03fa7fc700 1 --2- 172.21.15.111:0/4053611762 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f03e80366d0 0x7f03e8038b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009990 tx=0x7f03e4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:01.346 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.346+0000 7f03f37fe700 1 -- 172.21.15.111:0/4053611762 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f03ec011940 con 0x7f03fc066530 2023-12-08T20:22:01.599 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.599+0000 7f0401453700 1 -- 172.21.15.111:0/4053611762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f03fc10e980 con 0x7f03fc066530 2023-12-08T20:22:01.600 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.601+0000 7f03f37fe700 1 -- 172.21.15.111:0/4053611762 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f03ec011370 con 0x7f03fc066530 2023-12-08T20:22:01.600 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:22:01.601 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":1,"fsid":"28476818-9607-11ee-95a3-87774f69a715","modified":"2023-12-08T20:20:29.604120Z","created":"2023-12-08T20:20:29.604120Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi043","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-08T20:22:01.602 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.602+0000 7f0401453700 1 -- 172.21.15.111:0/4053611762 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f03e80366d0 msgr2=0x7f03e8038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:01.602 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.602+0000 7f0401453700 1 --2- 172.21.15.111:0/4053611762 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f03e80366d0 0x7f03e8038b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009990 tx=0x7f03e4006e40 comp rx=0 tx=0).stop 2023-12-08T20:22:01.603 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.602+0000 7f0401453700 1 -- 172.21.15.111:0/4053611762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03fc066530 msgr2=0x7f03fc10ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:01.603 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.602+0000 7f0401453700 1 --2- 172.21.15.111:0/4053611762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03fc066530 0x7f03fc10ca50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00b690 tx=0x7f03ec009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:01.603 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.602+0000 7f0401453700 1 -- 172.21.15.111:0/4053611762 shutdown_connections 2023-12-08T20:22:01.603 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.602+0000 7f0401453700 1 --2- 172.21.15.111:0/4053611762 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f03e80366d0 0x7f03e8038b80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:01.603 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.602+0000 7f0401453700 1 --2- 172.21.15.111:0/4053611762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03fc066530 0x7f03fc10ca50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:01.603 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.602+0000 7f0401453700 1 -- 172.21.15.111:0/4053611762 >> 172.21.15.111:0/4053611762 conn(0x7f03fc0f6e50 msgr2=0x7f03fc0f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:01.603 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.602+0000 7f0401453700 1 -- 172.21.15.111:0/4053611762 shutdown_connections 2023-12-08T20:22:01.603 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:01.602+0000 7f0401453700 1 -- 172.21.15.111:0/4053611762 wait complete. 2023-12-08T20:22:01.603 INFO:teuthology.orchestra.run.smithi111.stderr:dumped monmap epoch 1 2023-12-08T20:22:02.685 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:02 smithi043 ceph-mon[111966]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:02.685 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:02 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/4053611762' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:02.991 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-08T20:22:02.991 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-08T20:22:03.267 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:22:03.334 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:22:03.925 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:03 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:03.925 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:03 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:03.925 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:03 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:03.926 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:03 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:03.926 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:03 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:03.926 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:03 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:03.926 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:03 smithi043 ceph-mon[111966]: Deploying daemon prometheus.smithi043 on smithi043 2023-12-08T20:22:04.303 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.303+0000 7f03f8e0b700 1 -- 172.21.15.111:0/2832796485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03f40fd3b0 msgr2=0x7f03f40ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:04.304 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.303+0000 7f03f8e0b700 1 --2- 172.21.15.111:0/2832796485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03f40fd3b0 0x7f03f40ff790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f03e40048c0 tx=0x7f03e4009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:04.304 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.303+0000 7f03f8e0b700 1 -- 172.21.15.111:0/2832796485 shutdown_connections 2023-12-08T20:22:04.304 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.303+0000 7f03f8e0b700 1 --2- 172.21.15.111:0/2832796485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03f40fd3b0 0x7f03f40ff790 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:04.304 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.303+0000 7f03f8e0b700 1 -- 172.21.15.111:0/2832796485 >> 172.21.15.111:0/2832796485 conn(0x7f03f40f6e50 msgr2=0x7f03f40f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:04.304 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.303+0000 7f03f8e0b700 1 -- 172.21.15.111:0/2832796485 shutdown_connections 2023-12-08T20:22:04.304 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.303+0000 7f03f8e0b700 1 -- 172.21.15.111:0/2832796485 wait complete. 2023-12-08T20:22:04.304 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.303+0000 7f03f8e0b700 1 Processor -- start 2023-12-08T20:22:04.304 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.303+0000 7f03f8e0b700 1 -- start start 2023-12-08T20:22:04.304 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.304+0000 7f03f8e0b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03f40fd3b0 0x7f03f410ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:04.304 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.304+0000 7f03f8e0b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f410cfd0 con 0x7f03f40fd3b0 2023-12-08T20:22:04.306 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.304+0000 7f03f259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03f40fd3b0 0x7f03f410ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:04.306 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.304+0000 7f03f259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03f40fd3b0 0x7f03f410ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.111:37586/0 (socket says 172.21.15.111:37586) 2023-12-08T20:22:04.306 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.304+0000 7f03f259c700 1 -- 172.21.15.111:0/917625740 learned_addr learned my addr 172.21.15.111:0/917625740 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-12-08T20:22:04.307 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.304+0000 7f03f259c700 1 -- 172.21.15.111:0/917625740 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e4005040 con 0x7f03f40fd3b0 2023-12-08T20:22:04.307 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.304+0000 7f03f259c700 1 --2- 172.21.15.111:0/917625740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03f40fd3b0 0x7f03f410ca90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f03e400b690 tx=0x7f03e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:04.307 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.304+0000 7f03e2ffd700 1 -- 172.21.15.111:0/917625740 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f03e4009650 con 0x7f03f40fd3b0 2023-12-08T20:22:04.307 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.304+0000 7f03f8e0b700 1 -- 172.21.15.111:0/917625740 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f410d1d0 con 0x7f03f40fd3b0 2023-12-08T20:22:04.307 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.304+0000 7f03e2ffd700 1 -- 172.21.15.111:0/917625740 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f03e40097b0 con 0x7f03f40fd3b0 2023-12-08T20:22:04.307 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.305+0000 7f03e2ffd700 1 -- 172.21.15.111:0/917625740 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f03e401c5b0 con 0x7f03f40fd3b0 2023-12-08T20:22:04.307 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.305+0000 7f03f8e0b700 1 -- 172.21.15.111:0/917625740 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f410de70 con 0x7f03f40fd3b0 2023-12-08T20:22:04.307 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.305+0000 7f03f8e0b700 1 -- 172.21.15.111:0/917625740 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f405f270 con 0x7f03f40fd3b0 2023-12-08T20:22:04.307 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.306+0000 7f03e2ffd700 1 -- 172.21.15.111:0/917625740 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f03e4013a60 con 0x7f03f40fd3b0 2023-12-08T20:22:04.307 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.306+0000 7f03e2ffd700 1 --2- 172.21.15.111:0/917625740 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f03dc0366d0 0x7f03dc038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:04.307 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.306+0000 7f03e2ffd700 1 -- 172.21.15.111:0/917625740 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f03e4049850 con 0x7f03f40fd3b0 2023-12-08T20:22:04.307 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.306+0000 7f03f1d9b700 1 --2- 172.21.15.111:0/917625740 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f03dc0366d0 0x7f03dc038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:04.307 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.306+0000 7f03f1d9b700 1 --2- 172.21.15.111:0/917625740 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f03dc0366d0 0x7f03dc038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009990 tx=0x7f03e8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:04.311 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.312+0000 7f03e2ffd700 1 -- 172.21.15.111:0/917625740 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f03e4011550 con 0x7f03f40fd3b0 2023-12-08T20:22:04.562 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.561+0000 7f03f8e0b700 1 -- 172.21.15.111:0/917625740 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f03f410e9c0 con 0x7f03f40fd3b0 2023-12-08T20:22:04.562 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.562+0000 7f03e2ffd700 1 -- 172.21.15.111:0/917625740 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f03e4011370 con 0x7f03f40fd3b0 2023-12-08T20:22:04.562 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:22:04.562 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":1,"fsid":"28476818-9607-11ee-95a3-87774f69a715","modified":"2023-12-08T20:20:29.604120Z","created":"2023-12-08T20:20:29.604120Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi043","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-08T20:22:04.564 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.565+0000 7f03f8e0b700 1 -- 172.21.15.111:0/917625740 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f03dc0366d0 msgr2=0x7f03dc038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:04.564 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.565+0000 7f03f8e0b700 1 --2- 172.21.15.111:0/917625740 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f03dc0366d0 0x7f03dc038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009990 tx=0x7f03e8006e40 comp rx=0 tx=0).stop 2023-12-08T20:22:04.565 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.565+0000 7f03f8e0b700 1 -- 172.21.15.111:0/917625740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03f40fd3b0 msgr2=0x7f03f410ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:04.565 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.565+0000 7f03f8e0b700 1 --2- 172.21.15.111:0/917625740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03f40fd3b0 0x7f03f410ca90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f03e400b690 tx=0x7f03e4009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:04.565 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.565+0000 7f03f8e0b700 1 -- 172.21.15.111:0/917625740 shutdown_connections 2023-12-08T20:22:04.565 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.565+0000 7f03f8e0b700 1 --2- 172.21.15.111:0/917625740 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f03dc0366d0 0x7f03dc038b80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:04.565 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.565+0000 7f03f8e0b700 1 --2- 172.21.15.111:0/917625740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03f40fd3b0 0x7f03f410ca90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:04.565 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.565+0000 7f03f8e0b700 1 -- 172.21.15.111:0/917625740 >> 172.21.15.111:0/917625740 conn(0x7f03f40f6e50 msgr2=0x7f03f40f7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:04.565 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.565+0000 7f03f8e0b700 1 -- 172.21.15.111:0/917625740 shutdown_connections 2023-12-08T20:22:04.565 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:04.565+0000 7f03f8e0b700 1 -- 172.21.15.111:0/917625740 wait complete. 2023-12-08T20:22:04.565 INFO:teuthology.orchestra.run.smithi111.stderr:dumped monmap epoch 1 2023-12-08T20:22:05.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:04 smithi043 ceph-mon[111966]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:05.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:04 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/917625740' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:05.931 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-08T20:22:05.960 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-08T20:22:06.251 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:22:06.309 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:22:07.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:06 smithi043 ceph-mon[111966]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:07.225 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.225+0000 7fcdce3bf700 1 -- 172.21.15.111:0/2168619466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdc8065a40 msgr2=0x7fcdc80ff490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:07.225 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.225+0000 7fcdce3bf700 1 --2- 172.21.15.111:0/2168619466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdc8065a40 0x7fcdc80ff490 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcdb80048c0 tx=0x7fcdb8009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:07.225 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.225+0000 7fcdce3bf700 1 -- 172.21.15.111:0/2168619466 shutdown_connections 2023-12-08T20:22:07.225 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.225+0000 7fcdce3bf700 1 --2- 172.21.15.111:0/2168619466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdc8065a40 0x7fcdc80ff490 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:07.225 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.225+0000 7fcdce3bf700 1 -- 172.21.15.111:0/2168619466 >> 172.21.15.111:0/2168619466 conn(0x7fcdc80f6e40 msgr2=0x7fcdc80f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:07.226 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.225+0000 7fcdce3bf700 1 -- 172.21.15.111:0/2168619466 shutdown_connections 2023-12-08T20:22:07.226 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.225+0000 7fcdce3bf700 1 -- 172.21.15.111:0/2168619466 wait complete. 2023-12-08T20:22:07.226 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.225+0000 7fcdce3bf700 1 Processor -- start 2023-12-08T20:22:07.226 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.225+0000 7fcdce3bf700 1 -- start start 2023-12-08T20:22:07.226 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.226+0000 7fcdce3bf700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdc8065a40 0x7fcdc80fcf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:07.226 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.226+0000 7fcdce3bf700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80fb390 con 0x7fcdc8065a40 2023-12-08T20:22:07.226 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.226+0000 7fcdc7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdc8065a40 0x7fcdc80fcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:07.226 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.226+0000 7fcdc7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdc8065a40 0x7fcdc80fcf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.111:44692/0 (socket says 172.21.15.111:44692) 2023-12-08T20:22:07.226 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.226+0000 7fcdc7fff700 1 -- 172.21.15.111:0/645902801 learned_addr learned my addr 172.21.15.111:0/645902801 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-12-08T20:22:07.226 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.226+0000 7fcdc7fff700 1 -- 172.21.15.111:0/645902801 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb8005040 con 0x7fcdc8065a40 2023-12-08T20:22:07.227 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.226+0000 7fcdc7fff700 1 --2- 172.21.15.111:0/645902801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdc8065a40 0x7fcdc80fcf10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800b690 tx=0x7fcdb8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:07.228 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.227+0000 7fcdc4ff9700 1 -- 172.21.15.111:0/645902801 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcdb8009650 con 0x7fcdc8065a40 2023-12-08T20:22:07.228 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.227+0000 7fcdce3bf700 1 -- 172.21.15.111:0/645902801 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc80fb590 con 0x7fcdc8065a40 2023-12-08T20:22:07.228 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.227+0000 7fcdc4ff9700 1 -- 172.21.15.111:0/645902801 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcdb80097b0 con 0x7fcdc8065a40 2023-12-08T20:22:07.228 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.227+0000 7fcdc4ff9700 1 -- 172.21.15.111:0/645902801 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcdb801c5b0 con 0x7fcdc8065a40 2023-12-08T20:22:07.228 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.227+0000 7fcdce3bf700 1 -- 172.21.15.111:0/645902801 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc80fba80 con 0x7fcdc8065a40 2023-12-08T20:22:07.228 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.228+0000 7fcdc4ff9700 1 -- 172.21.15.111:0/645902801 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fcdb801c870 con 0x7fcdc8065a40 2023-12-08T20:22:07.228 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.228+0000 7fcdc4ff9700 1 --2- 172.21.15.111:0/645902801 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fcdb00366d0 0x7fcdb0038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:07.228 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.228+0000 7fcdc4ff9700 1 -- 172.21.15.111:0/645902801 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcdb80499b0 con 0x7fcdc8065a40 2023-12-08T20:22:07.228 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.228+0000 7fcdce3bf700 1 -- 172.21.15.111:0/645902801 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc8106510 con 0x7fcdc8065a40 2023-12-08T20:22:07.228 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.228+0000 7fcdc77fe700 1 --2- 172.21.15.111:0/645902801 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fcdb00366d0 0x7fcdb0038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:07.229 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.228+0000 7fcdc77fe700 1 --2- 172.21.15.111:0/645902801 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fcdb00366d0 0x7fcdb0038b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc009990 tx=0x7fcdbc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:07.232 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.233+0000 7fcdc4ff9700 1 -- 172.21.15.111:0/645902801 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcdb8011db0 con 0x7fcdc8065a40 2023-12-08T20:22:07.485 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.486+0000 7fcdce3bf700 1 -- 172.21.15.111:0/645902801 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcdc802b0e0 con 0x7fcdc8065a40 2023-12-08T20:22:07.486 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.487+0000 7fcdc4ff9700 1 -- 172.21.15.111:0/645902801 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fcdb8023990 con 0x7fcdc8065a40 2023-12-08T20:22:07.486 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:22:07.486 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":1,"fsid":"28476818-9607-11ee-95a3-87774f69a715","modified":"2023-12-08T20:20:29.604120Z","created":"2023-12-08T20:20:29.604120Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi043","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-08T20:22:07.488 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.488+0000 7fcdce3bf700 1 -- 172.21.15.111:0/645902801 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fcdb00366d0 msgr2=0x7fcdb0038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:07.488 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.488+0000 7fcdce3bf700 1 --2- 172.21.15.111:0/645902801 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fcdb00366d0 0x7fcdb0038b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc009990 tx=0x7fcdbc006e40 comp rx=0 tx=0).stop 2023-12-08T20:22:07.488 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.488+0000 7fcdce3bf700 1 -- 172.21.15.111:0/645902801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdc8065a40 msgr2=0x7fcdc80fcf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:07.488 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.488+0000 7fcdce3bf700 1 --2- 172.21.15.111:0/645902801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdc8065a40 0x7fcdc80fcf10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800b690 tx=0x7fcdb8009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:07.488 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.488+0000 7fcdce3bf700 1 -- 172.21.15.111:0/645902801 shutdown_connections 2023-12-08T20:22:07.488 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.488+0000 7fcdce3bf700 1 --2- 172.21.15.111:0/645902801 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7fcdb00366d0 0x7fcdb0038b80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:07.488 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.488+0000 7fcdce3bf700 1 --2- 172.21.15.111:0/645902801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdc8065a40 0x7fcdc80fcf10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:07.488 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.488+0000 7fcdce3bf700 1 -- 172.21.15.111:0/645902801 >> 172.21.15.111:0/645902801 conn(0x7fcdc80f6e40 msgr2=0x7fcdc80f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:07.488 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.489+0000 7fcdce3bf700 1 -- 172.21.15.111:0/645902801 shutdown_connections 2023-12-08T20:22:07.488 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:07.489+0000 7fcdce3bf700 1 -- 172.21.15.111:0/645902801 wait complete. 2023-12-08T20:22:07.489 INFO:teuthology.orchestra.run.smithi111.stderr:dumped monmap epoch 1 2023-12-08T20:22:08.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:08 smithi043 ceph-mon[111966]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:08.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:08 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:08.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:08 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/645902801' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:08.865 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-08T20:22:08.866 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-08T20:22:09.149 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:22:09.207 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:22:10.271 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.272+0000 7f21044f7700 1 -- 172.21.15.111:0/1016830422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20fc0fb780 msgr2=0x7f20fc0fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:10.272 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.272+0000 7f21044f7700 1 --2- 172.21.15.111:0/1016830422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20fc0fb780 0x7f20fc0fbb90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0048c0 tx=0x7f20ec009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:10.272 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.272+0000 7f21044f7700 1 -- 172.21.15.111:0/1016830422 shutdown_connections 2023-12-08T20:22:10.272 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.272+0000 7f21044f7700 1 --2- 172.21.15.111:0/1016830422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20fc0fb780 0x7f20fc0fbb90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:10.272 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.272+0000 7f21044f7700 1 -- 172.21.15.111:0/1016830422 >> 172.21.15.111:0/1016830422 conn(0x7f20fc0f6e40 msgr2=0x7f20fc0f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:10.272 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.272+0000 7f21044f7700 1 -- 172.21.15.111:0/1016830422 shutdown_connections 2023-12-08T20:22:10.272 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.272+0000 7f21044f7700 1 -- 172.21.15.111:0/1016830422 wait complete. 2023-12-08T20:22:10.273 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.273+0000 7f21044f7700 1 Processor -- start 2023-12-08T20:22:10.273 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.273+0000 7f21044f7700 1 -- start start 2023-12-08T20:22:10.273 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.273+0000 7f21044f7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20fc0fb780 0x7f20fc10b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:10.274 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.273+0000 7f21044f7700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc10bee0 con 0x7f20fc0fb780 2023-12-08T20:22:10.274 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.273+0000 7f2102293700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20fc0fb780 0x7f20fc10b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:10.274 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.273+0000 7f2102293700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20fc0fb780 0x7f20fc10b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.111:44708/0 (socket says 172.21.15.111:44708) 2023-12-08T20:22:10.274 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.273+0000 7f2102293700 1 -- 172.21.15.111:0/1884237120 learned_addr learned my addr 172.21.15.111:0/1884237120 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-12-08T20:22:10.274 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.274+0000 7f2102293700 1 -- 172.21.15.111:0/1884237120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec005040 con 0x7f20fc0fb780 2023-12-08T20:22:10.274 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.274+0000 7f2102293700 1 --2- 172.21.15.111:0/1884237120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20fc0fb780 0x7f20fc10b9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009680 tx=0x7f20ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:10.274 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.274+0000 7f20f2ffd700 1 -- 172.21.15.111:0/1884237120 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20ec004e60 con 0x7f20fc0fb780 2023-12-08T20:22:10.274 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.274+0000 7f21044f7700 1 -- 172.21.15.111:0/1884237120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20fc10c0e0 con 0x7f20fc0fb780 2023-12-08T20:22:10.274 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.274+0000 7f20f2ffd700 1 -- 172.21.15.111:0/1884237120 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f20ec00be50 con 0x7f20fc0fb780 2023-12-08T20:22:10.274 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.274+0000 7f20f2ffd700 1 -- 172.21.15.111:0/1884237120 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20ec01e6b0 con 0x7f20fc0fb780 2023-12-08T20:22:10.274 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.274+0000 7f21044f7700 1 -- 172.21.15.111:0/1884237120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20fc10cd80 con 0x7f20fc0fb780 2023-12-08T20:22:10.275 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.275+0000 7f21044f7700 1 -- 172.21.15.111:0/1884237120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20fc05f270 con 0x7f20fc0fb780 2023-12-08T20:22:10.275 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.275+0000 7f20f2ffd700 1 -- 172.21.15.111:0/1884237120 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f20ec013630 con 0x7f20fc0fb780 2023-12-08T20:22:10.275 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.275+0000 7f20f2ffd700 1 --2- 172.21.15.111:0/1884237120 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f20e80366d0 0x7f20e8038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:10.275 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.275+0000 7f20f2ffd700 1 -- 172.21.15.111:0/1884237120 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f20ec04c4e0 con 0x7f20fc0fb780 2023-12-08T20:22:10.275 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.275+0000 7f2101a92700 1 --2- 172.21.15.111:0/1884237120 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f20e80366d0 0x7f20e8038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:10.275 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.276+0000 7f2101a92700 1 --2- 172.21.15.111:0/1884237120 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f20e80366d0 0x7f20e8038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009990 tx=0x7f20f8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:10.279 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.280+0000 7f20f2ffd700 1 -- 172.21.15.111:0/1884237120 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f20ec0119c0 con 0x7f20fc0fb780 2023-12-08T20:22:10.534 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.534+0000 7f21044f7700 1 -- 172.21.15.111:0/1884237120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f20fc04bb80 con 0x7f20fc0fb780 2023-12-08T20:22:10.534 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.535+0000 7f20f2ffd700 1 -- 172.21.15.111:0/1884237120 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f20ec02ee60 con 0x7f20fc0fb780 2023-12-08T20:22:10.534 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:22:10.534 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":1,"fsid":"28476818-9607-11ee-95a3-87774f69a715","modified":"2023-12-08T20:20:29.604120Z","created":"2023-12-08T20:20:29.604120Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi043","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-08T20:22:10.536 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.536+0000 7f21044f7700 1 -- 172.21.15.111:0/1884237120 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f20e80366d0 msgr2=0x7f20e8038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:10.536 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.536+0000 7f21044f7700 1 --2- 172.21.15.111:0/1884237120 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f20e80366d0 0x7f20e8038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009990 tx=0x7f20f8006e40 comp rx=0 tx=0).stop 2023-12-08T20:22:10.536 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.536+0000 7f21044f7700 1 -- 172.21.15.111:0/1884237120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20fc0fb780 msgr2=0x7f20fc10b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:10.536 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.536+0000 7f21044f7700 1 --2- 172.21.15.111:0/1884237120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20fc0fb780 0x7f20fc10b9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009680 tx=0x7f20ec009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:10.536 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.537+0000 7f21044f7700 1 -- 172.21.15.111:0/1884237120 shutdown_connections 2023-12-08T20:22:10.536 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.537+0000 7f21044f7700 1 --2- 172.21.15.111:0/1884237120 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f20e80366d0 0x7f20e8038b80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:10.537 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.537+0000 7f21044f7700 1 --2- 172.21.15.111:0/1884237120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20fc0fb780 0x7f20fc10b9a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:10.537 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.537+0000 7f21044f7700 1 -- 172.21.15.111:0/1884237120 >> 172.21.15.111:0/1884237120 conn(0x7f20fc0f6e40 msgr2=0x7f20fc0f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:10.537 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.537+0000 7f21044f7700 1 -- 172.21.15.111:0/1884237120 shutdown_connections 2023-12-08T20:22:10.537 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:10.537+0000 7f21044f7700 1 -- 172.21.15.111:0/1884237120 wait complete. 2023-12-08T20:22:10.537 INFO:teuthology.orchestra.run.smithi111.stderr:dumped monmap epoch 1 2023-12-08T20:22:10.743 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:10 smithi043 ceph-mon[111966]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:11.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:11 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/1884237120' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:11.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:11 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:11.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:11 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:11.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:11 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:11.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:11 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-08T20:22:11.913 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-08T20:22:11.913 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-08T20:22:12.207 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:22:12.264 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:22:12.689 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:12 smithi043 ceph-mon[111966]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:12.689 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:12 smithi043 ceph-mon[111966]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-08T20:22:12.689 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:12 smithi043 ceph-mon[111966]: mgrmap e14: smithi043.hqcdcm(active, since 44s) 2023-12-08T20:22:13.256 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.256+0000 7f9859bc5700 1 -- 172.21.15.111:0/1731372294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98540fb780 msgr2=0x7f98540fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:13.256 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.256+0000 7f9859bc5700 1 --2- 172.21.15.111:0/1731372294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98540fb780 0x7f98540fbb90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f98440048c0 tx=0x7f9844009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:13.257 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.257+0000 7f9859bc5700 1 -- 172.21.15.111:0/1731372294 shutdown_connections 2023-12-08T20:22:13.257 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.257+0000 7f9859bc5700 1 --2- 172.21.15.111:0/1731372294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98540fb780 0x7f98540fbb90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:13.257 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.257+0000 7f9859bc5700 1 -- 172.21.15.111:0/1731372294 >> 172.21.15.111:0/1731372294 conn(0x7f98540f6e40 msgr2=0x7f98540f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:13.257 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.257+0000 7f9859bc5700 1 -- 172.21.15.111:0/1731372294 shutdown_connections 2023-12-08T20:22:13.257 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.257+0000 7f9859bc5700 1 -- 172.21.15.111:0/1731372294 wait complete. 2023-12-08T20:22:13.257 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.257+0000 7f9859bc5700 1 Processor -- start 2023-12-08T20:22:13.257 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.257+0000 7f9859bc5700 1 -- start start 2023-12-08T20:22:13.257 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.257+0000 7f9859bc5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98540fb780 0x7f985410f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:13.257 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.257+0000 7f9859bc5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9854065a10 con 0x7f98540fb780 2023-12-08T20:22:13.259 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.258+0000 7f98537fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98540fb780 0x7f985410f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:13.259 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.258+0000 7f98537fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98540fb780 0x7f985410f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.111:44722/0 (socket says 172.21.15.111:44722) 2023-12-08T20:22:13.259 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.258+0000 7f98537fe700 1 -- 172.21.15.111:0/3823826195 learned_addr learned my addr 172.21.15.111:0/3823826195 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-12-08T20:22:13.259 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.258+0000 7f98537fe700 1 -- 172.21.15.111:0/3823826195 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9844005040 con 0x7f98540fb780 2023-12-08T20:22:13.259 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.258+0000 7f98537fe700 1 --2- 172.21.15.111:0/3823826195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98540fb780 0x7f985410f7c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9844009330 tx=0x7f9844009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:13.259 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.258+0000 7f983bfff700 1 -- 172.21.15.111:0/3823826195 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98440096b0 con 0x7f98540fb780 2023-12-08T20:22:13.259 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.258+0000 7f983bfff700 1 -- 172.21.15.111:0/3823826195 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9844009810 con 0x7f98540fb780 2023-12-08T20:22:13.259 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.258+0000 7f983bfff700 1 -- 172.21.15.111:0/3823826195 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f984401c5b0 con 0x7f98540fb780 2023-12-08T20:22:13.259 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.258+0000 7f9859bc5700 1 -- 172.21.15.111:0/3823826195 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9854065c10 con 0x7f98540fb780 2023-12-08T20:22:13.259 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.258+0000 7f9859bc5700 1 -- 172.21.15.111:0/3823826195 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985410ff40 con 0x7f98540fb780 2023-12-08T20:22:13.259 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.259+0000 7f983bfff700 1 -- 172.21.15.111:0/3823826195 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7f9844013420 con 0x7f98540fb780 2023-12-08T20:22:13.259 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.259+0000 7f9859bc5700 1 -- 172.21.15.111:0/3823826195 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9854105410 con 0x7f98540fb780 2023-12-08T20:22:13.259 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.259+0000 7f983bfff700 1 --2- 172.21.15.111:0/3823826195 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f983c036720 0x7f983c038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:13.260 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.259+0000 7f983bfff700 1 -- 172.21.15.111:0/3823826195 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9844049aa0 con 0x7f98540fb780 2023-12-08T20:22:13.260 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.259+0000 7f9852ffd700 1 -- 172.21.15.111:0/3823826195 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f983c036720 msgr2=0x7f983c038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2315465125 2023-12-08T20:22:13.260 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.259+0000 7f9852ffd700 1 --2- 172.21.15.111:0/3823826195 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f983c036720 0x7f983c038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:22:13.263 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.264+0000 7f983bfff700 1 -- 172.21.15.111:0/3823826195 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f98440119c0 con 0x7f98540fb780 2023-12-08T20:22:13.459 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.460+0000 7f9852ffd700 1 -- 172.21.15.111:0/3823826195 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f983c036720 msgr2=0x7f983c038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2315465125 2023-12-08T20:22:13.459 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.460+0000 7f9852ffd700 1 --2- 172.21.15.111:0/3823826195 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f983c036720 0x7f983c038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T20:22:13.518 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.518+0000 7f9859bc5700 1 -- 172.21.15.111:0/3823826195 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9854101400 con 0x7f98540fb780 2023-12-08T20:22:13.518 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.518+0000 7f983bfff700 1 -- 172.21.15.111:0/3823826195 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f9844011370 con 0x7f98540fb780 2023-12-08T20:22:13.519 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:22:13.519 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":1,"fsid":"28476818-9607-11ee-95a3-87774f69a715","modified":"2023-12-08T20:20:29.604120Z","created":"2023-12-08T20:20:29.604120Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi043","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-08T20:22:13.519 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.520+0000 7f9859bc5700 1 -- 172.21.15.111:0/3823826195 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f983c036720 msgr2=0x7f983c038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-08T20:22:13.519 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.520+0000 7f9859bc5700 1 --2- 172.21.15.111:0/3823826195 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f983c036720 0x7f983c038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:13.520 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.520+0000 7f9859bc5700 1 -- 172.21.15.111:0/3823826195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98540fb780 msgr2=0x7f985410f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:13.520 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.520+0000 7f9859bc5700 1 --2- 172.21.15.111:0/3823826195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98540fb780 0x7f985410f7c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9844009330 tx=0x7f9844009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:13.520 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.520+0000 7f9859bc5700 1 -- 172.21.15.111:0/3823826195 shutdown_connections 2023-12-08T20:22:13.520 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.520+0000 7f9859bc5700 1 --2- 172.21.15.111:0/3823826195 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f983c036720 0x7f983c038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:13.520 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.520+0000 7f9859bc5700 1 --2- 172.21.15.111:0/3823826195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98540fb780 0x7f985410f7c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:13.520 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.520+0000 7f9859bc5700 1 -- 172.21.15.111:0/3823826195 >> 172.21.15.111:0/3823826195 conn(0x7f98540f6e40 msgr2=0x7f98540f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:13.520 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.520+0000 7f9859bc5700 1 -- 172.21.15.111:0/3823826195 shutdown_connections 2023-12-08T20:22:13.520 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:13.520+0000 7f9859bc5700 1 -- 172.21.15.111:0/3823826195 wait complete. 2023-12-08T20:22:13.520 INFO:teuthology.orchestra.run.smithi111.stderr:dumped monmap epoch 1 2023-12-08T20:22:13.920 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:13 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/3823826195' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:14.907 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-08T20:22:14.907 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-08T20:22:15.182 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:22:15.236 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:22:16.179 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.175+0000 7f60c3eef700 1 -- 172.21.15.111:0/386038261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60bc0fb700 msgr2=0x7f60bc0fbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:16.179 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.175+0000 7f60c3eef700 1 --2- 172.21.15.111:0/386038261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60bc0fb700 0x7f60bc0fbb10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0048c0 tx=0x7f60ac009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:16.179 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.175+0000 7f60c3eef700 1 -- 172.21.15.111:0/386038261 shutdown_connections 2023-12-08T20:22:16.179 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.175+0000 7f60c3eef700 1 --2- 172.21.15.111:0/386038261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60bc0fb700 0x7f60bc0fbb10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:16.180 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.175+0000 7f60c3eef700 1 -- 172.21.15.111:0/386038261 >> 172.21.15.111:0/386038261 conn(0x7f60bc0f6e80 msgr2=0x7f60bc0f9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:16.180 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.175+0000 7f60c3eef700 1 -- 172.21.15.111:0/386038261 shutdown_connections 2023-12-08T20:22:16.180 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.175+0000 7f60c3eef700 1 -- 172.21.15.111:0/386038261 wait complete. 2023-12-08T20:22:16.180 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.175+0000 7f60c3eef700 1 Processor -- start 2023-12-08T20:22:16.180 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.175+0000 7f60c3eef700 1 -- start start 2023-12-08T20:22:16.180 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.175+0000 7f60c3eef700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60bc0fb700 0x7f60bc10f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:16.180 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.175+0000 7f60c3eef700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc065a10 con 0x7f60bc0fb700 2023-12-08T20:22:16.180 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.176+0000 7f60c1c8b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60bc0fb700 0x7f60bc10f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:16.180 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.176+0000 7f60c1c8b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60bc0fb700 0x7f60bc10f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.111:44750/0 (socket says 172.21.15.111:44750) 2023-12-08T20:22:16.180 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.176+0000 7f60c1c8b700 1 -- 172.21.15.111:0/1980825740 learned_addr learned my addr 172.21.15.111:0/1980825740 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-12-08T20:22:16.180 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.176+0000 7f60c1c8b700 1 -- 172.21.15.111:0/1980825740 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac005040 con 0x7f60bc0fb700 2023-12-08T20:22:16.180 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.176+0000 7f60c1c8b700 1 --2- 172.21.15.111:0/1980825740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60bc0fb700 0x7f60bc10f740 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00b690 tx=0x7f60ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:16.180 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.176+0000 7f60b27fc700 1 -- 172.21.15.111:0/1980825740 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60ac009650 con 0x7f60bc0fb700 2023-12-08T20:22:16.180 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.176+0000 7f60b27fc700 1 -- 172.21.15.111:0/1980825740 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f60ac0097b0 con 0x7f60bc0fb700 2023-12-08T20:22:16.180 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.176+0000 7f60b27fc700 1 -- 172.21.15.111:0/1980825740 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60ac01c5b0 con 0x7f60bc0fb700 2023-12-08T20:22:16.181 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.176+0000 7f60c3eef700 1 -- 172.21.15.111:0/1980825740 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60bc065c10 con 0x7f60bc0fb700 2023-12-08T20:22:16.181 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.176+0000 7f60c3eef700 1 -- 172.21.15.111:0/1980825740 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60bc10fec0 con 0x7f60bc0fb700 2023-12-08T20:22:16.181 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.177+0000 7f60b27fc700 1 -- 172.21.15.111:0/1980825740 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7f60ac013a60 con 0x7f60bc0fb700 2023-12-08T20:22:16.181 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.177+0000 7f60c3eef700 1 -- 172.21.15.111:0/1980825740 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60bc105310 con 0x7f60bc0fb700 2023-12-08T20:22:16.181 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.177+0000 7f60b27fc700 1 --2- 172.21.15.111:0/1980825740 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f60a8036780 0x7f60a8038c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:16.181 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.177+0000 7f60b27fc700 1 -- 172.21.15.111:0/1980825740 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f60ac049940 con 0x7f60bc0fb700 2023-12-08T20:22:16.181 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.177+0000 7f60c148a700 1 -- 172.21.15.111:0/1980825740 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f60a8036780 msgr2=0x7f60a8038c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2315465125 2023-12-08T20:22:16.181 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.177+0000 7f60c148a700 1 --2- 172.21.15.111:0/1980825740 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f60a8036780 0x7f60a8038c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:22:16.182 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.182+0000 7f60b27fc700 1 -- 172.21.15.111:0/1980825740 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f60ac011550 con 0x7f60bc0fb700 2023-12-08T20:22:16.378 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.378+0000 7f60c148a700 1 -- 172.21.15.111:0/1980825740 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f60a8036780 msgr2=0x7f60a8038c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2315465125 2023-12-08T20:22:16.381 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.378+0000 7f60c148a700 1 --2- 172.21.15.111:0/1980825740 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f60a8036780 0x7f60a8038c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T20:22:16.434 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.434+0000 7f60c3eef700 1 -- 172.21.15.111:0/1980825740 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f60bc04bb80 con 0x7f60bc0fb700 2023-12-08T20:22:16.435 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.435+0000 7f60b27fc700 1 -- 172.21.15.111:0/1980825740 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f60ac011370 con 0x7f60bc0fb700 2023-12-08T20:22:16.435 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:22:16.435 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":1,"fsid":"28476818-9607-11ee-95a3-87774f69a715","modified":"2023-12-08T20:20:29.604120Z","created":"2023-12-08T20:20:29.604120Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi043","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-08T20:22:16.437 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.436+0000 7f60c3eef700 1 -- 172.21.15.111:0/1980825740 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f60a8036780 msgr2=0x7f60a8038c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-08T20:22:16.437 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.436+0000 7f60c3eef700 1 --2- 172.21.15.111:0/1980825740 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f60a8036780 0x7f60a8038c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:16.437 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.436+0000 7f60c3eef700 1 -- 172.21.15.111:0/1980825740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60bc0fb700 msgr2=0x7f60bc10f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:16.437 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.436+0000 7f60c3eef700 1 --2- 172.21.15.111:0/1980825740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60bc0fb700 0x7f60bc10f740 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00b690 tx=0x7f60ac009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:16.437 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.437+0000 7f60c3eef700 1 -- 172.21.15.111:0/1980825740 shutdown_connections 2023-12-08T20:22:16.437 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.437+0000 7f60c3eef700 1 --2- 172.21.15.111:0/1980825740 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f60a8036780 0x7f60a8038c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:16.437 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.437+0000 7f60c3eef700 1 --2- 172.21.15.111:0/1980825740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60bc0fb700 0x7f60bc10f740 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:16.437 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.437+0000 7f60c3eef700 1 -- 172.21.15.111:0/1980825740 >> 172.21.15.111:0/1980825740 conn(0x7f60bc0f6e80 msgr2=0x7f60bc0f7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:16.437 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.437+0000 7f60c3eef700 1 -- 172.21.15.111:0/1980825740 shutdown_connections 2023-12-08T20:22:16.437 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:16.437+0000 7f60c3eef700 1 -- 172.21.15.111:0/1980825740 wait complete. 2023-12-08T20:22:16.438 INFO:teuthology.orchestra.run.smithi111.stderr:dumped monmap epoch 1 2023-12-08T20:22:16.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:16 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/1980825740' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:17.815 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-08T20:22:17.816 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-08T20:22:18.104 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:22:18.162 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:22:19.104 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.102+0000 7f0d916e1700 1 -- 172.21.15.111:0/2163506464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d8c0fd3c0 msgr2=0x7f0d8c0ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:19.104 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.102+0000 7f0d916e1700 1 --2- 172.21.15.111:0/2163506464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d8c0fd3c0 0x7f0d8c0ff7a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0d740048c0 tx=0x7f0d74009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:19.104 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.102+0000 7f0d916e1700 1 -- 172.21.15.111:0/2163506464 shutdown_connections 2023-12-08T20:22:19.104 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.102+0000 7f0d916e1700 1 --2- 172.21.15.111:0/2163506464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d8c0fd3c0 0x7f0d8c0ff7a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:19.104 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.102+0000 7f0d916e1700 1 -- 172.21.15.111:0/2163506464 >> 172.21.15.111:0/2163506464 conn(0x7f0d8c0f6e40 msgr2=0x7f0d8c0f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:19.104 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.102+0000 7f0d916e1700 1 -- 172.21.15.111:0/2163506464 shutdown_connections 2023-12-08T20:22:19.104 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.102+0000 7f0d916e1700 1 -- 172.21.15.111:0/2163506464 wait complete. 2023-12-08T20:22:19.104 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.103+0000 7f0d916e1700 1 Processor -- start 2023-12-08T20:22:19.104 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.103+0000 7f0d916e1700 1 -- start start 2023-12-08T20:22:19.104 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.103+0000 7f0d916e1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d8c0fd3c0 0x7f0d8c0fce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:19.104 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.103+0000 7f0d916e1700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c0fb2d0 con 0x7f0d8c0fd3c0 2023-12-08T20:22:19.104 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.103+0000 7f0d8affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d8c0fd3c0 0x7f0d8c0fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:19.104 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.103+0000 7f0d8affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d8c0fd3c0 0x7f0d8c0fce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.111:42502/0 (socket says 172.21.15.111:42502) 2023-12-08T20:22:19.105 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.103+0000 7f0d8affd700 1 -- 172.21.15.111:0/1100627904 learned_addr learned my addr 172.21.15.111:0/1100627904 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-12-08T20:22:19.105 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.103+0000 7f0d8affd700 1 -- 172.21.15.111:0/1100627904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d74005040 con 0x7f0d8c0fd3c0 2023-12-08T20:22:19.105 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.103+0000 7f0d8affd700 1 --2- 172.21.15.111:0/1100627904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d8c0fd3c0 0x7f0d8c0fce50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400b690 tx=0x7f0d74009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:19.105 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.103+0000 7f0d837fe700 1 -- 172.21.15.111:0/1100627904 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d74009650 con 0x7f0d8c0fd3c0 2023-12-08T20:22:19.105 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.104+0000 7f0d837fe700 1 -- 172.21.15.111:0/1100627904 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0d740097b0 con 0x7f0d8c0fd3c0 2023-12-08T20:22:19.105 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.104+0000 7f0d916e1700 1 -- 172.21.15.111:0/1100627904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8c0fb4d0 con 0x7f0d8c0fd3c0 2023-12-08T20:22:19.105 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.104+0000 7f0d837fe700 1 -- 172.21.15.111:0/1100627904 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d7401c5b0 con 0x7f0d8c0fd3c0 2023-12-08T20:22:19.105 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.104+0000 7f0d916e1700 1 -- 172.21.15.111:0/1100627904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8c0fb9c0 con 0x7f0d8c0fd3c0 2023-12-08T20:22:19.106 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.104+0000 7f0d837fe700 1 -- 172.21.15.111:0/1100627904 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7f0d7401c820 con 0x7f0d8c0fd3c0 2023-12-08T20:22:19.106 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.104+0000 7f0d916e1700 1 -- 172.21.15.111:0/1100627904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8c106510 con 0x7f0d8c0fd3c0 2023-12-08T20:22:19.106 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.105+0000 7f0d837fe700 1 --2- 172.21.15.111:0/1100627904 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f0d78036770 0x7f0d78038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:19.106 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.105+0000 7f0d837fe700 1 -- 172.21.15.111:0/1100627904 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0d74049970 con 0x7f0d8c0fd3c0 2023-12-08T20:22:19.106 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.105+0000 7f0d8a7fc700 1 -- 172.21.15.111:0/1100627904 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f0d78036770 msgr2=0x7f0d78038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2315465125 2023-12-08T20:22:19.106 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.105+0000 7f0d8a7fc700 1 --2- 172.21.15.111:0/1100627904 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f0d78036770 0x7f0d78038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:22:19.109 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.110+0000 7f0d837fe700 1 -- 172.21.15.111:0/1100627904 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0d74011550 con 0x7f0d8c0fd3c0 2023-12-08T20:22:19.306 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.306+0000 7f0d8a7fc700 1 -- 172.21.15.111:0/1100627904 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f0d78036770 msgr2=0x7f0d78038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2315465125 2023-12-08T20:22:19.306 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.306+0000 7f0d8a7fc700 1 --2- 172.21.15.111:0/1100627904 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f0d78036770 0x7f0d78038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T20:22:19.366 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.363+0000 7f0d916e1700 1 -- 172.21.15.111:0/1100627904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0d8c04bb80 con 0x7f0d8c0fd3c0 2023-12-08T20:22:19.366 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.364+0000 7f0d837fe700 1 -- 172.21.15.111:0/1100627904 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f0d74011370 con 0x7f0d8c0fd3c0 2023-12-08T20:22:19.367 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:22:19.367 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":1,"fsid":"28476818-9607-11ee-95a3-87774f69a715","modified":"2023-12-08T20:20:29.604120Z","created":"2023-12-08T20:20:29.604120Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi043","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-08T20:22:19.367 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.366+0000 7f0d916e1700 1 -- 172.21.15.111:0/1100627904 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f0d78036770 msgr2=0x7f0d78038c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-08T20:22:19.367 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.366+0000 7f0d916e1700 1 --2- 172.21.15.111:0/1100627904 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f0d78036770 0x7f0d78038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:19.368 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.366+0000 7f0d916e1700 1 -- 172.21.15.111:0/1100627904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d8c0fd3c0 msgr2=0x7f0d8c0fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:19.368 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.366+0000 7f0d916e1700 1 --2- 172.21.15.111:0/1100627904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d8c0fd3c0 0x7f0d8c0fce50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400b690 tx=0x7f0d74009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:19.368 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.366+0000 7f0d916e1700 1 -- 172.21.15.111:0/1100627904 shutdown_connections 2023-12-08T20:22:19.368 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.366+0000 7f0d916e1700 1 --2- 172.21.15.111:0/1100627904 >> [v2:172.21.15.43:6800/2315465125,v1:172.21.15.43:6801/2315465125] conn(0x7f0d78036770 0x7f0d78038c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:19.368 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.366+0000 7f0d916e1700 1 --2- 172.21.15.111:0/1100627904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d8c0fd3c0 0x7f0d8c0fce50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:19.368 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.366+0000 7f0d916e1700 1 -- 172.21.15.111:0/1100627904 >> 172.21.15.111:0/1100627904 conn(0x7f0d8c0f6e40 msgr2=0x7f0d8c0f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:19.368 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.366+0000 7f0d916e1700 1 -- 172.21.15.111:0/1100627904 shutdown_connections 2023-12-08T20:22:19.368 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:19.366+0000 7f0d916e1700 1 -- 172.21.15.111:0/1100627904 wait complete. 2023-12-08T20:22:19.368 INFO:teuthology.orchestra.run.smithi111.stderr:dumped monmap epoch 1 2023-12-08T20:22:19.532 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:19 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/1100627904' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:20.760 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-08T20:22:20.761 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-08T20:22:20.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:20 smithi043 ceph-mon[111966]: Active manager daemon smithi043.hqcdcm restarted 2023-12-08T20:22:20.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:20 smithi043 ceph-mon[111966]: Activating manager daemon smithi043.hqcdcm 2023-12-08T20:22:20.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:20 smithi043 ceph-mon[111966]: osdmap e5: 0 total, 0 up, 0 in 2023-12-08T20:22:20.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:20 smithi043 ceph-mon[111966]: mgrmap e15: smithi043.hqcdcm(active, starting, since 0.00277933s) 2023-12-08T20:22:20.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:22:20.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr metadata", "who": "smithi043.hqcdcm", "id": "smithi043.hqcdcm"}]: dispatch 2023-12-08T20:22:20.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-08T20:22:20.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-08T20:22:20.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-08T20:22:20.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:20 smithi043 ceph-mon[111966]: Manager daemon smithi043.hqcdcm is now available 2023-12-08T20:22:20.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:22:20.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:22:20.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:20.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:22:20.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi043.hqcdcm/mirror_snapshot_schedule"}]: dispatch 2023-12-08T20:22:20.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi043.hqcdcm/trash_purge_schedule"}]: dispatch 2023-12-08T20:22:20.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:21.034 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:22:21.112 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:22:21.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:21 smithi043 ceph-mon[111966]: [08/Dec/2023:20:22:20] ENGINE Bus STARTING 2023-12-08T20:22:21.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:21 smithi043 ceph-mon[111966]: mgrmap e16: smithi043.hqcdcm(active, since 1.00625s) 2023-12-08T20:22:21.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:21 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:21.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:21 smithi043 ceph-mon[111966]: [08/Dec/2023:20:22:20] ENGINE Serving on https://172.21.15.43:7150 2023-12-08T20:22:21.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:21 smithi043 ceph-mon[111966]: [08/Dec/2023:20:22:20] ENGINE Bus STARTED 2023-12-08T20:22:21.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:21 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:21.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:21 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:22.114 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.112+0000 7fc509ec3700 1 -- 172.21.15.111:0/102673836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5040fd3c0 msgr2=0x7fc5040ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:22.114 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.112+0000 7fc509ec3700 1 --2- 172.21.15.111:0/102673836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5040fd3c0 0x7fc5040ff7a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc4f80048c0 tx=0x7fc4f8009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:22.114 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.112+0000 7fc509ec3700 1 -- 172.21.15.111:0/102673836 shutdown_connections 2023-12-08T20:22:22.114 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.112+0000 7fc509ec3700 1 --2- 172.21.15.111:0/102673836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5040fd3c0 0x7fc5040ff7a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:22.114 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.112+0000 7fc509ec3700 1 -- 172.21.15.111:0/102673836 >> 172.21.15.111:0/102673836 conn(0x7fc5040f6e40 msgr2=0x7fc5040f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:22.114 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.112+0000 7fc509ec3700 1 -- 172.21.15.111:0/102673836 shutdown_connections 2023-12-08T20:22:22.115 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.112+0000 7fc509ec3700 1 -- 172.21.15.111:0/102673836 wait complete. 2023-12-08T20:22:22.115 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.113+0000 7fc509ec3700 1 Processor -- start 2023-12-08T20:22:22.115 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.113+0000 7fc509ec3700 1 -- start start 2023-12-08T20:22:22.115 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.113+0000 7fc509ec3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5040fd3c0 0x7fc5040fce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:22.115 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.113+0000 7fc509ec3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5040fb2d0 con 0x7fc5040fd3c0 2023-12-08T20:22:22.115 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.113+0000 7fc5037fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5040fd3c0 0x7fc5040fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:22.115 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.113+0000 7fc5037fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5040fd3c0 0x7fc5040fce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.111:42512/0 (socket says 172.21.15.111:42512) 2023-12-08T20:22:22.115 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.113+0000 7fc5037fe700 1 -- 172.21.15.111:0/903165831 learned_addr learned my addr 172.21.15.111:0/903165831 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-12-08T20:22:22.115 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.113+0000 7fc5037fe700 1 -- 172.21.15.111:0/903165831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f8005040 con 0x7fc5040fd3c0 2023-12-08T20:22:22.115 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.114+0000 7fc5037fe700 1 --2- 172.21.15.111:0/903165831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5040fd3c0 0x7fc5040fce50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8009040 tx=0x7fc4f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:22.115 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.114+0000 7fc4ebfff700 1 -- 172.21.15.111:0/903165831 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4f8009620 con 0x7fc5040fd3c0 2023-12-08T20:22:22.115 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.114+0000 7fc509ec3700 1 -- 172.21.15.111:0/903165831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5040fb4d0 con 0x7fc5040fd3c0 2023-12-08T20:22:22.115 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.114+0000 7fc4ebfff700 1 -- 172.21.15.111:0/903165831 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc4f8009780 con 0x7fc5040fd3c0 2023-12-08T20:22:22.115 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.114+0000 7fc4ebfff700 1 -- 172.21.15.111:0/903165831 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4f801c5b0 con 0x7fc5040fd3c0 2023-12-08T20:22:22.116 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.114+0000 7fc509ec3700 1 -- 172.21.15.111:0/903165831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5040fb9c0 con 0x7fc5040fd3c0 2023-12-08T20:22:22.116 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.115+0000 7fc4ebfff700 1 -- 172.21.15.111:0/903165831 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) v1 ==== 43202+0+0 (secure 0 0 0) 0x7fc4f8013a60 con 0x7fc5040fd3c0 2023-12-08T20:22:22.116 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.115+0000 7fc509ec3700 1 -- 172.21.15.111:0/903165831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc504106510 con 0x7fc5040fd3c0 2023-12-08T20:22:22.116 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.115+0000 7fc4ebfff700 1 --2- 172.21.15.111:0/903165831 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fc4ec036560 0x7fc4ec038a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:22.117 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.115+0000 7fc4ebfff700 1 -- 172.21.15.111:0/903165831 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fc4f80496a0 con 0x7fc5040fd3c0 2023-12-08T20:22:22.117 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.115+0000 7fc502ffd700 1 --2- 172.21.15.111:0/903165831 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fc4ec036560 0x7fc4ec038a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:22.117 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.115+0000 7fc502ffd700 1 --2- 172.21.15.111:0/903165831 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fc4ec036560 0x7fc4ec038a10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009990 tx=0x7fc4f4006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:22.120 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.120+0000 7fc4ebfff700 1 -- 172.21.15.111:0/903165831 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc4f80118c0 con 0x7fc5040fd3c0 2023-12-08T20:22:22.383 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.382+0000 7fc509ec3700 1 -- 172.21.15.111:0/903165831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc50404bb80 con 0x7fc5040fd3c0 2023-12-08T20:22:22.383 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.383+0000 7fc4ebfff700 1 -- 172.21.15.111:0/903165831 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fc4f80118c0 con 0x7fc5040fd3c0 2023-12-08T20:22:22.383 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:22:22.384 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":1,"fsid":"28476818-9607-11ee-95a3-87774f69a715","modified":"2023-12-08T20:20:29.604120Z","created":"2023-12-08T20:20:29.604120Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi043","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-08T20:22:22.385 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.385+0000 7fc509ec3700 1 -- 172.21.15.111:0/903165831 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fc4ec036560 msgr2=0x7fc4ec038a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:22.385 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.385+0000 7fc509ec3700 1 --2- 172.21.15.111:0/903165831 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fc4ec036560 0x7fc4ec038a10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009990 tx=0x7fc4f4006e40 comp rx=0 tx=0).stop 2023-12-08T20:22:22.385 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.385+0000 7fc509ec3700 1 -- 172.21.15.111:0/903165831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5040fd3c0 msgr2=0x7fc5040fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:22.385 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.385+0000 7fc509ec3700 1 --2- 172.21.15.111:0/903165831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5040fd3c0 0x7fc5040fce50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8009040 tx=0x7fc4f8009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:22.385 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.385+0000 7fc509ec3700 1 -- 172.21.15.111:0/903165831 shutdown_connections 2023-12-08T20:22:22.386 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.385+0000 7fc509ec3700 1 --2- 172.21.15.111:0/903165831 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fc4ec036560 0x7fc4ec038a10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:22.386 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.385+0000 7fc509ec3700 1 --2- 172.21.15.111:0/903165831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5040fd3c0 0x7fc5040fce50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:22.386 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.385+0000 7fc509ec3700 1 -- 172.21.15.111:0/903165831 >> 172.21.15.111:0/903165831 conn(0x7fc5040f6e40 msgr2=0x7fc5040f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:22.386 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.385+0000 7fc509ec3700 1 -- 172.21.15.111:0/903165831 shutdown_connections 2023-12-08T20:22:22.386 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:22.385+0000 7fc509ec3700 1 -- 172.21.15.111:0/903165831 wait complete. 2023-12-08T20:22:22.386 INFO:teuthology.orchestra.run.smithi111.stderr:dumped monmap epoch 1 2023-12-08T20:22:22.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:22 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/903165831' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:23.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:23 smithi043 ceph-mon[111966]: mgrmap e17: smithi043.hqcdcm(active, since 3s) 2023-12-08T20:22:23.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:23 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:23.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:23 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:23.797 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-08T20:22:23.797 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-08T20:22:24.089 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:22:24.155 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-08T20:22:24.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:24 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:24.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:24 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:24.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:24 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd/host:smithi043", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:22:24.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:24 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:24.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:24 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:24.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:24 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:24.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:24 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:24.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:24 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd/host:smithi111", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:22:24.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:24 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:24.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:24 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:22:25.141 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.140+0000 7fdaaea65700 1 -- 172.21.15.111:0/1990616610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaa81028f0 msgr2=0x7fdaa8102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:25.141 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.140+0000 7fdaaea65700 1 --2- 172.21.15.111:0/1990616610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaa81028f0 0x7fdaa8102cc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0048c0 tx=0x7fda9c009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:25.141 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.140+0000 7fdaaea65700 1 -- 172.21.15.111:0/1990616610 shutdown_connections 2023-12-08T20:22:25.141 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.140+0000 7fdaaea65700 1 --2- 172.21.15.111:0/1990616610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaa81028f0 0x7fdaa8102cc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:25.141 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.140+0000 7fdaaea65700 1 -- 172.21.15.111:0/1990616610 >> 172.21.15.111:0/1990616610 conn(0x7fdaa80715e0 msgr2=0x7fdaa80719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:25.141 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.140+0000 7fdaaea65700 1 -- 172.21.15.111:0/1990616610 shutdown_connections 2023-12-08T20:22:25.141 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.140+0000 7fdaaea65700 1 -- 172.21.15.111:0/1990616610 wait complete. 2023-12-08T20:22:25.142 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.141+0000 7fdaaea65700 1 Processor -- start 2023-12-08T20:22:25.142 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.141+0000 7fdaaea65700 1 -- start start 2023-12-08T20:22:25.142 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.141+0000 7fdaaea65700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaa81028f0 0x7fdaa8112b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:25.142 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.141+0000 7fdaaea65700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa8113090 con 0x7fdaa81028f0 2023-12-08T20:22:25.143 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.141+0000 7fdaac801700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaa81028f0 0x7fdaa8112b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:25.143 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.141+0000 7fdaac801700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaa81028f0 0x7fdaa8112b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.111:42536/0 (socket says 172.21.15.111:42536) 2023-12-08T20:22:25.143 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.141+0000 7fdaac801700 1 -- 172.21.15.111:0/3131408603 learned_addr learned my addr 172.21.15.111:0/3131408603 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-12-08T20:22:25.144 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.142+0000 7fdaac801700 1 -- 172.21.15.111:0/3131408603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c005040 con 0x7fdaa81028f0 2023-12-08T20:22:25.144 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.142+0000 7fdaac801700 1 --2- 172.21.15.111:0/3131408603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaa81028f0 0x7fdaa8112b50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009300 tx=0x7fda9c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:25.144 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.142+0000 7fdaa57fa700 1 -- 172.21.15.111:0/3131408603 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda9c004e60 con 0x7fdaa81028f0 2023-12-08T20:22:25.144 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.142+0000 7fdaaea65700 1 -- 172.21.15.111:0/3131408603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa8113290 con 0x7fdaa81028f0 2023-12-08T20:22:25.144 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.142+0000 7fdaa57fa700 1 -- 172.21.15.111:0/3131408603 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda9c013420 con 0x7fdaa81028f0 2023-12-08T20:22:25.144 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.142+0000 7fdaa57fa700 1 -- 172.21.15.111:0/3131408603 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda9c01c5b0 con 0x7fdaa81028f0 2023-12-08T20:22:25.144 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.142+0000 7fdaaea65700 1 -- 172.21.15.111:0/3131408603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa810ca10 con 0x7fdaa81028f0 2023-12-08T20:22:25.144 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.143+0000 7fdaa57fa700 1 -- 172.21.15.111:0/3131408603 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7fda9c009600 con 0x7fdaa81028f0 2023-12-08T20:22:25.144 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.143+0000 7fdaaea65700 1 -- 172.21.15.111:0/3131408603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa805f270 con 0x7fdaa81028f0 2023-12-08T20:22:25.144 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.143+0000 7fdaa57fa700 1 --2- 172.21.15.111:0/3131408603 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fda980367c0 0x7fda98038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:25.144 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.143+0000 7fdaa57fa700 1 -- 172.21.15.111:0/3131408603 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fda9c049a40 con 0x7fdaa81028f0 2023-12-08T20:22:25.144 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.143+0000 7fdaa7fff700 1 --2- 172.21.15.111:0/3131408603 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fda980367c0 0x7fda98038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:25.145 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.144+0000 7fdaa7fff700 1 --2- 172.21.15.111:0/3131408603 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fda980367c0 0x7fda98038c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fda94009990 tx=0x7fda94006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:25.148 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.148+0000 7fdaa57fa700 1 -- 172.21.15.111:0/3131408603 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fda9c025400 con 0x7fdaa81028f0 2023-12-08T20:22:25.414 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.414+0000 7fdaaea65700 1 -- 172.21.15.111:0/3131408603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdaa810e130 con 0x7fdaa81028f0 2023-12-08T20:22:25.415 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.415+0000 7fdaa57fa700 1 -- 172.21.15.111:0/3131408603 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fda9c011370 con 0x7fdaa81028f0 2023-12-08T20:22:25.415 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:22:25.415 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":1,"fsid":"28476818-9607-11ee-95a3-87774f69a715","modified":"2023-12-08T20:20:29.604120Z","created":"2023-12-08T20:20:29.604120Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi043","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-08T20:22:25.417 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.417+0000 7fdaaea65700 1 -- 172.21.15.111:0/3131408603 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fda980367c0 msgr2=0x7fda98038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:25.417 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.417+0000 7fdaaea65700 1 --2- 172.21.15.111:0/3131408603 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fda980367c0 0x7fda98038c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fda94009990 tx=0x7fda94006e40 comp rx=0 tx=0).stop 2023-12-08T20:22:25.417 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.417+0000 7fdaaea65700 1 -- 172.21.15.111:0/3131408603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaa81028f0 msgr2=0x7fdaa8112b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:25.417 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.417+0000 7fdaaea65700 1 --2- 172.21.15.111:0/3131408603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaa81028f0 0x7fdaa8112b50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009300 tx=0x7fda9c009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:25.418 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.417+0000 7fdaaea65700 1 -- 172.21.15.111:0/3131408603 shutdown_connections 2023-12-08T20:22:25.418 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.417+0000 7fdaaea65700 1 --2- 172.21.15.111:0/3131408603 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fda980367c0 0x7fda98038c70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:25.418 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.417+0000 7fdaaea65700 1 --2- 172.21.15.111:0/3131408603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaa81028f0 0x7fdaa8112b50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:25.418 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.417+0000 7fdaaea65700 1 -- 172.21.15.111:0/3131408603 >> 172.21.15.111:0/3131408603 conn(0x7fdaa80715e0 msgr2=0x7fdaa8103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:25.418 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.417+0000 7fdaaea65700 1 -- 172.21.15.111:0/3131408603 shutdown_connections 2023-12-08T20:22:25.418 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:25.417+0000 7fdaaea65700 1 -- 172.21.15.111:0/3131408603 wait complete. 2023-12-08T20:22:25.418 INFO:teuthology.orchestra.run.smithi111.stderr:dumped monmap epoch 1 2023-12-08T20:22:25.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:25 smithi043 ceph-mon[111966]: Updating smithi043:/etc/ceph/ceph.conf 2023-12-08T20:22:25.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:25 smithi043 ceph-mon[111966]: Updating smithi111:/etc/ceph/ceph.conf 2023-12-08T20:22:25.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:25 smithi043 ceph-mon[111966]: Updating smithi111:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:22:25.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:25 smithi043 ceph-mon[111966]: Updating smithi043:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:22:25.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:25 smithi043 ceph-mon[111966]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2023-12-08T20:22:25.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:25 smithi043 ceph-mon[111966]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2023-12-08T20:22:25.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:25 smithi043 ceph-mon[111966]: Updating smithi111:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-08T20:22:25.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:25 smithi043 ceph-mon[111966]: Updating smithi043:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-08T20:22:25.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:25 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:25.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:25 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:25.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:25 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:25.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:25 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:25.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:25 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:25.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:25 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-08T20:22:25.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:25 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-08T20:22:25.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:25 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:25.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:25 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/3131408603' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:26.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:26 smithi043 ceph-mon[111966]: Deploying daemon crash.smithi111 on smithi111 2023-12-08T20:22:26.970 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-08T20:22:26.971 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-08T20:22:27.351 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:22:28.369 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.367+0000 7f5d15bcc700 1 -- 172.21.15.111:0/1821084939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d100fd8e0 msgr2=0x7f5d100fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:28.370 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.367+0000 7f5d15bcc700 1 --2- 172.21.15.111:0/1821084939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d100fd8e0 0x7f5d100fdcb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5d040048c0 tx=0x7f5d04009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:28.370 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.367+0000 7f5d15bcc700 1 -- 172.21.15.111:0/1821084939 shutdown_connections 2023-12-08T20:22:28.370 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.367+0000 7f5d15bcc700 1 --2- 172.21.15.111:0/1821084939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d100fd8e0 0x7f5d100fdcb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:28.370 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.367+0000 7f5d15bcc700 1 -- 172.21.15.111:0/1821084939 >> 172.21.15.111:0/1821084939 conn(0x7f5d100f7310 msgr2=0x7f5d100f9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:28.370 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.367+0000 7f5d15bcc700 1 -- 172.21.15.111:0/1821084939 shutdown_connections 2023-12-08T20:22:28.370 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.367+0000 7f5d15bcc700 1 -- 172.21.15.111:0/1821084939 wait complete. 2023-12-08T20:22:28.370 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.368+0000 7f5d15bcc700 1 Processor -- start 2023-12-08T20:22:28.370 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.368+0000 7f5d15bcc700 1 -- start start 2023-12-08T20:22:28.370 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.368+0000 7f5d15bcc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d100fd8e0 0x7f5d10112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:28.370 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.368+0000 7f5d15bcc700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d101130c0 con 0x7f5d100fd8e0 2023-12-08T20:22:28.370 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.369+0000 7f5d0f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d100fd8e0 0x7f5d10112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:28.370 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.369+0000 7f5d0f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d100fd8e0 0x7f5d10112b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.111:38542/0 (socket says 172.21.15.111:38542) 2023-12-08T20:22:28.371 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.369+0000 7f5d0f7fe700 1 -- 172.21.15.111:0/2101107091 learned_addr learned my addr 172.21.15.111:0/2101107091 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-12-08T20:22:28.371 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.369+0000 7f5d0f7fe700 1 -- 172.21.15.111:0/2101107091 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d04005040 con 0x7f5d100fd8e0 2023-12-08T20:22:28.371 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.369+0000 7f5d0f7fe700 1 --2- 172.21.15.111:0/2101107091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d100fd8e0 0x7f5d10112b80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009040 tx=0x7f5d04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:28.371 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.369+0000 7f5cf7fff700 1 -- 172.21.15.111:0/2101107091 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d04004e60 con 0x7f5d100fd8e0 2023-12-08T20:22:28.371 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.369+0000 7f5d15bcc700 1 -- 172.21.15.111:0/2101107091 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d101132c0 con 0x7f5d100fd8e0 2023-12-08T20:22:28.371 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.369+0000 7f5cf7fff700 1 -- 172.21.15.111:0/2101107091 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5d04009650 con 0x7f5d100fd8e0 2023-12-08T20:22:28.371 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.369+0000 7f5cf7fff700 1 -- 172.21.15.111:0/2101107091 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d0401c3f0 con 0x7f5d100fd8e0 2023-12-08T20:22:28.371 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.369+0000 7f5d15bcc700 1 -- 172.21.15.111:0/2101107091 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d10113730 con 0x7f5d100fd8e0 2023-12-08T20:22:28.372 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.370+0000 7f5cf7fff700 1 -- 172.21.15.111:0/2101107091 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f5d0401c6b0 con 0x7f5d100fd8e0 2023-12-08T20:22:28.372 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.370+0000 7f5d15bcc700 1 -- 172.21.15.111:0/2101107091 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d1005f270 con 0x7f5d100fd8e0 2023-12-08T20:22:28.372 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.370+0000 7f5cf7fff700 1 --2- 172.21.15.111:0/2101107091 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f5cf80367c0 0x7f5cf8038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:28.372 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.370+0000 7f5cf7fff700 1 -- 172.21.15.111:0/2101107091 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f5d04049a30 con 0x7f5d100fd8e0 2023-12-08T20:22:28.372 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.371+0000 7f5d0effd700 1 --2- 172.21.15.111:0/2101107091 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f5cf80367c0 0x7f5cf8038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:28.372 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.371+0000 7f5d0effd700 1 --2- 172.21.15.111:0/2101107091 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f5cf80367c0 0x7f5cf8038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5d00009990 tx=0x7f5d00006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:28.376 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.376+0000 7f5cf7fff700 1 -- 172.21.15.111:0/2101107091 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5d04013420 con 0x7f5d100fd8e0 2023-12-08T20:22:28.631 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.631+0000 7f5d15bcc700 1 -- 172.21.15.111:0/2101107091 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5d1004bc10 con 0x7f5d100fd8e0 2023-12-08T20:22:28.632 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.632+0000 7f5cf7fff700 1 -- 172.21.15.111:0/2101107091 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5d04011370 con 0x7f5d100fd8e0 2023-12-08T20:22:28.632 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:22:28.632 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":1,"fsid":"28476818-9607-11ee-95a3-87774f69a715","modified":"2023-12-08T20:20:29.604120Z","created":"2023-12-08T20:20:29.604120Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi043","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-08T20:22:28.634 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.634+0000 7f5d15bcc700 1 -- 172.21.15.111:0/2101107091 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f5cf80367c0 msgr2=0x7f5cf8038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:28.634 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.634+0000 7f5d15bcc700 1 --2- 172.21.15.111:0/2101107091 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f5cf80367c0 0x7f5cf8038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5d00009990 tx=0x7f5d00006e40 comp rx=0 tx=0).stop 2023-12-08T20:22:28.634 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.634+0000 7f5d15bcc700 1 -- 172.21.15.111:0/2101107091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d100fd8e0 msgr2=0x7f5d10112b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:28.634 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.634+0000 7f5d15bcc700 1 --2- 172.21.15.111:0/2101107091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d100fd8e0 0x7f5d10112b80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009040 tx=0x7f5d04009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:28.634 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.634+0000 7f5d15bcc700 1 -- 172.21.15.111:0/2101107091 shutdown_connections 2023-12-08T20:22:28.635 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.634+0000 7f5d15bcc700 1 --2- 172.21.15.111:0/2101107091 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f5cf80367c0 0x7f5cf8038c70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:28.635 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.634+0000 7f5d15bcc700 1 --2- 172.21.15.111:0/2101107091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d100fd8e0 0x7f5d10112b80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:28.635 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.634+0000 7f5d15bcc700 1 -- 172.21.15.111:0/2101107091 >> 172.21.15.111:0/2101107091 conn(0x7f5d100f7310 msgr2=0x7f5d10101100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:28.635 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.634+0000 7f5d15bcc700 1 -- 172.21.15.111:0/2101107091 shutdown_connections 2023-12-08T20:22:28.635 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:28.634+0000 7f5d15bcc700 1 -- 172.21.15.111:0/2101107091 wait complete. 2023-12-08T20:22:28.635 INFO:teuthology.orchestra.run.smithi111.stderr:dumped monmap epoch 1 2023-12-08T20:22:28.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:28 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:28.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:28 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:28.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:28 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:28.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:28 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:28.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:28 smithi043 ceph-mon[111966]: Deploying daemon node-exporter.smithi111 on smithi111 2023-12-08T20:22:29.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:29 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/2101107091' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:29.966 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-08T20:22:29.967 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-08T20:22:30.314 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:22:30.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:30 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:31.691 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.691+0000 7f7569e2d700 1 -- 172.21.15.111:0/2379987376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7564100f00 msgr2=0x7f75641012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:31.692 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.691+0000 7f7569e2d700 1 --2- 172.21.15.111:0/2379987376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7564100f00 0x7f75641012d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f75580048c0 tx=0x7f7558009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:31.692 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.691+0000 7f7569e2d700 1 -- 172.21.15.111:0/2379987376 shutdown_connections 2023-12-08T20:22:31.692 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.691+0000 7f7569e2d700 1 --2- 172.21.15.111:0/2379987376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7564100f00 0x7f75641012d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:31.692 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.691+0000 7f7569e2d700 1 -- 172.21.15.111:0/2379987376 >> 172.21.15.111:0/2379987376 conn(0x7f7564071d60 msgr2=0x7f7564072160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:31.692 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.691+0000 7f7569e2d700 1 -- 172.21.15.111:0/2379987376 shutdown_connections 2023-12-08T20:22:31.692 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.691+0000 7f7569e2d700 1 -- 172.21.15.111:0/2379987376 wait complete. 2023-12-08T20:22:31.693 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.692+0000 7f7569e2d700 1 Processor -- start 2023-12-08T20:22:31.693 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.692+0000 7f7569e2d700 1 -- start start 2023-12-08T20:22:31.693 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.692+0000 7f7569e2d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7564100f00 0x7f7564111a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:31.693 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.692+0000 7f7569e2d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7564111f40 con 0x7f7564100f00 2023-12-08T20:22:31.693 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.693+0000 7f75637fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7564100f00 0x7f7564111a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:31.693 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.693+0000 7f75637fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7564100f00 0x7f7564111a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.111:38562/0 (socket says 172.21.15.111:38562) 2023-12-08T20:22:31.693 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.693+0000 7f75637fe700 1 -- 172.21.15.111:0/1135932444 learned_addr learned my addr 172.21.15.111:0/1135932444 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-12-08T20:22:31.693 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.693+0000 7f75637fe700 1 -- 172.21.15.111:0/1135932444 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7558005040 con 0x7f7564100f00 2023-12-08T20:22:31.694 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.693+0000 7f75637fe700 1 --2- 172.21.15.111:0/1135932444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7564100f00 0x7f7564111a00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7558009300 tx=0x7f7558009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:31.694 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.694+0000 7f754bfff700 1 -- 172.21.15.111:0/1135932444 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7558004e60 con 0x7f7564100f00 2023-12-08T20:22:31.694 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.694+0000 7f7569e2d700 1 -- 172.21.15.111:0/1135932444 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7564112140 con 0x7f7564100f00 2023-12-08T20:22:31.694 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.694+0000 7f754bfff700 1 -- 172.21.15.111:0/1135932444 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7558013420 con 0x7f7564100f00 2023-12-08T20:22:31.694 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.694+0000 7f754bfff700 1 -- 172.21.15.111:0/1135932444 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f755801c5b0 con 0x7f7564100f00 2023-12-08T20:22:31.694 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.694+0000 7f7569e2d700 1 -- 172.21.15.111:0/1135932444 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7564112630 con 0x7f7564100f00 2023-12-08T20:22:31.695 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.695+0000 7f754bfff700 1 -- 172.21.15.111:0/1135932444 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f755801c7f0 con 0x7f7564100f00 2023-12-08T20:22:31.695 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.695+0000 7f7569e2d700 1 -- 172.21.15.111:0/1135932444 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7564100220 con 0x7f7564100f00 2023-12-08T20:22:31.695 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.695+0000 7f754bfff700 1 --2- 172.21.15.111:0/1135932444 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f754c0389d0 0x7f754c03ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:31.695 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.695+0000 7f754bfff700 1 -- 172.21.15.111:0/1135932444 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f7558049af0 con 0x7f7564100f00 2023-12-08T20:22:31.695 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.695+0000 7f7562ffd700 1 --2- 172.21.15.111:0/1135932444 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f754c0389d0 0x7f754c03ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:31.696 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.696+0000 7f7562ffd700 1 --2- 172.21.15.111:0/1135932444 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f754c0389d0 0x7f754c03ae80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7554009990 tx=0x7f7554006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:31.700 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.700+0000 7f754bfff700 1 -- 172.21.15.111:0/1135932444 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7558023300 con 0x7f7564100f00 2023-12-08T20:22:31.988 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.987+0000 7f7569e2d700 1 -- 172.21.15.111:0/1135932444 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f756405f270 con 0x7f7564100f00 2023-12-08T20:22:31.989 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.988+0000 7f754bfff700 1 -- 172.21.15.111:0/1135932444 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f7558011b60 con 0x7f7564100f00 2023-12-08T20:22:31.989 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:22:31.989 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":1,"fsid":"28476818-9607-11ee-95a3-87774f69a715","modified":"2023-12-08T20:20:29.604120Z","created":"2023-12-08T20:20:29.604120Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi043","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-08T20:22:31.991 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.990+0000 7f7569e2d700 1 -- 172.21.15.111:0/1135932444 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f754c0389d0 msgr2=0x7f754c03ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:31.991 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.990+0000 7f7569e2d700 1 --2- 172.21.15.111:0/1135932444 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f754c0389d0 0x7f754c03ae80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7554009990 tx=0x7f7554006e40 comp rx=0 tx=0).stop 2023-12-08T20:22:31.991 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.990+0000 7f7569e2d700 1 -- 172.21.15.111:0/1135932444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7564100f00 msgr2=0x7f7564111a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:31.991 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.990+0000 7f7569e2d700 1 --2- 172.21.15.111:0/1135932444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7564100f00 0x7f7564111a00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7558009300 tx=0x7f7558009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:31.991 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.990+0000 7f7569e2d700 1 -- 172.21.15.111:0/1135932444 shutdown_connections 2023-12-08T20:22:31.991 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.990+0000 7f7569e2d700 1 --2- 172.21.15.111:0/1135932444 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f754c0389d0 0x7f754c03ae80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:31.991 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.990+0000 7f7569e2d700 1 --2- 172.21.15.111:0/1135932444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7564100f00 0x7f7564111a00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:31.991 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.990+0000 7f7569e2d700 1 -- 172.21.15.111:0/1135932444 >> 172.21.15.111:0/1135932444 conn(0x7f7564071d60 msgr2=0x7f75640f9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:31.991 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.991+0000 7f7569e2d700 1 -- 172.21.15.111:0/1135932444 shutdown_connections 2023-12-08T20:22:31.991 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:31.991+0000 7f7569e2d700 1 -- 172.21.15.111:0/1135932444 wait complete. 2023-12-08T20:22:31.992 INFO:teuthology.orchestra.run.smithi111.stderr:dumped monmap epoch 1 2023-12-08T20:22:32.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:31 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:32.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:31 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:32.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:31 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:32.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:31 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:32.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:31 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.mtcffu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-08T20:22:32.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:31 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.mtcffu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-08T20:22:32.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:31 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-08T20:22:32.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:31 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:32.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:31 smithi043 ceph-mon[111966]: Deploying daemon mgr.smithi111.mtcffu on smithi111 2023-12-08T20:22:33.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:32 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/1135932444' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:33.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:32 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:33.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:32 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:33.326 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-08T20:22:33.326 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph mon dump -f json 2023-12-08T20:22:33.652 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:22:34.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:33 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:34.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:33 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:34.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:33 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-08T20:22:34.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:33 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:34.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:33 smithi043 ceph-mon[111966]: Deploying daemon mon.smithi111 on smithi111 2023-12-08T20:22:34.940 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.939+0000 7faae1198700 1 -- 172.21.15.111:0/2133830702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faadc1017d0 msgr2=0x7faadc101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:34.940 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.939+0000 7faae1198700 1 --2- 172.21.15.111:0/2133830702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faadc1017d0 0x7faadc101ba0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faacc0048c0 tx=0x7faacc009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:34.940 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.939+0000 7faae1198700 1 -- 172.21.15.111:0/2133830702 shutdown_connections 2023-12-08T20:22:34.941 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.939+0000 7faae1198700 1 --2- 172.21.15.111:0/2133830702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faadc1017d0 0x7faadc101ba0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:34.941 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.939+0000 7faae1198700 1 -- 172.21.15.111:0/2133830702 >> 172.21.15.111:0/2133830702 conn(0x7faadc0f72f0 msgr2=0x7faadc0f9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:34.941 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.939+0000 7faae1198700 1 -- 172.21.15.111:0/2133830702 shutdown_connections 2023-12-08T20:22:34.941 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.939+0000 7faae1198700 1 -- 172.21.15.111:0/2133830702 wait complete. 2023-12-08T20:22:34.941 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.940+0000 7faae1198700 1 Processor -- start 2023-12-08T20:22:34.941 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.940+0000 7faae1198700 1 -- start start 2023-12-08T20:22:34.944 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.940+0000 7faae1198700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faadc1017d0 0x7faadc10dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:34.944 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.940+0000 7faae1198700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc10e150 con 0x7faadc1017d0 2023-12-08T20:22:34.944 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.941+0000 7faadad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faadc1017d0 0x7faadc10dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:34.945 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.941+0000 7faadad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faadc1017d0 0x7faadc10dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.111:38606/0 (socket says 172.21.15.111:38606) 2023-12-08T20:22:34.945 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.941+0000 7faadad9d700 1 -- 172.21.15.111:0/3399795800 learned_addr learned my addr 172.21.15.111:0/3399795800 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-12-08T20:22:34.945 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.941+0000 7faadad9d700 1 -- 172.21.15.111:0/3399795800 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc005040 con 0x7faadc1017d0 2023-12-08T20:22:34.945 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.941+0000 7faadad9d700 1 --2- 172.21.15.111:0/3399795800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faadc1017d0 0x7faadc10dc10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faacc009300 tx=0x7faacc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:34.945 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.941+0000 7faac37fe700 1 -- 172.21.15.111:0/3399795800 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faacc004e60 con 0x7faadc1017d0 2023-12-08T20:22:34.945 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.941+0000 7faac37fe700 1 -- 172.21.15.111:0/3399795800 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faacc013420 con 0x7faadc1017d0 2023-12-08T20:22:34.945 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.941+0000 7faac37fe700 1 -- 172.21.15.111:0/3399795800 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faacc01c5b0 con 0x7faadc1017d0 2023-12-08T20:22:34.945 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.941+0000 7faae1198700 1 -- 172.21.15.111:0/3399795800 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc10e350 con 0x7faadc1017d0 2023-12-08T20:22:34.946 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.941+0000 7faae1198700 1 -- 172.21.15.111:0/3399795800 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc10e840 con 0x7faadc1017d0 2023-12-08T20:22:34.946 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.942+0000 7faac37fe700 1 -- 172.21.15.111:0/3399795800 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7faacc01c7a0 con 0x7faadc1017d0 2023-12-08T20:22:34.946 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.942+0000 7faac37fe700 1 --2- 172.21.15.111:0/3399795800 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7faac4036810 0x7faac4038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:34.946 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.943+0000 7faac37fe700 1 -- 172.21.15.111:0/3399795800 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7faacc0499b0 con 0x7faadc1017d0 2023-12-08T20:22:34.946 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.943+0000 7faae1198700 1 -- 172.21.15.111:0/3399795800 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faadc100a40 con 0x7faadc1017d0 2023-12-08T20:22:34.946 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.943+0000 7faada59c700 1 --2- 172.21.15.111:0/3399795800 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7faac4036810 0x7faac4038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:34.946 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.943+0000 7faada59c700 1 --2- 172.21.15.111:0/3399795800 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7faac4036810 0x7faac4038cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faad0009990 tx=0x7faad0006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:34.948 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:34.948+0000 7faac37fe700 1 -- 172.21.15.111:0/3399795800 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7faacc023300 con 0x7faadc1017d0 2023-12-08T20:22:35.199 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:35.198+0000 7faac37fe700 1 -- 172.21.15.111:0/3399795800 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faacc023300 con 0x7faadc1017d0 2023-12-08T20:22:35.243 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:35.243+0000 7faae1198700 1 -- 172.21.15.111:0/3399795800 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7faadc04bb80 con 0x7faadc1017d0 2023-12-08T20:22:35.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 systemd[1]: Started Ceph mon.smithi111 for 28476818-9607-11ee-95a3-87774f69a715. 2023-12-08T20:22:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: mon.smithi111@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-08T20:22:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: mon.smithi111@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-08T20:22:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: mon.smithi111@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-08T20:22:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: mon.smithi111@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-08T20:22:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-08T20:22:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-08T20:22:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: Deploying daemon grafana.smithi043 on smithi043 2023-12-08T20:22:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/4192048901' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-08T20:22:35.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:35.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/4192048901' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-08T20:22:35.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: osdmap e4: 0 total, 0 up, 0 in 2023-12-08T20:22:35.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:35.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi043:172.21.15.43=smithi043;smithi111:172.21.15.111=smithi111", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:22:35.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: Saving service mon spec with placement smithi043:172.21.15.43=smithi043;smithi111:172.21.15.111=smithi111;count:2 2023-12-08T20:22:35.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:35.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/3798101027' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:35.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:35.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/3055197153' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:35.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:35.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:35.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/4053611762' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:35.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: Deploying daemon prometheus.smithi043 on smithi043 2023-12-08T20:22:35.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:35.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/917625740' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:35.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:35.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:35.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/645902801' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:35.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:35.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/1884237120' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:35.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.470 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.470 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.470 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-08T20:22:35.470 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:35.470 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14162 172.21.15.43:0/1405481132' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-08T20:22:35.470 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: mgrmap e14: smithi043.hqcdcm(active, since 44s) 2023-12-08T20:22:35.470 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/3823826195' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:35.470 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/1980825740' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:35.470 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/1100627904' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:35.470 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: Active manager daemon smithi043.hqcdcm restarted 2023-12-08T20:22:35.470 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: Activating manager daemon smithi043.hqcdcm 2023-12-08T20:22:35.470 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: osdmap e5: 0 total, 0 up, 0 in 2023-12-08T20:22:35.470 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: mgrmap e15: smithi043.hqcdcm(active, starting, since 0.00277933s) 2023-12-08T20:22:35.470 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:22:35.470 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr metadata", "who": "smithi043.hqcdcm", "id": "smithi043.hqcdcm"}]: dispatch 2023-12-08T20:22:35.471 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-08T20:22:35.471 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-08T20:22:35.471 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-08T20:22:35.471 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: Manager daemon smithi043.hqcdcm is now available 2023-12-08T20:22:35.471 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:22:35.471 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:22:35.471 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.471 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:22:35.471 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi043.hqcdcm/mirror_snapshot_schedule"}]: dispatch 2023-12-08T20:22:35.471 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi043.hqcdcm/trash_purge_schedule"}]: dispatch 2023-12-08T20:22:35.471 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.471 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: [08/Dec/2023:20:22:20] ENGINE Bus STARTING 2023-12-08T20:22:35.471 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: mgrmap e16: smithi043.hqcdcm(active, since 1.00625s) 2023-12-08T20:22:35.471 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.471 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: [08/Dec/2023:20:22:20] ENGINE Serving on https://172.21.15.43:7150 2023-12-08T20:22:35.472 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: [08/Dec/2023:20:22:20] ENGINE Bus STARTED 2023-12-08T20:22:35.472 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.472 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.472 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/903165831' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:35.472 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: mgrmap e17: smithi043.hqcdcm(active, since 3s) 2023-12-08T20:22:35.472 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.472 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.472 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.472 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.472 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd/host:smithi043", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:22:35.472 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.472 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.472 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.472 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.472 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd/host:smithi111", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:22:35.472 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:35.472 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:22:35.473 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: Updating smithi043:/etc/ceph/ceph.conf 2023-12-08T20:22:35.473 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: Updating smithi111:/etc/ceph/ceph.conf 2023-12-08T20:22:35.473 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: Updating smithi111:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:22:35.473 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: Updating smithi043:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:22:35.473 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2023-12-08T20:22:35.473 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2023-12-08T20:22:35.473 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: Updating smithi111:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-08T20:22:35.473 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: Updating smithi043:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-08T20:22:35.473 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.473 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.474 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.474 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.474 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.474 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-08T20:22:35.474 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-08T20:22:35.474 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:35.474 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/3131408603' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:35.474 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: Deploying daemon crash.smithi111 on smithi111 2023-12-08T20:22:35.474 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.474 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.474 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.474 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.474 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: Deploying daemon node-exporter.smithi111 on smithi111 2023-12-08T20:22:35.474 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/2101107091' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:35.474 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.mtcffu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-08T20:22:35.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.mtcffu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-08T20:22:35.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-08T20:22:35.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:35.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: Deploying daemon mgr.smithi111.mtcffu on smithi111 2023-12-08T20:22:35.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/1135932444' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:35.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:35.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-08T20:22:35.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:35.476 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: Deploying daemon mon.smithi111 on smithi111 2023-12-08T20:22:35.476 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: mon.smithi111@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2023-12-08T20:22:35.476 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:35 smithi111 ceph-mon[121341]: mon.smithi111@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-12-08T20:22:40.247 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:40.246+0000 7faac37fe700 1 -- 172.21.15.111:0/3399795800 <== mon.0 v2:172.21.15.43:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7faacc011b60 con 0x7faadc1017d0 2023-12-08T20:22:40.247 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-12-08T20:22:40.247 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":2,"fsid":"28476818-9607-11ee-95a3-87774f69a715","modified":"2023-12-08T20:22:35.198986Z","created":"2023-12-08T20:20:29.604120Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi043","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-08T20:22:40.250 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:40.249+0000 7faae1198700 1 -- 172.21.15.111:0/3399795800 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7faac4036810 msgr2=0x7faac4038cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:40.250 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:40.249+0000 7faae1198700 1 --2- 172.21.15.111:0/3399795800 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7faac4036810 0x7faac4038cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faad0009990 tx=0x7faad0006e40 comp rx=0 tx=0).stop 2023-12-08T20:22:40.250 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:40.249+0000 7faae1198700 1 -- 172.21.15.111:0/3399795800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faadc1017d0 msgr2=0x7faadc10dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:40.250 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:40.249+0000 7faae1198700 1 --2- 172.21.15.111:0/3399795800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faadc1017d0 0x7faadc10dc10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faacc009300 tx=0x7faacc009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:40.250 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:40.249+0000 7faae1198700 1 -- 172.21.15.111:0/3399795800 shutdown_connections 2023-12-08T20:22:40.250 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:40.249+0000 7faae1198700 1 --2- 172.21.15.111:0/3399795800 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7faac4036810 0x7faac4038cc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:40.250 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:40.249+0000 7faae1198700 1 --2- 172.21.15.111:0/3399795800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faadc1017d0 0x7faadc10dc10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:40.250 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:40.249+0000 7faae1198700 1 -- 172.21.15.111:0/3399795800 >> 172.21.15.111:0/3399795800 conn(0x7faadc0f72f0 msgr2=0x7faadc0f7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:40.250 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:40.249+0000 7faae1198700 1 -- 172.21.15.111:0/3399795800 shutdown_connections 2023-12-08T20:22:40.250 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:22:40.250+0000 7faae1198700 1 -- 172.21.15.111:0/3399795800 wait complete. 2023-12-08T20:22:40.251 INFO:teuthology.orchestra.run.smithi111.stderr:dumped monmap epoch 2 2023-12-08T20:22:40.554 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:22:40.554 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:22:40.554 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: mon.smithi043 calling monitor election 2023-12-08T20:22:40.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/3399795800' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:40.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:22:40.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:22:40.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: mon.smithi111 calling monitor election 2023-12-08T20:22:40.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:22:40.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:22:40.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.111:0/681907511' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/crt"}]: dispatch 2023-12-08T20:22:40.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:40.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:22:40.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: mon.smithi043 is new leader, mons smithi043,smithi111 in quorum (ranks 0,1) 2023-12-08T20:22:40.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: monmap e2: 2 mons at {smithi043=[v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0],smithi111=[v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-08T20:22:40.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: fsmap 2023-12-08T20:22:40.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: osdmap e5: 0 total, 0 up, 0 in 2023-12-08T20:22:40.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: mgrmap e17: smithi043.hqcdcm(active, since 20s) 2023-12-08T20:22:40.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: Standby manager daemon smithi111.mtcffu started 2023-12-08T20:22:40.556 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.111:0/681907511' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-08T20:22:40.556 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: overall HEALTH_OK 2023-12-08T20:22:40.556 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.111:0/681907511' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/key"}]: dispatch 2023-12-08T20:22:40.556 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.111:0/681907511' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-08T20:22:40.556 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:40.556 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:40 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:40.622 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-12-08T20:22:40.623 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph config generate-minimal-conf 2023-12-08T20:22:40.657 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:22:40.658 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:22:40.658 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: mon.smithi043 calling monitor election 2023-12-08T20:22:40.658 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/3399795800' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-08T20:22:40.658 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:22:40.658 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:22:40.658 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: mon.smithi111 calling monitor election 2023-12-08T20:22:40.658 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:22:40.658 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:22:40.658 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: from='mgr.? 172.21.15.111:0/681907511' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/crt"}]: dispatch 2023-12-08T20:22:40.658 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:40.658 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:22:40.658 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: mon.smithi043 is new leader, mons smithi043,smithi111 in quorum (ranks 0,1) 2023-12-08T20:22:40.658 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: monmap e2: 2 mons at {smithi043=[v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0],smithi111=[v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-08T20:22:40.658 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: fsmap 2023-12-08T20:22:40.659 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: osdmap e5: 0 total, 0 up, 0 in 2023-12-08T20:22:40.659 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: mgrmap e17: smithi043.hqcdcm(active, since 20s) 2023-12-08T20:22:40.659 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: Standby manager daemon smithi111.mtcffu started 2023-12-08T20:22:40.659 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: from='mgr.? 172.21.15.111:0/681907511' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-08T20:22:40.659 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: overall HEALTH_OK 2023-12-08T20:22:40.659 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: from='mgr.? 172.21.15.111:0/681907511' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/key"}]: dispatch 2023-12-08T20:22:40.659 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: from='mgr.? 172.21.15.111:0/681907511' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-08T20:22:40.659 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:40.659 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:40 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:40.918 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:22:41.455 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:41 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:41.455 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:41 smithi111 ceph-mon[121341]: mgrmap e18: smithi043.hqcdcm(active, since 20s), standbys: smithi111.mtcffu 2023-12-08T20:22:41.455 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:41 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr metadata", "who": "smithi111.mtcffu", "id": "smithi111.mtcffu"}]: dispatch 2023-12-08T20:22:41.455 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:41 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:41.455 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:41 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:41.455 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:41 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:22:41.455 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:41 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:22:41.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:41 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:41.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:41 smithi043 ceph-mon[111966]: mgrmap e18: smithi043.hqcdcm(active, since 20s), standbys: smithi111.mtcffu 2023-12-08T20:22:41.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:41 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr metadata", "who": "smithi111.mtcffu", "id": "smithi111.mtcffu"}]: dispatch 2023-12-08T20:22:41.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:41 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:41.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:41 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:41.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:41 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:22:41.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:41 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:22:42.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.077+0000 7ff3053eb700 1 -- 172.21.15.43:0/572052211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3000fd880 msgr2=0x7ff3000fdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:42.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.077+0000 7ff3053eb700 1 --2- 172.21.15.43:0/572052211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3000fd880 0x7ff3000fdc50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009c60 tx=0x7ff2f0004d10 comp rx=0 tx=0).stop 2023-12-08T20:22:42.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.077+0000 7ff3053eb700 1 -- 172.21.15.43:0/572052211 shutdown_connections 2023-12-08T20:22:42.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.078+0000 7ff3053eb700 1 --2- 172.21.15.43:0/572052211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3000fd880 0x7ff3000fdc50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:42.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.078+0000 7ff3053eb700 1 -- 172.21.15.43:0/572052211 >> 172.21.15.43:0/572052211 conn(0x7ff3000f7310 msgr2=0x7ff3000f9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:42.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.078+0000 7ff3053eb700 1 -- 172.21.15.43:0/572052211 shutdown_connections 2023-12-08T20:22:42.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.078+0000 7ff3053eb700 1 -- 172.21.15.43:0/572052211 wait complete. 2023-12-08T20:22:42.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.078+0000 7ff3053eb700 1 Processor -- start 2023-12-08T20:22:42.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.078+0000 7ff3053eb700 1 -- start start 2023-12-08T20:22:42.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.079+0000 7ff3053eb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3000fd880 0x7ff3000fb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:42.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.079+0000 7ff3053eb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3000fbbf0 0x7ff3000fc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:42.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.079+0000 7ff3053eb700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3001190b0 con 0x7ff3000fd880 2023-12-08T20:22:42.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.079+0000 7ff3053eb700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3001191f0 con 0x7ff3000fbbf0 2023-12-08T20:22:42.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.079+0000 7ff2feffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3000fd880 0x7ff3000fb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:42.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.079+0000 7ff2feffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3000fd880 0x7ff3000fb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57954/0 (socket says 172.21.15.43:57954) 2023-12-08T20:22:42.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.079+0000 7ff2feffd700 1 -- 172.21.15.43:0/3112628974 learned_addr learned my addr 172.21.15.43:0/3112628974 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:22:42.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.079+0000 7ff2fe7fc700 1 --2- 172.21.15.43:0/3112628974 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3000fbbf0 0x7ff3000fc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:42.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.079+0000 7ff2fe7fc700 1 -- 172.21.15.43:0/3112628974 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3000fbbf0 msgr2=0x7ff3000fc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-08T20:22:42.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.079+0000 7ff2feffd700 1 -- 172.21.15.43:0/3112628974 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3000fbbf0 msgr2=0x7ff3000fc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:42.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.079+0000 7ff2fe7fc700 1 -- 172.21.15.43:0/3112628974 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3000fbbf0 msgr2=0x7ff3000fc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-08T20:22:42.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.079+0000 7ff2fe7fc700 1 --2- 172.21.15.43:0/3112628974 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3000fbbf0 0x7ff3000fc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-08T20:22:42.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.079+0000 7ff2fe7fc700 1 --2- 172.21.15.43:0/3112628974 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3000fbbf0 0x7ff3000fc060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:22:42.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.079+0000 7ff2feffd700 1 --2- 172.21.15.43:0/3112628974 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3000fbbf0 0x7ff3000fc060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:42.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.079+0000 7ff2feffd700 1 -- 172.21.15.43:0/3112628974 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f0009940 con 0x7ff3000fd880 2023-12-08T20:22:42.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.079+0000 7ff2feffd700 1 --2- 172.21.15.43:0/3112628974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3000fd880 0x7ff3000fb6b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000be90 tx=0x7ff2f0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:42.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.079+0000 7ff2e77fe700 1 -- 172.21.15.43:0/3112628974 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2f000e040 con 0x7ff3000fd880 2023-12-08T20:22:42.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.080+0000 7ff2e77fe700 1 -- 172.21.15.43:0/3112628974 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff2f00128c0 con 0x7ff3000fd880 2023-12-08T20:22:42.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.080+0000 7ff3053eb700 1 -- 172.21.15.43:0/3112628974 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3001193f0 con 0x7ff3000fd880 2023-12-08T20:22:42.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.080+0000 7ff2e77fe700 1 -- 172.21.15.43:0/3112628974 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2f001c800 con 0x7ff3000fd880 2023-12-08T20:22:42.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.080+0000 7ff3053eb700 1 -- 172.21.15.43:0/3112628974 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff300119900 con 0x7ff3000fd880 2023-12-08T20:22:42.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.081+0000 7ff3053eb700 1 -- 172.21.15.43:0/3112628974 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3001040c0 con 0x7ff3000fd880 2023-12-08T20:22:42.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.081+0000 7ff2e77fe700 1 -- 172.21.15.43:0/3112628974 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7ff2f0012410 con 0x7ff3000fd880 2023-12-08T20:22:42.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.082+0000 7ff2e77fe700 1 --2- 172.21.15.43:0/3112628974 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff2e8069030 0x7ff2e806b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:42.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.082+0000 7ff2e77fe700 1 -- 172.21.15.43:0/3112628974 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7ff2f0087ef0 con 0x7ff3000fd880 2023-12-08T20:22:42.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.082+0000 7ff2fe7fc700 1 --2- 172.21.15.43:0/3112628974 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff2e8069030 0x7ff2e806b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:42.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.082+0000 7ff2fe7fc700 1 --2- 172.21.15.43:0/3112628974 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff2e8069030 0x7ff2e806b4e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4006f30 tx=0x7ff2f4008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:42.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.086+0000 7ff2e77fe700 1 -- 172.21.15.43:0/3112628974 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff2f00554a0 con 0x7ff3000fd880 2023-12-08T20:22:42.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.315+0000 7ff3053eb700 1 -- 172.21.15.43:0/3112628974 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7ff30005f270 con 0x7ff3000fd880 2023-12-08T20:22:42.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.316+0000 7ff2e77fe700 1 -- 172.21.15.43:0/3112628974 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7ff2f002a100 con 0x7ff3000fd880 2023-12-08T20:22:42.316 INFO:teuthology.orchestra.run.smithi043.stdout:# minimal ceph.conf for 28476818-9607-11ee-95a3-87774f69a715 2023-12-08T20:22:42.316 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2023-12-08T20:22:42.316 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = 28476818-9607-11ee-95a3-87774f69a715 2023-12-08T20:22:42.316 INFO:teuthology.orchestra.run.smithi043.stdout: mon_host = [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2023-12-08T20:22:42.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.318+0000 7ff3053eb700 1 -- 172.21.15.43:0/3112628974 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff2e8069030 msgr2=0x7ff2e806b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:42.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.318+0000 7ff3053eb700 1 --2- 172.21.15.43:0/3112628974 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff2e8069030 0x7ff2e806b4e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4006f30 tx=0x7ff2f4008040 comp rx=0 tx=0).stop 2023-12-08T20:22:42.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.318+0000 7ff3053eb700 1 -- 172.21.15.43:0/3112628974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3000fd880 msgr2=0x7ff3000fb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:42.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.318+0000 7ff3053eb700 1 --2- 172.21.15.43:0/3112628974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3000fd880 0x7ff3000fb6b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000be90 tx=0x7ff2f0004d10 comp rx=0 tx=0).stop 2023-12-08T20:22:42.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.318+0000 7ff3053eb700 1 -- 172.21.15.43:0/3112628974 shutdown_connections 2023-12-08T20:22:42.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.318+0000 7ff3053eb700 1 --2- 172.21.15.43:0/3112628974 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff2e8069030 0x7ff2e806b4e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:42.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.318+0000 7ff3053eb700 1 --2- 172.21.15.43:0/3112628974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3000fd880 0x7ff3000fb6b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:42.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.318+0000 7ff3053eb700 1 --2- 172.21.15.43:0/3112628974 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3000fbbf0 0x7ff3000fc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:42.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.318+0000 7ff3053eb700 1 -- 172.21.15.43:0/3112628974 >> 172.21.15.43:0/3112628974 conn(0x7ff3000f7310 msgr2=0x7ff300101240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:42.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.318+0000 7ff3053eb700 1 -- 172.21.15.43:0/3112628974 shutdown_connections 2023-12-08T20:22:42.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:42.318+0000 7ff3053eb700 1 -- 172.21.15.43:0/3112628974 wait complete. 2023-12-08T20:22:42.737 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-12-08T20:22:42.737 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-12-08T20:22:42.737 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.conf 2023-12-08T20:22:42.813 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-12-08T20:22:42.814 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-08T20:22:42.884 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-12-08T20:22:42.885 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.conf 2023-12-08T20:22:42.916 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-12-08T20:22:42.917 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-08T20:22:42.979 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:42 smithi043 ceph-mon[111966]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:42.980 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:42.980 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:42.980 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:42.980 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:22:42.980 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:42 smithi043 ceph-mon[111966]: Updating smithi043:/etc/ceph/ceph.conf 2023-12-08T20:22:42.980 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:42 smithi043 ceph-mon[111966]: Updating smithi111:/etc/ceph/ceph.conf 2023-12-08T20:22:42.980 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:42.980 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:42.980 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:42 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3112628974' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:42.980 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:42.980 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:42.980 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:42.980 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-08T20:22:42.980 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-08T20:22:42.980 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:42.985 INFO:tasks.cephadm:Deploying OSDs... 2023-12-08T20:22:42.985 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-12-08T20:22:42.985 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/scratch_devs of=/dev/stdout 2023-12-08T20:22:43.009 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-08T20:22:43.009 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_1 2023-12-08T20:22:43.072 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-08T20:22:43.072 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T20:22:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 393044 Links: 1 2023-12-08T20:22:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T20:22:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T20:22:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2023-12-08 20:22:10.418830033 +0000 2023-12-08T20:22:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2023-12-08 20:15:07.409905124 +0000 2023-12-08T20:22:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2023-12-08 20:15:07.409905124 +0000 2023-12-08T20:22:43.073 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2023-12-08T20:22:43.073 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-08T20:22:43.146 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2023-12-08T20:22:43.146 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2023-12-08T20:22:43.146 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000123664 s, 4.1 MB/s 2023-12-08T20:22:43.147 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-08T20:22:43.213 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_2 2023-12-08T20:22:43.215 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:42 smithi111 ceph-mon[121341]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:43.215 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:43.215 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:43.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:43.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:22:43.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:42 smithi111 ceph-mon[121341]: Updating smithi043:/etc/ceph/ceph.conf 2023-12-08T20:22:43.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:42 smithi111 ceph-mon[121341]: Updating smithi111:/etc/ceph/ceph.conf 2023-12-08T20:22:43.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:43.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:43.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:42 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/3112628974' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:43.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:43.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:43.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:43.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-08T20:22:43.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-08T20:22:43.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:43.275 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-08T20:22:43.275 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T20:22:43.275 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 393760 Links: 1 2023-12-08T20:22:43.275 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T20:22:43.275 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T20:22:43.275 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2023-12-08 20:22:10.418830033 +0000 2023-12-08T20:22:43.275 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2023-12-08 20:15:08.022897596 +0000 2023-12-08T20:22:43.275 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2023-12-08 20:15:08.022897596 +0000 2023-12-08T20:22:43.275 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2023-12-08T20:22:43.276 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-08T20:22:43.349 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2023-12-08T20:22:43.349 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2023-12-08T20:22:43.349 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000163416 s, 3.1 MB/s 2023-12-08T20:22:43.350 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-08T20:22:43.414 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_3 2023-12-08T20:22:43.479 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-08T20:22:43.479 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T20:22:43.479 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 389100 Links: 1 2023-12-08T20:22:43.479 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T20:22:43.479 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T20:22:43.479 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2023-12-08 20:22:10.418830033 +0000 2023-12-08T20:22:43.479 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2023-12-08 20:15:08.618890275 +0000 2023-12-08T20:22:43.479 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2023-12-08 20:15:08.618890275 +0000 2023-12-08T20:22:43.479 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2023-12-08T20:22:43.480 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-08T20:22:43.552 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2023-12-08T20:22:43.552 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2023-12-08T20:22:43.552 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000111721 s, 4.6 MB/s 2023-12-08T20:22:43.553 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-08T20:22:43.617 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_4 2023-12-08T20:22:43.678 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-08T20:22:43.678 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T20:22:43.678 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 394762 Links: 1 2023-12-08T20:22:43.679 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T20:22:43.679 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T20:22:43.679 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2023-12-08 20:22:10.418830033 +0000 2023-12-08T20:22:43.679 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2023-12-08 20:15:09.211882991 +0000 2023-12-08T20:22:43.679 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2023-12-08 20:15:09.211882991 +0000 2023-12-08T20:22:43.679 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2023-12-08T20:22:43.679 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-08T20:22:43.749 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2023-12-08T20:22:43.749 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2023-12-08T20:22:43.749 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.00011967 s, 4.3 MB/s 2023-12-08T20:22:43.750 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-08T20:22:43.812 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-12-08T20:22:43.812 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/scratch_devs of=/dev/stdout 2023-12-08T20:22:43.835 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-08T20:22:43.835 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_1 2023-12-08T20:22:43.896 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-08T20:22:43.896 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T20:22:43.896 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 395435 Links: 1 2023-12-08T20:22:43.896 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T20:22:43.896 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T20:22:43.897 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2023-12-08 20:22:34.623629875 +0000 2023-12-08T20:22:43.897 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2023-12-08 20:14:20.375416383 +0000 2023-12-08T20:22:43.897 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2023-12-08 20:14:20.375416383 +0000 2023-12-08T20:22:43.897 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2023-12-08T20:22:43.897 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-08T20:22:43.966 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2023-12-08T20:22:43.966 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2023-12-08T20:22:43.967 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000249585 s, 2.1 MB/s 2023-12-08T20:22:43.968 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-08T20:22:44.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:43 smithi043 ceph-mon[111966]: Updating smithi111:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:22:44.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:43 smithi043 ceph-mon[111966]: Updating smithi043:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:22:44.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:43 smithi043 ceph-mon[111966]: Reconfiguring mon.smithi043 (unknown last config time)... 2023-12-08T20:22:44.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:43 smithi043 ceph-mon[111966]: Reconfiguring daemon mon.smithi043 on smithi043 2023-12-08T20:22:44.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:43 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:44.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:43 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:44.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:43 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi043.hqcdcm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-08T20:22:44.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:43 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-08T20:22:44.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:43 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:44.030 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_2 2023-12-08T20:22:44.090 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-08T20:22:44.090 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T20:22:44.090 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 390712 Links: 1 2023-12-08T20:22:44.090 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T20:22:44.090 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T20:22:44.091 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2023-12-08 20:22:34.623629875 +0000 2023-12-08T20:22:44.091 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2023-12-08 20:14:20.901407243 +0000 2023-12-08T20:22:44.091 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2023-12-08 20:14:20.901407243 +0000 2023-12-08T20:22:44.091 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2023-12-08T20:22:44.091 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-08T20:22:44.157 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:43 smithi111 ceph-mon[121341]: Updating smithi111:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:22:44.157 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:43 smithi111 ceph-mon[121341]: Updating smithi043:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:22:44.157 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:43 smithi111 ceph-mon[121341]: Reconfiguring mon.smithi043 (unknown last config time)... 2023-12-08T20:22:44.157 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:43 smithi111 ceph-mon[121341]: Reconfiguring daemon mon.smithi043 on smithi043 2023-12-08T20:22:44.158 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:43 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:44.158 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:43 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:44.158 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:43 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi043.hqcdcm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-08T20:22:44.158 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:43 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-08T20:22:44.158 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:43 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:44.159 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2023-12-08T20:22:44.159 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2023-12-08T20:22:44.159 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000205173 s, 2.5 MB/s 2023-12-08T20:22:44.160 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-08T20:22:44.221 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_3 2023-12-08T20:22:44.280 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-08T20:22:44.280 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T20:22:44.281 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 397476 Links: 1 2023-12-08T20:22:44.281 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T20:22:44.281 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T20:22:44.281 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2023-12-08 20:22:34.624629857 +0000 2023-12-08T20:22:44.281 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2023-12-08 20:14:21.408398434 +0000 2023-12-08T20:22:44.281 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2023-12-08 20:14:21.408398434 +0000 2023-12-08T20:22:44.281 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2023-12-08T20:22:44.281 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-08T20:22:44.348 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2023-12-08T20:22:44.349 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2023-12-08T20:22:44.349 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000221264 s, 2.3 MB/s 2023-12-08T20:22:44.350 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-08T20:22:44.409 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_4 2023-12-08T20:22:44.469 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-08T20:22:44.469 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T20:22:44.469 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 397611 Links: 1 2023-12-08T20:22:44.469 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T20:22:44.469 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T20:22:44.469 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2023-12-08 20:22:34.624629857 +0000 2023-12-08T20:22:44.469 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2023-12-08 20:14:21.947389068 +0000 2023-12-08T20:22:44.469 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2023-12-08 20:14:21.947389068 +0000 2023-12-08T20:22:44.469 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2023-12-08T20:22:44.469 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-08T20:22:44.537 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2023-12-08T20:22:44.537 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2023-12-08T20:22:44.537 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000212185 s, 2.4 MB/s 2023-12-08T20:22:44.538 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-08T20:22:44.597 INFO:tasks.cephadm:Deploying osd.0 on smithi043 with /dev/vg_nvme/lv_4... 2023-12-08T20:22:44.597 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-08T20:22:44.903 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:22:44.965 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:44 smithi111 ceph-mon[121341]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:44.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:44 smithi111 ceph-mon[121341]: Reconfiguring mgr.smithi043.hqcdcm (unknown last config time)... 2023-12-08T20:22:44.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:44 smithi111 ceph-mon[121341]: Reconfiguring daemon mgr.smithi043.hqcdcm on smithi043 2023-12-08T20:22:44.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:44 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:44.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:44 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:44.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:44 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:44.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:44 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi043", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-08T20:22:44.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:44 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:45.028 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:44 smithi043 ceph-mon[111966]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:45.028 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:44 smithi043 ceph-mon[111966]: Reconfiguring mgr.smithi043.hqcdcm (unknown last config time)... 2023-12-08T20:22:45.028 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:44 smithi043 ceph-mon[111966]: Reconfiguring daemon mgr.smithi043.hqcdcm on smithi043 2023-12-08T20:22:45.028 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:44 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:45.028 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:44 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:45.028 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:44 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:45.028 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:44 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi043", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-08T20:22:45.029 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:44 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:45.959 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:45 smithi043 ceph-mon[111966]: Reconfiguring crash.smithi043 (monmap changed)... 2023-12-08T20:22:45.959 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:45 smithi043 ceph-mon[111966]: Reconfiguring daemon crash.smithi043 on smithi043 2023-12-08T20:22:46.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:45 smithi111 ceph-mon[121341]: Reconfiguring crash.smithi043 (monmap changed)... 2023-12-08T20:22:46.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:45 smithi111 ceph-mon[121341]: Reconfiguring daemon crash.smithi043 on smithi043 2023-12-08T20:22:46.643 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-08T20:22:46.643 INFO:teuthology.orchestra.run.smithi043.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-08T20:22:46.644 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10+0 records in 2023-12-08T20:22:46.644 INFO:teuthology.orchestra.run.smithi043.stderr:10+0 records out 2023-12-08T20:22:46.644 INFO:teuthology.orchestra.run.smithi043.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00908305 s, 1.2 GB/s 2023-12-08T20:22:46.644 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping successful for: 2023-12-08T20:22:47.377 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:47 smithi043 ceph-mon[111966]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:47.377 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:47 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:47.377 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:47 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:47.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:47 smithi111 ceph-mon[121341]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:47.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:47 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:47.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:47 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:47.642 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi043:vg_nvme/lv_4 2023-12-08T20:22:47.998 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:22:48.165 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:48 smithi043 ceph-mon[111966]: Reconfiguring alertmanager.smithi043 (dependencies changed)... 2023-12-08T20:22:48.166 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:48 smithi043 ceph-mon[111966]: Reconfiguring daemon alertmanager.smithi043 on smithi043 2023-12-08T20:22:48.465 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:48 smithi111 ceph-mon[121341]: Reconfiguring alertmanager.smithi043 (dependencies changed)... 2023-12-08T20:22:48.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:48 smithi111 ceph-mon[121341]: Reconfiguring daemon alertmanager.smithi043 on smithi043 2023-12-08T20:22:49.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.308+0000 7fd74b695700 1 -- 172.21.15.43:0/1040559054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7440fcd10 msgr2=0x7fd7440fd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:49.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.308+0000 7fd74b695700 1 --2- 172.21.15.43:0/1040559054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7440fcd10 0x7fd7440fd160 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd734004940 tx=0x7fd734009e30 comp rx=0 tx=0).stop 2023-12-08T20:22:49.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.308+0000 7fd74b695700 1 -- 172.21.15.43:0/1040559054 shutdown_connections 2023-12-08T20:22:49.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.308+0000 7fd74b695700 1 --2- 172.21.15.43:0/1040559054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7440fcd10 0x7fd7440fd160 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:49.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.308+0000 7fd74b695700 1 --2- 172.21.15.43:0/1040559054 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7440fbb00 0x7fd7440fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:49.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.308+0000 7fd74b695700 1 -- 172.21.15.43:0/1040559054 >> 172.21.15.43:0/1040559054 conn(0x7fd7440f71c0 msgr2=0x7fd7440f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:22:49.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.308+0000 7fd74b695700 1 -- 172.21.15.43:0/1040559054 shutdown_connections 2023-12-08T20:22:49.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.308+0000 7fd74b695700 1 -- 172.21.15.43:0/1040559054 wait complete. 2023-12-08T20:22:49.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.309+0000 7fd74b695700 1 Processor -- start 2023-12-08T20:22:49.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.309+0000 7fd74b695700 1 -- start start 2023-12-08T20:22:49.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.309+0000 7fd74b695700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7440fbb00 0x7fd744112690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:49.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.309+0000 7fd74b695700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7440fcd10 0x7fd744114be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:49.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.309+0000 7fd74b695700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd744066890 con 0x7fd7440fcd10 2023-12-08T20:22:49.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.309+0000 7fd74b695700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7440669d0 con 0x7fd7440fbb00 2023-12-08T20:22:49.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.309+0000 7fd748c30700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7440fcd10 0x7fd744114be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:49.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.309+0000 7fd748c30700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7440fcd10 0x7fd744114be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57970/0 (socket says 172.21.15.43:57970) 2023-12-08T20:22:49.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.309+0000 7fd748c30700 1 -- 172.21.15.43:0/3660548565 learned_addr learned my addr 172.21.15.43:0/3660548565 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:22:49.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.310+0000 7fd749431700 1 --2- 172.21.15.43:0/3660548565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7440fbb00 0x7fd744112690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:49.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.310+0000 7fd748c30700 1 -- 172.21.15.43:0/3660548565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7440fbb00 msgr2=0x7fd744112690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:22:49.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.310+0000 7fd748c30700 1 --2- 172.21.15.43:0/3660548565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7440fbb00 0x7fd744112690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:22:49.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.310+0000 7fd748c30700 1 -- 172.21.15.43:0/3660548565 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd734005040 con 0x7fd7440fcd10 2023-12-08T20:22:49.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.310+0000 7fd749431700 1 --2- 172.21.15.43:0/3660548565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7440fbb00 0x7fd744112690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:22:49.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.310+0000 7fd748c30700 1 --2- 172.21.15.43:0/3660548565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7440fcd10 0x7fd744114be0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd734009380 tx=0x7fd734009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:49.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.310+0000 7fd739ffb700 1 -- 172.21.15.43:0/3660548565 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd73400e040 con 0x7fd7440fcd10 2023-12-08T20:22:49.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.310+0000 7fd739ffb700 1 -- 172.21.15.43:0/3660548565 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd73400bda0 con 0x7fd7440fcd10 2023-12-08T20:22:49.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.310+0000 7fd74b695700 1 -- 172.21.15.43:0/3660548565 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd744115120 con 0x7fd7440fcd10 2023-12-08T20:22:49.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.310+0000 7fd739ffb700 1 -- 172.21.15.43:0/3660548565 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd73401c630 con 0x7fd7440fcd10 2023-12-08T20:22:49.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.310+0000 7fd74b695700 1 -- 172.21.15.43:0/3660548565 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd744115580 con 0x7fd7440fcd10 2023-12-08T20:22:49.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.312+0000 7fd74b695700 1 -- 172.21.15.43:0/3660548565 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd74404bb80 con 0x7fd7440fcd10 2023-12-08T20:22:49.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.312+0000 7fd739ffb700 1 -- 172.21.15.43:0/3660548565 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7fd7340139d0 con 0x7fd7440fcd10 2023-12-08T20:22:49.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.312+0000 7fd739ffb700 1 --2- 172.21.15.43:0/3660548565 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fd730068ed0 0x7fd73006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:22:49.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.313+0000 7fd739ffb700 1 -- 172.21.15.43:0/3660548565 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fd7340870f0 con 0x7fd7440fcd10 2023-12-08T20:22:49.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.313+0000 7fd749431700 1 --2- 172.21.15.43:0/3660548565 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fd730068ed0 0x7fd73006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:22:49.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.313+0000 7fd749431700 1 --2- 172.21.15.43:0/3660548565 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fd730068ed0 0x7fd73006b380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd744066620 tx=0x7fd740008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:22:49.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.317+0000 7fd739ffb700 1 -- 172.21.15.43:0/3660548565 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd7340546a0 con 0x7fd7440fcd10 2023-12-08T20:22:49.465 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:49 smithi111 ceph-mon[121341]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:49.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:49 smithi043 ceph-mon[111966]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:49.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:22:49.554+0000 7fd74b695700 1 -- 172.21.15.43:0/3660548565 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd744101660 con 0x7fd730068ed0 2023-12-08T20:22:50.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:50 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:22:50.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:50 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-08T20:22:50.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:50 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-08T20:22:50.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:50 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:50.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:50 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:50.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:50 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:50.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:50 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:22:50.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:50 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-08T20:22:50.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:50 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-08T20:22:50.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:50 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:22:50.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:50 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:50.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:50 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:51.058 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:51 smithi043 ceph-mon[111966]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:51.058 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:51 smithi043 ceph-mon[111966]: from='client.14240 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:22:51.058 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:51 smithi043 ceph-mon[111966]: Reconfiguring grafana.smithi043 (dependencies changed)... 2023-12-08T20:22:51.058 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:51 smithi043 ceph-mon[111966]: Reconfiguring daemon grafana.smithi043 on smithi043 2023-12-08T20:22:51.465 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:51 smithi111 ceph-mon[121341]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:51.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:51 smithi111 ceph-mon[121341]: from='client.14240 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:22:51.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:51 smithi111 ceph-mon[121341]: Reconfiguring grafana.smithi043 (dependencies changed)... 2023-12-08T20:22:51.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:51 smithi111 ceph-mon[121341]: Reconfiguring daemon grafana.smithi043 on smithi043 2023-12-08T20:22:53.214 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:53 smithi043 ceph-mon[111966]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:53.215 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:53 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:53.215 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:53 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:53.465 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:53 smithi111 ceph-mon[121341]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:53.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:53 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:53.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:53 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:22:54.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:54 smithi111 ceph-mon[121341]: Reconfiguring prometheus.smithi043 (dependencies changed)... 2023-12-08T20:22:54.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:54 smithi111 ceph-mon[121341]: Reconfiguring daemon prometheus.smithi043 on smithi043 2023-12-08T20:22:54.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:54 smithi043 ceph-mon[111966]: Reconfiguring prometheus.smithi043 (dependencies changed)... 2023-12-08T20:22:54.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:54 smithi043 ceph-mon[111966]: Reconfiguring daemon prometheus.smithi043 on smithi043 2023-12-08T20:22:55.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:55 smithi111 ceph-mon[121341]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:55.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:55 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/4098956425' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c82b664-c209-4a61-8b21-c5d6a73af81e"}]: dispatch 2023-12-08T20:22:55.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:55 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/4098956425' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5c82b664-c209-4a61-8b21-c5d6a73af81e"}]': finished 2023-12-08T20:22:55.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:55 smithi111 ceph-mon[121341]: osdmap e6: 1 total, 0 up, 1 in 2023-12-08T20:22:55.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:55 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:22:55.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:55 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/3839736187' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-08T20:22:55.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:55 smithi043 ceph-mon[111966]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:55.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:55 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/4098956425' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c82b664-c209-4a61-8b21-c5d6a73af81e"}]: dispatch 2023-12-08T20:22:55.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:55 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/4098956425' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5c82b664-c209-4a61-8b21-c5d6a73af81e"}]': finished 2023-12-08T20:22:55.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:55 smithi043 ceph-mon[111966]: osdmap e6: 1 total, 0 up, 1 in 2023-12-08T20:22:55.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:55 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:22:55.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:55 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3839736187' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-08T20:22:56.715 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:56 smithi111 ceph-mon[121341]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:56.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:56 smithi043 ceph-mon[111966]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:58.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:22:58 smithi043 ceph-mon[111966]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:22:58.965 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:22:58 smithi111 ceph-mon[121341]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:23:00.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:00 smithi043 ceph-mon[111966]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:23:00.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:00 smithi111 ceph-mon[121341]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:23:02.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:02 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:02.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:02 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:02.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:02 smithi043 ceph-mon[111966]: Reconfiguring crash.smithi111 (monmap changed)... 2023-12-08T20:23:02.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:02 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-08T20:23:02.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:02 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:02.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:02 smithi043 ceph-mon[111966]: Reconfiguring daemon crash.smithi111 on smithi111 2023-12-08T20:23:02.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:02 smithi043 ceph-mon[111966]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:23:02.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:02 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:02.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:02 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:02.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:02 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.mtcffu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-08T20:23:02.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:02 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-08T20:23:02.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:02 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:02.579 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:02 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:02.579 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:02 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:02.579 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:02 smithi111 ceph-mon[121341]: Reconfiguring crash.smithi111 (monmap changed)... 2023-12-08T20:23:02.579 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:02 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-08T20:23:02.579 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:02 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:02.579 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:02 smithi111 ceph-mon[121341]: Reconfiguring daemon crash.smithi111 on smithi111 2023-12-08T20:23:02.579 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:02 smithi111 ceph-mon[121341]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:23:02.579 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:02 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:02.579 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:02 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:02.580 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:02 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.mtcffu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-08T20:23:02.580 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:02 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-08T20:23:02.580 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:02 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:03.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:03 smithi043 ceph-mon[111966]: Reconfiguring mgr.smithi111.mtcffu (monmap changed)... 2023-12-08T20:23:03.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:03 smithi043 ceph-mon[111966]: Reconfiguring daemon mgr.smithi111.mtcffu on smithi111 2023-12-08T20:23:03.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:03 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-08T20:23:03.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:03 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:03.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:03 smithi043 ceph-mon[111966]: Deploying daemon osd.0 on smithi043 2023-12-08T20:23:03.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:03 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:03.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:03 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:03.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:03 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-08T20:23:03.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:03 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-08T20:23:03.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:03 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:03.552 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:03 smithi111 ceph-mon[121341]: Reconfiguring mgr.smithi111.mtcffu (monmap changed)... 2023-12-08T20:23:03.552 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:03 smithi111 ceph-mon[121341]: Reconfiguring daemon mgr.smithi111.mtcffu on smithi111 2023-12-08T20:23:03.552 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:03 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-08T20:23:03.552 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:03 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:03.552 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:03 smithi111 ceph-mon[121341]: Deploying daemon osd.0 on smithi043 2023-12-08T20:23:03.552 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:03 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:03.552 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:03 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:03.552 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:03 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-08T20:23:03.552 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:03 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-08T20:23:03.552 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:03 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:04.653 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:04 smithi043 ceph-mon[111966]: Reconfiguring mon.smithi111 (monmap changed)... 2023-12-08T20:23:04.653 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:04 smithi043 ceph-mon[111966]: Reconfiguring daemon mon.smithi111 on smithi111 2023-12-08T20:23:04.653 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:04 smithi043 ceph-mon[111966]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:23:04.653 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:04.653 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:04.654 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-08T20:23:04.654 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi043.front.sepia.ceph.com:9093"}]: dispatch 2023-12-08T20:23:04.654 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:04.654 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-08T20:23:04.654 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi043.front.sepia.ceph.com:3000"}]: dispatch 2023-12-08T20:23:04.654 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:04.654 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-08T20:23:04.654 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi043.front.sepia.ceph.com:9095"}]: dispatch 2023-12-08T20:23:04.654 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:04.654 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:23:04.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:04 smithi111 ceph-mon[121341]: Reconfiguring mon.smithi111 (monmap changed)... 2023-12-08T20:23:04.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:04 smithi111 ceph-mon[121341]: Reconfiguring daemon mon.smithi111 on smithi111 2023-12-08T20:23:04.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:04 smithi111 ceph-mon[121341]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:23:04.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:04.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:04.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-08T20:23:04.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi043.front.sepia.ceph.com:9093"}]: dispatch 2023-12-08T20:23:04.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:04.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-08T20:23:04.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi043.front.sepia.ceph.com:3000"}]: dispatch 2023-12-08T20:23:04.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:04.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-08T20:23:04.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi043.front.sepia.ceph.com:9095"}]: dispatch 2023-12-08T20:23:04.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:04.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:23:05.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:05 smithi111 ceph-mon[121341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-08T20:23:05.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:05 smithi111 ceph-mon[121341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi043.front.sepia.ceph.com:9093"}]: dispatch 2023-12-08T20:23:05.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:05 smithi111 ceph-mon[121341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-08T20:23:05.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:05 smithi111 ceph-mon[121341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi043.front.sepia.ceph.com:3000"}]: dispatch 2023-12-08T20:23:05.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:05 smithi111 ceph-mon[121341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-08T20:23:05.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:05 smithi111 ceph-mon[121341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi043.front.sepia.ceph.com:9095"}]: dispatch 2023-12-08T20:23:05.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:05 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:23:05.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:05 smithi043 ceph-mon[111966]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-08T20:23:05.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:05 smithi043 ceph-mon[111966]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi043.front.sepia.ceph.com:9093"}]: dispatch 2023-12-08T20:23:05.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:05 smithi043 ceph-mon[111966]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-08T20:23:05.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:05 smithi043 ceph-mon[111966]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi043.front.sepia.ceph.com:3000"}]: dispatch 2023-12-08T20:23:05.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:05 smithi043 ceph-mon[111966]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-08T20:23:05.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:05 smithi043 ceph-mon[111966]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi043.front.sepia.ceph.com:9095"}]: dispatch 2023-12-08T20:23:05.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:05 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:23:06.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:06 smithi043 ceph-mon[111966]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:23:06.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:06 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:06.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:06 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:06.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:06 smithi111 ceph-mon[121341]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:23:06.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:06 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:06.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:06 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:08.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:07 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:08.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:07 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:08.224 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:07 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:08.224 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:07 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:09.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:08 smithi111 ceph-mon[121341]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:23:09.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:08 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:09.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:08 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:09.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:08 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:09.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:08 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:23:09.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:08 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:09.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:08 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:23:09.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:08 smithi043 ceph-mon[111966]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:23:09.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:08 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:09.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:08 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:09.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:08 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:09.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:08 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:23:09.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:08 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:09.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:08 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:23:09.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:09.613+0000 7fd739ffb700 1 -- 172.21.15.43:0/3660548565 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd744101660 con 0x7fd730068ed0 2023-12-08T20:23:09.614 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 0 on host 'smithi043' 2023-12-08T20:23:09.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:09.616+0000 7fd74b695700 1 -- 172.21.15.43:0/3660548565 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fd730068ed0 msgr2=0x7fd73006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:23:09.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:09.616+0000 7fd74b695700 1 --2- 172.21.15.43:0/3660548565 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fd730068ed0 0x7fd73006b380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd744066620 tx=0x7fd740008040 comp rx=0 tx=0).stop 2023-12-08T20:23:09.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:09.616+0000 7fd74b695700 1 -- 172.21.15.43:0/3660548565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7440fcd10 msgr2=0x7fd744114be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:23:09.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:09.616+0000 7fd74b695700 1 --2- 172.21.15.43:0/3660548565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7440fcd10 0x7fd744114be0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd734009380 tx=0x7fd734009e30 comp rx=0 tx=0).stop 2023-12-08T20:23:09.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:09.616+0000 7fd74b695700 1 -- 172.21.15.43:0/3660548565 shutdown_connections 2023-12-08T20:23:09.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:09.616+0000 7fd74b695700 1 --2- 172.21.15.43:0/3660548565 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fd730068ed0 0x7fd73006b380 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:23:09.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:09.616+0000 7fd74b695700 1 --2- 172.21.15.43:0/3660548565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7440fbb00 0x7fd744112690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:23:09.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:09.616+0000 7fd74b695700 1 --2- 172.21.15.43:0/3660548565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7440fcd10 0x7fd744114be0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:23:09.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:09.616+0000 7fd74b695700 1 -- 172.21.15.43:0/3660548565 >> 172.21.15.43:0/3660548565 conn(0x7fd7440f71c0 msgr2=0x7fd7440fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:23:09.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:09.616+0000 7fd74b695700 1 -- 172.21.15.43:0/3660548565 shutdown_connections 2023-12-08T20:23:09.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:09.616+0000 7fd74b695700 1 -- 172.21.15.43:0/3660548565 wait complete. 2023-12-08T20:23:10.304 DEBUG:teuthology.orchestra.run.smithi043:osd.0> sudo journalctl -f -n 0 -u ceph-28476818-9607-11ee-95a3-87774f69a715@osd.0.service 2023-12-08T20:23:10.306 INFO:tasks.cephadm:Deploying osd.1 on smithi043 with /dev/vg_nvme/lv_3... 2023-12-08T20:23:10.306 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-08T20:23:10.342 INFO:journalctl@ceph.osd.0.smithi043.stdout:-- Logs begin at Fri 2023-12-08 20:06:41 UTC. -- 2023-12-08T20:23:10.652 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:23:10.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:10 smithi111 ceph-mon[121341]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:23:10.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:10 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:10.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:10 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:10.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:10 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:10.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:10 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:10.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:10 smithi111 ceph-mon[121341]: from='osd.0 [v2:172.21.15.43:6802/3312385732,v1:172.21.15.43:6803/3312385732]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-08T20:23:10.985 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:23:10 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-0[136255]: 2023-12-08T20:23:10.579+0000 7faff29ae540 -1 osd.0 0 log_to_monitors true 2023-12-08T20:23:10.986 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:10 smithi043 ceph-mon[111966]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:23:10.986 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:10 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:10.986 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:10 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:10.986 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:10 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:10.986 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:10 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:10.986 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:10 smithi043 ceph-mon[111966]: from='osd.0 [v2:172.21.15.43:6802/3312385732,v1:172.21.15.43:6803/3312385732]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-08T20:23:12.452 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-08T20:23:12.452 INFO:teuthology.orchestra.run.smithi043.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-08T20:23:12.452 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10+0 records in 2023-12-08T20:23:12.452 INFO:teuthology.orchestra.run.smithi043.stderr:10+0 records out 2023-12-08T20:23:12.452 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0140948 s, 744 MB/s 2023-12-08T20:23:12.452 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping successful for: 2023-12-08T20:23:12.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:12 smithi111 ceph-mon[121341]: from='osd.0 [v2:172.21.15.43:6802/3312385732,v1:172.21.15.43:6803/3312385732]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-08T20:23:12.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:12 smithi111 ceph-mon[121341]: osdmap e7: 1 total, 0 up, 1 in 2023-12-08T20:23:12.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:12 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:23:12.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:12 smithi111 ceph-mon[121341]: from='osd.0 [v2:172.21.15.43:6802/3312385732,v1:172.21.15.43:6803/3312385732]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2023-12-08T20:23:12.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:12 smithi111 ceph-mon[121341]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:23:12.736 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:23:12 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-0[136255]: 2023-12-08T20:23:12.410+0000 7fafe9193700 -1 osd.0 0 waiting for initial osdmap 2023-12-08T20:23:12.736 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:23:12 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-0[136255]: 2023-12-08T20:23:12.427+0000 7fafe2f8c700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:23:12.737 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:12 smithi043 ceph-mon[111966]: from='osd.0 [v2:172.21.15.43:6802/3312385732,v1:172.21.15.43:6803/3312385732]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-08T20:23:12.737 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:12 smithi043 ceph-mon[111966]: osdmap e7: 1 total, 0 up, 1 in 2023-12-08T20:23:12.737 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:12 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:23:12.737 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:12 smithi043 ceph-mon[111966]: from='osd.0 [v2:172.21.15.43:6802/3312385732,v1:172.21.15.43:6803/3312385732]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2023-12-08T20:23:12.737 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:12 smithi043 ceph-mon[111966]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:23:12.807 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi043:vg_nvme/lv_3 2023-12-08T20:23:13.286 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:23:13.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:13 smithi043 ceph-mon[111966]: from='osd.0 [v2:172.21.15.43:6802/3312385732,v1:172.21.15.43:6803/3312385732]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2023-12-08T20:23:13.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:13 smithi043 ceph-mon[111966]: osdmap e8: 1 total, 0 up, 1 in 2023-12-08T20:23:13.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:13 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:23:13.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:13 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:23:13.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:13 smithi111 ceph-mon[121341]: from='osd.0 [v2:172.21.15.43:6802/3312385732,v1:172.21.15.43:6803/3312385732]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2023-12-08T20:23:13.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:13 smithi111 ceph-mon[121341]: osdmap e8: 1 total, 0 up, 1 in 2023-12-08T20:23:13.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:13 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:23:13.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:13 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:23:14.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:14 smithi111 ceph-mon[121341]: purged_snaps scrub starts 2023-12-08T20:23:14.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:14 smithi111 ceph-mon[121341]: purged_snaps scrub ok 2023-12-08T20:23:14.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:14 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:23:14.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:14 smithi111 ceph-mon[121341]: osd.0 [v2:172.21.15.43:6802/3312385732,v1:172.21.15.43:6803/3312385732] boot 2023-12-08T20:23:14.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:14 smithi111 ceph-mon[121341]: osdmap e9: 1 total, 1 up, 1 in 2023-12-08T20:23:14.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:14 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:23:14.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:14 smithi111 ceph-mon[121341]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:23:14.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:14 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:14.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:14 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:14.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:14 smithi043 ceph-mon[111966]: purged_snaps scrub starts 2023-12-08T20:23:14.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:14 smithi043 ceph-mon[111966]: purged_snaps scrub ok 2023-12-08T20:23:14.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:14 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:23:14.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:14 smithi043 ceph-mon[111966]: osd.0 [v2:172.21.15.43:6802/3312385732,v1:172.21.15.43:6803/3312385732] boot 2023-12-08T20:23:14.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:14 smithi043 ceph-mon[111966]: osdmap e9: 1 total, 1 up, 1 in 2023-12-08T20:23:14.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:14 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:23:14.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:14 smithi043 ceph-mon[111966]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-08T20:23:14.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:14 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:14.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:14 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.853+0000 7f8193092700 1 -- 172.21.15.43:0/3970485305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f818c0fee00 msgr2=0x7f818c0ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:23:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.853+0000 7f8193092700 1 --2- 172.21.15.43:0/3970485305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f818c0fee00 0x7f818c0ff210 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8180004940 tx=0x7f8180009e30 comp rx=0 tx=0).stop 2023-12-08T20:23:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.854+0000 7f8193092700 1 -- 172.21.15.43:0/3970485305 shutdown_connections 2023-12-08T20:23:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.854+0000 7f8193092700 1 --2- 172.21.15.43:0/3970485305 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f818c0fff70 0x7f818c1003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:23:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.854+0000 7f8193092700 1 --2- 172.21.15.43:0/3970485305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f818c0fee00 0x7f818c0ff210 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:23:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.854+0000 7f8193092700 1 -- 172.21.15.43:0/3970485305 >> 172.21.15.43:0/3970485305 conn(0x7f818c0fa5d0 msgr2=0x7f818c0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:23:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.854+0000 7f8193092700 1 -- 172.21.15.43:0/3970485305 shutdown_connections 2023-12-08T20:23:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.854+0000 7f8193092700 1 -- 172.21.15.43:0/3970485305 wait complete. 2023-12-08T20:23:14.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.854+0000 7f8193092700 1 Processor -- start 2023-12-08T20:23:14.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.854+0000 7f8193092700 1 -- start start 2023-12-08T20:23:14.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.855+0000 7f8193092700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f818c0fee00 0x7f818c10f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:23:14.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.855+0000 7f8193092700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f818c0fff70 0x7f818c10fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:23:14.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.855+0000 7f8193092700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c110250 con 0x7f818c0fff70 2023-12-08T20:23:14.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.855+0000 7f8193092700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c110af0 con 0x7f818c0fee00 2023-12-08T20:23:14.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.855+0000 7f818bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f818c0fff70 0x7f818c10fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:23:14.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.855+0000 7f818bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f818c0fff70 0x7f818c10fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51704/0 (socket says 172.21.15.43:51704) 2023-12-08T20:23:14.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.855+0000 7f818bfff700 1 -- 172.21.15.43:0/3449263157 learned_addr learned my addr 172.21.15.43:0/3449263157 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:23:14.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.855+0000 7f8190e2e700 1 --2- 172.21.15.43:0/3449263157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f818c0fee00 0x7f818c10f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:23:14.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.855+0000 7f818bfff700 1 -- 172.21.15.43:0/3449263157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f818c0fee00 msgr2=0x7f818c10f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:23:14.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.855+0000 7f818bfff700 1 --2- 172.21.15.43:0/3449263157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f818c0fee00 0x7f818c10f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:23:14.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.855+0000 7f818bfff700 1 -- 172.21.15.43:0/3449263157 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8180005040 con 0x7f818c0fff70 2023-12-08T20:23:14.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.855+0000 7f8190e2e700 1 --2- 172.21.15.43:0/3449263157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f818c0fee00 0x7f818c10f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:23:14.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.855+0000 7f818bfff700 1 --2- 172.21.15.43:0/3449263157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f818c0fff70 0x7f818c10fc50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f817800eb40 tx=0x7f817800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:23:14.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.855+0000 7f81897fa700 1 -- 172.21.15.43:0/3449263157 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8178007cc0 con 0x7f818c0fff70 2023-12-08T20:23:14.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.855+0000 7f81897fa700 1 -- 172.21.15.43:0/3449263157 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f817800f040 con 0x7f818c0fff70 2023-12-08T20:23:14.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.855+0000 7f8193092700 1 -- 172.21.15.43:0/3449263157 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818c110d70 con 0x7f818c0fff70 2023-12-08T20:23:14.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.855+0000 7f81897fa700 1 -- 172.21.15.43:0/3449263157 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8178009570 con 0x7f818c0fff70 2023-12-08T20:23:14.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.855+0000 7f8193092700 1 -- 172.21.15.43:0/3449263157 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818c1112b0 con 0x7f818c0fff70 2023-12-08T20:23:14.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.857+0000 7f8193092700 1 -- 172.21.15.43:0/3449263157 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818c04bb80 con 0x7f818c0fff70 2023-12-08T20:23:14.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.857+0000 7f81897fa700 1 -- 172.21.15.43:0/3449263157 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f81780096d0 con 0x7f818c0fff70 2023-12-08T20:23:14.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.857+0000 7f81897fa700 1 --2- 172.21.15.43:0/3449263157 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f817c068ed0 0x7f817c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:23:14.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.858+0000 7f81897fa700 1 -- 172.21.15.43:0/3449263157 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f8178085ac0 con 0x7f818c0fff70 2023-12-08T20:23:14.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.858+0000 7f8190e2e700 1 --2- 172.21.15.43:0/3449263157 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f817c068ed0 0x7f817c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:23:14.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.858+0000 7f8190e2e700 1 --2- 172.21.15.43:0/3449263157 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f817c068ed0 0x7f817c06b380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8180009fd0 tx=0x7f8180009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:23:14.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:14.862+0000 7f81897fa700 1 -- 172.21.15.43:0/3449263157 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f817804da00 con 0x7f818c0fff70 2023-12-08T20:23:15.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:15.085+0000 7f8193092700 1 -- 172.21.15.43:0/3449263157 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f818c111750 con 0x7f817c068ed0 2023-12-08T20:23:15.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:15 smithi111 ceph-mon[121341]: osdmap e10: 1 total, 1 up, 1 in 2023-12-08T20:23:15.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:15 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-08T20:23:15.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:15 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-08T20:23:15.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:15 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:15.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:15 smithi043 ceph-mon[111966]: osdmap e10: 1 total, 1 up, 1 in 2023-12-08T20:23:15.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:15 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-08T20:23:15.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:15 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-08T20:23:15.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:15 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:16.426 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:16 smithi043 ceph-mon[111966]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:23:16.426 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:16 smithi043 ceph-mon[111966]: pgmap v26: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:16.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:16 smithi111 ceph-mon[121341]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:23:16.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:16 smithi111 ceph-mon[121341]: pgmap v26: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:17.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:17 smithi111 ceph-mon[121341]: Detected new or changed devices on smithi043 2023-12-08T20:23:17.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:17 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:17.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:17 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:17.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:17 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:23:17.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:17 smithi111 ceph-mon[121341]: Adjusting osd_memory_target on smithi043 to 12902M 2023-12-08T20:23:17.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:17 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:17.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:17 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:17.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:17 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:23:17.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:17 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:17.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:17 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:23:17.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:17 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/1279209901' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "301dfde9-c50a-4f73-856f-ae88dc2d2d7b"}]: dispatch 2023-12-08T20:23:17.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:17 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/1279209901' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "301dfde9-c50a-4f73-856f-ae88dc2d2d7b"}]': finished 2023-12-08T20:23:17.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:17 smithi111 ceph-mon[121341]: osdmap e11: 2 total, 1 up, 2 in 2023-12-08T20:23:17.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:17 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-08T20:23:18.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:17 smithi043 ceph-mon[111966]: Detected new or changed devices on smithi043 2023-12-08T20:23:18.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:17 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:18.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:17 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:18.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:17 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:23:18.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:17 smithi043 ceph-mon[111966]: Adjusting osd_memory_target on smithi043 to 12902M 2023-12-08T20:23:18.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:17 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:18.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:17 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:18.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:17 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:23:18.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:17 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:18.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:17 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:23:18.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:17 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/1279209901' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "301dfde9-c50a-4f73-856f-ae88dc2d2d7b"}]: dispatch 2023-12-08T20:23:18.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:17 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/1279209901' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "301dfde9-c50a-4f73-856f-ae88dc2d2d7b"}]': finished 2023-12-08T20:23:18.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:17 smithi043 ceph-mon[111966]: osdmap e11: 2 total, 1 up, 2 in 2023-12-08T20:23:18.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:17 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-08T20:23:19.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:19 smithi111 ceph-mon[121341]: pgmap v27: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:19.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:19 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:19.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:19 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:19.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:19 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/4236600324' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-08T20:23:19.503 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:19 smithi043 ceph-mon[111966]: pgmap v27: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:19.503 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:19 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:19.503 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:19 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:19.503 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:19 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/4236600324' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-08T20:23:20.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:20 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:23:20.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:20 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:20.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:20 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:20.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:20 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:20.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:20 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:23:20.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:20 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:20.516 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:23:20.516 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:20.516 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:20.516 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:20.516 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:23:20.516 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:21.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:21 smithi111 ceph-mon[121341]: pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:21.482 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:21 smithi043 ceph-mon[111966]: pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:23.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:23 smithi111 ceph-mon[121341]: pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:23.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:23 smithi043 ceph-mon[111966]: pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:24.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:24 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-08T20:23:24.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:24 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:24.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:24 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-08T20:23:24.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:24 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:25.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:25 smithi043 ceph-mon[111966]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:25.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:25 smithi043 ceph-mon[111966]: Deploying daemon osd.1 on smithi043 2023-12-08T20:23:25.465 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:25 smithi111 ceph-mon[121341]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:25.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:25 smithi111 ceph-mon[121341]: Deploying daemon osd.1 on smithi043 2023-12-08T20:23:26.439 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:26 smithi043 ceph-mon[111966]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:26.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:26 smithi111 ceph-mon[121341]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:28.736 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:28 smithi043 ceph-mon[111966]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:28.737 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:28 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:28.737 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:28 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:28.737 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:28 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:23:28.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:28 smithi111 ceph-mon[121341]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:28.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:28 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:28.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:28 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:28.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:28 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:23:30.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:30.586+0000 7f81897fa700 1 -- 172.21.15.43:0/3449263157 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f818c111750 con 0x7f817c068ed0 2023-12-08T20:23:30.588 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 1 on host 'smithi043' 2023-12-08T20:23:30.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:30.588+0000 7f8193092700 1 -- 172.21.15.43:0/3449263157 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f817c068ed0 msgr2=0x7f817c06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:23:30.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:30.589+0000 7f8193092700 1 --2- 172.21.15.43:0/3449263157 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f817c068ed0 0x7f817c06b380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8180009fd0 tx=0x7f8180009e30 comp rx=0 tx=0).stop 2023-12-08T20:23:30.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:30.589+0000 7f8193092700 1 -- 172.21.15.43:0/3449263157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f818c0fff70 msgr2=0x7f818c10fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:23:30.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:30.589+0000 7f8193092700 1 --2- 172.21.15.43:0/3449263157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f818c0fff70 0x7f818c10fc50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f817800eb40 tx=0x7f817800b040 comp rx=0 tx=0).stop 2023-12-08T20:23:30.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:30.589+0000 7f8193092700 1 -- 172.21.15.43:0/3449263157 shutdown_connections 2023-12-08T20:23:30.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:30.589+0000 7f8193092700 1 --2- 172.21.15.43:0/3449263157 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f817c068ed0 0x7f817c06b380 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:23:30.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:30.589+0000 7f8193092700 1 --2- 172.21.15.43:0/3449263157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f818c0fee00 0x7f818c10f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:23:30.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:30.589+0000 7f8193092700 1 --2- 172.21.15.43:0/3449263157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f818c0fff70 0x7f818c10fc50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:23:30.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:30.589+0000 7f8193092700 1 -- 172.21.15.43:0/3449263157 >> 172.21.15.43:0/3449263157 conn(0x7f818c0fa5d0 msgr2=0x7f818c103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:23:30.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:30.589+0000 7f8193092700 1 -- 172.21.15.43:0/3449263157 shutdown_connections 2023-12-08T20:23:30.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:30.589+0000 7f8193092700 1 -- 172.21.15.43:0/3449263157 wait complete. 2023-12-08T20:23:30.650 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:30 smithi043 ceph-mon[111966]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:30.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:30 smithi111 ceph-mon[121341]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:31.219 DEBUG:teuthology.orchestra.run.smithi043:osd.1> sudo journalctl -f -n 0 -u ceph-28476818-9607-11ee-95a3-87774f69a715@osd.1.service 2023-12-08T20:23:31.221 INFO:tasks.cephadm:Deploying osd.2 on smithi043 with /dev/vg_nvme/lv_2... 2023-12-08T20:23:31.221 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-08T20:23:31.256 INFO:journalctl@ceph.osd.1.smithi043.stdout:-- Logs begin at Fri 2023-12-08 20:06:41 UTC. -- 2023-12-08T20:23:31.728 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:23:31.885 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:31 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:31.885 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:31 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:31.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:31 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:31.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:31 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:32.513 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:23:32 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-1[145532]: 2023-12-08T20:23:32.173+0000 7fd00abe0540 -1 osd.1 0 log_to_monitors true 2023-12-08T20:23:32.843 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:32 smithi043 ceph-mon[111966]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:32.844 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:32 smithi043 ceph-mon[111966]: from='osd.1 [v2:172.21.15.43:6810/3228320632,v1:172.21.15.43:6811/3228320632]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-08T20:23:32.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:32 smithi111 ceph-mon[121341]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:32.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:32 smithi111 ceph-mon[121341]: from='osd.1 [v2:172.21.15.43:6810/3228320632,v1:172.21.15.43:6811/3228320632]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-08T20:23:33.634 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-08T20:23:33.634 INFO:teuthology.orchestra.run.smithi043.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-08T20:23:33.635 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10+0 records in 2023-12-08T20:23:33.635 INFO:teuthology.orchestra.run.smithi043.stderr:10+0 records out 2023-12-08T20:23:33.635 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0145727 s, 720 MB/s 2023-12-08T20:23:33.635 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping successful for: 2023-12-08T20:23:33.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:33 smithi111 ceph-mon[121341]: from='osd.1 [v2:172.21.15.43:6810/3228320632,v1:172.21.15.43:6811/3228320632]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-08T20:23:33.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:33 smithi111 ceph-mon[121341]: osdmap e12: 2 total, 1 up, 2 in 2023-12-08T20:23:33.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:33 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-08T20:23:33.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:33 smithi111 ceph-mon[121341]: from='osd.1 [v2:172.21.15.43:6810/3228320632,v1:172.21.15.43:6811/3228320632]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2023-12-08T20:23:33.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:33 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:33.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:33 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:33.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:33 smithi111 ceph-mon[121341]: from='osd.1 [v2:172.21.15.43:6810/3228320632,v1:172.21.15.43:6811/3228320632]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2023-12-08T20:23:33.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:33 smithi111 ceph-mon[121341]: osdmap e13: 2 total, 1 up, 2 in 2023-12-08T20:23:33.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:33 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-08T20:23:33.986 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:23:33 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-1[145532]: 2023-12-08T20:23:33.588+0000 7fd0013c5700 -1 osd.1 0 waiting for initial osdmap 2023-12-08T20:23:33.986 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:23:33 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-1[145532]: 2023-12-08T20:23:33.595+0000 7fcffa1bc700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:23:33.986 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:33 smithi043 ceph-mon[111966]: from='osd.1 [v2:172.21.15.43:6810/3228320632,v1:172.21.15.43:6811/3228320632]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-08T20:23:33.986 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:33 smithi043 ceph-mon[111966]: osdmap e12: 2 total, 1 up, 2 in 2023-12-08T20:23:33.986 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:33 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-08T20:23:33.986 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:33 smithi043 ceph-mon[111966]: from='osd.1 [v2:172.21.15.43:6810/3228320632,v1:172.21.15.43:6811/3228320632]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2023-12-08T20:23:33.986 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:33 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:33.986 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:33 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:33.986 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:33 smithi043 ceph-mon[111966]: from='osd.1 [v2:172.21.15.43:6810/3228320632,v1:172.21.15.43:6811/3228320632]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2023-12-08T20:23:33.986 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:33 smithi043 ceph-mon[111966]: osdmap e13: 2 total, 1 up, 2 in 2023-12-08T20:23:33.986 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:33 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-08T20:23:34.611 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi043:vg_nvme/lv_2 2023-12-08T20:23:34.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:34 smithi111 ceph-mon[121341]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:34.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:34 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-08T20:23:34.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:34 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:23:34.970 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:23:35.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:34 smithi043 ceph-mon[111966]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:35.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:34 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-08T20:23:35.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:34 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:23:35.891 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:35 smithi043 ceph-mon[111966]: purged_snaps scrub starts 2023-12-08T20:23:35.891 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:35 smithi043 ceph-mon[111966]: purged_snaps scrub ok 2023-12-08T20:23:35.892 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:35 smithi043 ceph-mon[111966]: osd.1 [v2:172.21.15.43:6810/3228320632,v1:172.21.15.43:6811/3228320632] boot 2023-12-08T20:23:35.892 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:35 smithi043 ceph-mon[111966]: osdmap e14: 2 total, 2 up, 2 in 2023-12-08T20:23:35.892 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:35 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-08T20:23:35.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:35 smithi111 ceph-mon[121341]: purged_snaps scrub starts 2023-12-08T20:23:35.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:35 smithi111 ceph-mon[121341]: purged_snaps scrub ok 2023-12-08T20:23:35.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:35 smithi111 ceph-mon[121341]: osd.1 [v2:172.21.15.43:6810/3228320632,v1:172.21.15.43:6811/3228320632] boot 2023-12-08T20:23:35.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:35 smithi111 ceph-mon[121341]: osdmap e14: 2 total, 2 up, 2 in 2023-12-08T20:23:35.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:35 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-08T20:23:36.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.148+0000 7f7fe08fb700 1 -- 172.21.15.43:0/3052355333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fdc0fbaf0 msgr2=0x7f7fdc0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:23:36.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.148+0000 7f7fe08fb700 1 --2- 172.21.15.43:0/3052355333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fdc0fbaf0 0x7f7fdc0fbf00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc004940 tx=0x7f7fcc009e30 comp rx=0 tx=0).stop 2023-12-08T20:23:36.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.148+0000 7f7fe08fb700 1 -- 172.21.15.43:0/3052355333 shutdown_connections 2023-12-08T20:23:36.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.148+0000 7f7fe08fb700 1 --2- 172.21.15.43:0/3052355333 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fdc0fcd00 0x7f7fdc0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:23:36.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.148+0000 7f7fe08fb700 1 --2- 172.21.15.43:0/3052355333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fdc0fbaf0 0x7f7fdc0fbf00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:23:36.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.148+0000 7f7fe08fb700 1 -- 172.21.15.43:0/3052355333 >> 172.21.15.43:0/3052355333 conn(0x7f7fdc0f7190 msgr2=0x7f7fdc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:23:36.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.148+0000 7f7fe08fb700 1 -- 172.21.15.43:0/3052355333 shutdown_connections 2023-12-08T20:23:36.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.148+0000 7f7fe08fb700 1 -- 172.21.15.43:0/3052355333 wait complete. 2023-12-08T20:23:36.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.149+0000 7f7fe08fb700 1 Processor -- start 2023-12-08T20:23:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.149+0000 7f7fe08fb700 1 -- start start 2023-12-08T20:23:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.149+0000 7f7fe08fb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fdc0fbaf0 0x7f7fdc10d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:23:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.149+0000 7f7fe08fb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fdc0fcd00 0x7f7fdc10dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:23:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.149+0000 7f7fe08fb700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc10e0e0 con 0x7f7fdc0fbaf0 2023-12-08T20:23:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.149+0000 7f7fe08fb700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc10e980 con 0x7f7fdc0fcd00 2023-12-08T20:23:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.149+0000 7f7fda59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fdc0fbaf0 0x7f7fdc10d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:23:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.149+0000 7f7fda59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fdc0fbaf0 0x7f7fdc10d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35786/0 (socket says 172.21.15.43:35786) 2023-12-08T20:23:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.149+0000 7f7fda59c700 1 -- 172.21.15.43:0/2864705174 learned_addr learned my addr 172.21.15.43:0/2864705174 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:23:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.150+0000 7f7fd1d9b700 1 --2- 172.21.15.43:0/2864705174 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fdc0fcd00 0x7f7fdc10dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:23:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.150+0000 7f7fda59c700 1 -- 172.21.15.43:0/2864705174 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fdc0fcd00 msgr2=0x7f7fdc10dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:23:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.150+0000 7f7fda59c700 1 --2- 172.21.15.43:0/2864705174 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fdc0fcd00 0x7f7fdc10dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:23:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.150+0000 7f7fda59c700 1 -- 172.21.15.43:0/2864705174 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc005040 con 0x7f7fdc0fbaf0 2023-12-08T20:23:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.150+0000 7f7fd1d9b700 1 --2- 172.21.15.43:0/2864705174 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fdc0fcd00 0x7f7fdc10dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T20:23:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.150+0000 7f7fda59c700 1 --2- 172.21.15.43:0/2864705174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fdc0fbaf0 0x7f7fdc10d5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009360 tx=0x7f7fcc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:23:36.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.150+0000 7f7fd37fe700 1 -- 172.21.15.43:0/2864705174 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fcc00e040 con 0x7f7fdc0fbaf0 2023-12-08T20:23:36.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.150+0000 7f7fd37fe700 1 -- 172.21.15.43:0/2864705174 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7fcc004290 con 0x7f7fdc0fbaf0 2023-12-08T20:23:36.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.150+0000 7f7fe08fb700 1 -- 172.21.15.43:0/2864705174 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fdc10ec00 con 0x7f7fdc0fbaf0 2023-12-08T20:23:36.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.150+0000 7f7fd37fe700 1 -- 172.21.15.43:0/2864705174 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fcc01c630 con 0x7f7fdc0fbaf0 2023-12-08T20:23:36.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.150+0000 7f7fe08fb700 1 -- 172.21.15.43:0/2864705174 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fdc10f140 con 0x7f7fdc0fbaf0 2023-12-08T20:23:36.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.151+0000 7f7fe08fb700 1 -- 172.21.15.43:0/2864705174 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fdc04bb80 con 0x7f7fdc0fbaf0 2023-12-08T20:23:36.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.152+0000 7f7fd37fe700 1 -- 172.21.15.43:0/2864705174 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f7fcc013960 con 0x7f7fdc0fbaf0 2023-12-08T20:23:36.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.152+0000 7f7fd37fe700 1 --2- 172.21.15.43:0/2864705174 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f7fc8068ed0 0x7f7fc806b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:23:36.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.152+0000 7f7fd37fe700 1 -- 172.21.15.43:0/2864705174 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f7fcc087350 con 0x7f7fdc0fbaf0 2023-12-08T20:23:36.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.152+0000 7f7fd1d9b700 1 --2- 172.21.15.43:0/2864705174 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f7fc8068ed0 0x7f7fc806b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:23:36.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.153+0000 7f7fd1d9b700 1 --2- 172.21.15.43:0/2864705174 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f7fc8068ed0 0x7f7fc806b380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4007fd0 tx=0x7f7fc4009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:23:36.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.157+0000 7f7fd37fe700 1 -- 172.21.15.43:0/2864705174 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7fcc058020 con 0x7f7fdc0fbaf0 2023-12-08T20:23:36.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:36.370+0000 7f7fe08fb700 1 -- 172.21.15.43:0/2864705174 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fdc10f5a0 con 0x7f7fc8068ed0 2023-12-08T20:23:36.853 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:36 smithi043 ceph-mon[111966]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:36.853 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:36 smithi043 ceph-mon[111966]: osdmap e15: 2 total, 2 up, 2 in 2023-12-08T20:23:36.853 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:36 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-08T20:23:36.853 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:36 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-08T20:23:36.853 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:36 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:36.853 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:36 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:36.854 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:36 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:36.854 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:36 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:23:36.854 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:36 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:23:36.854 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:36 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:36.854 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:36 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:36.854 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:36 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:23:36.854 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:36 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:36.854 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:36 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:23:36.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:36 smithi111 ceph-mon[121341]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-08T20:23:36.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:36 smithi111 ceph-mon[121341]: osdmap e15: 2 total, 2 up, 2 in 2023-12-08T20:23:36.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:36 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-08T20:23:36.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:36 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-08T20:23:36.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:36 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:36.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:36 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:36.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:36 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:36.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:36 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:23:36.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:36 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:23:36.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:36 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:36.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:36 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:36.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:36 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:23:36.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:36 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:36.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:36 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:23:37.855 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:37 smithi043 ceph-mon[111966]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:23:37.856 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:37 smithi043 ceph-mon[111966]: Detected new or changed devices on smithi043 2023-12-08T20:23:37.856 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:37 smithi043 ceph-mon[111966]: Adjusting osd_memory_target on smithi043 to 6451M 2023-12-08T20:23:37.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:37 smithi111 ceph-mon[121341]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:23:37.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:37 smithi111 ceph-mon[121341]: Detected new or changed devices on smithi043 2023-12-08T20:23:37.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:37 smithi111 ceph-mon[121341]: Adjusting osd_memory_target on smithi043 to 6451M 2023-12-08T20:23:38.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:38 smithi111 ceph-mon[121341]: pgmap v42: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:39.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:38 smithi043 ceph-mon[111966]: pgmap v42: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:39.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:39 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/658900569' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc7be655-1abc-4982-a674-b78d9f7dc1ef"}]: dispatch 2023-12-08T20:23:39.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:39 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/658900569' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc7be655-1abc-4982-a674-b78d9f7dc1ef"}]': finished 2023-12-08T20:23:39.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:39 smithi111 ceph-mon[121341]: osdmap e16: 3 total, 2 up, 3 in 2023-12-08T20:23:39.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:39 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:23:39.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:39 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/1308115211' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-08T20:23:40.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:39 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/658900569' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc7be655-1abc-4982-a674-b78d9f7dc1ef"}]: dispatch 2023-12-08T20:23:40.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:39 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/658900569' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc7be655-1abc-4982-a674-b78d9f7dc1ef"}]': finished 2023-12-08T20:23:40.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:39 smithi043 ceph-mon[111966]: osdmap e16: 3 total, 2 up, 3 in 2023-12-08T20:23:40.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:39 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:23:40.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:39 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/1308115211' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-08T20:23:40.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:40 smithi111 ceph-mon[121341]: pgmap v44: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:40.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:40 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:40.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:40 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:40.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:40 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:40.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:40 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:23:40.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:40 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:41.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:40 smithi043 ceph-mon[111966]: pgmap v44: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:41.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:40 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:41.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:40 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:41.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:40 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:41.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:40 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:23:41.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:40 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:42.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:42 smithi043 ceph-mon[111966]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:42.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:42 smithi111 ceph-mon[121341]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:44.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:44 smithi111 ceph-mon[121341]: pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:45.009 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:44 smithi043 ceph-mon[111966]: pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:45.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:45 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-08T20:23:45.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:45 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:45.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:45 smithi111 ceph-mon[121341]: Deploying daemon osd.2 on smithi043 2023-12-08T20:23:45.979 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:45 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-08T20:23:45.979 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:45 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:45.979 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:45 smithi043 ceph-mon[111966]: Deploying daemon osd.2 on smithi043 2023-12-08T20:23:46.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:46 smithi111 ceph-mon[121341]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:47.012 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:46 smithi043 ceph-mon[111966]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:48.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:48 smithi111 ceph-mon[121341]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:48.998 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:48 smithi043 ceph-mon[111966]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:50.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:50 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:50.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:50 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:50.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:50 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:23:50.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:50 smithi111 ceph-mon[121341]: pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:50.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:50 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:23:50.512 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:50 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:50.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:50 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:50.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:50 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:23:50.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:50 smithi043 ceph-mon[111966]: pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:50.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:50 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:23:51.922 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 2 on host 'smithi043' 2023-12-08T20:23:51.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:51.921+0000 7f7fd37fe700 1 -- 172.21.15.43:0/2864705174 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7fdc10f5a0 con 0x7f7fc8068ed0 2023-12-08T20:23:51.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:51.923+0000 7f7fe08fb700 1 -- 172.21.15.43:0/2864705174 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f7fc8068ed0 msgr2=0x7f7fc806b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:23:51.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:51.923+0000 7f7fe08fb700 1 --2- 172.21.15.43:0/2864705174 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f7fc8068ed0 0x7f7fc806b380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4007fd0 tx=0x7f7fc4009040 comp rx=0 tx=0).stop 2023-12-08T20:23:51.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:51.923+0000 7f7fe08fb700 1 -- 172.21.15.43:0/2864705174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fdc0fbaf0 msgr2=0x7f7fdc10d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:23:51.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:51.923+0000 7f7fe08fb700 1 --2- 172.21.15.43:0/2864705174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fdc0fbaf0 0x7f7fdc10d5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009360 tx=0x7f7fcc009e30 comp rx=0 tx=0).stop 2023-12-08T20:23:51.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:51.924+0000 7f7fe08fb700 1 -- 172.21.15.43:0/2864705174 shutdown_connections 2023-12-08T20:23:51.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:51.924+0000 7f7fe08fb700 1 --2- 172.21.15.43:0/2864705174 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f7fc8068ed0 0x7f7fc806b380 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:23:51.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:51.924+0000 7f7fe08fb700 1 --2- 172.21.15.43:0/2864705174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fdc0fbaf0 0x7f7fdc10d5a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:23:51.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:51.924+0000 7f7fe08fb700 1 --2- 172.21.15.43:0/2864705174 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fdc0fcd00 0x7f7fdc10dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:23:51.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:51.924+0000 7f7fe08fb700 1 -- 172.21.15.43:0/2864705174 >> 172.21.15.43:0/2864705174 conn(0x7f7fdc0f7190 msgr2=0x7f7fdc065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:23:51.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:51.924+0000 7f7fe08fb700 1 -- 172.21.15.43:0/2864705174 shutdown_connections 2023-12-08T20:23:51.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:23:51.924+0000 7f7fe08fb700 1 -- 172.21.15.43:0/2864705174 wait complete. 2023-12-08T20:23:52.407 DEBUG:teuthology.orchestra.run.smithi043:osd.2> sudo journalctl -f -n 0 -u ceph-28476818-9607-11ee-95a3-87774f69a715@osd.2.service 2023-12-08T20:23:52.410 INFO:tasks.cephadm:Deploying osd.3 on smithi111 with /dev/vg_nvme/lv_4... 2023-12-08T20:23:52.410 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-08T20:23:52.447 INFO:journalctl@ceph.osd.2.smithi043.stdout:-- Logs begin at Fri 2023-12-08 20:06:41 UTC. -- 2023-12-08T20:23:52.678 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi111/config 2023-12-08T20:23:53.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:52 smithi043 ceph-mon[111966]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:53.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:52 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:53.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:52 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:53.090 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:52 smithi111 ceph-mon[121341]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:53.090 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:52 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:53.090 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:52 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:53.512 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:23:53 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-2[155391]: 2023-12-08T20:23:53.131+0000 7f25bd576540 -1 osd.2 0 log_to_monitors true 2023-12-08T20:23:53.893 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-08T20:23:53.894 INFO:teuthology.orchestra.run.smithi111.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-08T20:23:53.894 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10+0 records in 2023-12-08T20:23:53.894 INFO:teuthology.orchestra.run.smithi111.stderr:10+0 records out 2023-12-08T20:23:53.894 INFO:teuthology.orchestra.run.smithi111.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0118513 s, 885 MB/s 2023-12-08T20:23:53.894 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping successful for: 2023-12-08T20:23:54.184 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:53 smithi111 ceph-mon[121341]: from='osd.2 [v2:172.21.15.43:6818/2164647692,v1:172.21.15.43:6819/2164647692]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-08T20:23:54.184 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:53 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:54.185 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:53 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:54.236 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:53 smithi043 ceph-mon[111966]: from='osd.2 [v2:172.21.15.43:6818/2164647692,v1:172.21.15.43:6819/2164647692]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-08T20:23:54.236 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:53 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:54.236 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:53 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:54.242 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi111:vg_nvme/lv_4 2023-12-08T20:23:54.497 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi111/config 2023-12-08T20:23:55.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:54 smithi111 ceph-mon[121341]: pgmap v51: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:55.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:54 smithi111 ceph-mon[121341]: from='osd.2 [v2:172.21.15.43:6818/2164647692,v1:172.21.15.43:6819/2164647692]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-08T20:23:55.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:54 smithi111 ceph-mon[121341]: osdmap e17: 3 total, 2 up, 3 in 2023-12-08T20:23:55.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:54 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:23:55.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:54 smithi111 ceph-mon[121341]: from='osd.2 [v2:172.21.15.43:6818/2164647692,v1:172.21.15.43:6819/2164647692]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2023-12-08T20:23:55.263 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:23:54 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-2[155391]: 2023-12-08T20:23:54.889+0000 7f25b3d5b700 -1 osd.2 0 waiting for initial osdmap 2023-12-08T20:23:55.263 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:23:54 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-2[155391]: 2023-12-08T20:23:54.895+0000 7f25ad353700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:23:55.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:54 smithi043 ceph-mon[111966]: pgmap v51: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:55.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:54 smithi043 ceph-mon[111966]: from='osd.2 [v2:172.21.15.43:6818/2164647692,v1:172.21.15.43:6819/2164647692]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-08T20:23:55.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:54 smithi043 ceph-mon[111966]: osdmap e17: 3 total, 2 up, 3 in 2023-12-08T20:23:55.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:54 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:23:55.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:54 smithi043 ceph-mon[111966]: from='osd.2 [v2:172.21.15.43:6818/2164647692,v1:172.21.15.43:6819/2164647692]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2023-12-08T20:23:55.491 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.489+0000 7f5b04855700 1 -- 172.21.15.111:0/527956209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b000fcd00 msgr2=0x7f5b000fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:23:55.491 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.489+0000 7f5b04855700 1 --2- 172.21.15.111:0/527956209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b000fcd00 0x7f5b000fd150 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5af4004940 tx=0x7f5af4009e30 comp rx=0 tx=0).stop 2023-12-08T20:23:55.491 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.489+0000 7f5b04855700 1 -- 172.21.15.111:0/527956209 shutdown_connections 2023-12-08T20:23:55.491 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.489+0000 7f5b04855700 1 --2- 172.21.15.111:0/527956209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b000fcd00 0x7f5b000fd150 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:23:55.491 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.489+0000 7f5b04855700 1 --2- 172.21.15.111:0/527956209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b000fbaf0 0x7f5b000fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:23:55.491 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.489+0000 7f5b04855700 1 -- 172.21.15.111:0/527956209 >> 172.21.15.111:0/527956209 conn(0x7f5b000f7190 msgr2=0x7f5b000f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:23:55.491 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.489+0000 7f5b04855700 1 -- 172.21.15.111:0/527956209 shutdown_connections 2023-12-08T20:23:55.491 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.489+0000 7f5b04855700 1 -- 172.21.15.111:0/527956209 wait complete. 2023-12-08T20:23:55.491 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.489+0000 7f5b04855700 1 Processor -- start 2023-12-08T20:23:55.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.489+0000 7f5b04855700 1 -- start start 2023-12-08T20:23:55.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.489+0000 7f5b04855700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b000fbaf0 0x7f5b0010c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:23:55.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.489+0000 7f5b04855700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b000fcd00 0x7f5b0010c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:23:55.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.489+0000 7f5b04855700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0010cf10 con 0x7f5b000fcd00 2023-12-08T20:23:55.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.489+0000 7f5b04855700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0010d7b0 con 0x7f5b000fbaf0 2023-12-08T20:23:55.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.489+0000 7f5afe59c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b000fbaf0 0x7f5b0010c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:23:55.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.490+0000 7f5afe59c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b000fbaf0 0x7f5b0010c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39058/0 (socket says 172.21.15.111:39058) 2023-12-08T20:23:55.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.490+0000 7f5afe59c700 1 -- 172.21.15.111:0/1874068982 learned_addr learned my addr 172.21.15.111:0/1874068982 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-12-08T20:23:55.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.490+0000 7f5afdd9b700 1 --2- 172.21.15.111:0/1874068982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b000fcd00 0x7f5b0010c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:23:55.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.490+0000 7f5afe59c700 1 -- 172.21.15.111:0/1874068982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b000fcd00 msgr2=0x7f5b0010c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:23:55.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.490+0000 7f5afe59c700 1 --2- 172.21.15.111:0/1874068982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b000fcd00 0x7f5b0010c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:23:55.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.490+0000 7f5afe59c700 1 -- 172.21.15.111:0/1874068982 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af4005040 con 0x7f5b000fbaf0 2023-12-08T20:23:55.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.490+0000 7f5afe59c700 1 --2- 172.21.15.111:0/1874068982 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b000fbaf0 0x7f5b0010c3d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5af000eb70 tx=0x7f5af000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:23:55.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.490+0000 7f5aeeffd700 1 -- 172.21.15.111:0/1874068982 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5af0007cc0 con 0x7f5b000fbaf0 2023-12-08T20:23:55.492 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.490+0000 7f5aeeffd700 1 -- 172.21.15.111:0/1874068982 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5af000f040 con 0x7f5b000fbaf0 2023-12-08T20:23:55.493 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.490+0000 7f5b04855700 1 -- 172.21.15.111:0/1874068982 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0010da30 con 0x7f5b000fbaf0 2023-12-08T20:23:55.493 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.490+0000 7f5aeeffd700 1 -- 172.21.15.111:0/1874068982 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5af000c9d0 con 0x7f5b000fbaf0 2023-12-08T20:23:55.493 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.490+0000 7f5b04855700 1 -- 172.21.15.111:0/1874068982 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0010df70 con 0x7f5b000fbaf0 2023-12-08T20:23:55.493 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.491+0000 7f5b04855700 1 -- 172.21.15.111:0/1874068982 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0004bb80 con 0x7f5b000fbaf0 2023-12-08T20:23:55.494 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.491+0000 7f5aeeffd700 1 -- 172.21.15.111:0/1874068982 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f5af000cc40 con 0x7f5b000fbaf0 2023-12-08T20:23:55.494 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.492+0000 7f5aeeffd700 1 --2- 172.21.15.111:0/1874068982 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f5ae8068ed0 0x7f5ae806b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:23:55.494 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.492+0000 7f5aeeffd700 1 -- 172.21.15.111:0/1874068982 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 2562+0+0 (secure 0 0 0) 0x7f5af0085bf0 con 0x7f5b000fbaf0 2023-12-08T20:23:55.494 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.492+0000 7f5afdd9b700 1 --2- 172.21.15.111:0/1874068982 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f5ae8068ed0 0x7f5ae806b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:23:55.494 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.492+0000 7f5afdd9b700 1 --2- 172.21.15.111:0/1874068982 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f5ae8068ed0 0x7f5ae806b380 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5af4000c00 tx=0x7f5af4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:23:55.497 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.496+0000 7f5aeeffd700 1 -- 172.21.15.111:0/1874068982 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5af004da00 con 0x7f5b000fbaf0 2023-12-08T20:23:55.684 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:23:55.683+0000 7f5b04855700 1 -- 172.21.15.111:0/1874068982 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b0010e3c0 con 0x7f5ae8068ed0 2023-12-08T20:23:56.135 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:55 smithi043 ceph-mon[111966]: from='osd.2 [v2:172.21.15.43:6818/2164647692,v1:172.21.15.43:6819/2164647692]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2023-12-08T20:23:56.135 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:55 smithi043 ceph-mon[111966]: osdmap e18: 3 total, 2 up, 3 in 2023-12-08T20:23:56.135 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:55 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:23:56.135 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:55 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:23:56.135 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:55 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-08T20:23:56.135 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:55 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-08T20:23:56.135 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:55 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:56.135 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:55 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:23:56.158 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:55 smithi111 ceph-mon[121341]: from='osd.2 [v2:172.21.15.43:6818/2164647692,v1:172.21.15.43:6819/2164647692]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2023-12-08T20:23:56.158 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:55 smithi111 ceph-mon[121341]: osdmap e18: 3 total, 2 up, 3 in 2023-12-08T20:23:56.159 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:55 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:23:56.159 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:55 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:23:56.159 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:55 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-08T20:23:56.159 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:55 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-08T20:23:56.159 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:55 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:56.159 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:55 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:23:57.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: purged_snaps scrub starts 2023-12-08T20:23:57.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: purged_snaps scrub ok 2023-12-08T20:23:57.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:57.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: from='client.24147 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:23:57.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: osd.2 [v2:172.21.15.43:6818/2164647692,v1:172.21.15.43:6819/2164647692] boot 2023-12-08T20:23:57.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: osdmap e19: 3 total, 3 up, 3 in 2023-12-08T20:23:57.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:23:57.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:57.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:57.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:23:57.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:23:57.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:23:57.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:57.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:57.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:23:57.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:57.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:23:57.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:57.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:23:57.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:56 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:57.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: purged_snaps scrub starts 2023-12-08T20:23:57.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: purged_snaps scrub ok 2023-12-08T20:23:57.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-08T20:23:57.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: from='client.24147 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:23:57.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: osd.2 [v2:172.21.15.43:6818/2164647692,v1:172.21.15.43:6819/2164647692] boot 2023-12-08T20:23:57.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: osdmap e19: 3 total, 3 up, 3 in 2023-12-08T20:23:57.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:23:57.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:57.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:57.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:23:57.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:23:57.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:23:57.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:57.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:57.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:23:57.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:57.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:23:57.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:23:57.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:23:57.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:56 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:23:58.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:57 smithi111 ceph-mon[121341]: Detected new or changed devices on smithi043 2023-12-08T20:23:58.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:57 smithi111 ceph-mon[121341]: Adjusting osd_memory_target on smithi043 to 4300M 2023-12-08T20:23:58.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:57 smithi111 ceph-mon[121341]: osdmap e20: 3 total, 3 up, 3 in 2023-12-08T20:23:58.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:57 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/3008227023' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c0628df-2c6b-40ce-97e2-141d2057af11"}]: dispatch 2023-12-08T20:23:58.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:57 smithi111 ceph-mon[121341]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c0628df-2c6b-40ce-97e2-141d2057af11"}]: dispatch 2023-12-08T20:23:58.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:57 smithi111 ceph-mon[121341]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0c0628df-2c6b-40ce-97e2-141d2057af11"}]': finished 2023-12-08T20:23:58.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:57 smithi111 ceph-mon[121341]: osdmap e21: 4 total, 3 up, 4 in 2023-12-08T20:23:58.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:57 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:23:58.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:57 smithi043 ceph-mon[111966]: Detected new or changed devices on smithi043 2023-12-08T20:23:58.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:57 smithi043 ceph-mon[111966]: Adjusting osd_memory_target on smithi043 to 4300M 2023-12-08T20:23:58.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:57 smithi043 ceph-mon[111966]: osdmap e20: 3 total, 3 up, 3 in 2023-12-08T20:23:58.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:57 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/3008227023' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c0628df-2c6b-40ce-97e2-141d2057af11"}]: dispatch 2023-12-08T20:23:58.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:57 smithi043 ceph-mon[111966]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c0628df-2c6b-40ce-97e2-141d2057af11"}]: dispatch 2023-12-08T20:23:58.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:57 smithi043 ceph-mon[111966]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0c0628df-2c6b-40ce-97e2-141d2057af11"}]': finished 2023-12-08T20:23:58.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:57 smithi043 ceph-mon[111966]: osdmap e21: 4 total, 3 up, 4 in 2023-12-08T20:23:58.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:57 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:23:59.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:58 smithi111 ceph-mon[121341]: pgmap v58: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-08T20:23:59.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:58 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-08T20:23:59.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:58 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/1364387836' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-08T20:23:59.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:58 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-08T20:23:59.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:58 smithi111 ceph-mon[121341]: osdmap e22: 4 total, 3 up, 4 in 2023-12-08T20:23:59.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:58 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:23:59.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:23:58 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-08T20:23:59.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:58 smithi043 ceph-mon[111966]: pgmap v58: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-08T20:23:59.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:58 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-08T20:23:59.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:58 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/1364387836' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-08T20:23:59.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:58 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-08T20:23:59.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:58 smithi043 ceph-mon[111966]: osdmap e22: 4 total, 3 up, 4 in 2023-12-08T20:23:59.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:58 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:23:59.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:23:58 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-08T20:24:00.433 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:24:00 smithi043 sudo[161482]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-08T20:24:00.433 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:24:00 smithi043 sudo[161482]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-08T20:24:00.433 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:24:00 smithi043 sudo[161482]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-08T20:24:00.434 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:24:00 smithi043 sudo[161482]: pam_unix(sudo:session): session closed for user root 2023-12-08T20:24:00.438 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:00.439+0000 7f5aeeffd700 1 -- 172.21.15.111:0/1874068982 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f5af00530f0 con 0x7f5b000fbaf0 2023-12-08T20:24:00.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:00 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-08T20:24:00.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:00 smithi111 ceph-mon[121341]: osdmap e23: 4 total, 3 up, 4 in 2023-12-08T20:24:00.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:00 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:24:00.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:00 smithi111 ceph-mon[121341]: pgmap v61: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-08T20:24:00.762 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:24:00 smithi043 sudo[161485]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-08T20:24:00.762 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:24:00 smithi043 sudo[161485]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-08T20:24:00.763 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:24:00 smithi043 sudo[161485]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-08T20:24:00.763 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:24:00 smithi043 sudo[161485]: pam_unix(sudo:session): session closed for user root 2023-12-08T20:24:00.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:00 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-08T20:24:00.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:00 smithi043 ceph-mon[111966]: osdmap e23: 4 total, 3 up, 4 in 2023-12-08T20:24:00.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:00 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:24:00.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:00 smithi043 ceph-mon[111966]: pgmap v61: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-08T20:24:01.262 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:24:00 smithi043 sudo[161488]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-08T20:24:01.262 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:24:00 smithi043 sudo[161488]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-08T20:24:01.262 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:24:00 smithi043 sudo[161488]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-08T20:24:01.263 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:24:01 smithi043 sudo[161488]: pam_unix(sudo:session): session closed for user root 2023-12-08T20:24:01.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:01 smithi111 ceph-mon[121341]: mgrmap e19: smithi043.hqcdcm(active, since 101s), standbys: smithi111.mtcffu 2023-12-08T20:24:01.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:01 smithi111 ceph-mon[121341]: osdmap e24: 4 total, 3 up, 4 in 2023-12-08T20:24:01.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:01 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:24:01.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:01 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:01.762 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:24:01 smithi043 sudo[161491]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-08T20:24:01.763 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:24:01 smithi043 sudo[161491]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-08T20:24:01.763 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:24:01 smithi043 sudo[161491]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-08T20:24:01.763 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:24:01 smithi043 sudo[161491]: pam_unix(sudo:session): session closed for user root 2023-12-08T20:24:01.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:01 smithi043 ceph-mon[111966]: mgrmap e19: smithi043.hqcdcm(active, since 101s), standbys: smithi111.mtcffu 2023-12-08T20:24:01.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:01 smithi043 ceph-mon[111966]: osdmap e24: 4 total, 3 up, 4 in 2023-12-08T20:24:01.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:01 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:24:01.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:01 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:02.262 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:24:01 smithi043 sudo[161494]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-08T20:24:02.262 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:24:01 smithi043 sudo[161494]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-08T20:24:02.263 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:24:01 smithi043 sudo[161494]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-08T20:24:02.263 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:24:01 smithi043 sudo[161494]: pam_unix(sudo:session): session closed for user root 2023-12-08T20:24:02.762 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:24:02 smithi043 sudo[161499]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-08T20:24:02.762 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:24:02 smithi043 sudo[161499]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-08T20:24:02.762 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:24:02 smithi043 sudo[161499]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-08T20:24:02.763 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:24:02 smithi043 sudo[161499]: pam_unix(sudo:session): session closed for user root 2023-12-08T20:24:03.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:02 smithi043 sudo[161502]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-08T20:24:03.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:02 smithi043 sudo[161502]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-08T20:24:03.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:02 smithi043 sudo[161502]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-08T20:24:03.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:02 smithi043 sudo[161502]: pam_unix(sudo:session): session closed for user root 2023-12-08T20:24:03.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:03 smithi043 sudo[161505]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-08T20:24:03.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:03 smithi043 sudo[161505]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-08T20:24:03.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:03 smithi043 sudo[161505]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-08T20:24:03.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:03 smithi043 sudo[161505]: pam_unix(sudo:session): session closed for user root 2023-12-08T20:24:03.823 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:03 smithi111 sudo[126933]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-08T20:24:03.823 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:03 smithi111 sudo[126933]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-08T20:24:03.824 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:03 smithi111 sudo[126933]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-08T20:24:03.824 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:03 smithi111 sudo[126933]: pam_unix(sudo:session): session closed for user root 2023-12-08T20:24:04.081 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:03 smithi111 sudo[127012]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-08T20:24:04.081 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:03 smithi111 sudo[127012]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-08T20:24:04.081 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:03 smithi111 sudo[127012]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-08T20:24:04.081 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:03 smithi111 sudo[127012]: pam_unix(sudo:session): session closed for user root 2023-12-08T20:24:04.081 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:03 smithi111 ceph-mon[121341]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2023-12-08T20:24:04.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:03 smithi043 ceph-mon[111966]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2023-12-08T20:24:05.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:04 smithi043 ceph-mon[111966]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-08T20:24:05.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:04 smithi043 ceph-mon[111966]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-08T20:24:05.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:24:05.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:24:05.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:04 smithi043 ceph-mon[111966]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-08T20:24:05.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:24:05.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:24:05.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-08T20:24:05.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:05.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:04 smithi043 ceph-mon[111966]: Deploying daemon osd.3 on smithi111 2023-12-08T20:24:05.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:04 smithi043 ceph-mon[111966]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-08T20:24:05.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:04 smithi043 ceph-mon[111966]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-08T20:24:05.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:05.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:24:05.171 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:04 smithi111 ceph-mon[121341]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-08T20:24:05.172 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:04 smithi111 ceph-mon[121341]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-08T20:24:05.172 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:24:05.172 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:24:05.172 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:04 smithi111 ceph-mon[121341]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-08T20:24:05.172 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:24:05.172 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:24:05.172 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-08T20:24:05.172 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:05.172 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:04 smithi111 ceph-mon[121341]: Deploying daemon osd.3 on smithi111 2023-12-08T20:24:05.172 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:04 smithi111 ceph-mon[121341]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-08T20:24:05.172 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:04 smithi111 ceph-mon[121341]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-08T20:24:05.172 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:05.172 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:24:06.677 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:06 smithi111 ceph-mon[121341]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-08T20:24:06.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:06 smithi043 ceph-mon[111966]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-08T20:24:07.860 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:07 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:07.860 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:07 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:07.860 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:07 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:24:08.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:07 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:08.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:07 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:08.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:07 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:24:09.146 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:08 smithi111 ceph-mon[121341]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-12-08T20:24:09.146 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:08 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:09.146 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:08 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:09.147 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:08 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:09.147 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:08 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:24:09.147 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:08 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:09.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:08 smithi043 ceph-mon[111966]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-12-08T20:24:09.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:08 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:09.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:08 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:09.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:08 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:09.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:08 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:24:09.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:08 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:09.335 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:09.333+0000 7f5aeeffd700 1 -- 172.21.15.111:0/1874068982 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5b0010e3c0 con 0x7f5ae8068ed0 2023-12-08T20:24:09.335 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 3 on host 'smithi111' 2023-12-08T20:24:09.336 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:09.335+0000 7f5b04855700 1 -- 172.21.15.111:0/1874068982 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f5ae8068ed0 msgr2=0x7f5ae806b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:09.337 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:09.335+0000 7f5b04855700 1 --2- 172.21.15.111:0/1874068982 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f5ae8068ed0 0x7f5ae806b380 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5af4000c00 tx=0x7f5af4009e30 comp rx=0 tx=0).stop 2023-12-08T20:24:09.337 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:09.335+0000 7f5b04855700 1 -- 172.21.15.111:0/1874068982 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b000fbaf0 msgr2=0x7f5b0010c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:09.337 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:09.335+0000 7f5b04855700 1 --2- 172.21.15.111:0/1874068982 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b000fbaf0 0x7f5b0010c3d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5af000eb70 tx=0x7f5af000b040 comp rx=0 tx=0).stop 2023-12-08T20:24:09.337 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:09.336+0000 7f5b04855700 1 -- 172.21.15.111:0/1874068982 shutdown_connections 2023-12-08T20:24:09.337 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:09.336+0000 7f5b04855700 1 --2- 172.21.15.111:0/1874068982 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f5ae8068ed0 0x7f5ae806b380 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:09.337 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:09.336+0000 7f5b04855700 1 --2- 172.21.15.111:0/1874068982 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b000fbaf0 0x7f5b0010c3d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:09.337 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:09.336+0000 7f5b04855700 1 --2- 172.21.15.111:0/1874068982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b000fcd00 0x7f5b0010c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:09.337 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:09.336+0000 7f5b04855700 1 -- 172.21.15.111:0/1874068982 >> 172.21.15.111:0/1874068982 conn(0x7f5b000f7190 msgr2=0x7f5b000fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:24:09.338 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:09.336+0000 7f5b04855700 1 -- 172.21.15.111:0/1874068982 shutdown_connections 2023-12-08T20:24:09.338 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:09.336+0000 7f5b04855700 1 -- 172.21.15.111:0/1874068982 wait complete. 2023-12-08T20:24:09.706 DEBUG:teuthology.orchestra.run.smithi111:osd.3> sudo journalctl -f -n 0 -u ceph-28476818-9607-11ee-95a3-87774f69a715@osd.3.service 2023-12-08T20:24:09.708 INFO:tasks.cephadm:Deploying osd.4 on smithi111 with /dev/vg_nvme/lv_3... 2023-12-08T20:24:09.708 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-08T20:24:09.741 INFO:journalctl@ceph.osd.3.smithi111.stdout:-- Logs begin at Fri 2023-12-08 20:06:57 UTC. -- 2023-12-08T20:24:10.325 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi111/config 2023-12-08T20:24:10.586 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:10 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:10.586 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:10 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:10.586 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:10 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:24:10.586 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:10 smithi111 ceph-mon[121341]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-08T20:24:10.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:10 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:10.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:10 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:10.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:10 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:24:10.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:10 smithi043 ceph-mon[111966]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-08T20:24:10.903 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:24:10 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-3[127506]: 2023-12-08T20:24:10.788+0000 7f5481906540 -1 osd.3 0 log_to_monitors true 2023-12-08T20:24:11.559 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-08T20:24:11.559 INFO:teuthology.orchestra.run.smithi111.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-08T20:24:11.559 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10+0 records in 2023-12-08T20:24:11.559 INFO:teuthology.orchestra.run.smithi111.stderr:10+0 records out 2023-12-08T20:24:11.559 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112169 s, 935 MB/s 2023-12-08T20:24:11.559 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping successful for: 2023-12-08T20:24:11.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:11 smithi111 ceph-mon[121341]: from='osd.3 [v2:172.21.15.111:6800/2187527806,v1:172.21.15.111:6801/2187527806]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-08T20:24:11.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:11 smithi111 ceph-mon[121341]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-08T20:24:11.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:11 smithi043 ceph-mon[111966]: from='osd.3 [v2:172.21.15.111:6800/2187527806,v1:172.21.15.111:6801/2187527806]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-08T20:24:11.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:11 smithi043 ceph-mon[111966]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-08T20:24:11.899 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi111:vg_nvme/lv_3 2023-12-08T20:24:12.214 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi111/config 2023-12-08T20:24:12.653 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:24:12 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-3[127506]: 2023-12-08T20:24:12.429+0000 7f54780eb700 -1 osd.3 0 waiting for initial osdmap 2023-12-08T20:24:12.654 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:24:12 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-3[127506]: 2023-12-08T20:24:12.435+0000 7f5470ee2700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:24:12.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:12 smithi111 ceph-mon[121341]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-08T20:24:12.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:12 smithi111 ceph-mon[121341]: osdmap e25: 4 total, 3 up, 4 in 2023-12-08T20:24:12.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:12 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:24:12.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:12 smithi111 ceph-mon[121341]: from='osd.3 [v2:172.21.15.111:6800/2187527806,v1:172.21.15.111:6801/2187527806]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:24:12.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:12 smithi111 ceph-mon[121341]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:24:12.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:12 smithi111 ceph-mon[121341]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-12-08T20:24:12.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:12 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:12.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:12 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:12.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:12 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:24:12.655 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:12 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:12.655 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:12 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:12.655 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:12 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:24:12.655 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:12 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:12.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:12 smithi043 ceph-mon[111966]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-08T20:24:12.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:12 smithi043 ceph-mon[111966]: osdmap e25: 4 total, 3 up, 4 in 2023-12-08T20:24:12.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:12 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:24:12.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:12 smithi043 ceph-mon[111966]: from='osd.3 [v2:172.21.15.111:6800/2187527806,v1:172.21.15.111:6801/2187527806]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:24:12.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:12 smithi043 ceph-mon[111966]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:24:12.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:12 smithi043 ceph-mon[111966]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-12-08T20:24:12.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:12 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:12.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:12 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:12.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:12 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:24:12.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:12 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:12.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:12 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:12.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:12 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:24:12.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:12 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:13.088 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.086+0000 7fb44bb64700 1 -- 172.21.15.111:0/1400134871 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4440fd730 msgr2=0x7fb4440ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:13.088 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.086+0000 7fb44bb64700 1 --2- 172.21.15.111:0/1400134871 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4440fd730 0x7fb4440ffb10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb438004940 tx=0x7fb438009e30 comp rx=0 tx=0).stop 2023-12-08T20:24:13.088 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.086+0000 7fb44bb64700 1 -- 172.21.15.111:0/1400134871 shutdown_connections 2023-12-08T20:24:13.088 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.086+0000 7fb44bb64700 1 --2- 172.21.15.111:0/1400134871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb444100050 0x7fb444102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:13.088 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.086+0000 7fb44bb64700 1 --2- 172.21.15.111:0/1400134871 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4440fd730 0x7fb4440ffb10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:13.089 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.086+0000 7fb44bb64700 1 -- 172.21.15.111:0/1400134871 >> 172.21.15.111:0/1400134871 conn(0x7fb4440f7190 msgr2=0x7fb4440f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:24:13.089 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.086+0000 7fb44bb64700 1 -- 172.21.15.111:0/1400134871 shutdown_connections 2023-12-08T20:24:13.089 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.086+0000 7fb44bb64700 1 -- 172.21.15.111:0/1400134871 wait complete. 2023-12-08T20:24:13.089 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.086+0000 7fb44bb64700 1 Processor -- start 2023-12-08T20:24:13.089 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.087+0000 7fb44bb64700 1 -- start start 2023-12-08T20:24:13.089 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.087+0000 7fb44bb64700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4440fd730 0x7fb44410d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:13.089 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.087+0000 7fb44bb64700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb444100050 0x7fb44410da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:13.089 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.087+0000 7fb44bb64700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44410e090 con 0x7fb444100050 2023-12-08T20:24:13.089 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.087+0000 7fb44bb64700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44410e8d0 con 0x7fb4440fd730 2023-12-08T20:24:13.089 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.087+0000 7fb449900700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4440fd730 0x7fb44410d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:13.089 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.087+0000 7fb449900700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4440fd730 0x7fb44410d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50206/0 (socket says 172.21.15.111:50206) 2023-12-08T20:24:13.089 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.087+0000 7fb449900700 1 -- 172.21.15.111:0/14598038 learned_addr learned my addr 172.21.15.111:0/14598038 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-12-08T20:24:13.089 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.087+0000 7fb4490ff700 1 --2- 172.21.15.111:0/14598038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb444100050 0x7fb44410da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:13.089 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.087+0000 7fb449900700 1 -- 172.21.15.111:0/14598038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb444100050 msgr2=0x7fb44410da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:13.089 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.087+0000 7fb449900700 1 --2- 172.21.15.111:0/14598038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb444100050 0x7fb44410da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:13.090 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.087+0000 7fb449900700 1 -- 172.21.15.111:0/14598038 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb438005040 con 0x7fb4440fd730 2023-12-08T20:24:13.090 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.087+0000 7fb449900700 1 --2- 172.21.15.111:0/14598038 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4440fd730 0x7fb44410d4c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb438009360 tx=0x7fb438009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:24:13.090 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.087+0000 7fb4367fc700 1 -- 172.21.15.111:0/14598038 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb43800e040 con 0x7fb4440fd730 2023-12-08T20:24:13.090 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.087+0000 7fb4367fc700 1 -- 172.21.15.111:0/14598038 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb43800bcd0 con 0x7fb4440fd730 2023-12-08T20:24:13.090 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.087+0000 7fb44bb64700 1 -- 172.21.15.111:0/14598038 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44410eb50 con 0x7fb4440fd730 2023-12-08T20:24:13.090 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.087+0000 7fb4367fc700 1 -- 172.21.15.111:0/14598038 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb43801c630 con 0x7fb4440fd730 2023-12-08T20:24:13.090 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.088+0000 7fb44bb64700 1 -- 172.21.15.111:0/14598038 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44410f090 con 0x7fb4440fd730 2023-12-08T20:24:13.091 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.088+0000 7fb44bb64700 1 -- 172.21.15.111:0/14598038 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44404bb80 con 0x7fb4440fd730 2023-12-08T20:24:13.091 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.089+0000 7fb4367fc700 1 -- 172.21.15.111:0/14598038 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb438013960 con 0x7fb4440fd730 2023-12-08T20:24:13.091 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.089+0000 7fb4367fc700 1 --2- 172.21.15.111:0/14598038 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb430068f60 0x7fb43006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:13.091 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.089+0000 7fb4367fc700 1 -- 172.21.15.111:0/14598038 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 3490+0+0 (secure 0 0 0) 0x7fb438087ab0 con 0x7fb4440fd730 2023-12-08T20:24:13.091 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.089+0000 7fb4490ff700 1 --2- 172.21.15.111:0/14598038 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb430068f60 0x7fb43006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:13.091 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.090+0000 7fb4490ff700 1 --2- 172.21.15.111:0/14598038 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb430068f60 0x7fb43006b410 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb440006fd0 tx=0x7fb440008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:24:13.094 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.094+0000 7fb4367fc700 1 -- 172.21.15.111:0/14598038 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb4380581c0 con 0x7fb4440fd730 2023-12-08T20:24:13.283 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:13.283+0000 7fb44bb64700 1 -- 172.21.15.111:0/14598038 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb444100cb0 con 0x7fb430068f60 2023-12-08T20:24:13.679 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:13 smithi111 ceph-mon[121341]: Detected new or changed devices on smithi111 2023-12-08T20:24:13.679 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:13 smithi111 ceph-mon[121341]: Adjusting osd_memory_target on smithi111 to 15970M 2023-12-08T20:24:13.679 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:13 smithi111 ceph-mon[121341]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2023-12-08T20:24:13.679 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:13 smithi111 ceph-mon[121341]: osdmap e26: 4 total, 3 up, 4 in 2023-12-08T20:24:13.679 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:13 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:24:13.679 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:13 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:24:13.679 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:13 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-08T20:24:13.679 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:13 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-08T20:24:13.679 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:13 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:13.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:13 smithi043 ceph-mon[111966]: Detected new or changed devices on smithi111 2023-12-08T20:24:13.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:13 smithi043 ceph-mon[111966]: Adjusting osd_memory_target on smithi111 to 15970M 2023-12-08T20:24:13.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:13 smithi043 ceph-mon[111966]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2023-12-08T20:24:13.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:13 smithi043 ceph-mon[111966]: osdmap e26: 4 total, 3 up, 4 in 2023-12-08T20:24:13.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:13 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:24:13.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:13 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:24:13.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:13 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-08T20:24:13.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:13 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-08T20:24:13.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:13 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:14.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:14 smithi111 ceph-mon[121341]: purged_snaps scrub starts 2023-12-08T20:24:14.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:14 smithi111 ceph-mon[121341]: purged_snaps scrub ok 2023-12-08T20:24:14.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:14 smithi111 ceph-mon[121341]: from='client.24171 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:24:14.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:14 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:24:14.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:14 smithi111 ceph-mon[121341]: osd.3 [v2:172.21.15.111:6800/2187527806,v1:172.21.15.111:6801/2187527806] boot 2023-12-08T20:24:14.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:14 smithi111 ceph-mon[121341]: osdmap e27: 4 total, 4 up, 4 in 2023-12-08T20:24:14.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:14 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:24:14.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:14 smithi111 ceph-mon[121341]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-08T20:24:14.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:14 smithi043 ceph-mon[111966]: purged_snaps scrub starts 2023-12-08T20:24:14.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:14 smithi043 ceph-mon[111966]: purged_snaps scrub ok 2023-12-08T20:24:14.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:14 smithi043 ceph-mon[111966]: from='client.24171 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:24:14.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:14 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:24:14.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:14 smithi043 ceph-mon[111966]: osd.3 [v2:172.21.15.111:6800/2187527806,v1:172.21.15.111:6801/2187527806] boot 2023-12-08T20:24:14.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:14 smithi043 ceph-mon[111966]: osdmap e27: 4 total, 4 up, 4 in 2023-12-08T20:24:14.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:14 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:24:14.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:14 smithi043 ceph-mon[111966]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-08T20:24:15.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:15 smithi111 ceph-mon[121341]: osdmap e28: 4 total, 4 up, 4 in 2023-12-08T20:24:15.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:15 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/4062942154' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87b65c6d-d7c2-44d7-b891-8477e5e891b0"}]: dispatch 2023-12-08T20:24:15.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:15 smithi111 ceph-mon[121341]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87b65c6d-d7c2-44d7-b891-8477e5e891b0"}]: dispatch 2023-12-08T20:24:15.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:15 smithi111 ceph-mon[121341]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87b65c6d-d7c2-44d7-b891-8477e5e891b0"}]': finished 2023-12-08T20:24:15.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:15 smithi111 ceph-mon[121341]: osdmap e29: 5 total, 4 up, 5 in 2023-12-08T20:24:15.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:15 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:24:15.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:15 smithi111 ceph-mon[121341]: osdmap e30: 5 total, 4 up, 5 in 2023-12-08T20:24:15.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:15 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:24:15.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:15 smithi043 ceph-mon[111966]: osdmap e28: 4 total, 4 up, 4 in 2023-12-08T20:24:15.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:15 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/4062942154' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87b65c6d-d7c2-44d7-b891-8477e5e891b0"}]: dispatch 2023-12-08T20:24:15.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:15 smithi043 ceph-mon[111966]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87b65c6d-d7c2-44d7-b891-8477e5e891b0"}]: dispatch 2023-12-08T20:24:15.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:15 smithi043 ceph-mon[111966]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87b65c6d-d7c2-44d7-b891-8477e5e891b0"}]': finished 2023-12-08T20:24:15.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:15 smithi043 ceph-mon[111966]: osdmap e29: 5 total, 4 up, 5 in 2023-12-08T20:24:15.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:15 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:24:15.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:15 smithi043 ceph-mon[111966]: osdmap e30: 5 total, 4 up, 5 in 2023-12-08T20:24:15.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:15 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:24:16.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:16 smithi111 ceph-mon[121341]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-08T20:24:16.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:16 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/3744392103' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-08T20:24:16.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:16 smithi111 ceph-mon[121341]: osdmap e31: 5 total, 4 up, 5 in 2023-12-08T20:24:16.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:16 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:24:16.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:16 smithi043 ceph-mon[111966]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-08T20:24:16.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:16 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/3744392103' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-08T20:24:16.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:16 smithi043 ceph-mon[111966]: osdmap e31: 5 total, 4 up, 5 in 2023-12-08T20:24:16.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:16 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:24:18.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:18 smithi111 ceph-mon[121341]: pgmap v78: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-08T20:24:18.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:18 smithi043 ceph-mon[111966]: pgmap v78: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-08T20:24:20.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:20 smithi111 ceph-mon[121341]: pgmap v79: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 115 KiB/s, 0 objects/s recovering 2023-12-08T20:24:20.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:20 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:24:20.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:20 smithi043 ceph-mon[111966]: pgmap v79: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 115 KiB/s, 0 objects/s recovering 2023-12-08T20:24:20.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:24:21.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:21 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-08T20:24:21.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:21 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:21.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:21 smithi111 ceph-mon[121341]: Deploying daemon osd.4 on smithi111 2023-12-08T20:24:21.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:21 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-08T20:24:21.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:21 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:21.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:21 smithi043 ceph-mon[111966]: Deploying daemon osd.4 on smithi111 2023-12-08T20:24:22.705 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:22 smithi111 ceph-mon[121341]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2023-12-08T20:24:22.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:22 smithi043 ceph-mon[111966]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2023-12-08T20:24:24.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:24 smithi111 ceph-mon[121341]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-08T20:24:24.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:24 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:24.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:24 smithi043 ceph-mon[111966]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-08T20:24:24.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:24 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:25.518 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:25 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:25.519 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:25 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:24:25.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:25 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:25.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:25 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:24:26.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:26 smithi111 ceph-mon[121341]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-08T20:24:26.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:26 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:26.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:26 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:26.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:26 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:26.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:26 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:24:26.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:26 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:26.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:26 smithi043 ceph-mon[111966]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-08T20:24:26.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:26 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:26.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:26 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:26.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:26 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:26.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:26 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:24:26.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:26 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:26.888 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:26.887+0000 7fb4367fc700 1 -- 172.21.15.111:0/14598038 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb444100cb0 con 0x7fb430068f60 2023-12-08T20:24:26.888 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 4 on host 'smithi111' 2023-12-08T20:24:26.890 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:26.890+0000 7fb44bb64700 1 -- 172.21.15.111:0/14598038 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb430068f60 msgr2=0x7fb43006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:26.890 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:26.890+0000 7fb44bb64700 1 --2- 172.21.15.111:0/14598038 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb430068f60 0x7fb43006b410 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb440006fd0 tx=0x7fb440008040 comp rx=0 tx=0).stop 2023-12-08T20:24:26.891 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:26.890+0000 7fb44bb64700 1 -- 172.21.15.111:0/14598038 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4440fd730 msgr2=0x7fb44410d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:26.891 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:26.890+0000 7fb44bb64700 1 --2- 172.21.15.111:0/14598038 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4440fd730 0x7fb44410d4c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb438009360 tx=0x7fb438009e30 comp rx=0 tx=0).stop 2023-12-08T20:24:26.891 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:26.890+0000 7fb44bb64700 1 -- 172.21.15.111:0/14598038 shutdown_connections 2023-12-08T20:24:26.891 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:26.890+0000 7fb44bb64700 1 --2- 172.21.15.111:0/14598038 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb430068f60 0x7fb43006b410 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:26.891 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:26.890+0000 7fb44bb64700 1 --2- 172.21.15.111:0/14598038 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4440fd730 0x7fb44410d4c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:26.891 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:26.890+0000 7fb44bb64700 1 --2- 172.21.15.111:0/14598038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb444100050 0x7fb44410da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:26.891 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:26.890+0000 7fb44bb64700 1 -- 172.21.15.111:0/14598038 >> 172.21.15.111:0/14598038 conn(0x7fb4440f7190 msgr2=0x7fb4440f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:24:26.891 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:26.890+0000 7fb44bb64700 1 -- 172.21.15.111:0/14598038 shutdown_connections 2023-12-08T20:24:26.891 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:26.890+0000 7fb44bb64700 1 -- 172.21.15.111:0/14598038 wait complete. 2023-12-08T20:24:27.275 DEBUG:teuthology.orchestra.run.smithi111:osd.4> sudo journalctl -f -n 0 -u ceph-28476818-9607-11ee-95a3-87774f69a715@osd.4.service 2023-12-08T20:24:27.277 INFO:tasks.cephadm:Deploying osd.5 on smithi111 with /dev/vg_nvme/lv_2... 2023-12-08T20:24:27.277 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-08T20:24:27.307 INFO:journalctl@ceph.osd.4.smithi111.stdout:-- Logs begin at Fri 2023-12-08 20:06:57 UTC. -- 2023-12-08T20:24:27.690 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi111/config 2023-12-08T20:24:27.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:27 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:27.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:27 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:27.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:27 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:24:28.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:27 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:28.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:27 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:28.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:27 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:24:28.622 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:24:28 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4[135430]: 2023-12-08T20:24:28.459+0000 7feac66af540 -1 osd.4 0 log_to_monitors true 2023-12-08T20:24:28.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:28 smithi111 ceph-mon[121341]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-08T20:24:28.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:28 smithi111 ceph-mon[121341]: from='osd.4 [v2:172.21.15.111:6808/2408695979,v1:172.21.15.111:6809/2408695979]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-08T20:24:28.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:28 smithi111 ceph-mon[121341]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-08T20:24:29.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:28 smithi043 ceph-mon[111966]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-08T20:24:29.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:28 smithi043 ceph-mon[111966]: from='osd.4 [v2:172.21.15.111:6808/2408695979,v1:172.21.15.111:6809/2408695979]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-08T20:24:29.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:28 smithi043 ceph-mon[111966]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-08T20:24:29.292 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-08T20:24:29.292 INFO:teuthology.orchestra.run.smithi111.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-08T20:24:29.292 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10+0 records in 2023-12-08T20:24:29.292 INFO:teuthology.orchestra.run.smithi111.stderr:10+0 records out 2023-12-08T20:24:29.292 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0109479 s, 958 MB/s 2023-12-08T20:24:29.292 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping successful for: 2023-12-08T20:24:29.780 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph orch daemon add osd smithi111:vg_nvme/lv_2 2023-12-08T20:24:30.041 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi111/config 2023-12-08T20:24:30.141 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:24:29 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4[135430]: 2023-12-08T20:24:29.854+0000 7feabce94700 -1 osd.4 0 waiting for initial osdmap 2023-12-08T20:24:30.141 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:24:29 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4[135430]: 2023-12-08T20:24:29.861+0000 7feab7c8f700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:24:30.141 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:29 smithi111 ceph-mon[121341]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-08T20:24:30.141 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:29 smithi111 ceph-mon[121341]: osdmap e32: 5 total, 4 up, 5 in 2023-12-08T20:24:30.141 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:29 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:24:30.141 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:29 smithi111 ceph-mon[121341]: from='osd.4 [v2:172.21.15.111:6808/2408695979,v1:172.21.15.111:6809/2408695979]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:24:30.142 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:29 smithi111 ceph-mon[121341]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:24:30.142 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:29 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:30.142 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:29 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:30.142 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:29 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:24:30.142 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:29 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:24:30.142 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:29 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:30.142 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:29 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:30.142 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:29 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:24:30.142 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:29 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:30.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:29 smithi043 ceph-mon[111966]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-08T20:24:30.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:29 smithi043 ceph-mon[111966]: osdmap e32: 5 total, 4 up, 5 in 2023-12-08T20:24:30.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:29 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:24:30.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:29 smithi043 ceph-mon[111966]: from='osd.4 [v2:172.21.15.111:6808/2408695979,v1:172.21.15.111:6809/2408695979]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:24:30.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:29 smithi043 ceph-mon[111966]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:24:30.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:29 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:30.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:29 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:30.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:29 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:24:30.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:29 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:24:30.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:29 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:30.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:29 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:30.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:29 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:24:30.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:29 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:30.961 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.959+0000 7fa151cda700 1 -- 172.21.15.111:0/920269648 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa14c0fcbf0 msgr2=0x7fa14c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:30.961 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.959+0000 7fa151cda700 1 --2- 172.21.15.111:0/920269648 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa14c0fcbf0 0x7fa14c0fd000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa140004940 tx=0x7fa140009e30 comp rx=0 tx=0).stop 2023-12-08T20:24:30.962 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.959+0000 7fa151cda700 1 -- 172.21.15.111:0/920269648 shutdown_connections 2023-12-08T20:24:30.962 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.959+0000 7fa151cda700 1 --2- 172.21.15.111:0/920269648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa14c0fde00 0x7fa14c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:30.962 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.959+0000 7fa151cda700 1 --2- 172.21.15.111:0/920269648 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa14c0fcbf0 0x7fa14c0fd000 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:30.962 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.959+0000 7fa151cda700 1 -- 172.21.15.111:0/920269648 >> 172.21.15.111:0/920269648 conn(0x7fa14c0f82d0 msgr2=0x7fa14c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:24:30.962 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.959+0000 7fa151cda700 1 -- 172.21.15.111:0/920269648 shutdown_connections 2023-12-08T20:24:30.962 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.959+0000 7fa151cda700 1 -- 172.21.15.111:0/920269648 wait complete. 2023-12-08T20:24:30.962 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.959+0000 7fa151cda700 1 Processor -- start 2023-12-08T20:24:30.962 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.959+0000 7fa151cda700 1 -- start start 2023-12-08T20:24:30.962 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.960+0000 7fa151cda700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa14c0fcbf0 0x7fa14c071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:30.962 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.960+0000 7fa151cda700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa14c0fde00 0x7fa14c06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:30.962 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.960+0000 7fa151cda700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c070590 con 0x7fa14c0fde00 2023-12-08T20:24:30.962 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.960+0000 7fa151cda700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c070700 con 0x7fa14c0fcbf0 2023-12-08T20:24:30.962 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.960+0000 7fa14b7fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa14c0fcbf0 0x7fa14c071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:30.962 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.960+0000 7fa14b7fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa14c0fcbf0 0x7fa14c071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:58326/0 (socket says 172.21.15.111:58326) 2023-12-08T20:24:30.962 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.960+0000 7fa14b7fe700 1 -- 172.21.15.111:0/3423330666 learned_addr learned my addr 172.21.15.111:0/3423330666 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-12-08T20:24:30.963 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.960+0000 7fa14affd700 1 --2- 172.21.15.111:0/3423330666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa14c0fde00 0x7fa14c06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:30.963 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.960+0000 7fa14b7fe700 1 -- 172.21.15.111:0/3423330666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa14c0fde00 msgr2=0x7fa14c06ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:30.963 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.960+0000 7fa14b7fe700 1 --2- 172.21.15.111:0/3423330666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa14c0fde00 0x7fa14c06ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:30.963 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.960+0000 7fa14b7fe700 1 -- 172.21.15.111:0/3423330666 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa140005040 con 0x7fa14c0fcbf0 2023-12-08T20:24:30.963 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.960+0000 7fa14b7fe700 1 --2- 172.21.15.111:0/3423330666 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa14c0fcbf0 0x7fa14c071b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa140000c00 tx=0x7fa140009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:24:30.963 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.960+0000 7fa133fff700 1 -- 172.21.15.111:0/3423330666 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa14000e040 con 0x7fa14c0fcbf0 2023-12-08T20:24:30.963 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.960+0000 7fa133fff700 1 -- 172.21.15.111:0/3423330666 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa140009af0 con 0x7fa14c0fcbf0 2023-12-08T20:24:30.963 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.960+0000 7fa151cda700 1 -- 172.21.15.111:0/3423330666 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14c070980 con 0x7fa14c0fcbf0 2023-12-08T20:24:30.963 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.960+0000 7fa133fff700 1 -- 172.21.15.111:0/3423330666 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa14001c630 con 0x7fa14c0fcbf0 2023-12-08T20:24:30.963 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.960+0000 7fa151cda700 1 -- 172.21.15.111:0/3423330666 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14c115500 con 0x7fa14c0fcbf0 2023-12-08T20:24:30.964 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.961+0000 7fa151cda700 1 -- 172.21.15.111:0/3423330666 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa14c04bb80 con 0x7fa14c0fcbf0 2023-12-08T20:24:30.964 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.962+0000 7fa133fff700 1 -- 172.21.15.111:0/3423330666 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa14000bc50 con 0x7fa14c0fcbf0 2023-12-08T20:24:30.964 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.962+0000 7fa133fff700 1 --2- 172.21.15.111:0/3423330666 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa134068f60 0x7fa13406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:30.964 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.962+0000 7fa133fff700 1 -- 172.21.15.111:0/3423330666 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4202+0+0 (secure 0 0 0) 0x7fa140087c00 con 0x7fa14c0fcbf0 2023-12-08T20:24:30.964 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.962+0000 7fa14affd700 1 --2- 172.21.15.111:0/3423330666 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa134068f60 0x7fa13406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:30.964 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.963+0000 7fa14affd700 1 --2- 172.21.15.111:0/3423330666 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa134068f60 0x7fa13406b410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa13c009fd0 tx=0x7fa13c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:24:30.967 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:30.966+0000 7fa133fff700 1 -- 172.21.15.111:0/3423330666 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa14008d020 con 0x7fa14c0fcbf0 2023-12-08T20:24:31.157 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:31.156+0000 7fa151cda700 1 -- 172.21.15.111:0/3423330666 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa14c102750 con 0x7fa134068f60 2023-12-08T20:24:31.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:30 smithi111 ceph-mon[121341]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-08T20:24:31.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:30 smithi111 ceph-mon[121341]: Detected new or changed devices on smithi111 2023-12-08T20:24:31.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:30 smithi111 ceph-mon[121341]: Adjusting osd_memory_target on smithi111 to 7985M 2023-12-08T20:24:31.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:30 smithi111 ceph-mon[121341]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2023-12-08T20:24:31.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:30 smithi111 ceph-mon[121341]: osdmap e33: 5 total, 4 up, 5 in 2023-12-08T20:24:31.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:30 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:24:31.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:30 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:24:31.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:30 smithi043 ceph-mon[111966]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-08T20:24:31.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:30 smithi043 ceph-mon[111966]: Detected new or changed devices on smithi111 2023-12-08T20:24:31.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:30 smithi043 ceph-mon[111966]: Adjusting osd_memory_target on smithi111 to 7985M 2023-12-08T20:24:31.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:30 smithi043 ceph-mon[111966]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2023-12-08T20:24:31.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:30 smithi043 ceph-mon[111966]: osdmap e33: 5 total, 4 up, 5 in 2023-12-08T20:24:31.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:30 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:24:31.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:30 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:24:32.200 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:31 smithi111 ceph-mon[121341]: purged_snaps scrub starts 2023-12-08T20:24:32.200 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:31 smithi111 ceph-mon[121341]: purged_snaps scrub ok 2023-12-08T20:24:32.200 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:31 smithi111 ceph-mon[121341]: osd.4 [v2:172.21.15.111:6808/2408695979,v1:172.21.15.111:6809/2408695979] boot 2023-12-08T20:24:32.200 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:31 smithi111 ceph-mon[121341]: osdmap e34: 5 total, 5 up, 5 in 2023-12-08T20:24:32.200 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:31 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:24:32.200 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:31 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-08T20:24:32.200 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:31 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-08T20:24:32.200 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:31 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:32.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:31 smithi043 ceph-mon[111966]: purged_snaps scrub starts 2023-12-08T20:24:32.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:31 smithi043 ceph-mon[111966]: purged_snaps scrub ok 2023-12-08T20:24:32.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:31 smithi043 ceph-mon[111966]: osd.4 [v2:172.21.15.111:6808/2408695979,v1:172.21.15.111:6809/2408695979] boot 2023-12-08T20:24:32.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:31 smithi043 ceph-mon[111966]: osdmap e34: 5 total, 5 up, 5 in 2023-12-08T20:24:32.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:31 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:24:32.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:31 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-08T20:24:32.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:31 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-08T20:24:32.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:31 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:33.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:32 smithi111 ceph-mon[121341]: from='client.24189 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:24:33.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:32 smithi111 ceph-mon[121341]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:33.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:32 smithi111 ceph-mon[121341]: osdmap e35: 5 total, 5 up, 5 in 2023-12-08T20:24:33.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:32 smithi043 ceph-mon[111966]: from='client.24189 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:24:33.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:32 smithi043 ceph-mon[111966]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:33.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:32 smithi043 ceph-mon[111966]: osdmap e35: 5 total, 5 up, 5 in 2023-12-08T20:24:34.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:33 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/1189210405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a99cd97-6a80-4d01-bb37-a159803f7333"}]: dispatch 2023-12-08T20:24:34.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:33 smithi111 ceph-mon[121341]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a99cd97-6a80-4d01-bb37-a159803f7333"}]: dispatch 2023-12-08T20:24:34.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:33 smithi111 ceph-mon[121341]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a99cd97-6a80-4d01-bb37-a159803f7333"}]': finished 2023-12-08T20:24:34.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:33 smithi111 ceph-mon[121341]: osdmap e36: 6 total, 5 up, 6 in 2023-12-08T20:24:34.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:33 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:24:34.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:33 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/2416977736' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-08T20:24:34.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:33 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/1189210405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a99cd97-6a80-4d01-bb37-a159803f7333"}]: dispatch 2023-12-08T20:24:34.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:33 smithi043 ceph-mon[111966]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a99cd97-6a80-4d01-bb37-a159803f7333"}]: dispatch 2023-12-08T20:24:34.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:33 smithi043 ceph-mon[111966]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a99cd97-6a80-4d01-bb37-a159803f7333"}]': finished 2023-12-08T20:24:34.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:33 smithi043 ceph-mon[111966]: osdmap e36: 6 total, 5 up, 6 in 2023-12-08T20:24:34.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:33 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:24:34.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:33 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/2416977736' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-08T20:24:35.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:34 smithi111 ceph-mon[121341]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:35.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:34 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:24:35.262 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:34 smithi043 ceph-mon[111966]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:35.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:34 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:24:36.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:36 smithi111 ceph-mon[121341]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:36.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:36 smithi043 ceph-mon[111966]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:38.695 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:38 smithi111 ceph-mon[121341]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:38.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:38 smithi043 ceph-mon[111966]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:39.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:39 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-08T20:24:39.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:39 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:39.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:39 smithi043 ceph-mon[111966]: Deploying daemon osd.5 on smithi111 2023-12-08T20:24:39.816 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:39 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-08T20:24:39.816 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:39 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:39.816 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:39 smithi111 ceph-mon[121341]: Deploying daemon osd.5 on smithi111 2023-12-08T20:24:40.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:40 smithi043 ceph-mon[111966]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:40.794 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:40 smithi111 ceph-mon[121341]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:42.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:42 smithi043 ceph-mon[111966]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:42.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:42 smithi111 ceph-mon[121341]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:43.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:43 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:24:43.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:43 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:43.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:43 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:43.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:43 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:24:43.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:43 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:43.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:43 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:44.710 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:44.709+0000 7fa133fff700 1 -- 172.21.15.111:0/3423330666 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa14c102750 con 0x7fa134068f60 2023-12-08T20:24:44.711 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 5 on host 'smithi111' 2023-12-08T20:24:44.712 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:44.712+0000 7fa151cda700 1 -- 172.21.15.111:0/3423330666 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa134068f60 msgr2=0x7fa13406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:44.712 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:44.712+0000 7fa151cda700 1 --2- 172.21.15.111:0/3423330666 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa134068f60 0x7fa13406b410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa13c009fd0 tx=0x7fa13c00b040 comp rx=0 tx=0).stop 2023-12-08T20:24:44.713 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:44.712+0000 7fa151cda700 1 -- 172.21.15.111:0/3423330666 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa14c0fcbf0 msgr2=0x7fa14c071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:44.713 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:44.712+0000 7fa151cda700 1 --2- 172.21.15.111:0/3423330666 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa14c0fcbf0 0x7fa14c071b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa140000c00 tx=0x7fa140009e30 comp rx=0 tx=0).stop 2023-12-08T20:24:44.713 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:44.712+0000 7fa151cda700 1 -- 172.21.15.111:0/3423330666 shutdown_connections 2023-12-08T20:24:44.713 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:44.712+0000 7fa151cda700 1 --2- 172.21.15.111:0/3423330666 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa134068f60 0x7fa13406b410 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:44.713 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:44.712+0000 7fa151cda700 1 --2- 172.21.15.111:0/3423330666 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa14c0fcbf0 0x7fa14c071b10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:44.713 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:44.712+0000 7fa151cda700 1 --2- 172.21.15.111:0/3423330666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa14c0fde00 0x7fa14c06ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:44.713 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:44.712+0000 7fa151cda700 1 -- 172.21.15.111:0/3423330666 >> 172.21.15.111:0/3423330666 conn(0x7fa14c0f82d0 msgr2=0x7fa14c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:24:44.713 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:44.712+0000 7fa151cda700 1 -- 172.21.15.111:0/3423330666 shutdown_connections 2023-12-08T20:24:44.713 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:44.712+0000 7fa151cda700 1 -- 172.21.15.111:0/3423330666 wait complete. 2023-12-08T20:24:44.865 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:44 smithi111 ceph-mon[121341]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:45.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:44 smithi043 ceph-mon[111966]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:45.106 DEBUG:teuthology.orchestra.run.smithi111:osd.5> sudo journalctl -f -n 0 -u ceph-28476818-9607-11ee-95a3-87774f69a715@osd.5.service 2023-12-08T20:24:45.108 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2023-12-08T20:24:45.108 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph osd stat -f json 2023-12-08T20:24:45.137 INFO:journalctl@ceph.osd.5.smithi111.stdout:-- Logs begin at Fri 2023-12-08 20:06:57 UTC. -- 2023-12-08T20:24:45.410 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:24:45.840 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:45 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:45.840 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:45 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:45.840 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:45 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:45.840 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:45 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:45.929 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:45 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:45.929 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:45 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:45.929 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:45 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:45.929 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:45 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:46.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.527+0000 7ff0f72e6700 1 -- 172.21.15.43:0/729597145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0f00fbaf0 msgr2=0x7ff0f00fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:46.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.527+0000 7ff0f72e6700 1 --2- 172.21.15.43:0/729597145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0f00fbaf0 0x7ff0f00fbf00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec004940 tx=0x7ff0ec009e30 comp rx=0 tx=0).stop 2023-12-08T20:24:46.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.527+0000 7ff0f72e6700 1 -- 172.21.15.43:0/729597145 shutdown_connections 2023-12-08T20:24:46.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.527+0000 7ff0f72e6700 1 --2- 172.21.15.43:0/729597145 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0f00fcd00 0x7ff0f00fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:46.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.527+0000 7ff0f72e6700 1 --2- 172.21.15.43:0/729597145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0f00fbaf0 0x7ff0f00fbf00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:46.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.527+0000 7ff0f72e6700 1 -- 172.21.15.43:0/729597145 >> 172.21.15.43:0/729597145 conn(0x7ff0f00f7190 msgr2=0x7ff0f00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:24:46.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.527+0000 7ff0f72e6700 1 -- 172.21.15.43:0/729597145 shutdown_connections 2023-12-08T20:24:46.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.527+0000 7ff0f72e6700 1 -- 172.21.15.43:0/729597145 wait complete. 2023-12-08T20:24:46.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.528+0000 7ff0f72e6700 1 Processor -- start 2023-12-08T20:24:46.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.528+0000 7ff0f72e6700 1 -- start start 2023-12-08T20:24:46.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.528+0000 7ff0f72e6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0f00fbaf0 0x7ff0f010d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:46.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.528+0000 7ff0f72e6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0f00fcd00 0x7ff0f010da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:46.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.528+0000 7ff0f72e6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f010e050 con 0x7ff0f00fbaf0 2023-12-08T20:24:46.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.528+0000 7ff0f72e6700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f010e8f0 con 0x7ff0f00fcd00 2023-12-08T20:24:46.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.528+0000 7ff0f5082700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0f00fbaf0 0x7ff0f010d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:46.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.528+0000 7ff0f5082700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0f00fbaf0 0x7ff0f010d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39816/0 (socket says 172.21.15.43:39816) 2023-12-08T20:24:46.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.528+0000 7ff0f4881700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0f00fcd00 0x7ff0f010da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:46.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.528+0000 7ff0f5082700 1 -- 172.21.15.43:0/2238268025 learned_addr learned my addr 172.21.15.43:0/2238268025 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:24:46.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.528+0000 7ff0f5082700 1 -- 172.21.15.43:0/2238268025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0f00fcd00 msgr2=0x7ff0f010da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:46.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.528+0000 7ff0f5082700 1 --2- 172.21.15.43:0/2238268025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0f00fcd00 0x7ff0f010da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:46.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.528+0000 7ff0f5082700 1 -- 172.21.15.43:0/2238268025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec005040 con 0x7ff0f00fbaf0 2023-12-08T20:24:46.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.528+0000 7ff0f4881700 1 --2- 172.21.15.43:0/2238268025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0f00fcd00 0x7ff0f010da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T20:24:46.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.529+0000 7ff0f5082700 1 --2- 172.21.15.43:0/2238268025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0f00fbaf0 0x7ff0f010d510 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec000c00 tx=0x7ff0ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:24:46.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.529+0000 7ff0e5ffb700 1 -- 172.21.15.43:0/2238268025 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0ec021070 con 0x7ff0f00fbaf0 2023-12-08T20:24:46.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.529+0000 7ff0f72e6700 1 -- 172.21.15.43:0/2238268025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f010eb70 con 0x7ff0f00fbaf0 2023-12-08T20:24:46.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.529+0000 7ff0e5ffb700 1 -- 172.21.15.43:0/2238268025 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff0ec01c400 con 0x7ff0f00fbaf0 2023-12-08T20:24:46.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.529+0000 7ff0e5ffb700 1 -- 172.21.15.43:0/2238268025 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0ec00e070 con 0x7ff0f00fbaf0 2023-12-08T20:24:46.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.529+0000 7ff0f72e6700 1 -- 172.21.15.43:0/2238268025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f010f050 con 0x7ff0f00fbaf0 2023-12-08T20:24:46.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.530+0000 7ff0f72e6700 1 -- 172.21.15.43:0/2238268025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f004bb80 con 0x7ff0f00fbaf0 2023-12-08T20:24:46.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.531+0000 7ff0e5ffb700 1 -- 172.21.15.43:0/2238268025 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff0ec01ca00 con 0x7ff0f00fbaf0 2023-12-08T20:24:46.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.531+0000 7ff0e5ffb700 1 --2- 172.21.15.43:0/2238268025 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff0dc068f60 0x7ff0dc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:46.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.531+0000 7ff0e5ffb700 1 -- 172.21.15.43:0/2238268025 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4317+0+0 (secure 0 0 0) 0x7ff0ec087bb0 con 0x7ff0f00fbaf0 2023-12-08T20:24:46.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.531+0000 7ff0f4881700 1 --2- 172.21.15.43:0/2238268025 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff0dc068f60 0x7ff0dc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:46.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.531+0000 7ff0f4881700 1 --2- 172.21.15.43:0/2238268025 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff0dc068f60 0x7ff0dc06b410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0004fd0 tx=0x7ff0e000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:24:46.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.536+0000 7ff0e5ffb700 1 -- 172.21.15.43:0/2238268025 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff0ec057ef0 con 0x7ff0f00fbaf0 2023-12-08T20:24:46.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.739+0000 7ff0f72e6700 1 -- 172.21.15.43:0/2238268025 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7ff0f010f430 con 0x7ff0f00fbaf0 2023-12-08T20:24:46.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.740+0000 7ff0e5ffb700 1 -- 172.21.15.43:0/2238268025 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) v1 ==== 74+0+130 (secure 0 0 0) 0x7ff0ec057a80 con 0x7ff0f00fbaf0 2023-12-08T20:24:46.742 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:24:46.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.742+0000 7ff0f72e6700 1 -- 172.21.15.43:0/2238268025 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff0dc068f60 msgr2=0x7ff0dc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:46.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.742+0000 7ff0f72e6700 1 --2- 172.21.15.43:0/2238268025 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff0dc068f60 0x7ff0dc06b410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0004fd0 tx=0x7ff0e000b040 comp rx=0 tx=0).stop 2023-12-08T20:24:46.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.742+0000 7ff0f72e6700 1 -- 172.21.15.43:0/2238268025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0f00fbaf0 msgr2=0x7ff0f010d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:46.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.742+0000 7ff0f72e6700 1 --2- 172.21.15.43:0/2238268025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0f00fbaf0 0x7ff0f010d510 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec000c00 tx=0x7ff0ec009e30 comp rx=0 tx=0).stop 2023-12-08T20:24:46.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.742+0000 7ff0f72e6700 1 -- 172.21.15.43:0/2238268025 shutdown_connections 2023-12-08T20:24:46.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.742+0000 7ff0f72e6700 1 --2- 172.21.15.43:0/2238268025 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff0dc068f60 0x7ff0dc06b410 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:46.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.742+0000 7ff0f72e6700 1 --2- 172.21.15.43:0/2238268025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0f00fbaf0 0x7ff0f010d510 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:46.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.742+0000 7ff0f72e6700 1 --2- 172.21.15.43:0/2238268025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0f00fcd00 0x7ff0f010da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:46.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.742+0000 7ff0f72e6700 1 -- 172.21.15.43:0/2238268025 >> 172.21.15.43:0/2238268025 conn(0x7ff0f00f7190 msgr2=0x7ff0f0065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:24:46.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.742+0000 7ff0f72e6700 1 -- 172.21.15.43:0/2238268025 shutdown_connections 2023-12-08T20:24:46.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:46.742+0000 7ff0f72e6700 1 -- 172.21.15.43:0/2238268025 wait complete. 2023-12-08T20:24:46.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:46 smithi111 ceph-mon[121341]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:46.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:46 smithi111 ceph-mon[121341]: from='osd.5 [v2:172.21.15.111:6816/3881389263,v1:172.21.15.111:6817/3881389263]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-08T20:24:46.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:46 smithi111 ceph-mon[121341]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-08T20:24:46.967 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:24:46 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[143399]: 2023-12-08T20:24:46.530+0000 7fb00d47d540 -1 osd.5 0 log_to_monitors true 2023-12-08T20:24:47.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:46 smithi043 ceph-mon[111966]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:47.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:46 smithi043 ceph-mon[111966]: from='osd.5 [v2:172.21.15.111:6816/3881389263,v1:172.21.15.111:6817/3881389263]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-08T20:24:47.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:46 smithi043 ceph-mon[111966]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-08T20:24:47.123 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1702067070,"num_in_osds":6,"osd_in_since":1702067072,"num_remapped_pgs":0} 2023-12-08T20:24:47.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:47 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/2238268025' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-08T20:24:47.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:47 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:47.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:47 smithi111 ceph-mon[121341]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-08T20:24:47.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:47 smithi111 ceph-mon[121341]: osdmap e37: 6 total, 5 up, 6 in 2023-12-08T20:24:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:47 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:24:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:47 smithi111 ceph-mon[121341]: from='osd.5 [v2:172.21.15.111:6816/3881389263,v1:172.21.15.111:6817/3881389263]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:24:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:47 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:47 smithi111 ceph-mon[121341]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:24:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:47 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:24:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:47 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:24:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:47 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:24:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:47 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:47 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:47 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:24:47.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:47 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:47.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:47 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:24:47.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:47 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:47.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:47 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:24:47.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:47 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:48.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:47 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/2238268025' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-08T20:24:48.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:47 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:48.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:47 smithi043 ceph-mon[111966]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-08T20:24:48.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:47 smithi043 ceph-mon[111966]: osdmap e37: 6 total, 5 up, 6 in 2023-12-08T20:24:48.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:47 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:24:48.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:47 smithi043 ceph-mon[111966]: from='osd.5 [v2:172.21.15.111:6816/3881389263,v1:172.21.15.111:6817/3881389263]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:24:48.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:47 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:48.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:47 smithi043 ceph-mon[111966]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:24:48.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:47 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:24:48.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:47 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:24:48.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:47 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:24:48.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:47 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:48.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:47 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:48.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:47 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:24:48.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:47 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:48.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:47 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:24:48.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:47 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:24:48.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:47 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:24:48.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:47 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:24:48.125 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph osd stat -f json 2023-12-08T20:24:48.427 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:24:48.706 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:24:48 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[143399]: 2023-12-08T20:24:48.437+0000 7fb003c62700 -1 osd.5 0 waiting for initial osdmap 2023-12-08T20:24:48.707 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:24:48 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[143399]: 2023-12-08T20:24:48.447+0000 7faffda5b700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:24:48.961 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:48 smithi043 ceph-mon[111966]: Detected new or changed devices on smithi111 2023-12-08T20:24:48.961 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:48 smithi043 ceph-mon[111966]: Adjusting osd_memory_target on smithi111 to 5323M 2023-12-08T20:24:48.962 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:48 smithi043 ceph-mon[111966]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:48.962 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:48 smithi043 ceph-mon[111966]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2023-12-08T20:24:48.962 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:48 smithi043 ceph-mon[111966]: osdmap e38: 6 total, 5 up, 6 in 2023-12-08T20:24:48.962 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:48 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:24:48.962 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:48 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:24:48.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:48 smithi111 ceph-mon[121341]: Detected new or changed devices on smithi111 2023-12-08T20:24:48.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:48 smithi111 ceph-mon[121341]: Adjusting osd_memory_target on smithi111 to 5323M 2023-12-08T20:24:48.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:48 smithi111 ceph-mon[121341]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:48.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:48 smithi111 ceph-mon[121341]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2023-12-08T20:24:48.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:48 smithi111 ceph-mon[121341]: osdmap e38: 6 total, 5 up, 6 in 2023-12-08T20:24:48.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:48 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:24:48.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:48 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:24:49.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.544+0000 7f94ca0e5700 1 -- 172.21.15.43:0/2503936000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c40fcd00 msgr2=0x7f94c40fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:49.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.544+0000 7f94ca0e5700 1 --2- 172.21.15.43:0/2503936000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c40fcd00 0x7f94c40fd150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f94b8004940 tx=0x7f94b8009e30 comp rx=0 tx=0).stop 2023-12-08T20:24:49.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.544+0000 7f94ca0e5700 1 -- 172.21.15.43:0/2503936000 shutdown_connections 2023-12-08T20:24:49.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.544+0000 7f94ca0e5700 1 --2- 172.21.15.43:0/2503936000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c40fcd00 0x7f94c40fd150 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:49.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.544+0000 7f94ca0e5700 1 --2- 172.21.15.43:0/2503936000 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f94c40fbaf0 0x7f94c40fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:49.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.544+0000 7f94ca0e5700 1 -- 172.21.15.43:0/2503936000 >> 172.21.15.43:0/2503936000 conn(0x7f94c40f7190 msgr2=0x7f94c40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:24:49.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.544+0000 7f94ca0e5700 1 -- 172.21.15.43:0/2503936000 shutdown_connections 2023-12-08T20:24:49.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.544+0000 7f94ca0e5700 1 -- 172.21.15.43:0/2503936000 wait complete. 2023-12-08T20:24:49.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.545+0000 7f94ca0e5700 1 Processor -- start 2023-12-08T20:24:49.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.545+0000 7f94ca0e5700 1 -- start start 2023-12-08T20:24:49.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.545+0000 7f94ca0e5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f94c40fbaf0 0x7f94c40ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:49.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.545+0000 7f94ca0e5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c40fcd00 0x7f94c40fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:49.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.545+0000 7f94ca0e5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c40fe640 con 0x7f94c40fcd00 2023-12-08T20:24:49.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.545+0000 7f94ca0e5700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c40fe7b0 con 0x7f94c40fbaf0 2023-12-08T20:24:49.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.545+0000 7f94c2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c40fcd00 0x7f94c40fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:49.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.545+0000 7f94c2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c40fcd00 0x7f94c40fe040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39838/0 (socket says 172.21.15.43:39838) 2023-12-08T20:24:49.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.545+0000 7f94c2ffd700 1 -- 172.21.15.43:0/3798741289 learned_addr learned my addr 172.21.15.43:0/3798741289 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:24:49.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.545+0000 7f94c37fe700 1 --2- 172.21.15.43:0/3798741289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f94c40fbaf0 0x7f94c40ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:49.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.546+0000 7f94c2ffd700 1 -- 172.21.15.43:0/3798741289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f94c40fbaf0 msgr2=0x7f94c40ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:49.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.546+0000 7f94c2ffd700 1 --2- 172.21.15.43:0/3798741289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f94c40fbaf0 0x7f94c40ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:49.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.546+0000 7f94c2ffd700 1 -- 172.21.15.43:0/3798741289 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b8005040 con 0x7f94c40fcd00 2023-12-08T20:24:49.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.546+0000 7f94c2ffd700 1 --2- 172.21.15.43:0/3798741289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c40fcd00 0x7f94c40fe040 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009360 tx=0x7f94b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:24:49.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.546+0000 7f94abfff700 1 -- 172.21.15.43:0/3798741289 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94b800e040 con 0x7f94c40fcd00 2023-12-08T20:24:49.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.546+0000 7f94abfff700 1 -- 172.21.15.43:0/3798741289 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f94b800bc50 con 0x7f94c40fcd00 2023-12-08T20:24:49.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.546+0000 7f94ca0e5700 1 -- 172.21.15.43:0/3798741289 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c40fea30 con 0x7f94c40fcd00 2023-12-08T20:24:49.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.546+0000 7f94abfff700 1 -- 172.21.15.43:0/3798741289 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94b801c3f0 con 0x7f94c40fcd00 2023-12-08T20:24:49.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.546+0000 7f94ca0e5700 1 -- 172.21.15.43:0/3798741289 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c41155a0 con 0x7f94c40fcd00 2023-12-08T20:24:49.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.547+0000 7f94ca0e5700 1 -- 172.21.15.43:0/3798741289 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c404bb80 con 0x7f94c40fcd00 2023-12-08T20:24:49.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.548+0000 7f94abfff700 1 -- 172.21.15.43:0/3798741289 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f94b8013420 con 0x7f94c40fcd00 2023-12-08T20:24:49.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.548+0000 7f94abfff700 1 --2- 172.21.15.43:0/3798741289 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f94ac068f60 0x7f94ac06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:49.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.548+0000 7f94abfff700 1 -- 172.21.15.43:0/3798741289 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f94b8087dd0 con 0x7f94c40fcd00 2023-12-08T20:24:49.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.548+0000 7f94c37fe700 1 --2- 172.21.15.43:0/3798741289 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f94ac068f60 0x7f94ac06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:49.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.549+0000 7f94c37fe700 1 --2- 172.21.15.43:0/3798741289 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f94ac068f60 0x7f94ac06b410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f94c40ff950 tx=0x7f94b4009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:24:49.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.553+0000 7f94abfff700 1 -- 172.21.15.43:0/3798741289 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f94b8057ff0 con 0x7f94c40fcd00 2023-12-08T20:24:49.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.755+0000 7f94ca0e5700 1 -- 172.21.15.43:0/3798741289 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f94c4104490 con 0x7f94c40fcd00 2023-12-08T20:24:49.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.756+0000 7f94abfff700 1 -- 172.21.15.43:0/3798741289 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) v1 ==== 74+0+130 (secure 0 0 0) 0x7f94b8057b80 con 0x7f94c40fcd00 2023-12-08T20:24:49.757 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:24:49.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.758+0000 7f94ca0e5700 1 -- 172.21.15.43:0/3798741289 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f94ac068f60 msgr2=0x7f94ac06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:49.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.758+0000 7f94ca0e5700 1 --2- 172.21.15.43:0/3798741289 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f94ac068f60 0x7f94ac06b410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f94c40ff950 tx=0x7f94b4009040 comp rx=0 tx=0).stop 2023-12-08T20:24:49.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.758+0000 7f94ca0e5700 1 -- 172.21.15.43:0/3798741289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c40fcd00 msgr2=0x7f94c40fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:49.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.758+0000 7f94ca0e5700 1 --2- 172.21.15.43:0/3798741289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c40fcd00 0x7f94c40fe040 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009360 tx=0x7f94b8009e30 comp rx=0 tx=0).stop 2023-12-08T20:24:49.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.758+0000 7f94ca0e5700 1 -- 172.21.15.43:0/3798741289 shutdown_connections 2023-12-08T20:24:49.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.758+0000 7f94ca0e5700 1 --2- 172.21.15.43:0/3798741289 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f94ac068f60 0x7f94ac06b410 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:49.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.758+0000 7f94ca0e5700 1 --2- 172.21.15.43:0/3798741289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f94c40fbaf0 0x7f94c40ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:49.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.758+0000 7f94ca0e5700 1 --2- 172.21.15.43:0/3798741289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94c40fcd00 0x7f94c40fe040 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:49.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.758+0000 7f94ca0e5700 1 -- 172.21.15.43:0/3798741289 >> 172.21.15.43:0/3798741289 conn(0x7f94c40f7190 msgr2=0x7f94c4065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:24:49.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.758+0000 7f94ca0e5700 1 -- 172.21.15.43:0/3798741289 shutdown_connections 2023-12-08T20:24:49.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:49.758+0000 7f94ca0e5700 1 -- 172.21.15.43:0/3798741289 wait complete. 2023-12-08T20:24:49.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:49 smithi111 ceph-mon[121341]: purged_snaps scrub starts 2023-12-08T20:24:49.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:49 smithi111 ceph-mon[121341]: purged_snaps scrub ok 2023-12-08T20:24:49.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:49 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:24:49.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:49 smithi111 ceph-mon[121341]: osd.5 [v2:172.21.15.111:6816/3881389263,v1:172.21.15.111:6817/3881389263] boot 2023-12-08T20:24:49.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:49 smithi111 ceph-mon[121341]: osdmap e39: 6 total, 6 up, 6 in 2023-12-08T20:24:49.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:49 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:24:49.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:49 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:24:50.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:49 smithi043 ceph-mon[111966]: purged_snaps scrub starts 2023-12-08T20:24:50.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:49 smithi043 ceph-mon[111966]: purged_snaps scrub ok 2023-12-08T20:24:50.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:49 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:24:50.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:49 smithi043 ceph-mon[111966]: osd.5 [v2:172.21.15.111:6816/3881389263,v1:172.21.15.111:6817/3881389263] boot 2023-12-08T20:24:50.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:49 smithi043 ceph-mon[111966]: osdmap e39: 6 total, 6 up, 6 in 2023-12-08T20:24:50.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:49 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:24:50.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:49 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:24:50.155 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":39,"num_osds":6,"num_up_osds":6,"osd_up_since":1702067089,"num_in_osds":6,"osd_in_since":1702067072,"num_remapped_pgs":0} 2023-12-08T20:24:50.155 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph osd dump --format=json 2023-12-08T20:24:50.457 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:24:50.977 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:50 smithi043 ceph-mon[111966]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:50.978 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:50 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3798741289' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-08T20:24:50.978 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:50 smithi043 ceph-mon[111966]: osdmap e40: 6 total, 6 up, 6 in 2023-12-08T20:24:51.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:50 smithi111 ceph-mon[121341]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-08T20:24:51.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:50 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/3798741289' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-08T20:24:51.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:50 smithi111 ceph-mon[121341]: osdmap e40: 6 total, 6 up, 6 in 2023-12-08T20:24:51.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.554+0000 7f627c473700 1 -- 172.21.15.43:0/2540827987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62740fbb40 msgr2=0x7f62740fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:51.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.554+0000 7f627c473700 1 --2- 172.21.15.43:0/2540827987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62740fbb40 0x7f62740fbfb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6264004880 tx=0x7f6264009e30 comp rx=0 tx=0).stop 2023-12-08T20:24:51.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.554+0000 7f627c473700 1 -- 172.21.15.43:0/2540827987 shutdown_connections 2023-12-08T20:24:51.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.554+0000 7f627c473700 1 --2- 172.21.15.43:0/2540827987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62740fbb40 0x7f62740fbfb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:51.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.554+0000 7f627c473700 1 --2- 172.21.15.43:0/2540827987 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6274101b00 0x7f6274101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:51.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.554+0000 7f627c473700 1 -- 172.21.15.43:0/2540827987 >> 172.21.15.43:0/2540827987 conn(0x7f62740719b0 msgr2=0x7f6274071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:24:51.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.554+0000 7f627c473700 1 -- 172.21.15.43:0/2540827987 shutdown_connections 2023-12-08T20:24:51.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.554+0000 7f627c473700 1 -- 172.21.15.43:0/2540827987 wait complete. 2023-12-08T20:24:51.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.554+0000 7f627c473700 1 Processor -- start 2023-12-08T20:24:51.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.555+0000 7f627c473700 1 -- start start 2023-12-08T20:24:51.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.555+0000 7f627c473700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62740fbb40 0x7f62741135c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:51.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.555+0000 7f627c473700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6274101b00 0x7f6274113b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:51.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.555+0000 7f627c473700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6274114150 con 0x7f6274101b00 2023-12-08T20:24:51.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.555+0000 7f627c473700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627410d480 con 0x7f62740fbb40 2023-12-08T20:24:51.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.555+0000 7f6279a0e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6274101b00 0x7f6274113b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:51.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.555+0000 7f6279a0e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6274101b00 0x7f6274113b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36050/0 (socket says 172.21.15.43:36050) 2023-12-08T20:24:51.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.555+0000 7f6279a0e700 1 -- 172.21.15.43:0/3108770683 learned_addr learned my addr 172.21.15.43:0/3108770683 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:24:51.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.555+0000 7f627a20f700 1 --2- 172.21.15.43:0/3108770683 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62740fbb40 0x7f62741135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:51.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.555+0000 7f6279a0e700 1 -- 172.21.15.43:0/3108770683 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62740fbb40 msgr2=0x7f62741135c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:51.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.555+0000 7f6279a0e700 1 --2- 172.21.15.43:0/3108770683 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62740fbb40 0x7f62741135c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:51.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.555+0000 7f6279a0e700 1 -- 172.21.15.43:0/3108770683 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6270005040 con 0x7f6274101b00 2023-12-08T20:24:51.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.555+0000 7f6279a0e700 1 --2- 172.21.15.43:0/3108770683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6274101b00 0x7f6274113b00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f62640134a0 tx=0x7f6264009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:24:51.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.556+0000 7f626affd700 1 -- 172.21.15.43:0/3108770683 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f626400e030 con 0x7f6274101b00 2023-12-08T20:24:51.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.556+0000 7f626affd700 1 -- 172.21.15.43:0/3108770683 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f626401c400 con 0x7f6274101b00 2023-12-08T20:24:51.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.556+0000 7f627c473700 1 -- 172.21.15.43:0/3108770683 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6264005040 con 0x7f6274101b00 2023-12-08T20:24:51.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.556+0000 7f626affd700 1 -- 172.21.15.43:0/3108770683 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62640125e0 con 0x7f6274101b00 2023-12-08T20:24:51.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.556+0000 7f627c473700 1 -- 172.21.15.43:0/3108770683 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627410dab0 con 0x7f6274101b00 2023-12-08T20:24:51.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.557+0000 7f627c473700 1 -- 172.21.15.43:0/3108770683 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62740734d0 con 0x7f6274101b00 2023-12-08T20:24:51.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.557+0000 7f626affd700 1 -- 172.21.15.43:0/3108770683 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f626401c570 con 0x7f6274101b00 2023-12-08T20:24:51.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.558+0000 7f626affd700 1 --2- 172.21.15.43:0/3108770683 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6260068f60 0x7f626006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:51.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.558+0000 7f626affd700 1 -- 172.21.15.43:0/3108770683 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6264088440 con 0x7f6274101b00 2023-12-08T20:24:51.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.558+0000 7f627a20f700 1 --2- 172.21.15.43:0/3108770683 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6260068f60 0x7f626006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:51.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.558+0000 7f627a20f700 1 --2- 172.21.15.43:0/3108770683 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6260068f60 0x7f626006b410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6270009fd0 tx=0x7f627000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:24:51.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.563+0000 7f626affd700 1 -- 172.21.15.43:0/3108770683 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f62640586e0 con 0x7f6274101b00 2023-12-08T20:24:51.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.769+0000 7f627c473700 1 -- 172.21.15.43:0/3108770683 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f627410eba0 con 0x7f6274101b00 2023-12-08T20:24:51.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.769+0000 7f626affd700 1 -- 172.21.15.43:0/3108770683 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11096 (secure 0 0 0) 0x7f626401c820 con 0x7f6274101b00 2023-12-08T20:24:51.771 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:24:51.771 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":40,"fsid":"28476818-9607-11ee-95a3-87774f69a715","created":"2023-12-08T20:20:31.669394+0000","modified":"2023-12-08T20:24:50.447446+0000","last_up_change":"2023-12-08T20:24:49.445749+0000","last_in_change":"2023-12-08T20:24:32.898273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:23:57.952150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"5c82b664-c209-4a61-8b21-c5d6a73af81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3312385732},{"type":"v1","addr":"172.21.15.43:6803","nonce":3312385732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3312385732},{"type":"v1","addr":"172.21.15.43:6805","nonce":3312385732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3312385732},{"type":"v1","addr":"172.21.15.43:6809","nonce":3312385732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3312385732},{"type":"v1","addr":"172.21.15.43:6807","nonce":3312385732}]},"public_addr":"172.21.15.43:6803/3312385732","cluster_addr":"172.21.15.43:6805/3312385732","heartbeat_back_addr":"172.21.15.43:6809/3312385732","heartbeat_front_addr":"172.21.15.43:6807/3312385732","state":["exists","up"]},{"osd":1,"uuid":"301dfde9-c50a-4f73-856f-ae88dc2d2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3228320632},{"type":"v1","addr":"172.21.15.43:6811","nonce":3228320632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3228320632},{"type":"v1","addr":"172.21.15.43:6813","nonce":3228320632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":3228320632},{"type":"v1","addr":"172.21.15.43:6817","nonce":3228320632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3228320632},{"type":"v1","addr":"172.21.15.43:6815","nonce":3228320632}]},"public_addr":"172.21.15.43:6811/3228320632","cluster_addr":"172.21.15.43:6813/3228320632","heartbeat_back_addr":"172.21.15.43:6817/3228320632","heartbeat_front_addr":"172.21.15.43:6815/3228320632","state":["exists","up"]},{"osd":2,"uuid":"bc7be655-1abc-4982-a674-b78d9f7dc1ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2164647692},{"type":"v1","addr":"172.21.15.43:6819","nonce":2164647692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":2164647692},{"type":"v1","addr":"172.21.15.43:6821","nonce":2164647692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":2164647692},{"type":"v1","addr":"172.21.15.43:6825","nonce":2164647692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":2164647692},{"type":"v1","addr":"172.21.15.43:6823","nonce":2164647692}]},"public_addr":"172.21.15.43:6819/2164647692","cluster_addr":"172.21.15.43:6821/2164647692","heartbeat_back_addr":"172.21.15.43:6825/2164647692","heartbeat_front_addr":"172.21.15.43:6823/2164647692","state":["exists","up"]},{"osd":3,"uuid":"0c0628df-2c6b-40ce-97e2-141d2057af11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2187527806},{"type":"v1","addr":"172.21.15.111:6801","nonce":2187527806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2187527806},{"type":"v1","addr":"172.21.15.111:6803","nonce":2187527806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2187527806},{"type":"v1","addr":"172.21.15.111:6807","nonce":2187527806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2187527806},{"type":"v1","addr":"172.21.15.111:6805","nonce":2187527806}]},"public_addr":"172.21.15.111:6801/2187527806","cluster_addr":"172.21.15.111:6803/2187527806","heartbeat_back_addr":"172.21.15.111:6807/2187527806","heartbeat_front_addr":"172.21.15.111:6805/2187527806","state":["exists","up"]},{"osd":4,"uuid":"87b65c6d-d7c2-44d7-b891-8477e5e891b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":2408695979},{"type":"v1","addr":"172.21.15.111:6809","nonce":2408695979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":2408695979},{"type":"v1","addr":"172.21.15.111:6811","nonce":2408695979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":2408695979},{"type":"v1","addr":"172.21.15.111:6815","nonce":2408695979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":2408695979},{"type":"v1","addr":"172.21.15.111:6813","nonce":2408695979}]},"public_addr":"172.21.15.111:6809/2408695979","cluster_addr":"172.21.15.111:6811/2408695979","heartbeat_back_addr":"172.21.15.111:6815/2408695979","heartbeat_front_addr":"172.21.15.111:6813/2408695979","state":["exists","up"]},{"osd":5,"uuid":"6a99cd97-6a80-4d01-bb37-a159803f7333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":3881389263},{"type":"v1","addr":"172.21.15.111:6817","nonce":3881389263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":3881389263},{"type":"v1","addr":"172.21.15.111:6819","nonce":3881389263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":3881389263},{"type":"v1","addr":"172.21.15.111:6823","nonce":3881389263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":3881389263},{"type":"v1","addr":"172.21.15.111:6821","nonce":3881389263}]},"public_addr":"172.21.15.111:6817/3881389263","cluster_addr":"172.21.15.111:6819/3881389263","heartbeat_back_addr":"172.21.15.111:6823/3881389263","heartbeat_front_addr":"172.21.15.111:6821/3881389263","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:23:11.583744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:23:33.216409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:23:54.174665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:24:11.801925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:24:29.476994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:24:47.562110+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6801/2315465125":"2023-12-09T20:22:19.417857+0000","172.21.15.43:0/4033535283":"2023-12-09T20:22:19.417857+0000","172.21.15.43:0/392501150":"2023-12-09T20:22:19.417857+0000","172.21.15.43:6801/1561199606":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/2345173464":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/3678520486":"2023-12-09T20:22:19.417857+0000","172.21.15.43:0/2451027781":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/3571683356":"2023-12-09T20:21:01.600933+0000","172.21.15.43:0/1298471102":"2023-12-09T20:21:01.600933+0000","172.21.15.43:6800/1561199606":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/2976228612":"2023-12-09T20:21:01.600933+0000","172.21.15.43:6800/2195776328":"2023-12-09T20:21:01.600933+0000","172.21.15.43:6800/2315465125":"2023-12-09T20:22:19.417857+0000","172.21.15.43:6801/2195776328":"2023-12-09T20:21:01.600933+0000","172.21.15.43:0/3758242596":"2023-12-09T20:21:27.333855+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:24:51.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.773+0000 7f627c473700 1 -- 172.21.15.43:0/3108770683 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6260068f60 msgr2=0x7f626006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:51.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.773+0000 7f627c473700 1 --2- 172.21.15.43:0/3108770683 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6260068f60 0x7f626006b410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6270009fd0 tx=0x7f627000b040 comp rx=0 tx=0).stop 2023-12-08T20:24:51.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.773+0000 7f627c473700 1 -- 172.21.15.43:0/3108770683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6274101b00 msgr2=0x7f6274113b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:51.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.773+0000 7f627c473700 1 --2- 172.21.15.43:0/3108770683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6274101b00 0x7f6274113b00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f62640134a0 tx=0x7f6264009e30 comp rx=0 tx=0).stop 2023-12-08T20:24:51.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.773+0000 7f627c473700 1 -- 172.21.15.43:0/3108770683 shutdown_connections 2023-12-08T20:24:51.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.773+0000 7f627c473700 1 --2- 172.21.15.43:0/3108770683 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6260068f60 0x7f626006b410 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:51.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.773+0000 7f627c473700 1 --2- 172.21.15.43:0/3108770683 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62740fbb40 0x7f62741135c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:51.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.773+0000 7f627c473700 1 --2- 172.21.15.43:0/3108770683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6274101b00 0x7f6274113b00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:51.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.773+0000 7f627c473700 1 -- 172.21.15.43:0/3108770683 >> 172.21.15.43:0/3108770683 conn(0x7f62740719b0 msgr2=0x7f62740653f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:24:51.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.773+0000 7f627c473700 1 -- 172.21.15.43:0/3108770683 shutdown_connections 2023-12-08T20:24:51.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:51.773+0000 7f627c473700 1 -- 172.21.15.43:0/3108770683 wait complete. 2023-12-08T20:24:52.194 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T20:23:57.952150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-08T20:24:52.194 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph osd pool get .mgr pg_num 2023-12-08T20:24:52.494 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:24:52.986 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:52 smithi043 ceph-mon[111966]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:24:52.986 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:52 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3108770683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-08T20:24:53.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:52 smithi111 ceph-mon[121341]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:24:53.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:52 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/3108770683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-08T20:24:53.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.586+0000 7f6fbe3d6700 1 -- 172.21.15.43:0/3865740147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fb80fbb40 msgr2=0x7f6fb80fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:53.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.586+0000 7f6fbe3d6700 1 --2- 172.21.15.43:0/3865740147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fb80fbb40 0x7f6fb80fbfb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0004940 tx=0x7f6fa0009e30 comp rx=0 tx=0).stop 2023-12-08T20:24:53.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.587+0000 7f6fbe3d6700 1 -- 172.21.15.43:0/3865740147 shutdown_connections 2023-12-08T20:24:53.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.587+0000 7f6fbe3d6700 1 --2- 172.21.15.43:0/3865740147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fb80fbb40 0x7f6fb80fbfb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:53.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.587+0000 7f6fbe3d6700 1 --2- 172.21.15.43:0/3865740147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6fb8101b00 0x7f6fb8101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:53.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.587+0000 7f6fbe3d6700 1 -- 172.21.15.43:0/3865740147 >> 172.21.15.43:0/3865740147 conn(0x7f6fb80719b0 msgr2=0x7f6fb8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:24:53.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.587+0000 7f6fbe3d6700 1 -- 172.21.15.43:0/3865740147 shutdown_connections 2023-12-08T20:24:53.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.587+0000 7f6fbe3d6700 1 -- 172.21.15.43:0/3865740147 wait complete. 2023-12-08T20:24:53.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.587+0000 7f6fbe3d6700 1 Processor -- start 2023-12-08T20:24:53.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.587+0000 7f6fbe3d6700 1 -- start start 2023-12-08T20:24:53.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.588+0000 7f6fbe3d6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fb80fbb40 0x7f6fb8112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:53.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.588+0000 7f6fbe3d6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6fb8101b00 0x7f6fb8112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:53.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.588+0000 7f6fbe3d6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb81131d0 con 0x7f6fb80fbb40 2023-12-08T20:24:53.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.588+0000 7f6fbe3d6700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb810c4c0 con 0x7f6fb8101b00 2023-12-08T20:24:53.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.588+0000 7f6fb7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fb80fbb40 0x7f6fb8112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:53.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.588+0000 7f6fb7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fb80fbb40 0x7f6fb8112640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36076/0 (socket says 172.21.15.43:36076) 2023-12-08T20:24:53.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.588+0000 7f6fb7fff700 1 -- 172.21.15.43:0/63123452 learned_addr learned my addr 172.21.15.43:0/63123452 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:24:53.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.588+0000 7f6faffff700 1 --2- 172.21.15.43:0/63123452 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6fb8101b00 0x7f6fb8112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:53.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.588+0000 7f6fb7fff700 1 -- 172.21.15.43:0/63123452 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6fb8101b00 msgr2=0x7f6fb8112b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:53.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.588+0000 7f6fb7fff700 1 --2- 172.21.15.43:0/63123452 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6fb8101b00 0x7f6fb8112b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:53.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.588+0000 7f6fb7fff700 1 -- 172.21.15.43:0/63123452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa0005040 con 0x7f6fb80fbb40 2023-12-08T20:24:53.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.588+0000 7f6fb7fff700 1 --2- 172.21.15.43:0/63123452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fb80fbb40 0x7f6fb8112640 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800c8c0 tx=0x7f6fa80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:24:53.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.589+0000 7f6fb57fa700 1 -- 172.21.15.43:0/63123452 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fa800a980 con 0x7f6fb80fbb40 2023-12-08T20:24:53.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.589+0000 7f6fb57fa700 1 -- 172.21.15.43:0/63123452 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6fa800ce60 con 0x7f6fb80fbb40 2023-12-08T20:24:53.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.589+0000 7f6fbe3d6700 1 -- 172.21.15.43:0/63123452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb810c7a0 con 0x7f6fb80fbb40 2023-12-08T20:24:53.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.589+0000 7f6fb57fa700 1 -- 172.21.15.43:0/63123452 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fa80113a0 con 0x7f6fb80fbb40 2023-12-08T20:24:53.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.589+0000 7f6fbe3d6700 1 -- 172.21.15.43:0/63123452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb810cce0 con 0x7f6fb80fbb40 2023-12-08T20:24:53.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.590+0000 7f6fbe3d6700 1 -- 172.21.15.43:0/63123452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb81122f0 con 0x7f6fb80fbb40 2023-12-08T20:24:53.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.590+0000 7f6fb57fa700 1 -- 172.21.15.43:0/63123452 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6fa8012400 con 0x7f6fb80fbb40 2023-12-08T20:24:53.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.591+0000 7f6fb57fa700 1 --2- 172.21.15.43:0/63123452 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6fa4068f60 0x7f6fa406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:53.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.591+0000 7f6fb57fa700 1 -- 172.21.15.43:0/63123452 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6fa8086a70 con 0x7f6fb80fbb40 2023-12-08T20:24:53.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.591+0000 7f6faffff700 1 --2- 172.21.15.43:0/63123452 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6fa4068f60 0x7f6fa406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:53.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.591+0000 7f6faffff700 1 --2- 172.21.15.43:0/63123452 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6fa4068f60 0x7f6fa406b410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0004f90 tx=0x7f6fa0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:24:53.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.595+0000 7f6fb57fa700 1 -- 172.21.15.43:0/63123452 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6fa8056db0 con 0x7f6fb80fbb40 2023-12-08T20:24:53.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.795+0000 7f6fbe3d6700 1 -- 172.21.15.43:0/63123452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6fb804bb80 con 0x7f6fb80fbb40 2023-12-08T20:24:53.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.795+0000 7f6fb57fa700 1 -- 172.21.15.43:0/63123452 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6fa8056940 con 0x7f6fb80fbb40 2023-12-08T20:24:53.796 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-12-08T20:24:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.797+0000 7f6fbe3d6700 1 -- 172.21.15.43:0/63123452 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6fa4068f60 msgr2=0x7f6fa406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.797+0000 7f6fbe3d6700 1 --2- 172.21.15.43:0/63123452 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6fa4068f60 0x7f6fa406b410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0004f90 tx=0x7f6fa0009e30 comp rx=0 tx=0).stop 2023-12-08T20:24:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.797+0000 7f6fbe3d6700 1 -- 172.21.15.43:0/63123452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fb80fbb40 msgr2=0x7f6fb8112640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.797+0000 7f6fbe3d6700 1 --2- 172.21.15.43:0/63123452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fb80fbb40 0x7f6fb8112640 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800c8c0 tx=0x7f6fa80044c0 comp rx=0 tx=0).stop 2023-12-08T20:24:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.797+0000 7f6fbe3d6700 1 -- 172.21.15.43:0/63123452 shutdown_connections 2023-12-08T20:24:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.797+0000 7f6fbe3d6700 1 --2- 172.21.15.43:0/63123452 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6fa4068f60 0x7f6fa406b410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.797+0000 7f6fbe3d6700 1 --2- 172.21.15.43:0/63123452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fb80fbb40 0x7f6fb8112640 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.797+0000 7f6fbe3d6700 1 --2- 172.21.15.43:0/63123452 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6fb8101b00 0x7f6fb8112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.797+0000 7f6fbe3d6700 1 -- 172.21.15.43:0/63123452 >> 172.21.15.43:0/63123452 conn(0x7f6fb80719b0 msgr2=0x7f6fb80fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:24:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.797+0000 7f6fbe3d6700 1 -- 172.21.15.43:0/63123452 shutdown_connections 2023-12-08T20:24:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:53.797+0000 7f6fbe3d6700 1 -- 172.21.15.43:0/63123452 wait complete. 2023-12-08T20:24:54.189 INFO:tasks.cephadm:Setting up client nodes... 2023-12-08T20:24:54.189 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-08T20:24:54.491 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:24:54.985 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:54 smithi043 ceph-mon[111966]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:24:54.985 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:54 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/63123452' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-08T20:24:55.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:54 smithi111 ceph-mon[121341]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:24:55.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:54 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/63123452' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-08T20:24:55.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.548+0000 7f3d8ee89700 1 -- 172.21.15.43:0/2214686490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d880fcbf0 msgr2=0x7f3d880fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:55.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.548+0000 7f3d8ee89700 1 --2- 172.21.15.43:0/2214686490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d880fcbf0 0x7f3d880fd000 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c004940 tx=0x7f3d7c009e30 comp rx=0 tx=0).stop 2023-12-08T20:24:55.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.548+0000 7f3d8ee89700 1 -- 172.21.15.43:0/2214686490 shutdown_connections 2023-12-08T20:24:55.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.548+0000 7f3d8ee89700 1 --2- 172.21.15.43:0/2214686490 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3d880fde00 0x7f3d880fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:55.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.548+0000 7f3d8ee89700 1 --2- 172.21.15.43:0/2214686490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d880fcbf0 0x7f3d880fd000 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:55.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.548+0000 7f3d8ee89700 1 -- 172.21.15.43:0/2214686490 >> 172.21.15.43:0/2214686490 conn(0x7f3d880f82d0 msgr2=0x7f3d880fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:24:55.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.548+0000 7f3d8ee89700 1 -- 172.21.15.43:0/2214686490 shutdown_connections 2023-12-08T20:24:55.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.548+0000 7f3d8ee89700 1 -- 172.21.15.43:0/2214686490 wait complete. 2023-12-08T20:24:55.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.548+0000 7f3d8ee89700 1 Processor -- start 2023-12-08T20:24:55.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.548+0000 7f3d8ee89700 1 -- start start 2023-12-08T20:24:55.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.549+0000 7f3d8ee89700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d880fcbf0 0x7f3d8810d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:55.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.549+0000 7f3d8ee89700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3d880fde00 0x7f3d8810daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:55.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.549+0000 7f3d8ee89700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8810e0a0 con 0x7f3d880fcbf0 2023-12-08T20:24:55.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.549+0000 7f3d8ee89700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8810e940 con 0x7f3d880fde00 2023-12-08T20:24:55.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.549+0000 7f3d8cc25700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d880fcbf0 0x7f3d8810d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:55.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.549+0000 7f3d8cc25700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d880fcbf0 0x7f3d8810d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36096/0 (socket says 172.21.15.43:36096) 2023-12-08T20:24:55.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.549+0000 7f3d8cc25700 1 -- 172.21.15.43:0/1225399850 learned_addr learned my addr 172.21.15.43:0/1225399850 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:24:55.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.549+0000 7f3d87fff700 1 --2- 172.21.15.43:0/1225399850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3d880fde00 0x7f3d8810daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:55.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.549+0000 7f3d8cc25700 1 -- 172.21.15.43:0/1225399850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3d880fde00 msgr2=0x7f3d8810daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:55.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.549+0000 7f3d8cc25700 1 --2- 172.21.15.43:0/1225399850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3d880fde00 0x7f3d8810daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:55.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.549+0000 7f3d8cc25700 1 -- 172.21.15.43:0/1225399850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c005040 con 0x7f3d880fcbf0 2023-12-08T20:24:55.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.549+0000 7f3d8cc25700 1 --2- 172.21.15.43:0/1225399850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d880fcbf0 0x7f3d8810d560 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c004f90 tx=0x7f3d7c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:24:55.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.550+0000 7f3d857fa700 1 -- 172.21.15.43:0/1225399850 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d7c00e040 con 0x7f3d880fcbf0 2023-12-08T20:24:55.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.550+0000 7f3d857fa700 1 -- 172.21.15.43:0/1225399850 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d7c00bc50 con 0x7f3d880fcbf0 2023-12-08T20:24:55.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.550+0000 7f3d8ee89700 1 -- 172.21.15.43:0/1225399850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8810ebc0 con 0x7f3d880fcbf0 2023-12-08T20:24:55.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.550+0000 7f3d857fa700 1 -- 172.21.15.43:0/1225399850 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d7c01c630 con 0x7f3d880fcbf0 2023-12-08T20:24:55.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.550+0000 7f3d8ee89700 1 -- 172.21.15.43:0/1225399850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8810f100 con 0x7f3d880fcbf0 2023-12-08T20:24:55.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.551+0000 7f3d8ee89700 1 -- 172.21.15.43:0/1225399850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d881075d0 con 0x7f3d880fcbf0 2023-12-08T20:24:55.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.551+0000 7f3d857fa700 1 -- 172.21.15.43:0/1225399850 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f3d7c013420 con 0x7f3d880fcbf0 2023-12-08T20:24:55.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.552+0000 7f3d857fa700 1 --2- 172.21.15.43:0/1225399850 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f3d78068f60 0x7f3d7806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:55.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.552+0000 7f3d857fa700 1 -- 172.21.15.43:0/1225399850 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3d7c087e10 con 0x7f3d880fcbf0 2023-12-08T20:24:55.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.552+0000 7f3d87fff700 1 --2- 172.21.15.43:0/1225399850 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f3d78068f60 0x7f3d7806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:55.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.552+0000 7f3d87fff700 1 --2- 172.21.15.43:0/1225399850 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f3d78068f60 0x7f3d7806b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3d740041d0 tx=0x7f3d740043c0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:24:55.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.557+0000 7f3d857fa700 1 -- 172.21.15.43:0/1225399850 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3d7c0580b0 con 0x7f3d880fcbf0 2023-12-08T20:24:55.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.840+0000 7f3d8ee89700 1 -- 172.21.15.43:0/1225399850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f3d8804bb80 con 0x7f3d880fcbf0 2023-12-08T20:24:55.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.845+0000 7f3d857fa700 1 -- 172.21.15.43:0/1225399850 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f3d7c057c40 con 0x7f3d880fcbf0 2023-12-08T20:24:55.845 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2023-12-08T20:24:55.846 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCXe3Nl9RE0MhAAZo7eov1uI0NxhAOHulHjBw== 2023-12-08T20:24:55.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.847+0000 7f3d8ee89700 1 -- 172.21.15.43:0/1225399850 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f3d78068f60 msgr2=0x7f3d7806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:55.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.847+0000 7f3d8ee89700 1 --2- 172.21.15.43:0/1225399850 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f3d78068f60 0x7f3d7806b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3d740041d0 tx=0x7f3d740043c0 comp rx=0 tx=0).stop 2023-12-08T20:24:55.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.847+0000 7f3d8ee89700 1 -- 172.21.15.43:0/1225399850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d880fcbf0 msgr2=0x7f3d8810d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:55.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.847+0000 7f3d8ee89700 1 --2- 172.21.15.43:0/1225399850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d880fcbf0 0x7f3d8810d560 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c004f90 tx=0x7f3d7c009e30 comp rx=0 tx=0).stop 2023-12-08T20:24:55.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.847+0000 7f3d8ee89700 1 -- 172.21.15.43:0/1225399850 shutdown_connections 2023-12-08T20:24:55.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.847+0000 7f3d8ee89700 1 --2- 172.21.15.43:0/1225399850 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f3d78068f60 0x7f3d7806b410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:55.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.847+0000 7f3d8ee89700 1 --2- 172.21.15.43:0/1225399850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d880fcbf0 0x7f3d8810d560 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:55.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.847+0000 7f3d8ee89700 1 --2- 172.21.15.43:0/1225399850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3d880fde00 0x7f3d8810daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:55.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.847+0000 7f3d8ee89700 1 -- 172.21.15.43:0/1225399850 >> 172.21.15.43:0/1225399850 conn(0x7f3d880f82d0 msgr2=0x7f3d880fa590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:24:55.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.847+0000 7f3d8ee89700 1 -- 172.21.15.43:0/1225399850 shutdown_connections 2023-12-08T20:24:55.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:55.847+0000 7f3d8ee89700 1 -- 172.21.15.43:0/1225399850 wait complete. 2023-12-08T20:24:56.229 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-12-08T20:24:56.229 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-12-08T20:24:56.229 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-08T20:24:56.277 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-08T20:24:56.553 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi111/config 2023-12-08T20:24:56.681 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:56 smithi111 ceph-mon[121341]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:24:56.682 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:56 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/1225399850' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-08T20:24:56.682 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:56 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/1225399850' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-08T20:24:56.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:56 smithi043 ceph-mon[111966]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:24:56.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:56 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/1225399850' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-08T20:24:56.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:56 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/1225399850' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-08T20:24:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.564+0000 7fc273b8e700 1 -- 172.21.15.111:0/2498880882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc26c0fbaf0 msgr2=0x7fc26c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.564+0000 7fc273b8e700 1 --2- 172.21.15.111:0/2498880882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc26c0fbaf0 0x7fc26c0fbf00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc268004940 tx=0x7fc268009e30 comp rx=0 tx=0).stop 2023-12-08T20:24:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.564+0000 7fc273b8e700 1 -- 172.21.15.111:0/2498880882 shutdown_connections 2023-12-08T20:24:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.564+0000 7fc273b8e700 1 --2- 172.21.15.111:0/2498880882 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc26c0fcd00 0x7fc26c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.564+0000 7fc273b8e700 1 --2- 172.21.15.111:0/2498880882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc26c0fbaf0 0x7fc26c0fbf00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.564+0000 7fc273b8e700 1 -- 172.21.15.111:0/2498880882 >> 172.21.15.111:0/2498880882 conn(0x7fc26c0f7190 msgr2=0x7fc26c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:24:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.564+0000 7fc273b8e700 1 -- 172.21.15.111:0/2498880882 shutdown_connections 2023-12-08T20:24:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.565+0000 7fc273b8e700 1 -- 172.21.15.111:0/2498880882 wait complete. 2023-12-08T20:24:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.565+0000 7fc273b8e700 1 Processor -- start 2023-12-08T20:24:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.565+0000 7fc273b8e700 1 -- start start 2023-12-08T20:24:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.565+0000 7fc273b8e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc26c0fbaf0 0x7fc26c10c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.565+0000 7fc273b8e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc26c0fcd00 0x7fc26c10c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.565+0000 7fc273b8e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c10cf30 con 0x7fc26c0fbaf0 2023-12-08T20:24:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.565+0000 7fc273b8e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c10d7d0 con 0x7fc26c0fcd00 2023-12-08T20:24:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.565+0000 7fc271129700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc26c0fcd00 0x7fc26c10c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.565+0000 7fc271129700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc26c0fcd00 0x7fc26c10c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60292/0 (socket says 172.21.15.111:60292) 2023-12-08T20:24:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.565+0000 7fc271129700 1 -- 172.21.15.111:0/3514440691 learned_addr learned my addr 172.21.15.111:0/3514440691 (peer_addr_for_me v2:172.21.15.111:0/0) 2023-12-08T20:24:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.565+0000 7fc27192a700 1 --2- 172.21.15.111:0/3514440691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc26c0fbaf0 0x7fc26c10c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.566+0000 7fc271129700 1 -- 172.21.15.111:0/3514440691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc26c0fbaf0 msgr2=0x7fc26c10c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.566+0000 7fc271129700 1 --2- 172.21.15.111:0/3514440691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc26c0fbaf0 0x7fc26c10c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.566+0000 7fc271129700 1 -- 172.21.15.111:0/3514440691 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc268005040 con 0x7fc26c0fcd00 2023-12-08T20:24:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.566+0000 7fc271129700 1 --2- 172.21.15.111:0/3514440691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc26c0fcd00 0x7fc26c10c930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc260002a80 tx=0x7fc2600046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:24:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.566+0000 7fc25e7fc700 1 -- 172.21.15.111:0/3514440691 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc260007cc0 con 0x7fc26c0fcd00 2023-12-08T20:24:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.566+0000 7fc25e7fc700 1 -- 172.21.15.111:0/3514440691 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc26000f040 con 0x7fc26c0fcd00 2023-12-08T20:24:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.566+0000 7fc273b8e700 1 -- 172.21.15.111:0/3514440691 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc26c10dab0 con 0x7fc26c0fcd00 2023-12-08T20:24:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.566+0000 7fc25e7fc700 1 -- 172.21.15.111:0/3514440691 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc26000da60 con 0x7fc26c0fcd00 2023-12-08T20:24:57.568 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.566+0000 7fc273b8e700 1 -- 172.21.15.111:0/3514440691 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26c10dff0 con 0x7fc26c0fcd00 2023-12-08T20:24:57.569 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.567+0000 7fc273b8e700 1 -- 172.21.15.111:0/3514440691 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26c04bb80 con 0x7fc26c0fcd00 2023-12-08T20:24:57.569 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.567+0000 7fc25e7fc700 1 -- 172.21.15.111:0/3514440691 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc26000dbc0 con 0x7fc26c0fcd00 2023-12-08T20:24:57.569 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.568+0000 7fc25e7fc700 1 --2- 172.21.15.111:0/3514440691 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fc258068f60 0x7fc25806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:57.569 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.568+0000 7fc25e7fc700 1 -- 172.21.15.111:0/3514440691 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc2600866c0 con 0x7fc26c0fcd00 2023-12-08T20:24:57.569 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.568+0000 7fc27192a700 1 --2- 172.21.15.111:0/3514440691 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fc258068f60 0x7fc25806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:57.569 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.568+0000 7fc27192a700 1 --2- 172.21.15.111:0/3514440691 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fc258068f60 0x7fc25806b410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc268004890 tx=0x7fc268009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:24:57.572 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.572+0000 7fc25e7fc700 1 -- 172.21.15.111:0/3514440691 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc2600568e0 con 0x7fc26c0fcd00 2023-12-08T20:24:57.825 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.825+0000 7fc273b8e700 1 -- 172.21.15.111:0/3514440691 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fc26c104490 con 0x7fc26c0fcd00 2023-12-08T20:24:57.830 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.830+0000 7fc25e7fc700 1 -- 172.21.15.111:0/3514440691 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7fc260056470 con 0x7fc26c0fcd00 2023-12-08T20:24:57.830 INFO:teuthology.orchestra.run.smithi111.stdout:[client.1] 2023-12-08T20:24:57.830 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCZe3Nl7ZRNMRAA3IoiamSmYBjLSekwoZTVkA== 2023-12-08T20:24:57.832 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.832+0000 7fc273b8e700 1 -- 172.21.15.111:0/3514440691 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fc258068f60 msgr2=0x7fc25806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:57.832 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.832+0000 7fc273b8e700 1 --2- 172.21.15.111:0/3514440691 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fc258068f60 0x7fc25806b410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc268004890 tx=0x7fc268009e30 comp rx=0 tx=0).stop 2023-12-08T20:24:57.832 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.832+0000 7fc273b8e700 1 -- 172.21.15.111:0/3514440691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc26c0fcd00 msgr2=0x7fc26c10c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:57.832 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.832+0000 7fc273b8e700 1 --2- 172.21.15.111:0/3514440691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc26c0fcd00 0x7fc26c10c930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc260002a80 tx=0x7fc2600046b0 comp rx=0 tx=0).stop 2023-12-08T20:24:57.832 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.832+0000 7fc273b8e700 1 -- 172.21.15.111:0/3514440691 shutdown_connections 2023-12-08T20:24:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.832+0000 7fc273b8e700 1 --2- 172.21.15.111:0/3514440691 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fc258068f60 0x7fc25806b410 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.832+0000 7fc273b8e700 1 --2- 172.21.15.111:0/3514440691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc26c0fbaf0 0x7fc26c10c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.832+0000 7fc273b8e700 1 --2- 172.21.15.111:0/3514440691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc26c0fcd00 0x7fc26c10c930 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.832+0000 7fc273b8e700 1 -- 172.21.15.111:0/3514440691 >> 172.21.15.111:0/3514440691 conn(0x7fc26c0f7190 msgr2=0x7fc26c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:24:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.832+0000 7fc273b8e700 1 -- 172.21.15.111:0/3514440691 shutdown_connections 2023-12-08T20:24:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2023-12-08T20:24:57.832+0000 7fc273b8e700 1 -- 172.21.15.111:0/3514440691 wait complete. 2023-12-08T20:24:58.411 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-12-08T20:24:58.411 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2023-12-08T20:24:58.411 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-08T20:24:58.452 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-08T20:24:58.452 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-12-08T20:24:58.453 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph mgr dump --format=json 2023-12-08T20:24:58.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:58 smithi111 ceph-mon[121341]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:24:58.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:58 smithi111 ceph-mon[121341]: from='client.? 172.21.15.111:0/3514440691' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-08T20:24:58.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:58 smithi111 ceph-mon[121341]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-08T20:24:58.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:24:58 smithi111 ceph-mon[121341]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-08T20:24:58.752 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:24:58.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:58 smithi043 ceph-mon[111966]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:24:58.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:58 smithi043 ceph-mon[111966]: from='client.? 172.21.15.111:0/3514440691' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-08T20:24:58.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:58 smithi043 ceph-mon[111966]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-08T20:24:58.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:24:58 smithi043 ceph-mon[111966]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-08T20:24:59.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.823+0000 7fa484e0e700 1 -- 172.21.15.43:0/3704631598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa480101b00 msgr2=0x7fa480101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:59.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.823+0000 7fa484e0e700 1 --2- 172.21.15.43:0/3704631598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa480101b00 0x7fa480101ed0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa470004940 tx=0x7fa470009e30 comp rx=0 tx=0).stop 2023-12-08T20:24:59.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.823+0000 7fa484e0e700 1 -- 172.21.15.43:0/3704631598 shutdown_connections 2023-12-08T20:24:59.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.823+0000 7fa484e0e700 1 --2- 172.21.15.43:0/3704631598 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4800fbb40 0x7fa4800fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:59.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.823+0000 7fa484e0e700 1 --2- 172.21.15.43:0/3704631598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa480101b00 0x7fa480101ed0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:59.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.823+0000 7fa484e0e700 1 -- 172.21.15.43:0/3704631598 >> 172.21.15.43:0/3704631598 conn(0x7fa4800719b0 msgr2=0x7fa480071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:24:59.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.824+0000 7fa484e0e700 1 -- 172.21.15.43:0/3704631598 shutdown_connections 2023-12-08T20:24:59.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.824+0000 7fa484e0e700 1 -- 172.21.15.43:0/3704631598 wait complete. 2023-12-08T20:24:59.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.824+0000 7fa484e0e700 1 Processor -- start 2023-12-08T20:24:59.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.824+0000 7fa484e0e700 1 -- start start 2023-12-08T20:24:59.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.824+0000 7fa484e0e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4800fbb40 0x7fa480112550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.824+0000 7fa484e0e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa480101b00 0x7fa480112a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.824+0000 7fa484e0e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4801130e0 con 0x7fa4800fbb40 2023-12-08T20:24:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.824+0000 7fa484e0e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48010c410 con 0x7fa480101b00 2023-12-08T20:24:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.825+0000 7fa47e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4800fbb40 0x7fa480112550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.825+0000 7fa47e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4800fbb40 0x7fa480112550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36112/0 (socket says 172.21.15.43:36112) 2023-12-08T20:24:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.825+0000 7fa47e59c700 1 -- 172.21.15.43:0/377631222 learned_addr learned my addr 172.21.15.43:0/377631222 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:24:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.825+0000 7fa47dd9b700 1 --2- 172.21.15.43:0/377631222 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa480101b00 0x7fa480112a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.825+0000 7fa47e59c700 1 -- 172.21.15.43:0/377631222 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa480101b00 msgr2=0x7fa480112a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:24:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.825+0000 7fa47e59c700 1 --2- 172.21.15.43:0/377631222 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa480101b00 0x7fa480112a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:24:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.825+0000 7fa47e59c700 1 -- 172.21.15.43:0/377631222 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa470005040 con 0x7fa4800fbb40 2023-12-08T20:24:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.825+0000 7fa47e59c700 1 --2- 172.21.15.43:0/377631222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4800fbb40 0x7fa480112550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa47000b3b0 tx=0x7fa470009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:24:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.825+0000 7fa46effd700 1 -- 172.21.15.43:0/377631222 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa47000e040 con 0x7fa4800fbb40 2023-12-08T20:24:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.825+0000 7fa46effd700 1 -- 172.21.15.43:0/377631222 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa47000bc50 con 0x7fa4800fbb40 2023-12-08T20:24:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.825+0000 7fa484e0e700 1 -- 172.21.15.43:0/377631222 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48010c690 con 0x7fa4800fbb40 2023-12-08T20:24:59.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.825+0000 7fa46effd700 1 -- 172.21.15.43:0/377631222 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa470013420 con 0x7fa4800fbb40 2023-12-08T20:24:59.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.825+0000 7fa484e0e700 1 -- 172.21.15.43:0/377631222 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48010cbd0 con 0x7fa4800fbb40 2023-12-08T20:24:59.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.826+0000 7fa484e0e700 1 -- 172.21.15.43:0/377631222 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa480103fb0 con 0x7fa4800fbb40 2023-12-08T20:24:59.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.827+0000 7fa46effd700 1 -- 172.21.15.43:0/377631222 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa47001c430 con 0x7fa4800fbb40 2023-12-08T20:24:59.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.827+0000 7fa46effd700 1 --2- 172.21.15.43:0/377631222 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa468068f60 0x7fa46806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:24:59.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.827+0000 7fa46effd700 1 -- 172.21.15.43:0/377631222 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa470087780 con 0x7fa4800fbb40 2023-12-08T20:24:59.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.827+0000 7fa47dd9b700 1 --2- 172.21.15.43:0/377631222 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa468068f60 0x7fa46806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:24:59.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.828+0000 7fa47dd9b700 1 --2- 172.21.15.43:0/377631222 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa468068f60 0x7fa46806b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa48010ddf0 tx=0x7fa474009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:24:59.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:24:59.832+0000 7fa46effd700 1 -- 172.21.15.43:0/377631222 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa470057b70 con 0x7fa4800fbb40 2023-12-08T20:25:00.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:00.088+0000 7fa484e0e700 1 -- 172.21.15.43:0/377631222 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa48010db30 con 0x7fa4800fbb40 2023-12-08T20:25:00.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:00.092+0000 7fa46effd700 1 -- 172.21.15.43:0/377631222 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+166776 (secure 0 0 0) 0x7fa470057700 con 0x7fa4800fbb40 2023-12-08T20:25:00.095 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:25:00.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:00.094+0000 7fa484e0e700 1 -- 172.21.15.43:0/377631222 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa468068f60 msgr2=0x7fa46806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:00.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:00.094+0000 7fa484e0e700 1 --2- 172.21.15.43:0/377631222 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa468068f60 0x7fa46806b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa48010ddf0 tx=0x7fa474009040 comp rx=0 tx=0).stop 2023-12-08T20:25:00.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:00.094+0000 7fa484e0e700 1 -- 172.21.15.43:0/377631222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4800fbb40 msgr2=0x7fa480112550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:00.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:00.094+0000 7fa484e0e700 1 --2- 172.21.15.43:0/377631222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4800fbb40 0x7fa480112550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa47000b3b0 tx=0x7fa470009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:00.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:00.094+0000 7fa484e0e700 1 -- 172.21.15.43:0/377631222 shutdown_connections 2023-12-08T20:25:00.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:00.094+0000 7fa484e0e700 1 --2- 172.21.15.43:0/377631222 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa468068f60 0x7fa46806b410 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:00.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:00.094+0000 7fa484e0e700 1 --2- 172.21.15.43:0/377631222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4800fbb40 0x7fa480112550 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:00.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:00.094+0000 7fa484e0e700 1 --2- 172.21.15.43:0/377631222 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa480101b00 0x7fa480112a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:00.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:00.094+0000 7fa484e0e700 1 -- 172.21.15.43:0/377631222 >> 172.21.15.43:0/377631222 conn(0x7fa4800719b0 msgr2=0x7fa4800fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:00.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:00.095+0000 7fa484e0e700 1 -- 172.21.15.43:0/377631222 shutdown_connections 2023-12-08T20:25:00.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:00.095+0000 7fa484e0e700 1 -- 172.21.15.43:0/377631222 wait complete. 2023-12-08T20:25:00.462 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":19,"active_gid":14208,"active_name":"smithi043.hqcdcm","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3959093322},{"type":"v1","addr":"172.21.15.43:6801","nonce":3959093322}]},"active_addr":"172.21.15.43:6801/3959093322","active_change":"2023-12-08T20:22:19.417964+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14230,"name":"smithi111.mtcffu","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.43:8443/","prometheus":"http://172.21.15.43:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":993195790}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":1958100424}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":3231089927}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":4006048852}]}]} 2023-12-08T20:25:00.838 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-12-08T20:25:00.839 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-12-08T20:25:00.839 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph osd dump --format=json 2023-12-08T20:25:00.840 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:00 smithi043 ceph-mon[111966]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:00.840 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:00 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/377631222' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-08T20:25:00.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:00 smithi111 ceph-mon[121341]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:00.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:00 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/377631222' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-08T20:25:01.138 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:02.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.171+0000 7fb23f4d3700 1 -- 172.21.15.43:0/1816475852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb238101270 msgr2=0x7fb238101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:02.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.171+0000 7fb23f4d3700 1 --2- 172.21.15.43:0/1816475852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb238101270 0x7fb238101640 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb234004a50 tx=0x7fb23400af40 comp rx=0 tx=0).stop 2023-12-08T20:25:02.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.171+0000 7fb23f4d3700 1 -- 172.21.15.43:0/1816475852 shutdown_connections 2023-12-08T20:25:02.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.171+0000 7fb23f4d3700 1 --2- 172.21.15.43:0/1816475852 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb238101c10 0x7fb2380fb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:02.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.171+0000 7fb23f4d3700 1 --2- 172.21.15.43:0/1816475852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb238101270 0x7fb238101640 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:02.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.171+0000 7fb23f4d3700 1 -- 172.21.15.43:0/1816475852 >> 172.21.15.43:0/1816475852 conn(0x7fb2380711a0 msgr2=0x7fb2380715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:02.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.171+0000 7fb23f4d3700 1 -- 172.21.15.43:0/1816475852 shutdown_connections 2023-12-08T20:25:02.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.171+0000 7fb23f4d3700 1 -- 172.21.15.43:0/1816475852 wait complete. 2023-12-08T20:25:02.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.172+0000 7fb23f4d3700 1 Processor -- start 2023-12-08T20:25:02.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.172+0000 7fb23f4d3700 1 -- start start 2023-12-08T20:25:02.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.172+0000 7fb23f4d3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb238101270 0x7fb2381135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:02.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.172+0000 7fb23f4d3700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb238101c10 0x7fb238113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:02.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.172+0000 7fb23f4d3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2381141f0 con 0x7fb238101270 2023-12-08T20:25:02.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.172+0000 7fb23f4d3700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23810d490 con 0x7fb238101c10 2023-12-08T20:25:02.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.172+0000 7fb23d26f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb238101270 0x7fb2381135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:02.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.172+0000 7fb23d26f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb238101270 0x7fb2381135d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40904/0 (socket says 172.21.15.43:40904) 2023-12-08T20:25:02.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.172+0000 7fb23d26f700 1 -- 172.21.15.43:0/307394086 learned_addr learned my addr 172.21.15.43:0/307394086 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:02.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.172+0000 7fb23ca6e700 1 --2- 172.21.15.43:0/307394086 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb238101c10 0x7fb238113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:02.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.173+0000 7fb23d26f700 1 -- 172.21.15.43:0/307394086 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb238101c10 msgr2=0x7fb238113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:02.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.173+0000 7fb23d26f700 1 --2- 172.21.15.43:0/307394086 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb238101c10 0x7fb238113b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:02.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.173+0000 7fb23d26f700 1 -- 172.21.15.43:0/307394086 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb234005040 con 0x7fb238101270 2023-12-08T20:25:02.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.173+0000 7fb23d26f700 1 --2- 172.21.15.43:0/307394086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb238101270 0x7fb2381135d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb23400ce40 tx=0x7fb23400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:02.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.173+0000 7fb22dffb700 1 -- 172.21.15.43:0/307394086 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb23400f070 con 0x7fb238101270 2023-12-08T20:25:02.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.173+0000 7fb22dffb700 1 -- 172.21.15.43:0/307394086 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb23401c8d0 con 0x7fb238101270 2023-12-08T20:25:02.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.173+0000 7fb23f4d3700 1 -- 172.21.15.43:0/307394086 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb23810d710 con 0x7fb238101270 2023-12-08T20:25:02.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.173+0000 7fb22dffb700 1 -- 172.21.15.43:0/307394086 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb234014950 con 0x7fb238101270 2023-12-08T20:25:02.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.173+0000 7fb23f4d3700 1 -- 172.21.15.43:0/307394086 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb23810dbf0 con 0x7fb238101270 2023-12-08T20:25:02.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.174+0000 7fb23f4d3700 1 -- 172.21.15.43:0/307394086 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb238100590 con 0x7fb238101270 2023-12-08T20:25:02.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.175+0000 7fb22dffb700 1 -- 172.21.15.43:0/307394086 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb23401ca40 con 0x7fb238101270 2023-12-08T20:25:02.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.175+0000 7fb22dffb700 1 --2- 172.21.15.43:0/307394086 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb224068f60 0x7fb22406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:02.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.175+0000 7fb22dffb700 1 -- 172.21.15.43:0/307394086 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb234088410 con 0x7fb238101270 2023-12-08T20:25:02.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.175+0000 7fb23ca6e700 1 --2- 172.21.15.43:0/307394086 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb224068f60 0x7fb22406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:02.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.176+0000 7fb23ca6e700 1 --2- 172.21.15.43:0/307394086 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb224068f60 0x7fb22406b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb228006fd0 tx=0x7fb228008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:02.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.180+0000 7fb22dffb700 1 -- 172.21.15.43:0/307394086 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb234058610 con 0x7fb238101270 2023-12-08T20:25:02.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.381+0000 7fb23f4d3700 1 -- 172.21.15.43:0/307394086 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb23804bb80 con 0x7fb238101270 2023-12-08T20:25:02.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.382+0000 7fb22dffb700 1 -- 172.21.15.43:0/307394086 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11096 (secure 0 0 0) 0x7fb2340581a0 con 0x7fb238101270 2023-12-08T20:25:02.383 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:25:02.383 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":40,"fsid":"28476818-9607-11ee-95a3-87774f69a715","created":"2023-12-08T20:20:31.669394+0000","modified":"2023-12-08T20:24:50.447446+0000","last_up_change":"2023-12-08T20:24:49.445749+0000","last_in_change":"2023-12-08T20:24:32.898273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:23:57.952150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"5c82b664-c209-4a61-8b21-c5d6a73af81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3312385732},{"type":"v1","addr":"172.21.15.43:6803","nonce":3312385732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3312385732},{"type":"v1","addr":"172.21.15.43:6805","nonce":3312385732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3312385732},{"type":"v1","addr":"172.21.15.43:6809","nonce":3312385732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3312385732},{"type":"v1","addr":"172.21.15.43:6807","nonce":3312385732}]},"public_addr":"172.21.15.43:6803/3312385732","cluster_addr":"172.21.15.43:6805/3312385732","heartbeat_back_addr":"172.21.15.43:6809/3312385732","heartbeat_front_addr":"172.21.15.43:6807/3312385732","state":["exists","up"]},{"osd":1,"uuid":"301dfde9-c50a-4f73-856f-ae88dc2d2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3228320632},{"type":"v1","addr":"172.21.15.43:6811","nonce":3228320632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3228320632},{"type":"v1","addr":"172.21.15.43:6813","nonce":3228320632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":3228320632},{"type":"v1","addr":"172.21.15.43:6817","nonce":3228320632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3228320632},{"type":"v1","addr":"172.21.15.43:6815","nonce":3228320632}]},"public_addr":"172.21.15.43:6811/3228320632","cluster_addr":"172.21.15.43:6813/3228320632","heartbeat_back_addr":"172.21.15.43:6817/3228320632","heartbeat_front_addr":"172.21.15.43:6815/3228320632","state":["exists","up"]},{"osd":2,"uuid":"bc7be655-1abc-4982-a674-b78d9f7dc1ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2164647692},{"type":"v1","addr":"172.21.15.43:6819","nonce":2164647692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":2164647692},{"type":"v1","addr":"172.21.15.43:6821","nonce":2164647692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":2164647692},{"type":"v1","addr":"172.21.15.43:6825","nonce":2164647692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":2164647692},{"type":"v1","addr":"172.21.15.43:6823","nonce":2164647692}]},"public_addr":"172.21.15.43:6819/2164647692","cluster_addr":"172.21.15.43:6821/2164647692","heartbeat_back_addr":"172.21.15.43:6825/2164647692","heartbeat_front_addr":"172.21.15.43:6823/2164647692","state":["exists","up"]},{"osd":3,"uuid":"0c0628df-2c6b-40ce-97e2-141d2057af11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2187527806},{"type":"v1","addr":"172.21.15.111:6801","nonce":2187527806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2187527806},{"type":"v1","addr":"172.21.15.111:6803","nonce":2187527806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2187527806},{"type":"v1","addr":"172.21.15.111:6807","nonce":2187527806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2187527806},{"type":"v1","addr":"172.21.15.111:6805","nonce":2187527806}]},"public_addr":"172.21.15.111:6801/2187527806","cluster_addr":"172.21.15.111:6803/2187527806","heartbeat_back_addr":"172.21.15.111:6807/2187527806","heartbeat_front_addr":"172.21.15.111:6805/2187527806","state":["exists","up"]},{"osd":4,"uuid":"87b65c6d-d7c2-44d7-b891-8477e5e891b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":2408695979},{"type":"v1","addr":"172.21.15.111:6809","nonce":2408695979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":2408695979},{"type":"v1","addr":"172.21.15.111:6811","nonce":2408695979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":2408695979},{"type":"v1","addr":"172.21.15.111:6815","nonce":2408695979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":2408695979},{"type":"v1","addr":"172.21.15.111:6813","nonce":2408695979}]},"public_addr":"172.21.15.111:6809/2408695979","cluster_addr":"172.21.15.111:6811/2408695979","heartbeat_back_addr":"172.21.15.111:6815/2408695979","heartbeat_front_addr":"172.21.15.111:6813/2408695979","state":["exists","up"]},{"osd":5,"uuid":"6a99cd97-6a80-4d01-bb37-a159803f7333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":3881389263},{"type":"v1","addr":"172.21.15.111:6817","nonce":3881389263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":3881389263},{"type":"v1","addr":"172.21.15.111:6819","nonce":3881389263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":3881389263},{"type":"v1","addr":"172.21.15.111:6823","nonce":3881389263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":3881389263},{"type":"v1","addr":"172.21.15.111:6821","nonce":3881389263}]},"public_addr":"172.21.15.111:6817/3881389263","cluster_addr":"172.21.15.111:6819/3881389263","heartbeat_back_addr":"172.21.15.111:6823/3881389263","heartbeat_front_addr":"172.21.15.111:6821/3881389263","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:23:11.583744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:23:33.216409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:23:54.174665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:24:11.801925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:24:29.476994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:24:47.562110+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6801/2315465125":"2023-12-09T20:22:19.417857+0000","172.21.15.43:0/4033535283":"2023-12-09T20:22:19.417857+0000","172.21.15.43:0/392501150":"2023-12-09T20:22:19.417857+0000","172.21.15.43:6801/1561199606":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/2345173464":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/3678520486":"2023-12-09T20:22:19.417857+0000","172.21.15.43:0/2451027781":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/3571683356":"2023-12-09T20:21:01.600933+0000","172.21.15.43:0/1298471102":"2023-12-09T20:21:01.600933+0000","172.21.15.43:6800/1561199606":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/2976228612":"2023-12-09T20:21:01.600933+0000","172.21.15.43:6800/2195776328":"2023-12-09T20:21:01.600933+0000","172.21.15.43:6800/2315465125":"2023-12-09T20:22:19.417857+0000","172.21.15.43:6801/2195776328":"2023-12-09T20:21:01.600933+0000","172.21.15.43:0/3758242596":"2023-12-09T20:21:27.333855+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:25:02.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.384+0000 7fb23f4d3700 1 -- 172.21.15.43:0/307394086 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb224068f60 msgr2=0x7fb22406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:02.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.384+0000 7fb23f4d3700 1 --2- 172.21.15.43:0/307394086 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb224068f60 0x7fb22406b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb228006fd0 tx=0x7fb228008040 comp rx=0 tx=0).stop 2023-12-08T20:25:02.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.384+0000 7fb23f4d3700 1 -- 172.21.15.43:0/307394086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb238101270 msgr2=0x7fb2381135d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:02.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.384+0000 7fb23f4d3700 1 --2- 172.21.15.43:0/307394086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb238101270 0x7fb2381135d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb23400ce40 tx=0x7fb23400af40 comp rx=0 tx=0).stop 2023-12-08T20:25:02.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.384+0000 7fb23f4d3700 1 -- 172.21.15.43:0/307394086 shutdown_connections 2023-12-08T20:25:02.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.384+0000 7fb23f4d3700 1 --2- 172.21.15.43:0/307394086 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb224068f60 0x7fb22406b410 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:02.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.384+0000 7fb23f4d3700 1 --2- 172.21.15.43:0/307394086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb238101270 0x7fb2381135d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:02.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.384+0000 7fb23f4d3700 1 --2- 172.21.15.43:0/307394086 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb238101c10 0x7fb238113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:02.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.384+0000 7fb23f4d3700 1 -- 172.21.15.43:0/307394086 >> 172.21.15.43:0/307394086 conn(0x7fb2380711a0 msgr2=0x7fb238104920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:02.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.384+0000 7fb23f4d3700 1 -- 172.21.15.43:0/307394086 shutdown_connections 2023-12-08T20:25:02.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:02.384+0000 7fb23f4d3700 1 -- 172.21.15.43:0/307394086 wait complete. 2023-12-08T20:25:02.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:02 smithi043 ceph-mon[111966]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:02.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:02 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/307394086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-08T20:25:02.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:02 smithi111 ceph-mon[121341]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:02.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:02 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/307394086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-08T20:25:02.986 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-12-08T20:25:02.987 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph osd dump --format=json 2023-12-08T20:25:03.292 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:04.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.466+0000 7f087432b700 1 -- 172.21.15.43:0/3601968532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f086c103590 msgr2=0x7f086c0fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:04.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.466+0000 7f087432b700 1 --2- 172.21.15.43:0/3601968532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f086c103590 0x7f086c0fcc00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0860004940 tx=0x7f0860009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:04.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.466+0000 7f087432b700 1 -- 172.21.15.43:0/3601968532 shutdown_connections 2023-12-08T20:25:04.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.466+0000 7f087432b700 1 --2- 172.21.15.43:0/3601968532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f086c103590 0x7f086c0fcc00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:04.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.466+0000 7f087432b700 1 --2- 172.21.15.43:0/3601968532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f086c102bf0 0x7f086c102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.466+0000 7f087432b700 1 -- 172.21.15.43:0/3601968532 >> 172.21.15.43:0/3601968532 conn(0x7f086c0f87a0 msgr2=0x7f086c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.466+0000 7f087432b700 1 -- 172.21.15.43:0/3601968532 shutdown_connections 2023-12-08T20:25:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.466+0000 7f087432b700 1 -- 172.21.15.43:0/3601968532 wait complete. 2023-12-08T20:25:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.467+0000 7f087432b700 1 Processor -- start 2023-12-08T20:25:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.467+0000 7f087432b700 1 -- start start 2023-12-08T20:25:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.467+0000 7f087432b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f086c102bf0 0x7f086c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.467+0000 7f087432b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f086c103590 0x7f086c070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.467+0000 7f087432b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c070a80 con 0x7f086c102bf0 2023-12-08T20:25:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.467+0000 7f087432b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c070bf0 con 0x7f086c103590 2023-12-08T20:25:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.467+0000 7f08720c7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f086c102bf0 0x7f086c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.467+0000 7f08720c7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f086c102bf0 0x7f086c06ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40926/0 (socket says 172.21.15.43:40926) 2023-12-08T20:25:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.467+0000 7f08720c7700 1 -- 172.21.15.43:0/1866149538 learned_addr learned my addr 172.21.15.43:0/1866149538 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.467+0000 7f08718c6700 1 --2- 172.21.15.43:0/1866149538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f086c103590 0x7f086c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.467+0000 7f08720c7700 1 -- 172.21.15.43:0/1866149538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f086c103590 msgr2=0x7f086c070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.467+0000 7f08720c7700 1 --2- 172.21.15.43:0/1866149538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f086c103590 0x7f086c070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:04.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.467+0000 7f08720c7700 1 -- 172.21.15.43:0/1866149538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0860005040 con 0x7f086c102bf0 2023-12-08T20:25:04.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.468+0000 7f08720c7700 1 --2- 172.21.15.43:0/1866149538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f086c102bf0 0x7f086c06ff40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f086800eb40 tx=0x7f086800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:04.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.468+0000 7f085effd700 1 -- 172.21.15.43:0/1866149538 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0868007cc0 con 0x7f086c102bf0 2023-12-08T20:25:04.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.468+0000 7f085effd700 1 -- 172.21.15.43:0/1866149538 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f086800f040 con 0x7f086c102bf0 2023-12-08T20:25:04.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.468+0000 7f087432b700 1 -- 172.21.15.43:0/1866149538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c119800 con 0x7f086c102bf0 2023-12-08T20:25:04.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.468+0000 7f085effd700 1 -- 172.21.15.43:0/1866149538 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f086800c990 con 0x7f086c102bf0 2023-12-08T20:25:04.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.468+0000 7f087432b700 1 -- 172.21.15.43:0/1866149538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c119c60 con 0x7f086c102bf0 2023-12-08T20:25:04.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.469+0000 7f087432b700 1 -- 172.21.15.43:0/1866149538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c1050c0 con 0x7f086c102bf0 2023-12-08T20:25:04.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.469+0000 7f085effd700 1 -- 172.21.15.43:0/1866149538 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f086800caf0 con 0x7f086c102bf0 2023-12-08T20:25:04.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.470+0000 7f085effd700 1 --2- 172.21.15.43:0/1866149538 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0858068f70 0x7f085806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:04.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.470+0000 7f085effd700 1 -- 172.21.15.43:0/1866149538 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0868086590 con 0x7f086c102bf0 2023-12-08T20:25:04.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.470+0000 7f08718c6700 1 --2- 172.21.15.43:0/1866149538 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0858068f70 0x7f085806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:04.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.470+0000 7f08718c6700 1 --2- 172.21.15.43:0/1866149538 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0858068f70 0x7f085806b420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f086c072050 tx=0x7f0860009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:04.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.475+0000 7f085effd700 1 -- 172.21.15.43:0/1866149538 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f086804da00 con 0x7f086c102bf0 2023-12-08T20:25:04.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.682+0000 7f087432b700 1 -- 172.21.15.43:0/1866149538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f086c071680 con 0x7f086c102bf0 2023-12-08T20:25:04.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.683+0000 7f085effd700 1 -- 172.21.15.43:0/1866149538 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11096 (secure 0 0 0) 0x7f0868052e50 con 0x7f086c102bf0 2023-12-08T20:25:04.684 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:25:04.684 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":40,"fsid":"28476818-9607-11ee-95a3-87774f69a715","created":"2023-12-08T20:20:31.669394+0000","modified":"2023-12-08T20:24:50.447446+0000","last_up_change":"2023-12-08T20:24:49.445749+0000","last_in_change":"2023-12-08T20:24:32.898273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:23:57.952150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"5c82b664-c209-4a61-8b21-c5d6a73af81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3312385732},{"type":"v1","addr":"172.21.15.43:6803","nonce":3312385732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3312385732},{"type":"v1","addr":"172.21.15.43:6805","nonce":3312385732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3312385732},{"type":"v1","addr":"172.21.15.43:6809","nonce":3312385732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3312385732},{"type":"v1","addr":"172.21.15.43:6807","nonce":3312385732}]},"public_addr":"172.21.15.43:6803/3312385732","cluster_addr":"172.21.15.43:6805/3312385732","heartbeat_back_addr":"172.21.15.43:6809/3312385732","heartbeat_front_addr":"172.21.15.43:6807/3312385732","state":["exists","up"]},{"osd":1,"uuid":"301dfde9-c50a-4f73-856f-ae88dc2d2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3228320632},{"type":"v1","addr":"172.21.15.43:6811","nonce":3228320632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3228320632},{"type":"v1","addr":"172.21.15.43:6813","nonce":3228320632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":3228320632},{"type":"v1","addr":"172.21.15.43:6817","nonce":3228320632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3228320632},{"type":"v1","addr":"172.21.15.43:6815","nonce":3228320632}]},"public_addr":"172.21.15.43:6811/3228320632","cluster_addr":"172.21.15.43:6813/3228320632","heartbeat_back_addr":"172.21.15.43:6817/3228320632","heartbeat_front_addr":"172.21.15.43:6815/3228320632","state":["exists","up"]},{"osd":2,"uuid":"bc7be655-1abc-4982-a674-b78d9f7dc1ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2164647692},{"type":"v1","addr":"172.21.15.43:6819","nonce":2164647692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":2164647692},{"type":"v1","addr":"172.21.15.43:6821","nonce":2164647692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":2164647692},{"type":"v1","addr":"172.21.15.43:6825","nonce":2164647692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":2164647692},{"type":"v1","addr":"172.21.15.43:6823","nonce":2164647692}]},"public_addr":"172.21.15.43:6819/2164647692","cluster_addr":"172.21.15.43:6821/2164647692","heartbeat_back_addr":"172.21.15.43:6825/2164647692","heartbeat_front_addr":"172.21.15.43:6823/2164647692","state":["exists","up"]},{"osd":3,"uuid":"0c0628df-2c6b-40ce-97e2-141d2057af11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2187527806},{"type":"v1","addr":"172.21.15.111:6801","nonce":2187527806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2187527806},{"type":"v1","addr":"172.21.15.111:6803","nonce":2187527806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2187527806},{"type":"v1","addr":"172.21.15.111:6807","nonce":2187527806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2187527806},{"type":"v1","addr":"172.21.15.111:6805","nonce":2187527806}]},"public_addr":"172.21.15.111:6801/2187527806","cluster_addr":"172.21.15.111:6803/2187527806","heartbeat_back_addr":"172.21.15.111:6807/2187527806","heartbeat_front_addr":"172.21.15.111:6805/2187527806","state":["exists","up"]},{"osd":4,"uuid":"87b65c6d-d7c2-44d7-b891-8477e5e891b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":2408695979},{"type":"v1","addr":"172.21.15.111:6809","nonce":2408695979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":2408695979},{"type":"v1","addr":"172.21.15.111:6811","nonce":2408695979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":2408695979},{"type":"v1","addr":"172.21.15.111:6815","nonce":2408695979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":2408695979},{"type":"v1","addr":"172.21.15.111:6813","nonce":2408695979}]},"public_addr":"172.21.15.111:6809/2408695979","cluster_addr":"172.21.15.111:6811/2408695979","heartbeat_back_addr":"172.21.15.111:6815/2408695979","heartbeat_front_addr":"172.21.15.111:6813/2408695979","state":["exists","up"]},{"osd":5,"uuid":"6a99cd97-6a80-4d01-bb37-a159803f7333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":3881389263},{"type":"v1","addr":"172.21.15.111:6817","nonce":3881389263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":3881389263},{"type":"v1","addr":"172.21.15.111:6819","nonce":3881389263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":3881389263},{"type":"v1","addr":"172.21.15.111:6823","nonce":3881389263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":3881389263},{"type":"v1","addr":"172.21.15.111:6821","nonce":3881389263}]},"public_addr":"172.21.15.111:6817/3881389263","cluster_addr":"172.21.15.111:6819/3881389263","heartbeat_back_addr":"172.21.15.111:6823/3881389263","heartbeat_front_addr":"172.21.15.111:6821/3881389263","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:23:11.583744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:23:33.216409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:23:54.174665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:24:11.801925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:24:29.476994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:24:47.562110+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6801/2315465125":"2023-12-09T20:22:19.417857+0000","172.21.15.43:0/4033535283":"2023-12-09T20:22:19.417857+0000","172.21.15.43:0/392501150":"2023-12-09T20:22:19.417857+0000","172.21.15.43:6801/1561199606":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/2345173464":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/3678520486":"2023-12-09T20:22:19.417857+0000","172.21.15.43:0/2451027781":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/3571683356":"2023-12-09T20:21:01.600933+0000","172.21.15.43:0/1298471102":"2023-12-09T20:21:01.600933+0000","172.21.15.43:6800/1561199606":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/2976228612":"2023-12-09T20:21:01.600933+0000","172.21.15.43:6800/2195776328":"2023-12-09T20:21:01.600933+0000","172.21.15.43:6800/2315465125":"2023-12-09T20:22:19.417857+0000","172.21.15.43:6801/2195776328":"2023-12-09T20:21:01.600933+0000","172.21.15.43:0/3758242596":"2023-12-09T20:21:27.333855+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:25:04.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.686+0000 7f087432b700 1 -- 172.21.15.43:0/1866149538 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0858068f70 msgr2=0x7f085806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:04.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.686+0000 7f087432b700 1 --2- 172.21.15.43:0/1866149538 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0858068f70 0x7f085806b420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f086c072050 tx=0x7f0860009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:04.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.686+0000 7f087432b700 1 -- 172.21.15.43:0/1866149538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f086c102bf0 msgr2=0x7f086c06ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:04.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.686+0000 7f087432b700 1 --2- 172.21.15.43:0/1866149538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f086c102bf0 0x7f086c06ff40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f086800eb40 tx=0x7f086800b040 comp rx=0 tx=0).stop 2023-12-08T20:25:04.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.686+0000 7f087432b700 1 -- 172.21.15.43:0/1866149538 shutdown_connections 2023-12-08T20:25:04.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.686+0000 7f087432b700 1 --2- 172.21.15.43:0/1866149538 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0858068f70 0x7f085806b420 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:04.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.686+0000 7f087432b700 1 --2- 172.21.15.43:0/1866149538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f086c102bf0 0x7f086c06ff40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:04.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.686+0000 7f087432b700 1 --2- 172.21.15.43:0/1866149538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f086c103590 0x7f086c070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:04.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.686+0000 7f087432b700 1 -- 172.21.15.43:0/1866149538 >> 172.21.15.43:0/1866149538 conn(0x7f086c0f87a0 msgr2=0x7f086c0fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:04.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.686+0000 7f087432b700 1 -- 172.21.15.43:0/1866149538 shutdown_connections 2023-12-08T20:25:04.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:04.686+0000 7f087432b700 1 -- 172.21.15.43:0/1866149538 wait complete. 2023-12-08T20:25:04.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:04 smithi043 ceph-mon[111966]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:04.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:25:04.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:04 smithi111 ceph-mon[121341]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:04.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:25:05.090 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2023-12-08T20:25:05.090 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2023-12-08T20:25:05.091 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2023-12-08T20:25:05.091 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2023-12-08T20:25:05.091 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2023-12-08T20:25:05.092 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2023-12-08T20:25:05.480 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:05.549 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:05.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:05 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/1866149538' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-08T20:25:05.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:05 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/1866149538' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-08T20:25:06.013 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:06.792 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:06 smithi043 ceph-mon[111966]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:06.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:06 smithi111 ceph-mon[121341]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:07.155 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:07.158 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:08.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.673+0000 7fe1d3616700 1 -- 172.21.15.43:0/3580532747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1cc06ff80 msgr2=0x7fe1cc070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:09.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.673+0000 7fe1d3616700 1 --2- 172.21.15.43:0/3580532747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1cc06ff80 0x7fe1cc070350 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8004970 tx=0x7fe1c8009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:09.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.673+0000 7fe1d3616700 1 -- 172.21.15.43:0/3580532747 shutdown_connections 2023-12-08T20:25:09.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.673+0000 7fe1d3616700 1 --2- 172.21.15.43:0/3580532747 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe1cc070890 0x7fe1cc108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.673+0000 7fe1d3616700 1 --2- 172.21.15.43:0/3580532747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1cc06ff80 0x7fe1cc070350 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.673+0000 7fe1d3616700 1 -- 172.21.15.43:0/3580532747 >> 172.21.15.43:0/3580532747 conn(0x7fe1cc0f8790 msgr2=0x7fe1cc0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:09.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.673+0000 7fe1d3616700 1 -- 172.21.15.43:0/3580532747 shutdown_connections 2023-12-08T20:25:09.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.673+0000 7fe1d3616700 1 -- 172.21.15.43:0/3580532747 wait complete. 2023-12-08T20:25:09.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:08 smithi111 ceph-mon[121341]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:09.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.674+0000 7fe1d3616700 1 Processor -- start 2023-12-08T20:25:09.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.674+0000 7fe1d3616700 1 -- start start 2023-12-08T20:25:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.674+0000 7fe1d3616700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1cc06ff80 0x7fe1cc115810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.674+0000 7fe1d3616700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe1cc070890 0x7fe1cc115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.674+0000 7fe1d3616700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc1163a0 con 0x7fe1cc06ff80 2023-12-08T20:25:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.674+0000 7fe1d3616700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc10f6d0 con 0x7fe1cc070890 2023-12-08T20:25:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.674+0000 7fe1d13b2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1cc06ff80 0x7fe1cc115810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.674+0000 7fe1d13b2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1cc06ff80 0x7fe1cc115810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40956/0 (socket says 172.21.15.43:40956) 2023-12-08T20:25:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.674+0000 7fe1d13b2700 1 -- 172.21.15.43:0/1845844935 learned_addr learned my addr 172.21.15.43:0/1845844935 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.675+0000 7fe1d0bb1700 1 --2- 172.21.15.43:0/1845844935 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe1cc070890 0x7fe1cc115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.675+0000 7fe1d13b2700 1 -- 172.21.15.43:0/1845844935 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe1cc070890 msgr2=0x7fe1cc115d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.675+0000 7fe1d13b2700 1 --2- 172.21.15.43:0/1845844935 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe1cc070890 0x7fe1cc115d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.675+0000 7fe1d13b2700 1 -- 172.21.15.43:0/1845844935 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c8005040 con 0x7fe1cc06ff80 2023-12-08T20:25:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.675+0000 7fe1d0bb1700 1 --2- 172.21.15.43:0/1845844935 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe1cc070890 0x7fe1cc115d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T20:25:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.675+0000 7fe1d13b2700 1 --2- 172.21.15.43:0/1845844935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1cc06ff80 0x7fe1cc115810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8004f50 tx=0x7fe1c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.675+0000 7fe1c1ffb700 1 -- 172.21.15.43:0/1845844935 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1c800e040 con 0x7fe1cc06ff80 2023-12-08T20:25:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.675+0000 7fe1c1ffb700 1 -- 172.21.15.43:0/1845844935 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe1c800bc10 con 0x7fe1cc06ff80 2023-12-08T20:25:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.675+0000 7fe1d3616700 1 -- 172.21.15.43:0/1845844935 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc10f950 con 0x7fe1cc06ff80 2023-12-08T20:25:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.675+0000 7fe1c1ffb700 1 -- 172.21.15.43:0/1845844935 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1c801c3f0 con 0x7fe1cc06ff80 2023-12-08T20:25:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.675+0000 7fe1d3616700 1 -- 172.21.15.43:0/1845844935 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc10fe90 con 0x7fe1cc06ff80 2023-12-08T20:25:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.676+0000 7fe1d3616700 1 -- 172.21.15.43:0/1845844935 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe1cc110330 con 0x7fe1cc06ff80 2023-12-08T20:25:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.677+0000 7fe1c1ffb700 1 -- 172.21.15.43:0/1845844935 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe1c8013420 con 0x7fe1cc06ff80 2023-12-08T20:25:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.677+0000 7fe1c1ffb700 1 --2- 172.21.15.43:0/1845844935 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fe1b8068f70 0x7fe1b806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.677+0000 7fe1c1ffb700 1 -- 172.21.15.43:0/1845844935 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe1c8087eb0 con 0x7fe1cc06ff80 2023-12-08T20:25:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.677+0000 7fe1d0bb1700 1 --2- 172.21.15.43:0/1845844935 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fe1b8068f70 0x7fe1b806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.677+0000 7fe1c1ffb700 1 --2- 172.21.15.43:0/1845844935 >> [v2:172.21.15.111:6808/2408695979,v1:172.21.15.111:6809/2408695979] conn(0x7fe1b806ec40 0x7fe1b8071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.678+0000 7fe1c1ffb700 1 -- 172.21.15.43:0/1845844935 --> [v2:172.21.15.111:6808/2408695979,v1:172.21.15.111:6809/2408695979] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1b8071700 con 0x7fe1b806ec40 2023-12-08T20:25:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.678+0000 7fe1c1ffb700 1 -- 172.21.15.43:0/1845844935 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1c808d4b0 con 0x7fe1cc06ff80 2023-12-08T20:25:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.678+0000 7fe1d1bb3700 1 --2- 172.21.15.43:0/1845844935 >> [v2:172.21.15.111:6808/2408695979,v1:172.21.15.111:6809/2408695979] conn(0x7fe1b806ec40 0x7fe1b8071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.678+0000 7fe1d0bb1700 1 --2- 172.21.15.43:0/1845844935 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fe1b8068f70 0x7fe1b806b420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009fd0 tx=0x7fe1bc00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.678+0000 7fe1d1bb3700 1 --2- 172.21.15.43:0/1845844935 >> [v2:172.21.15.111:6808/2408695979,v1:172.21.15.111:6809/2408695979] conn(0x7fe1b806ec40 0x7fe1b8071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:09.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.679+0000 7fe1c1ffb700 1 -- 172.21.15.43:0/1845844935 <== osd.4 v2:172.21.15.111:6808/2408695979 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe1b8071700 con 0x7fe1b806ec40 2023-12-08T20:25:09.889 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:08 smithi043 ceph-mon[111966]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:09.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.698+0000 7fe1d3616700 1 -- 172.21.15.43:0/1845844935 --> [v2:172.21.15.111:6808/2408695979,v1:172.21.15.111:6809/2408695979] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe1cc1104f0 con 0x7fe1b806ec40 2023-12-08T20:25:09.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.698+0000 7fe1c1ffb700 1 -- 172.21.15.43:0/1845844935 <== osd.4 v2:172.21.15.111:6808/2408695979 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe1cc1104f0 con 0x7fe1b806ec40 2023-12-08T20:25:09.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.699+0000 7fe1d3616700 1 -- 172.21.15.43:0/1845844935 >> [v2:172.21.15.111:6808/2408695979,v1:172.21.15.111:6809/2408695979] conn(0x7fe1b806ec40 msgr2=0x7fe1b8071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:09.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.699+0000 7fe1d3616700 1 --2- 172.21.15.43:0/1845844935 >> [v2:172.21.15.111:6808/2408695979,v1:172.21.15.111:6809/2408695979] conn(0x7fe1b806ec40 0x7fe1b8071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.699+0000 7fe1d3616700 1 -- 172.21.15.43:0/1845844935 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fe1b8068f70 msgr2=0x7fe1b806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:09.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.699+0000 7fe1d3616700 1 --2- 172.21.15.43:0/1845844935 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fe1b8068f70 0x7fe1b806b420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009fd0 tx=0x7fe1bc00b040 comp rx=0 tx=0).stop 2023-12-08T20:25:09.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.699+0000 7fe1d3616700 1 -- 172.21.15.43:0/1845844935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1cc06ff80 msgr2=0x7fe1cc115810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:09.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.699+0000 7fe1d3616700 1 --2- 172.21.15.43:0/1845844935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1cc06ff80 0x7fe1cc115810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8004f50 tx=0x7fe1c8009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:09.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.699+0000 7fe1d3616700 1 -- 172.21.15.43:0/1845844935 shutdown_connections 2023-12-08T20:25:09.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.699+0000 7fe1d3616700 1 --2- 172.21.15.43:0/1845844935 >> [v2:172.21.15.111:6808/2408695979,v1:172.21.15.111:6809/2408695979] conn(0x7fe1b806ec40 0x7fe1b8071050 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.699+0000 7fe1d3616700 1 --2- 172.21.15.43:0/1845844935 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fe1b8068f70 0x7fe1b806b420 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.699+0000 7fe1d3616700 1 --2- 172.21.15.43:0/1845844935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1cc06ff80 0x7fe1cc115810 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.699+0000 7fe1d3616700 1 --2- 172.21.15.43:0/1845844935 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe1cc070890 0x7fe1cc115d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.699+0000 7fe1d3616700 1 -- 172.21.15.43:0/1845844935 >> 172.21.15.43:0/1845844935 conn(0x7fe1cc0f8790 msgr2=0x7fe1cc1037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:09.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.699+0000 7fe1d3616700 1 -- 172.21.15.43:0/1845844935 shutdown_connections 2023-12-08T20:25:09.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.700+0000 7fe1d3616700 1 -- 172.21.15.43:0/1845844935 wait complete. 2023-12-08T20:25:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.846+0000 7fd7e5d44700 1 -- 172.21.15.43:0/3491896724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7e0065390 msgr2=0x7fd7e0065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.846+0000 7fd7e5d44700 1 --2- 172.21.15.43:0/3491896724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7e0065390 0x7fd7e0065800 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8004940 tx=0x7fd7c8009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.846+0000 7fd7e5d44700 1 -- 172.21.15.43:0/3491896724 shutdown_connections 2023-12-08T20:25:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.846+0000 7fd7e5d44700 1 --2- 172.21.15.43:0/3491896724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7e0065390 0x7fd7e0065800 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.846+0000 7fd7e5d44700 1 --2- 172.21.15.43:0/3491896724 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7e0102c20 0x7fd7e0102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.846+0000 7fd7e5d44700 1 -- 172.21.15.43:0/3491896724 >> 172.21.15.43:0/3491896724 conn(0x7fd7e00719b0 msgr2=0x7fd7e0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.847+0000 7fd7e5d44700 1 -- 172.21.15.43:0/3491896724 shutdown_connections 2023-12-08T20:25:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.847+0000 7fd7e5d44700 1 -- 172.21.15.43:0/3491896724 wait complete. 2023-12-08T20:25:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.847+0000 7fd7e5d44700 1 Processor -- start 2023-12-08T20:25:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.847+0000 7fd7e5d44700 1 -- start start 2023-12-08T20:25:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.848+0000 7fd7e5d44700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7e0065390 0x7fd7e00fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.848+0000 7fd7e5d44700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7e0102c20 0x7fd7e00fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:09.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.848+0000 7fd7e5d44700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e00fc730 con 0x7fd7e0102c20 2023-12-08T20:25:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.848+0000 7fd7e5d44700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e00fc8a0 con 0x7fd7e0065390 2023-12-08T20:25:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.848+0000 7fd7deffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7e0102c20 0x7fd7e00fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.848+0000 7fd7deffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7e0102c20 0x7fd7e00fc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40976/0 (socket says 172.21.15.43:40976) 2023-12-08T20:25:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.848+0000 7fd7deffd700 1 -- 172.21.15.43:0/1928746276 learned_addr learned my addr 172.21.15.43:0/1928746276 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.848+0000 7fd7df7fe700 1 --2- 172.21.15.43:0/1928746276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7e0065390 0x7fd7e00fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.848+0000 7fd7deffd700 1 -- 172.21.15.43:0/1928746276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7e0065390 msgr2=0x7fd7e00fbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.848+0000 7fd7deffd700 1 --2- 172.21.15.43:0/1928746276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7e0065390 0x7fd7e00fbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.848+0000 7fd7deffd700 1 -- 172.21.15.43:0/1928746276 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c8005040 con 0x7fd7e0102c20 2023-12-08T20:25:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.848+0000 7fd7deffd700 1 --2- 172.21.15.43:0/1928746276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7e0102c20 0x7fd7e00fc130 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800b3b0 tx=0x7fd7c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.848+0000 7fd7d7fff700 1 -- 172.21.15.43:0/1928746276 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7c800e040 con 0x7fd7e0102c20 2023-12-08T20:25:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.848+0000 7fd7e5d44700 1 -- 172.21.15.43:0/1928746276 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e0119970 con 0x7fd7e0102c20 2023-12-08T20:25:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.849+0000 7fd7d7fff700 1 -- 172.21.15.43:0/1928746276 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd7c801c430 con 0x7fd7e0102c20 2023-12-08T20:25:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.849+0000 7fd7d7fff700 1 -- 172.21.15.43:0/1928746276 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7c8013640 con 0x7fd7e0102c20 2023-12-08T20:25:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.849+0000 7fd7e5d44700 1 -- 172.21.15.43:0/1928746276 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e0119dd0 con 0x7fd7e0102c20 2023-12-08T20:25:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.850+0000 7fd7e5d44700 1 -- 172.21.15.43:0/1928746276 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7e005e300 con 0x7fd7e0102c20 2023-12-08T20:25:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.850+0000 7fd7d7fff700 1 -- 172.21.15.43:0/1928746276 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd7c801c5a0 con 0x7fd7e0102c20 2023-12-08T20:25:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.851+0000 7fd7d7fff700 1 --2- 172.21.15.43:0/1928746276 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fd7cc068f60 0x7fd7cc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.851+0000 7fd7d7fff700 1 -- 172.21.15.43:0/1928746276 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd7c8087590 con 0x7fd7e0102c20 2023-12-08T20:25:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.851+0000 7fd7d7fff700 1 --2- 172.21.15.43:0/1928746276 >> [v2:172.21.15.111:6816/3881389263,v1:172.21.15.111:6817/3881389263] conn(0x7fd7cc06ec30 0x7fd7cc071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.851+0000 7fd7d7fff700 1 -- 172.21.15.43:0/1928746276 --> [v2:172.21.15.111:6816/3881389263,v1:172.21.15.111:6817/3881389263] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7cc0716f0 con 0x7fd7cc06ec30 2023-12-08T20:25:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.851+0000 7fd7d7fff700 1 -- 172.21.15.43:0/1928746276 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7c8089be0 con 0x7fd7e0102c20 2023-12-08T20:25:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.851+0000 7fd7df7fe700 1 --2- 172.21.15.43:0/1928746276 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fd7cc068f60 0x7fd7cc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.851+0000 7fd7dffff700 1 --2- 172.21.15.43:0/1928746276 >> [v2:172.21.15.111:6816/3881389263,v1:172.21.15.111:6817/3881389263] conn(0x7fd7cc06ec30 0x7fd7cc071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.852+0000 7fd7df7fe700 1 --2- 172.21.15.43:0/1928746276 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fd7cc068f60 0x7fd7cc06b410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0007a40 tx=0x7fd7d0009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.852+0000 7fd7dffff700 1 --2- 172.21.15.43:0/1928746276 >> [v2:172.21.15.111:6816/3881389263,v1:172.21.15.111:6817/3881389263] conn(0x7fd7cc06ec30 0x7fd7cc071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.853+0000 7fd7d7fff700 1 -- 172.21.15.43:0/1928746276 <== osd.5 v2:172.21.15.111:6816/3881389263 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd7cc0716f0 con 0x7fd7cc06ec30 2023-12-08T20:25:09.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.868+0000 7fd7e5d44700 1 -- 172.21.15.43:0/1928746276 --> [v2:172.21.15.111:6816/3881389263,v1:172.21.15.111:6817/3881389263] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7e005e730 con 0x7fd7cc06ec30 2023-12-08T20:25:09.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.868+0000 7fd7d7fff700 1 -- 172.21.15.43:0/1928746276 <== osd.5 v2:172.21.15.111:6816/3881389263 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd7e005e730 con 0x7fd7cc06ec30 2023-12-08T20:25:09.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.869+0000 7fd7e5d44700 1 -- 172.21.15.43:0/1928746276 >> [v2:172.21.15.111:6816/3881389263,v1:172.21.15.111:6817/3881389263] conn(0x7fd7cc06ec30 msgr2=0x7fd7cc071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:09.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.869+0000 7fd7e5d44700 1 --2- 172.21.15.43:0/1928746276 >> [v2:172.21.15.111:6816/3881389263,v1:172.21.15.111:6817/3881389263] conn(0x7fd7cc06ec30 0x7fd7cc071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.869+0000 7fd7e5d44700 1 -- 172.21.15.43:0/1928746276 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fd7cc068f60 msgr2=0x7fd7cc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:09.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.869+0000 7fd7e5d44700 1 --2- 172.21.15.43:0/1928746276 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fd7cc068f60 0x7fd7cc06b410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0007a40 tx=0x7fd7d0009da0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.869+0000 7fd7e5d44700 1 -- 172.21.15.43:0/1928746276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7e0102c20 msgr2=0x7fd7e00fc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:09.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.869+0000 7fd7e5d44700 1 --2- 172.21.15.43:0/1928746276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7e0102c20 0x7fd7e00fc130 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800b3b0 tx=0x7fd7c8009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:09.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.869+0000 7fd7e5d44700 1 -- 172.21.15.43:0/1928746276 shutdown_connections 2023-12-08T20:25:09.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.869+0000 7fd7e5d44700 1 --2- 172.21.15.43:0/1928746276 >> [v2:172.21.15.111:6816/3881389263,v1:172.21.15.111:6817/3881389263] conn(0x7fd7cc06ec30 0x7fd7cc071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.869+0000 7fd7e5d44700 1 --2- 172.21.15.43:0/1928746276 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fd7cc068f60 0x7fd7cc06b410 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.869+0000 7fd7e5d44700 1 --2- 172.21.15.43:0/1928746276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7e0065390 0x7fd7e00fbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.869+0000 7fd7e5d44700 1 --2- 172.21.15.43:0/1928746276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7e0102c20 0x7fd7e00fc130 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.869+0000 7fd7e5d44700 1 -- 172.21.15.43:0/1928746276 >> 172.21.15.43:0/1928746276 conn(0x7fd7e00719b0 msgr2=0x7fd7e00fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:09.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.869+0000 7fd7e5d44700 1 -- 172.21.15.43:0/1928746276 shutdown_connections 2023-12-08T20:25:09.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.869+0000 7fd7e5d44700 1 -- 172.21.15.43:0/1928746276 wait complete. 2023-12-08T20:25:09.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.922+0000 7fb634351700 1 -- 172.21.15.43:0/862904827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62c101b60 msgr2=0x7fb62c101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:09.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.922+0000 7fb634351700 1 --2- 172.21.15.43:0/862904827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62c101b60 0x7fb62c101f30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb628004940 tx=0x7fb628009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:09.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.922+0000 7fb634351700 1 -- 172.21.15.43:0/862904827 shutdown_connections 2023-12-08T20:25:09.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.922+0000 7fb634351700 1 --2- 172.21.15.43:0/862904827 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb62c0fbb00 0x7fb62c0fbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.922+0000 7fb634351700 1 --2- 172.21.15.43:0/862904827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62c101b60 0x7fb62c101f30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.922+0000 7fb634351700 1 -- 172.21.15.43:0/862904827 >> 172.21.15.43:0/862904827 conn(0x7fb62c0f7680 msgr2=0x7fb62c0f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:09.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.922+0000 7fb634351700 1 -- 172.21.15.43:0/862904827 shutdown_connections 2023-12-08T20:25:09.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.922+0000 7fb634351700 1 -- 172.21.15.43:0/862904827 wait complete. 2023-12-08T20:25:09.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.923+0000 7fb634351700 1 Processor -- start 2023-12-08T20:25:09.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.923+0000 7fb634351700 1 -- start start 2023-12-08T20:25:09.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.923+0000 7fb634351700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb62c0fbb00 0x7fb62c1124b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:09.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.923+0000 7fb634351700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62c101b60 0x7fb62c1129f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:09.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.923+0000 7fb634351700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c113040 con 0x7fb62c101b60 2023-12-08T20:25:09.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.923+0000 7fb634351700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c10c370 con 0x7fb62c0fbb00 2023-12-08T20:25:09.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.923+0000 7fb6318ec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62c101b60 0x7fb62c1129f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:09.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.923+0000 7fb6318ec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62c101b60 0x7fb62c1129f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41002/0 (socket says 172.21.15.43:41002) 2023-12-08T20:25:09.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.923+0000 7fb6318ec700 1 -- 172.21.15.43:0/1525085563 learned_addr learned my addr 172.21.15.43:0/1525085563 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:09.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.924+0000 7fb6320ed700 1 --2- 172.21.15.43:0/1525085563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb62c0fbb00 0x7fb62c1124b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:09.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.924+0000 7fb6318ec700 1 -- 172.21.15.43:0/1525085563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb62c0fbb00 msgr2=0x7fb62c1124b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:09.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.924+0000 7fb6318ec700 1 --2- 172.21.15.43:0/1525085563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb62c0fbb00 0x7fb62c1124b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.924+0000 7fb6318ec700 1 -- 172.21.15.43:0/1525085563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb628005040 con 0x7fb62c101b60 2023-12-08T20:25:09.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.924+0000 7fb6320ed700 1 --2- 172.21.15.43:0/1525085563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb62c0fbb00 0x7fb62c1124b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:25:09.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.924+0000 7fb6318ec700 1 --2- 172.21.15.43:0/1525085563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62c101b60 0x7fb62c1129f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00eb40 tx=0x7fb61c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:09.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.924+0000 7fb622ffd700 1 -- 172.21.15.43:0/1525085563 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb61c007cc0 con 0x7fb62c101b60 2023-12-08T20:25:09.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.924+0000 7fb622ffd700 1 -- 172.21.15.43:0/1525085563 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb61c00f040 con 0x7fb62c101b60 2023-12-08T20:25:09.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.924+0000 7fb634351700 1 -- 172.21.15.43:0/1525085563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62c10c5f0 con 0x7fb62c101b60 2023-12-08T20:25:09.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.924+0000 7fb622ffd700 1 -- 172.21.15.43:0/1525085563 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb61c009570 con 0x7fb62c101b60 2023-12-08T20:25:09.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.924+0000 7fb634351700 1 -- 172.21.15.43:0/1525085563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62c10cb30 con 0x7fb62c101b60 2023-12-08T20:25:09.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.925+0000 7fb634351700 1 -- 172.21.15.43:0/1525085563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb62c10d050 con 0x7fb62c101b60 2023-12-08T20:25:09.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.926+0000 7fb622ffd700 1 -- 172.21.15.43:0/1525085563 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb61c0096d0 con 0x7fb62c101b60 2023-12-08T20:25:09.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.926+0000 7fb622ffd700 1 --2- 172.21.15.43:0/1525085563 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb618068f60 0x7fb61806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:09.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.926+0000 7fb622ffd700 1 -- 172.21.15.43:0/1525085563 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb61c0868f0 con 0x7fb62c101b60 2023-12-08T20:25:09.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.926+0000 7fb6320ed700 1 --2- 172.21.15.43:0/1525085563 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb618068f60 0x7fb61806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:09.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.927+0000 7fb622ffd700 1 --2- 172.21.15.43:0/1525085563 >> [v2:172.21.15.111:6800/2187527806,v1:172.21.15.111:6801/2187527806] conn(0x7fb61806ec30 0x7fb618071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:09.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.927+0000 7fb622ffd700 1 -- 172.21.15.43:0/1525085563 --> [v2:172.21.15.111:6800/2187527806,v1:172.21.15.111:6801/2187527806] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb6180716f0 con 0x7fb61806ec30 2023-12-08T20:25:09.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.927+0000 7fb622ffd700 1 -- 172.21.15.43:0/1525085563 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb61c086cd0 con 0x7fb62c101b60 2023-12-08T20:25:09.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.927+0000 7fb6320ed700 1 --2- 172.21.15.43:0/1525085563 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb618068f60 0x7fb61806b410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb62800b0d0 tx=0x7fb628009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:09.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.927+0000 7fb6328ee700 1 --2- 172.21.15.43:0/1525085563 >> [v2:172.21.15.111:6800/2187527806,v1:172.21.15.111:6801/2187527806] conn(0x7fb61806ec30 0x7fb618071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:09.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.927+0000 7fb6328ee700 1 --2- 172.21.15.43:0/1525085563 >> [v2:172.21.15.111:6800/2187527806,v1:172.21.15.111:6801/2187527806] conn(0x7fb61806ec30 0x7fb618071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:09.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.928+0000 7fb622ffd700 1 -- 172.21.15.43:0/1525085563 <== osd.3 v2:172.21.15.111:6800/2187527806 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb6180716f0 con 0x7fb61806ec30 2023-12-08T20:25:09.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.946+0000 7fb634351700 1 -- 172.21.15.43:0/1525085563 --> [v2:172.21.15.111:6800/2187527806,v1:172.21.15.111:6801/2187527806] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb62c10d210 con 0x7fb61806ec30 2023-12-08T20:25:09.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.947+0000 7fb622ffd700 1 -- 172.21.15.43:0/1525085563 <== osd.3 v2:172.21.15.111:6800/2187527806 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb62c10d210 con 0x7fb61806ec30 2023-12-08T20:25:09.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.947+0000 7fb634351700 1 -- 172.21.15.43:0/1525085563 >> [v2:172.21.15.111:6800/2187527806,v1:172.21.15.111:6801/2187527806] conn(0x7fb61806ec30 msgr2=0x7fb618071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:09.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.947+0000 7fb634351700 1 --2- 172.21.15.43:0/1525085563 >> [v2:172.21.15.111:6800/2187527806,v1:172.21.15.111:6801/2187527806] conn(0x7fb61806ec30 0x7fb618071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.947+0000 7fb634351700 1 -- 172.21.15.43:0/1525085563 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb618068f60 msgr2=0x7fb61806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:09.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.947+0000 7fb634351700 1 --2- 172.21.15.43:0/1525085563 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb618068f60 0x7fb61806b410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb62800b0d0 tx=0x7fb628009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:09.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.947+0000 7fb634351700 1 -- 172.21.15.43:0/1525085563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62c101b60 msgr2=0x7fb62c1129f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:09.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.947+0000 7fb634351700 1 --2- 172.21.15.43:0/1525085563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62c101b60 0x7fb62c1129f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00eb40 tx=0x7fb61c00b040 comp rx=0 tx=0).stop 2023-12-08T20:25:09.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.947+0000 7fb634351700 1 -- 172.21.15.43:0/1525085563 shutdown_connections 2023-12-08T20:25:09.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.947+0000 7fb634351700 1 --2- 172.21.15.43:0/1525085563 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb618068f60 0x7fb61806b410 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.947+0000 7fb634351700 1 --2- 172.21.15.43:0/1525085563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb62c0fbb00 0x7fb62c1124b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.947+0000 7fb634351700 1 --2- 172.21.15.43:0/1525085563 >> [v2:172.21.15.111:6800/2187527806,v1:172.21.15.111:6801/2187527806] conn(0x7fb61806ec30 0x7fb618071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.947+0000 7fb634351700 1 --2- 172.21.15.43:0/1525085563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62c101b60 0x7fb62c1129f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:09.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.947+0000 7fb634351700 1 -- 172.21.15.43:0/1525085563 >> 172.21.15.43:0/1525085563 conn(0x7fb62c0f7680 msgr2=0x7fb62c0f81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:09.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.948+0000 7fb634351700 1 -- 172.21.15.43:0/1525085563 shutdown_connections 2023-12-08T20:25:09.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:08.948+0000 7fb634351700 1 -- 172.21.15.43:0/1525085563 wait complete. 2023-12-08T20:25:09.903 INFO:teuthology.orchestra.run.smithi043.stdout:167503724551 2023-12-08T20:25:09.904 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.5 2023-12-08T20:25:10.006 INFO:teuthology.orchestra.run.smithi043.stdout:146028888074 2023-12-08T20:25:10.009 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.4 2023-12-08T20:25:10.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.326+0000 7fa91676c700 1 -- 172.21.15.43:0/3914893996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9100fcee0 msgr2=0x7fa910109190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:10.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.326+0000 7fa91676c700 1 --2- 172.21.15.43:0/3914893996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9100fcee0 0x7fa910109190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa904004880 tx=0x7fa904009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:10.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.326+0000 7fa91676c700 1 -- 172.21.15.43:0/3914893996 shutdown_connections 2023-12-08T20:25:10.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.326+0000 7fa91676c700 1 --2- 172.21.15.43:0/3914893996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9100fcee0 0x7fa910109190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:10.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.326+0000 7fa91676c700 1 --2- 172.21.15.43:0/3914893996 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa9100fc5d0 0x7fa9100fc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:10.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.326+0000 7fa91676c700 1 -- 172.21.15.43:0/3914893996 >> 172.21.15.43:0/3914893996 conn(0x7fa9100719b0 msgr2=0x7fa910071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:10.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.326+0000 7fa91676c700 1 -- 172.21.15.43:0/3914893996 shutdown_connections 2023-12-08T20:25:10.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.326+0000 7fa91676c700 1 -- 172.21.15.43:0/3914893996 wait complete. 2023-12-08T20:25:10.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.326+0000 7fa91676c700 1 Processor -- start 2023-12-08T20:25:10.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.327+0000 7fa91676c700 1 -- start start 2023-12-08T20:25:10.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.327+0000 7fa91676c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9100fc5d0 0x7fa910115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:10.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.327+0000 7fa91676c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa9100fcee0 0x7fa910115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:10.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.327+0000 7fa91676c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9101163d0 con 0x7fa9100fc5d0 2023-12-08T20:25:10.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.327+0000 7fa91676c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91010f700 con 0x7fa9100fcee0 2023-12-08T20:25:10.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.327+0000 7fa90ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9100fc5d0 0x7fa910115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:10.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.327+0000 7fa90ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9100fc5d0 0x7fa910115840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41016/0 (socket says 172.21.15.43:41016) 2023-12-08T20:25:10.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.327+0000 7fa90ffff700 1 -- 172.21.15.43:0/396339239 learned_addr learned my addr 172.21.15.43:0/396339239 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:10.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.327+0000 7fa90f7fe700 1 --2- 172.21.15.43:0/396339239 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa9100fcee0 0x7fa910115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:10.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.327+0000 7fa90ffff700 1 -- 172.21.15.43:0/396339239 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa9100fcee0 msgr2=0x7fa910115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:10.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.327+0000 7fa90ffff700 1 --2- 172.21.15.43:0/396339239 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa9100fcee0 0x7fa910115d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:10.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.327+0000 7fa90ffff700 1 -- 172.21.15.43:0/396339239 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa900005040 con 0x7fa9100fc5d0 2023-12-08T20:25:10.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.328+0000 7fa90ffff700 1 --2- 172.21.15.43:0/396339239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9100fc5d0 0x7fa910115840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa9000096b0 tx=0x7fa900009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:10.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.328+0000 7fa90cff9700 1 -- 172.21.15.43:0/396339239 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa900017070 con 0x7fa9100fc5d0 2023-12-08T20:25:10.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.328+0000 7fa90cff9700 1 -- 172.21.15.43:0/396339239 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa90000f040 con 0x7fa9100fc5d0 2023-12-08T20:25:10.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.328+0000 7fa90cff9700 1 -- 172.21.15.43:0/396339239 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa900013b30 con 0x7fa9100fc5d0 2023-12-08T20:25:10.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.328+0000 7fa91676c700 1 -- 172.21.15.43:0/396339239 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa904005040 con 0x7fa9100fc5d0 2023-12-08T20:25:10.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.328+0000 7fa91676c700 1 -- 172.21.15.43:0/396339239 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91010fd30 con 0x7fa9100fc5d0 2023-12-08T20:25:10.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.329+0000 7fa91676c700 1 -- 172.21.15.43:0/396339239 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa9101101d0 con 0x7fa9100fc5d0 2023-12-08T20:25:10.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.329+0000 7fa90cff9700 1 -- 172.21.15.43:0/396339239 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa90000e840 con 0x7fa9100fc5d0 2023-12-08T20:25:10.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.330+0000 7fa90cff9700 1 --2- 172.21.15.43:0/396339239 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa8f8068f70 0x7fa8f806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:10.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.330+0000 7fa90cff9700 1 -- 172.21.15.43:0/396339239 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa9000868d0 con 0x7fa9100fc5d0 2023-12-08T20:25:10.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.330+0000 7fa90f7fe700 1 --2- 172.21.15.43:0/396339239 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa8f8068f70 0x7fa8f806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:10.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.330+0000 7fa90cff9700 1 --2- 172.21.15.43:0/396339239 >> [v2:172.21.15.43:6802/3312385732,v1:172.21.15.43:6803/3312385732] conn(0x7fa8f806ec40 0x7fa8f8071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:10.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.330+0000 7fa90cff9700 1 -- 172.21.15.43:0/396339239 --> [v2:172.21.15.43:6802/3312385732,v1:172.21.15.43:6803/3312385732] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa8f8071700 con 0x7fa8f806ec40 2023-12-08T20:25:10.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.330+0000 7fa90cff9700 1 -- 172.21.15.43:0/396339239 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa90008b220 con 0x7fa9100fc5d0 2023-12-08T20:25:10.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.330+0000 7fa914d09700 1 --2- 172.21.15.43:0/396339239 >> [v2:172.21.15.43:6802/3312385732,v1:172.21.15.43:6803/3312385732] conn(0x7fa8f806ec40 0x7fa8f8071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:10.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.331+0000 7fa90f7fe700 1 --2- 172.21.15.43:0/396339239 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa8f8068f70 0x7fa8f806b420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa910111070 tx=0x7fa904009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:10.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.331+0000 7fa914d09700 1 --2- 172.21.15.43:0/396339239 >> [v2:172.21.15.43:6802/3312385732,v1:172.21.15.43:6803/3312385732] conn(0x7fa8f806ec40 0x7fa8f8071050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:10.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.331+0000 7fa90cff9700 1 -- 172.21.15.43:0/396339239 <== osd.0 v2:172.21.15.43:6802/3312385732 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa8f8071700 con 0x7fa8f806ec40 2023-12-08T20:25:10.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.347+0000 7fa91676c700 1 -- 172.21.15.43:0/396339239 --> [v2:172.21.15.43:6802/3312385732,v1:172.21.15.43:6803/3312385732] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa9100734d0 con 0x7fa8f806ec40 2023-12-08T20:25:10.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.348+0000 7fa90cff9700 1 -- 172.21.15.43:0/396339239 <== osd.0 v2:172.21.15.43:6802/3312385732 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa9100734d0 con 0x7fa8f806ec40 2023-12-08T20:25:10.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.348+0000 7fa91676c700 1 -- 172.21.15.43:0/396339239 >> [v2:172.21.15.43:6802/3312385732,v1:172.21.15.43:6803/3312385732] conn(0x7fa8f806ec40 msgr2=0x7fa8f8071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:10.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.348+0000 7fa91676c700 1 --2- 172.21.15.43:0/396339239 >> [v2:172.21.15.43:6802/3312385732,v1:172.21.15.43:6803/3312385732] conn(0x7fa8f806ec40 0x7fa8f8071050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:10.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.348+0000 7fa91676c700 1 -- 172.21.15.43:0/396339239 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa8f8068f70 msgr2=0x7fa8f806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:10.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.348+0000 7fa91676c700 1 --2- 172.21.15.43:0/396339239 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa8f8068f70 0x7fa8f806b420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa910111070 tx=0x7fa904009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:10.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.348+0000 7fa91676c700 1 -- 172.21.15.43:0/396339239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9100fc5d0 msgr2=0x7fa910115840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:10.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.348+0000 7fa91676c700 1 --2- 172.21.15.43:0/396339239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9100fc5d0 0x7fa910115840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa9000096b0 tx=0x7fa900009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:10.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.348+0000 7fa91676c700 1 -- 172.21.15.43:0/396339239 shutdown_connections 2023-12-08T20:25:10.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.348+0000 7fa91676c700 1 --2- 172.21.15.43:0/396339239 >> [v2:172.21.15.43:6802/3312385732,v1:172.21.15.43:6803/3312385732] conn(0x7fa8f806ec40 0x7fa8f8071050 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:10.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.348+0000 7fa91676c700 1 --2- 172.21.15.43:0/396339239 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa8f8068f70 0x7fa8f806b420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:10.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.348+0000 7fa91676c700 1 --2- 172.21.15.43:0/396339239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9100fc5d0 0x7fa910115840 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:10.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.348+0000 7fa91676c700 1 --2- 172.21.15.43:0/396339239 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa9100fcee0 0x7fa910115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:10.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.348+0000 7fa91676c700 1 -- 172.21.15.43:0/396339239 >> 172.21.15.43:0/396339239 conn(0x7fa9100719b0 msgr2=0x7fa9100fa680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:10.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.348+0000 7fa91676c700 1 -- 172.21.15.43:0/396339239 shutdown_connections 2023-12-08T20:25:10.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.348+0000 7fa91676c700 1 -- 172.21.15.43:0/396339239 wait complete. 2023-12-08T20:25:10.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.427+0000 7f09345a6700 1 -- 172.21.15.43:0/1985286906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f092c1035a0 msgr2=0x7f092c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:10.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.427+0000 7f09345a6700 1 --2- 172.21.15.43:0/1985286906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f092c1035a0 0x7f092c0fcc10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f091c004940 tx=0x7f091c009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:10.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.428+0000 7f09345a6700 1 -- 172.21.15.43:0/1985286906 shutdown_connections 2023-12-08T20:25:10.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.428+0000 7f09345a6700 1 --2- 172.21.15.43:0/1985286906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f092c1035a0 0x7f092c0fcc10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:10.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.428+0000 7f09345a6700 1 --2- 172.21.15.43:0/1985286906 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f092c102c00 0x7f092c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:10.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.428+0000 7f09345a6700 1 -- 172.21.15.43:0/1985286906 >> 172.21.15.43:0/1985286906 conn(0x7f092c0f8790 msgr2=0x7f092c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:10.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.428+0000 7f09345a6700 1 -- 172.21.15.43:0/1985286906 shutdown_connections 2023-12-08T20:25:10.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.428+0000 7f09345a6700 1 -- 172.21.15.43:0/1985286906 wait complete. 2023-12-08T20:25:10.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.428+0000 7f09345a6700 1 Processor -- start 2023-12-08T20:25:10.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.428+0000 7f09345a6700 1 -- start start 2023-12-08T20:25:10.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.429+0000 7f09345a6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f092c102c00 0x7f092c1136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:10.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.429+0000 7f09345a6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f092c1035a0 0x7f092c113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:10.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.429+0000 7f09345a6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c114280 con 0x7f092c1035a0 2023-12-08T20:25:10.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.429+0000 7f09345a6700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c10d570 con 0x7f092c102c00 2023-12-08T20:25:10.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.429+0000 7f0931b41700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f092c1035a0 0x7f092c113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:10.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.429+0000 7f0931b41700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f092c1035a0 0x7f092c113c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41032/0 (socket says 172.21.15.43:41032) 2023-12-08T20:25:10.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.429+0000 7f0931b41700 1 -- 172.21.15.43:0/1078262978 learned_addr learned my addr 172.21.15.43:0/1078262978 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:10.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.429+0000 7f0932342700 1 --2- 172.21.15.43:0/1078262978 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f092c102c00 0x7f092c1136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:10.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.429+0000 7f0931b41700 1 -- 172.21.15.43:0/1078262978 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f092c102c00 msgr2=0x7f092c1136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:10.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.429+0000 7f0931b41700 1 --2- 172.21.15.43:0/1078262978 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f092c102c00 0x7f092c1136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:10.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.429+0000 7f0931b41700 1 -- 172.21.15.43:0/1078262978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091c005040 con 0x7f092c1035a0 2023-12-08T20:25:10.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.429+0000 7f0932342700 1 --2- 172.21.15.43:0/1078262978 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f092c102c00 0x7f092c1136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:25:10.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.429+0000 7f0931b41700 1 --2- 172.21.15.43:0/1078262978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f092c1035a0 0x7f092c113c30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f091c009180 tx=0x7f091c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:10.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.429+0000 7f0922ffd700 1 -- 172.21.15.43:0/1078262978 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f091c00e040 con 0x7f092c1035a0 2023-12-08T20:25:10.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.429+0000 7f09345a6700 1 -- 172.21.15.43:0/1078262978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f092c10d7f0 con 0x7f092c1035a0 2023-12-08T20:25:10.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.430+0000 7f09345a6700 1 -- 172.21.15.43:0/1078262978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f092c10dd30 con 0x7f092c1035a0 2023-12-08T20:25:10.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.430+0000 7f09345a6700 1 -- 172.21.15.43:0/1078262978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f092c10e1f0 con 0x7f092c1035a0 2023-12-08T20:25:10.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.432+0000 7f0922ffd700 1 -- 172.21.15.43:0/1078262978 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f092c10e1f0 con 0x7f092c1035a0 2023-12-08T20:25:10.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.432+0000 7f0922ffd700 1 -- 172.21.15.43:0/1078262978 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f091c02fc80 con 0x7f092c1035a0 2023-12-08T20:25:10.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.433+0000 7f0922ffd700 1 -- 172.21.15.43:0/1078262978 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f091c013420 con 0x7f092c1035a0 2023-12-08T20:25:10.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.433+0000 7f0922ffd700 1 --2- 172.21.15.43:0/1078262978 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0918068f70 0x7f091806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:10.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.434+0000 7f0922ffd700 1 -- 172.21.15.43:0/1078262978 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f091c0887f0 con 0x7f092c1035a0 2023-12-08T20:25:10.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.434+0000 7f0932342700 1 --2- 172.21.15.43:0/1078262978 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0918068f70 0x7f091806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:10.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.434+0000 7f0922ffd700 1 --2- 172.21.15.43:0/1078262978 >> [v2:172.21.15.43:6810/3228320632,v1:172.21.15.43:6811/3228320632] conn(0x7f091806ec40 0x7f0918071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:10.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.434+0000 7f0922ffd700 1 -- 172.21.15.43:0/1078262978 --> [v2:172.21.15.43:6810/3228320632,v1:172.21.15.43:6811/3228320632] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0918071700 con 0x7f091806ec40 2023-12-08T20:25:10.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.434+0000 7f0922ffd700 1 -- 172.21.15.43:0/1078262978 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f091c088bf0 con 0x7f092c1035a0 2023-12-08T20:25:10.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.434+0000 7f0932b43700 1 --2- 172.21.15.43:0/1078262978 >> [v2:172.21.15.43:6810/3228320632,v1:172.21.15.43:6811/3228320632] conn(0x7f091806ec40 0x7f0918071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:10.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.434+0000 7f0932342700 1 --2- 172.21.15.43:0/1078262978 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0918068f70 0x7f091806b420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0928009fd0 tx=0x7f0928009f20 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:10.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.434+0000 7f0932b43700 1 --2- 172.21.15.43:0/1078262978 >> [v2:172.21.15.43:6810/3228320632,v1:172.21.15.43:6811/3228320632] conn(0x7f091806ec40 0x7f0918071050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:10.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.435+0000 7f0922ffd700 1 -- 172.21.15.43:0/1078262978 <== osd.1 v2:172.21.15.43:6810/3228320632 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f0918071700 con 0x7f091806ec40 2023-12-08T20:25:10.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.451+0000 7f09345a6700 1 -- 172.21.15.43:0/1078262978 --> [v2:172.21.15.43:6810/3228320632,v1:172.21.15.43:6811/3228320632] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f092c05e2c0 con 0x7f091806ec40 2023-12-08T20:25:10.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.451+0000 7f0922ffd700 1 -- 172.21.15.43:0/1078262978 <== osd.1 v2:172.21.15.43:6810/3228320632 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f092c05e2c0 con 0x7f091806ec40 2023-12-08T20:25:10.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.452+0000 7f09345a6700 1 -- 172.21.15.43:0/1078262978 >> [v2:172.21.15.43:6810/3228320632,v1:172.21.15.43:6811/3228320632] conn(0x7f091806ec40 msgr2=0x7f0918071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:10.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.452+0000 7f09345a6700 1 --2- 172.21.15.43:0/1078262978 >> [v2:172.21.15.43:6810/3228320632,v1:172.21.15.43:6811/3228320632] conn(0x7f091806ec40 0x7f0918071050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:10.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.452+0000 7f09345a6700 1 -- 172.21.15.43:0/1078262978 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0918068f70 msgr2=0x7f091806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:10.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.452+0000 7f09345a6700 1 --2- 172.21.15.43:0/1078262978 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0918068f70 0x7f091806b420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0928009fd0 tx=0x7f0928009f20 comp rx=0 tx=0).stop 2023-12-08T20:25:10.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.452+0000 7f09345a6700 1 -- 172.21.15.43:0/1078262978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f092c1035a0 msgr2=0x7f092c113c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:10.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.452+0000 7f09345a6700 1 --2- 172.21.15.43:0/1078262978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f092c1035a0 0x7f092c113c30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f091c009180 tx=0x7f091c009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:10.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.452+0000 7f09345a6700 1 -- 172.21.15.43:0/1078262978 shutdown_connections 2023-12-08T20:25:10.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.452+0000 7f09345a6700 1 --2- 172.21.15.43:0/1078262978 >> [v2:172.21.15.43:6810/3228320632,v1:172.21.15.43:6811/3228320632] conn(0x7f091806ec40 0x7f0918071050 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:10.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.452+0000 7f09345a6700 1 --2- 172.21.15.43:0/1078262978 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0918068f70 0x7f091806b420 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:10.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.452+0000 7f09345a6700 1 --2- 172.21.15.43:0/1078262978 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f092c102c00 0x7f092c1136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:10.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.452+0000 7f09345a6700 1 --2- 172.21.15.43:0/1078262978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f092c1035a0 0x7f092c113c30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:10.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.452+0000 7f09345a6700 1 -- 172.21.15.43:0/1078262978 >> 172.21.15.43:0/1078262978 conn(0x7f092c0f8790 msgr2=0x7f092c0fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:10.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.452+0000 7f09345a6700 1 -- 172.21.15.43:0/1078262978 shutdown_connections 2023-12-08T20:25:10.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:10.452+0000 7f09345a6700 1 -- 172.21.15.43:0/1078262978 wait complete. 2023-12-08T20:25:10.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:10 smithi043 ceph-mon[111966]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:10.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:10 smithi111 ceph-mon[121341]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:11.170 INFO:teuthology.orchestra.run.smithi043.stdout:115964117006 2023-12-08T20:25:11.170 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.3 2023-12-08T20:25:11.405 INFO:teuthology.orchestra.run.smithi043.stdout:38654705691 2023-12-08T20:25:11.405 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.0 2023-12-08T20:25:11.489 INFO:teuthology.orchestra.run.smithi043.stdout:60129542166 2023-12-08T20:25:11.489 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.1 2023-12-08T20:25:11.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.976+0000 7f9897633700 1 -- 172.21.15.43:0/111291188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9890102c70 msgr2=0x7f9890103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:11.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.976+0000 7f9897633700 1 --2- 172.21.15.43:0/111291188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9890102c70 0x7f9890103040 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f988c004940 tx=0x7f988c009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:11.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.976+0000 7f9897633700 1 -- 172.21.15.43:0/111291188 shutdown_connections 2023-12-08T20:25:11.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.977+0000 7f9897633700 1 --2- 172.21.15.43:0/111291188 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98900fb1e0 0x7f98900fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:11.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.977+0000 7f9897633700 1 --2- 172.21.15.43:0/111291188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9890102c70 0x7f9890103040 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:11.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.977+0000 7f9897633700 1 -- 172.21.15.43:0/111291188 >> 172.21.15.43:0/111291188 conn(0x7f98900711a0 msgr2=0x7f98900715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:11.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.977+0000 7f9897633700 1 -- 172.21.15.43:0/111291188 shutdown_connections 2023-12-08T20:25:11.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.977+0000 7f9897633700 1 -- 172.21.15.43:0/111291188 wait complete. 2023-12-08T20:25:11.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.978+0000 7f9897633700 1 Processor -- start 2023-12-08T20:25:11.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.978+0000 7f9897633700 1 -- start start 2023-12-08T20:25:11.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.979+0000 7f9897633700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98900fb1e0 0x7f98901103c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:11.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.979+0000 7f9897633700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9890102c70 0x7f9890110940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:11.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.979+0000 7f9897633700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9890110f90 con 0x7f98900fb1e0 2023-12-08T20:25:11.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.979+0000 7f9897633700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98901161f0 con 0x7f9890102c70 2023-12-08T20:25:11.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.979+0000 7f98953cf700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98900fb1e0 0x7f98901103c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:11.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.979+0000 7f98953cf700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98900fb1e0 0x7f98901103c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43862/0 (socket says 172.21.15.43:43862) 2023-12-08T20:25:11.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.979+0000 7f98953cf700 1 -- 172.21.15.43:0/2599749493 learned_addr learned my addr 172.21.15.43:0/2599749493 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:11.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.979+0000 7f9894bce700 1 --2- 172.21.15.43:0/2599749493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9890102c70 0x7f9890110940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:11.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.979+0000 7f98953cf700 1 -- 172.21.15.43:0/2599749493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9890102c70 msgr2=0x7f9890110940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:11.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.979+0000 7f98953cf700 1 --2- 172.21.15.43:0/2599749493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9890102c70 0x7f9890110940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:11.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.979+0000 7f98953cf700 1 -- 172.21.15.43:0/2599749493 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c005040 con 0x7f98900fb1e0 2023-12-08T20:25:11.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.979+0000 7f98953cf700 1 --2- 172.21.15.43:0/2599749493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98900fb1e0 0x7f98901103c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f988c00b3b0 tx=0x7f988c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:11.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.980+0000 7f9885ffb700 1 -- 172.21.15.43:0/2599749493 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f988c00e040 con 0x7f98900fb1e0 2023-12-08T20:25:11.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.980+0000 7f9897633700 1 -- 172.21.15.43:0/2599749493 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9890116440 con 0x7f98900fb1e0 2023-12-08T20:25:11.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.980+0000 7f9885ffb700 1 -- 172.21.15.43:0/2599749493 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f988c01c430 con 0x7f98900fb1e0 2023-12-08T20:25:11.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.980+0000 7f9885ffb700 1 -- 172.21.15.43:0/2599749493 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f988c013640 con 0x7f98900fb1e0 2023-12-08T20:25:11.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.980+0000 7f9897633700 1 -- 172.21.15.43:0/2599749493 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9890116980 con 0x7f98900fb1e0 2023-12-08T20:25:11.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.981+0000 7f9897633700 1 -- 172.21.15.43:0/2599749493 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9890072cc0 con 0x7f98900fb1e0 2023-12-08T20:25:11.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.982+0000 7f9885ffb700 1 -- 172.21.15.43:0/2599749493 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f988c01c5a0 con 0x7f98900fb1e0 2023-12-08T20:25:11.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.982+0000 7f9885ffb700 1 --2- 172.21.15.43:0/2599749493 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f987c068f60 0x7f987c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:11.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.982+0000 7f9885ffb700 1 -- 172.21.15.43:0/2599749493 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f988c0880c0 con 0x7f98900fb1e0 2023-12-08T20:25:11.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.982+0000 7f9894bce700 1 --2- 172.21.15.43:0/2599749493 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f987c068f60 0x7f987c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:11.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.982+0000 7f9885ffb700 1 --2- 172.21.15.43:0/2599749493 >> [v2:172.21.15.43:6818/2164647692,v1:172.21.15.43:6819/2164647692] conn(0x7f987c06ec30 0x7f987c071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:11.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.982+0000 7f9885ffb700 1 -- 172.21.15.43:0/2599749493 --> [v2:172.21.15.43:6818/2164647692,v1:172.21.15.43:6819/2164647692] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f987c0716f0 con 0x7f987c06ec30 2023-12-08T20:25:11.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.982+0000 7f9885ffb700 1 -- 172.21.15.43:0/2599749493 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f988c0884a0 con 0x7f98900fb1e0 2023-12-08T20:25:11.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.983+0000 7f9895bd0700 1 --2- 172.21.15.43:0/2599749493 >> [v2:172.21.15.43:6818/2164647692,v1:172.21.15.43:6819/2164647692] conn(0x7f987c06ec30 0x7f987c071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:11.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.983+0000 7f9894bce700 1 --2- 172.21.15.43:0/2599749493 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f987c068f60 0x7f987c06b410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f989010cd00 tx=0x7f9880009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:11.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.983+0000 7f9895bd0700 1 --2- 172.21.15.43:0/2599749493 >> [v2:172.21.15.43:6818/2164647692,v1:172.21.15.43:6819/2164647692] conn(0x7f987c06ec30 0x7f987c071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:11.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:11.984+0000 7f9885ffb700 1 -- 172.21.15.43:0/2599749493 <== osd.2 v2:172.21.15.43:6818/2164647692 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f987c0716f0 con 0x7f987c06ec30 2023-12-08T20:25:12.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:12.000+0000 7f9897633700 1 -- 172.21.15.43:0/2599749493 --> [v2:172.21.15.43:6818/2164647692,v1:172.21.15.43:6819/2164647692] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f98900fd090 con 0x7f987c06ec30 2023-12-08T20:25:12.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:12.000+0000 7f9885ffb700 1 -- 172.21.15.43:0/2599749493 <== osd.2 v2:172.21.15.43:6818/2164647692 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f98900fd090 con 0x7f987c06ec30 2023-12-08T20:25:12.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:12.001+0000 7f9897633700 1 -- 172.21.15.43:0/2599749493 >> [v2:172.21.15.43:6818/2164647692,v1:172.21.15.43:6819/2164647692] conn(0x7f987c06ec30 msgr2=0x7f987c071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:12.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:12.001+0000 7f9897633700 1 --2- 172.21.15.43:0/2599749493 >> [v2:172.21.15.43:6818/2164647692,v1:172.21.15.43:6819/2164647692] conn(0x7f987c06ec30 0x7f987c071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:12.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:12.001+0000 7f9897633700 1 -- 172.21.15.43:0/2599749493 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f987c068f60 msgr2=0x7f987c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:12.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:12.001+0000 7f9897633700 1 --2- 172.21.15.43:0/2599749493 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f987c068f60 0x7f987c06b410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f989010cd00 tx=0x7f9880009040 comp rx=0 tx=0).stop 2023-12-08T20:25:12.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:12.001+0000 7f9897633700 1 -- 172.21.15.43:0/2599749493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98900fb1e0 msgr2=0x7f98901103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:12.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:12.001+0000 7f9897633700 1 --2- 172.21.15.43:0/2599749493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98900fb1e0 0x7f98901103c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f988c00b3b0 tx=0x7f988c009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:12.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:12.001+0000 7f9897633700 1 -- 172.21.15.43:0/2599749493 shutdown_connections 2023-12-08T20:25:12.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:12.001+0000 7f9897633700 1 --2- 172.21.15.43:0/2599749493 >> [v2:172.21.15.43:6818/2164647692,v1:172.21.15.43:6819/2164647692] conn(0x7f987c06ec30 0x7f987c071040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:12.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:12.001+0000 7f9897633700 1 --2- 172.21.15.43:0/2599749493 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f987c068f60 0x7f987c06b410 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:12.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:12.001+0000 7f9897633700 1 --2- 172.21.15.43:0/2599749493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98900fb1e0 0x7f98901103c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:12.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:12.001+0000 7f9897633700 1 --2- 172.21.15.43:0/2599749493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9890102c70 0x7f9890110940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:12.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:12.001+0000 7f9897633700 1 -- 172.21.15.43:0/2599749493 >> 172.21.15.43:0/2599749493 conn(0x7f98900711a0 msgr2=0x7f98900fc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:12.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:12.001+0000 7f9897633700 1 -- 172.21.15.43:0/2599749493 shutdown_connections 2023-12-08T20:25:12.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:12.002+0000 7f9897633700 1 -- 172.21.15.43:0/2599749493 wait complete. 2023-12-08T20:25:12.007 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:12.149 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:12.149 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:12.486 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:12.623 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:12 smithi043 ceph-mon[111966]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:12.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:12 smithi111 ceph-mon[121341]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:13.002 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:13.168 INFO:teuthology.orchestra.run.smithi043.stdout:81604378643 2023-12-08T20:25:13.168 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph osd last-stat-seq osd.2 2023-12-08T20:25:14.526 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:14 smithi043 ceph-mon[111966]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:14.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:14 smithi111 ceph-mon[121341]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:15.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.210+0000 7f7ac1133700 1 -- 172.21.15.43:0/32874456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7abc101b00 msgr2=0x7f7abc101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:15.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.210+0000 7f7ac1133700 1 --2- 172.21.15.43:0/32874456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7abc101b00 0x7f7abc101ed0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7aac004940 tx=0x7f7aac009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:15.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.210+0000 7f7ac1133700 1 -- 172.21.15.43:0/32874456 shutdown_connections 2023-12-08T20:25:15.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.210+0000 7f7ac1133700 1 --2- 172.21.15.43:0/32874456 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7abc0fbb40 0x7f7abc0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:15.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.210+0000 7f7ac1133700 1 --2- 172.21.15.43:0/32874456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7abc101b00 0x7f7abc101ed0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:15.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.210+0000 7f7ac1133700 1 -- 172.21.15.43:0/32874456 >> 172.21.15.43:0/32874456 conn(0x7f7abc0719b0 msgr2=0x7f7abc071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:15.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.210+0000 7f7ac1133700 1 -- 172.21.15.43:0/32874456 shutdown_connections 2023-12-08T20:25:15.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.210+0000 7f7ac1133700 1 -- 172.21.15.43:0/32874456 wait complete. 2023-12-08T20:25:15.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.211+0000 7f7ac1133700 1 Processor -- start 2023-12-08T20:25:15.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.211+0000 7f7ac1133700 1 -- start start 2023-12-08T20:25:15.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.211+0000 7f7ac1133700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7abc0fbb40 0x7f7abc113590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:15.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.212+0000 7f7ac1133700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7abc101b00 0x7f7abc113ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:15.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.212+0000 7f7ac1133700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc114120 con 0x7f7abc101b00 2023-12-08T20:25:15.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.212+0000 7f7ac1133700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc10d450 con 0x7f7abc0fbb40 2023-12-08T20:25:15.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.212+0000 7f7aba59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7abc101b00 0x7f7abc113ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:15.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.212+0000 7f7aba59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7abc101b00 0x7f7abc113ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43880/0 (socket says 172.21.15.43:43880) 2023-12-08T20:25:15.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.212+0000 7f7aba59c700 1 -- 172.21.15.43:0/2924471625 learned_addr learned my addr 172.21.15.43:0/2924471625 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:15.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.212+0000 7f7abad9d700 1 --2- 172.21.15.43:0/2924471625 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7abc0fbb40 0x7f7abc113590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:15.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.212+0000 7f7aba59c700 1 -- 172.21.15.43:0/2924471625 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7abc0fbb40 msgr2=0x7f7abc113590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:15.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.212+0000 7f7aba59c700 1 --2- 172.21.15.43:0/2924471625 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7abc0fbb40 0x7f7abc113590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:15.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.212+0000 7f7aba59c700 1 -- 172.21.15.43:0/2924471625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac005040 con 0x7f7abc101b00 2023-12-08T20:25:15.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.212+0000 7f7aba59c700 1 --2- 172.21.15.43:0/2924471625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7abc101b00 0x7f7abc113ad0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000eb40 tx=0x7f7ab000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:15.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.212+0000 7f7aa37fe700 1 -- 172.21.15.43:0/2924471625 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ab0007cc0 con 0x7f7abc101b00 2023-12-08T20:25:15.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.212+0000 7f7aa37fe700 1 -- 172.21.15.43:0/2924471625 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7ab000f040 con 0x7f7abc101b00 2023-12-08T20:25:15.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.213+0000 7f7aa37fe700 1 -- 172.21.15.43:0/2924471625 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ab0009570 con 0x7f7abc101b00 2023-12-08T20:25:15.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.213+0000 7f7ac1133700 1 -- 172.21.15.43:0/2924471625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7abc10d6d0 con 0x7f7abc101b00 2023-12-08T20:25:15.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.213+0000 7f7ac1133700 1 -- 172.21.15.43:0/2924471625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc10dbc0 con 0x7f7abc101b00 2023-12-08T20:25:15.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.214+0000 7f7ac1133700 1 -- 172.21.15.43:0/2924471625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7abc0734d0 con 0x7f7abc101b00 2023-12-08T20:25:15.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.214+0000 7f7aa37fe700 1 -- 172.21.15.43:0/2924471625 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f7ab00096d0 con 0x7f7abc101b00 2023-12-08T20:25:15.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.215+0000 7f7aa37fe700 1 --2- 172.21.15.43:0/2924471625 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f7aa4068f70 0x7f7aa406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:15.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.215+0000 7f7aa37fe700 1 -- 172.21.15.43:0/2924471625 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7ab0088840 con 0x7f7abc101b00 2023-12-08T20:25:15.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.215+0000 7f7abad9d700 1 --2- 172.21.15.43:0/2924471625 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f7aa4068f70 0x7f7aa406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:15.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.215+0000 7f7abad9d700 1 --2- 172.21.15.43:0/2924471625 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f7aa4068f70 0x7f7aa406b420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7aac00b0d0 tx=0x7f7aac009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:15.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.220+0000 7f7aa37fe700 1 -- 172.21.15.43:0/2924471625 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7ab008c060 con 0x7f7abc101b00 2023-12-08T20:25:15.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.312+0000 7f1193519700 1 -- 172.21.15.43:0/4049464907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f118c0708f0 msgr2=0x7f118c108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:15.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.312+0000 7f1193519700 1 --2- 172.21.15.43:0/4049464907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f118c0708f0 0x7f118c108f10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f117c004970 tx=0x7f117c009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:15.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.312+0000 7f1193519700 1 -- 172.21.15.43:0/4049464907 shutdown_connections 2023-12-08T20:25:15.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.312+0000 7f1193519700 1 --2- 172.21.15.43:0/4049464907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f118c0708f0 0x7f118c108f10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:15.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.312+0000 7f1193519700 1 --2- 172.21.15.43:0/4049464907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f118c06ffe0 0x7f118c0703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:15.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.312+0000 7f1193519700 1 -- 172.21.15.43:0/4049464907 >> 172.21.15.43:0/4049464907 conn(0x7f118c0f8790 msgr2=0x7f118c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:15.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.312+0000 7f1193519700 1 -- 172.21.15.43:0/4049464907 shutdown_connections 2023-12-08T20:25:15.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.312+0000 7f1193519700 1 -- 172.21.15.43:0/4049464907 wait complete. 2023-12-08T20:25:15.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.313+0000 7f1193519700 1 Processor -- start 2023-12-08T20:25:15.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.313+0000 7f1193519700 1 -- start start 2023-12-08T20:25:15.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.313+0000 7f1193519700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f118c06ffe0 0x7f118c115810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:15.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.313+0000 7f1193519700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f118c0708f0 0x7f118c115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:15.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.313+0000 7f1193519700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c1163a0 con 0x7f118c06ffe0 2023-12-08T20:25:15.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.313+0000 7f1193519700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c10f6d0 con 0x7f118c0708f0 2023-12-08T20:25:15.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.313+0000 7f11912b5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f118c06ffe0 0x7f118c115810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:15.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.313+0000 7f11912b5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f118c06ffe0 0x7f118c115810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43888/0 (socket says 172.21.15.43:43888) 2023-12-08T20:25:15.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.313+0000 7f11912b5700 1 -- 172.21.15.43:0/3182523552 learned_addr learned my addr 172.21.15.43:0/3182523552 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:15.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.314+0000 7f1190ab4700 1 --2- 172.21.15.43:0/3182523552 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f118c0708f0 0x7f118c115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:15.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.314+0000 7f11912b5700 1 -- 172.21.15.43:0/3182523552 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f118c0708f0 msgr2=0x7f118c115d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:15.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.314+0000 7f11912b5700 1 --2- 172.21.15.43:0/3182523552 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f118c0708f0 0x7f118c115d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:15.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.314+0000 7f11912b5700 1 -- 172.21.15.43:0/3182523552 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c005040 con 0x7f118c06ffe0 2023-12-08T20:25:15.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.314+0000 7f11912b5700 1 --2- 172.21.15.43:0/3182523552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f118c06ffe0 0x7f118c115810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f118800eb40 tx=0x7f118800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:15.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.314+0000 7f1181ffb700 1 -- 172.21.15.43:0/3182523552 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1188007cc0 con 0x7f118c06ffe0 2023-12-08T20:25:15.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.314+0000 7f1181ffb700 1 -- 172.21.15.43:0/3182523552 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f118800f040 con 0x7f118c06ffe0 2023-12-08T20:25:15.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.314+0000 7f1181ffb700 1 -- 172.21.15.43:0/3182523552 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f118800c990 con 0x7f118c06ffe0 2023-12-08T20:25:15.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.314+0000 7f1193519700 1 -- 172.21.15.43:0/3182523552 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118c10f950 con 0x7f118c06ffe0 2023-12-08T20:25:15.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.315+0000 7f1193519700 1 -- 172.21.15.43:0/3182523552 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118c10fe60 con 0x7f118c06ffe0 2023-12-08T20:25:15.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.316+0000 7f1193519700 1 -- 172.21.15.43:0/3182523552 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118c1065d0 con 0x7f118c06ffe0 2023-12-08T20:25:15.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.317+0000 7f1181ffb700 1 -- 172.21.15.43:0/3182523552 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f118800caf0 con 0x7f118c06ffe0 2023-12-08T20:25:15.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.318+0000 7f1181ffb700 1 --2- 172.21.15.43:0/3182523552 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f1178068f60 0x7f117806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:15.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.318+0000 7f1190ab4700 1 --2- 172.21.15.43:0/3182523552 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f1178068f60 0x7f117806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:15.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.318+0000 7f1181ffb700 1 -- 172.21.15.43:0/3182523552 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1188086560 con 0x7f118c06ffe0 2023-12-08T20:25:15.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.319+0000 7f1190ab4700 1 --2- 172.21.15.43:0/3182523552 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f1178068f60 0x7f117806b410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f117c009fd0 tx=0x7f117c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:15.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.323+0000 7f1181ffb700 1 -- 172.21.15.43:0/3182523552 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f118804da00 con 0x7f118c06ffe0 2023-12-08T20:25:15.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.450+0000 7f7ac1133700 1 -- 172.21.15.43:0/2924471625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7abc10eb70 con 0x7f7abc101b00 2023-12-08T20:25:15.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.450+0000 7f7aa37fe700 1 -- 172.21.15.43:0/2924471625 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ab0019020 con 0x7f7abc101b00 2023-12-08T20:25:15.451 INFO:teuthology.orchestra.run.smithi043.stdout:167503724552 2023-12-08T20:25:15.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.453+0000 7f7ac1133700 1 -- 172.21.15.43:0/2924471625 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f7aa4068f70 msgr2=0x7f7aa406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:15.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.453+0000 7f7ac1133700 1 --2- 172.21.15.43:0/2924471625 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f7aa4068f70 0x7f7aa406b420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7aac00b0d0 tx=0x7f7aac009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:15.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.453+0000 7f7ac1133700 1 -- 172.21.15.43:0/2924471625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7abc101b00 msgr2=0x7f7abc113ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:15.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.453+0000 7f7ac1133700 1 --2- 172.21.15.43:0/2924471625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7abc101b00 0x7f7abc113ad0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000eb40 tx=0x7f7ab000b040 comp rx=0 tx=0).stop 2023-12-08T20:25:15.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.453+0000 7f7ac1133700 1 -- 172.21.15.43:0/2924471625 shutdown_connections 2023-12-08T20:25:15.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.453+0000 7f7ac1133700 1 --2- 172.21.15.43:0/2924471625 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f7aa4068f70 0x7f7aa406b420 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:15.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.453+0000 7f7ac1133700 1 --2- 172.21.15.43:0/2924471625 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7abc0fbb40 0x7f7abc113590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:15.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.453+0000 7f7ac1133700 1 --2- 172.21.15.43:0/2924471625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7abc101b00 0x7f7abc113ad0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:15.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.453+0000 7f7ac1133700 1 -- 172.21.15.43:0/2924471625 >> 172.21.15.43:0/2924471625 conn(0x7f7abc0719b0 msgr2=0x7f7abc065470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:15.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.453+0000 7f7ac1133700 1 -- 172.21.15.43:0/2924471625 shutdown_connections 2023-12-08T20:25:15.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.453+0000 7f7ac1133700 1 -- 172.21.15.43:0/2924471625 wait complete. 2023-12-08T20:25:15.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.545+0000 7f1193519700 1 -- 172.21.15.43:0/3182523552 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f118c04bbd0 con 0x7f118c06ffe0 2023-12-08T20:25:15.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.545+0000 7f1181ffb700 1 -- 172.21.15.43:0/3182523552 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f11880568b0 con 0x7f118c06ffe0 2023-12-08T20:25:15.546 INFO:teuthology.orchestra.run.smithi043.stdout:38654705691 2023-12-08T20:25:15.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.547+0000 7f1193519700 1 -- 172.21.15.43:0/3182523552 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f1178068f60 msgr2=0x7f117806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:15.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.547+0000 7f1193519700 1 --2- 172.21.15.43:0/3182523552 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f1178068f60 0x7f117806b410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f117c009fd0 tx=0x7f117c009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:15.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.547+0000 7f1193519700 1 -- 172.21.15.43:0/3182523552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f118c06ffe0 msgr2=0x7f118c115810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:15.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.547+0000 7f1193519700 1 --2- 172.21.15.43:0/3182523552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f118c06ffe0 0x7f118c115810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f118800eb40 tx=0x7f118800b040 comp rx=0 tx=0).stop 2023-12-08T20:25:15.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.548+0000 7f1193519700 1 -- 172.21.15.43:0/3182523552 shutdown_connections 2023-12-08T20:25:15.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.548+0000 7f1193519700 1 --2- 172.21.15.43:0/3182523552 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f1178068f60 0x7f117806b410 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:15.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.548+0000 7f1193519700 1 --2- 172.21.15.43:0/3182523552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f118c06ffe0 0x7f118c115810 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:15.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.548+0000 7f1193519700 1 --2- 172.21.15.43:0/3182523552 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f118c0708f0 0x7f118c115d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:15.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.548+0000 7f1193519700 1 -- 172.21.15.43:0/3182523552 >> 172.21.15.43:0/3182523552 conn(0x7f118c0f8790 msgr2=0x7f118c103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:15.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.548+0000 7f1193519700 1 -- 172.21.15.43:0/3182523552 shutdown_connections 2023-12-08T20:25:15.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.548+0000 7f1193519700 1 -- 172.21.15.43:0/3182523552 wait complete. 2023-12-08T20:25:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.807+0000 7f58ce807700 1 -- 172.21.15.43:0/3652929471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58c8101b00 msgr2=0x7f58c8101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.807+0000 7f58ce807700 1 --2- 172.21.15.43:0/3652929471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58c8101b00 0x7f58c8101ed0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f58b8004940 tx=0x7f58b8009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.807+0000 7f58ce807700 1 -- 172.21.15.43:0/3652929471 shutdown_connections 2023-12-08T20:25:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.807+0000 7f58ce807700 1 --2- 172.21.15.43:0/3652929471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58c80fbb40 0x7f58c80fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.807+0000 7f58ce807700 1 --2- 172.21.15.43:0/3652929471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58c8101b00 0x7f58c8101ed0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.807+0000 7f58ce807700 1 -- 172.21.15.43:0/3652929471 >> 172.21.15.43:0/3652929471 conn(0x7f58c80719b0 msgr2=0x7f58c8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.807+0000 7f58ce807700 1 -- 172.21.15.43:0/3652929471 shutdown_connections 2023-12-08T20:25:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.807+0000 7f58ce807700 1 -- 172.21.15.43:0/3652929471 wait complete. 2023-12-08T20:25:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.807+0000 7f58ce807700 1 Processor -- start 2023-12-08T20:25:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.808+0000 7f58ce807700 1 -- start start 2023-12-08T20:25:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.808+0000 7f58ce807700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58c80fbb40 0x7f58c810e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:15.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.808+0000 7f58ce807700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58c8101b00 0x7f58c810eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:15.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.808+0000 7f58ce807700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c810f150 con 0x7f58c80fbb40 2023-12-08T20:25:15.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.808+0000 7f58ce807700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c810f2c0 con 0x7f58c8101b00 2023-12-08T20:25:15.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.808+0000 7f58c7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58c80fbb40 0x7f58c810e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:15.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.808+0000 7f58c7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58c80fbb40 0x7f58c810e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43904/0 (socket says 172.21.15.43:43904) 2023-12-08T20:25:15.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.808+0000 7f58c7fff700 1 -- 172.21.15.43:0/3963921332 learned_addr learned my addr 172.21.15.43:0/3963921332 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:15.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.808+0000 7f58c77fe700 1 --2- 172.21.15.43:0/3963921332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58c8101b00 0x7f58c810eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:15.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.808+0000 7f58c7fff700 1 -- 172.21.15.43:0/3963921332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58c8101b00 msgr2=0x7f58c810eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:15.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.808+0000 7f58c7fff700 1 --2- 172.21.15.43:0/3963921332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58c8101b00 0x7f58c810eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:15.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.808+0000 7f58c7fff700 1 -- 172.21.15.43:0/3963921332 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b8005040 con 0x7f58c80fbb40 2023-12-08T20:25:15.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.809+0000 7f58c7fff700 1 --2- 172.21.15.43:0/3963921332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58c80fbb40 0x7f58c810e660 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f58b8000c00 tx=0x7f58b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:15.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.809+0000 7f58c4ff9700 1 -- 172.21.15.43:0/3963921332 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58b8021070 con 0x7f58c80fbb40 2023-12-08T20:25:15.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.809+0000 7f58ce807700 1 -- 172.21.15.43:0/3963921332 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c81175d0 con 0x7f58c80fbb40 2023-12-08T20:25:15.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.809+0000 7f58c4ff9700 1 -- 172.21.15.43:0/3963921332 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f58b801c400 con 0x7f58c80fbb40 2023-12-08T20:25:15.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.809+0000 7f58c4ff9700 1 -- 172.21.15.43:0/3963921332 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58b800e070 con 0x7f58c80fbb40 2023-12-08T20:25:15.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.809+0000 7f58ce807700 1 -- 172.21.15.43:0/3963921332 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c8117a80 con 0x7f58c80fbb40 2023-12-08T20:25:15.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.810+0000 7f58ce807700 1 -- 172.21.15.43:0/3963921332 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c8103fb0 con 0x7f58c80fbb40 2023-12-08T20:25:15.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.810+0000 7f58c4ff9700 1 -- 172.21.15.43:0/3963921332 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f58b8013a30 con 0x7f58c80fbb40 2023-12-08T20:25:15.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.811+0000 7f58c4ff9700 1 --2- 172.21.15.43:0/3963921332 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f58b0068f60 0x7f58b006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:15.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.811+0000 7f58c4ff9700 1 -- 172.21.15.43:0/3963921332 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f58b8087b70 con 0x7f58c80fbb40 2023-12-08T20:25:15.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.811+0000 7f58c77fe700 1 --2- 172.21.15.43:0/3963921332 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f58b0068f60 0x7f58b006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:15.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.811+0000 7f58c77fe700 1 --2- 172.21.15.43:0/3963921332 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f58b0068f60 0x7f58b006b410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f58c8065e30 tx=0x7f58bc00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:15.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:15.816+0000 7f58c4ff9700 1 -- 172.21.15.43:0/3963921332 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f58b8054380 con 0x7f58c80fbb40 2023-12-08T20:25:16.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.027+0000 7f58ce807700 1 -- 172.21.15.43:0/3963921332 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f58c804bb80 con 0x7f58c80fbb40 2023-12-08T20:25:16.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.028+0000 7f58c4ff9700 1 -- 172.21.15.43:0/3963921332 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f58b80579a0 con 0x7f58c80fbb40 2023-12-08T20:25:16.029 INFO:teuthology.orchestra.run.smithi043.stdout:146028888075 2023-12-08T20:25:16.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.030+0000 7f58ce807700 1 -- 172.21.15.43:0/3963921332 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f58b0068f60 msgr2=0x7f58b006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:16.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.030+0000 7f58ce807700 1 --2- 172.21.15.43:0/3963921332 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f58b0068f60 0x7f58b006b410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f58c8065e30 tx=0x7f58bc00b040 comp rx=0 tx=0).stop 2023-12-08T20:25:16.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.030+0000 7f58ce807700 1 -- 172.21.15.43:0/3963921332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58c80fbb40 msgr2=0x7f58c810e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:16.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.030+0000 7f58ce807700 1 --2- 172.21.15.43:0/3963921332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58c80fbb40 0x7f58c810e660 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f58b8000c00 tx=0x7f58b8009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:16.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.030+0000 7f58ce807700 1 -- 172.21.15.43:0/3963921332 shutdown_connections 2023-12-08T20:25:16.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.030+0000 7f58ce807700 1 --2- 172.21.15.43:0/3963921332 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f58b0068f60 0x7f58b006b410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:16.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.030+0000 7f58ce807700 1 --2- 172.21.15.43:0/3963921332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58c80fbb40 0x7f58c810e660 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:16.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.030+0000 7f58ce807700 1 --2- 172.21.15.43:0/3963921332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58c8101b00 0x7f58c810eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:16.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.030+0000 7f58ce807700 1 -- 172.21.15.43:0/3963921332 >> 172.21.15.43:0/3963921332 conn(0x7f58c80719b0 msgr2=0x7f58c80faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:16.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.030+0000 7f58ce807700 1 -- 172.21.15.43:0/3963921332 shutdown_connections 2023-12-08T20:25:16.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.030+0000 7f58ce807700 1 -- 172.21.15.43:0/3963921332 wait complete. 2023-12-08T20:25:16.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.459+0000 7fc07c56b700 1 -- 172.21.15.43:0/946531112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc074102c20 msgr2=0x7fc074102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:16.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.459+0000 7fc07c56b700 1 --2- 172.21.15.43:0/946531112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc074102c20 0x7fc074102ff0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc070004940 tx=0x7fc070009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:16.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.459+0000 7fc07c56b700 1 -- 172.21.15.43:0/946531112 shutdown_connections 2023-12-08T20:25:16.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.459+0000 7fc07c56b700 1 --2- 172.21.15.43:0/946531112 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc074065390 0x7fc074065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:16.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.459+0000 7fc07c56b700 1 --2- 172.21.15.43:0/946531112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc074102c20 0x7fc074102ff0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:16.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.459+0000 7fc07c56b700 1 -- 172.21.15.43:0/946531112 >> 172.21.15.43:0/946531112 conn(0x7fc0740719b0 msgr2=0x7fc074071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:16.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.459+0000 7fc07c56b700 1 -- 172.21.15.43:0/946531112 shutdown_connections 2023-12-08T20:25:16.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.459+0000 7fc07c56b700 1 -- 172.21.15.43:0/946531112 wait complete. 2023-12-08T20:25:16.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.460+0000 7fc07c56b700 1 Processor -- start 2023-12-08T20:25:16.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.460+0000 7fc07c56b700 1 -- start start 2023-12-08T20:25:16.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.460+0000 7fc07c56b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc074065390 0x7fc074113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:16.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.460+0000 7fc07c56b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc074102c20 0x7fc074113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:16.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.460+0000 7fc07c56b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc074114220 con 0x7fc074065390 2023-12-08T20:25:16.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.460+0000 7fc07c56b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07410d570 con 0x7fc074102c20 2023-12-08T20:25:16.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.460+0000 7fc07a307700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc074065390 0x7fc074113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:16.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.460+0000 7fc07a307700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc074065390 0x7fc074113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43926/0 (socket says 172.21.15.43:43926) 2023-12-08T20:25:16.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.460+0000 7fc07a307700 1 -- 172.21.15.43:0/283771276 learned_addr learned my addr 172.21.15.43:0/283771276 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:16.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.461+0000 7fc079b06700 1 --2- 172.21.15.43:0/283771276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc074102c20 0x7fc074113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:16.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.461+0000 7fc07a307700 1 -- 172.21.15.43:0/283771276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc074102c20 msgr2=0x7fc074113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:16.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.461+0000 7fc07a307700 1 --2- 172.21.15.43:0/283771276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc074102c20 0x7fc074113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:16.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.461+0000 7fc07a307700 1 -- 172.21.15.43:0/283771276 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc070005040 con 0x7fc074065390 2023-12-08T20:25:16.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.461+0000 7fc07a307700 1 --2- 172.21.15.43:0/283771276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc074065390 0x7fc074113690 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc07000b3b0 tx=0x7fc070009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:16.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.461+0000 7fc06affd700 1 -- 172.21.15.43:0/283771276 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc07000e040 con 0x7fc074065390 2023-12-08T20:25:16.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.461+0000 7fc07c56b700 1 -- 172.21.15.43:0/283771276 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07410d7f0 con 0x7fc074065390 2023-12-08T20:25:16.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.461+0000 7fc06affd700 1 -- 172.21.15.43:0/283771276 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc07000bc50 con 0x7fc074065390 2023-12-08T20:25:16.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.461+0000 7fc06affd700 1 -- 172.21.15.43:0/283771276 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc070013420 con 0x7fc074065390 2023-12-08T20:25:16.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.461+0000 7fc07c56b700 1 -- 172.21.15.43:0/283771276 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07410dd30 con 0x7fc074065390 2023-12-08T20:25:16.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.462+0000 7fc07c56b700 1 -- 172.21.15.43:0/283771276 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0740fff40 con 0x7fc074065390 2023-12-08T20:25:16.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.463+0000 7fc06affd700 1 -- 172.21.15.43:0/283771276 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc07001c430 con 0x7fc074065390 2023-12-08T20:25:16.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.463+0000 7fc06affd700 1 --2- 172.21.15.43:0/283771276 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fc060068f60 0x7fc06006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:16.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.463+0000 7fc06affd700 1 -- 172.21.15.43:0/283771276 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc070087850 con 0x7fc074065390 2023-12-08T20:25:16.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.463+0000 7fc079b06700 1 --2- 172.21.15.43:0/283771276 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fc060068f60 0x7fc06006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:16.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.464+0000 7fc079b06700 1 --2- 172.21.15.43:0/283771276 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fc060068f60 0x7fc06006b410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc064007fd0 tx=0x7fc064009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:16.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.468+0000 7fc06affd700 1 -- 172.21.15.43:0/283771276 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc070057ba0 con 0x7fc074065390 2023-12-08T20:25:16.509 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705691 got 38654705691 for osd.0 2023-12-08T20:25:16.509 DEBUG:teuthology.parallel:result is None 2023-12-08T20:25:16.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.685+0000 7fc07c56b700 1 -- 172.21.15.43:0/283771276 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc07404bb80 con 0x7fc074065390 2023-12-08T20:25:16.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.686+0000 7fc06affd700 1 -- 172.21.15.43:0/283771276 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc070057730 con 0x7fc074065390 2023-12-08T20:25:16.686 INFO:teuthology.orchestra.run.smithi043.stdout:115964117008 2023-12-08T20:25:16.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.688+0000 7fc07c56b700 1 -- 172.21.15.43:0/283771276 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fc060068f60 msgr2=0x7fc06006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:16.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.688+0000 7fc07c56b700 1 --2- 172.21.15.43:0/283771276 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fc060068f60 0x7fc06006b410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc064007fd0 tx=0x7fc064009040 comp rx=0 tx=0).stop 2023-12-08T20:25:16.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.688+0000 7fc07c56b700 1 -- 172.21.15.43:0/283771276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc074065390 msgr2=0x7fc074113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:16.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.688+0000 7fc07c56b700 1 --2- 172.21.15.43:0/283771276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc074065390 0x7fc074113690 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc07000b3b0 tx=0x7fc070009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:16.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.688+0000 7fc07c56b700 1 -- 172.21.15.43:0/283771276 shutdown_connections 2023-12-08T20:25:16.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.688+0000 7fc07c56b700 1 --2- 172.21.15.43:0/283771276 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fc060068f60 0x7fc06006b410 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:16.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.688+0000 7fc07c56b700 1 --2- 172.21.15.43:0/283771276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc074065390 0x7fc074113690 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:16.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.688+0000 7fc07c56b700 1 --2- 172.21.15.43:0/283771276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc074102c20 0x7fc074113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:16.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.688+0000 7fc07c56b700 1 -- 172.21.15.43:0/283771276 >> 172.21.15.43:0/283771276 conn(0x7fc0740719b0 msgr2=0x7fc0740fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:16.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.688+0000 7fc07c56b700 1 -- 172.21.15.43:0/283771276 shutdown_connections 2023-12-08T20:25:16.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.688+0000 7fc07c56b700 1 -- 172.21.15.43:0/283771276 wait complete. 2023-12-08T20:25:16.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:16 smithi111 ceph-mon[121341]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:16.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:16 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/2924471625' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-08T20:25:16.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:16 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/3182523552' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-08T20:25:16.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:16 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/3963921332' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-08T20:25:16.723 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:16 smithi043 ceph-mon[111966]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:16.723 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:16 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/2924471625' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-08T20:25:16.724 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:16 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3182523552' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-08T20:25:16.724 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:16 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3963921332' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-08T20:25:16.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.804+0000 7ff60ae4e700 1 -- 172.21.15.43:0/3670841691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff604101b00 msgr2=0x7ff604101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:16.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.804+0000 7ff60ae4e700 1 --2- 172.21.15.43:0/3670841691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff604101b00 0x7ff604101ed0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8004940 tx=0x7ff5f8009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:16.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.805+0000 7ff60ae4e700 1 -- 172.21.15.43:0/3670841691 shutdown_connections 2023-12-08T20:25:16.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.805+0000 7ff60ae4e700 1 --2- 172.21.15.43:0/3670841691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff604102410 0x7ff6040fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:16.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.805+0000 7ff60ae4e700 1 --2- 172.21.15.43:0/3670841691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff604101b00 0x7ff604101ed0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:16.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.805+0000 7ff60ae4e700 1 -- 172.21.15.43:0/3670841691 >> 172.21.15.43:0/3670841691 conn(0x7ff6040711a0 msgr2=0x7ff6040715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:16.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.805+0000 7ff60ae4e700 1 -- 172.21.15.43:0/3670841691 shutdown_connections 2023-12-08T20:25:16.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.805+0000 7ff60ae4e700 1 -- 172.21.15.43:0/3670841691 wait complete. 2023-12-08T20:25:16.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.806+0000 7ff60ae4e700 1 Processor -- start 2023-12-08T20:25:16.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.806+0000 7ff60ae4e700 1 -- start start 2023-12-08T20:25:16.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.807+0000 7ff60ae4e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff604101b00 0x7ff6041069a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:16.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.807+0000 7ff60ae4e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff604102410 0x7ff604106ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:16.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.807+0000 7ff60ae4e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff604111460 con 0x7ff604102410 2023-12-08T20:25:16.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.807+0000 7ff60ae4e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6041115d0 con 0x7ff604101b00 2023-12-08T20:25:16.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.807+0000 7ff603fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff604102410 0x7ff604106ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:16.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.807+0000 7ff603fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff604102410 0x7ff604106ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43934/0 (socket says 172.21.15.43:43934) 2023-12-08T20:25:16.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.807+0000 7ff603fff700 1 -- 172.21.15.43:0/689204321 learned_addr learned my addr 172.21.15.43:0/689204321 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:16.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.807+0000 7ff608bea700 1 --2- 172.21.15.43:0/689204321 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff604101b00 0x7ff6041069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:16.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.807+0000 7ff603fff700 1 -- 172.21.15.43:0/689204321 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff604101b00 msgr2=0x7ff6041069a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:16.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.807+0000 7ff603fff700 1 --2- 172.21.15.43:0/689204321 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff604101b00 0x7ff6041069a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:16.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.807+0000 7ff603fff700 1 -- 172.21.15.43:0/689204321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f8005040 con 0x7ff604102410 2023-12-08T20:25:16.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.808+0000 7ff603fff700 1 --2- 172.21.15.43:0/689204321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff604102410 0x7ff604106ee0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000eb40 tx=0x7ff5f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:16.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.808+0000 7ff6017fa700 1 -- 172.21.15.43:0/689204321 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5f0007cc0 con 0x7ff604102410 2023-12-08T20:25:16.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.808+0000 7ff6017fa700 1 -- 172.21.15.43:0/689204321 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff5f000f040 con 0x7ff604102410 2023-12-08T20:25:16.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.808+0000 7ff60ae4e700 1 -- 172.21.15.43:0/689204321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6041074e0 con 0x7ff604102410 2023-12-08T20:25:16.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.808+0000 7ff6017fa700 1 -- 172.21.15.43:0/689204321 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5f000c8f0 con 0x7ff604102410 2023-12-08T20:25:16.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.808+0000 7ff60ae4e700 1 -- 172.21.15.43:0/689204321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60411e1a0 con 0x7ff604102410 2023-12-08T20:25:16.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.809+0000 7ff60ae4e700 1 -- 172.21.15.43:0/689204321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6040fee60 con 0x7ff604102410 2023-12-08T20:25:16.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.815+0000 7ff6017fa700 1 -- 172.21.15.43:0/689204321 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff5f00090d0 con 0x7ff604102410 2023-12-08T20:25:16.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.815+0000 7ff6017fa700 1 --2- 172.21.15.43:0/689204321 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff5f4069100 0x7ff5f406b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:16.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.816+0000 7ff6017fa700 1 -- 172.21.15.43:0/689204321 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff5f0086680 con 0x7ff604102410 2023-12-08T20:25:16.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.816+0000 7ff608bea700 1 --2- 172.21.15.43:0/689204321 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff5f4069100 0x7ff5f406b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:16.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.816+0000 7ff6017fa700 1 -- 172.21.15.43:0/689204321 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff5f0052f20 con 0x7ff604102410 2023-12-08T20:25:16.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:16.816+0000 7ff608bea700 1 --2- 172.21.15.43:0/689204321 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff5f4069100 0x7ff5f406b5b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8000c00 tx=0x7ff5f8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:16.828 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888074 got 146028888075 for osd.4 2023-12-08T20:25:16.828 DEBUG:teuthology.parallel:result is None 2023-12-08T20:25:17.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:17.020+0000 7ff60ae4e700 1 -- 172.21.15.43:0/689204321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff604072cc0 con 0x7ff604102410 2023-12-08T20:25:17.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:17.020+0000 7ff6017fa700 1 -- 172.21.15.43:0/689204321 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff5f0056540 con 0x7ff604102410 2023-12-08T20:25:17.021 INFO:teuthology.orchestra.run.smithi043.stdout:60129542167 2023-12-08T20:25:17.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:17.022+0000 7ff60ae4e700 1 -- 172.21.15.43:0/689204321 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff5f4069100 msgr2=0x7ff5f406b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:17.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:17.022+0000 7ff60ae4e700 1 --2- 172.21.15.43:0/689204321 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff5f4069100 0x7ff5f406b5b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8000c00 tx=0x7ff5f8009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:17.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:17.022+0000 7ff60ae4e700 1 -- 172.21.15.43:0/689204321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff604102410 msgr2=0x7ff604106ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:17.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:17.022+0000 7ff60ae4e700 1 --2- 172.21.15.43:0/689204321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff604102410 0x7ff604106ee0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000eb40 tx=0x7ff5f000b040 comp rx=0 tx=0).stop 2023-12-08T20:25:17.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:17.023+0000 7ff60ae4e700 1 -- 172.21.15.43:0/689204321 shutdown_connections 2023-12-08T20:25:17.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:17.023+0000 7ff60ae4e700 1 --2- 172.21.15.43:0/689204321 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff5f4069100 0x7ff5f406b5b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:17.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:17.023+0000 7ff60ae4e700 1 --2- 172.21.15.43:0/689204321 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff604101b00 0x7ff6041069a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:17.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:17.023+0000 7ff60ae4e700 1 --2- 172.21.15.43:0/689204321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff604102410 0x7ff604106ee0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:17.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:17.023+0000 7ff60ae4e700 1 -- 172.21.15.43:0/689204321 >> 172.21.15.43:0/689204321 conn(0x7ff6040711a0 msgr2=0x7ff6040fa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:17.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:17.023+0000 7ff60ae4e700 1 -- 172.21.15.43:0/689204321 shutdown_connections 2023-12-08T20:25:17.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:17.023+0000 7ff60ae4e700 1 -- 172.21.15.43:0/689204321 wait complete. 2023-12-08T20:25:17.043 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:17.603 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542166 got 60129542167 for osd.1 2023-12-08T20:25:17.603 DEBUG:teuthology.parallel:result is None 2023-12-08T20:25:17.620 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724551 got 167503724552 for osd.5 2023-12-08T20:25:17.620 DEBUG:teuthology.parallel:result is None 2023-12-08T20:25:17.647 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:17 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/283771276' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-08T20:25:17.647 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:17 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/689204321' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-08T20:25:17.648 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117006 got 115964117008 for osd.3 2023-12-08T20:25:17.648 DEBUG:teuthology.parallel:result is None 2023-12-08T20:25:17.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:17 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/283771276' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-08T20:25:17.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:17 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/689204321' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-08T20:25:18.590 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:18 smithi043 ceph-mon[111966]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:18.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:18 smithi111 ceph-mon[121341]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:18.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.743+0000 7f5149204700 1 -- 172.21.15.43:0/2964626662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5144101b00 msgr2=0x7f5144101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:18.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.743+0000 7f5149204700 1 --2- 172.21.15.43:0/2964626662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5144101b00 0x7f5144101ed0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5134004940 tx=0x7f5134009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:18.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.743+0000 7f5149204700 1 -- 172.21.15.43:0/2964626662 shutdown_connections 2023-12-08T20:25:18.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.743+0000 7f5149204700 1 --2- 172.21.15.43:0/2964626662 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51440fbb40 0x7f51440fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:18.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.743+0000 7f5149204700 1 --2- 172.21.15.43:0/2964626662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5144101b00 0x7f5144101ed0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:18.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.743+0000 7f5149204700 1 -- 172.21.15.43:0/2964626662 >> 172.21.15.43:0/2964626662 conn(0x7f51440719b0 msgr2=0x7f5144071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:18.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.743+0000 7f5149204700 1 -- 172.21.15.43:0/2964626662 shutdown_connections 2023-12-08T20:25:18.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.744+0000 7f5149204700 1 -- 172.21.15.43:0/2964626662 wait complete. 2023-12-08T20:25:18.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.744+0000 7f5149204700 1 Processor -- start 2023-12-08T20:25:18.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.744+0000 7f5149204700 1 -- start start 2023-12-08T20:25:18.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.745+0000 7f5149204700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51440fbb40 0x7f514410e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:18.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.745+0000 7f5149204700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5144101b00 0x7f514410eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:18.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.745+0000 7f5149204700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514410f130 con 0x7f5144101b00 2023-12-08T20:25:18.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.745+0000 7f5149204700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514410f2a0 con 0x7f51440fbb40 2023-12-08T20:25:18.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.745+0000 7f514259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5144101b00 0x7f514410eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:18.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.745+0000 7f514259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5144101b00 0x7f514410eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43944/0 (socket says 172.21.15.43:43944) 2023-12-08T20:25:18.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.745+0000 7f514259c700 1 -- 172.21.15.43:0/3949777808 learned_addr learned my addr 172.21.15.43:0/3949777808 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:18.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.745+0000 7f5142d9d700 1 --2- 172.21.15.43:0/3949777808 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51440fbb40 0x7f514410e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:18.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.745+0000 7f514259c700 1 -- 172.21.15.43:0/3949777808 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51440fbb40 msgr2=0x7f514410e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:18.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.745+0000 7f514259c700 1 --2- 172.21.15.43:0/3949777808 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51440fbb40 0x7f514410e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:18.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.745+0000 7f514259c700 1 -- 172.21.15.43:0/3949777808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5134005040 con 0x7f5144101b00 2023-12-08T20:25:18.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.745+0000 7f5142d9d700 1 --2- 172.21.15.43:0/3949777808 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51440fbb40 0x7f514410e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:25:18.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.745+0000 7f514259c700 1 --2- 172.21.15.43:0/3949777808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5144101b00 0x7f514410eb80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f513800eb40 tx=0x7f513800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:18.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.745+0000 7f512b7fe700 1 -- 172.21.15.43:0/3949777808 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5138007cc0 con 0x7f5144101b00 2023-12-08T20:25:18.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.745+0000 7f512b7fe700 1 -- 172.21.15.43:0/3949777808 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f513800f040 con 0x7f5144101b00 2023-12-08T20:25:18.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.745+0000 7f5149204700 1 -- 172.21.15.43:0/3949777808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51441175b0 con 0x7f5144101b00 2023-12-08T20:25:18.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.745+0000 7f512b7fe700 1 -- 172.21.15.43:0/3949777808 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5138009570 con 0x7f5144101b00 2023-12-08T20:25:18.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.746+0000 7f5149204700 1 -- 172.21.15.43:0/3949777808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5144117ac0 con 0x7f5144101b00 2023-12-08T20:25:18.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.747+0000 7f5149204700 1 -- 172.21.15.43:0/3949777808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5144103fb0 con 0x7f5144101b00 2023-12-08T20:25:18.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.747+0000 7f512b7fe700 1 -- 172.21.15.43:0/3949777808 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f51380096d0 con 0x7f5144101b00 2023-12-08T20:25:18.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.748+0000 7f512b7fe700 1 --2- 172.21.15.43:0/3949777808 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f512c068f60 0x7f512c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:18.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.748+0000 7f512b7fe700 1 -- 172.21.15.43:0/3949777808 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5138086630 con 0x7f5144101b00 2023-12-08T20:25:18.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.748+0000 7f5142d9d700 1 --2- 172.21.15.43:0/3949777808 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f512c068f60 0x7f512c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:18.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.748+0000 7f5142d9d700 1 --2- 172.21.15.43:0/3949777808 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f512c068f60 0x7f512c06b410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f513400b0d0 tx=0x7f5134009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:18.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.752+0000 7f512b7fe700 1 -- 172.21.15.43:0/3949777808 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f513804da00 con 0x7f5144101b00 2023-12-08T20:25:18.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.953+0000 7f5149204700 1 -- 172.21.15.43:0/3949777808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f51440734d0 con 0x7f5144101b00 2023-12-08T20:25:18.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.954+0000 7f512b7fe700 1 -- 172.21.15.43:0/3949777808 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5138052ef0 con 0x7f5144101b00 2023-12-08T20:25:18.955 INFO:teuthology.orchestra.run.smithi043.stdout:81604378644 2023-12-08T20:25:18.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.956+0000 7f5149204700 1 -- 172.21.15.43:0/3949777808 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f512c068f60 msgr2=0x7f512c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:18.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.956+0000 7f5149204700 1 --2- 172.21.15.43:0/3949777808 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f512c068f60 0x7f512c06b410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f513400b0d0 tx=0x7f5134009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:18.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.956+0000 7f5149204700 1 -- 172.21.15.43:0/3949777808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5144101b00 msgr2=0x7f514410eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:18.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.956+0000 7f5149204700 1 --2- 172.21.15.43:0/3949777808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5144101b00 0x7f514410eb80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f513800eb40 tx=0x7f513800b040 comp rx=0 tx=0).stop 2023-12-08T20:25:18.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.956+0000 7f5149204700 1 -- 172.21.15.43:0/3949777808 shutdown_connections 2023-12-08T20:25:18.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.956+0000 7f5149204700 1 --2- 172.21.15.43:0/3949777808 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f512c068f60 0x7f512c06b410 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:18.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.956+0000 7f5149204700 1 --2- 172.21.15.43:0/3949777808 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51440fbb40 0x7f514410e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:18.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.956+0000 7f5149204700 1 --2- 172.21.15.43:0/3949777808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5144101b00 0x7f514410eb80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:18.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.956+0000 7f5149204700 1 -- 172.21.15.43:0/3949777808 >> 172.21.15.43:0/3949777808 conn(0x7f51440719b0 msgr2=0x7f51440faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:18.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.956+0000 7f5149204700 1 -- 172.21.15.43:0/3949777808 shutdown_connections 2023-12-08T20:25:18.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:18.956+0000 7f5149204700 1 -- 172.21.15.43:0/3949777808 wait complete. 2023-12-08T20:25:19.335 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378643 got 81604378644 for osd.2 2023-12-08T20:25:19.335 DEBUG:teuthology.parallel:result is None 2023-12-08T20:25:19.335 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-12-08T20:25:19.336 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph pg dump --format=json 2023-12-08T20:25:19.641 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:19.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:19 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/3949777808' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-08T20:25:19.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:19 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3949777808' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-08T20:25:20.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:20 smithi111 ceph-mon[121341]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:20.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:20 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:25:20.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.742+0000 7f9aade9e700 1 -- 172.21.15.43:0/643860124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aa8065390 msgr2=0x7f9aa8065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:20.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.742+0000 7f9aade9e700 1 --2- 172.21.15.43:0/643860124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aa8065390 0x7f9aa8065800 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c004940 tx=0x7f9a9c009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:20.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.742+0000 7f9aade9e700 1 -- 172.21.15.43:0/643860124 shutdown_connections 2023-12-08T20:25:20.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.742+0000 7f9aade9e700 1 --2- 172.21.15.43:0/643860124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aa8065390 0x7f9aa8065800 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:20.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.742+0000 7f9aade9e700 1 --2- 172.21.15.43:0/643860124 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9aa8102c20 0x7f9aa8102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:20.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.742+0000 7f9aade9e700 1 -- 172.21.15.43:0/643860124 >> 172.21.15.43:0/643860124 conn(0x7f9aa80719b0 msgr2=0x7f9aa8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:20.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.743+0000 7f9aade9e700 1 -- 172.21.15.43:0/643860124 shutdown_connections 2023-12-08T20:25:20.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.743+0000 7f9aade9e700 1 -- 172.21.15.43:0/643860124 wait complete. 2023-12-08T20:25:20.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.743+0000 7f9aade9e700 1 Processor -- start 2023-12-08T20:25:20.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.743+0000 7f9aade9e700 1 -- start start 2023-12-08T20:25:20.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.744+0000 7f9aade9e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aa8065390 0x7f9aa81135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:20.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.744+0000 7f9aade9e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9aa8102c20 0x7f9aa8113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:20.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.744+0000 7f9aade9e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa8114170 con 0x7f9aa8065390 2023-12-08T20:25:20.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.744+0000 7f9aade9e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa810d4a0 con 0x7f9aa8102c20 2023-12-08T20:25:20.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.744+0000 7f9aa77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aa8065390 0x7f9aa81135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:20.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.744+0000 7f9aa77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aa8065390 0x7f9aa81135e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47352/0 (socket says 172.21.15.43:47352) 2023-12-08T20:25:20.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.744+0000 7f9aa77fe700 1 -- 172.21.15.43:0/1477358647 learned_addr learned my addr 172.21.15.43:0/1477358647 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:20.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.744+0000 7f9aa6ffd700 1 --2- 172.21.15.43:0/1477358647 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9aa8102c20 0x7f9aa8113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:20.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.744+0000 7f9aa77fe700 1 -- 172.21.15.43:0/1477358647 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9aa8102c20 msgr2=0x7f9aa8113b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:20.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.744+0000 7f9aa77fe700 1 --2- 172.21.15.43:0/1477358647 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9aa8102c20 0x7f9aa8113b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:20.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.744+0000 7f9aa77fe700 1 -- 172.21.15.43:0/1477358647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c005040 con 0x7f9aa8065390 2023-12-08T20:25:20.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.744+0000 7f9aa77fe700 1 --2- 172.21.15.43:0/1477358647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aa8065390 0x7f9aa81135e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800eb40 tx=0x7f9a9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:20.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.744+0000 7f9a8ffff700 1 -- 172.21.15.43:0/1477358647 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a98007cc0 con 0x7f9aa8065390 2023-12-08T20:25:20.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.744+0000 7f9a8ffff700 1 -- 172.21.15.43:0/1477358647 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9a9800f040 con 0x7f9aa8065390 2023-12-08T20:25:20.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.744+0000 7f9aade9e700 1 -- 172.21.15.43:0/1477358647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa810d720 con 0x7f9aa8065390 2023-12-08T20:25:20.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.744+0000 7f9a8ffff700 1 -- 172.21.15.43:0/1477358647 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a98009570 con 0x7f9aa8065390 2023-12-08T20:25:20.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.745+0000 7f9aade9e700 1 -- 172.21.15.43:0/1477358647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa810dc60 con 0x7f9aa8065390 2023-12-08T20:25:20.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.746+0000 7f9aade9e700 1 -- 172.21.15.43:0/1477358647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa80fff40 con 0x7f9aa8065390 2023-12-08T20:25:20.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.746+0000 7f9a8ffff700 1 -- 172.21.15.43:0/1477358647 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9a980096d0 con 0x7f9aa8065390 2023-12-08T20:25:20.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.747+0000 7f9a8ffff700 1 --2- 172.21.15.43:0/1477358647 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f9a90068f60 0x7f9a9006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:20.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.747+0000 7f9a8ffff700 1 -- 172.21.15.43:0/1477358647 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9a98086790 con 0x7f9aa8065390 2023-12-08T20:25:20.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.747+0000 7f9aa6ffd700 1 --2- 172.21.15.43:0/1477358647 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f9a90068f60 0x7f9a9006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:20.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.747+0000 7f9aa6ffd700 1 --2- 172.21.15.43:0/1477358647 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f9a90068f60 0x7f9a9006b410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9aa810ee80 tx=0x7f9a9c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:20.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.751+0000 7f9a8ffff700 1 -- 172.21.15.43:0/1477358647 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9a9804da00 con 0x7f9aa8065390 2023-12-08T20:25:20.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:20 smithi043 ceph-mon[111966]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:20.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:20 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:25:20.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.945+0000 7f9aade9e700 1 -- 172.21.15.43:0/1477358647 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9aa804bbf0 con 0x7f9a90068f60 2023-12-08T20:25:20.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.946+0000 7f9a8ffff700 1 -- 172.21.15.43:0/1477358647 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24527 (secure 0 0 0) 0x7f9aa804bbf0 con 0x7f9a90068f60 2023-12-08T20:25:20.947 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:25:20.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.948+0000 7f9aade9e700 1 -- 172.21.15.43:0/1477358647 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f9a90068f60 msgr2=0x7f9a9006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:20.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.948+0000 7f9aade9e700 1 --2- 172.21.15.43:0/1477358647 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f9a90068f60 0x7f9a9006b410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9aa810ee80 tx=0x7f9a9c009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:20.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.949+0000 7f9aade9e700 1 -- 172.21.15.43:0/1477358647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aa8065390 msgr2=0x7f9aa81135e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:20.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.949+0000 7f9aade9e700 1 --2- 172.21.15.43:0/1477358647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aa8065390 0x7f9aa81135e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800eb40 tx=0x7f9a9800b040 comp rx=0 tx=0).stop 2023-12-08T20:25:20.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.949+0000 7f9aade9e700 1 -- 172.21.15.43:0/1477358647 shutdown_connections 2023-12-08T20:25:20.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.949+0000 7f9aade9e700 1 --2- 172.21.15.43:0/1477358647 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f9a90068f60 0x7f9a9006b410 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:20.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.949+0000 7f9aade9e700 1 --2- 172.21.15.43:0/1477358647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aa8065390 0x7f9aa81135e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:20.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.949+0000 7f9aade9e700 1 --2- 172.21.15.43:0/1477358647 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9aa8102c20 0x7f9aa8113b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:20.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.949+0000 7f9aade9e700 1 -- 172.21.15.43:0/1477358647 >> 172.21.15.43:0/1477358647 conn(0x7f9aa80719b0 msgr2=0x7f9aa80fab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:20.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.949+0000 7f9aade9e700 1 -- 172.21.15.43:0/1477358647 shutdown_connections 2023-12-08T20:25:20.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:20.949+0000 7f9aade9e700 1 -- 172.21.15.43:0/1477358647 wait complete. 2023-12-08T20:25:20.950 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-12-08T20:25:21.351 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2023-12-08T20:25:19.452203+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787604,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683308,"statfs":{"total":575970213888,"available":574139707392,"internally_reserved":0,"allocated":3969024,"data_stored":2601828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002303"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":188,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-08T20:24:50.394813+0000","last_change":"2023-12-08T20:24:30.858119+0000","last_active":"2023-12-08T20:24:50.394813+0000","last_peered":"2023-12-08T20:24:50.394813+0000","last_clean":"2023-12-08T20:24:50.394813+0000","last_became_active":"2023-12-08T20:24:30.857869+0000","last_became_peered":"2023-12-08T20:24:30.857869+0000","last_unstale":"2023-12-08T20:24:50.394813+0000","last_undegraded":"2023-12-08T20:24:50.394813+0000","last_fullsized":"2023-12-08T20:24:50.394813+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:23:58.423206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:23:58.423206+0000","last_clean_scrub_stamp":"2023-12-08T20:23:58.423206+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:48:01.233055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888076,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117009,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":728822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:25:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.46800000000000003}]},{"osd":1,"last update":"Fri Dec 8 20:25:14 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.51800000000000002}]},{"osd":2,"last update":"Fri Dec 8 20:25:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.58299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]}]},{"osd":2,"up_from":19,"seq":81604378644,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Dec 8 20:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.40799999999999997}]},{"osd":3,"last update":"Fri Dec 8 20:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":728822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 20:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.27400000000000002}]},{"osd":2,"last update":"Fri Dec 8 20:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.309}]},{"osd":3,"last update":"Fri Dec 8 20:25:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":728822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"last":0.34499999999999997}]},{"osd":2,"last update":"Fri Dec 8 20:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.39100000000000001}]},{"osd":3,"last update":"Fri Dec 8 20:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T20:25:21.352 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph pg dump --format=json 2023-12-08T20:25:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:21.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:21 smithi111 ceph-mon[121341]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-08T20:25:21.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:21 smithi043 ceph-mon[111966]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-08T20:25:22.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:22 smithi043 ceph-mon[111966]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:22.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:22 smithi111 ceph-mon[121341]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:22.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.847+0000 7f92f63fe700 1 -- 172.21.15.43:0/3569929438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92f0102c20 msgr2=0x7f92f0102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:22.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.847+0000 7f92f63fe700 1 --2- 172.21.15.43:0/3569929438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92f0102c20 0x7f92f0102ff0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f92e0004940 tx=0x7f92e0009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:22.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.847+0000 7f92f63fe700 1 -- 172.21.15.43:0/3569929438 shutdown_connections 2023-12-08T20:25:22.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.847+0000 7f92f63fe700 1 --2- 172.21.15.43:0/3569929438 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92f0065390 0x7f92f0065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:22.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.847+0000 7f92f63fe700 1 --2- 172.21.15.43:0/3569929438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92f0102c20 0x7f92f0102ff0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:22.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.847+0000 7f92f63fe700 1 -- 172.21.15.43:0/3569929438 >> 172.21.15.43:0/3569929438 conn(0x7f92f00719b0 msgr2=0x7f92f0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:22.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.847+0000 7f92f63fe700 1 -- 172.21.15.43:0/3569929438 shutdown_connections 2023-12-08T20:25:22.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.847+0000 7f92f63fe700 1 -- 172.21.15.43:0/3569929438 wait complete. 2023-12-08T20:25:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.848+0000 7f92f63fe700 1 Processor -- start 2023-12-08T20:25:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.848+0000 7f92f63fe700 1 -- start start 2023-12-08T20:25:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.848+0000 7f92f63fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92f0065390 0x7f92f0113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.848+0000 7f92f63fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92f0102c20 0x7f92f0113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.848+0000 7f92f63fe700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f0114220 con 0x7f92f0102c20 2023-12-08T20:25:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.848+0000 7f92f63fe700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f010d570 con 0x7f92f0065390 2023-12-08T20:25:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.848+0000 7f92e7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92f0102c20 0x7f92f0113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.848+0000 7f92e7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92f0102c20 0x7f92f0113bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47368/0 (socket says 172.21.15.43:47368) 2023-12-08T20:25:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.848+0000 7f92e7fff700 1 -- 172.21.15.43:0/4180523449 learned_addr learned my addr 172.21.15.43:0/4180523449 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:22.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.848+0000 7f92effff700 1 --2- 172.21.15.43:0/4180523449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92f0065390 0x7f92f0113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:22.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.849+0000 7f92e7fff700 1 -- 172.21.15.43:0/4180523449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92f0065390 msgr2=0x7f92f0113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:22.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.849+0000 7f92e7fff700 1 --2- 172.21.15.43:0/4180523449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92f0065390 0x7f92f0113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:22.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.849+0000 7f92e7fff700 1 -- 172.21.15.43:0/4180523449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e0005040 con 0x7f92f0102c20 2023-12-08T20:25:22.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.849+0000 7f92e7fff700 1 --2- 172.21.15.43:0/4180523449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92f0102c20 0x7f92f0113bd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f92d8002a50 tx=0x7f92d80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:22.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.849+0000 7f92ed7fa700 1 -- 172.21.15.43:0/4180523449 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92d8007cc0 con 0x7f92f0102c20 2023-12-08T20:25:22.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.849+0000 7f92ed7fa700 1 -- 172.21.15.43:0/4180523449 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f92d800f040 con 0x7f92f0102c20 2023-12-08T20:25:22.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.849+0000 7f92f63fe700 1 -- 172.21.15.43:0/4180523449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f010d850 con 0x7f92f0102c20 2023-12-08T20:25:22.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.849+0000 7f92ed7fa700 1 -- 172.21.15.43:0/4180523449 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92d800d9c0 con 0x7f92f0102c20 2023-12-08T20:25:22.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.849+0000 7f92f63fe700 1 -- 172.21.15.43:0/4180523449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f010dd90 con 0x7f92f0102c20 2023-12-08T20:25:22.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.850+0000 7f92f63fe700 1 -- 172.21.15.43:0/4180523449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f00fff40 con 0x7f92f0102c20 2023-12-08T20:25:22.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.851+0000 7f92ed7fa700 1 -- 172.21.15.43:0/4180523449 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f92d800db20 con 0x7f92f0102c20 2023-12-08T20:25:22.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.851+0000 7f92ed7fa700 1 --2- 172.21.15.43:0/4180523449 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f92dc068f60 0x7f92dc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:22.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.851+0000 7f92ed7fa700 1 -- 172.21.15.43:0/4180523449 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f92d8086790 con 0x7f92f0102c20 2023-12-08T20:25:22.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.851+0000 7f92effff700 1 --2- 172.21.15.43:0/4180523449 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f92dc068f60 0x7f92dc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:22.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.852+0000 7f92effff700 1 --2- 172.21.15.43:0/4180523449 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f92dc068f60 0x7f92dc06b410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f92e0004f90 tx=0x7f92e0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:22.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:22.856+0000 7f92ed7fa700 1 -- 172.21.15.43:0/4180523449 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f92d80569b0 con 0x7f92f0102c20 2023-12-08T20:25:23.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:23.050+0000 7f92f63fe700 1 -- 172.21.15.43:0/4180523449 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f92f004bb80 con 0x7f92dc068f60 2023-12-08T20:25:23.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:23.052+0000 7f92ed7fa700 1 -- 172.21.15.43:0/4180523449 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24511 (secure 0 0 0) 0x7f92f004bb80 con 0x7f92dc068f60 2023-12-08T20:25:23.053 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:25:23.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:23.054+0000 7f92f63fe700 1 -- 172.21.15.43:0/4180523449 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f92dc068f60 msgr2=0x7f92dc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:23.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:23.054+0000 7f92f63fe700 1 --2- 172.21.15.43:0/4180523449 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f92dc068f60 0x7f92dc06b410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f92e0004f90 tx=0x7f92e0009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:23.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:23.054+0000 7f92f63fe700 1 -- 172.21.15.43:0/4180523449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92f0102c20 msgr2=0x7f92f0113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:23.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:23.054+0000 7f92f63fe700 1 --2- 172.21.15.43:0/4180523449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92f0102c20 0x7f92f0113bd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f92d8002a50 tx=0x7f92d80046b0 comp rx=0 tx=0).stop 2023-12-08T20:25:23.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:23.054+0000 7f92f63fe700 1 -- 172.21.15.43:0/4180523449 shutdown_connections 2023-12-08T20:25:23.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:23.054+0000 7f92f63fe700 1 --2- 172.21.15.43:0/4180523449 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f92dc068f60 0x7f92dc06b410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:23.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:23.054+0000 7f92f63fe700 1 --2- 172.21.15.43:0/4180523449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92f0065390 0x7f92f0113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:23.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:23.054+0000 7f92f63fe700 1 --2- 172.21.15.43:0/4180523449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92f0102c20 0x7f92f0113bd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:23.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:23.054+0000 7f92f63fe700 1 -- 172.21.15.43:0/4180523449 >> 172.21.15.43:0/4180523449 conn(0x7f92f00719b0 msgr2=0x7f92f00fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:23.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:23.054+0000 7f92f63fe700 1 -- 172.21.15.43:0/4180523449 shutdown_connections 2023-12-08T20:25:23.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:23.054+0000 7f92f63fe700 1 -- 172.21.15.43:0/4180523449 wait complete. 2023-12-08T20:25:23.056 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-12-08T20:25:23.409 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":119,"stamp":"2023-12-08T20:25:21.452497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787604,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683308,"statfs":{"total":575970213888,"available":574139707392,"internally_reserved":0,"allocated":3969024,"data_stored":2601828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002136"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":188,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-08T20:24:50.394813+0000","last_change":"2023-12-08T20:24:30.858119+0000","last_active":"2023-12-08T20:24:50.394813+0000","last_peered":"2023-12-08T20:24:50.394813+0000","last_clean":"2023-12-08T20:24:50.394813+0000","last_became_active":"2023-12-08T20:24:30.857869+0000","last_became_peered":"2023-12-08T20:24:30.857869+0000","last_unstale":"2023-12-08T20:24:50.394813+0000","last_undegraded":"2023-12-08T20:24:50.394813+0000","last_fullsized":"2023-12-08T20:24:50.394813+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T20:23:58.423206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T20:23:58.423206+0000","last_clean_scrub_stamp":"2023-12-08T20:23:58.423206+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-10T07:48:01.233055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724554,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":4,"up_from":34,"seq":146028888077,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]},{"osd":3,"up_from":27,"seq":115964117009,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":728822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:25:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.46800000000000003}]},{"osd":1,"last update":"Fri Dec 8 20:25:14 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.51800000000000002}]},{"osd":2,"last update":"Fri Dec 8 20:25:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.58299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]}]},{"osd":2,"up_from":19,"seq":81604378644,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Dec 8 20:24:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.40799999999999997}]},{"osd":3,"last update":"Fri Dec 8 20:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":728822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 20:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.27400000000000002}]},{"osd":2,"last update":"Fri Dec 8 20:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.309}]},{"osd":3,"last update":"Fri Dec 8 20:25:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":728822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 20:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.318},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"last":0.35699999999999998}]},{"osd":2,"last update":"Fri Dec 8 20:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.38100000000000001}]},{"osd":3,"last update":"Fri Dec 8 20:25:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.5},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T20:25:23.410 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-12-08T20:25:23.410 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-08T20:25:23.410 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-12-08T20:25:23.410 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph health --format=json 2023-12-08T20:25:23.709 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:23.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:23 smithi111 ceph-mon[121341]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-08T20:25:23.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:23 smithi043 ceph-mon[111966]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-08T20:25:24.762 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:24 smithi043 ceph-mon[111966]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:24.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.817+0000 7fecb160d700 1 -- 172.21.15.43:0/2311498325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecac0fdc10 msgr2=0x7fecac0fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:24.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.817+0000 7fecb160d700 1 --2- 172.21.15.43:0/2311498325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecac0fdc10 0x7fecac0fdfe0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fec9c004940 tx=0x7fec9c009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:24.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.817+0000 7fecb160d700 1 -- 172.21.15.43:0/2311498325 shutdown_connections 2023-12-08T20:25:24.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.817+0000 7fecb160d700 1 --2- 172.21.15.43:0/2311498325 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fecac0fe5b0 0x7fecac106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:24.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.817+0000 7fecb160d700 1 --2- 172.21.15.43:0/2311498325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecac0fdc10 0x7fecac0fdfe0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:24.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.817+0000 7fecb160d700 1 -- 172.21.15.43:0/2311498325 >> 172.21.15.43:0/2311498325 conn(0x7fecac0f76c0 msgr2=0x7fecac0f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:24.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.817+0000 7fecb160d700 1 -- 172.21.15.43:0/2311498325 shutdown_connections 2023-12-08T20:25:24.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.817+0000 7fecb160d700 1 -- 172.21.15.43:0/2311498325 wait complete. 2023-12-08T20:25:24.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.817+0000 7fecb160d700 1 Processor -- start 2023-12-08T20:25:24.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.818+0000 7fecb160d700 1 -- start start 2023-12-08T20:25:24.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.818+0000 7fecb160d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fecac0fdc10 0x7fecac113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:24.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.818+0000 7fecb160d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecac0fe5b0 0x7fecac113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:24.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.818+0000 7fecb160d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecac114200 con 0x7fecac0fe5b0 2023-12-08T20:25:24.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.818+0000 7fecb160d700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecac10d4f0 con 0x7fecac0fdc10 2023-12-08T20:25:24.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.818+0000 7feca27fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecac0fe5b0 0x7fecac113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:24.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.818+0000 7feca27fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecac0fe5b0 0x7fecac113bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47382/0 (socket says 172.21.15.43:47382) 2023-12-08T20:25:24.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.818+0000 7feca27fc700 1 -- 172.21.15.43:0/699365370 learned_addr learned my addr 172.21.15.43:0/699365370 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:24.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.818+0000 7fecaaffd700 1 --2- 172.21.15.43:0/699365370 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fecac0fdc10 0x7fecac113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:24.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.818+0000 7feca27fc700 1 -- 172.21.15.43:0/699365370 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fecac0fdc10 msgr2=0x7fecac113630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:24.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.818+0000 7feca27fc700 1 --2- 172.21.15.43:0/699365370 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fecac0fdc10 0x7fecac113630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:24.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.818+0000 7feca27fc700 1 -- 172.21.15.43:0/699365370 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c005040 con 0x7fecac0fe5b0 2023-12-08T20:25:24.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.818+0000 7feca27fc700 1 --2- 172.21.15.43:0/699365370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecac0fe5b0 0x7fecac113bb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fec94002a50 tx=0x7fec940046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:24.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.819+0000 7feca3fff700 1 -- 172.21.15.43:0/699365370 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec94007cc0 con 0x7fecac0fe5b0 2023-12-08T20:25:24.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.819+0000 7fecb160d700 1 -- 172.21.15.43:0/699365370 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecac10d780 con 0x7fecac0fe5b0 2023-12-08T20:25:24.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.819+0000 7feca3fff700 1 -- 172.21.15.43:0/699365370 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fec9400f040 con 0x7fecac0fe5b0 2023-12-08T20:25:24.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.819+0000 7feca3fff700 1 -- 172.21.15.43:0/699365370 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec9400d9c0 con 0x7fecac0fe5b0 2023-12-08T20:25:24.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.819+0000 7fecb160d700 1 -- 172.21.15.43:0/699365370 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecac10dcc0 con 0x7fecac0fe5b0 2023-12-08T20:25:24.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.820+0000 7fecb160d700 1 -- 172.21.15.43:0/699365370 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecac104200 con 0x7fecac0fe5b0 2023-12-08T20:25:24.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.820+0000 7feca3fff700 1 -- 172.21.15.43:0/699365370 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fec9400db20 con 0x7fecac0fe5b0 2023-12-08T20:25:24.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.821+0000 7feca3fff700 1 --2- 172.21.15.43:0/699365370 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fec98068f60 0x7fec9806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:24.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.821+0000 7feca3fff700 1 -- 172.21.15.43:0/699365370 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fec940867f0 con 0x7fecac0fe5b0 2023-12-08T20:25:24.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.821+0000 7fecaaffd700 1 --2- 172.21.15.43:0/699365370 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fec98068f60 0x7fec9806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:24.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.821+0000 7fecaaffd700 1 --2- 172.21.15.43:0/699365370 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fec98068f60 0x7fec9806b410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009fd0 tx=0x7fec9c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:24.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:24.825+0000 7feca3fff700 1 -- 172.21.15.43:0/699365370 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fec940569b0 con 0x7fecac0fe5b0 2023-12-08T20:25:24.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:24 smithi111 ceph-mon[121341]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:25.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:25.068+0000 7fecb160d700 1 -- 172.21.15.43:0/699365370 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fecac04bbb0 con 0x7fecac0fe5b0 2023-12-08T20:25:25.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:25.068+0000 7feca3fff700 1 -- 172.21.15.43:0/699365370 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fec94056540 con 0x7fecac0fe5b0 2023-12-08T20:25:25.069 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:25:25.069 INFO:teuthology.orchestra.run.smithi043.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-08T20:25:25.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:25.070+0000 7fecb160d700 1 -- 172.21.15.43:0/699365370 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fec98068f60 msgr2=0x7fec9806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:25.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:25.070+0000 7fecb160d700 1 --2- 172.21.15.43:0/699365370 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fec98068f60 0x7fec9806b410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009fd0 tx=0x7fec9c009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:25.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:25.070+0000 7fecb160d700 1 -- 172.21.15.43:0/699365370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecac0fe5b0 msgr2=0x7fecac113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:25.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:25.070+0000 7fecb160d700 1 --2- 172.21.15.43:0/699365370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecac0fe5b0 0x7fecac113bb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fec94002a50 tx=0x7fec940046b0 comp rx=0 tx=0).stop 2023-12-08T20:25:25.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:25.071+0000 7fecb160d700 1 -- 172.21.15.43:0/699365370 shutdown_connections 2023-12-08T20:25:25.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:25.071+0000 7fecb160d700 1 --2- 172.21.15.43:0/699365370 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fec98068f60 0x7fec9806b410 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:25.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:25.071+0000 7fecb160d700 1 --2- 172.21.15.43:0/699365370 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fecac0fdc10 0x7fecac113630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:25.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:25.071+0000 7fecb160d700 1 --2- 172.21.15.43:0/699365370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecac0fe5b0 0x7fecac113bb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:25.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:25.071+0000 7fecb160d700 1 -- 172.21.15.43:0/699365370 >> 172.21.15.43:0/699365370 conn(0x7fecac0f76c0 msgr2=0x7fecac101380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:25.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:25.071+0000 7fecb160d700 1 -- 172.21.15.43:0/699365370 shutdown_connections 2023-12-08T20:25:25.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:25.071+0000 7fecb160d700 1 -- 172.21.15.43:0/699365370 wait complete. 2023-12-08T20:25:25.472 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-12-08T20:25:25.472 INFO:tasks.cephadm:Setup complete, yielding 2023-12-08T20:25:25.472 INFO:teuthology.run_tasks:Running task print... 2023-12-08T20:25:25.484 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2023-12-08T20:25:25.484 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-08T20:25:25.506 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi043.front.sepia.ceph.com 2023-12-08T20:25:25.507 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2023-12-08T20:25:25.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:25 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/699365370' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-08T20:25:25.805 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:25.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:25 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/699365370' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-08T20:25:26.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:26 smithi043 ceph-mon[111966]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:26.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:26 smithi111 ceph-mon[121341]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:27.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.031+0000 7f23454c4700 1 -- 172.21.15.43:0/2949354218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23400fde00 msgr2=0x7f23400fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:27.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.031+0000 7f23454c4700 1 --2- 172.21.15.43:0/2949354218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23400fde00 0x7f23400fe250 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2334004940 tx=0x7f2334009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:27.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.031+0000 7f23454c4700 1 -- 172.21.15.43:0/2949354218 shutdown_connections 2023-12-08T20:25:27.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.031+0000 7f23454c4700 1 --2- 172.21.15.43:0/2949354218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23400fde00 0x7f23400fe250 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:27.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.031+0000 7f23454c4700 1 --2- 172.21.15.43:0/2949354218 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f23400fcbf0 0x7f23400fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:27.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.031+0000 7f23454c4700 1 -- 172.21.15.43:0/2949354218 >> 172.21.15.43:0/2949354218 conn(0x7f23400f82d0 msgr2=0x7f23400fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:27.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.031+0000 7f23454c4700 1 -- 172.21.15.43:0/2949354218 shutdown_connections 2023-12-08T20:25:27.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.031+0000 7f23454c4700 1 -- 172.21.15.43:0/2949354218 wait complete. 2023-12-08T20:25:27.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.032+0000 7f23454c4700 1 Processor -- start 2023-12-08T20:25:27.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.032+0000 7f23454c4700 1 -- start start 2023-12-08T20:25:27.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.032+0000 7f23454c4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23400fcbf0 0x7f2340071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:27.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.032+0000 7f23454c4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f23400fde00 0x7f234006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:27.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.032+0000 7f23454c4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2340070590 con 0x7f23400fcbf0 2023-12-08T20:25:27.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.032+0000 7f23454c4700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2340070700 con 0x7f23400fde00 2023-12-08T20:25:27.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.032+0000 7f233effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23400fcbf0 0x7f2340071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:27.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.032+0000 7f233effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23400fcbf0 0x7f2340071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47388/0 (socket says 172.21.15.43:47388) 2023-12-08T20:25:27.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.032+0000 7f233effd700 1 -- 172.21.15.43:0/3394518296 learned_addr learned my addr 172.21.15.43:0/3394518296 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:27.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.032+0000 7f233effd700 1 -- 172.21.15.43:0/3394518296 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f23400fde00 msgr2=0x7f234006ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:27.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.032+0000 7f233e7fc700 1 --2- 172.21.15.43:0/3394518296 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f23400fde00 0x7f234006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:27.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.033+0000 7f233effd700 1 --2- 172.21.15.43:0/3394518296 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f23400fde00 0x7f234006ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:27.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.033+0000 7f233effd700 1 -- 172.21.15.43:0/3394518296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2334005040 con 0x7f23400fcbf0 2023-12-08T20:25:27.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.033+0000 7f233effd700 1 --2- 172.21.15.43:0/3394518296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23400fcbf0 0x7f2340071b10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f233000cb10 tx=0x7f233000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:27.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.033+0000 7f23277fe700 1 -- 172.21.15.43:0/3394518296 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f233000a980 con 0x7f23400fcbf0 2023-12-08T20:25:27.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.033+0000 7f23277fe700 1 -- 172.21.15.43:0/3394518296 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2330012420 con 0x7f23400fcbf0 2023-12-08T20:25:27.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.033+0000 7f23454c4700 1 -- 172.21.15.43:0/3394518296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23400709e0 con 0x7f23400fcbf0 2023-12-08T20:25:27.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.033+0000 7f23277fe700 1 -- 172.21.15.43:0/3394518296 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23300115c0 con 0x7f23400fcbf0 2023-12-08T20:25:27.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.033+0000 7f23454c4700 1 -- 172.21.15.43:0/3394518296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23401155c0 con 0x7f23400fcbf0 2023-12-08T20:25:27.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.034+0000 7f23454c4700 1 -- 172.21.15.43:0/3394518296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f234004bb80 con 0x7f23400fcbf0 2023-12-08T20:25:27.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.034+0000 7f23277fe700 1 -- 172.21.15.43:0/3394518296 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f2330003020 con 0x7f23400fcbf0 2023-12-08T20:25:27.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.035+0000 7f23277fe700 1 --2- 172.21.15.43:0/3394518296 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f2328068f60 0x7f232806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:27.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.035+0000 7f23277fe700 1 -- 172.21.15.43:0/3394518296 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2330086e60 con 0x7f23400fcbf0 2023-12-08T20:25:27.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.035+0000 7f233e7fc700 1 --2- 172.21.15.43:0/3394518296 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f2328068f60 0x7f232806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:27.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.035+0000 7f233e7fc700 1 --2- 172.21.15.43:0/3394518296 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f2328068f60 0x7f232806b410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2334004560 tx=0x7f2334009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:27.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.040+0000 7f23277fe700 1 -- 172.21.15.43:0/3394518296 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2330057100 con 0x7f23400fcbf0 2023-12-08T20:25:27.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.241+0000 7f23454c4700 1 -- 172.21.15.43:0/3394518296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f2340105590 con 0x7f23400fcbf0 2023-12-08T20:25:27.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.245+0000 7f23277fe700 1 -- 172.21.15.43:0/3394518296 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f2330056c90 con 0x7f23400fcbf0 2023-12-08T20:25:27.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.247+0000 7f23454c4700 1 -- 172.21.15.43:0/3394518296 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f2328068f60 msgr2=0x7f232806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:27.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.247+0000 7f23454c4700 1 --2- 172.21.15.43:0/3394518296 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f2328068f60 0x7f232806b410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2334004560 tx=0x7f2334009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:27.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.247+0000 7f23454c4700 1 -- 172.21.15.43:0/3394518296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23400fcbf0 msgr2=0x7f2340071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:27.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.247+0000 7f23454c4700 1 --2- 172.21.15.43:0/3394518296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23400fcbf0 0x7f2340071b10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f233000cb10 tx=0x7f233000ced0 comp rx=0 tx=0).stop 2023-12-08T20:25:27.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.248+0000 7f23454c4700 1 -- 172.21.15.43:0/3394518296 shutdown_connections 2023-12-08T20:25:27.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.248+0000 7f23454c4700 1 --2- 172.21.15.43:0/3394518296 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f2328068f60 0x7f232806b410 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:27.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.248+0000 7f23454c4700 1 --2- 172.21.15.43:0/3394518296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23400fcbf0 0x7f2340071b10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:27.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.248+0000 7f23454c4700 1 --2- 172.21.15.43:0/3394518296 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f23400fde00 0x7f234006ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:27.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.248+0000 7f23454c4700 1 -- 172.21.15.43:0/3394518296 >> 172.21.15.43:0/3394518296 conn(0x7f23400f82d0 msgr2=0x7f2340101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:27.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.248+0000 7f23454c4700 1 -- 172.21.15.43:0/3394518296 shutdown_connections 2023-12-08T20:25:27.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:27.248+0000 7f23454c4700 1 -- 172.21.15.43:0/3394518296 wait complete. 2023-12-08T20:25:27.725 INFO:teuthology.run_tasks:Running task print... 2023-12-08T20:25:27.735 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2023-12-08T20:25:27.735 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-08T20:25:27.745 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi043.front.sepia.ceph.com 2023-12-08T20:25:27.746 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- bash -c 'ceph orch status' 2023-12-08T20:25:28.047 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:28.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:28 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3394518296' entity='client.admin' 2023-12-08T20:25:28.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:28 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:25:28.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:28 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:25:28.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:28 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:25:28.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:28 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:28.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:28 smithi043 ceph-mon[111966]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:28.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:28 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/3394518296' entity='client.admin' 2023-12-08T20:25:28.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:28 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:25:28.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:28 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:25:28.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:28 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:25:28.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:28 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:28.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:28 smithi111 ceph-mon[121341]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:29.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.169+0000 7f8ef33ea700 1 -- 172.21.15.43:0/2931127008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eec0fb520 msgr2=0x7f8eec0fb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:29.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.169+0000 7f8ef33ea700 1 --2- 172.21.15.43:0/2931127008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eec0fb520 0x7f8eec0fb930 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8004940 tx=0x7f8ee8009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:29.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.169+0000 7f8ef33ea700 1 -- 172.21.15.43:0/2931127008 shutdown_connections 2023-12-08T20:25:29.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.169+0000 7f8ef33ea700 1 --2- 172.21.15.43:0/2931127008 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8eec0fbe70 0x7f8eec0fc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:29.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.169+0000 7f8ef33ea700 1 --2- 172.21.15.43:0/2931127008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eec0fb520 0x7f8eec0fb930 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:29.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.169+0000 7f8ef33ea700 1 -- 172.21.15.43:0/2931127008 >> 172.21.15.43:0/2931127008 conn(0x7f8eec0f7190 msgr2=0x7f8eec0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:29.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.169+0000 7f8ef33ea700 1 -- 172.21.15.43:0/2931127008 shutdown_connections 2023-12-08T20:25:29.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.169+0000 7f8ef33ea700 1 -- 172.21.15.43:0/2931127008 wait complete. 2023-12-08T20:25:29.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.170+0000 7f8ef33ea700 1 Processor -- start 2023-12-08T20:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.170+0000 7f8ef33ea700 1 -- start start 2023-12-08T20:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.170+0000 7f8ef33ea700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eec0fb520 0x7f8eec10f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.170+0000 7f8ef33ea700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8eec0fbe70 0x7f8eec10fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.170+0000 7f8ef33ea700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec110310 con 0x7f8eec0fb520 2023-12-08T20:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.170+0000 7f8ef33ea700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec110bb0 con 0x7f8eec0fbe70 2023-12-08T20:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.170+0000 7f8ef1186700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eec0fb520 0x7f8eec10f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.170+0000 7f8ef1186700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eec0fb520 0x7f8eec10f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47392/0 (socket says 172.21.15.43:47392) 2023-12-08T20:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.170+0000 7f8ef1186700 1 -- 172.21.15.43:0/3738278983 learned_addr learned my addr 172.21.15.43:0/3738278983 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.170+0000 7f8ef0985700 1 --2- 172.21.15.43:0/3738278983 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8eec0fbe70 0x7f8eec10fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.171+0000 7f8ef1186700 1 -- 172.21.15.43:0/3738278983 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8eec0fbe70 msgr2=0x7f8eec10fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.171+0000 7f8ef1186700 1 --2- 172.21.15.43:0/3738278983 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8eec0fbe70 0x7f8eec10fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.171+0000 7f8ef1186700 1 -- 172.21.15.43:0/3738278983 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee8005040 con 0x7f8eec0fb520 2023-12-08T20:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.171+0000 7f8ef1186700 1 --2- 172.21.15.43:0/3738278983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eec0fb520 0x7f8eec10f7d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8009360 tx=0x7f8ee8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.171+0000 7f8ee1ffb700 1 -- 172.21.15.43:0/3738278983 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ee800e040 con 0x7f8eec0fb520 2023-12-08T20:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.171+0000 7f8ee1ffb700 1 -- 172.21.15.43:0/3738278983 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8ee800bc50 con 0x7f8eec0fb520 2023-12-08T20:25:29.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.171+0000 7f8ef33ea700 1 -- 172.21.15.43:0/3738278983 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eec110e30 con 0x7f8eec0fb520 2023-12-08T20:25:29.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.171+0000 7f8ee1ffb700 1 -- 172.21.15.43:0/3738278983 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ee801c3f0 con 0x7f8eec0fb520 2023-12-08T20:25:29.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.171+0000 7f8ef33ea700 1 -- 172.21.15.43:0/3738278983 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eec111370 con 0x7f8eec0fb520 2023-12-08T20:25:29.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.172+0000 7f8ef33ea700 1 -- 172.21.15.43:0/3738278983 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eec1096e0 con 0x7f8eec0fb520 2023-12-08T20:25:29.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.173+0000 7f8ee1ffb700 1 -- 172.21.15.43:0/3738278983 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8ee8013420 con 0x7f8eec0fb520 2023-12-08T20:25:29.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.173+0000 7f8ee1ffb700 1 --2- 172.21.15.43:0/3738278983 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f8ed8068f60 0x7f8ed806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:29.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.173+0000 7f8ee1ffb700 1 -- 172.21.15.43:0/3738278983 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8ee8087cd0 con 0x7f8eec0fb520 2023-12-08T20:25:29.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.173+0000 7f8ef0985700 1 --2- 172.21.15.43:0/3738278983 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f8ed8068f60 0x7f8ed806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:29.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.174+0000 7f8ef0985700 1 --2- 172.21.15.43:0/3738278983 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f8ed8068f60 0x7f8ed806b410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8edc004f40 tx=0x7f8edc00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:29.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.178+0000 7f8ee1ffb700 1 -- 172.21.15.43:0/3738278983 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8ee8057f70 con 0x7f8eec0fb520 2023-12-08T20:25:29.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.394+0000 7f8ef33ea700 1 -- 172.21.15.43:0/3738278983 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8eec1115e0 con 0x7f8ed8068f60 2023-12-08T20:25:29.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.395+0000 7f8ee1ffb700 1 -- 172.21.15.43:0/3738278983 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f8eec1115e0 con 0x7f8ed8068f60 2023-12-08T20:25:29.396 INFO:teuthology.orchestra.run.smithi043.stdout:Backend: cephadm 2023-12-08T20:25:29.396 INFO:teuthology.orchestra.run.smithi043.stdout:Available: Yes 2023-12-08T20:25:29.396 INFO:teuthology.orchestra.run.smithi043.stdout:Paused: No 2023-12-08T20:25:29.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.397+0000 7f8ef33ea700 1 -- 172.21.15.43:0/3738278983 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f8ed8068f60 msgr2=0x7f8ed806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:29.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.397+0000 7f8ef33ea700 1 --2- 172.21.15.43:0/3738278983 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f8ed8068f60 0x7f8ed806b410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8edc004f40 tx=0x7f8edc00b040 comp rx=0 tx=0).stop 2023-12-08T20:25:29.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.397+0000 7f8ef33ea700 1 -- 172.21.15.43:0/3738278983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eec0fb520 msgr2=0x7f8eec10f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:29.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.397+0000 7f8ef33ea700 1 --2- 172.21.15.43:0/3738278983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eec0fb520 0x7f8eec10f7d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8009360 tx=0x7f8ee8009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:29.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.397+0000 7f8ef33ea700 1 -- 172.21.15.43:0/3738278983 shutdown_connections 2023-12-08T20:25:29.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.397+0000 7f8ef33ea700 1 --2- 172.21.15.43:0/3738278983 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f8ed8068f60 0x7f8ed806b410 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:29.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.397+0000 7f8ef33ea700 1 --2- 172.21.15.43:0/3738278983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eec0fb520 0x7f8eec10f7d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:29.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.397+0000 7f8ef33ea700 1 --2- 172.21.15.43:0/3738278983 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8eec0fbe70 0x7f8eec10fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:29.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.397+0000 7f8ef33ea700 1 -- 172.21.15.43:0/3738278983 >> 172.21.15.43:0/3738278983 conn(0x7f8eec0f7190 msgr2=0x7f8eec1043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:29.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.398+0000 7f8ef33ea700 1 -- 172.21.15.43:0/3738278983 shutdown_connections 2023-12-08T20:25:29.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:29.398+0000 7f8ef33ea700 1 -- 172.21.15.43:0/3738278983 wait complete. 2023-12-08T20:25:29.800 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- bash -c 'ceph orch ps' 2023-12-08T20:25:30.097 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:30.637 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:30 smithi043 ceph-mon[111966]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:25:30.637 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:30 smithi043 ceph-mon[111966]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:30.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:30 smithi111 ceph-mon[121341]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:25:30.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:30 smithi111 ceph-mon[121341]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:31.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.267+0000 7f7858c3e700 1 -- 172.21.15.43:0/972474667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78540fd730 msgr2=0x7f78540ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:31.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.267+0000 7f7858c3e700 1 --2- 172.21.15.43:0/972474667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78540fd730 0x7f78540ffb10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7844004940 tx=0x7f7844009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:31.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.267+0000 7f7858c3e700 1 -- 172.21.15.43:0/972474667 shutdown_connections 2023-12-08T20:25:31.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.267+0000 7f7858c3e700 1 --2- 172.21.15.43:0/972474667 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7854100050 0x7f7854102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:31.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.267+0000 7f7858c3e700 1 --2- 172.21.15.43:0/972474667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78540fd730 0x7f78540ffb10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:31.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.267+0000 7f7858c3e700 1 -- 172.21.15.43:0/972474667 >> 172.21.15.43:0/972474667 conn(0x7f78540f7190 msgr2=0x7f78540f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:31.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.267+0000 7f7858c3e700 1 -- 172.21.15.43:0/972474667 shutdown_connections 2023-12-08T20:25:31.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.267+0000 7f7858c3e700 1 -- 172.21.15.43:0/972474667 wait complete. 2023-12-08T20:25:31.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.268+0000 7f7858c3e700 1 Processor -- start 2023-12-08T20:25:31.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.268+0000 7f7858c3e700 1 -- start start 2023-12-08T20:25:31.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.268+0000 7f7858c3e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78540fd730 0x7f785410f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:31.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.268+0000 7f7858c3e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7854100050 0x7f785410fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:31.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.268+0000 7f7858c3e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7854110250 con 0x7f7854100050 2023-12-08T20:25:31.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.268+0000 7f7858c3e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7854110af0 con 0x7f78540fd730 2023-12-08T20:25:31.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.268+0000 7f7851d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7854100050 0x7f785410fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:31.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.268+0000 7f7851d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7854100050 0x7f785410fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43246/0 (socket says 172.21.15.43:43246) 2023-12-08T20:25:31.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.268+0000 7f7851d9b700 1 -- 172.21.15.43:0/2806795571 learned_addr learned my addr 172.21.15.43:0/2806795571 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:31.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.268+0000 7f785259c700 1 --2- 172.21.15.43:0/2806795571 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78540fd730 0x7f785410f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:31.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.268+0000 7f7851d9b700 1 -- 172.21.15.43:0/2806795571 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78540fd730 msgr2=0x7f785410f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:31.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.268+0000 7f7851d9b700 1 --2- 172.21.15.43:0/2806795571 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78540fd730 0x7f785410f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:31.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.268+0000 7f7851d9b700 1 -- 172.21.15.43:0/2806795571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7844005040 con 0x7f7854100050 2023-12-08T20:25:31.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.269+0000 7f7851d9b700 1 --2- 172.21.15.43:0/2806795571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7854100050 0x7f785410fc50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7848002a50 tx=0x7f78480046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:31.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.269+0000 7f7842ffd700 1 -- 172.21.15.43:0/2806795571 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7848007cc0 con 0x7f7854100050 2023-12-08T20:25:31.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.269+0000 7f7842ffd700 1 -- 172.21.15.43:0/2806795571 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f784800f040 con 0x7f7854100050 2023-12-08T20:25:31.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.269+0000 7f7842ffd700 1 -- 172.21.15.43:0/2806795571 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f784800d9c0 con 0x7f7854100050 2023-12-08T20:25:31.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.269+0000 7f7858c3e700 1 -- 172.21.15.43:0/2806795571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7854110dd0 con 0x7f7854100050 2023-12-08T20:25:31.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.269+0000 7f7858c3e700 1 -- 172.21.15.43:0/2806795571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7854111310 con 0x7f7854100050 2023-12-08T20:25:31.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.270+0000 7f7858c3e700 1 -- 172.21.15.43:0/2806795571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f785404bb80 con 0x7f7854100050 2023-12-08T20:25:31.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.270+0000 7f7842ffd700 1 -- 172.21.15.43:0/2806795571 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f784800db20 con 0x7f7854100050 2023-12-08T20:25:31.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.271+0000 7f7842ffd700 1 --2- 172.21.15.43:0/2806795571 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f783c068f60 0x7f783c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:31.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.271+0000 7f7842ffd700 1 -- 172.21.15.43:0/2806795571 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7848086790 con 0x7f7854100050 2023-12-08T20:25:31.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.271+0000 7f785259c700 1 --2- 172.21.15.43:0/2806795571 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f783c068f60 0x7f783c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:31.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.271+0000 7f785259c700 1 --2- 172.21.15.43:0/2806795571 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f783c068f60 0x7f783c06b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f784400b3b0 tx=0x7f7844009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:31.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.276+0000 7f7842ffd700 1 -- 172.21.15.43:0/2806795571 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f78480569b0 con 0x7f7854100050 2023-12-08T20:25:31.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.485+0000 7f7858c3e700 1 -- 172.21.15.43:0/2806795571 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7854111760 con 0x7f783c068f60 2023-12-08T20:25:31.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.494+0000 7f7842ffd700 1 -- 172.21.15.43:0/2806795571 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2718 (secure 0 0 0) 0x7f7854111760 con 0x7f783c068f60 2023-12-08T20:25:31.495 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-08T20:25:31.495 INFO:teuthology.orchestra.run.smithi043.stdout:alertmanager.smithi043 smithi043 *:9093,9094 running (2m) 98s ago 3m 26.8M - 0.25.0 c8568f914cd2 4a24f8273198 2023-12-08T20:25:31.495 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi043 smithi043 running (3m) 98s ago 3m 7432k - 17.2.7-119-ge2143d99 f761b6e42225 f84d492b732c 2023-12-08T20:25:31.495 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi111 smithi111 running (3m) 46s ago 3m 7428k - 17.2.7-119-ge2143d99 f761b6e42225 88b53685ae54 2023-12-08T20:25:31.496 INFO:teuthology.orchestra.run.smithi043.stdout:grafana.smithi043 smithi043 *:3000 running (2m) 98s ago 3m 85.1M - 9.4.7 954c08fa6188 503ad8a7ae04 2023-12-08T20:25:31.496 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi043.hqcdcm smithi043 *:9283 running (4m) 98s ago 4m 483M - 17.2.7-119-ge2143d99 f761b6e42225 58b656e8e333 2023-12-08T20:25:31.496 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi111.mtcffu smithi111 *:8443,9283 running (2m) 46s ago 2m 438M - 17.2.7-119-ge2143d99 f761b6e42225 fefa1ba8c663 2023-12-08T20:25:31.496 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi043 smithi043 running (4m) 98s ago 4m 59.0M 2048M 17.2.7-119-ge2143d99 f761b6e42225 fe2a56effef3 2023-12-08T20:25:31.496 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi111 smithi111 running (2m) 46s ago 2m 50.4M 2048M 17.2.7-119-ge2143d99 f761b6e42225 2ae21cf3fa1e 2023-12-08T20:25:31.496 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi043 smithi043 *:9100 running (3m) 98s ago 3m 17.3M - 1.5.0 0da6a335fe13 8e51a55a8bc8 2023-12-08T20:25:31.496 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi111 smithi111 *:9100 running (3m) 46s ago 3m 16.2M - 1.5.0 0da6a335fe13 73de1624518e 2023-12-08T20:25:31.496 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (2m) 98s ago 2m 40.3M 4300M 17.2.7-119-ge2143d99 f761b6e42225 462eeaf62b2c 2023-12-08T20:25:31.496 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi043 running (2m) 98s ago 2m 40.0M 4300M 17.2.7-119-ge2143d99 f761b6e42225 dde419c88a89 2023-12-08T20:25:31.496 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi043 running (102s) 98s ago 102s 11.7M 4300M 17.2.7-119-ge2143d99 f761b6e42225 f7e812026ef5 2023-12-08T20:25:31.496 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi111 running (84s) 46s ago 84s 43.5M 5323M 17.2.7-119-ge2143d99 f761b6e42225 2a738d30441c 2023-12-08T20:25:31.496 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi111 running (67s) 46s ago 67s 43.4M 5323M 17.2.7-119-ge2143d99 f761b6e42225 38cdb6a88694 2023-12-08T20:25:31.496 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi111 running (49s) 46s ago 48s 11.0M 5323M 17.2.7-119-ge2143d99 f761b6e42225 59a9ce8c1141 2023-12-08T20:25:31.496 INFO:teuthology.orchestra.run.smithi043.stdout:prometheus.smithi043 smithi043 *:9095 running (2m) 98s ago 3m 34.7M - 2.43.0 a07b618ecd1d 88bcbb698598 2023-12-08T20:25:31.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.496+0000 7f7858c3e700 1 -- 172.21.15.43:0/2806795571 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f783c068f60 msgr2=0x7f783c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:31.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.496+0000 7f7858c3e700 1 --2- 172.21.15.43:0/2806795571 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f783c068f60 0x7f783c06b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f784400b3b0 tx=0x7f7844009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:31.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.496+0000 7f7858c3e700 1 -- 172.21.15.43:0/2806795571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7854100050 msgr2=0x7f785410fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:31.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.496+0000 7f7858c3e700 1 --2- 172.21.15.43:0/2806795571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7854100050 0x7f785410fc50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7848002a50 tx=0x7f78480046b0 comp rx=0 tx=0).stop 2023-12-08T20:25:31.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.496+0000 7f7858c3e700 1 -- 172.21.15.43:0/2806795571 shutdown_connections 2023-12-08T20:25:31.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.496+0000 7f7858c3e700 1 --2- 172.21.15.43:0/2806795571 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f783c068f60 0x7f783c06b410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:31.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.496+0000 7f7858c3e700 1 --2- 172.21.15.43:0/2806795571 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78540fd730 0x7f785410f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.496+0000 7f7858c3e700 1 --2- 172.21.15.43:0/2806795571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7854100050 0x7f785410fc50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.496+0000 7f7858c3e700 1 -- 172.21.15.43:0/2806795571 >> 172.21.15.43:0/2806795571 conn(0x7f78540f7190 msgr2=0x7f78540fb520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.497+0000 7f7858c3e700 1 -- 172.21.15.43:0/2806795571 shutdown_connections 2023-12-08T20:25:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:31.497+0000 7f7858c3e700 1 -- 172.21.15.43:0/2806795571 wait complete. 2023-12-08T20:25:31.933 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- bash -c 'ceph orch ls' 2023-12-08T20:25:32.234 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:32.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:32 smithi043 ceph-mon[111966]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:32.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:32 smithi043 ceph-mon[111966]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:25:32.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:32 smithi111 ceph-mon[121341]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:32.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:32 smithi111 ceph-mon[121341]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:25:33.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.394+0000 7fcbb30df700 1 -- 172.21.15.43:0/2773742096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbac0fd730 msgr2=0x7fcbac0ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:33.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.394+0000 7fcbb30df700 1 --2- 172.21.15.43:0/2773742096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbac0fd730 0x7fcbac0ffb10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c004940 tx=0x7fcb9c009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:33.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.394+0000 7fcbb30df700 1 -- 172.21.15.43:0/2773742096 shutdown_connections 2023-12-08T20:25:33.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.394+0000 7fcbb30df700 1 --2- 172.21.15.43:0/2773742096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbac100050 0x7fcbac102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:33.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.394+0000 7fcbb30df700 1 --2- 172.21.15.43:0/2773742096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbac0fd730 0x7fcbac0ffb10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:33.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.394+0000 7fcbb30df700 1 -- 172.21.15.43:0/2773742096 >> 172.21.15.43:0/2773742096 conn(0x7fcbac0f7190 msgr2=0x7fcbac0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:33.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.394+0000 7fcbb30df700 1 -- 172.21.15.43:0/2773742096 shutdown_connections 2023-12-08T20:25:33.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.394+0000 7fcbb30df700 1 -- 172.21.15.43:0/2773742096 wait complete. 2023-12-08T20:25:33.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.394+0000 7fcbb30df700 1 Processor -- start 2023-12-08T20:25:33.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.394+0000 7fcbb30df700 1 -- start start 2023-12-08T20:25:33.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.395+0000 7fcbb30df700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbac0fd730 0x7fcbac0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:33.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.395+0000 7fcbb30df700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbac100050 0x7fcbac0fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:33.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.395+0000 7fcbb30df700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac0fbc40 con 0x7fcbac0fd730 2023-12-08T20:25:33.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.395+0000 7fcbb30df700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac0fbdb0 con 0x7fcbac100050 2023-12-08T20:25:33.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.395+0000 7fcbb0e7b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbac0fd730 0x7fcbac0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:33.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.395+0000 7fcbb0e7b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbac0fd730 0x7fcbac0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43260/0 (socket says 172.21.15.43:43260) 2023-12-08T20:25:33.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.395+0000 7fcbb0e7b700 1 -- 172.21.15.43:0/3913463057 learned_addr learned my addr 172.21.15.43:0/3913463057 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:33.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.395+0000 7fcbabfff700 1 --2- 172.21.15.43:0/3913463057 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbac100050 0x7fcbac0fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:33.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.395+0000 7fcbb0e7b700 1 -- 172.21.15.43:0/3913463057 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbac100050 msgr2=0x7fcbac0fb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:33.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.395+0000 7fcbb0e7b700 1 --2- 172.21.15.43:0/3913463057 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbac100050 0x7fcbac0fb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:33.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.395+0000 7fcbb0e7b700 1 -- 172.21.15.43:0/3913463057 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c005040 con 0x7fcbac0fd730 2023-12-08T20:25:33.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.395+0000 7fcbb0e7b700 1 --2- 172.21.15.43:0/3913463057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbac0fd730 0x7fcbac0fd1c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009360 tx=0x7fcb9c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:33.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.395+0000 7fcba97fa700 1 -- 172.21.15.43:0/3913463057 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb9c00e040 con 0x7fcbac0fd730 2023-12-08T20:25:33.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.395+0000 7fcba97fa700 1 -- 172.21.15.43:0/3913463057 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcb9c00bc50 con 0x7fcbac0fd730 2023-12-08T20:25:33.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.395+0000 7fcba97fa700 1 -- 172.21.15.43:0/3913463057 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb9c01c3f0 con 0x7fcbac0fd730 2023-12-08T20:25:33.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.396+0000 7fcbb30df700 1 -- 172.21.15.43:0/3913463057 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbac0fc030 con 0x7fcbac0fd730 2023-12-08T20:25:33.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.396+0000 7fcbb30df700 1 -- 172.21.15.43:0/3913463057 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbac115530 con 0x7fcbac0fd730 2023-12-08T20:25:33.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.397+0000 7fcbb30df700 1 -- 172.21.15.43:0/3913463057 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbac04bb80 con 0x7fcbac0fd730 2023-12-08T20:25:33.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.397+0000 7fcba97fa700 1 -- 172.21.15.43:0/3913463057 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fcb9c013420 con 0x7fcbac0fd730 2023-12-08T20:25:33.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.397+0000 7fcba97fa700 1 --2- 172.21.15.43:0/3913463057 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fcb94068f60 0x7fcb9406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:33.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.398+0000 7fcba97fa700 1 -- 172.21.15.43:0/3913463057 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcb9c087cd0 con 0x7fcbac0fd730 2023-12-08T20:25:33.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.398+0000 7fcbabfff700 1 --2- 172.21.15.43:0/3913463057 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fcb94068f60 0x7fcb9406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:33.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.398+0000 7fcbabfff700 1 --2- 172.21.15.43:0/3913463057 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fcb94068f60 0x7fcb9406b410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcba0004f40 tx=0x7fcba000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:33.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.402+0000 7fcba97fa700 1 -- 172.21.15.43:0/3913463057 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcb9c057f70 con 0x7fcbac0fd730 2023-12-08T20:25:33.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.617+0000 7fcbb30df700 1 -- 172.21.15.43:0/3913463057 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbac100cb0 con 0x7fcb94068f60 2023-12-08T20:25:33.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.621+0000 7fcba97fa700 1 -- 172.21.15.43:0/3913463057 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7fcbac100cb0 con 0x7fcb94068f60 2023-12-08T20:25:33.622 INFO:teuthology.orchestra.run.smithi043.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-12-08T20:25:33.622 INFO:teuthology.orchestra.run.smithi043.stdout:alertmanager ?:9093,9094 1/1 100s ago 4m count:1 2023-12-08T20:25:33.622 INFO:teuthology.orchestra.run.smithi043.stdout:crash 2/2 100s ago 4m * 2023-12-08T20:25:33.622 INFO:teuthology.orchestra.run.smithi043.stdout:grafana ?:3000 1/1 100s ago 4m count:1 2023-12-08T20:25:33.623 INFO:teuthology.orchestra.run.smithi043.stdout:mgr 2/2 100s ago 4m count:2 2023-12-08T20:25:33.623 INFO:teuthology.orchestra.run.smithi043.stdout:mon 2/2 100s ago 3m smithi043:172.21.15.43=smithi043;smithi111:172.21.15.111=smithi111;count:2 2023-12-08T20:25:33.623 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter ?:9100 2/2 100s ago 4m * 2023-12-08T20:25:33.623 INFO:teuthology.orchestra.run.smithi043.stdout:osd 6 100s ago - 2023-12-08T20:25:33.623 INFO:teuthology.orchestra.run.smithi043.stdout:prometheus ?:9095 1/1 100s ago 4m count:1 2023-12-08T20:25:33.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.624+0000 7fcbb30df700 1 -- 172.21.15.43:0/3913463057 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fcb94068f60 msgr2=0x7fcb9406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:33.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.624+0000 7fcbb30df700 1 --2- 172.21.15.43:0/3913463057 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fcb94068f60 0x7fcb9406b410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcba0004f40 tx=0x7fcba000b040 comp rx=0 tx=0).stop 2023-12-08T20:25:33.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.624+0000 7fcbb30df700 1 -- 172.21.15.43:0/3913463057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbac0fd730 msgr2=0x7fcbac0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:33.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.624+0000 7fcbb30df700 1 --2- 172.21.15.43:0/3913463057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbac0fd730 0x7fcbac0fd1c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009360 tx=0x7fcb9c009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:33.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.624+0000 7fcbb30df700 1 -- 172.21.15.43:0/3913463057 shutdown_connections 2023-12-08T20:25:33.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.624+0000 7fcbb30df700 1 --2- 172.21.15.43:0/3913463057 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fcb94068f60 0x7fcb9406b410 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:33.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.624+0000 7fcbb30df700 1 --2- 172.21.15.43:0/3913463057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbac0fd730 0x7fcbac0fd1c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:33.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.624+0000 7fcbb30df700 1 --2- 172.21.15.43:0/3913463057 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbac100050 0x7fcbac0fb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:33.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.624+0000 7fcbb30df700 1 -- 172.21.15.43:0/3913463057 >> 172.21.15.43:0/3913463057 conn(0x7fcbac0f7190 msgr2=0x7fcbac0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:33.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.624+0000 7fcbb30df700 1 -- 172.21.15.43:0/3913463057 shutdown_connections 2023-12-08T20:25:33.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:33.624+0000 7fcbb30df700 1 -- 172.21.15.43:0/3913463057 wait complete. 2023-12-08T20:25:34.024 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- bash -c 'ceph orch host ls' 2023-12-08T20:25:34.325 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:34.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:34 smithi043 ceph-mon[111966]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:34.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:34 smithi043 ceph-mon[111966]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:25:34.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:34 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:25:34.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:34 smithi111 ceph-mon[121341]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:34.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:34 smithi111 ceph-mon[121341]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:25:34.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:34 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:25:35.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.552+0000 7f2cfd082700 1 -- 172.21.15.43:0/838912828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cf80fdf60 msgr2=0x7f2cf80fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:35.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.552+0000 7f2cfd082700 1 --2- 172.21.15.43:0/838912828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cf80fdf60 0x7f2cf80fe3b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2cec004940 tx=0x7f2cec009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:35.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.552+0000 7f2cfd082700 1 -- 172.21.15.43:0/838912828 shutdown_connections 2023-12-08T20:25:35.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.552+0000 7f2cfd082700 1 --2- 172.21.15.43:0/838912828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cf80fdf60 0x7f2cf80fe3b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:35.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.552+0000 7f2cfd082700 1 --2- 172.21.15.43:0/838912828 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2cf80faed0 0x7f2cf80fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:35.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.552+0000 7f2cfd082700 1 -- 172.21.15.43:0/838912828 >> 172.21.15.43:0/838912828 conn(0x7f2cf80f6950 msgr2=0x7f2cf80f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:35.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.552+0000 7f2cfd082700 1 -- 172.21.15.43:0/838912828 shutdown_connections 2023-12-08T20:25:35.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.552+0000 7f2cfd082700 1 -- 172.21.15.43:0/838912828 wait complete. 2023-12-08T20:25:35.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.553+0000 7f2cfd082700 1 Processor -- start 2023-12-08T20:25:35.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.553+0000 7f2cfd082700 1 -- start start 2023-12-08T20:25:35.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.553+0000 7f2cfd082700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2cf80faed0 0x7f2cf810d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:35.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.553+0000 7f2cfd082700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cf80fdf60 0x7f2cf810dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:35.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.553+0000 7f2cfd082700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf810e1b0 con 0x7f2cf80fdf60 2023-12-08T20:25:35.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.553+0000 7f2cfd082700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf810ea50 con 0x7f2cf80faed0 2023-12-08T20:25:35.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.553+0000 7f2cf659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cf80fdf60 0x7f2cf810dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:35.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.553+0000 7f2cf659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cf80fdf60 0x7f2cf810dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43280/0 (socket says 172.21.15.43:43280) 2023-12-08T20:25:35.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.553+0000 7f2cf659c700 1 -- 172.21.15.43:0/249133842 learned_addr learned my addr 172.21.15.43:0/249133842 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:35.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.553+0000 7f2cf6d9d700 1 --2- 172.21.15.43:0/249133842 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2cf80faed0 0x7f2cf810d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:35.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.554+0000 7f2cf659c700 1 -- 172.21.15.43:0/249133842 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2cf80faed0 msgr2=0x7f2cf810d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:35.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.554+0000 7f2cf659c700 1 --2- 172.21.15.43:0/249133842 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2cf80faed0 0x7f2cf810d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:35.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.554+0000 7f2cf659c700 1 -- 172.21.15.43:0/249133842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec005040 con 0x7f2cf80fdf60 2023-12-08T20:25:35.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.554+0000 7f2cf659c700 1 --2- 172.21.15.43:0/249133842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cf80fdf60 0x7f2cf810dbb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00b3b0 tx=0x7f2cec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:35.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.554+0000 7f2cdf7fe700 1 -- 172.21.15.43:0/249133842 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cec00e040 con 0x7f2cf80fdf60 2023-12-08T20:25:35.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.554+0000 7f2cdf7fe700 1 -- 172.21.15.43:0/249133842 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2cec00bc50 con 0x7f2cf80fdf60 2023-12-08T20:25:35.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.554+0000 7f2cfd082700 1 -- 172.21.15.43:0/249133842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf810ecd0 con 0x7f2cf80fdf60 2023-12-08T20:25:35.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.554+0000 7f2cdf7fe700 1 -- 172.21.15.43:0/249133842 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cec013660 con 0x7f2cf80fdf60 2023-12-08T20:25:35.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.554+0000 7f2cfd082700 1 -- 172.21.15.43:0/249133842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf810f210 con 0x7f2cf80fdf60 2023-12-08T20:25:35.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.555+0000 7f2cfd082700 1 -- 172.21.15.43:0/249133842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf81075f0 con 0x7f2cf80fdf60 2023-12-08T20:25:35.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.555+0000 7f2cdf7fe700 1 -- 172.21.15.43:0/249133842 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f2cec01c430 con 0x7f2cf80fdf60 2023-12-08T20:25:35.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.556+0000 7f2cdf7fe700 1 --2- 172.21.15.43:0/249133842 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f2ce0068f60 0x7f2ce006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:35.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.556+0000 7f2cdf7fe700 1 -- 172.21.15.43:0/249133842 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2cec087750 con 0x7f2cf80fdf60 2023-12-08T20:25:35.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.556+0000 7f2cf6d9d700 1 --2- 172.21.15.43:0/249133842 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f2ce0068f60 0x7f2ce006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:35.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.556+0000 7f2cf6d9d700 1 --2- 172.21.15.43:0/249133842 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f2ce0068f60 0x7f2ce006b410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80650d0 tx=0x7f2ce800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:35.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.561+0000 7f2cdf7fe700 1 -- 172.21.15.43:0/249133842 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2cec057b40 con 0x7f2cf80fdf60 2023-12-08T20:25:35.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.766+0000 7f2cfd082700 1 -- 172.21.15.43:0/249133842 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2cf810f480 con 0x7f2ce0068f60 2023-12-08T20:25:35.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.767+0000 7f2cdf7fe700 1 -- 172.21.15.43:0/249133842 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f2cf810f480 con 0x7f2ce0068f60 2023-12-08T20:25:35.768 INFO:teuthology.orchestra.run.smithi043.stdout:HOST ADDR LABELS STATUS 2023-12-08T20:25:35.768 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043 172.21.15.43 2023-12-08T20:25:35.769 INFO:teuthology.orchestra.run.smithi043.stdout:smithi111 172.21.15.111 2023-12-08T20:25:35.769 INFO:teuthology.orchestra.run.smithi043.stdout:2 hosts in cluster 2023-12-08T20:25:35.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.770+0000 7f2cfd082700 1 -- 172.21.15.43:0/249133842 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f2ce0068f60 msgr2=0x7f2ce006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:35.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.770+0000 7f2cfd082700 1 --2- 172.21.15.43:0/249133842 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f2ce0068f60 0x7f2ce006b410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80650d0 tx=0x7f2ce800b040 comp rx=0 tx=0).stop 2023-12-08T20:25:35.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.770+0000 7f2cfd082700 1 -- 172.21.15.43:0/249133842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cf80fdf60 msgr2=0x7f2cf810dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:35.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.770+0000 7f2cfd082700 1 --2- 172.21.15.43:0/249133842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cf80fdf60 0x7f2cf810dbb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00b3b0 tx=0x7f2cec009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:35.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.770+0000 7f2cfd082700 1 -- 172.21.15.43:0/249133842 shutdown_connections 2023-12-08T20:25:35.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.770+0000 7f2cfd082700 1 --2- 172.21.15.43:0/249133842 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f2ce0068f60 0x7f2ce006b410 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:35.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.770+0000 7f2cfd082700 1 --2- 172.21.15.43:0/249133842 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2cf80faed0 0x7f2cf810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:35.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.770+0000 7f2cfd082700 1 --2- 172.21.15.43:0/249133842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cf80fdf60 0x7f2cf810dbb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:35.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.770+0000 7f2cfd082700 1 -- 172.21.15.43:0/249133842 >> 172.21.15.43:0/249133842 conn(0x7f2cf80f6950 msgr2=0x7f2cf80f8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:35.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.770+0000 7f2cfd082700 1 -- 172.21.15.43:0/249133842 shutdown_connections 2023-12-08T20:25:35.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:35.770+0000 7f2cfd082700 1 -- 172.21.15.43:0/249133842 wait complete. 2023-12-08T20:25:36.200 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- bash -c 'ceph orch device ls' 2023-12-08T20:25:36.502 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:36.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:36 smithi111 ceph-mon[121341]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:36.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:36 smithi111 ceph-mon[121341]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:25:36.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:36 smithi043 ceph-mon[111966]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:36.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:36 smithi043 ceph-mon[111966]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:25:37.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.609+0000 7fa5e424d700 1 -- 172.21.15.43:0/3905966539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5dc0fcd00 msgr2=0x7fa5dc0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:37.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.609+0000 7fa5e424d700 1 --2- 172.21.15.43:0/3905966539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5dc0fcd00 0x7fa5dc0fd150 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc004940 tx=0x7fa5cc009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:37.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.609+0000 7fa5e424d700 1 -- 172.21.15.43:0/3905966539 shutdown_connections 2023-12-08T20:25:37.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.609+0000 7fa5e424d700 1 --2- 172.21.15.43:0/3905966539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5dc0fcd00 0x7fa5dc0fd150 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:37.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.609+0000 7fa5e424d700 1 --2- 172.21.15.43:0/3905966539 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5dc0fbaf0 0x7fa5dc0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:37.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.609+0000 7fa5e424d700 1 -- 172.21.15.43:0/3905966539 >> 172.21.15.43:0/3905966539 conn(0x7fa5dc0f7190 msgr2=0x7fa5dc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:37.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.609+0000 7fa5e424d700 1 -- 172.21.15.43:0/3905966539 shutdown_connections 2023-12-08T20:25:37.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.610+0000 7fa5e424d700 1 -- 172.21.15.43:0/3905966539 wait complete. 2023-12-08T20:25:37.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.610+0000 7fa5e424d700 1 Processor -- start 2023-12-08T20:25:37.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.610+0000 7fa5e424d700 1 -- start start 2023-12-08T20:25:37.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.610+0000 7fa5e424d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5dc0fbaf0 0x7fa5dc10b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:37.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.610+0000 7fa5e424d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5dc0fcd00 0x7fa5dc10b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:37.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.610+0000 7fa5e424d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc10be90 con 0x7fa5dc0fcd00 2023-12-08T20:25:37.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.610+0000 7fa5e424d700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc10c730 con 0x7fa5dc0fbaf0 2023-12-08T20:25:37.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.610+0000 7fa5e17e8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5dc0fcd00 0x7fa5dc10b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:37.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.610+0000 7fa5e1fe9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5dc0fbaf0 0x7fa5dc10b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:37.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.611+0000 7fa5e17e8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5dc0fcd00 0x7fa5dc10b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43298/0 (socket says 172.21.15.43:43298) 2023-12-08T20:25:37.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.611+0000 7fa5e17e8700 1 -- 172.21.15.43:0/4117365784 learned_addr learned my addr 172.21.15.43:0/4117365784 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:37.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.611+0000 7fa5e17e8700 1 -- 172.21.15.43:0/4117365784 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5dc0fbaf0 msgr2=0x7fa5dc10b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:37.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.611+0000 7fa5e17e8700 1 --2- 172.21.15.43:0/4117365784 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5dc0fbaf0 0x7fa5dc10b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:37.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.611+0000 7fa5e17e8700 1 -- 172.21.15.43:0/4117365784 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc005040 con 0x7fa5dc0fcd00 2023-12-08T20:25:37.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.611+0000 7fa5e17e8700 1 --2- 172.21.15.43:0/4117365784 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5dc0fcd00 0x7fa5dc10b890 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc009380 tx=0x7fa5cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:37.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.611+0000 7fa5d27fc700 1 -- 172.21.15.43:0/4117365784 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5cc00e040 con 0x7fa5dc0fcd00 2023-12-08T20:25:37.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.611+0000 7fa5e424d700 1 -- 172.21.15.43:0/4117365784 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5dc10c9b0 con 0x7fa5dc0fcd00 2023-12-08T20:25:37.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.611+0000 7fa5d27fc700 1 -- 172.21.15.43:0/4117365784 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa5cc00bd20 con 0x7fa5dc0fcd00 2023-12-08T20:25:37.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.611+0000 7fa5d27fc700 1 -- 172.21.15.43:0/4117365784 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5cc01c630 con 0x7fa5dc0fcd00 2023-12-08T20:25:37.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.611+0000 7fa5e424d700 1 -- 172.21.15.43:0/4117365784 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5dc10cef0 con 0x7fa5dc0fcd00 2023-12-08T20:25:37.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.612+0000 7fa5e424d700 1 -- 172.21.15.43:0/4117365784 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5dc04bb80 con 0x7fa5dc0fcd00 2023-12-08T20:25:37.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.613+0000 7fa5d27fc700 1 -- 172.21.15.43:0/4117365784 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa5cc013420 con 0x7fa5dc0fcd00 2023-12-08T20:25:37.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.613+0000 7fa5d27fc700 1 --2- 172.21.15.43:0/4117365784 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa5c8068f60 0x7fa5c806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:37.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.613+0000 7fa5d27fc700 1 -- 172.21.15.43:0/4117365784 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa5cc087df0 con 0x7fa5dc0fcd00 2023-12-08T20:25:37.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.613+0000 7fa5e1fe9700 1 --2- 172.21.15.43:0/4117365784 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa5c8068f60 0x7fa5c806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:37.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.614+0000 7fa5e1fe9700 1 --2- 172.21.15.43:0/4117365784 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa5c8068f60 0x7fa5c806b410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0fcb60 tx=0x7fa5d800d040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:37.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.618+0000 7fa5d27fc700 1 -- 172.21.15.43:0/4117365784 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa5cc058090 con 0x7fa5dc0fcd00 2023-12-08T20:25:37.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.826+0000 7fa5e424d700 1 -- 172.21.15.43:0/4117365784 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5dc10d340 con 0x7fa5c8068f60 2023-12-08T20:25:37.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.828+0000 7fa5d27fc700 1 -- 172.21.15.43:0/4117365784 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7fa5dc10d340 con 0x7fa5c8068f60 2023-12-08T20:25:37.829 INFO:teuthology.orchestra.run.smithi043.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-12-08T20:25:37.829 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300GH480DGN 447G No 101s ago Has a FileSystem, LVM detected 2023-12-08T20:25:37.829 INFO:teuthology.orchestra.run.smithi043.stdout:smithi111 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400VZ400BGN 372G No 50s ago Has a FileSystem, LVM detected 2023-12-08T20:25:37.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.830+0000 7fa5e424d700 1 -- 172.21.15.43:0/4117365784 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa5c8068f60 msgr2=0x7fa5c806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:37.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.830+0000 7fa5e424d700 1 --2- 172.21.15.43:0/4117365784 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa5c8068f60 0x7fa5c806b410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0fcb60 tx=0x7fa5d800d040 comp rx=0 tx=0).stop 2023-12-08T20:25:37.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.830+0000 7fa5e424d700 1 -- 172.21.15.43:0/4117365784 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5dc0fcd00 msgr2=0x7fa5dc10b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:37.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.830+0000 7fa5e424d700 1 --2- 172.21.15.43:0/4117365784 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5dc0fcd00 0x7fa5dc10b890 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc009380 tx=0x7fa5cc009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:37.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.830+0000 7fa5e424d700 1 -- 172.21.15.43:0/4117365784 shutdown_connections 2023-12-08T20:25:37.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.830+0000 7fa5e424d700 1 --2- 172.21.15.43:0/4117365784 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fa5c8068f60 0x7fa5c806b410 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:37.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.830+0000 7fa5e424d700 1 --2- 172.21.15.43:0/4117365784 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5dc0fbaf0 0x7fa5dc10b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:37.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.830+0000 7fa5e424d700 1 --2- 172.21.15.43:0/4117365784 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5dc0fcd00 0x7fa5dc10b890 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:37.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.830+0000 7fa5e424d700 1 -- 172.21.15.43:0/4117365784 >> 172.21.15.43:0/4117365784 conn(0x7fa5dc0f7190 msgr2=0x7fa5dc0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:37.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.830+0000 7fa5e424d700 1 -- 172.21.15.43:0/4117365784 shutdown_connections 2023-12-08T20:25:37.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:37.830+0000 7fa5e424d700 1 -- 172.21.15.43:0/4117365784 wait complete. 2023-12-08T20:25:38.241 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-08T20:25:38.248 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi043.front.sepia.ceph.com 2023-12-08T20:25:38.248 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2023-12-08T20:25:38.553 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:38.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:38 smithi043 ceph-mon[111966]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:38.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:38 smithi043 ceph-mon[111966]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:25:38.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:38 smithi111 ceph-mon[121341]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:38.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:38 smithi111 ceph-mon[121341]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:25:39.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.674+0000 7f35d4a9b700 1 -- 172.21.15.43:0/1801942762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35d00fcd10 msgr2=0x7f35d00fd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:39.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.674+0000 7f35d4a9b700 1 --2- 172.21.15.43:0/1801942762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35d00fcd10 0x7f35d00fd160 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f35c4004940 tx=0x7f35c4009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:39.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.674+0000 7f35d4a9b700 1 -- 172.21.15.43:0/1801942762 shutdown_connections 2023-12-08T20:25:39.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.674+0000 7f35d4a9b700 1 --2- 172.21.15.43:0/1801942762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35d00fcd10 0x7f35d00fd160 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:39.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.674+0000 7f35d4a9b700 1 --2- 172.21.15.43:0/1801942762 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35d00fbb00 0x7f35d00fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:39.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.674+0000 7f35d4a9b700 1 -- 172.21.15.43:0/1801942762 >> 172.21.15.43:0/1801942762 conn(0x7f35d00f71c0 msgr2=0x7f35d00f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:39.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.674+0000 7f35d4a9b700 1 -- 172.21.15.43:0/1801942762 shutdown_connections 2023-12-08T20:25:39.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.674+0000 7f35d4a9b700 1 -- 172.21.15.43:0/1801942762 wait complete. 2023-12-08T20:25:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.674+0000 7f35d4a9b700 1 Processor -- start 2023-12-08T20:25:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.674+0000 7f35d4a9b700 1 -- start start 2023-12-08T20:25:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.675+0000 7f35d4a9b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35d00fbb00 0x7f35d010c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.675+0000 7f35d4a9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35d00fcd10 0x7f35d010c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.675+0000 7f35d4a9b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d010cf40 con 0x7f35d00fcd10 2023-12-08T20:25:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.675+0000 7f35d4a9b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d010d7e0 con 0x7f35d00fbb00 2023-12-08T20:25:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.675+0000 7f35cdd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35d00fcd10 0x7f35d010c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.675+0000 7f35cdd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35d00fcd10 0x7f35d010c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43316/0 (socket says 172.21.15.43:43316) 2023-12-08T20:25:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.675+0000 7f35cdd9b700 1 -- 172.21.15.43:0/2128590327 learned_addr learned my addr 172.21.15.43:0/2128590327 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.675+0000 7f35ce59c700 1 --2- 172.21.15.43:0/2128590327 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35d00fbb00 0x7f35d010c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.675+0000 7f35cdd9b700 1 -- 172.21.15.43:0/2128590327 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35d00fbb00 msgr2=0x7f35d010c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.675+0000 7f35cdd9b700 1 --2- 172.21.15.43:0/2128590327 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35d00fbb00 0x7f35d010c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:39.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.675+0000 7f35cdd9b700 1 -- 172.21.15.43:0/2128590327 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c4005040 con 0x7f35d00fcd10 2023-12-08T20:25:39.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.675+0000 7f35cdd9b700 1 --2- 172.21.15.43:0/2128590327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35d00fcd10 0x7f35d010c940 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f35c4009380 tx=0x7f35c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:39.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.675+0000 7f35beffd700 1 -- 172.21.15.43:0/2128590327 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35c400e040 con 0x7f35d00fcd10 2023-12-08T20:25:39.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.675+0000 7f35beffd700 1 -- 172.21.15.43:0/2128590327 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f35c400bd20 con 0x7f35d00fcd10 2023-12-08T20:25:39.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.675+0000 7f35d4a9b700 1 -- 172.21.15.43:0/2128590327 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d010da60 con 0x7f35d00fcd10 2023-12-08T20:25:39.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.676+0000 7f35beffd700 1 -- 172.21.15.43:0/2128590327 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35c401c630 con 0x7f35d00fcd10 2023-12-08T20:25:39.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.676+0000 7f35d4a9b700 1 -- 172.21.15.43:0/2128590327 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d010dfa0 con 0x7f35d00fcd10 2023-12-08T20:25:39.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.677+0000 7f35d4a9b700 1 -- 172.21.15.43:0/2128590327 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d004bb80 con 0x7f35d00fcd10 2023-12-08T20:25:39.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.677+0000 7f35beffd700 1 -- 172.21.15.43:0/2128590327 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f35c4013420 con 0x7f35d00fcd10 2023-12-08T20:25:39.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.677+0000 7f35beffd700 1 --2- 172.21.15.43:0/2128590327 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f35b8068f60 0x7f35b806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:39.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.678+0000 7f35beffd700 1 -- 172.21.15.43:0/2128590327 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f35c4087d30 con 0x7f35d00fcd10 2023-12-08T20:25:39.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.678+0000 7f35ce59c700 1 --2- 172.21.15.43:0/2128590327 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f35b8068f60 0x7f35b806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:39.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.678+0000 7f35ce59c700 1 --2- 172.21.15.43:0/2128590327 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f35b8068f60 0x7f35b806b410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f35d00fcb70 tx=0x7f35c000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.682+0000 7f35beffd700 1 -- 172.21.15.43:0/2128590327 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f35c4058070 con 0x7f35d00fcd10 2023-12-08T20:25:39.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:39.913+0000 7f35d4a9b700 1 -- 172.21.15.43:0/2128590327 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f35d010e440 con 0x7f35b8068f60 2023-12-08T20:25:40.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:40 smithi043 ceph-mon[111966]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:40.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:40 smithi043 ceph-mon[111966]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:25:40.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:40 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-08T20:25:40.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:40 smithi111 ceph-mon[121341]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:40.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:40 smithi111 ceph-mon[121341]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:25:40.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:40 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-08T20:25:41.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:41.556+0000 7f35beffd700 1 -- 172.21.15.43:0/2128590327 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f35d010e440 con 0x7f35b8068f60 2023-12-08T20:25:41.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:41.558+0000 7f35d4a9b700 1 -- 172.21.15.43:0/2128590327 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f35b8068f60 msgr2=0x7f35b806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:41.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:41.558+0000 7f35d4a9b700 1 --2- 172.21.15.43:0/2128590327 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f35b8068f60 0x7f35b806b410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f35d00fcb70 tx=0x7f35c000b040 comp rx=0 tx=0).stop 2023-12-08T20:25:41.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:41.558+0000 7f35d4a9b700 1 -- 172.21.15.43:0/2128590327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35d00fcd10 msgr2=0x7f35d010c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:41.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:41.558+0000 7f35d4a9b700 1 --2- 172.21.15.43:0/2128590327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35d00fcd10 0x7f35d010c940 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f35c4009380 tx=0x7f35c4009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:41.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:41.559+0000 7f35d4a9b700 1 -- 172.21.15.43:0/2128590327 shutdown_connections 2023-12-08T20:25:41.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:41.559+0000 7f35d4a9b700 1 --2- 172.21.15.43:0/2128590327 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f35b8068f60 0x7f35b806b410 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:41.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:41.559+0000 7f35d4a9b700 1 --2- 172.21.15.43:0/2128590327 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35d00fbb00 0x7f35d010c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:41.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:41.559+0000 7f35d4a9b700 1 --2- 172.21.15.43:0/2128590327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35d00fcd10 0x7f35d010c940 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:41.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:41.559+0000 7f35d4a9b700 1 -- 172.21.15.43:0/2128590327 >> 172.21.15.43:0/2128590327 conn(0x7f35d00f71c0 msgr2=0x7f35d00fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:41.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:41.559+0000 7f35d4a9b700 1 -- 172.21.15.43:0/2128590327 shutdown_connections 2023-12-08T20:25:41.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:41.559+0000 7f35d4a9b700 1 -- 172.21.15.43:0/2128590327 wait complete. 2023-12-08T20:25:41.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:41 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-08T20:25:41.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:41 smithi111 ceph-mon[121341]: osdmap e41: 6 total, 6 up, 6 in 2023-12-08T20:25:41.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:41 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-08T20:25:41.980 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:41 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-08T20:25:41.981 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:41 smithi043 ceph-mon[111966]: osdmap e41: 6 total, 6 up, 6 in 2023-12-08T20:25:41.981 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:41 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-08T20:25:41.981 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:41 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-mon-smithi043[111943]: 2023-12-08T20:25:41.527+0000 7f7867ecb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T20:25:42.007 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-08T20:25:42.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: pgmap v130: 33 pgs: 10 creating+peering, 1 active+clean, 22 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:42.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-08T20:25:42.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-08T20:25:42.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: osdmap e42: 6 total, 6 up, 6 in 2023-12-08T20:25:42.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-08T20:25:42.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T20:25:42.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-08T20:25:42.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: osdmap e43: 6 total, 6 up, 6 in 2023-12-08T20:25:42.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-08T20:25:42.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: fsmap cephfs:0 2023-12-08T20:25:42.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: Saving service mds.cephfs spec with placement count:4 2023-12-08T20:25:42.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:42.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:25:42.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:25:42.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:25:42.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:42.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi043.pjmszb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-08T20:25:42.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi043.pjmszb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-08T20:25:42.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:25:42.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:42 smithi043 ceph-mon[111966]: Deploying daemon mds.cephfs.smithi043.pjmszb on smithi043 2023-12-08T20:25:42.787 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:42.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: pgmap v130: 33 pgs: 10 creating+peering, 1 active+clean, 22 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:42.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-08T20:25:42.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-08T20:25:42.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: osdmap e42: 6 total, 6 up, 6 in 2023-12-08T20:25:42.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-08T20:25:42.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T20:25:42.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-08T20:25:42.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: osdmap e43: 6 total, 6 up, 6 in 2023-12-08T20:25:42.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-08T20:25:42.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: fsmap cephfs:0 2023-12-08T20:25:42.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: Saving service mds.cephfs spec with placement count:4 2023-12-08T20:25:42.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:42.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:25:42.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:25:42.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:25:42.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:42.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi043.pjmszb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-08T20:25:42.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi043.pjmszb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-08T20:25:42.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:25:42.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:42 smithi111 ceph-mon[121341]: Deploying daemon mds.cephfs.smithi043.pjmszb on smithi043 2023-12-08T20:25:43.748 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:43 smithi043 ceph-mon[111966]: osdmap e44: 6 total, 6 up, 6 in 2023-12-08T20:25:43.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:43 smithi111 ceph-mon[121341]: osdmap e44: 6 total, 6 up, 6 in 2023-12-08T20:25:44.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.106+0000 7f49fc632700 1 -- 172.21.15.43:0/3214319021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49f40fcbf0 msgr2=0x7f49f40fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:44.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.106+0000 7f49fc632700 1 --2- 172.21.15.43:0/3214319021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49f40fcbf0 0x7f49f40fd000 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f49e4004940 tx=0x7f49e4009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:44.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.106+0000 7f49fc632700 1 -- 172.21.15.43:0/3214319021 shutdown_connections 2023-12-08T20:25:44.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.106+0000 7f49fc632700 1 --2- 172.21.15.43:0/3214319021 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49f40fde00 0x7f49f40fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:44.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.106+0000 7f49fc632700 1 --2- 172.21.15.43:0/3214319021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49f40fcbf0 0x7f49f40fd000 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:44.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.106+0000 7f49fc632700 1 -- 172.21.15.43:0/3214319021 >> 172.21.15.43:0/3214319021 conn(0x7f49f40f82d0 msgr2=0x7f49f40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:44.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.107+0000 7f49fc632700 1 -- 172.21.15.43:0/3214319021 shutdown_connections 2023-12-08T20:25:44.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.107+0000 7f49fc632700 1 -- 172.21.15.43:0/3214319021 wait complete. 2023-12-08T20:25:44.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.107+0000 7f49fc632700 1 Processor -- start 2023-12-08T20:25:44.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.107+0000 7f49fc632700 1 -- start start 2023-12-08T20:25:44.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.107+0000 7f49fc632700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49f40fcbf0 0x7f49f410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:44.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.108+0000 7f49fc632700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49f40fde00 0x7f49f410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:44.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.108+0000 7f49fc632700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f410e010 con 0x7f49f40fde00 2023-12-08T20:25:44.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.108+0000 7f49fc632700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f410e8b0 con 0x7f49f40fcbf0 2023-12-08T20:25:44.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.108+0000 7f49f9bcd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49f40fde00 0x7f49f410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:44.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.108+0000 7f49f9bcd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49f40fde00 0x7f49f410da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52968/0 (socket says 172.21.15.43:52968) 2023-12-08T20:25:44.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.108+0000 7f49f9bcd700 1 -- 172.21.15.43:0/978149163 learned_addr learned my addr 172.21.15.43:0/978149163 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:44.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.108+0000 7f49fa3ce700 1 --2- 172.21.15.43:0/978149163 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49f40fcbf0 0x7f49f410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:44.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.108+0000 7f49f9bcd700 1 -- 172.21.15.43:0/978149163 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49f40fcbf0 msgr2=0x7f49f410d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:44.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.108+0000 7f49f9bcd700 1 --2- 172.21.15.43:0/978149163 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49f40fcbf0 0x7f49f410d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:44.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.108+0000 7f49f9bcd700 1 -- 172.21.15.43:0/978149163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e4005040 con 0x7f49f40fde00 2023-12-08T20:25:44.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.108+0000 7f49f9bcd700 1 --2- 172.21.15.43:0/978149163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49f40fde00 0x7f49f410da10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f49f0002a80 tx=0x7f49f00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:44.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.108+0000 7f49eaffd700 1 -- 172.21.15.43:0/978149163 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49f0007cc0 con 0x7f49f40fde00 2023-12-08T20:25:44.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.108+0000 7f49eaffd700 1 -- 172.21.15.43:0/978149163 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f49f000f040 con 0x7f49f40fde00 2023-12-08T20:25:44.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.108+0000 7f49fc632700 1 -- 172.21.15.43:0/978149163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f410eb90 con 0x7f49f40fde00 2023-12-08T20:25:44.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.108+0000 7f49eaffd700 1 -- 172.21.15.43:0/978149163 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49f000da60 con 0x7f49f40fde00 2023-12-08T20:25:44.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.109+0000 7f49fc632700 1 -- 172.21.15.43:0/978149163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f410f0d0 con 0x7f49f40fde00 2023-12-08T20:25:44.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.110+0000 7f49fc632700 1 -- 172.21.15.43:0/978149163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f404bb80 con 0x7f49f40fde00 2023-12-08T20:25:44.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.110+0000 7f49eaffd700 1 -- 172.21.15.43:0/978149163 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f49f000dbc0 con 0x7f49f40fde00 2023-12-08T20:25:44.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.111+0000 7f49eaffd700 1 --2- 172.21.15.43:0/978149163 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f49e0068f60 0x7f49e006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:44.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.111+0000 7f49eaffd700 1 -- 172.21.15.43:0/978149163 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f49f0086950 con 0x7f49f40fde00 2023-12-08T20:25:44.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.111+0000 7f49fa3ce700 1 --2- 172.21.15.43:0/978149163 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f49e0068f60 0x7f49e006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:44.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.111+0000 7f49fa3ce700 1 --2- 172.21.15.43:0/978149163 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f49e0068f60 0x7f49e006b410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f49e4004890 tx=0x7f49e4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:44.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.116+0000 7f49eaffd700 1 -- 172.21.15.43:0/978149163 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f49f00568b0 con 0x7f49f40fde00 2023-12-08T20:25:44.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.363+0000 7f49fc632700 1 -- 172.21.15.43:0/978149163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f49f4105590 con 0x7f49f40fde00 2023-12-08T20:25:44.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.364+0000 7f49eaffd700 1 -- 172.21.15.43:0/978149163 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f49f0056440 con 0x7f49f40fde00 2023-12-08T20:25:44.365 INFO:teuthology.orchestra.run.smithi043.stdout:e2 2023-12-08T20:25:44.365 INFO:teuthology.orchestra.run.smithi043.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-08T20:25:44.365 INFO:teuthology.orchestra.run.smithi043.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:25:44.365 INFO:teuthology.orchestra.run.smithi043.stdout:legacy client fscid: 1 2023-12-08T20:25:44.365 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:25:44.365 INFO:teuthology.orchestra.run.smithi043.stdout:Filesystem 'cephfs' (1) 2023-12-08T20:25:44.365 INFO:teuthology.orchestra.run.smithi043.stdout:fs_name cephfs 2023-12-08T20:25:44.365 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 2 2023-12-08T20:25:44.365 INFO:teuthology.orchestra.run.smithi043.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-08T20:25:44.365 INFO:teuthology.orchestra.run.smithi043.stdout:created 2023-12-08T20:25:41.527734+0000 2023-12-08T20:25:44.365 INFO:teuthology.orchestra.run.smithi043.stdout:modified 2023-12-08T20:25:41.527807+0000 2023-12-08T20:25:44.366 INFO:teuthology.orchestra.run.smithi043.stdout:tableserver 0 2023-12-08T20:25:44.366 INFO:teuthology.orchestra.run.smithi043.stdout:root 0 2023-12-08T20:25:44.366 INFO:teuthology.orchestra.run.smithi043.stdout:session_timeout 60 2023-12-08T20:25:44.366 INFO:teuthology.orchestra.run.smithi043.stdout:session_autoclose 300 2023-12-08T20:25:44.366 INFO:teuthology.orchestra.run.smithi043.stdout:max_file_size 1099511627776 2023-12-08T20:25:44.366 INFO:teuthology.orchestra.run.smithi043.stdout:required_client_features {} 2023-12-08T20:25:44.366 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure 0 2023-12-08T20:25:44.366 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure_osd_epoch 0 2023-12-08T20:25:44.366 INFO:teuthology.orchestra.run.smithi043.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:25:44.366 INFO:teuthology.orchestra.run.smithi043.stdout:max_mds 1 2023-12-08T20:25:44.366 INFO:teuthology.orchestra.run.smithi043.stdout:in 2023-12-08T20:25:44.366 INFO:teuthology.orchestra.run.smithi043.stdout:up {} 2023-12-08T20:25:44.366 INFO:teuthology.orchestra.run.smithi043.stdout:failed 2023-12-08T20:25:44.366 INFO:teuthology.orchestra.run.smithi043.stdout:damaged 2023-12-08T20:25:44.366 INFO:teuthology.orchestra.run.smithi043.stdout:stopped 2023-12-08T20:25:44.367 INFO:teuthology.orchestra.run.smithi043.stdout:data_pools [3] 2023-12-08T20:25:44.367 INFO:teuthology.orchestra.run.smithi043.stdout:metadata_pool 2 2023-12-08T20:25:44.367 INFO:teuthology.orchestra.run.smithi043.stdout:inline_data disabled 2023-12-08T20:25:44.367 INFO:teuthology.orchestra.run.smithi043.stdout:balancer 2023-12-08T20:25:44.367 INFO:teuthology.orchestra.run.smithi043.stdout:standby_count_wanted 0 2023-12-08T20:25:44.367 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:25:44.367 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:25:44.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.366+0000 7f49fc632700 1 -- 172.21.15.43:0/978149163 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f49e0068f60 msgr2=0x7f49e006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:44.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.366+0000 7f49fc632700 1 --2- 172.21.15.43:0/978149163 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f49e0068f60 0x7f49e006b410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f49e4004890 tx=0x7f49e4009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:44.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.366+0000 7f49fc632700 1 -- 172.21.15.43:0/978149163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49f40fde00 msgr2=0x7f49f410da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:44.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.366+0000 7f49fc632700 1 --2- 172.21.15.43:0/978149163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49f40fde00 0x7f49f410da10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f49f0002a80 tx=0x7f49f00046b0 comp rx=0 tx=0).stop 2023-12-08T20:25:44.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.366+0000 7f49fc632700 1 -- 172.21.15.43:0/978149163 shutdown_connections 2023-12-08T20:25:44.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.366+0000 7f49fc632700 1 --2- 172.21.15.43:0/978149163 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f49e0068f60 0x7f49e006b410 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:44.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.366+0000 7f49fc632700 1 --2- 172.21.15.43:0/978149163 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49f40fcbf0 0x7f49f410d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:44.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.366+0000 7f49fc632700 1 --2- 172.21.15.43:0/978149163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49f40fde00 0x7f49f410da10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:44.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.366+0000 7f49fc632700 1 -- 172.21.15.43:0/978149163 >> 172.21.15.43:0/978149163 conn(0x7f49f40f82d0 msgr2=0x7f49f4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:44.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.366+0000 7f49fc632700 1 -- 172.21.15.43:0/978149163 shutdown_connections 2023-12-08T20:25:44.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:44.366+0000 7f49fc632700 1 -- 172.21.15.43:0/978149163 wait complete. 2023-12-08T20:25:44.369 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 2 2023-12-08T20:25:44.707 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:44 smithi043 ceph-mon[111966]: pgmap v134: 65 pgs: 14 creating+peering, 6 active+clean, 45 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:44.707 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:44 smithi043 ceph-mon[111966]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-08T20:25:44.707 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:44 smithi043 ceph-mon[111966]: osdmap e45: 6 total, 6 up, 6 in 2023-12-08T20:25:44.707 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:44 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:44.707 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:44 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:44.708 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:44 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:44.708 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:44 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.veeegc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-08T20:25:44.708 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:44 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.veeegc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-08T20:25:44.708 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:44 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:25:44.708 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:44 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/978149163' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-08T20:25:44.766 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-08T20:25:44.789 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi043.front.sepia.ceph.com 2023-12-08T20:25:44.789 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2023-12-08T20:25:44.848 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:44 smithi111 ceph-mon[121341]: pgmap v134: 65 pgs: 14 creating+peering, 6 active+clean, 45 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:44.849 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:44 smithi111 ceph-mon[121341]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-08T20:25:44.849 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:44 smithi111 ceph-mon[121341]: osdmap e45: 6 total, 6 up, 6 in 2023-12-08T20:25:44.849 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:44 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:44.849 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:44 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:44.849 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:44 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:44.849 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:44 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.veeegc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-08T20:25:44.849 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:44 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.veeegc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-08T20:25:44.849 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:44 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:25:44.849 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:44 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/978149163' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-08T20:25:45.093 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:45.835 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:45 smithi043 ceph-mon[111966]: Deploying daemon mds.cephfs.smithi111.veeegc on smithi111 2023-12-08T20:25:45.835 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:45 smithi043 ceph-mon[111966]: mds.? [v2:172.21.15.43:6826/441584552,v1:172.21.15.43:6827/441584552] up:boot 2023-12-08T20:25:45.835 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:45 smithi043 ceph-mon[111966]: daemon mds.cephfs.smithi043.pjmszb assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-08T20:25:45.835 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:45 smithi043 ceph-mon[111966]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-08T20:25:45.835 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:45 smithi043 ceph-mon[111966]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-08T20:25:45.835 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:45 smithi043 ceph-mon[111966]: Cluster is now healthy 2023-12-08T20:25:45.836 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:45 smithi043 ceph-mon[111966]: fsmap cephfs:0 1 up:standby 2023-12-08T20:25:45.836 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:45 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi043.pjmszb"}]: dispatch 2023-12-08T20:25:45.836 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:45 smithi043 ceph-mon[111966]: fsmap cephfs:1 {0=cephfs.smithi043.pjmszb=up:creating} 2023-12-08T20:25:45.836 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:45 smithi043 ceph-mon[111966]: daemon mds.cephfs.smithi043.pjmszb is now active in filesystem cephfs as rank 0 2023-12-08T20:25:45.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:45 smithi111 ceph-mon[121341]: Deploying daemon mds.cephfs.smithi111.veeegc on smithi111 2023-12-08T20:25:45.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:45 smithi111 ceph-mon[121341]: mds.? [v2:172.21.15.43:6826/441584552,v1:172.21.15.43:6827/441584552] up:boot 2023-12-08T20:25:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:45 smithi111 ceph-mon[121341]: daemon mds.cephfs.smithi043.pjmszb assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-08T20:25:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:45 smithi111 ceph-mon[121341]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-08T20:25:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:45 smithi111 ceph-mon[121341]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-08T20:25:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:45 smithi111 ceph-mon[121341]: Cluster is now healthy 2023-12-08T20:25:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:45 smithi111 ceph-mon[121341]: fsmap cephfs:0 1 up:standby 2023-12-08T20:25:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:45 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi043.pjmszb"}]: dispatch 2023-12-08T20:25:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:45 smithi111 ceph-mon[121341]: fsmap cephfs:1 {0=cephfs.smithi043.pjmszb=up:creating} 2023-12-08T20:25:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:45 smithi111 ceph-mon[121341]: daemon mds.cephfs.smithi043.pjmszb is now active in filesystem cephfs as rank 0 2023-12-08T20:25:46.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.251+0000 7f78dd615700 1 -- 172.21.15.43:0/3818268078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78d8100060 msgr2=0x7f78d8102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:46.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.251+0000 7f78dd615700 1 --2- 172.21.15.43:0/3818268078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78d8100060 0x7f78d8102440 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f78c0004940 tx=0x7f78c0009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:46.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.251+0000 7f78dd615700 1 -- 172.21.15.43:0/3818268078 shutdown_connections 2023-12-08T20:25:46.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.251+0000 7f78dd615700 1 --2- 172.21.15.43:0/3818268078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78d8100060 0x7f78d8102440 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:46.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.251+0000 7f78dd615700 1 --2- 172.21.15.43:0/3818268078 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78d80fd740 0x7f78d80ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:46.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.251+0000 7f78dd615700 1 -- 172.21.15.43:0/3818268078 >> 172.21.15.43:0/3818268078 conn(0x7f78d80f71c0 msgr2=0x7f78d80f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:46.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.251+0000 7f78dd615700 1 -- 172.21.15.43:0/3818268078 shutdown_connections 2023-12-08T20:25:46.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.251+0000 7f78dd615700 1 -- 172.21.15.43:0/3818268078 wait complete. 2023-12-08T20:25:46.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.252+0000 7f78dd615700 1 Processor -- start 2023-12-08T20:25:46.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.252+0000 7f78dd615700 1 -- start start 2023-12-08T20:25:46.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.252+0000 7f78dd615700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78d80fd740 0x7f78d810d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:46.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.252+0000 7f78dd615700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78d8100060 0x7f78d810d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:46.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.252+0000 7f78dd615700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d810dff0 con 0x7f78d8100060 2023-12-08T20:25:46.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.252+0000 7f78dd615700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d810e890 con 0x7f78d80fd740 2023-12-08T20:25:46.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.252+0000 7f78cffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78d8100060 0x7f78d810d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:46.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.252+0000 7f78cffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78d8100060 0x7f78d810d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52980/0 (socket says 172.21.15.43:52980) 2023-12-08T20:25:46.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.252+0000 7f78cffff700 1 -- 172.21.15.43:0/4230801410 learned_addr learned my addr 172.21.15.43:0/4230801410 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:46.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.253+0000 7f78d6ffd700 1 --2- 172.21.15.43:0/4230801410 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78d80fd740 0x7f78d810d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:46.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.253+0000 7f78cffff700 1 -- 172.21.15.43:0/4230801410 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78d80fd740 msgr2=0x7f78d810d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:46.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.253+0000 7f78cffff700 1 --2- 172.21.15.43:0/4230801410 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78d80fd740 0x7f78d810d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:46.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.253+0000 7f78cffff700 1 -- 172.21.15.43:0/4230801410 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c0005040 con 0x7f78d8100060 2023-12-08T20:25:46.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.253+0000 7f78cffff700 1 --2- 172.21.15.43:0/4230801410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78d8100060 0x7f78d810d9f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f78c0008f90 tx=0x7f78c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:46.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.253+0000 7f78cf7fe700 1 -- 172.21.15.43:0/4230801410 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78c0021070 con 0x7f78d8100060 2023-12-08T20:25:46.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.253+0000 7f78cf7fe700 1 -- 172.21.15.43:0/4230801410 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f78c001c400 con 0x7f78d8100060 2023-12-08T20:25:46.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.253+0000 7f78dd615700 1 -- 172.21.15.43:0/4230801410 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d810eb10 con 0x7f78d8100060 2023-12-08T20:25:46.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.253+0000 7f78cf7fe700 1 -- 172.21.15.43:0/4230801410 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78c000e030 con 0x7f78d8100060 2023-12-08T20:25:46.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.253+0000 7f78dd615700 1 -- 172.21.15.43:0/4230801410 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d810f050 con 0x7f78d8100060 2023-12-08T20:25:46.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.255+0000 7f78dd615700 1 -- 172.21.15.43:0/4230801410 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d81075d0 con 0x7f78d8100060 2023-12-08T20:25:46.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.255+0000 7f78cf7fe700 1 -- 172.21.15.43:0/4230801410 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f78c001ca00 con 0x7f78d8100060 2023-12-08T20:25:46.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.256+0000 7f78cf7fe700 1 --2- 172.21.15.43:0/4230801410 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f78c4068f70 0x7f78c406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:46.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.256+0000 7f78cf7fe700 1 -- 172.21.15.43:0/4230801410 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f78c0087f80 con 0x7f78d8100060 2023-12-08T20:25:46.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.256+0000 7f78d6ffd700 1 --2- 172.21.15.43:0/4230801410 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f78c4068f70 0x7f78c406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:46.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.256+0000 7f78d6ffd700 1 --2- 172.21.15.43:0/4230801410 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f78c4068f70 0x7f78c406b420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009b80 tx=0x7f78c800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:46.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.261+0000 7f78cf7fe700 1 -- 172.21.15.43:0/4230801410 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f78c0057f80 con 0x7f78d8100060 2023-12-08T20:25:46.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.529+0000 7f78dd615700 1 -- 172.21.15.43:0/4230801410 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f78d81055c0 con 0x7f78d8100060 2023-12-08T20:25:46.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.567+0000 7f78cf7fe700 1 -- 172.21.15.43:0/4230801410 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f78c0057b10 con 0x7f78d8100060 2023-12-08T20:25:46.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.569+0000 7f78dd615700 1 -- 172.21.15.43:0/4230801410 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f78c4068f70 msgr2=0x7f78c406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:46.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.569+0000 7f78dd615700 1 --2- 172.21.15.43:0/4230801410 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f78c4068f70 0x7f78c406b420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009b80 tx=0x7f78c800b040 comp rx=0 tx=0).stop 2023-12-08T20:25:46.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.569+0000 7f78dd615700 1 -- 172.21.15.43:0/4230801410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78d8100060 msgr2=0x7f78d810d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:46.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.569+0000 7f78dd615700 1 --2- 172.21.15.43:0/4230801410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78d8100060 0x7f78d810d9f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f78c0008f90 tx=0x7f78c0009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:46.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.569+0000 7f78dd615700 1 -- 172.21.15.43:0/4230801410 shutdown_connections 2023-12-08T20:25:46.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.569+0000 7f78dd615700 1 --2- 172.21.15.43:0/4230801410 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f78c4068f70 0x7f78c406b420 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:46.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.569+0000 7f78dd615700 1 --2- 172.21.15.43:0/4230801410 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78d80fd740 0x7f78d810d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:46.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.569+0000 7f78dd615700 1 --2- 172.21.15.43:0/4230801410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78d8100060 0x7f78d810d9f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:46.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.569+0000 7f78dd615700 1 -- 172.21.15.43:0/4230801410 >> 172.21.15.43:0/4230801410 conn(0x7f78d80f71c0 msgr2=0x7f78d80f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:46.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.569+0000 7f78dd615700 1 -- 172.21.15.43:0/4230801410 shutdown_connections 2023-12-08T20:25:46.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:46.569+0000 7f78dd615700 1 -- 172.21.15.43:0/4230801410 wait complete. 2023-12-08T20:25:46.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:46 smithi043 ceph-mon[111966]: pgmap v136: 65 pgs: 14 creating+peering, 43 active+clean, 8 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:46.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:46 smithi043 ceph-mon[111966]: mds.? [v2:172.21.15.43:6826/441584552,v1:172.21.15.43:6827/441584552] up:active 2023-12-08T20:25:46.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:46 smithi043 ceph-mon[111966]: fsmap cephfs:1 {0=cephfs.smithi043.pjmszb=up:active} 2023-12-08T20:25:46.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:46 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:46.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:46 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:46.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:46 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:46.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:46 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi043.akrjef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-08T20:25:46.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:46 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi043.akrjef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-08T20:25:46.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:46 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:25:46.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:46 smithi043 ceph-mon[111966]: Deploying daemon mds.cephfs.smithi043.akrjef on smithi043 2023-12-08T20:25:46.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:46 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/4230801410' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-12-08T20:25:46.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:46 smithi111 ceph-mon[121341]: pgmap v136: 65 pgs: 14 creating+peering, 43 active+clean, 8 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:25:46.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:46 smithi111 ceph-mon[121341]: mds.? [v2:172.21.15.43:6826/441584552,v1:172.21.15.43:6827/441584552] up:active 2023-12-08T20:25:46.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:46 smithi111 ceph-mon[121341]: fsmap cephfs:1 {0=cephfs.smithi043.pjmszb=up:active} 2023-12-08T20:25:46.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:46 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:46.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:46 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:46.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:46 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:46.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:46 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi043.akrjef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-08T20:25:46.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:46 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi043.akrjef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-08T20:25:46.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:46 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:25:46.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:46 smithi111 ceph-mon[121341]: Deploying daemon mds.cephfs.smithi043.akrjef on smithi043 2023-12-08T20:25:46.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:46 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/4230801410' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-12-08T20:25:47.286 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-08T20:25:47.296 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi043.front.sepia.ceph.com 2023-12-08T20:25:47.296 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2023-12-08T20:25:47.828 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:47 smithi043 ceph-mon[111966]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-08T20:25:47.828 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:47 smithi043 ceph-mon[111966]: mds.? [v2:172.21.15.111:6824/1990395192,v1:172.21.15.111:6825/1990395192] up:boot 2023-12-08T20:25:47.828 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:47 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/4230801410' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2023-12-08T20:25:47.828 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:47 smithi043 ceph-mon[111966]: daemon mds.cephfs.smithi111.veeegc assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-08T20:25:47.828 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:47 smithi043 ceph-mon[111966]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-12-08T20:25:47.828 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:47 smithi043 ceph-mon[111966]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-08T20:25:47.828 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:47 smithi043 ceph-mon[111966]: fsmap cephfs:1 {0=cephfs.smithi043.pjmszb=up:active} 1 up:standby 2023-12-08T20:25:47.828 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:47 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.veeegc"}]: dispatch 2023-12-08T20:25:47.828 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:47 smithi043 ceph-mon[111966]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:creating} 2023-12-08T20:25:47.828 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:47 smithi043 ceph-mon[111966]: daemon mds.cephfs.smithi111.veeegc is now active in filesystem cephfs as rank 1 2023-12-08T20:25:47.884 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:47.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:47 smithi111 ceph-mon[121341]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-08T20:25:47.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:47 smithi111 ceph-mon[121341]: mds.? [v2:172.21.15.111:6824/1990395192,v1:172.21.15.111:6825/1990395192] up:boot 2023-12-08T20:25:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:47 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/4230801410' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2023-12-08T20:25:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:47 smithi111 ceph-mon[121341]: daemon mds.cephfs.smithi111.veeegc assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-08T20:25:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:47 smithi111 ceph-mon[121341]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-12-08T20:25:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:47 smithi111 ceph-mon[121341]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-08T20:25:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:47 smithi111 ceph-mon[121341]: fsmap cephfs:1 {0=cephfs.smithi043.pjmszb=up:active} 1 up:standby 2023-12-08T20:25:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:47 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.veeegc"}]: dispatch 2023-12-08T20:25:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:47 smithi111 ceph-mon[121341]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:creating} 2023-12-08T20:25:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:47 smithi111 ceph-mon[121341]: daemon mds.cephfs.smithi111.veeegc is now active in filesystem cephfs as rank 1 2023-12-08T20:25:48.672 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:48 smithi111 ceph-mon[121341]: pgmap v137: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 517 B/s wr, 4 op/s 2023-12-08T20:25:48.672 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:48 smithi111 ceph-mon[121341]: mds.? [v2:172.21.15.111:6824/1990395192,v1:172.21.15.111:6825/1990395192] up:active 2023-12-08T20:25:48.672 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:48 smithi111 ceph-mon[121341]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2023-12-08T20:25:48.672 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:48 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:48.673 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:48 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:48.673 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:48 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:48.673 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:48 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.svpasm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-08T20:25:48.673 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:48 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.svpasm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-08T20:25:48.673 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:48 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:25:48.673 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:48 smithi111 ceph-mon[121341]: Deploying daemon mds.cephfs.smithi111.svpasm on smithi111 2023-12-08T20:25:48.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:48 smithi043 ceph-mon[111966]: pgmap v137: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 517 B/s wr, 4 op/s 2023-12-08T20:25:48.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:48 smithi043 ceph-mon[111966]: mds.? [v2:172.21.15.111:6824/1990395192,v1:172.21.15.111:6825/1990395192] up:active 2023-12-08T20:25:48.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:48 smithi043 ceph-mon[111966]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2023-12-08T20:25:48.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:48 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:48.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:48 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:48.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:48 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:48.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:48 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.svpasm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-08T20:25:48.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:48 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.svpasm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-08T20:25:48.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:48 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:25:48.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:48 smithi043 ceph-mon[111966]: Deploying daemon mds.cephfs.smithi111.svpasm on smithi111 2023-12-08T20:25:48.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.930+0000 7f87b620a700 1 -- 172.21.15.43:0/1057539573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87b0066090 msgr2=0x7f87b0101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:48.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.930+0000 7f87b620a700 1 --2- 172.21.15.43:0/1057539573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87b0066090 0x7f87b0101ba0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f87a0004940 tx=0x7f87a0009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:48.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.930+0000 7f87b620a700 1 -- 172.21.15.43:0/1057539573 shutdown_connections 2023-12-08T20:25:48.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.930+0000 7f87b620a700 1 --2- 172.21.15.43:0/1057539573 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87b01020e0 0x7f87b01044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:48.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.930+0000 7f87b620a700 1 --2- 172.21.15.43:0/1057539573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87b0066090 0x7f87b0101ba0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:48.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.930+0000 7f87b620a700 1 -- 172.21.15.43:0/1057539573 >> 172.21.15.43:0/1057539573 conn(0x7f87b00f7190 msgr2=0x7f87b00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:48.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.930+0000 7f87b620a700 1 -- 172.21.15.43:0/1057539573 shutdown_connections 2023-12-08T20:25:48.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.930+0000 7f87b620a700 1 -- 172.21.15.43:0/1057539573 wait complete. 2023-12-08T20:25:48.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.931+0000 7f87b620a700 1 Processor -- start 2023-12-08T20:25:48.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.931+0000 7f87b620a700 1 -- start start 2023-12-08T20:25:48.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.931+0000 7f87b620a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87b0066090 0x7f87b010f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:48.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.931+0000 7f87b620a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87b01020e0 0x7f87b010fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:48.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.931+0000 7f87b620a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b01102d0 con 0x7f87b0066090 2023-12-08T20:25:48.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.931+0000 7f87b620a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b0110b70 con 0x7f87b01020e0 2023-12-08T20:25:48.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.931+0000 7f87af7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87b0066090 0x7f87b010f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:48.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.931+0000 7f87af7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87b0066090 0x7f87b010f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53016/0 (socket says 172.21.15.43:53016) 2023-12-08T20:25:48.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.931+0000 7f87af7fe700 1 -- 172.21.15.43:0/2747602721 learned_addr learned my addr 172.21.15.43:0/2747602721 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:48.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.931+0000 7f87aeffd700 1 --2- 172.21.15.43:0/2747602721 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87b01020e0 0x7f87b010fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:48.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.932+0000 7f87af7fe700 1 -- 172.21.15.43:0/2747602721 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87b01020e0 msgr2=0x7f87b010fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:48.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.932+0000 7f87af7fe700 1 --2- 172.21.15.43:0/2747602721 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87b01020e0 0x7f87b010fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:48.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.932+0000 7f87af7fe700 1 -- 172.21.15.43:0/2747602721 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a0005040 con 0x7f87b0066090 2023-12-08T20:25:48.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.932+0000 7f87af7fe700 1 --2- 172.21.15.43:0/2747602721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87b0066090 0x7f87b010f790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f87a0009360 tx=0x7f87a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:48.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.932+0000 7f87a7fff700 1 -- 172.21.15.43:0/2747602721 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87a000e040 con 0x7f87b0066090 2023-12-08T20:25:48.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.932+0000 7f87b620a700 1 -- 172.21.15.43:0/2747602721 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b0110df0 con 0x7f87b0066090 2023-12-08T20:25:48.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.932+0000 7f87a7fff700 1 -- 172.21.15.43:0/2747602721 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f87a000bc50 con 0x7f87b0066090 2023-12-08T20:25:48.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.932+0000 7f87a7fff700 1 -- 172.21.15.43:0/2747602721 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87a001c3f0 con 0x7f87b0066090 2023-12-08T20:25:48.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.932+0000 7f87b620a700 1 -- 172.21.15.43:0/2747602721 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b0111330 con 0x7f87b0066090 2023-12-08T20:25:48.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.933+0000 7f87b620a700 1 -- 172.21.15.43:0/2747602721 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b01097e0 con 0x7f87b0066090 2023-12-08T20:25:48.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.934+0000 7f87a7fff700 1 -- 172.21.15.43:0/2747602721 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f87a0013420 con 0x7f87b0066090 2023-12-08T20:25:48.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.934+0000 7f87a7fff700 1 --2- 172.21.15.43:0/2747602721 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f879c068f60 0x7f879c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:48.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.934+0000 7f87a7fff700 1 -- 172.21.15.43:0/2747602721 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f87a0088110 con 0x7f87b0066090 2023-12-08T20:25:48.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.934+0000 7f87aeffd700 1 --2- 172.21.15.43:0/2747602721 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f879c068f60 0x7f879c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:48.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.935+0000 7f87aeffd700 1 --2- 172.21.15.43:0/2747602721 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f879c068f60 0x7f879c06b410 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f87b0065dd0 tx=0x7f879800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:48.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:48.939+0000 7f87a7fff700 1 -- 172.21.15.43:0/2747602721 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f87a0057ff0 con 0x7f87b0066090 2023-12-08T20:25:49.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:49.184+0000 7f87b620a700 1 -- 172.21.15.43:0/2747602721 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f87b004bb80 con 0x7f87b0066090 2023-12-08T20:25:49.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:49.592+0000 7f87a7fff700 1 -- 172.21.15.43:0/2747602721 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f87a0057b80 con 0x7f87b0066090 2023-12-08T20:25:49.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:49.595+0000 7f87b620a700 1 -- 172.21.15.43:0/2747602721 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f879c068f60 msgr2=0x7f879c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:49.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:49.595+0000 7f87b620a700 1 --2- 172.21.15.43:0/2747602721 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f879c068f60 0x7f879c06b410 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f87b0065dd0 tx=0x7f879800b040 comp rx=0 tx=0).stop 2023-12-08T20:25:49.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:49.595+0000 7f87b620a700 1 -- 172.21.15.43:0/2747602721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87b0066090 msgr2=0x7f87b010f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:49.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:49.595+0000 7f87b620a700 1 --2- 172.21.15.43:0/2747602721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87b0066090 0x7f87b010f790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f87a0009360 tx=0x7f87a0009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:49.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:49.595+0000 7f87b620a700 1 -- 172.21.15.43:0/2747602721 shutdown_connections 2023-12-08T20:25:49.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:49.595+0000 7f87b620a700 1 --2- 172.21.15.43:0/2747602721 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f879c068f60 0x7f879c06b410 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:49.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:49.595+0000 7f87b620a700 1 --2- 172.21.15.43:0/2747602721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87b0066090 0x7f87b010f790 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:49.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:49.595+0000 7f87b620a700 1 --2- 172.21.15.43:0/2747602721 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87b01020e0 0x7f87b010fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:49.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:49.595+0000 7f87b620a700 1 -- 172.21.15.43:0/2747602721 >> 172.21.15.43:0/2747602721 conn(0x7f87b00f7190 msgr2=0x7f87b00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:49.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:49.595+0000 7f87b620a700 1 -- 172.21.15.43:0/2747602721 shutdown_connections 2023-12-08T20:25:49.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:49.595+0000 7f87b620a700 1 -- 172.21.15.43:0/2747602721 wait complete. 2023-12-08T20:25:49.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:49 smithi111 ceph-mon[121341]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-12-08T20:25:49.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:49 smithi111 ceph-mon[121341]: Cluster is now healthy 2023-12-08T20:25:49.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:49 smithi111 ceph-mon[121341]: mds.? [v2:172.21.15.43:6828/2926918083,v1:172.21.15.43:6829/2926918083] up:boot 2023-12-08T20:25:49.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:49 smithi111 ceph-mon[121341]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 1 up:standby 2023-12-08T20:25:49.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:49 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi043.akrjef"}]: dispatch 2023-12-08T20:25:49.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:49 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/2747602721' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-08T20:25:49.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:49 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:25:49.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:49 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:49.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:49 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:49.996 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:49 smithi043 ceph-mon[111966]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-12-08T20:25:49.996 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:49 smithi043 ceph-mon[111966]: Cluster is now healthy 2023-12-08T20:25:49.996 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:49 smithi043 ceph-mon[111966]: mds.? [v2:172.21.15.43:6828/2926918083,v1:172.21.15.43:6829/2926918083] up:boot 2023-12-08T20:25:49.997 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:49 smithi043 ceph-mon[111966]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 1 up:standby 2023-12-08T20:25:49.997 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:49 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi043.akrjef"}]: dispatch 2023-12-08T20:25:49.997 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:49 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/2747602721' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-08T20:25:49.997 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:49 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:25:49.997 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:49 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:49.997 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:49 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:50.022 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-08T20:25:50.033 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi043.front.sepia.ceph.com 2023-12-08T20:25:50.034 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2023-12-08T20:25:50.403 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:50.703 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:50 smithi111 ceph-mon[121341]: pgmap v138: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s wr, 8 op/s 2023-12-08T20:25:50.703 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:50 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:50.703 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:50 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:50.703 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:50 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/2747602721' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-08T20:25:50.703 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:50 smithi111 ceph-mon[121341]: mds.? [v2:172.21.15.111:6826/2885759138,v1:172.21.15.111:6827/2885759138] up:boot 2023-12-08T20:25:50.703 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:50 smithi111 ceph-mon[121341]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:25:50.703 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:50 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.svpasm"}]: dispatch 2023-12-08T20:25:50.703 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:50 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:50.703 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:50 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:25:50.718 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:50 smithi043 ceph-mon[111966]: pgmap v138: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s wr, 8 op/s 2023-12-08T20:25:50.719 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:50 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:50.719 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:50 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:50.719 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:50 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/2747602721' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-08T20:25:50.719 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:50 smithi043 ceph-mon[111966]: mds.? [v2:172.21.15.111:6826/2885759138,v1:172.21.15.111:6827/2885759138] up:boot 2023-12-08T20:25:50.719 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:50 smithi043 ceph-mon[111966]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:25:50.719 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:50 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.svpasm"}]: dispatch 2023-12-08T20:25:50.719 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:50 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:50.719 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:50 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:25:52.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.046+0000 7ff21116a700 1 -- 172.21.15.43:0/4063601026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff20c0fbaf0 msgr2=0x7ff20c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:52.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.046+0000 7ff21116a700 1 --2- 172.21.15.43:0/4063601026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff20c0fbaf0 0x7ff20c0fbf00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009ce0 tx=0x7ff1fc004d10 comp rx=0 tx=0).stop 2023-12-08T20:25:52.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.046+0000 7ff21116a700 1 -- 172.21.15.43:0/4063601026 shutdown_connections 2023-12-08T20:25:52.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.046+0000 7ff21116a700 1 --2- 172.21.15.43:0/4063601026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff20c0fcd00 0x7ff20c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:52.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.046+0000 7ff21116a700 1 --2- 172.21.15.43:0/4063601026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff20c0fbaf0 0x7ff20c0fbf00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:52.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.046+0000 7ff21116a700 1 -- 172.21.15.43:0/4063601026 >> 172.21.15.43:0/4063601026 conn(0x7ff20c0f7190 msgr2=0x7ff20c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:52.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.046+0000 7ff21116a700 1 -- 172.21.15.43:0/4063601026 shutdown_connections 2023-12-08T20:25:52.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.046+0000 7ff21116a700 1 -- 172.21.15.43:0/4063601026 wait complete. 2023-12-08T20:25:52.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.047+0000 7ff21116a700 1 Processor -- start 2023-12-08T20:25:52.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.047+0000 7ff21116a700 1 -- start start 2023-12-08T20:25:52.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.047+0000 7ff21116a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff20c0fbaf0 0x7ff20c1126a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:52.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.047+0000 7ff21116a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff20c0fcd00 0x7ff20c114bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:52.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.047+0000 7ff21116a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c066000 con 0x7ff20c0fbaf0 2023-12-08T20:25:52.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.047+0000 7ff21116a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c066140 con 0x7ff20c0fcd00 2023-12-08T20:25:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.047+0000 7ff20ad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff20c0fbaf0 0x7ff20c1126a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.047+0000 7ff20ad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff20c0fbaf0 0x7ff20c1126a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43572/0 (socket says 172.21.15.43:43572) 2023-12-08T20:25:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.047+0000 7ff20ad9d700 1 -- 172.21.15.43:0/501567022 learned_addr learned my addr 172.21.15.43:0/501567022 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.047+0000 7ff20a59c700 1 --2- 172.21.15.43:0/501567022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff20c0fcd00 0x7ff20c114bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.048+0000 7ff20ad9d700 1 -- 172.21.15.43:0/501567022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff20c0fcd00 msgr2=0x7ff20c114bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.048+0000 7ff20ad9d700 1 --2- 172.21.15.43:0/501567022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff20c0fcd00 0x7ff20c114bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.048+0000 7ff20ad9d700 1 -- 172.21.15.43:0/501567022 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc009940 con 0x7ff20c0fbaf0 2023-12-08T20:25:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.048+0000 7ff20ad9d700 1 --2- 172.21.15.43:0/501567022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff20c0fbaf0 0x7ff20c1126a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc004740 tx=0x7ff1fc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.048+0000 7ff2037fe700 1 -- 172.21.15.43:0/501567022 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1fc00e040 con 0x7ff20c0fbaf0 2023-12-08T20:25:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.048+0000 7ff21116a700 1 -- 172.21.15.43:0/501567022 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff20c115130 con 0x7ff20c0fbaf0 2023-12-08T20:25:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.048+0000 7ff2037fe700 1 -- 172.21.15.43:0/501567022 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff1fc01cce0 con 0x7ff20c0fbaf0 2023-12-08T20:25:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.048+0000 7ff2037fe700 1 -- 172.21.15.43:0/501567022 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1fc012c20 con 0x7ff20c0fbaf0 2023-12-08T20:25:52.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.048+0000 7ff21116a700 1 -- 172.21.15.43:0/501567022 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20c1154d0 con 0x7ff20c0fbaf0 2023-12-08T20:25:52.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.049+0000 7ff21116a700 1 -- 172.21.15.43:0/501567022 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20c04bb80 con 0x7ff20c0fbaf0 2023-12-08T20:25:52.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.050+0000 7ff2037fe700 1 -- 172.21.15.43:0/501567022 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff1fc012410 con 0x7ff20c0fbaf0 2023-12-08T20:25:52.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.050+0000 7ff2037fe700 1 --2- 172.21.15.43:0/501567022 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff1f8068f60 0x7ff1f806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:52.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.050+0000 7ff2037fe700 1 -- 172.21.15.43:0/501567022 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff1fc0890a0 con 0x7ff20c0fbaf0 2023-12-08T20:25:52.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.050+0000 7ff20a59c700 1 --2- 172.21.15.43:0/501567022 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff1f8068f60 0x7ff1f806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:52.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.051+0000 7ff20a59c700 1 --2- 172.21.15.43:0/501567022 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff1f8068f60 0x7ff1f806b410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4009b80 tx=0x7ff1f400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:52.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.055+0000 7ff2037fe700 1 -- 172.21.15.43:0/501567022 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff1fc0554f0 con 0x7ff20c0fbaf0 2023-12-08T20:25:52.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.337+0000 7ff21116a700 1 -- 172.21.15.43:0/501567022 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7ff20c104490 con 0x7ff20c0fbaf0 2023-12-08T20:25:52.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:52 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:52.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:52 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:52.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:52 smithi111 ceph-mon[121341]: pgmap v139: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s wr, 9 op/s 2023-12-08T20:25:52.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:52 smithi111 ceph-mon[121341]: mds.? [v2:172.21.15.111:6824/1990395192,v1:172.21.15.111:6825/1990395192] up:active 2023-12-08T20:25:52.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:52 smithi111 ceph-mon[121341]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:25:52.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:52 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:52.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:52 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:52.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:52 smithi043 ceph-mon[111966]: pgmap v139: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s wr, 9 op/s 2023-12-08T20:25:52.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:52 smithi043 ceph-mon[111966]: mds.? [v2:172.21.15.111:6824/1990395192,v1:172.21.15.111:6825/1990395192] up:active 2023-12-08T20:25:52.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:52 smithi043 ceph-mon[111966]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:25:52.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.584+0000 7ff2037fe700 1 -- 172.21.15.43:0/501567022 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7ff1fc058b10 con 0x7ff20c0fbaf0 2023-12-08T20:25:52.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.587+0000 7ff21116a700 1 -- 172.21.15.43:0/501567022 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff1f8068f60 msgr2=0x7ff1f806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:52.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.587+0000 7ff21116a700 1 --2- 172.21.15.43:0/501567022 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff1f8068f60 0x7ff1f806b410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4009b80 tx=0x7ff1f400b040 comp rx=0 tx=0).stop 2023-12-08T20:25:52.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.587+0000 7ff21116a700 1 -- 172.21.15.43:0/501567022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff20c0fbaf0 msgr2=0x7ff20c1126a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:52.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.587+0000 7ff21116a700 1 --2- 172.21.15.43:0/501567022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff20c0fbaf0 0x7ff20c1126a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc004740 tx=0x7ff1fc004d10 comp rx=0 tx=0).stop 2023-12-08T20:25:52.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.587+0000 7ff21116a700 1 -- 172.21.15.43:0/501567022 shutdown_connections 2023-12-08T20:25:52.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.587+0000 7ff21116a700 1 --2- 172.21.15.43:0/501567022 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff1f8068f60 0x7ff1f806b410 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:52.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.587+0000 7ff21116a700 1 --2- 172.21.15.43:0/501567022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff20c0fbaf0 0x7ff20c1126a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:52.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.587+0000 7ff21116a700 1 --2- 172.21.15.43:0/501567022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff20c0fcd00 0x7ff20c114bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:52.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.587+0000 7ff21116a700 1 -- 172.21.15.43:0/501567022 >> 172.21.15.43:0/501567022 conn(0x7ff20c0f7190 msgr2=0x7ff20c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:52.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.587+0000 7ff21116a700 1 -- 172.21.15.43:0/501567022 shutdown_connections 2023-12-08T20:25:52.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:52.587+0000 7ff21116a700 1 -- 172.21.15.43:0/501567022 wait complete. 2023-12-08T20:25:52.588 INFO:teuthology.orchestra.run.smithi043.stderr:inline data disabled 2023-12-08T20:25:53.103 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-08T20:25:53.113 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi043.front.sepia.ceph.com 2023-12-08T20:25:53.113 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-08T20:25:53.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:53 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/501567022' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-08T20:25:53.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:53 smithi111 ceph-mon[121341]: mds.? [v2:172.21.15.43:6828/2926918083,v1:172.21.15.43:6829/2926918083] up:standby 2023-12-08T20:25:53.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:53 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/501567022' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2023-12-08T20:25:53.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:53 smithi111 ceph-mon[121341]: mds.? [v2:172.21.15.43:6826/441584552,v1:172.21.15.43:6827/441584552] up:active 2023-12-08T20:25:53.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:53 smithi111 ceph-mon[121341]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:25:53.483 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:53.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:53 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/501567022' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-08T20:25:53.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:53 smithi043 ceph-mon[111966]: mds.? [v2:172.21.15.43:6828/2926918083,v1:172.21.15.43:6829/2926918083] up:standby 2023-12-08T20:25:53.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:53 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/501567022' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2023-12-08T20:25:53.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:53 smithi043 ceph-mon[111966]: mds.? [v2:172.21.15.43:6826/441584552,v1:172.21.15.43:6827/441584552] up:active 2023-12-08T20:25:53.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:53 smithi043 ceph-mon[111966]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:25:54.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.565+0000 7f28ca2e6700 1 -- 172.21.15.43:0/3771945319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28c40fd730 msgr2=0x7f28c40ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:54.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.565+0000 7f28ca2e6700 1 --2- 172.21.15.43:0/3771945319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28c40fd730 0x7f28c40ffb10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f28b4004940 tx=0x7f28b4009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:54.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.565+0000 7f28ca2e6700 1 -- 172.21.15.43:0/3771945319 shutdown_connections 2023-12-08T20:25:54.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.565+0000 7f28ca2e6700 1 --2- 172.21.15.43:0/3771945319 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28c4100050 0x7f28c4102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:54.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.565+0000 7f28ca2e6700 1 --2- 172.21.15.43:0/3771945319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28c40fd730 0x7f28c40ffb10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:54.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.565+0000 7f28ca2e6700 1 -- 172.21.15.43:0/3771945319 >> 172.21.15.43:0/3771945319 conn(0x7f28c40f7190 msgr2=0x7f28c40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:54.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.565+0000 7f28ca2e6700 1 -- 172.21.15.43:0/3771945319 shutdown_connections 2023-12-08T20:25:54.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.565+0000 7f28ca2e6700 1 -- 172.21.15.43:0/3771945319 wait complete. 2023-12-08T20:25:54.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.565+0000 7f28ca2e6700 1 Processor -- start 2023-12-08T20:25:54.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.566+0000 7f28ca2e6700 1 -- start start 2023-12-08T20:25:54.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.566+0000 7f28ca2e6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28c40fd730 0x7f28c410d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:54.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.566+0000 7f28ca2e6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28c4100050 0x7f28c410da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:54.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.566+0000 7f28ca2e6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c410e000 con 0x7f28c40fd730 2023-12-08T20:25:54.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.566+0000 7f28ca2e6700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c410e8a0 con 0x7f28c4100050 2023-12-08T20:25:54.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.566+0000 7f28c3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28c40fd730 0x7f28c410d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:54.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.566+0000 7f28c3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28c40fd730 0x7f28c410d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43590/0 (socket says 172.21.15.43:43590) 2023-12-08T20:25:54.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.566+0000 7f28c3fff700 1 -- 172.21.15.43:0/3288678916 learned_addr learned my addr 172.21.15.43:0/3288678916 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:54.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.566+0000 7f28c37fe700 1 --2- 172.21.15.43:0/3288678916 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28c4100050 0x7f28c410da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:54.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.566+0000 7f28c3fff700 1 -- 172.21.15.43:0/3288678916 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28c4100050 msgr2=0x7f28c410da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:54.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.566+0000 7f28c3fff700 1 --2- 172.21.15.43:0/3288678916 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28c4100050 0x7f28c410da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:54.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.566+0000 7f28c3fff700 1 -- 172.21.15.43:0/3288678916 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b4005040 con 0x7f28c40fd730 2023-12-08T20:25:54.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.566+0000 7f28c3fff700 1 --2- 172.21.15.43:0/3288678916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28c40fd730 0x7f28c410d4c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f28b4008f90 tx=0x7f28b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:54.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.567+0000 7f28c0ff9700 1 -- 172.21.15.43:0/3288678916 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28b4021070 con 0x7f28c40fd730 2023-12-08T20:25:54.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.567+0000 7f28c0ff9700 1 -- 172.21.15.43:0/3288678916 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f28b401c400 con 0x7f28c40fd730 2023-12-08T20:25:54.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.567+0000 7f28ca2e6700 1 -- 172.21.15.43:0/3288678916 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c410eb20 con 0x7f28c40fd730 2023-12-08T20:25:54.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.567+0000 7f28c0ff9700 1 -- 172.21.15.43:0/3288678916 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28b400e030 con 0x7f28c40fd730 2023-12-08T20:25:54.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.567+0000 7f28ca2e6700 1 -- 172.21.15.43:0/3288678916 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c410f060 con 0x7f28c40fd730 2023-12-08T20:25:54.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.568+0000 7f28ca2e6700 1 -- 172.21.15.43:0/3288678916 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c404bb80 con 0x7f28c40fd730 2023-12-08T20:25:54.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.569+0000 7f28c0ff9700 1 -- 172.21.15.43:0/3288678916 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f28b401ca00 con 0x7f28c40fd730 2023-12-08T20:25:54.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.569+0000 7f28c0ff9700 1 --2- 172.21.15.43:0/3288678916 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f28ac068f70 0x7f28ac06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:54.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.569+0000 7f28c0ff9700 1 -- 172.21.15.43:0/3288678916 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f28b4087f80 con 0x7f28c40fd730 2023-12-08T20:25:54.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.569+0000 7f28c37fe700 1 --2- 172.21.15.43:0/3288678916 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f28ac068f70 0x7f28ac06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:54.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.570+0000 7f28c37fe700 1 --2- 172.21.15.43:0/3288678916 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f28ac068f70 0x7f28ac06b420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f28b8009b80 tx=0x7f28b800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:54.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.574+0000 7f28c0ff9700 1 -- 172.21.15.43:0/3288678916 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f28b4057f80 con 0x7f28c40fd730 2023-12-08T20:25:54.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.826+0000 7f28ca2e6700 1 -- 172.21.15.43:0/3288678916 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f28c410f620 con 0x7f28c40fd730 2023-12-08T20:25:54.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.826+0000 7f28c0ff9700 1 -- 172.21.15.43:0/3288678916 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1817 (secure 0 0 0) 0x7f28b4057b10 con 0x7f28c40fd730 2023-12-08T20:25:54.827 INFO:teuthology.orchestra.run.smithi043.stdout:e13 2023-12-08T20:25:54.828 INFO:teuthology.orchestra.run.smithi043.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-08T20:25:54.828 INFO:teuthology.orchestra.run.smithi043.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:25:54.828 INFO:teuthology.orchestra.run.smithi043.stdout:legacy client fscid: 1 2023-12-08T20:25:54.828 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:25:54.828 INFO:teuthology.orchestra.run.smithi043.stdout:Filesystem 'cephfs' (1) 2023-12-08T20:25:54.828 INFO:teuthology.orchestra.run.smithi043.stdout:fs_name cephfs 2023-12-08T20:25:54.828 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 12 2023-12-08T20:25:54.828 INFO:teuthology.orchestra.run.smithi043.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-08T20:25:54.828 INFO:teuthology.orchestra.run.smithi043.stdout:created 2023-12-08T20:25:41.527734+0000 2023-12-08T20:25:54.828 INFO:teuthology.orchestra.run.smithi043.stdout:modified 2023-12-08T20:25:52.581820+0000 2023-12-08T20:25:54.828 INFO:teuthology.orchestra.run.smithi043.stdout:tableserver 0 2023-12-08T20:25:54.828 INFO:teuthology.orchestra.run.smithi043.stdout:root 0 2023-12-08T20:25:54.828 INFO:teuthology.orchestra.run.smithi043.stdout:session_timeout 60 2023-12-08T20:25:54.828 INFO:teuthology.orchestra.run.smithi043.stdout:session_autoclose 300 2023-12-08T20:25:54.828 INFO:teuthology.orchestra.run.smithi043.stdout:max_file_size 1099511627776 2023-12-08T20:25:54.829 INFO:teuthology.orchestra.run.smithi043.stdout:required_client_features {} 2023-12-08T20:25:54.829 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure 0 2023-12-08T20:25:54.829 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure_osd_epoch 0 2023-12-08T20:25:54.829 INFO:teuthology.orchestra.run.smithi043.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:25:54.829 INFO:teuthology.orchestra.run.smithi043.stdout:max_mds 2 2023-12-08T20:25:54.829 INFO:teuthology.orchestra.run.smithi043.stdout:in 0,1 2023-12-08T20:25:54.829 INFO:teuthology.orchestra.run.smithi043.stdout:up {0=14452,1=24315} 2023-12-08T20:25:54.829 INFO:teuthology.orchestra.run.smithi043.stdout:failed 2023-12-08T20:25:54.829 INFO:teuthology.orchestra.run.smithi043.stdout:damaged 2023-12-08T20:25:54.829 INFO:teuthology.orchestra.run.smithi043.stdout:stopped 2023-12-08T20:25:54.829 INFO:teuthology.orchestra.run.smithi043.stdout:data_pools [3] 2023-12-08T20:25:54.829 INFO:teuthology.orchestra.run.smithi043.stdout:metadata_pool 2 2023-12-08T20:25:54.830 INFO:teuthology.orchestra.run.smithi043.stdout:inline_data disabled 2023-12-08T20:25:54.830 INFO:teuthology.orchestra.run.smithi043.stdout:balancer 2023-12-08T20:25:54.830 INFO:teuthology.orchestra.run.smithi043.stdout:standby_count_wanted 1 2023-12-08T20:25:54.830 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi043.pjmszb{0:14452} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.43:6826/441584552,v1:172.21.15.43:6827/441584552] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:25:54.830 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi111.veeegc{1:24315} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.111:6824/1990395192,v1:172.21.15.111:6825/1990395192] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:25:54.830 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:25:54.830 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:25:54.830 INFO:teuthology.orchestra.run.smithi043.stdout:Standby daemons: 2023-12-08T20:25:54.830 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:25:54.830 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi043.akrjef{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.43:6828/2926918083,v1:172.21.15.43:6829/2926918083] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:25:54.830 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi111.svpasm{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6826/2885759138,v1:172.21.15.111:6827/2885759138] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:25:54.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.830+0000 7f28ca2e6700 1 -- 172.21.15.43:0/3288678916 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f28ac068f70 msgr2=0x7f28ac06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:54.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.830+0000 7f28ca2e6700 1 --2- 172.21.15.43:0/3288678916 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f28ac068f70 0x7f28ac06b420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f28b8009b80 tx=0x7f28b800b040 comp rx=0 tx=0).stop 2023-12-08T20:25:54.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.830+0000 7f28ca2e6700 1 -- 172.21.15.43:0/3288678916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28c40fd730 msgr2=0x7f28c410d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:54.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.830+0000 7f28ca2e6700 1 --2- 172.21.15.43:0/3288678916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28c40fd730 0x7f28c410d4c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f28b4008f90 tx=0x7f28b4009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:54.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.830+0000 7f28ca2e6700 1 -- 172.21.15.43:0/3288678916 shutdown_connections 2023-12-08T20:25:54.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.830+0000 7f28ca2e6700 1 --2- 172.21.15.43:0/3288678916 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f28ac068f70 0x7f28ac06b420 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:54.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.830+0000 7f28ca2e6700 1 --2- 172.21.15.43:0/3288678916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28c40fd730 0x7f28c410d4c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:54.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.830+0000 7f28ca2e6700 1 --2- 172.21.15.43:0/3288678916 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28c4100050 0x7f28c410da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:54.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.830+0000 7f28ca2e6700 1 -- 172.21.15.43:0/3288678916 >> 172.21.15.43:0/3288678916 conn(0x7f28c40f7190 msgr2=0x7f28c40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:54.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.831+0000 7f28ca2e6700 1 -- 172.21.15.43:0/3288678916 shutdown_connections 2023-12-08T20:25:54.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:54.831+0000 7f28ca2e6700 1 -- 172.21.15.43:0/3288678916 wait complete. 2023-12-08T20:25:54.832 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 13 2023-12-08T20:25:54.864 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:54 smithi043 ceph-mon[111966]: pgmap v140: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2023-12-08T20:25:54.864 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:54 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:54.864 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:54 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:54.864 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:54 smithi043 ceph-mon[111966]: mds.? [v2:172.21.15.111:6826/2885759138,v1:172.21.15.111:6827/2885759138] up:standby 2023-12-08T20:25:54.864 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:54 smithi043 ceph-mon[111966]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:25:54.864 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:54 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:25:54.864 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:54 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:25:54.865 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:54 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:54.865 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:54 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:54.865 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:54 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:25:54.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:54 smithi111 ceph-mon[121341]: pgmap v140: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2023-12-08T20:25:54.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:54 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:54.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:54 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:54.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:54 smithi111 ceph-mon[121341]: mds.? [v2:172.21.15.111:6826/2885759138,v1:172.21.15.111:6827/2885759138] up:standby 2023-12-08T20:25:54.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:54 smithi111 ceph-mon[121341]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:25:54.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:54 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:25:54.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:54 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:25:54.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:54 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:54.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:54 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:54.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:54 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:25:55.280 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2023-12-08T20:25:55.690 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:55.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:55 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/3288678916' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-08T20:25:55.967 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:55 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3288678916' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-08T20:25:57.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:56 smithi043 ceph-mon[111966]: pgmap v141: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2023-12-08T20:25:57.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:56 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:57.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:56 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:57.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.352+0000 7fb419334700 1 -- 172.21.15.43:0/1045597289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb414066070 msgr2=0x7fb414101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:57.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.352+0000 7fb419334700 1 --2- 172.21.15.43:0/1045597289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb414066070 0x7fb414101bc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb404004940 tx=0x7fb404009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:57.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.352+0000 7fb419334700 1 -- 172.21.15.43:0/1045597289 shutdown_connections 2023-12-08T20:25:57.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.352+0000 7fb419334700 1 --2- 172.21.15.43:0/1045597289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb414102100 0x7fb4141044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:57.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.352+0000 7fb419334700 1 --2- 172.21.15.43:0/1045597289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb414066070 0x7fb414101bc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:57.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.352+0000 7fb419334700 1 -- 172.21.15.43:0/1045597289 >> 172.21.15.43:0/1045597289 conn(0x7fb4140f7190 msgr2=0x7fb4140f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:57.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.352+0000 7fb419334700 1 -- 172.21.15.43:0/1045597289 shutdown_connections 2023-12-08T20:25:57.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.352+0000 7fb419334700 1 -- 172.21.15.43:0/1045597289 wait complete. 2023-12-08T20:25:57.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.353+0000 7fb419334700 1 Processor -- start 2023-12-08T20:25:57.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.353+0000 7fb419334700 1 -- start start 2023-12-08T20:25:57.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.353+0000 7fb419334700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb414066070 0x7fb41410f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:57.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.353+0000 7fb419334700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb414102100 0x7fb41410fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:57.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.353+0000 7fb419334700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4141102b0 con 0x7fb414102100 2023-12-08T20:25:57.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.353+0000 7fb419334700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb414110b50 con 0x7fb414066070 2023-12-08T20:25:57.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.353+0000 7fb40a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb414102100 0x7fb41410fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:57.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.353+0000 7fb40a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb414102100 0x7fb41410fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43604/0 (socket says 172.21.15.43:43604) 2023-12-08T20:25:57.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.353+0000 7fb40a7fc700 1 -- 172.21.15.43:0/1852470426 learned_addr learned my addr 172.21.15.43:0/1852470426 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:57.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.353+0000 7fb412ffd700 1 --2- 172.21.15.43:0/1852470426 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb414066070 0x7fb41410f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:57.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.354+0000 7fb40a7fc700 1 -- 172.21.15.43:0/1852470426 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb414066070 msgr2=0x7fb41410f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:57.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.354+0000 7fb40a7fc700 1 --2- 172.21.15.43:0/1852470426 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb414066070 0x7fb41410f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:57.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.354+0000 7fb40a7fc700 1 -- 172.21.15.43:0/1852470426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb404005040 con 0x7fb414102100 2023-12-08T20:25:57.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.354+0000 7fb412ffd700 1 --2- 172.21.15.43:0/1852470426 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb414066070 0x7fb41410f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:25:57.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.354+0000 7fb40a7fc700 1 --2- 172.21.15.43:0/1852470426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb414102100 0x7fb41410fcb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00c800 tx=0x7fb3fc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:57.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.354+0000 7fb40bfff700 1 -- 172.21.15.43:0/1852470426 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3fc00a760 con 0x7fb414102100 2023-12-08T20:25:57.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.354+0000 7fb40bfff700 1 -- 172.21.15.43:0/1852470426 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb3fc00ad70 con 0x7fb414102100 2023-12-08T20:25:57.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.354+0000 7fb419334700 1 -- 172.21.15.43:0/1852470426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb414110e30 con 0x7fb414102100 2023-12-08T20:25:57.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.354+0000 7fb40bfff700 1 -- 172.21.15.43:0/1852470426 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3fc0113a0 con 0x7fb414102100 2023-12-08T20:25:57.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.354+0000 7fb419334700 1 -- 172.21.15.43:0/1852470426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb414111370 con 0x7fb414102100 2023-12-08T20:25:57.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.355+0000 7fb419334700 1 -- 172.21.15.43:0/1852470426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4141097f0 con 0x7fb414102100 2023-12-08T20:25:57.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.356+0000 7fb40bfff700 1 -- 172.21.15.43:0/1852470426 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb3fc012400 con 0x7fb414102100 2023-12-08T20:25:57.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.356+0000 7fb40bfff700 1 --2- 172.21.15.43:0/1852470426 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb400068f60 0x7fb40006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:57.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.356+0000 7fb40bfff700 1 -- 172.21.15.43:0/1852470426 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb3fc086de0 con 0x7fb414102100 2023-12-08T20:25:57.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.356+0000 7fb412ffd700 1 --2- 172.21.15.43:0/1852470426 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb400068f60 0x7fb40006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:57.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.357+0000 7fb412ffd700 1 --2- 172.21.15.43:0/1852470426 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb400068f60 0x7fb40006b410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb404004560 tx=0x7fb404009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:57.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.361+0000 7fb40bfff700 1 -- 172.21.15.43:0/1852470426 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb3fc056d40 con 0x7fb414102100 2023-12-08T20:25:57.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:56 smithi111 ceph-mon[121341]: pgmap v141: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2023-12-08T20:25:57.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:56 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:57.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:56 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:25:57.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.621+0000 7fb419334700 1 -- 172.21.15.43:0/1852470426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4141077b0 con 0x7fb414102100 2023-12-08T20:25:57.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.622+0000 7fb40bfff700 1 -- 172.21.15.43:0/1852470426 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4704 (secure 0 0 0) 0x7fb3fc0568d0 con 0x7fb414102100 2023-12-08T20:25:57.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.624+0000 7fb419334700 1 -- 172.21.15.43:0/1852470426 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb400068f60 msgr2=0x7fb40006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:57.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.624+0000 7fb419334700 1 --2- 172.21.15.43:0/1852470426 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb400068f60 0x7fb40006b410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb404004560 tx=0x7fb404009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:57.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.624+0000 7fb419334700 1 -- 172.21.15.43:0/1852470426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb414102100 msgr2=0x7fb41410fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:57.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.624+0000 7fb419334700 1 --2- 172.21.15.43:0/1852470426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb414102100 0x7fb41410fcb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00c800 tx=0x7fb3fc004470 comp rx=0 tx=0).stop 2023-12-08T20:25:57.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.624+0000 7fb419334700 1 -- 172.21.15.43:0/1852470426 shutdown_connections 2023-12-08T20:25:57.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.624+0000 7fb419334700 1 --2- 172.21.15.43:0/1852470426 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fb400068f60 0x7fb40006b410 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:57.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.624+0000 7fb419334700 1 --2- 172.21.15.43:0/1852470426 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb414066070 0x7fb41410f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:57.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.624+0000 7fb419334700 1 --2- 172.21.15.43:0/1852470426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb414102100 0x7fb41410fcb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:57.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.624+0000 7fb419334700 1 -- 172.21.15.43:0/1852470426 >> 172.21.15.43:0/1852470426 conn(0x7fb4140f7190 msgr2=0x7fb4140f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:57.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.624+0000 7fb419334700 1 -- 172.21.15.43:0/1852470426 shutdown_connections 2023-12-08T20:25:57.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:57.624+0000 7fb419334700 1 -- 172.21.15.43:0/1852470426 wait complete. 2023-12-08T20:25:57.626 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 13 2023-12-08T20:25:57.638 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:25:58.138 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2023-12-08T20:25:58.171 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:58 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/1852470426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-08T20:25:58.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:58 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/1852470426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-08T20:25:58.623 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:25:59.006 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:25:59 smithi043 ceph-mon[111966]: pgmap v142: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2023-12-08T20:25:59.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:25:59 smithi111 ceph-mon[121341]: pgmap v142: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2023-12-08T20:25:59.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.748+0000 7fcd96104700 1 -- 172.21.15.43:0/1829157615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd900fd730 msgr2=0x7fcd900ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:59.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.748+0000 7fcd96104700 1 --2- 172.21.15.43:0/1829157615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd900fd730 0x7fcd900ffb10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcd80004940 tx=0x7fcd80009e30 comp rx=0 tx=0).stop 2023-12-08T20:25:59.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.748+0000 7fcd96104700 1 -- 172.21.15.43:0/1829157615 shutdown_connections 2023-12-08T20:25:59.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.748+0000 7fcd96104700 1 --2- 172.21.15.43:0/1829157615 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd90100050 0x7fcd90102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:59.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.748+0000 7fcd96104700 1 --2- 172.21.15.43:0/1829157615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd900fd730 0x7fcd900ffb10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:59.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.748+0000 7fcd96104700 1 -- 172.21.15.43:0/1829157615 >> 172.21.15.43:0/1829157615 conn(0x7fcd900f7190 msgr2=0x7fcd900f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:25:59.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.748+0000 7fcd96104700 1 -- 172.21.15.43:0/1829157615 shutdown_connections 2023-12-08T20:25:59.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.748+0000 7fcd96104700 1 -- 172.21.15.43:0/1829157615 wait complete. 2023-12-08T20:25:59.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.748+0000 7fcd96104700 1 Processor -- start 2023-12-08T20:25:59.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.749+0000 7fcd96104700 1 -- start start 2023-12-08T20:25:59.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.749+0000 7fcd96104700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd900fd730 0x7fcd9010f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:59.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.749+0000 7fcd96104700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd90100050 0x7fcd9010fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:59.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.749+0000 7fcd96104700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd901101d0 con 0x7fcd900fd730 2023-12-08T20:25:59.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.749+0000 7fcd96104700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd90110a70 con 0x7fcd90100050 2023-12-08T20:25:59.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.749+0000 7fcd8f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd900fd730 0x7fcd9010f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:59.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.749+0000 7fcd8f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd900fd730 0x7fcd9010f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43616/0 (socket says 172.21.15.43:43616) 2023-12-08T20:25:59.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.749+0000 7fcd8f7fe700 1 -- 172.21.15.43:0/3684899405 learned_addr learned my addr 172.21.15.43:0/3684899405 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:25:59.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.749+0000 7fcd8effd700 1 --2- 172.21.15.43:0/3684899405 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd90100050 0x7fcd9010fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:59.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.749+0000 7fcd8f7fe700 1 -- 172.21.15.43:0/3684899405 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd90100050 msgr2=0x7fcd9010fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:25:59.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.749+0000 7fcd8f7fe700 1 --2- 172.21.15.43:0/3684899405 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd90100050 0x7fcd9010fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:25:59.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.749+0000 7fcd8f7fe700 1 -- 172.21.15.43:0/3684899405 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd80005040 con 0x7fcd900fd730 2023-12-08T20:25:59.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.749+0000 7fcd8effd700 1 --2- 172.21.15.43:0/3684899405 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd90100050 0x7fcd9010fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:25:59.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.749+0000 7fcd8f7fe700 1 --2- 172.21.15.43:0/3684899405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd900fd730 0x7fcd9010f690 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009380 tx=0x7fcd80009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:59.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.749+0000 7fcd77fff700 1 -- 172.21.15.43:0/3684899405 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd8000e040 con 0x7fcd900fd730 2023-12-08T20:25:59.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.750+0000 7fcd77fff700 1 -- 172.21.15.43:0/3684899405 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcd8000bda0 con 0x7fcd900fd730 2023-12-08T20:25:59.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.750+0000 7fcd96104700 1 -- 172.21.15.43:0/3684899405 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd90110cf0 con 0x7fcd900fd730 2023-12-08T20:25:59.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.750+0000 7fcd77fff700 1 -- 172.21.15.43:0/3684899405 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd8001c630 con 0x7fcd900fd730 2023-12-08T20:25:59.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.750+0000 7fcd96104700 1 -- 172.21.15.43:0/3684899405 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd90111230 con 0x7fcd900fd730 2023-12-08T20:25:59.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.751+0000 7fcd96104700 1 -- 172.21.15.43:0/3684899405 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9004bb80 con 0x7fcd900fd730 2023-12-08T20:25:59.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.751+0000 7fcd77fff700 1 -- 172.21.15.43:0/3684899405 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fcd800139d0 con 0x7fcd900fd730 2023-12-08T20:25:59.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.752+0000 7fcd77fff700 1 --2- 172.21.15.43:0/3684899405 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fcd78068f60 0x7fcd7806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:25:59.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.752+0000 7fcd77fff700 1 -- 172.21.15.43:0/3684899405 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fcd80088210 con 0x7fcd900fd730 2023-12-08T20:25:59.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.752+0000 7fcd8effd700 1 --2- 172.21.15.43:0/3684899405 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fcd78068f60 0x7fcd7806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:25:59.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.752+0000 7fcd8effd700 1 --2- 172.21.15.43:0/3684899405 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fcd78068f60 0x7fcd7806b410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcd84007fd0 tx=0x7fcd84009f60 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:25:59.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:25:59.756+0000 7fcd77fff700 1 -- 172.21.15.43:0/3684899405 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcd80058170 con 0x7fcd900fd730 2023-12-08T20:26:00.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.038+0000 7fcd96104700 1 -- 172.21.15.43:0/3684899405 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fcd90105580 con 0x7fcd900fd730 2023-12-08T20:26:00.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.039+0000 7fcd77fff700 1 -- 172.21.15.43:0/3684899405 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v13) v1 ==== 78+0+99 (secure 0 0 0) 0x7fcd80057d00 con 0x7fcd900fd730 2023-12-08T20:26:00.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.041+0000 7fcd96104700 1 -- 172.21.15.43:0/3684899405 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fcd78068f60 msgr2=0x7fcd7806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:00.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.041+0000 7fcd96104700 1 --2- 172.21.15.43:0/3684899405 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fcd78068f60 0x7fcd7806b410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcd84007fd0 tx=0x7fcd84009f60 comp rx=0 tx=0).stop 2023-12-08T20:26:00.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.041+0000 7fcd96104700 1 -- 172.21.15.43:0/3684899405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd900fd730 msgr2=0x7fcd9010f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:00.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.041+0000 7fcd96104700 1 --2- 172.21.15.43:0/3684899405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd900fd730 0x7fcd9010f690 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009380 tx=0x7fcd80009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:00.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.041+0000 7fcd96104700 1 -- 172.21.15.43:0/3684899405 shutdown_connections 2023-12-08T20:26:00.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.041+0000 7fcd96104700 1 --2- 172.21.15.43:0/3684899405 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fcd78068f60 0x7fcd7806b410 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:00.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.041+0000 7fcd96104700 1 --2- 172.21.15.43:0/3684899405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd900fd730 0x7fcd9010f690 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:00.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.041+0000 7fcd96104700 1 --2- 172.21.15.43:0/3684899405 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd90100050 0x7fcd9010fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:00.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.041+0000 7fcd96104700 1 -- 172.21.15.43:0/3684899405 >> 172.21.15.43:0/3684899405 conn(0x7fcd900f7190 msgr2=0x7fcd900fb520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:00.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.041+0000 7fcd96104700 1 -- 172.21.15.43:0/3684899405 shutdown_connections 2023-12-08T20:26:00.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.041+0000 7fcd96104700 1 -- 172.21.15.43:0/3684899405 wait complete. 2023-12-08T20:26:00.054 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:26:00.387 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:00 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:26:00.387 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:00 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:26:00.388 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:00 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:26:00.388 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:00 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:26:00.388 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:00 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:26:00.388 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:00 smithi043 ceph-mon[111966]: pgmap v143: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s wr, 4 op/s 2023-12-08T20:26:00.388 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:00 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3684899405' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-08T20:26:00.437 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2023-12-08T20:26:00.488 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T20:26:00.489 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:00 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:26:00.489 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:00 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:26:00.489 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:00 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:26:00.489 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:00 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:26:00.489 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:00 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:26:00.490 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:00 smithi111 ceph-mon[121341]: pgmap v143: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s wr, 4 op/s 2023-12-08T20:26:00.490 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:00 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/3684899405' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-08T20:26:00.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.644+0000 7f0ec5127700 1 -- 172.21.15.43:0/336856426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ec00fcc00 msgr2=0x7f0ec00fd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:00.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.644+0000 7f0ec5127700 1 --2- 172.21.15.43:0/336856426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ec00fcc00 0x7f0ec00fd050 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4004940 tx=0x7f0eb4009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:00.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.644+0000 7f0ec5127700 1 -- 172.21.15.43:0/336856426 shutdown_connections 2023-12-08T20:26:00.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.644+0000 7f0ec5127700 1 --2- 172.21.15.43:0/336856426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ec00fcc00 0x7f0ec00fd050 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:00.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.644+0000 7f0ec5127700 1 --2- 172.21.15.43:0/336856426 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ec00fb9f0 0x7f0ec00fbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:00.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.644+0000 7f0ec5127700 1 -- 172.21.15.43:0/336856426 >> 172.21.15.43:0/336856426 conn(0x7f0ec00f7070 msgr2=0x7f0ec00f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:00.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.644+0000 7f0ec5127700 1 -- 172.21.15.43:0/336856426 shutdown_connections 2023-12-08T20:26:00.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.644+0000 7f0ec5127700 1 -- 172.21.15.43:0/336856426 wait complete. 2023-12-08T20:26:00.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.644+0000 7f0ec5127700 1 Processor -- start 2023-12-08T20:26:00.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.644+0000 7f0ec5127700 1 -- start start 2023-12-08T20:26:00.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.645+0000 7f0ec5127700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ec00fb9f0 0x7f0ec010d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:00.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.645+0000 7f0ec5127700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ec00fcc00 0x7f0ec010d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:00.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.645+0000 7f0ec5127700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec010de20 con 0x7f0ec00fcc00 2023-12-08T20:26:00.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.645+0000 7f0ec5127700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec010df90 con 0x7f0ec00fb9f0 2023-12-08T20:26:00.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.645+0000 7f0ebe59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ec00fcc00 0x7f0ec010d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:00.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.645+0000 7f0ebe59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ec00fcc00 0x7f0ec010d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34304/0 (socket says 172.21.15.43:34304) 2023-12-08T20:26:00.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.645+0000 7f0ebe59c700 1 -- 172.21.15.43:0/3843967224 learned_addr learned my addr 172.21.15.43:0/3843967224 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:26:00.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.645+0000 7f0ebed9d700 1 --2- 172.21.15.43:0/3843967224 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ec00fb9f0 0x7f0ec010d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:00.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.645+0000 7f0ebe59c700 1 -- 172.21.15.43:0/3843967224 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ec00fb9f0 msgr2=0x7f0ec010d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:00.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.645+0000 7f0ebe59c700 1 --2- 172.21.15.43:0/3843967224 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ec00fb9f0 0x7f0ec010d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:00.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.645+0000 7f0ebe59c700 1 -- 172.21.15.43:0/3843967224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb4005040 con 0x7f0ec00fcc00 2023-12-08T20:26:00.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.645+0000 7f0ebe59c700 1 --2- 172.21.15.43:0/3843967224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ec00fcc00 0x7f0ec010d820 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009fd0 tx=0x7f0eb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:00.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.645+0000 7f0ea77fe700 1 -- 172.21.15.43:0/3843967224 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0eb400e040 con 0x7f0ec00fcc00 2023-12-08T20:26:00.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.645+0000 7f0ea77fe700 1 -- 172.21.15.43:0/3843967224 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0eb4004290 con 0x7f0ec00fcc00 2023-12-08T20:26:00.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.645+0000 7f0ec5127700 1 -- 172.21.15.43:0/3843967224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec01129e0 con 0x7f0ec00fcc00 2023-12-08T20:26:00.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.645+0000 7f0ea77fe700 1 -- 172.21.15.43:0/3843967224 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0eb401c3f0 con 0x7f0ec00fcc00 2023-12-08T20:26:00.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.646+0000 7f0ec5127700 1 -- 172.21.15.43:0/3843967224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec0112fa0 con 0x7f0ec00fcc00 2023-12-08T20:26:00.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.647+0000 7f0ec5127700 1 -- 172.21.15.43:0/3843967224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec01043b0 con 0x7f0ec00fcc00 2023-12-08T20:26:00.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.647+0000 7f0ea77fe700 1 -- 172.21.15.43:0/3843967224 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f0eb400bc50 con 0x7f0ec00fcc00 2023-12-08T20:26:00.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.647+0000 7f0ea77fe700 1 --2- 172.21.15.43:0/3843967224 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0ea8068f70 0x7f0ea806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:00.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.647+0000 7f0ea77fe700 1 -- 172.21.15.43:0/3843967224 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0eb4088220 con 0x7f0ec00fcc00 2023-12-08T20:26:00.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.647+0000 7f0ebed9d700 1 --2- 172.21.15.43:0/3843967224 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0ea8068f70 0x7f0ea806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:00.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.648+0000 7f0ebed9d700 1 --2- 172.21.15.43:0/3843967224 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0ea8068f70 0x7f0ea806b420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00fca60 tx=0x7f0eb000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:00.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.652+0000 7f0ea77fe700 1 -- 172.21.15.43:0/3843967224 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0eb40580e0 con 0x7f0ec00fcc00 2023-12-08T20:26:00.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.858+0000 7f0ec5127700 1 -- 172.21.15.43:0/3843967224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ec01131f0 con 0x7f0ec00fcc00 2023-12-08T20:26:00.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.859+0000 7f0ea77fe700 1 -- 172.21.15.43:0/3843967224 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+14281 (secure 0 0 0) 0x7f0eb4057c70 con 0x7f0ec00fcc00 2023-12-08T20:26:00.861 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:26:00.861 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":45,"fsid":"28476818-9607-11ee-95a3-87774f69a715","created":"2023-12-08T20:20:31.669394+0000","modified":"2023-12-08T20:25:43.541561+0000","last_up_change":"2023-12-08T20:24:49.445749+0000","last_in_change":"2023-12-08T20:24:32.898273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:23:57.952150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-08T20:25:40.366334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-08T20:25:40.972845+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c82b664-c209-4a61-8b21-c5d6a73af81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3312385732},{"type":"v1","addr":"172.21.15.43:6803","nonce":3312385732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3312385732},{"type":"v1","addr":"172.21.15.43:6805","nonce":3312385732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3312385732},{"type":"v1","addr":"172.21.15.43:6809","nonce":3312385732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3312385732},{"type":"v1","addr":"172.21.15.43:6807","nonce":3312385732}]},"public_addr":"172.21.15.43:6803/3312385732","cluster_addr":"172.21.15.43:6805/3312385732","heartbeat_back_addr":"172.21.15.43:6809/3312385732","heartbeat_front_addr":"172.21.15.43:6807/3312385732","state":["exists","up"]},{"osd":1,"uuid":"301dfde9-c50a-4f73-856f-ae88dc2d2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3228320632},{"type":"v1","addr":"172.21.15.43:6811","nonce":3228320632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3228320632},{"type":"v1","addr":"172.21.15.43:6813","nonce":3228320632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":3228320632},{"type":"v1","addr":"172.21.15.43:6817","nonce":3228320632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3228320632},{"type":"v1","addr":"172.21.15.43:6815","nonce":3228320632}]},"public_addr":"172.21.15.43:6811/3228320632","cluster_addr":"172.21.15.43:6813/3228320632","heartbeat_back_addr":"172.21.15.43:6817/3228320632","heartbeat_front_addr":"172.21.15.43:6815/3228320632","state":["exists","up"]},{"osd":2,"uuid":"bc7be655-1abc-4982-a674-b78d9f7dc1ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":2164647692},{"type":"v1","addr":"172.21.15.43:6819","nonce":2164647692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":2164647692},{"type":"v1","addr":"172.21.15.43:6821","nonce":2164647692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":2164647692},{"type":"v1","addr":"172.21.15.43:6825","nonce":2164647692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":2164647692},{"type":"v1","addr":"172.21.15.43:6823","nonce":2164647692}]},"public_addr":"172.21.15.43:6819/2164647692","cluster_addr":"172.21.15.43:6821/2164647692","heartbeat_back_addr":"172.21.15.43:6825/2164647692","heartbeat_front_addr":"172.21.15.43:6823/2164647692","state":["exists","up"]},{"osd":3,"uuid":"0c0628df-2c6b-40ce-97e2-141d2057af11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2187527806},{"type":"v1","addr":"172.21.15.111:6801","nonce":2187527806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2187527806},{"type":"v1","addr":"172.21.15.111:6803","nonce":2187527806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2187527806},{"type":"v1","addr":"172.21.15.111:6807","nonce":2187527806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2187527806},{"type":"v1","addr":"172.21.15.111:6805","nonce":2187527806}]},"public_addr":"172.21.15.111:6801/2187527806","cluster_addr":"172.21.15.111:6803/2187527806","heartbeat_back_addr":"172.21.15.111:6807/2187527806","heartbeat_front_addr":"172.21.15.111:6805/2187527806","state":["exists","up"]},{"osd":4,"uuid":"87b65c6d-d7c2-44d7-b891-8477e5e891b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":2408695979},{"type":"v1","addr":"172.21.15.111:6809","nonce":2408695979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":2408695979},{"type":"v1","addr":"172.21.15.111:6811","nonce":2408695979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":2408695979},{"type":"v1","addr":"172.21.15.111:6815","nonce":2408695979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":2408695979},{"type":"v1","addr":"172.21.15.111:6813","nonce":2408695979}]},"public_addr":"172.21.15.111:6809/2408695979","cluster_addr":"172.21.15.111:6811/2408695979","heartbeat_back_addr":"172.21.15.111:6815/2408695979","heartbeat_front_addr":"172.21.15.111:6813/2408695979","state":["exists","up"]},{"osd":5,"uuid":"6a99cd97-6a80-4d01-bb37-a159803f7333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":3881389263},{"type":"v1","addr":"172.21.15.111:6817","nonce":3881389263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":3881389263},{"type":"v1","addr":"172.21.15.111:6819","nonce":3881389263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":3881389263},{"type":"v1","addr":"172.21.15.111:6823","nonce":3881389263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":3881389263},{"type":"v1","addr":"172.21.15.111:6821","nonce":3881389263}]},"public_addr":"172.21.15.111:6817/3881389263","cluster_addr":"172.21.15.111:6819/3881389263","heartbeat_back_addr":"172.21.15.111:6823/3881389263","heartbeat_front_addr":"172.21.15.111:6821/3881389263","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:23:11.583744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:23:33.216409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:23:54.174665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:24:11.801925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:24:29.476994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:24:47.562110+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6801/2315465125":"2023-12-09T20:22:19.417857+0000","172.21.15.43:0/4033535283":"2023-12-09T20:22:19.417857+0000","172.21.15.43:0/392501150":"2023-12-09T20:22:19.417857+0000","172.21.15.43:6801/1561199606":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/2345173464":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/3678520486":"2023-12-09T20:22:19.417857+0000","172.21.15.43:0/2451027781":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/3571683356":"2023-12-09T20:21:01.600933+0000","172.21.15.43:0/1298471102":"2023-12-09T20:21:01.600933+0000","172.21.15.43:6800/1561199606":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/2976228612":"2023-12-09T20:21:01.600933+0000","172.21.15.43:6800/2195776328":"2023-12-09T20:21:01.600933+0000","172.21.15.43:6800/2315465125":"2023-12-09T20:22:19.417857+0000","172.21.15.43:6801/2195776328":"2023-12-09T20:21:01.600933+0000","172.21.15.43:0/3758242596":"2023-12-09T20:21:27.333855+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:26:00.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.862+0000 7f0ec5127700 1 -- 172.21.15.43:0/3843967224 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0ea8068f70 msgr2=0x7f0ea806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:00.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.862+0000 7f0ec5127700 1 --2- 172.21.15.43:0/3843967224 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0ea8068f70 0x7f0ea806b420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00fca60 tx=0x7f0eb000b040 comp rx=0 tx=0).stop 2023-12-08T20:26:00.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.862+0000 7f0ec5127700 1 -- 172.21.15.43:0/3843967224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ec00fcc00 msgr2=0x7f0ec010d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:00.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.862+0000 7f0ec5127700 1 --2- 172.21.15.43:0/3843967224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ec00fcc00 0x7f0ec010d820 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009fd0 tx=0x7f0eb4009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:00.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.862+0000 7f0ec5127700 1 -- 172.21.15.43:0/3843967224 shutdown_connections 2023-12-08T20:26:00.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.862+0000 7f0ec5127700 1 --2- 172.21.15.43:0/3843967224 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0ea8068f70 0x7f0ea806b420 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:00.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.862+0000 7f0ec5127700 1 --2- 172.21.15.43:0/3843967224 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ec00fb9f0 0x7f0ec010d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:00.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.862+0000 7f0ec5127700 1 --2- 172.21.15.43:0/3843967224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ec00fcc00 0x7f0ec010d820 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:00.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.862+0000 7f0ec5127700 1 -- 172.21.15.43:0/3843967224 >> 172.21.15.43:0/3843967224 conn(0x7f0ec00f7070 msgr2=0x7f0ec0064b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:00.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.862+0000 7f0ec5127700 1 -- 172.21.15.43:0/3843967224 shutdown_connections 2023-12-08T20:26:00.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:00.862+0000 7f0ec5127700 1 -- 172.21.15.43:0/3843967224 wait complete. 2023-12-08T20:26:00.878 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T20:23:57.952150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-08T20:25:40.366334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-08T20:25:40.972845+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T20:26:00.879 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T20:26:01.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.013+0000 7f9545e14700 1 -- 172.21.15.43:0/1943454831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95400658a0 msgr2=0x7f95400ff620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:01.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.013+0000 7f9545e14700 1 --2- 172.21.15.43:0/1943454831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95400658a0 0x7f95400ff620 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9528004940 tx=0x7f9528009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:01.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.013+0000 7f9545e14700 1 -- 172.21.15.43:0/1943454831 shutdown_connections 2023-12-08T20:26:01.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.013+0000 7f9545e14700 1 --2- 172.21.15.43:0/1943454831 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95400ffbf0 0x7f9540102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:01.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.013+0000 7f9545e14700 1 --2- 172.21.15.43:0/1943454831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95400658a0 0x7f95400ff620 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:01.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.013+0000 7f9545e14700 1 -- 172.21.15.43:0/1943454831 >> 172.21.15.43:0/1943454831 conn(0x7f95400f7010 msgr2=0x7f95400f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:01.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.013+0000 7f9545e14700 1 -- 172.21.15.43:0/1943454831 shutdown_connections 2023-12-08T20:26:01.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.013+0000 7f9545e14700 1 -- 172.21.15.43:0/1943454831 wait complete. 2023-12-08T20:26:01.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.014+0000 7f9545e14700 1 Processor -- start 2023-12-08T20:26:01.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.014+0000 7f9545e14700 1 -- start start 2023-12-08T20:26:01.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.014+0000 7f9545e14700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95400658a0 0x7f95400fcec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:01.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.014+0000 7f9545e14700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95400ffbf0 0x7f95400fb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:01.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.014+0000 7f9545e14700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95400fd4c0 con 0x7f95400658a0 2023-12-08T20:26:01.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.014+0000 7f9545e14700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95400fba90 con 0x7f95400ffbf0 2023-12-08T20:26:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.014+0000 7f953f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95400658a0 0x7f95400fcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.014+0000 7f953f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95400658a0 0x7f95400fcec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34326/0 (socket says 172.21.15.43:34326) 2023-12-08T20:26:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.014+0000 7f953f7fe700 1 -- 172.21.15.43:0/463033811 learned_addr learned my addr 172.21.15.43:0/463033811 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:26:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.014+0000 7f953effd700 1 --2- 172.21.15.43:0/463033811 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95400ffbf0 0x7f95400fb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.014+0000 7f953f7fe700 1 -- 172.21.15.43:0/463033811 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95400ffbf0 msgr2=0x7f95400fb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.014+0000 7f953f7fe700 1 --2- 172.21.15.43:0/463033811 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95400ffbf0 0x7f95400fb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.014+0000 7f953f7fe700 1 -- 172.21.15.43:0/463033811 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9528005040 con 0x7f95400658a0 2023-12-08T20:26:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.015+0000 7f953f7fe700 1 --2- 172.21.15.43:0/463033811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95400658a0 0x7f95400fcec0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9528000c00 tx=0x7f9528009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.015+0000 7f9537fff700 1 -- 172.21.15.43:0/463033811 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9528021070 con 0x7f95400658a0 2023-12-08T20:26:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.015+0000 7f9537fff700 1 -- 172.21.15.43:0/463033811 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f952801c400 con 0x7f95400658a0 2023-12-08T20:26:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.015+0000 7f9537fff700 1 -- 172.21.15.43:0/463033811 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f952800e070 con 0x7f95400658a0 2023-12-08T20:26:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.015+0000 7f9545e14700 1 -- 172.21.15.43:0/463033811 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95400fbd10 con 0x7f95400658a0 2023-12-08T20:26:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.015+0000 7f9545e14700 1 -- 172.21.15.43:0/463033811 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95400fc220 con 0x7f95400658a0 2023-12-08T20:26:01.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.016+0000 7f9545e14700 1 -- 172.21.15.43:0/463033811 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9540105420 con 0x7f95400658a0 2023-12-08T20:26:01.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.016+0000 7f9537fff700 1 -- 172.21.15.43:0/463033811 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f952801c9c0 con 0x7f95400658a0 2023-12-08T20:26:01.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.017+0000 7f9537fff700 1 --2- 172.21.15.43:0/463033811 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f952c068f60 0x7f952c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:01.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.017+0000 7f9537fff700 1 -- 172.21.15.43:0/463033811 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9528087ff0 con 0x7f95400658a0 2023-12-08T20:26:01.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.017+0000 7f953effd700 1 --2- 172.21.15.43:0/463033811 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f952c068f60 0x7f952c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:01.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.017+0000 7f953effd700 1 --2- 172.21.15.43:0/463033811 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f952c068f60 0x7f952c06b410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9530009b80 tx=0x7f953000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:01.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.021+0000 7f9537fff700 1 -- 172.21.15.43:0/463033811 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9528057f50 con 0x7f95400658a0 2023-12-08T20:26:01.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.227+0000 7f9545e14700 1 -- 172.21.15.43:0/463033811 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9540115440 con 0x7f95400658a0 2023-12-08T20:26:01.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.227+0000 7f9537fff700 1 -- 172.21.15.43:0/463033811 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9528057ae0 con 0x7f95400658a0 2023-12-08T20:26:01.229 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-12-08T20:26:01.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.229+0000 7f9545e14700 1 -- 172.21.15.43:0/463033811 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f952c068f60 msgr2=0x7f952c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:01.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.229+0000 7f9545e14700 1 --2- 172.21.15.43:0/463033811 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f952c068f60 0x7f952c06b410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9530009b80 tx=0x7f953000b040 comp rx=0 tx=0).stop 2023-12-08T20:26:01.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.229+0000 7f9545e14700 1 -- 172.21.15.43:0/463033811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95400658a0 msgr2=0x7f95400fcec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:01.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.229+0000 7f9545e14700 1 --2- 172.21.15.43:0/463033811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95400658a0 0x7f95400fcec0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9528000c00 tx=0x7f9528009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:01.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.230+0000 7f9545e14700 1 -- 172.21.15.43:0/463033811 shutdown_connections 2023-12-08T20:26:01.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.230+0000 7f9545e14700 1 --2- 172.21.15.43:0/463033811 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f952c068f60 0x7f952c06b410 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:01.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.230+0000 7f9545e14700 1 --2- 172.21.15.43:0/463033811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95400658a0 0x7f95400fcec0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:01.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.230+0000 7f9545e14700 1 --2- 172.21.15.43:0/463033811 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95400ffbf0 0x7f95400fb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:01.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.230+0000 7f9545e14700 1 -- 172.21.15.43:0/463033811 >> 172.21.15.43:0/463033811 conn(0x7f95400f7010 msgr2=0x7f95400f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:01.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.230+0000 7f9545e14700 1 -- 172.21.15.43:0/463033811 shutdown_connections 2023-12-08T20:26:01.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.230+0000 7f9545e14700 1 -- 172.21.15.43:0/463033811 wait complete. 2023-12-08T20:26:01.245 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-08T20:26:01.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.378+0000 7fdaefd96700 1 -- 172.21.15.43:0/2312153839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdae80fb3a0 msgr2=0x7fdae80fb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:01.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.378+0000 7fdaefd96700 1 --2- 172.21.15.43:0/2312153839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdae80fb3a0 0x7fdae80fb7b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdae4004940 tx=0x7fdae4009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:01.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.379+0000 7fdaefd96700 1 -- 172.21.15.43:0/2312153839 shutdown_connections 2023-12-08T20:26:01.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.379+0000 7fdaefd96700 1 --2- 172.21.15.43:0/2312153839 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdae80fbcf0 0x7fdae80fc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:01.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.379+0000 7fdaefd96700 1 --2- 172.21.15.43:0/2312153839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdae80fb3a0 0x7fdae80fb7b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:01.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.379+0000 7fdaefd96700 1 -- 172.21.15.43:0/2312153839 >> 172.21.15.43:0/2312153839 conn(0x7fdae80f7010 msgr2=0x7fdae80f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:01.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.379+0000 7fdaefd96700 1 -- 172.21.15.43:0/2312153839 shutdown_connections 2023-12-08T20:26:01.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.379+0000 7fdaefd96700 1 -- 172.21.15.43:0/2312153839 wait complete. 2023-12-08T20:26:01.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.379+0000 7fdaefd96700 1 Processor -- start 2023-12-08T20:26:01.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.379+0000 7fdaefd96700 1 -- start start 2023-12-08T20:26:01.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.379+0000 7fdaefd96700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdae80fb3a0 0x7fdae810f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:01.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.379+0000 7fdaefd96700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdae80fbcf0 0x7fdae810f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:01.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.379+0000 7fdaefd96700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae810ffb0 con 0x7fdae80fbcf0 2023-12-08T20:26:01.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.379+0000 7fdaefd96700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae8110120 con 0x7fdae80fb3a0 2023-12-08T20:26:01.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.380+0000 7fdaed331700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdae80fbcf0 0x7fdae810f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:01.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.380+0000 7fdaed331700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdae80fbcf0 0x7fdae810f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34352/0 (socket says 172.21.15.43:34352) 2023-12-08T20:26:01.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.380+0000 7fdaed331700 1 -- 172.21.15.43:0/414122323 learned_addr learned my addr 172.21.15.43:0/414122323 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:26:01.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.380+0000 7fdaedb32700 1 --2- 172.21.15.43:0/414122323 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdae80fb3a0 0x7fdae810f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:01.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.380+0000 7fdaed331700 1 -- 172.21.15.43:0/414122323 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdae80fb3a0 msgr2=0x7fdae810f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:01.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.380+0000 7fdaed331700 1 --2- 172.21.15.43:0/414122323 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdae80fb3a0 0x7fdae810f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:01.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.380+0000 7fdaed331700 1 -- 172.21.15.43:0/414122323 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae4005040 con 0x7fdae80fbcf0 2023-12-08T20:26:01.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.380+0000 7fdaed331700 1 --2- 172.21.15.43:0/414122323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdae80fbcf0 0x7fdae810f9b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdad800c8c0 tx=0x7fdad80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:01.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.380+0000 7fdade7fc700 1 -- 172.21.15.43:0/414122323 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdad800a980 con 0x7fdae80fbcf0 2023-12-08T20:26:01.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.380+0000 7fdaefd96700 1 -- 172.21.15.43:0/414122323 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae8114bd0 con 0x7fdae80fbcf0 2023-12-08T20:26:01.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.380+0000 7fdade7fc700 1 -- 172.21.15.43:0/414122323 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdad800ce60 con 0x7fdae80fbcf0 2023-12-08T20:26:01.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.380+0000 7fdade7fc700 1 -- 172.21.15.43:0/414122323 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdad80113a0 con 0x7fdae80fbcf0 2023-12-08T20:26:01.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.380+0000 7fdaefd96700 1 -- 172.21.15.43:0/414122323 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae8115190 con 0x7fdae80fbcf0 2023-12-08T20:26:01.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.381+0000 7fdaefd96700 1 -- 172.21.15.43:0/414122323 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae81075f0 con 0x7fdae80fbcf0 2023-12-08T20:26:01.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.382+0000 7fdade7fc700 1 -- 172.21.15.43:0/414122323 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fdad8012400 con 0x7fdae80fbcf0 2023-12-08T20:26:01.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.382+0000 7fdade7fc700 1 --2- 172.21.15.43:0/414122323 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fdad4068f60 0x7fdad406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:01.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.382+0000 7fdade7fc700 1 -- 172.21.15.43:0/414122323 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fdad8086ec0 con 0x7fdae80fbcf0 2023-12-08T20:26:01.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.382+0000 7fdaedb32700 1 --2- 172.21.15.43:0/414122323 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fdad4068f60 0x7fdad406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:01.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.383+0000 7fdaedb32700 1 --2- 172.21.15.43:0/414122323 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fdad4068f60 0x7fdad406b410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdae400b3b0 tx=0x7fdae4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:01.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.387+0000 7fdade7fc700 1 -- 172.21.15.43:0/414122323 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdad8056e20 con 0x7fdae80fbcf0 2023-12-08T20:26:01.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:01 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3843967224' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-08T20:26:01.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:01 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/463033811' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-08T20:26:01.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.591+0000 7fdaefd96700 1 -- 172.21.15.43:0/414122323 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fdae81153e0 con 0x7fdae80fbcf0 2023-12-08T20:26:01.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.592+0000 7fdade7fc700 1 -- 172.21.15.43:0/414122323 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v45) v1 ==== 107+0+11 (secure 0 0 0) 0x7fdad80569b0 con 0x7fdae80fbcf0 2023-12-08T20:26:01.594 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-12-08T20:26:01.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.594+0000 7fdaefd96700 1 -- 172.21.15.43:0/414122323 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fdad4068f60 msgr2=0x7fdad406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:01.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.594+0000 7fdaefd96700 1 --2- 172.21.15.43:0/414122323 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fdad4068f60 0x7fdad406b410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdae400b3b0 tx=0x7fdae4009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:01.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.594+0000 7fdaefd96700 1 -- 172.21.15.43:0/414122323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdae80fbcf0 msgr2=0x7fdae810f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:01.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.594+0000 7fdaefd96700 1 --2- 172.21.15.43:0/414122323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdae80fbcf0 0x7fdae810f9b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdad800c8c0 tx=0x7fdad80044c0 comp rx=0 tx=0).stop 2023-12-08T20:26:01.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.594+0000 7fdaefd96700 1 -- 172.21.15.43:0/414122323 shutdown_connections 2023-12-08T20:26:01.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.594+0000 7fdaefd96700 1 --2- 172.21.15.43:0/414122323 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fdad4068f60 0x7fdad406b410 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:01.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.594+0000 7fdaefd96700 1 --2- 172.21.15.43:0/414122323 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdae80fb3a0 0x7fdae810f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:01.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.594+0000 7fdaefd96700 1 --2- 172.21.15.43:0/414122323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdae80fbcf0 0x7fdae810f9b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:01.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.594+0000 7fdaefd96700 1 -- 172.21.15.43:0/414122323 >> 172.21.15.43:0/414122323 conn(0x7fdae80f7010 msgr2=0x7fdae81039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:01.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.595+0000 7fdaefd96700 1 -- 172.21.15.43:0/414122323 shutdown_connections 2023-12-08T20:26:01.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.595+0000 7fdaefd96700 1 -- 172.21.15.43:0/414122323 wait complete. 2023-12-08T20:26:01.610 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-08T20:26:01.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:01 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/3843967224' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-08T20:26:01.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:01 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/463033811' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-08T20:26:01.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.743+0000 7f42538a4700 1 -- 172.21.15.43:0/3385397646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f424c0fb970 msgr2=0x7f424c0fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:01.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.743+0000 7f42538a4700 1 --2- 172.21.15.43:0/3385397646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f424c0fb970 0x7f424c0fbd80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4248004940 tx=0x7f4248009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:01.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.743+0000 7f42538a4700 1 -- 172.21.15.43:0/3385397646 shutdown_connections 2023-12-08T20:26:01.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.743+0000 7f42538a4700 1 --2- 172.21.15.43:0/3385397646 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f424c0fcb80 0x7f424c0fcfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:01.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.743+0000 7f42538a4700 1 --2- 172.21.15.43:0/3385397646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f424c0fb970 0x7f424c0fbd80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:01.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.743+0000 7f42538a4700 1 -- 172.21.15.43:0/3385397646 >> 172.21.15.43:0/3385397646 conn(0x7f424c0f7010 msgr2=0x7f424c0f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:01.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.743+0000 7f42538a4700 1 -- 172.21.15.43:0/3385397646 shutdown_connections 2023-12-08T20:26:01.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.743+0000 7f42538a4700 1 -- 172.21.15.43:0/3385397646 wait complete. 2023-12-08T20:26:01.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.744+0000 7f42538a4700 1 Processor -- start 2023-12-08T20:26:01.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.744+0000 7f42538a4700 1 -- start start 2023-12-08T20:26:01.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.744+0000 7f42538a4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f424c0fb970 0x7f424c10d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:01.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.744+0000 7f42538a4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f424c0fcb80 0x7f424c10d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:01.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.744+0000 7f42538a4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424c10dd90 con 0x7f424c0fb970 2023-12-08T20:26:01.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.744+0000 7f42538a4700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424c10df00 con 0x7f424c0fcb80 2023-12-08T20:26:01.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.744+0000 7f4251640700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f424c0fb970 0x7f424c10d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:01.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.744+0000 7f4251640700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f424c0fb970 0x7f424c10d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34364/0 (socket says 172.21.15.43:34364) 2023-12-08T20:26:01.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.744+0000 7f4251640700 1 -- 172.21.15.43:0/89583907 learned_addr learned my addr 172.21.15.43:0/89583907 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:26:01.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.744+0000 7f4250e3f700 1 --2- 172.21.15.43:0/89583907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f424c0fcb80 0x7f424c10d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:01.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.745+0000 7f4251640700 1 -- 172.21.15.43:0/89583907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f424c0fcb80 msgr2=0x7f424c10d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:01.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.745+0000 7f4251640700 1 --2- 172.21.15.43:0/89583907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f424c0fcb80 0x7f424c10d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:01.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.745+0000 7f4251640700 1 -- 172.21.15.43:0/89583907 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4248005040 con 0x7f424c0fb970 2023-12-08T20:26:01.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.745+0000 7f4250e3f700 1 --2- 172.21.15.43:0/89583907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f424c0fcb80 0x7f424c10d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:26:01.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.745+0000 7f4251640700 1 --2- 172.21.15.43:0/89583907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f424c0fb970 0x7f424c10d250 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4248008f80 tx=0x7f4248009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:01.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.745+0000 7f4241ffb700 1 -- 172.21.15.43:0/89583907 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4248021070 con 0x7f424c0fb970 2023-12-08T20:26:01.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.745+0000 7f4241ffb700 1 -- 172.21.15.43:0/89583907 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f424801c400 con 0x7f424c0fb970 2023-12-08T20:26:01.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.745+0000 7f4241ffb700 1 -- 172.21.15.43:0/89583907 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f424800e070 con 0x7f424c0fb970 2023-12-08T20:26:01.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.745+0000 7f42538a4700 1 -- 172.21.15.43:0/89583907 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f424c112950 con 0x7f424c0fb970 2023-12-08T20:26:01.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.745+0000 7f42538a4700 1 -- 172.21.15.43:0/89583907 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f424c112eb0 con 0x7f424c0fb970 2023-12-08T20:26:01.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.746+0000 7f42538a4700 1 -- 172.21.15.43:0/89583907 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f424c104310 con 0x7f424c0fb970 2023-12-08T20:26:01.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.747+0000 7f4241ffb700 1 -- 172.21.15.43:0/89583907 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f424801c9c0 con 0x7f424c0fb970 2023-12-08T20:26:01.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.747+0000 7f4241ffb700 1 --2- 172.21.15.43:0/89583907 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f4238068f70 0x7f423806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:01.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.747+0000 7f4241ffb700 1 -- 172.21.15.43:0/89583907 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4248088070 con 0x7f424c0fb970 2023-12-08T20:26:01.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.747+0000 7f4250e3f700 1 --2- 172.21.15.43:0/89583907 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f4238068f70 0x7f423806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:01.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.748+0000 7f4250e3f700 1 --2- 172.21.15.43:0/89583907 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f4238068f70 0x7f423806b420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f423c004600 tx=0x7f423c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:01.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.752+0000 7f4241ffb700 1 -- 172.21.15.43:0/89583907 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4248057fd0 con 0x7f424c0fb970 2023-12-08T20:26:01.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.954+0000 7f42538a4700 1 -- 172.21.15.43:0/89583907 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f424c113100 con 0x7f424c0fb970 2023-12-08T20:26:01.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.955+0000 7f4241ffb700 1 -- 172.21.15.43:0/89583907 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v45) v1 ==== 107+0+11 (secure 0 0 0) 0x7f4248057b60 con 0x7f424c0fb970 2023-12-08T20:26:01.956 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-12-08T20:26:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.957+0000 7f42538a4700 1 -- 172.21.15.43:0/89583907 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f4238068f70 msgr2=0x7f423806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.957+0000 7f42538a4700 1 --2- 172.21.15.43:0/89583907 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f4238068f70 0x7f423806b420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f423c004600 tx=0x7f423c00b040 comp rx=0 tx=0).stop 2023-12-08T20:26:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.957+0000 7f42538a4700 1 -- 172.21.15.43:0/89583907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f424c0fb970 msgr2=0x7f424c10d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.957+0000 7f42538a4700 1 --2- 172.21.15.43:0/89583907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f424c0fb970 0x7f424c10d250 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4248008f80 tx=0x7f4248009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.957+0000 7f42538a4700 1 -- 172.21.15.43:0/89583907 shutdown_connections 2023-12-08T20:26:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.957+0000 7f42538a4700 1 --2- 172.21.15.43:0/89583907 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f4238068f70 0x7f423806b420 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.957+0000 7f42538a4700 1 --2- 172.21.15.43:0/89583907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f424c0fb970 0x7f424c10d250 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:01.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.957+0000 7f42538a4700 1 --2- 172.21.15.43:0/89583907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f424c0fcb80 0x7f424c10d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:01.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.957+0000 7f42538a4700 1 -- 172.21.15.43:0/89583907 >> 172.21.15.43:0/89583907 conn(0x7f424c0f7010 msgr2=0x7f424c064b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:01.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.957+0000 7f42538a4700 1 -- 172.21.15.43:0/89583907 shutdown_connections 2023-12-08T20:26:01.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:01.957+0000 7f42538a4700 1 -- 172.21.15.43:0/89583907 wait complete. 2023-12-08T20:26:01.973 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T20:26:02.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.103+0000 7f0923f7e700 1 -- 172.21.15.43:0/3192382584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f091c0fbd70 msgr2=0x7f091c0fc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:02.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.103+0000 7f0923f7e700 1 --2- 172.21.15.43:0/3192382584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f091c0fbd70 0x7f091c0fc1e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f090c004940 tx=0x7f090c009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:02.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.103+0000 7f0923f7e700 1 -- 172.21.15.43:0/3192382584 shutdown_connections 2023-12-08T20:26:02.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.103+0000 7f0923f7e700 1 --2- 172.21.15.43:0/3192382584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f091c0fbd70 0x7f091c0fc1e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:02.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.103+0000 7f0923f7e700 1 --2- 172.21.15.43:0/3192382584 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f091c0fb420 0x7f091c0fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:02.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.103+0000 7f0923f7e700 1 -- 172.21.15.43:0/3192382584 >> 172.21.15.43:0/3192382584 conn(0x7f091c0f7070 msgr2=0x7f091c0f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:02.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.103+0000 7f0923f7e700 1 -- 172.21.15.43:0/3192382584 shutdown_connections 2023-12-08T20:26:02.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.103+0000 7f0923f7e700 1 -- 172.21.15.43:0/3192382584 wait complete. 2023-12-08T20:26:02.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.104+0000 7f0923f7e700 1 Processor -- start 2023-12-08T20:26:02.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.104+0000 7f0923f7e700 1 -- start start 2023-12-08T20:26:02.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.104+0000 7f0923f7e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f091c0fb420 0x7f091c10f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:02.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.104+0000 7f0923f7e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f091c0fbd70 0x7f091c10f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:02.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.104+0000 7f0923f7e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091c10ff20 con 0x7f091c0fbd70 2023-12-08T20:26:02.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.104+0000 7f0923f7e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091c110090 con 0x7f091c0fb420 2023-12-08T20:26:02.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.104+0000 7f0921519700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f091c0fbd70 0x7f091c10f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:02.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.104+0000 7f0921d1a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f091c0fb420 0x7f091c10f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:02.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.104+0000 7f0921d1a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f091c0fb420 0x7f091c10f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.43:34860/0 (socket says 172.21.15.43:34860) 2023-12-08T20:26:02.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.104+0000 7f0921519700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f091c0fbd70 0x7f091c10f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34384/0 (socket says 172.21.15.43:34384) 2023-12-08T20:26:02.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.104+0000 7f0921d1a700 1 -- 172.21.15.43:0/3476889618 learned_addr learned my addr 172.21.15.43:0/3476889618 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:26:02.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.104+0000 7f0921519700 1 -- 172.21.15.43:0/3476889618 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f091c0fb420 msgr2=0x7f091c10f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:02.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.104+0000 7f0921519700 1 --2- 172.21.15.43:0/3476889618 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f091c0fb420 0x7f091c10f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:02.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.104+0000 7f0921519700 1 -- 172.21.15.43:0/3476889618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c005040 con 0x7f091c0fbd70 2023-12-08T20:26:02.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.104+0000 7f0921519700 1 --2- 172.21.15.43:0/3476889618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f091c0fbd70 0x7f091c10f920 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f090c00b0d0 tx=0x7f090c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:02.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.105+0000 7f09127fc700 1 -- 172.21.15.43:0/3476889618 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f090c00e070 con 0x7f091c0fbd70 2023-12-08T20:26:02.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.105+0000 7f09127fc700 1 -- 172.21.15.43:0/3476889618 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f090c01c400 con 0x7f091c0fbd70 2023-12-08T20:26:02.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.105+0000 7f0923f7e700 1 -- 172.21.15.43:0/3476889618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091c114ae0 con 0x7f091c0fbd70 2023-12-08T20:26:02.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.105+0000 7f09127fc700 1 -- 172.21.15.43:0/3476889618 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f090c00b650 con 0x7f091c0fbd70 2023-12-08T20:26:02.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.105+0000 7f0923f7e700 1 -- 172.21.15.43:0/3476889618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091c115040 con 0x7f091c0fbd70 2023-12-08T20:26:02.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.106+0000 7f0923f7e700 1 -- 172.21.15.43:0/3476889618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091c107670 con 0x7f091c0fbd70 2023-12-08T20:26:02.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.106+0000 7f09127fc700 1 -- 172.21.15.43:0/3476889618 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f090c01c9e0 con 0x7f091c0fbd70 2023-12-08T20:26:02.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.107+0000 7f09127fc700 1 --2- 172.21.15.43:0/3476889618 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0908068f60 0x7f090806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:02.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.107+0000 7f09127fc700 1 -- 172.21.15.43:0/3476889618 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f090c087f90 con 0x7f091c0fbd70 2023-12-08T20:26:02.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.107+0000 7f0921d1a700 1 --2- 172.21.15.43:0/3476889618 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0908068f60 0x7f090806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:02.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.107+0000 7f0921d1a700 1 --2- 172.21.15.43:0/3476889618 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0908068f60 0x7f090806b410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0918008fd0 tx=0x7f091800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:02.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.111+0000 7f09127fc700 1 -- 172.21.15.43:0/3476889618 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f090c057f90 con 0x7f091c0fbd70 2023-12-08T20:26:02.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.367+0000 7f0923f7e700 1 -- 172.21.15.43:0/3476889618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f091c115440 con 0x7f091c0fbd70 2023-12-08T20:26:02.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.368+0000 7f09127fc700 1 -- 172.21.15.43:0/3476889618 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4704 (secure 0 0 0) 0x7f090c057b20 con 0x7f091c0fbd70 2023-12-08T20:26:02.370 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:26:02.370 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14466,"name":"cephfs.smithi043.akrjef","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.43:6829/2926918083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":2926918083},{"type":"v1","addr":"172.21.15.43:6829","nonce":2926918083}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24331,"name":"cephfs.smithi111.svpasm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.111:6827/2885759138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":2885759138},{"type":"v1","addr":"172.21.15.111:6827","nonce":2885759138}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T20:25:41.527734+0000","modified":"2023-12-08T20:25:52.581820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14452,"mds_1":24315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14452":{"gid":14452,"name":"cephfs.smithi043.pjmszb","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.43:6827/441584552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":441584552},{"type":"v1","addr":"172.21.15.43:6827","nonce":441584552}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24315":{"gid":24315,"name":"cephfs.smithi111.veeegc","rank":1,"incarnation":7,"state":"up:active","state_seq":3,"addr":"172.21.15.111:6825/1990395192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":1990395192},{"type":"v1","addr":"172.21.15.111:6825","nonce":1990395192}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-12-08T20:26:02.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.370+0000 7f0923f7e700 1 -- 172.21.15.43:0/3476889618 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0908068f60 msgr2=0x7f090806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:02.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.370+0000 7f0923f7e700 1 --2- 172.21.15.43:0/3476889618 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0908068f60 0x7f090806b410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0918008fd0 tx=0x7f091800b040 comp rx=0 tx=0).stop 2023-12-08T20:26:02.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.370+0000 7f0923f7e700 1 -- 172.21.15.43:0/3476889618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f091c0fbd70 msgr2=0x7f091c10f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:02.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.370+0000 7f0923f7e700 1 --2- 172.21.15.43:0/3476889618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f091c0fbd70 0x7f091c10f920 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f090c00b0d0 tx=0x7f090c009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:02.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.370+0000 7f0923f7e700 1 -- 172.21.15.43:0/3476889618 shutdown_connections 2023-12-08T20:26:02.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.370+0000 7f0923f7e700 1 --2- 172.21.15.43:0/3476889618 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f0908068f60 0x7f090806b410 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:02.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.370+0000 7f0923f7e700 1 --2- 172.21.15.43:0/3476889618 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f091c0fb420 0x7f091c10f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:02.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.371+0000 7f0923f7e700 1 --2- 172.21.15.43:0/3476889618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f091c0fbd70 0x7f091c10f920 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:02.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.371+0000 7f0923f7e700 1 -- 172.21.15.43:0/3476889618 >> 172.21.15.43:0/3476889618 conn(0x7f091c0f7070 msgr2=0x7f091c103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:02.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.371+0000 7f0923f7e700 1 -- 172.21.15.43:0/3476889618 shutdown_connections 2023-12-08T20:26:02.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:02.371+0000 7f0923f7e700 1 -- 172.21.15.43:0/3476889618 wait complete. 2023-12-08T20:26:02.373 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 13 2023-12-08T20:26:02.386 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 12, 'max_mds': 2, 'flags': 18} 2023-12-08T20:26:02.386 INFO:teuthology.run_tasks:Running task kclient... 2023-12-08T20:26:02.429 INFO:tasks.kclient:Mounting kernel clients... 2023-12-08T20:26:02.429 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-08T20:26:02.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:02.429 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2023-12-08T20:26:02.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:02.452 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2023-12-08T20:26:02.529 INFO:teuthology.orchestra.run.smithi043.stderr:Cannot find device "ceph-brx" 2023-12-08T20:26:02.530 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:26:02.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:02.530 DEBUG:teuthology.orchestra.run.smithi111:> ip netns list 2023-12-08T20:26:02.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:02.554 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link delete ceph-brx 2023-12-08T20:26:02.632 INFO:teuthology.orchestra.run.smithi111.stderr:Cannot find device "ceph-brx" 2023-12-08T20:26:02.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:26:02.633 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-08T20:26:02.634 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-08T20:26:02.634 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T20:26:02.634 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph fs ls 2023-12-08T20:26:02.666 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:02 smithi043 ceph-mon[111966]: pgmap v144: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 1 op/s 2023-12-08T20:26:02.666 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:02 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/414122323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-08T20:26:02.666 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:02 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/89583907' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-08T20:26:02.666 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:02 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3476889618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-08T20:26:02.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:02 smithi111 ceph-mon[121341]: pgmap v144: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 1 op/s 2023-12-08T20:26:02.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:02 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/414122323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-08T20:26:02.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:02 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/89583907' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-08T20:26:02.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:02 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/3476889618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-08T20:26:02.936 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:26:04.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.036+0000 7eff46d54700 1 -- 172.21.15.43:0/3470198204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff40065390 msgr2=0x7eff40065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:04.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.036+0000 7eff46d54700 1 --2- 172.21.15.43:0/3470198204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff40065390 0x7eff40065800 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7eff30004940 tx=0x7eff30009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:04.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.036+0000 7eff46d54700 1 -- 172.21.15.43:0/3470198204 shutdown_connections 2023-12-08T20:26:04.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.036+0000 7eff46d54700 1 --2- 172.21.15.43:0/3470198204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff40065390 0x7eff40065800 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:04.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.036+0000 7eff46d54700 1 --2- 172.21.15.43:0/3470198204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff40102c20 0x7eff40102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:04.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.036+0000 7eff46d54700 1 -- 172.21.15.43:0/3470198204 >> 172.21.15.43:0/3470198204 conn(0x7eff400719b0 msgr2=0x7eff40071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:04.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.036+0000 7eff46d54700 1 -- 172.21.15.43:0/3470198204 shutdown_connections 2023-12-08T20:26:04.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.036+0000 7eff46d54700 1 -- 172.21.15.43:0/3470198204 wait complete. 2023-12-08T20:26:04.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.036+0000 7eff46d54700 1 Processor -- start 2023-12-08T20:26:04.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.036+0000 7eff46d54700 1 -- start start 2023-12-08T20:26:04.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.037+0000 7eff46d54700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff40065390 0x7eff40113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:04.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.037+0000 7eff46d54700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff40102c20 0x7eff40113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:04.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.037+0000 7eff46d54700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff401142c0 con 0x7eff40065390 2023-12-08T20:26:04.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.037+0000 7eff46d54700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4010d5f0 con 0x7eff40102c20 2023-12-08T20:26:04.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.037+0000 7eff44af0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff40065390 0x7eff40113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:04.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.037+0000 7eff44af0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff40065390 0x7eff40113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34400/0 (socket says 172.21.15.43:34400) 2023-12-08T20:26:04.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.037+0000 7eff44af0700 1 -- 172.21.15.43:0/3703997814 learned_addr learned my addr 172.21.15.43:0/3703997814 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:26:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.037+0000 7eff37fff700 1 --2- 172.21.15.43:0/3703997814 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff40102c20 0x7eff40113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.037+0000 7eff44af0700 1 -- 172.21.15.43:0/3703997814 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff40102c20 msgr2=0x7eff40113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.037+0000 7eff44af0700 1 --2- 172.21.15.43:0/3703997814 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff40102c20 0x7eff40113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.037+0000 7eff44af0700 1 -- 172.21.15.43:0/3703997814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff30005040 con 0x7eff40065390 2023-12-08T20:26:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.037+0000 7eff37fff700 1 --2- 172.21.15.43:0/3703997814 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff40102c20 0x7eff40113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T20:26:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.038+0000 7eff44af0700 1 --2- 172.21.15.43:0/3703997814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff40065390 0x7eff40113730 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7eff3c002a50 tx=0x7eff3c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.038+0000 7eff357fa700 1 -- 172.21.15.43:0/3703997814 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff3c007cc0 con 0x7eff40065390 2023-12-08T20:26:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.038+0000 7eff357fa700 1 -- 172.21.15.43:0/3703997814 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7eff3c00f040 con 0x7eff40065390 2023-12-08T20:26:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.038+0000 7eff46d54700 1 -- 172.21.15.43:0/3703997814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff4010d8d0 con 0x7eff40065390 2023-12-08T20:26:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.038+0000 7eff357fa700 1 -- 172.21.15.43:0/3703997814 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff3c00d9c0 con 0x7eff40065390 2023-12-08T20:26:04.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.038+0000 7eff46d54700 1 -- 172.21.15.43:0/3703997814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4010de10 con 0x7eff40065390 2023-12-08T20:26:04.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.039+0000 7eff46d54700 1 -- 172.21.15.43:0/3703997814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff400fff40 con 0x7eff40065390 2023-12-08T20:26:04.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.039+0000 7eff357fa700 1 -- 172.21.15.43:0/3703997814 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7eff3c00db20 con 0x7eff40065390 2023-12-08T20:26:04.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.040+0000 7eff357fa700 1 --2- 172.21.15.43:0/3703997814 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7eff28068f70 0x7eff2806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:04.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.040+0000 7eff357fa700 1 -- 172.21.15.43:0/3703997814 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7eff3c086ad0 con 0x7eff40065390 2023-12-08T20:26:04.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.040+0000 7eff37fff700 1 --2- 172.21.15.43:0/3703997814 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7eff28068f70 0x7eff2806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:04.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.040+0000 7eff37fff700 1 --2- 172.21.15.43:0/3703997814 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7eff28068f70 0x7eff2806b420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7eff4010e800 tx=0x7eff30009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:04.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.045+0000 7eff357fa700 1 -- 172.21.15.43:0/3703997814 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7eff3c0569b0 con 0x7eff40065390 2023-12-08T20:26:04.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.293+0000 7eff46d54700 1 -- 172.21.15.43:0/3703997814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7eff4004bb80 con 0x7eff40065390 2023-12-08T20:26:04.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.294+0000 7eff357fa700 1 -- 172.21.15.43:0/3703997814 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7eff3c056540 con 0x7eff40065390 2023-12-08T20:26:04.295 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-08T20:26:04.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.296+0000 7eff46d54700 1 -- 172.21.15.43:0/3703997814 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7eff28068f70 msgr2=0x7eff2806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:04.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.296+0000 7eff46d54700 1 --2- 172.21.15.43:0/3703997814 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7eff28068f70 0x7eff2806b420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7eff4010e800 tx=0x7eff30009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:04.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.296+0000 7eff46d54700 1 -- 172.21.15.43:0/3703997814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff40065390 msgr2=0x7eff40113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:04.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.296+0000 7eff46d54700 1 --2- 172.21.15.43:0/3703997814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff40065390 0x7eff40113730 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7eff3c002a50 tx=0x7eff3c0046b0 comp rx=0 tx=0).stop 2023-12-08T20:26:04.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.296+0000 7eff46d54700 1 -- 172.21.15.43:0/3703997814 shutdown_connections 2023-12-08T20:26:04.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.296+0000 7eff46d54700 1 --2- 172.21.15.43:0/3703997814 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7eff28068f70 0x7eff2806b420 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:04.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.296+0000 7eff46d54700 1 --2- 172.21.15.43:0/3703997814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff40065390 0x7eff40113730 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:04.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.296+0000 7eff46d54700 1 --2- 172.21.15.43:0/3703997814 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff40102c20 0x7eff40113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:04.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.296+0000 7eff46d54700 1 -- 172.21.15.43:0/3703997814 >> 172.21.15.43:0/3703997814 conn(0x7eff400719b0 msgr2=0x7eff400fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:04.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.296+0000 7eff46d54700 1 -- 172.21.15.43:0/3703997814 shutdown_connections 2023-12-08T20:26:04.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:04.296+0000 7eff46d54700 1 -- 172.21.15.43:0/3703997814 wait complete. 2023-12-08T20:26:04.611 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:04 smithi043 ceph-mon[111966]: pgmap v145: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-08T20:26:04.612 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:04 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3703997814' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-08T20:26:04.612 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:26:04.670 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-08T20:26:04.670 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T20:26:04.671 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2023-12-08T20:26:04.671 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-08T20:26:04.671 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T20:26:04.671 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-08T20:26:04.671 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T20:26:04.671 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T20:26:04.671 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T20:26:04.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:04.671 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2023-12-08T20:26:04.736 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T20:26:04.737 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T20:26:04.737 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T20:26:04.737 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-12-08T20:26:04.737 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2023-12-08T20:26:04.737 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-12-08T20:26:04.737 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T20:26:04.737 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2023-12-08T20:26:04.737 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2023-12-08T20:26:04.737 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T20:26:04.737 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2023-12-08T20:26:04.737 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2023-12-08T20:26:04.737 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T20:26:04.737 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2023-12-08T20:26:04.737 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2023-12-08T20:26:04.738 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-08T20:26:04.738 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42050sec preferred_lft 42050sec 2023-12-08T20:26:04.738 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link 2023-12-08T20:26:04.738 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-12-08T20:26:04.738 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T20:26:04.738 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2023-12-08T20:26:04.738 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2023-12-08T20:26:04.738 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-08T20:26:04.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:04.739 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-12-08T20:26:04.739 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-12-08T20:26:04.739 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add name ceph-brx type bridge 2023-12-08T20:26:04.739 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr flush dev ceph-brx 2023-12-08T20:26:04.739 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set ceph-brx up 2023-12-08T20:26:04.739 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-08T20:26:04.739 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-12-08T20:26:04.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:04.922 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T20:26:04.955 INFO:teuthology.orchestra.run.smithi043.stdout:1 2023-12-08T20:26:04.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:04.956 DEBUG:teuthology.orchestra.run.smithi043:> route 2023-12-08T20:26:04.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:04 smithi111 ceph-mon[121341]: pgmap v145: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-08T20:26:04.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:04 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/3703997814' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-08T20:26:04.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:26:05.037 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2023-12-08T20:26:05.037 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T20:26:05.037 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-08T20:26:05.037 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-08T20:26:05.037 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T20:26:05.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:05.038 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-12-08T20:26:05.038 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-12-08T20:26:05.038 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T20:26:05.038 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T20:26:05.038 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T20:26:05.038 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-12-08T20:26:05.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:05.341 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2023-12-08T20:26:05.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:05.364 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2023-12-08T20:26:05.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:05.429 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-12-08T20:26:05.429 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-12-08T20:26:05.429 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:26:05.429 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-08T20:26:05.429 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-12-08T20:26:05.540 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-08T20:26:05.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:05.540 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-12-08T20:26:05.540 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-12-08T20:26:05.540 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-08T20:26:05.540 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-08T20:26:05.540 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-08T20:26:05.540 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-08T20:26:05.540 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-08T20:26:05.541 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-12-08T20:26:05.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:05.759 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-12-08T20:26:05.759 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-12-08T20:26:05.759 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2023-12-08T20:26:05.759 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.0 master ceph-brx 2023-12-08T20:26:05.759 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-12-08T20:26:05.876 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T20:26:05.876 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T20:26:05.897 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-08T20:26:05.897 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T20:26:05.897 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T20:26:05.959 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-08T20:26:05.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:05.960 DEBUG:teuthology.orchestra.run.smithi043:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-08T20:26:06.063 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-08T20:26:06.064 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-08T20:26:06.064 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2023-12-08T20:26:06.151 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-08T20:26:06.151 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-08T20:26:06.151 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2023-12-08T20:26:06.152 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.111:3300" 2023-12-08T20:26:06.152 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-08T20:26:06.170 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-08T20:26:06.171 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-08T20:26:06.171 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2023-12-08T20:26:06.171 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.111:3300" 2023-12-08T20:26:06.171 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-08T20:26:06.171 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:6789,172.21.15.111:6789" 2023-12-08T20:26:06.171 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.43:6789,172.21.15.111:6789:/ 2023-12-08T20:26:06.171 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=28476818-9607-11ee-95a3-87774f69a715" will pass to kernel 2023-12-08T20:26:06.174 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T20:26:06.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:06.175 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-08T20:26:06.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:06.207 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T20:26:06.301 INFO:teuthology.orchestra.run.smithi043.stdout:client24369 2023-12-08T20:26:06.301 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-12-08T20:26:06.302 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T20:26:06.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:06.326 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T20:26:06.425 INFO:teuthology.orchestra.run.smithi043.stdout:client24369 2023-12-08T20:26:06.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:06.425 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T20:26:06.480 INFO:teuthology.orchestra.run.smithi043.stdout:client24369 2023-12-08T20:26:06.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:06.480 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/28476818-9607-11ee-95a3-87774f69a715.client24369/status') 2023-12-08T20:26:06.541 INFO:teuthology.orchestra.run.smithi043.stdout:instance: client.24369 (3)172.21.15.43:0/1224441074 2023-12-08T20:26:06.541 INFO:teuthology.orchestra.run.smithi043.stdout:blocklisted: false 2023-12-08T20:26:06.541 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records in 2023-12-08T20:26:06.542 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records out 2023-12-08T20:26:06.542 INFO:teuthology.orchestra.run.smithi043.stderr:71 bytes copied, 2.6817e-05 s, 2.6 MB/s 2023-12-08T20:26:06.543 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-12-08T20:26:06.543 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-08T20:26:06.543 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T20:26:06.543 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 28476818-9607-11ee-95a3-87774f69a715 -- ceph fs ls 2023-12-08T20:26:06.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:06 smithi111 ceph-mon[121341]: pgmap v146: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-08T20:26:06.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:06 smithi043 ceph-mon[111966]: pgmap v146: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-08T20:26:06.840 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:26:08.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.008+0000 7f7330d8a700 1 -- 172.21.15.43:0/1764322952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f732c0fcee0 msgr2=0x7f732c109190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:08.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.008+0000 7f7330d8a700 1 --2- 172.21.15.43:0/1764322952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f732c0fcee0 0x7f732c109190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7320004940 tx=0x7f7320009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:08.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.008+0000 7f7330d8a700 1 -- 172.21.15.43:0/1764322952 shutdown_connections 2023-12-08T20:26:08.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.008+0000 7f7330d8a700 1 --2- 172.21.15.43:0/1764322952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f732c0fcee0 0x7f732c109190 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:08.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.008+0000 7f7330d8a700 1 --2- 172.21.15.43:0/1764322952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f732c0fc5d0 0x7f732c0fc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:08.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.008+0000 7f7330d8a700 1 -- 172.21.15.43:0/1764322952 >> 172.21.15.43:0/1764322952 conn(0x7f732c0719b0 msgr2=0x7f732c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:08.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.009+0000 7f7330d8a700 1 -- 172.21.15.43:0/1764322952 shutdown_connections 2023-12-08T20:26:08.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.009+0000 7f7330d8a700 1 -- 172.21.15.43:0/1764322952 wait complete. 2023-12-08T20:26:08.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.009+0000 7f7330d8a700 1 Processor -- start 2023-12-08T20:26:08.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.009+0000 7f7330d8a700 1 -- start start 2023-12-08T20:26:08.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.010+0000 7f7330d8a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f732c0fc5d0 0x7f732c115980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:08.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.010+0000 7f7330d8a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f732c0fcee0 0x7f732c115ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:08.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.010+0000 7f7330d8a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c116510 con 0x7f732c0fcee0 2023-12-08T20:26:08.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.010+0000 7f7330d8a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c10f840 con 0x7f732c0fc5d0 2023-12-08T20:26:08.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.010+0000 7f7329d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f732c0fcee0 0x7f732c115ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:08.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.010+0000 7f7329d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f732c0fcee0 0x7f732c115ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34420/0 (socket says 172.21.15.43:34420) 2023-12-08T20:26:08.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.010+0000 7f7329d9b700 1 -- 172.21.15.43:0/1673282655 learned_addr learned my addr 172.21.15.43:0/1673282655 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:26:08.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.010+0000 7f732a59c700 1 --2- 172.21.15.43:0/1673282655 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f732c0fc5d0 0x7f732c115980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:08.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.010+0000 7f7329d9b700 1 -- 172.21.15.43:0/1673282655 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f732c0fc5d0 msgr2=0x7f732c115980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:08.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.010+0000 7f7329d9b700 1 --2- 172.21.15.43:0/1673282655 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f732c0fc5d0 0x7f732c115980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:08.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.010+0000 7f7329d9b700 1 -- 172.21.15.43:0/1673282655 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7320005040 con 0x7f732c0fcee0 2023-12-08T20:26:08.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.010+0000 7f7329d9b700 1 --2- 172.21.15.43:0/1673282655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f732c0fcee0 0x7f732c115ec0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f732000b3b0 tx=0x7f7320009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:08.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.011+0000 7f731affd700 1 -- 172.21.15.43:0/1673282655 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f732000e040 con 0x7f732c0fcee0 2023-12-08T20:26:08.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.011+0000 7f731affd700 1 -- 172.21.15.43:0/1673282655 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f732001c430 con 0x7f732c0fcee0 2023-12-08T20:26:08.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.011+0000 7f731affd700 1 -- 172.21.15.43:0/1673282655 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7320013640 con 0x7f732c0fcee0 2023-12-08T20:26:08.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.011+0000 7f7330d8a700 1 -- 172.21.15.43:0/1673282655 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f732c10fac0 con 0x7f732c0fcee0 2023-12-08T20:26:08.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.011+0000 7f7330d8a700 1 -- 172.21.15.43:0/1673282655 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732c110000 con 0x7f732c0fcee0 2023-12-08T20:26:08.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.012+0000 7f7330d8a700 1 -- 172.21.15.43:0/1673282655 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f732c1068c0 con 0x7f732c0fcee0 2023-12-08T20:26:08.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.013+0000 7f731affd700 1 -- 172.21.15.43:0/1673282655 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f732001c5a0 con 0x7f732c0fcee0 2023-12-08T20:26:08.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.013+0000 7f731affd700 1 --2- 172.21.15.43:0/1673282655 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f7314068f60 0x7f731406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:08.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.013+0000 7f731affd700 1 -- 172.21.15.43:0/1673282655 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f7320087790 con 0x7f732c0fcee0 2023-12-08T20:26:08.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.013+0000 7f732a59c700 1 --2- 172.21.15.43:0/1673282655 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f7314068f60 0x7f731406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:08.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.014+0000 7f732a59c700 1 --2- 172.21.15.43:0/1673282655 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f7314068f60 0x7f731406b410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f731c007a40 tx=0x7f731c009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:08.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.018+0000 7f731affd700 1 -- 172.21.15.43:0/1673282655 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7320057840 con 0x7f732c0fcee0 2023-12-08T20:26:08.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.268+0000 7f7330d8a700 1 -- 172.21.15.43:0/1673282655 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f732c110fd0 con 0x7f732c0fcee0 2023-12-08T20:26:08.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.269+0000 7f731affd700 1 -- 172.21.15.43:0/1673282655 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7f732c110fd0 con 0x7f732c0fcee0 2023-12-08T20:26:08.271 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-08T20:26:08.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.271+0000 7f7330d8a700 1 -- 172.21.15.43:0/1673282655 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f7314068f60 msgr2=0x7f731406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:08.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.271+0000 7f7330d8a700 1 --2- 172.21.15.43:0/1673282655 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f7314068f60 0x7f731406b410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f731c007a40 tx=0x7f731c009da0 comp rx=0 tx=0).stop 2023-12-08T20:26:08.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.271+0000 7f7330d8a700 1 -- 172.21.15.43:0/1673282655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f732c0fcee0 msgr2=0x7f732c115ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:08.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.271+0000 7f7330d8a700 1 --2- 172.21.15.43:0/1673282655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f732c0fcee0 0x7f732c115ec0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f732000b3b0 tx=0x7f7320009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:08.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.271+0000 7f7330d8a700 1 -- 172.21.15.43:0/1673282655 shutdown_connections 2023-12-08T20:26:08.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.271+0000 7f7330d8a700 1 --2- 172.21.15.43:0/1673282655 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f7314068f60 0x7f731406b410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:08.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.271+0000 7f7330d8a700 1 --2- 172.21.15.43:0/1673282655 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f732c0fc5d0 0x7f732c115980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:08.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.271+0000 7f7330d8a700 1 --2- 172.21.15.43:0/1673282655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f732c0fcee0 0x7f732c115ec0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:08.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.271+0000 7f7330d8a700 1 -- 172.21.15.43:0/1673282655 >> 172.21.15.43:0/1673282655 conn(0x7f732c0719b0 msgr2=0x7f732c0fa770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:08.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.271+0000 7f7330d8a700 1 -- 172.21.15.43:0/1673282655 shutdown_connections 2023-12-08T20:26:08.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:08.271+0000 7f7330d8a700 1 -- 172.21.15.43:0/1673282655 wait complete. 2023-12-08T20:26:08.586 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:08 smithi043 ceph-mon[111966]: pgmap v147: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-08T20:26:08.586 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:08 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/1673282655' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-08T20:26:08.661 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-08T20:26:08.661 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T20:26:08.661 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi111.front.sepia.ceph.com 2023-12-08T20:26:08.661 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-08T20:26:08.661 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T20:26:08.661 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-08T20:26:08.661 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T20:26:08.661 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T20:26:08.661 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T20:26:08.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:08.661 DEBUG:teuthology.orchestra.run.smithi111:> ip addr 2023-12-08T20:26:08.685 INFO:teuthology.orchestra.run.smithi111.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T20:26:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T20:26:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T20:26:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: valid_lft forever preferred_lft forever 2023-12-08T20:26:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: inet6 ::1/128 scope host 2023-12-08T20:26:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: valid_lft forever preferred_lft forever 2023-12-08T20:26:08.685 INFO:teuthology.orchestra.run.smithi111.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T20:26:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: link/ether 0c:c4:7a:d8:a1:24 brd ff:ff:ff:ff:ff:ff 2023-12-08T20:26:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: altname enp7s0f0 2023-12-08T20:26:08.685 INFO:teuthology.orchestra.run.smithi111.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T20:26:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: link/ether 0c:c4:7a:d8:a1:25 brd ff:ff:ff:ff:ff:ff 2023-12-08T20:26:08.685 INFO:teuthology.orchestra.run.smithi111.stdout: altname enp7s0f1 2023-12-08T20:26:08.685 INFO:teuthology.orchestra.run.smithi111.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T20:26:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: link/ether 0c:c4:7a:8f:cc:2e brd ff:ff:ff:ff:ff:ff 2023-12-08T20:26:08.686 INFO:teuthology.orchestra.run.smithi111.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T20:26:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: link/ether 0c:c4:7a:8f:cc:2f brd ff:ff:ff:ff:ff:ff 2023-12-08T20:26:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: inet 172.21.15.111/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-08T20:26:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: valid_lft 42063sec preferred_lft 42063sec 2023-12-08T20:26:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: inet6 fe80::ec4:7aff:fe8f:cc2f/64 scope link 2023-12-08T20:26:08.686 INFO:teuthology.orchestra.run.smithi111.stdout: valid_lft forever preferred_lft forever 2023-12-08T20:26:08.686 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-08T20:26:08.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:08.686 DEBUG:teuthology.orchestra.run.smithi111:> (cd / && exec bash -c ' 2023-12-08T20:26:08.686 DEBUG:teuthology.orchestra.run.smithi111:> set -e 2023-12-08T20:26:08.687 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link add name ceph-brx type bridge 2023-12-08T20:26:08.687 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip addr flush dev ceph-brx 2023-12-08T20:26:08.687 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link set ceph-brx up 2023-12-08T20:26:08.687 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-08T20:26:08.687 DEBUG:teuthology.orchestra.run.smithi111:> ') 2023-12-08T20:26:08.770 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:08 smithi111 ceph-mon[121341]: pgmap v147: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-08T20:26:08.770 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:08 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/1673282655' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-08T20:26:08.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:08.862 DEBUG:teuthology.orchestra.run.smithi111:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T20:26:08.889 INFO:teuthology.orchestra.run.smithi111.stdout:1 2023-12-08T20:26:08.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:08.891 DEBUG:teuthology.orchestra.run.smithi111:> route 2023-12-08T20:26:08.973 INFO:teuthology.orchestra.run.smithi111.stdout:Kernel IP routing table 2023-12-08T20:26:08.973 INFO:teuthology.orchestra.run.smithi111.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T20:26:08.973 INFO:teuthology.orchestra.run.smithi111.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T20:26:08.973 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T20:26:08.973 INFO:teuthology.orchestra.run.smithi111.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T20:26:08.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:08.974 DEBUG:teuthology.orchestra.run.smithi111:> (cd / && exec bash -c ' 2023-12-08T20:26:08.974 DEBUG:teuthology.orchestra.run.smithi111:> set -e 2023-12-08T20:26:08.974 DEBUG:teuthology.orchestra.run.smithi111:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T20:26:08.974 DEBUG:teuthology.orchestra.run.smithi111:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T20:26:08.974 DEBUG:teuthology.orchestra.run.smithi111:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T20:26:08.974 DEBUG:teuthology.orchestra.run.smithi111:> ') 2023-12-08T20:26:09.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:09.257 DEBUG:teuthology.orchestra.run.smithi111:> ip netns list 2023-12-08T20:26:09.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:09.275 DEBUG:teuthology.orchestra.run.smithi111:> ip netns list-id 2023-12-08T20:26:09.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:09.334 DEBUG:teuthology.orchestra.run.smithi111:> (cd / && exec bash -c ' 2023-12-08T20:26:09.334 DEBUG:teuthology.orchestra.run.smithi111:> set -e 2023-12-08T20:26:09.334 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T20:26:09.335 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-08T20:26:09.335 DEBUG:teuthology.orchestra.run.smithi111:> ') 2023-12-08T20:26:09.430 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-08T20:26:09.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:09.431 DEBUG:teuthology.orchestra.run.smithi111:> (cd / && exec bash -c ' 2023-12-08T20:26:09.431 DEBUG:teuthology.orchestra.run.smithi111:> set -e 2023-12-08T20:26:09.431 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-08T20:26:09.431 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-08T20:26:09.431 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-08T20:26:09.432 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-08T20:26:09.432 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-08T20:26:09.432 DEBUG:teuthology.orchestra.run.smithi111:> ') 2023-12-08T20:26:09.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:09.651 DEBUG:teuthology.orchestra.run.smithi111:> (cd / && exec bash -c ' 2023-12-08T20:26:09.651 DEBUG:teuthology.orchestra.run.smithi111:> set -e 2023-12-08T20:26:09.651 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link set brx.0 up 2023-12-08T20:26:09.651 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link set dev brx.0 master ceph-brx 2023-12-08T20:26:09.651 DEBUG:teuthology.orchestra.run.smithi111:> ') 2023-12-08T20:26:09.747 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T20:26:09.747 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-08T20:26:09.767 INFO:teuthology.orchestra.run.smithi111.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-08T20:26:09.767 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T20:26:09.767 DEBUG:teuthology.orchestra.run.smithi111:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-08T20:26:09.824 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-08T20:26:09.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:09.825 DEBUG:teuthology.orchestra.run.smithi111:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-08T20:26:09.929 INFO:teuthology.orchestra.run.smithi111.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-08T20:26:09.929 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-08T20:26:09.929 INFO:teuthology.orchestra.run.smithi111.stdout:invalid new device string format 2023-12-08T20:26:10.016 INFO:teuthology.orchestra.run.smithi111.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-08T20:26:10.016 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-08T20:26:10.016 INFO:teuthology.orchestra.run.smithi111.stdout:invalid new device string format 2023-12-08T20:26:10.016 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.111:3300" 2023-12-08T20:26:10.016 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-08T20:26:10.035 INFO:teuthology.orchestra.run.smithi111.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-08T20:26:10.035 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-08T20:26:10.035 INFO:teuthology.orchestra.run.smithi111.stdout:invalid new device string format 2023-12-08T20:26:10.035 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.111:3300" 2023-12-08T20:26:10.035 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-08T20:26:10.035 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: resolved to: "172.21.15.43:6789,172.21.15.111:6789" 2023-12-08T20:26:10.036 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.43:6789,172.21.15.111:6789:/ 2023-12-08T20:26:10.036 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=28476818-9607-11ee-95a3-87774f69a715" will pass to kernel 2023-12-08T20:26:10.038 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T20:26:10.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:10.038 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-08T20:26:10.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:10.066 DEBUG:teuthology.orchestra.run.smithi111:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T20:26:10.139 INFO:teuthology.orchestra.run.smithi111.stdout:client14516 2023-12-08T20:26:10.139 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-12-08T20:26:10.139 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T20:26:10.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:10.202 DEBUG:teuthology.orchestra.run.smithi111:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T20:26:10.274 INFO:teuthology.orchestra.run.smithi111.stdout:client14516 2023-12-08T20:26:10.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:10.275 DEBUG:teuthology.orchestra.run.smithi111:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T20:26:10.348 INFO:teuthology.orchestra.run.smithi111.stdout:client14516 2023-12-08T20:26:10.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:26:10.348 DEBUG:teuthology.orchestra.run.smithi111:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/28476818-9607-11ee-95a3-87774f69a715.client14516/status') 2023-12-08T20:26:10.429 INFO:teuthology.orchestra.run.smithi111.stdout:instance: client.14516 (3)172.21.15.111:0/3022277986 2023-12-08T20:26:10.429 INFO:teuthology.orchestra.run.smithi111.stdout:blocklisted: false 2023-12-08T20:26:10.430 INFO:teuthology.orchestra.run.smithi111.stderr:0+1 records in 2023-12-08T20:26:10.430 INFO:teuthology.orchestra.run.smithi111.stderr:0+1 records out 2023-12-08T20:26:10.430 INFO:teuthology.orchestra.run.smithi111.stderr:72 bytes copied, 2.2926e-05 s, 3.1 MB/s 2023-12-08T20:26:10.431 INFO:teuthology.run_tasks:Running task print... 2023-12-08T20:26:10.444 INFO:teuthology.task.print:**** done client 2023-12-08T20:26:10.445 INFO:teuthology.run_tasks:Running task parallel... 2023-12-08T20:26:10.548 INFO:teuthology.task.parallel:starting parallel... 2023-12-08T20:26:10.548 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-08T20:26:10.551 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-08T20:26:10.551 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi043.front.sepia.ceph.com 2023-12-08T20:26:10.551 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-08T20:26:10.552 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-08T20:26:10.552 INFO:teuthology.task.sequential:In sequential, running task workunit... 2023-12-08T20:26:10.556 INFO:tasks.workunit:Pulling workunits from ref 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:26:10.556 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-08T20:26:10.556 INFO:tasks.workunit:timeout=3h 2023-12-08T20:26:10.557 INFO:tasks.workunit:cleanup=True 2023-12-08T20:26:10.557 DEBUG:teuthology.orchestra.run.smithi043:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-08T20:26:10.584 INFO:teuthology.orchestra.run.smithi043.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-08T20:26:10.584 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-12-08T20:26:10.584 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 99h/153d Inode: 1 Links: 2 2023-12-08T20:26:10.584 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T20:26:10.584 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-08T20:26:10.585 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-08T20:26:10.585 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2023-12-08 20:25:44.561797020 +0000 2023-12-08T20:26:10.585 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2023-12-08 20:26:06.202922643 +0000 2023-12-08T20:26:10.585 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2023-12-08 20:25:44.561797020 +0000 2023-12-08T20:26:10.585 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-08T20:26:10.585 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-08T20:26:10.660 DEBUG:teuthology.orchestra.run.smithi111:> stat -- /home/ubuntu/cephtest/mnt.1 2023-12-08T20:26:10.681 INFO:teuthology.orchestra.run.smithi111.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-12-08T20:26:10.681 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-12-08T20:26:10.681 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 78h/120d Inode: 1 Links: 3 2023-12-08T20:26:10.681 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T20:26:10.682 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-08T20:26:10.682 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-08T20:26:10.682 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2023-12-08 20:26:10.653867802 +0000 2023-12-08T20:26:10.682 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2023-12-08 20:26:10.653867802 +0000 2023-12-08T20:26:10.682 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: 2023-12-08 20:25:44.561797020 +0000 2023-12-08T20:26:10.682 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-12-08T20:26:10.683 DEBUG:teuthology.orchestra.run.smithi111:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-12-08T20:26:10.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:10 smithi111 ceph-mon[121341]: pgmap v148: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-08T20:26:10.750 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:26:10.750 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:26:10.770 INFO:tasks.workunit.client.0.smithi043.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-08T20:26:10.808 INFO:tasks.workunit.client.1.smithi111.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-12-08T20:26:10.869 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:26:11.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:10 smithi043 ceph-mon[111966]: pgmap v148: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-08T20:26:12.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.073+0000 7f6cdf731700 1 -- 172.21.15.43:0/2789330924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cd8100050 msgr2=0x7f6cd8102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:12.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.073+0000 7f6cdf731700 1 --2- 172.21.15.43:0/2789330924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cd8100050 0x7f6cd8102430 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8004940 tx=0x7f6cc8009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:12.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.073+0000 7f6cdf731700 1 -- 172.21.15.43:0/2789330924 shutdown_connections 2023-12-08T20:26:12.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.073+0000 7f6cdf731700 1 --2- 172.21.15.43:0/2789330924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cd8100050 0x7f6cd8102430 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:12.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.073+0000 7f6cdf731700 1 --2- 172.21.15.43:0/2789330924 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6cd80fd730 0x7f6cd80ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:12.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.073+0000 7f6cdf731700 1 -- 172.21.15.43:0/2789330924 >> 172.21.15.43:0/2789330924 conn(0x7f6cd80f7190 msgr2=0x7f6cd80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:12.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.074+0000 7f6cdf731700 1 -- 172.21.15.43:0/2789330924 shutdown_connections 2023-12-08T20:26:12.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.074+0000 7f6cdf731700 1 -- 172.21.15.43:0/2789330924 wait complete. 2023-12-08T20:26:12.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.074+0000 7f6cdf731700 1 Processor -- start 2023-12-08T20:26:12.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.074+0000 7f6cdf731700 1 -- start start 2023-12-08T20:26:12.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.074+0000 7f6cdf731700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cd80fd730 0x7f6cd810d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:12.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.074+0000 7f6cdf731700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6cd8100050 0x7f6cd810da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:12.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.074+0000 7f6cdf731700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd810e070 con 0x7f6cd80fd730 2023-12-08T20:26:12.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.074+0000 7f6cdf731700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd810e910 con 0x7f6cd8100050 2023-12-08T20:26:12.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.074+0000 7f6cdd4cd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cd80fd730 0x7f6cd810d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:12.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.074+0000 7f6cdd4cd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cd80fd730 0x7f6cd810d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39442/0 (socket says 172.21.15.43:39442) 2023-12-08T20:26:12.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.074+0000 7f6cdd4cd700 1 -- 172.21.15.43:0/1164535011 learned_addr learned my addr 172.21.15.43:0/1164535011 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:26:12.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.075+0000 7f6cdcccc700 1 --2- 172.21.15.43:0/1164535011 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6cd8100050 0x7f6cd810da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:12.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.075+0000 7f6cdd4cd700 1 -- 172.21.15.43:0/1164535011 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6cd8100050 msgr2=0x7f6cd810da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:12.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.075+0000 7f6cdd4cd700 1 --2- 172.21.15.43:0/1164535011 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6cd8100050 0x7f6cd810da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:12.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.075+0000 7f6cdd4cd700 1 -- 172.21.15.43:0/1164535011 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc8005040 con 0x7f6cd80fd730 2023-12-08T20:26:12.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.075+0000 7f6cdcccc700 1 --2- 172.21.15.43:0/1164535011 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6cd8100050 0x7f6cd810da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:26:12.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.075+0000 7f6cdd4cd700 1 --2- 172.21.15.43:0/1164535011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cd80fd730 0x7f6cd810d530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6cd400c8c0 tx=0x7f6cd40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:12.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.075+0000 7f6ccdffb700 1 -- 172.21.15.43:0/1164535011 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cd400a980 con 0x7f6cd80fd730 2023-12-08T20:26:12.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.075+0000 7f6ccdffb700 1 -- 172.21.15.43:0/1164535011 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6cd400ce60 con 0x7f6cd80fd730 2023-12-08T20:26:12.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.075+0000 7f6ccdffb700 1 -- 172.21.15.43:0/1164535011 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cd40113a0 con 0x7f6cd80fd730 2023-12-08T20:26:12.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.075+0000 7f6cdf731700 1 -- 172.21.15.43:0/1164535011 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd810ebf0 con 0x7f6cd80fd730 2023-12-08T20:26:12.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.075+0000 7f6cdf731700 1 -- 172.21.15.43:0/1164535011 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd810f130 con 0x7f6cd80fd730 2023-12-08T20:26:12.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.076+0000 7f6cdf731700 1 -- 172.21.15.43:0/1164535011 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd81075c0 con 0x7f6cd80fd730 2023-12-08T20:26:12.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.077+0000 7f6ccdffb700 1 -- 172.21.15.43:0/1164535011 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6cd4012400 con 0x7f6cd80fd730 2023-12-08T20:26:12.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.077+0000 7f6ccdffb700 1 --2- 172.21.15.43:0/1164535011 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6cc4068f60 0x7f6cc406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:12.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.077+0000 7f6ccdffb700 1 -- 172.21.15.43:0/1164535011 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6cd4086db0 con 0x7f6cd80fd730 2023-12-08T20:26:12.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.077+0000 7f6cdcccc700 1 --2- 172.21.15.43:0/1164535011 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6cc4068f60 0x7f6cc406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:12.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.078+0000 7f6cdcccc700 1 --2- 172.21.15.43:0/1164535011 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6cc4068f60 0x7f6cc406b410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8004560 tx=0x7f6cc8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:12.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.082+0000 7f6ccdffb700 1 -- 172.21.15.43:0/1164535011 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6cd4056db0 con 0x7f6cd80fd730 2023-12-08T20:26:12.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.281+0000 7f6cdf731700 1 -- 172.21.15.43:0/1164535011 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f6cd804bb80 con 0x7f6cd80fd730 2023-12-08T20:26:12.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.282+0000 7f6ccdffb700 1 -- 172.21.15.43:0/1164535011 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f6cd4056940 con 0x7f6cd80fd730 2023-12-08T20:26:12.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.284+0000 7f6cdf731700 1 -- 172.21.15.43:0/1164535011 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6cc4068f60 msgr2=0x7f6cc406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:12.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.284+0000 7f6cdf731700 1 --2- 172.21.15.43:0/1164535011 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6cc4068f60 0x7f6cc406b410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8004560 tx=0x7f6cc8009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:12.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.284+0000 7f6cdf731700 1 -- 172.21.15.43:0/1164535011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cd80fd730 msgr2=0x7f6cd810d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:12.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.284+0000 7f6cdf731700 1 --2- 172.21.15.43:0/1164535011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cd80fd730 0x7f6cd810d530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6cd400c8c0 tx=0x7f6cd40044c0 comp rx=0 tx=0).stop 2023-12-08T20:26:12.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.284+0000 7f6cdf731700 1 -- 172.21.15.43:0/1164535011 shutdown_connections 2023-12-08T20:26:12.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.284+0000 7f6cdf731700 1 --2- 172.21.15.43:0/1164535011 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6cc4068f60 0x7f6cc406b410 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:12.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.284+0000 7f6cdf731700 1 --2- 172.21.15.43:0/1164535011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cd80fd730 0x7f6cd810d530 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:12.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.284+0000 7f6cdf731700 1 --2- 172.21.15.43:0/1164535011 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6cd8100050 0x7f6cd810da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:12.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.284+0000 7f6cdf731700 1 -- 172.21.15.43:0/1164535011 >> 172.21.15.43:0/1164535011 conn(0x7f6cd80f7190 msgr2=0x7f6cd80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:12.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.284+0000 7f6cdf731700 1 -- 172.21.15.43:0/1164535011 shutdown_connections 2023-12-08T20:26:12.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:12.284+0000 7f6cdf731700 1 -- 172.21.15.43:0/1164535011 wait complete. 2023-12-08T20:26:12.677 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:12 smithi043 ceph-mon[111966]: pgmap v149: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-08T20:26:12.710 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-08T20:26:12.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:12 smithi111 ceph-mon[121341]: pgmap v149: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-08T20:26:13.054 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:26:14.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.160+0000 7feb06dd7700 1 -- 172.21.15.43:0/2704181225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb000fde00 msgr2=0x7feb000fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:14.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.160+0000 7feb06dd7700 1 --2- 172.21.15.43:0/2704181225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb000fde00 0x7feb000fe250 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feaec004940 tx=0x7feaec009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:14.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.160+0000 7feb06dd7700 1 -- 172.21.15.43:0/2704181225 shutdown_connections 2023-12-08T20:26:14.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.160+0000 7feb06dd7700 1 --2- 172.21.15.43:0/2704181225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb000fde00 0x7feb000fe250 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:14.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.160+0000 7feb06dd7700 1 --2- 172.21.15.43:0/2704181225 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feb000fcbf0 0x7feb000fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:14.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.160+0000 7feb06dd7700 1 -- 172.21.15.43:0/2704181225 >> 172.21.15.43:0/2704181225 conn(0x7feb000f82d0 msgr2=0x7feb000fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:14.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.160+0000 7feb06dd7700 1 -- 172.21.15.43:0/2704181225 shutdown_connections 2023-12-08T20:26:14.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.160+0000 7feb06dd7700 1 -- 172.21.15.43:0/2704181225 wait complete. 2023-12-08T20:26:14.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.161+0000 7feb06dd7700 1 Processor -- start 2023-12-08T20:26:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.161+0000 7feb06dd7700 1 -- start start 2023-12-08T20:26:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.161+0000 7feb06dd7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feb000fcbf0 0x7feb00071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.161+0000 7feb06dd7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb000fde00 0x7feb0006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.161+0000 7feb06dd7700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb00070590 con 0x7feb000fde00 2023-12-08T20:26:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.161+0000 7feb06dd7700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb00070700 con 0x7feb000fcbf0 2023-12-08T20:26:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.162+0000 7feafffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb000fde00 0x7feb0006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.162+0000 7feafffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb000fde00 0x7feb0006ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39456/0 (socket says 172.21.15.43:39456) 2023-12-08T20:26:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.162+0000 7feafffff700 1 -- 172.21.15.43:0/3520952175 learned_addr learned my addr 172.21.15.43:0/3520952175 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:26:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.162+0000 7feb04b73700 1 --2- 172.21.15.43:0/3520952175 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feb000fcbf0 0x7feb00071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.162+0000 7feafffff700 1 -- 172.21.15.43:0/3520952175 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feb000fcbf0 msgr2=0x7feb00071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.162+0000 7feafffff700 1 --2- 172.21.15.43:0/3520952175 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feb000fcbf0 0x7feb00071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.162+0000 7feafffff700 1 -- 172.21.15.43:0/3520952175 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaec005040 con 0x7feb000fde00 2023-12-08T20:26:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.162+0000 7feafffff700 1 --2- 172.21.15.43:0/3520952175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb000fde00 0x7feb0006ff90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7feaec009360 tx=0x7feaec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.162+0000 7feafd7fa700 1 -- 172.21.15.43:0/3520952175 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaec00e040 con 0x7feb000fde00 2023-12-08T20:26:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.162+0000 7feb06dd7700 1 -- 172.21.15.43:0/3520952175 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb00070980 con 0x7feb000fde00 2023-12-08T20:26:14.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.162+0000 7feafd7fa700 1 -- 172.21.15.43:0/3520952175 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feaec00bcd0 con 0x7feb000fde00 2023-12-08T20:26:14.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.162+0000 7feafd7fa700 1 -- 172.21.15.43:0/3520952175 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaec01c630 con 0x7feb000fde00 2023-12-08T20:26:14.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.162+0000 7feb06dd7700 1 -- 172.21.15.43:0/3520952175 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb001155b0 con 0x7feb000fde00 2023-12-08T20:26:14.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.163+0000 7feb06dd7700 1 -- 172.21.15.43:0/3520952175 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0004bb80 con 0x7feb000fde00 2023-12-08T20:26:14.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.164+0000 7feafd7fa700 1 -- 172.21.15.43:0/3520952175 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7feaec013960 con 0x7feb000fde00 2023-12-08T20:26:14.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.164+0000 7feafd7fa700 1 --2- 172.21.15.43:0/3520952175 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7feaf0068f60 0x7feaf006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:14.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.164+0000 7feafd7fa700 1 -- 172.21.15.43:0/3520952175 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7feaec088260 con 0x7feb000fde00 2023-12-08T20:26:14.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.164+0000 7feb04b73700 1 --2- 172.21.15.43:0/3520952175 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7feaf0068f60 0x7feaf006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:14.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.165+0000 7feb04b73700 1 --2- 172.21.15.43:0/3520952175 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7feaf0068f60 0x7feaf006b410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feaf4007fd0 tx=0x7feaf4009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:14.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.169+0000 7feafd7fa700 1 -- 172.21.15.43:0/3520952175 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7feaec0581c0 con 0x7feb000fde00 2023-12-08T20:26:14.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.368+0000 7feb06dd7700 1 -- 172.21.15.43:0/3520952175 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7feb001158a0 con 0x7feb000fde00 2023-12-08T20:26:14.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.368+0000 7feafd7fa700 1 -- 172.21.15.43:0/3520952175 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7feaec057d50 con 0x7feb000fde00 2023-12-08T20:26:14.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.371+0000 7feb06dd7700 1 -- 172.21.15.43:0/3520952175 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7feaf0068f60 msgr2=0x7feaf006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:14.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.371+0000 7feb06dd7700 1 --2- 172.21.15.43:0/3520952175 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7feaf0068f60 0x7feaf006b410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feaf4007fd0 tx=0x7feaf4009040 comp rx=0 tx=0).stop 2023-12-08T20:26:14.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.371+0000 7feb06dd7700 1 -- 172.21.15.43:0/3520952175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb000fde00 msgr2=0x7feb0006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:14.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.371+0000 7feb06dd7700 1 --2- 172.21.15.43:0/3520952175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb000fde00 0x7feb0006ff90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7feaec009360 tx=0x7feaec009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:14.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.371+0000 7feb06dd7700 1 -- 172.21.15.43:0/3520952175 shutdown_connections 2023-12-08T20:26:14.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.371+0000 7feb06dd7700 1 --2- 172.21.15.43:0/3520952175 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7feaf0068f60 0x7feaf006b410 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:14.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.371+0000 7feb06dd7700 1 --2- 172.21.15.43:0/3520952175 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feb000fcbf0 0x7feb00071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:14.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.371+0000 7feb06dd7700 1 --2- 172.21.15.43:0/3520952175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb000fde00 0x7feb0006ff90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:14.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.371+0000 7feb06dd7700 1 -- 172.21.15.43:0/3520952175 >> 172.21.15.43:0/3520952175 conn(0x7feb000f82d0 msgr2=0x7feb00101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:14.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.371+0000 7feb06dd7700 1 -- 172.21.15.43:0/3520952175 shutdown_connections 2023-12-08T20:26:14.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:14.371+0000 7feb06dd7700 1 -- 172.21.15.43:0/3520952175 wait complete. 2023-12-08T20:26:14.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:14 smithi043 ceph-mon[111966]: pgmap v150: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-08T20:26:14.787 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-08T20:26:14.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:14 smithi111 ceph-mon[121341]: pgmap v150: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-08T20:26:15.104 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:26:16.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.258+0000 7fdcc0dbe700 1 -- 172.21.15.43:0/3670661022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcbc0ffd70 msgr2=0x7fdcbc1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:16.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.258+0000 7fdcc0dbe700 1 --2- 172.21.15.43:0/3670661022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcbc0ffd70 0x7fdcbc1021d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0004940 tx=0x7fdcb0009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:16.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.258+0000 7fdcc0dbe700 1 -- 172.21.15.43:0/3670661022 shutdown_connections 2023-12-08T20:26:16.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.258+0000 7fdcc0dbe700 1 --2- 172.21.15.43:0/3670661022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcbc0ffd70 0x7fdcbc1021d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:16.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.258+0000 7fdcc0dbe700 1 --2- 172.21.15.43:0/3670661022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdcbc066090 0x7fdcbc0ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:16.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.258+0000 7fdcc0dbe700 1 -- 172.21.15.43:0/3670661022 >> 172.21.15.43:0/3670661022 conn(0x7fdcbc0f7190 msgr2=0x7fdcbc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:16.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.258+0000 7fdcc0dbe700 1 -- 172.21.15.43:0/3670661022 shutdown_connections 2023-12-08T20:26:16.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.258+0000 7fdcc0dbe700 1 -- 172.21.15.43:0/3670661022 wait complete. 2023-12-08T20:26:16.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.258+0000 7fdcc0dbe700 1 Processor -- start 2023-12-08T20:26:16.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.259+0000 7fdcc0dbe700 1 -- start start 2023-12-08T20:26:16.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.259+0000 7fdcc0dbe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcbc066090 0x7fdcbc0fd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:16.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.259+0000 7fdcc0dbe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdcbc0ffd70 0x7fdcbc0fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:16.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.259+0000 7fdcc0dbe700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc0fbca0 con 0x7fdcbc066090 2023-12-08T20:26:16.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.259+0000 7fdcc0dbe700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc0fbe10 con 0x7fdcbc0ffd70 2023-12-08T20:26:16.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.259+0000 7fdcba59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcbc066090 0x7fdcbc0fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:16.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.259+0000 7fdcba59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcbc066090 0x7fdcbc0fd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39464/0 (socket says 172.21.15.43:39464) 2023-12-08T20:26:16.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.259+0000 7fdcba59c700 1 -- 172.21.15.43:0/2522517317 learned_addr learned my addr 172.21.15.43:0/2522517317 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:26:16.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.259+0000 7fdcb9d9b700 1 --2- 172.21.15.43:0/2522517317 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdcbc0ffd70 0x7fdcbc0fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:16.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.259+0000 7fdcba59c700 1 -- 172.21.15.43:0/2522517317 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdcbc0ffd70 msgr2=0x7fdcbc0fb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:16.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.259+0000 7fdcba59c700 1 --2- 172.21.15.43:0/2522517317 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdcbc0ffd70 0x7fdcbc0fb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:16.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.259+0000 7fdcba59c700 1 -- 172.21.15.43:0/2522517317 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb0005040 con 0x7fdcbc066090 2023-12-08T20:26:16.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.259+0000 7fdcb9d9b700 1 --2- 172.21.15.43:0/2522517317 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdcbc0ffd70 0x7fdcbc0fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T20:26:16.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.259+0000 7fdcba59c700 1 --2- 172.21.15.43:0/2522517317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcbc066090 0x7fdcbc0fd220 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00eb40 tx=0x7fdcac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:16.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.260+0000 7fdcaaffd700 1 -- 172.21.15.43:0/2522517317 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcac007cc0 con 0x7fdcbc066090 2023-12-08T20:26:16.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.260+0000 7fdcc0dbe700 1 -- 172.21.15.43:0/2522517317 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcbc0fc090 con 0x7fdcbc066090 2023-12-08T20:26:16.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.260+0000 7fdcaaffd700 1 -- 172.21.15.43:0/2522517317 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdcac00f040 con 0x7fdcbc066090 2023-12-08T20:26:16.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.260+0000 7fdcaaffd700 1 -- 172.21.15.43:0/2522517317 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcac00c990 con 0x7fdcbc066090 2023-12-08T20:26:16.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.260+0000 7fdcc0dbe700 1 -- 172.21.15.43:0/2522517317 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcbc115510 con 0x7fdcbc066090 2023-12-08T20:26:16.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.261+0000 7fdcc0dbe700 1 -- 172.21.15.43:0/2522517317 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcbc04bb80 con 0x7fdcbc066090 2023-12-08T20:26:16.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.262+0000 7fdcaaffd700 1 -- 172.21.15.43:0/2522517317 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fdcac00cc00 con 0x7fdcbc066090 2023-12-08T20:26:16.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.262+0000 7fdcaaffd700 1 --2- 172.21.15.43:0/2522517317 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fdca4068f60 0x7fdca406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:16.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.262+0000 7fdcaaffd700 1 -- 172.21.15.43:0/2522517317 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fdcac0869a0 con 0x7fdcbc066090 2023-12-08T20:26:16.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.262+0000 7fdcb9d9b700 1 --2- 172.21.15.43:0/2522517317 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fdca4068f60 0x7fdca406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:16.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.263+0000 7fdcb9d9b700 1 --2- 172.21.15.43:0/2522517317 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fdca4068f60 0x7fdca406b410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0013680 tx=0x7fdcb0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:16.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.267+0000 7fdcaaffd700 1 -- 172.21.15.43:0/2522517317 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdcac04da00 con 0x7fdcbc066090 2023-12-08T20:26:16.454 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:16 smithi043 ceph-mon[111966]: pgmap v151: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2023-12-08T20:26:16.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.473+0000 7fdcc0dbe700 1 -- 172.21.15.43:0/2522517317 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fdcbc1159b0 con 0x7fdcbc066090 2023-12-08T20:26:16.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.473+0000 7fdcaaffd700 1 -- 172.21.15.43:0/2522517317 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7fdcac056930 con 0x7fdcbc066090 2023-12-08T20:26:16.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.475+0000 7fdcc0dbe700 1 -- 172.21.15.43:0/2522517317 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fdca4068f60 msgr2=0x7fdca406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:16.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.475+0000 7fdcc0dbe700 1 --2- 172.21.15.43:0/2522517317 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fdca4068f60 0x7fdca406b410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0013680 tx=0x7fdcb0009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:16.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.475+0000 7fdcc0dbe700 1 -- 172.21.15.43:0/2522517317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcbc066090 msgr2=0x7fdcbc0fd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:16.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.475+0000 7fdcc0dbe700 1 --2- 172.21.15.43:0/2522517317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcbc066090 0x7fdcbc0fd220 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00eb40 tx=0x7fdcac00b040 comp rx=0 tx=0).stop 2023-12-08T20:26:16.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.476+0000 7fdcc0dbe700 1 -- 172.21.15.43:0/2522517317 shutdown_connections 2023-12-08T20:26:16.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.476+0000 7fdcc0dbe700 1 --2- 172.21.15.43:0/2522517317 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7fdca4068f60 0x7fdca406b410 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:16.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.476+0000 7fdcc0dbe700 1 --2- 172.21.15.43:0/2522517317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcbc066090 0x7fdcbc0fd220 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:16.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.476+0000 7fdcc0dbe700 1 --2- 172.21.15.43:0/2522517317 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdcbc0ffd70 0x7fdcbc0fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:16.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.476+0000 7fdcc0dbe700 1 -- 172.21.15.43:0/2522517317 >> 172.21.15.43:0/2522517317 conn(0x7fdcbc0f7190 msgr2=0x7fdcbc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:16.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.476+0000 7fdcc0dbe700 1 -- 172.21.15.43:0/2522517317 shutdown_connections 2023-12-08T20:26:16.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:16.476+0000 7fdcc0dbe700 1 -- 172.21.15.43:0/2522517317 wait complete. 2023-12-08T20:26:16.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:16 smithi111 ceph-mon[121341]: pgmap v151: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2023-12-08T20:26:16.857 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2023-12-08T20:26:17.167 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:26:18.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.308+0000 7faed5573700 1 -- 172.21.15.43:0/2274456896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faed00fbe50 msgr2=0x7faed00fc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:18.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.308+0000 7faed5573700 1 --2- 172.21.15.43:0/2274456896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faed00fbe50 0x7faed00fc2a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7faec4004940 tx=0x7faec4009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:18.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.308+0000 7faed5573700 1 -- 172.21.15.43:0/2274456896 shutdown_connections 2023-12-08T20:26:18.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.308+0000 7faed5573700 1 --2- 172.21.15.43:0/2274456896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faed00fbe50 0x7faed00fc2a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:18.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.308+0000 7faed5573700 1 --2- 172.21.15.43:0/2274456896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faed00fd0f0 0x7faed00fd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:18.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.308+0000 7faed5573700 1 -- 172.21.15.43:0/2274456896 >> 172.21.15.43:0/2274456896 conn(0x7faed00f6950 msgr2=0x7faed00f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:18.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.308+0000 7faed5573700 1 -- 172.21.15.43:0/2274456896 shutdown_connections 2023-12-08T20:26:18.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.308+0000 7faed5573700 1 -- 172.21.15.43:0/2274456896 wait complete. 2023-12-08T20:26:18.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.309+0000 7faed5573700 1 Processor -- start 2023-12-08T20:26:18.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.309+0000 7faed5573700 1 -- start start 2023-12-08T20:26:18.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.309+0000 7faed5573700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faed00fbe50 0x7faed010c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:18.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.309+0000 7faed5573700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faed00fd0f0 0x7faed010c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:18.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.309+0000 7faed5573700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed010cf80 con 0x7faed00fd0f0 2023-12-08T20:26:18.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.309+0000 7faed5573700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed010d820 con 0x7faed00fbe50 2023-12-08T20:26:18.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.310+0000 7faece7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faed00fd0f0 0x7faed010c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:18.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.310+0000 7faeceffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faed00fbe50 0x7faed010c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:18.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.310+0000 7faece7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faed00fd0f0 0x7faed010c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39488/0 (socket says 172.21.15.43:39488) 2023-12-08T20:26:18.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.310+0000 7faeceffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faed00fbe50 0x7faed010c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.43:58332/0 (socket says 172.21.15.43:58332) 2023-12-08T20:26:18.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.310+0000 7faece7fc700 1 -- 172.21.15.43:0/3122396587 learned_addr learned my addr 172.21.15.43:0/3122396587 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:26:18.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.310+0000 7faeceffd700 1 -- 172.21.15.43:0/3122396587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faed00fd0f0 msgr2=0x7faed010c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:18.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.310+0000 7faeceffd700 1 --2- 172.21.15.43:0/3122396587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faed00fd0f0 0x7faed010c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:18.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.310+0000 7faeceffd700 1 -- 172.21.15.43:0/3122396587 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec4005040 con 0x7faed00fbe50 2023-12-08T20:26:18.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.310+0000 7faece7fc700 1 --2- 172.21.15.43:0/3122396587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faed00fd0f0 0x7faed010c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T20:26:18.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.310+0000 7faeceffd700 1 --2- 172.21.15.43:0/3122396587 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faed00fbe50 0x7faed010c440 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faed0065090 tx=0x7faec000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:18.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.310+0000 7faeb77fe700 1 -- 172.21.15.43:0/3122396587 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faec0004e90 con 0x7faed00fbe50 2023-12-08T20:26:18.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.310+0000 7faeb77fe700 1 -- 172.21.15.43:0/3122396587 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faec000f040 con 0x7faed00fbe50 2023-12-08T20:26:18.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.310+0000 7faed5573700 1 -- 172.21.15.43:0/3122396587 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed010daa0 con 0x7faed00fbe50 2023-12-08T20:26:18.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.310+0000 7faeb77fe700 1 -- 172.21.15.43:0/3122396587 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faec000c890 con 0x7faed00fbe50 2023-12-08T20:26:18.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.310+0000 7faed5573700 1 -- 172.21.15.43:0/3122396587 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed010dfe0 con 0x7faed00fbe50 2023-12-08T20:26:18.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.311+0000 7faed5573700 1 -- 172.21.15.43:0/3122396587 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed004bb80 con 0x7faed00fbe50 2023-12-08T20:26:18.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.312+0000 7faeb77fe700 1 -- 172.21.15.43:0/3122396587 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7faec000cb00 con 0x7faed00fbe50 2023-12-08T20:26:18.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.312+0000 7faeb77fe700 1 --2- 172.21.15.43:0/3122396587 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7faeb8068f60 0x7faeb806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:18.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.312+0000 7faeb77fe700 1 -- 172.21.15.43:0/3122396587 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7faec0086890 con 0x7faed00fbe50 2023-12-08T20:26:18.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.312+0000 7faece7fc700 1 --2- 172.21.15.43:0/3122396587 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7faeb8068f60 0x7faeb806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:18.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.313+0000 7faece7fc700 1 --2- 172.21.15.43:0/3122396587 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7faeb8068f60 0x7faeb806b410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faec4004890 tx=0x7faec4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.317+0000 7faeb77fe700 1 -- 172.21.15.43:0/3122396587 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7faec004da00 con 0x7faed00fbe50 2023-12-08T20:26:18.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:18.557+0000 7faed5573700 1 -- 172.21.15.43:0/3122396587 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7faed010e430 con 0x7faeb8068f60 2023-12-08T20:26:18.894 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:18 smithi111 ceph-mon[121341]: pgmap v152: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2023-12-08T20:26:19.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:18 smithi043 ceph-mon[111966]: pgmap v152: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2023-12-08T20:26:19.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:19 smithi111 ceph-mon[121341]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:26:19.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:19 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:26:20.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:19 smithi043 ceph-mon[111966]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:26:20.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:19 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:26:20.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:20 smithi111 ceph-mon[121341]: pgmap v153: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2023-12-08T20:26:21.803 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:20 smithi043 ceph-mon[111966]: pgmap v153: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2023-12-08T20:26:22.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:22 smithi111 ceph-mon[121341]: pgmap v154: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-08T20:26:23.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:22 smithi043 ceph-mon[111966]: pgmap v154: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-08T20:26:24.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:24 smithi111 ceph-mon[121341]: pgmap v155: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-08T20:26:25.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:24 smithi043 ceph-mon[111966]: pgmap v155: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-08T20:26:26.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:26 smithi111 ceph-mon[121341]: pgmap v156: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-08T20:26:26.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:26 smithi043 ceph-mon[111966]: pgmap v156: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-08T20:26:28.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:28 smithi111 ceph-mon[121341]: pgmap v157: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-08T20:26:29.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:28 smithi043 ceph-mon[111966]: pgmap v157: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-08T20:26:30.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:30 smithi111 ceph-mon[121341]: pgmap v158: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-08T20:26:31.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:30 smithi043 ceph-mon[111966]: pgmap v158: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-08T20:26:32.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:32 smithi111 ceph-mon[121341]: pgmap v159: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-08T20:26:33.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:32 smithi043 ceph-mon[111966]: pgmap v159: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-08T20:26:34.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:34 smithi111 ceph-mon[121341]: pgmap v160: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:26:34.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:34 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:26:35.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:34 smithi043 ceph-mon[111966]: pgmap v160: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:26:35.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:34 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:26:36.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:36 smithi111 ceph-mon[121341]: pgmap v161: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:26:36.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:36 smithi043 ceph-mon[111966]: pgmap v161: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:26:38.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:38 smithi111 ceph-mon[121341]: pgmap v162: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:26:39.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:38 smithi043 ceph-mon[111966]: pgmap v162: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:26:40.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:40 smithi111 ceph-mon[121341]: pgmap v163: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:26:41.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:40 smithi043 ceph-mon[111966]: pgmap v163: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:26:42.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:42 smithi111 ceph-mon[121341]: pgmap v164: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:26:43.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:42 smithi043 ceph-mon[111966]: pgmap v164: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:26:44.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:44.369+0000 7faeb77fe700 1 -- 172.21.15.43:0/3122396587 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7faed010e430 con 0x7faeb8068f60 2023-12-08T20:26:44.371 INFO:teuthology.orchestra.run.smithi043.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:26:44.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:44.372+0000 7faed5573700 1 -- 172.21.15.43:0/3122396587 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7faeb8068f60 msgr2=0x7faeb806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:44.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:44.372+0000 7faed5573700 1 --2- 172.21.15.43:0/3122396587 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7faeb8068f60 0x7faeb806b410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faec4004890 tx=0x7faec4009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:44.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:44.372+0000 7faed5573700 1 -- 172.21.15.43:0/3122396587 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faed00fbe50 msgr2=0x7faed010c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:44.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:44.372+0000 7faed5573700 1 --2- 172.21.15.43:0/3122396587 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faed00fbe50 0x7faed010c440 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faed0065090 tx=0x7faec000b040 comp rx=0 tx=0).stop 2023-12-08T20:26:44.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:44.373+0000 7faed5573700 1 -- 172.21.15.43:0/3122396587 shutdown_connections 2023-12-08T20:26:44.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:44.373+0000 7faed5573700 1 --2- 172.21.15.43:0/3122396587 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7faeb8068f60 0x7faeb806b410 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:44.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:44.373+0000 7faed5573700 1 --2- 172.21.15.43:0/3122396587 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faed00fbe50 0x7faed010c440 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:44.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:44.373+0000 7faed5573700 1 --2- 172.21.15.43:0/3122396587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faed00fd0f0 0x7faed010c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:44.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:44.373+0000 7faed5573700 1 -- 172.21.15.43:0/3122396587 >> 172.21.15.43:0/3122396587 conn(0x7faed00f6950 msgr2=0x7faed0100090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:44.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:44.373+0000 7faed5573700 1 -- 172.21.15.43:0/3122396587 shutdown_connections 2023-12-08T20:26:44.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:44.373+0000 7faed5573700 1 -- 172.21.15.43:0/3122396587 wait complete. 2023-12-08T20:26:44.552 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:44 smithi043 ceph-mon[111966]: pgmap v165: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:26:44.552 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:44 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:26:44.552 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:44 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:26:44.553 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:44 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:26:44.553 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:44 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:26:44.553 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:44 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:26:44.768 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2023-12-08T20:26:44.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:44 smithi111 ceph-mon[121341]: pgmap v165: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:26:44.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:44 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:26:44.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:44 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:26:44.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:44 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:26:44.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:44 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:26:44.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:44 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:26:45.238 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:26:45.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:45 smithi043 ceph-mon[111966]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:26:45.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:45 smithi043 ceph-mon[111966]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:26:45.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:45 smithi111 ceph-mon[121341]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:26:45.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:45 smithi111 ceph-mon[121341]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:26:46.815 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:46 smithi043 ceph-mon[111966]: pgmap v166: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-08T20:26:46.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:46 smithi111 ceph-mon[121341]: pgmap v166: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-08T20:26:47.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.910+0000 7f6c0c896700 1 -- 172.21.15.43:0/1100459462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c080fcd00 msgr2=0x7f6c080fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:47.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.910+0000 7f6c0c896700 1 --2- 172.21.15.43:0/1100459462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c080fcd00 0x7f6c080fd150 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc004940 tx=0x7f6bfc009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:47.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.910+0000 7f6c0c896700 1 -- 172.21.15.43:0/1100459462 shutdown_connections 2023-12-08T20:26:47.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.910+0000 7f6c0c896700 1 --2- 172.21.15.43:0/1100459462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c080fcd00 0x7f6c080fd150 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:47.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.910+0000 7f6c0c896700 1 --2- 172.21.15.43:0/1100459462 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c080fbaf0 0x7f6c080fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:47.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.910+0000 7f6c0c896700 1 -- 172.21.15.43:0/1100459462 >> 172.21.15.43:0/1100459462 conn(0x7f6c080f7190 msgr2=0x7f6c080f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:47.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.910+0000 7f6c0c896700 1 -- 172.21.15.43:0/1100459462 shutdown_connections 2023-12-08T20:26:47.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.910+0000 7f6c0c896700 1 -- 172.21.15.43:0/1100459462 wait complete. 2023-12-08T20:26:47.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.911+0000 7f6c0c896700 1 Processor -- start 2023-12-08T20:26:47.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.911+0000 7f6c0c896700 1 -- start start 2023-12-08T20:26:47.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.911+0000 7f6c0c896700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c080fbaf0 0x7f6c08065a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:47.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.911+0000 7f6c0c896700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c080fcd00 0x7f6c0806e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:47.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.911+0000 7f6c0c896700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c08066170 con 0x7f6c080fbaf0 2023-12-08T20:26:47.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.911+0000 7f6c0c896700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c080662e0 con 0x7f6c080fcd00 2023-12-08T20:26:47.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.912+0000 7f6c05d9b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c080fcd00 0x7f6c0806e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:47.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.912+0000 7f6c05d9b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c080fcd00 0x7f6c0806e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.43:41500/0 (socket says 172.21.15.43:41500) 2023-12-08T20:26:47.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.912+0000 7f6c05d9b700 1 -- 172.21.15.43:0/1125740439 learned_addr learned my addr 172.21.15.43:0/1125740439 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:26:47.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.912+0000 7f6c0659c700 1 --2- 172.21.15.43:0/1125740439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c080fbaf0 0x7f6c08065a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:47.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.912+0000 7f6c05d9b700 1 -- 172.21.15.43:0/1125740439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c080fbaf0 msgr2=0x7f6c08065a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:47.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.912+0000 7f6c05d9b700 1 --2- 172.21.15.43:0/1125740439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c080fbaf0 0x7f6c08065a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:47.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.912+0000 7f6c05d9b700 1 -- 172.21.15.43:0/1125740439 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc005040 con 0x7f6c080fcd00 2023-12-08T20:26:47.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.912+0000 7f6c05d9b700 1 --2- 172.21.15.43:0/1125740439 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c080fcd00 0x7f6c0806e860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc009380 tx=0x7f6bfc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:47.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.913+0000 7f6bf6ffd700 1 -- 172.21.15.43:0/1125740439 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bfc00e040 con 0x7f6c080fcd00 2023-12-08T20:26:47.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.913+0000 7f6bf6ffd700 1 -- 172.21.15.43:0/1125740439 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6bfc00bd20 con 0x7f6c080fcd00 2023-12-08T20:26:47.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.913+0000 7f6bf6ffd700 1 -- 172.21.15.43:0/1125740439 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bfc01c630 con 0x7f6c080fcd00 2023-12-08T20:26:47.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.913+0000 7f6c0c896700 1 -- 172.21.15.43:0/1125740439 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0806ee30 con 0x7f6c080fcd00 2023-12-08T20:26:47.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.913+0000 7f6c0c896700 1 -- 172.21.15.43:0/1125740439 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0806f310 con 0x7f6c080fcd00 2023-12-08T20:26:47.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.914+0000 7f6c0c896700 1 -- 172.21.15.43:0/1125740439 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0804bb80 con 0x7f6c080fcd00 2023-12-08T20:26:47.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.915+0000 7f6bf6ffd700 1 -- 172.21.15.43:0/1125740439 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6bfc013420 con 0x7f6c080fcd00 2023-12-08T20:26:47.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.916+0000 7f6bf6ffd700 1 --2- 172.21.15.43:0/1125740439 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6bf0068f60 0x7f6bf006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:47.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.916+0000 7f6bf6ffd700 1 -- 172.21.15.43:0/1125740439 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6bfc088b60 con 0x7f6c080fcd00 2023-12-08T20:26:47.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.916+0000 7f6c0659c700 1 --2- 172.21.15.43:0/1125740439 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6bf0068f60 0x7f6bf006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:47.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.916+0000 7f6c0659c700 1 --2- 172.21.15.43:0/1125740439 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6bf0068f60 0x7f6bf006b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6c080fcb60 tx=0x7f6bf80091a0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:47.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:47.924+0000 7f6bf6ffd700 1 -- 172.21.15.43:0/1125740439 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6bfc055010 con 0x7f6c080fcd00 2023-12-08T20:26:48.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.144+0000 7f6c0c896700 1 -- 172.21.15.43:0/1125740439 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c08101650 con 0x7f6bf0068f60 2023-12-08T20:26:48.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.145+0000 7f6bf6ffd700 1 -- 172.21.15.43:0/1125740439 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f6c08101650 con 0x7f6bf0068f60 2023-12-08T20:26:48.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.148+0000 7f6c0c896700 1 -- 172.21.15.43:0/1125740439 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6bf0068f60 msgr2=0x7f6bf006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:48.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.148+0000 7f6c0c896700 1 --2- 172.21.15.43:0/1125740439 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6bf0068f60 0x7f6bf006b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6c080fcb60 tx=0x7f6bf80091a0 comp rx=0 tx=0).stop 2023-12-08T20:26:48.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.148+0000 7f6c0c896700 1 -- 172.21.15.43:0/1125740439 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c080fcd00 msgr2=0x7f6c0806e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:48.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.148+0000 7f6c0c896700 1 --2- 172.21.15.43:0/1125740439 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c080fcd00 0x7f6c0806e860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc009380 tx=0x7f6bfc009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:48.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.148+0000 7f6c0c896700 1 -- 172.21.15.43:0/1125740439 shutdown_connections 2023-12-08T20:26:48.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.148+0000 7f6c0c896700 1 --2- 172.21.15.43:0/1125740439 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f6bf0068f60 0x7f6bf006b410 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:48.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.148+0000 7f6c0c896700 1 --2- 172.21.15.43:0/1125740439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c080fbaf0 0x7f6c08065a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:48.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.148+0000 7f6c0c896700 1 --2- 172.21.15.43:0/1125740439 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c080fcd00 0x7f6c0806e860 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:48.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.148+0000 7f6c0c896700 1 -- 172.21.15.43:0/1125740439 >> 172.21.15.43:0/1125740439 conn(0x7f6c080f7190 msgr2=0x7f6c080fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:48.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.148+0000 7f6c0c896700 1 -- 172.21.15.43:0/1125740439 shutdown_connections 2023-12-08T20:26:48.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.148+0000 7f6c0c896700 1 -- 172.21.15.43:0/1125740439 wait complete. 2023-12-08T20:26:48.161 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:26:48.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.271+0000 7f43183c0700 1 -- 172.21.15.43:0/2178747425 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4310100050 msgr2=0x7f4310102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:48.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.272+0000 7f43183c0700 1 --2- 172.21.15.43:0/2178747425 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4310100050 0x7f4310102430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f430c004880 tx=0x7f430c009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:48.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.272+0000 7f43183c0700 1 -- 172.21.15.43:0/2178747425 shutdown_connections 2023-12-08T20:26:48.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.272+0000 7f43183c0700 1 --2- 172.21.15.43:0/2178747425 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4310100050 0x7f4310102430 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:48.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.272+0000 7f43183c0700 1 --2- 172.21.15.43:0/2178747425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43100fd730 0x7f43100ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:48.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.272+0000 7f43183c0700 1 -- 172.21.15.43:0/2178747425 >> 172.21.15.43:0/2178747425 conn(0x7f43100f7190 msgr2=0x7f43100f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:48.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.272+0000 7f43183c0700 1 -- 172.21.15.43:0/2178747425 shutdown_connections 2023-12-08T20:26:48.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.272+0000 7f43183c0700 1 -- 172.21.15.43:0/2178747425 wait complete. 2023-12-08T20:26:48.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.272+0000 7f43183c0700 1 Processor -- start 2023-12-08T20:26:48.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.272+0000 7f43183c0700 1 -- start start 2023-12-08T20:26:48.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.273+0000 7f43183c0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f43100fd730 0x7f431010d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:48.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.273+0000 7f43183c0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4310100050 0x7f431010d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:48.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.273+0000 7f43183c0700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431010dfa0 con 0x7f4310100050 2023-12-08T20:26:48.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.273+0000 7f43183c0700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431010e840 con 0x7f43100fd730 2023-12-08T20:26:48.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.273+0000 7f431615c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f43100fd730 0x7f431010d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:48.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.273+0000 7f431615c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f43100fd730 0x7f431010d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.43:41514/0 (socket says 172.21.15.43:41514) 2023-12-08T20:26:48.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.273+0000 7f431615c700 1 -- 172.21.15.43:0/2528417247 learned_addr learned my addr 172.21.15.43:0/2528417247 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:26:48.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.273+0000 7f431595b700 1 --2- 172.21.15.43:0/2528417247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4310100050 0x7f431010d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:48.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.273+0000 7f431615c700 1 -- 172.21.15.43:0/2528417247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4310100050 msgr2=0x7f431010d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:48.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.273+0000 7f431615c700 1 --2- 172.21.15.43:0/2528417247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4310100050 0x7f431010d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:48.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.273+0000 7f431615c700 1 -- 172.21.15.43:0/2528417247 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c005040 con 0x7f43100fd730 2023-12-08T20:26:48.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.273+0000 7f431595b700 1 --2- 172.21.15.43:0/2528417247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4310100050 0x7f431010d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T20:26:48.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.273+0000 7f431615c700 1 --2- 172.21.15.43:0/2528417247 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f43100fd730 0x7f431010d460 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f43000041d0 tx=0x7f430000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:48.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.274+0000 7f4306ffd700 1 -- 172.21.15.43:0/2528417247 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4300007cc0 con 0x7f43100fd730 2023-12-08T20:26:48.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.274+0000 7f4306ffd700 1 -- 172.21.15.43:0/2528417247 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f430000f040 con 0x7f43100fd730 2023-12-08T20:26:48.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.274+0000 7f43183c0700 1 -- 172.21.15.43:0/2528417247 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f431010eac0 con 0x7f43100fd730 2023-12-08T20:26:48.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.274+0000 7f4306ffd700 1 -- 172.21.15.43:0/2528417247 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f430000c990 con 0x7f43100fd730 2023-12-08T20:26:48.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.274+0000 7f43183c0700 1 -- 172.21.15.43:0/2528417247 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431010f000 con 0x7f43100fd730 2023-12-08T20:26:48.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.275+0000 7f43183c0700 1 -- 172.21.15.43:0/2528417247 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f431004bb80 con 0x7f43100fd730 2023-12-08T20:26:48.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.276+0000 7f4306ffd700 1 -- 172.21.15.43:0/2528417247 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f430000caf0 con 0x7f43100fd730 2023-12-08T20:26:48.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.276+0000 7f4306ffd700 1 --2- 172.21.15.43:0/2528417247 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f42fc068f70 0x7f42fc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:48.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.276+0000 7f4306ffd700 1 -- 172.21.15.43:0/2528417247 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4300086720 con 0x7f43100fd730 2023-12-08T20:26:48.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.277+0000 7f431595b700 1 --2- 172.21.15.43:0/2528417247 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f42fc068f70 0x7f42fc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:48.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.277+0000 7f431595b700 1 --2- 172.21.15.43:0/2528417247 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f42fc068f70 0x7f42fc06b420 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f430c0135d0 tx=0x7f430c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:48.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.281+0000 7f4306ffd700 1 -- 172.21.15.43:0/2528417247 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f430004da00 con 0x7f43100fd730 2023-12-08T20:26:48.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.600+0000 7f43183c0700 1 -- 172.21.15.43:0/2528417247 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4310100cb0 con 0x7f42fc068f70 2023-12-08T20:26:48.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.602+0000 7f4306ffd700 1 -- 172.21.15.43:0/2528417247 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f4310100cb0 con 0x7f42fc068f70 2023-12-08T20:26:48.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.604+0000 7f43183c0700 1 -- 172.21.15.43:0/2528417247 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f42fc068f70 msgr2=0x7f42fc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:48.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.604+0000 7f43183c0700 1 --2- 172.21.15.43:0/2528417247 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f42fc068f70 0x7f42fc06b420 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f430c0135d0 tx=0x7f430c009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:48.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.604+0000 7f43183c0700 1 -- 172.21.15.43:0/2528417247 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f43100fd730 msgr2=0x7f431010d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:48.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.604+0000 7f43183c0700 1 --2- 172.21.15.43:0/2528417247 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f43100fd730 0x7f431010d460 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f43000041d0 tx=0x7f430000b040 comp rx=0 tx=0).stop 2023-12-08T20:26:48.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.604+0000 7f43183c0700 1 -- 172.21.15.43:0/2528417247 shutdown_connections 2023-12-08T20:26:48.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.604+0000 7f43183c0700 1 --2- 172.21.15.43:0/2528417247 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f42fc068f70 0x7f42fc06b420 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:48.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.604+0000 7f43183c0700 1 --2- 172.21.15.43:0/2528417247 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f43100fd730 0x7f431010d460 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:48.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.604+0000 7f43183c0700 1 --2- 172.21.15.43:0/2528417247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4310100050 0x7f431010d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:48.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.604+0000 7f43183c0700 1 -- 172.21.15.43:0/2528417247 >> 172.21.15.43:0/2528417247 conn(0x7f43100f7190 msgr2=0x7f43100f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:48.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.604+0000 7f43183c0700 1 -- 172.21.15.43:0/2528417247 shutdown_connections 2023-12-08T20:26:48.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.604+0000 7f43183c0700 1 -- 172.21.15.43:0/2528417247 wait complete. 2023-12-08T20:26:48.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.724+0000 7ff9ff64e700 1 -- 172.21.15.43:0/621625960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9f80fcd00 msgr2=0x7ff9f80fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:48.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.724+0000 7ff9ff64e700 1 --2- 172.21.15.43:0/621625960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9f80fcd00 0x7ff9f80fd150 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8004940 tx=0x7ff9e8009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:48.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.724+0000 7ff9ff64e700 1 -- 172.21.15.43:0/621625960 shutdown_connections 2023-12-08T20:26:48.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.724+0000 7ff9ff64e700 1 --2- 172.21.15.43:0/621625960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9f80fcd00 0x7ff9f80fd150 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:48.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.724+0000 7ff9ff64e700 1 --2- 172.21.15.43:0/621625960 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9f80fbaf0 0x7ff9f80fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:48.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.724+0000 7ff9ff64e700 1 -- 172.21.15.43:0/621625960 >> 172.21.15.43:0/621625960 conn(0x7ff9f80f71b0 msgr2=0x7ff9f80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:48.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.725+0000 7ff9ff64e700 1 -- 172.21.15.43:0/621625960 shutdown_connections 2023-12-08T20:26:48.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.725+0000 7ff9ff64e700 1 -- 172.21.15.43:0/621625960 wait complete. 2023-12-08T20:26:48.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.725+0000 7ff9ff64e700 1 Processor -- start 2023-12-08T20:26:48.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.725+0000 7ff9ff64e700 1 -- start start 2023-12-08T20:26:48.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.725+0000 7ff9ff64e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9f80fbaf0 0x7ff9f810d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:48.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.726+0000 7ff9ff64e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9f80fcd00 0x7ff9f810d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:48.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.726+0000 7ff9ff64e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f810dfb0 con 0x7ff9f80fbaf0 2023-12-08T20:26:48.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.726+0000 7ff9ff64e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f810e850 con 0x7ff9f80fcd00 2023-12-08T20:26:48.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.726+0000 7ff9fd3ea700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9f80fbaf0 0x7ff9f810d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:48.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.726+0000 7ff9fcbe9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9f80fcd00 0x7ff9f810d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:48.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.726+0000 7ff9fcbe9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9f80fcd00 0x7ff9f810d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.43:41538/0 (socket says 172.21.15.43:41538) 2023-12-08T20:26:48.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.726+0000 7ff9fd3ea700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9f80fbaf0 0x7ff9f810d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35260/0 (socket says 172.21.15.43:35260) 2023-12-08T20:26:48.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.726+0000 7ff9fcbe9700 1 -- 172.21.15.43:0/503678583 learned_addr learned my addr 172.21.15.43:0/503678583 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:26:48.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.726+0000 7ff9fcbe9700 1 -- 172.21.15.43:0/503678583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9f80fbaf0 msgr2=0x7ff9f810d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:48.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.726+0000 7ff9fcbe9700 1 --2- 172.21.15.43:0/503678583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9f80fbaf0 0x7ff9f810d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:48.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.726+0000 7ff9fcbe9700 1 -- 172.21.15.43:0/503678583 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e8005040 con 0x7ff9f80fcd00 2023-12-08T20:26:48.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.726+0000 7ff9fcbe9700 1 --2- 172.21.15.43:0/503678583 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9f80fcd00 0x7ff9f810d9b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800b0d0 tx=0x7ff9e8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:48.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.726+0000 7ff9edffb700 1 -- 172.21.15.43:0/503678583 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9e800e040 con 0x7ff9f80fcd00 2023-12-08T20:26:48.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.727+0000 7ff9edffb700 1 -- 172.21.15.43:0/503678583 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff9e8014c00 con 0x7ff9f80fcd00 2023-12-08T20:26:48.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.727+0000 7ff9edffb700 1 -- 172.21.15.43:0/503678583 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9e800b410 con 0x7ff9f80fcd00 2023-12-08T20:26:48.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.727+0000 7ff9ff64e700 1 -- 172.21.15.43:0/503678583 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f810ea70 con 0x7ff9f80fcd00 2023-12-08T20:26:48.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.727+0000 7ff9ff64e700 1 -- 172.21.15.43:0/503678583 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f810ef50 con 0x7ff9f80fcd00 2023-12-08T20:26:48.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.728+0000 7ff9ff64e700 1 -- 172.21.15.43:0/503678583 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f804bb80 con 0x7ff9f80fcd00 2023-12-08T20:26:48.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.730+0000 7ff9edffb700 1 -- 172.21.15.43:0/503678583 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff9e801c3f0 con 0x7ff9f80fcd00 2023-12-08T20:26:48.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.730+0000 7ff9edffb700 1 --2- 172.21.15.43:0/503678583 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff9e4068f60 0x7ff9e406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:48.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.730+0000 7ff9edffb700 1 -- 172.21.15.43:0/503678583 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff9e8087e90 con 0x7ff9f80fcd00 2023-12-08T20:26:48.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.730+0000 7ff9fd3ea700 1 --2- 172.21.15.43:0/503678583 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff9e4068f60 0x7ff9e406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:48.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.731+0000 7ff9fd3ea700 1 --2- 172.21.15.43:0/503678583 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff9e4068f60 0x7ff9e406b410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4009b80 tx=0x7ff9f400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:48.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.737+0000 7ff9edffb700 1 -- 172.21.15.43:0/503678583 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff9e8057dd0 con 0x7ff9f80fcd00 2023-12-08T20:26:48.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.951+0000 7ff9ff64e700 1 -- 172.21.15.43:0/503678583 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9f810f6e0 con 0x7ff9e4068f60 2023-12-08T20:26:48.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.962+0000 7ff9edffb700 1 -- 172.21.15.43:0/503678583 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7ff9f400f040 con 0x7ff9e4068f60 2023-12-08T20:26:48.963 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-08T20:26:48.964 INFO:teuthology.orchestra.run.smithi043.stdout:alertmanager.smithi043 smithi043 *:9093,9094 running (3m) 49s ago 4m - - 0.25.0 c8568f914cd2 4a24f8273198 2023-12-08T20:26:48.964 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi043 smithi043 running (5m) 49s ago 5m - - 17.2.7-119-ge2143d99 f761b6e42225 f84d492b732c 2023-12-08T20:26:48.964 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi111 smithi111 running (4m) 52s ago 4m 7432k - 17.2.7-119-ge2143d99 f761b6e42225 88b53685ae54 2023-12-08T20:26:48.964 INFO:teuthology.orchestra.run.smithi043.stdout:grafana.smithi043 smithi043 *:3000 running (3m) 49s ago 4m - - 9.4.7 954c08fa6188 503ad8a7ae04 2023-12-08T20:26:48.964 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.akrjef smithi043 running (61s) 49s ago 61s - - 17.2.7-119-ge2143d99 f761b6e42225 1c0cb8d34ef8 2023-12-08T20:26:48.964 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.pjmszb smithi043 running (65s) 49s ago 64s - - 17.2.7-119-ge2143d99 f761b6e42225 d7eee0c78093 2023-12-08T20:26:48.965 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.svpasm smithi111 running (59s) 52s ago 59s 13.2M - 17.2.7-119-ge2143d99 f761b6e42225 657d4d1cf4b2 2023-12-08T20:26:48.965 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.veeegc smithi111 running (63s) 52s ago 63s 16.5M - 17.2.7-119-ge2143d99 f761b6e42225 31f794a388ab 2023-12-08T20:26:48.965 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi043.hqcdcm smithi043 *:9283 running (6m) 49s ago 6m - - 17.2.7-119-ge2143d99 f761b6e42225 58b656e8e333 2023-12-08T20:26:48.965 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi111.mtcffu smithi111 *:8443,9283 running (4m) 52s ago 4m 438M - 17.2.7-119-ge2143d99 f761b6e42225 fefa1ba8c663 2023-12-08T20:26:48.965 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi043 smithi043 running (6m) 49s ago 6m - 2048M 17.2.7-119-ge2143d99 f761b6e42225 fe2a56effef3 2023-12-08T20:26:48.965 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi111 smithi111 running (4m) 52s ago 4m 56.9M 2048M 17.2.7-119-ge2143d99 f761b6e42225 2ae21cf3fa1e 2023-12-08T20:26:48.965 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi043 smithi043 *:9100 running (5m) 49s ago 5m - - 1.5.0 0da6a335fe13 8e51a55a8bc8 2023-12-08T20:26:48.965 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi111 smithi111 *:9100 running (4m) 52s ago 4m 16.4M - 1.5.0 0da6a335fe13 73de1624518e 2023-12-08T20:26:48.965 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (3m) 49s ago 3m - 4300M 17.2.7-119-ge2143d99 f761b6e42225 462eeaf62b2c 2023-12-08T20:26:48.965 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi043 running (3m) 49s ago 3m - 4300M 17.2.7-119-ge2143d99 f761b6e42225 dde419c88a89 2023-12-08T20:26:48.965 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi043 running (3m) 49s ago 2m - 4300M 17.2.7-119-ge2143d99 f761b6e42225 f7e812026ef5 2023-12-08T20:26:48.965 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi111 running (2m) 52s ago 2m 54.2M 5323M 17.2.7-119-ge2143d99 f761b6e42225 2a738d30441c 2023-12-08T20:26:48.965 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi111 running (2m) 52s ago 2m 51.7M 5323M 17.2.7-119-ge2143d99 f761b6e42225 38cdb6a88694 2023-12-08T20:26:48.965 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi111 running (2m) 52s ago 2m 48.4M 5323M 17.2.7-119-ge2143d99 f761b6e42225 59a9ce8c1141 2023-12-08T20:26:48.966 INFO:teuthology.orchestra.run.smithi043.stdout:prometheus.smithi043 smithi043 *:9095 running (3m) 49s ago 4m - - 2.43.0 a07b618ecd1d 88bcbb698598 2023-12-08T20:26:48.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.964+0000 7ff9ff64e700 1 -- 172.21.15.43:0/503678583 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff9e4068f60 msgr2=0x7ff9e406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:48.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.964+0000 7ff9ff64e700 1 --2- 172.21.15.43:0/503678583 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff9e4068f60 0x7ff9e406b410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4009b80 tx=0x7ff9f400b040 comp rx=0 tx=0).stop 2023-12-08T20:26:48.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.964+0000 7ff9ff64e700 1 -- 172.21.15.43:0/503678583 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9f80fcd00 msgr2=0x7ff9f810d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:48.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.964+0000 7ff9ff64e700 1 --2- 172.21.15.43:0/503678583 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9f80fcd00 0x7ff9f810d9b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800b0d0 tx=0x7ff9e8009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:48.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.964+0000 7ff9ff64e700 1 -- 172.21.15.43:0/503678583 shutdown_connections 2023-12-08T20:26:48.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.964+0000 7ff9ff64e700 1 --2- 172.21.15.43:0/503678583 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7ff9e4068f60 0x7ff9e406b410 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:48.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.964+0000 7ff9ff64e700 1 --2- 172.21.15.43:0/503678583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9f80fbaf0 0x7ff9f810d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:48.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.964+0000 7ff9ff64e700 1 --2- 172.21.15.43:0/503678583 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9f80fcd00 0x7ff9f810d9b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:48.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.964+0000 7ff9ff64e700 1 -- 172.21.15.43:0/503678583 >> 172.21.15.43:0/503678583 conn(0x7ff9f80f71b0 msgr2=0x7ff9f80fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:48.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.964+0000 7ff9ff64e700 1 -- 172.21.15.43:0/503678583 shutdown_connections 2023-12-08T20:26:48.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:48.964+0000 7ff9ff64e700 1 -- 172.21.15.43:0/503678583 wait complete. 2023-12-08T20:26:48.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:48 smithi111 ceph-mon[121341]: pgmap v167: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-08T20:26:48.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:48 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:26:48.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:48 smithi111 ceph-mon[121341]: Upgrade: Target is version 19.0.0-44-g9dcc13bb (unknown) 2023-12-08T20:26:48.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:48 smithi111 ceph-mon[121341]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389'] 2023-12-08T20:26:48.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:48 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:26:48.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:48 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:26:48.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:48 smithi111 ceph-mon[121341]: Upgrade: Need to upgrade myself (mgr.smithi043.hqcdcm) 2023-12-08T20:26:48.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:48 smithi111 ceph-mon[121341]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389 on smithi111 2023-12-08T20:26:49.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:48 smithi043 ceph-mon[111966]: pgmap v167: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-08T20:26:49.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:48 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:26:49.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:48 smithi043 ceph-mon[111966]: Upgrade: Target is version 19.0.0-44-g9dcc13bb (unknown) 2023-12-08T20:26:49.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:48 smithi043 ceph-mon[111966]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389'] 2023-12-08T20:26:49.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:48 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:26:49.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:48 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:26:49.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:48 smithi043 ceph-mon[111966]: Upgrade: Need to upgrade myself (mgr.smithi043.hqcdcm) 2023-12-08T20:26:49.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:48 smithi043 ceph-mon[111966]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389 on smithi111 2023-12-08T20:26:49.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.080+0000 7f4acbe82700 1 -- 172.21.15.43:0/3918905199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ac40fcd00 msgr2=0x7f4ac40fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:49.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.080+0000 7f4acbe82700 1 --2- 172.21.15.43:0/3918905199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ac40fcd00 0x7f4ac40fd150 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4004940 tx=0x7f4ab4009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:49.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.081+0000 7f4acbe82700 1 -- 172.21.15.43:0/3918905199 shutdown_connections 2023-12-08T20:26:49.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.081+0000 7f4acbe82700 1 --2- 172.21.15.43:0/3918905199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ac40fcd00 0x7f4ac40fd150 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:49.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.081+0000 7f4acbe82700 1 --2- 172.21.15.43:0/3918905199 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ac40fbaf0 0x7f4ac40fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:49.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.081+0000 7f4acbe82700 1 -- 172.21.15.43:0/3918905199 >> 172.21.15.43:0/3918905199 conn(0x7f4ac40f7190 msgr2=0x7f4ac40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:49.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.081+0000 7f4acbe82700 1 -- 172.21.15.43:0/3918905199 shutdown_connections 2023-12-08T20:26:49.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.081+0000 7f4acbe82700 1 -- 172.21.15.43:0/3918905199 wait complete. 2023-12-08T20:26:49.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.081+0000 7f4acbe82700 1 Processor -- start 2023-12-08T20:26:49.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.082+0000 7f4acbe82700 1 -- start start 2023-12-08T20:26:49.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.082+0000 7f4acbe82700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ac40fbaf0 0x7f4ac410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:49.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.082+0000 7f4acbe82700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ac40fcd00 0x7f4ac410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:49.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.082+0000 7f4acbe82700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac410e010 con 0x7f4ac40fbaf0 2023-12-08T20:26:49.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.082+0000 7f4acbe82700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac410e8b0 con 0x7f4ac40fcd00 2023-12-08T20:26:49.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.082+0000 7f4ac941d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ac40fcd00 0x7f4ac410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:49.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.082+0000 7f4ac941d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ac40fcd00 0x7f4ac410da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.43:41556/0 (socket says 172.21.15.43:41556) 2023-12-08T20:26:49.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.082+0000 7f4ac941d700 1 -- 172.21.15.43:0/495053530 learned_addr learned my addr 172.21.15.43:0/495053530 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:26:49.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.082+0000 7f4ac941d700 1 -- 172.21.15.43:0/495053530 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ac40fbaf0 msgr2=0x7f4ac410d4d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-08T20:26:49.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.082+0000 7f4ac941d700 1 --2- 172.21.15.43:0/495053530 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ac40fbaf0 0x7f4ac410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:49.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.082+0000 7f4ac941d700 1 -- 172.21.15.43:0/495053530 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab4005040 con 0x7f4ac40fcd00 2023-12-08T20:26:49.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.083+0000 7f4ac941d700 1 --2- 172.21.15.43:0/495053530 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ac40fcd00 0x7f4ac410da10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4000c00 tx=0x7f4ab4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:49.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.083+0000 7f4aba7fc700 1 -- 172.21.15.43:0/495053530 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ab4021070 con 0x7f4ac40fcd00 2023-12-08T20:26:49.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.083+0000 7f4aba7fc700 1 -- 172.21.15.43:0/495053530 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4ab4013c40 con 0x7f4ac40fcd00 2023-12-08T20:26:49.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.083+0000 7f4aba7fc700 1 -- 172.21.15.43:0/495053530 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ab400e070 con 0x7f4ac40fcd00 2023-12-08T20:26:49.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.083+0000 7f4acbe82700 1 -- 172.21.15.43:0/495053530 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac410eb30 con 0x7f4ac40fcd00 2023-12-08T20:26:49.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.083+0000 7f4acbe82700 1 -- 172.21.15.43:0/495053530 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac410efc0 con 0x7f4ac40fcd00 2023-12-08T20:26:49.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.084+0000 7f4acbe82700 1 -- 172.21.15.43:0/495053530 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac404bb80 con 0x7f4ac40fcd00 2023-12-08T20:26:49.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.085+0000 7f4aba7fc700 1 -- 172.21.15.43:0/495053530 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f4ab401c400 con 0x7f4ac40fcd00 2023-12-08T20:26:49.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.086+0000 7f4aba7fc700 1 --2- 172.21.15.43:0/495053530 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f4ab0068f60 0x7f4ab006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:49.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.086+0000 7f4aba7fc700 1 -- 172.21.15.43:0/495053530 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4ab4087940 con 0x7f4ac40fcd00 2023-12-08T20:26:49.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.086+0000 7f4ac9c1e700 1 --2- 172.21.15.43:0/495053530 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f4ab0068f60 0x7f4ab006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:49.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.087+0000 7f4ac9c1e700 1 --2- 172.21.15.43:0/495053530 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f4ab0068f60 0x7f4ab006b410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40fcb60 tx=0x7f4ac000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:49.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.096+0000 7f4aba7fc700 1 -- 172.21.15.43:0/495053530 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4ab4057810 con 0x7f4ac40fcd00 2023-12-08T20:26:49.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.389+0000 7f4acbe82700 1 -- 172.21.15.43:0/495053530 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4ac410f4e0 con 0x7f4ac40fcd00 2023-12-08T20:26:49.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.390+0000 7f4aba7fc700 1 -- 172.21.15.43:0/495053530 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f4ab40573a0 con 0x7f4ac40fcd00 2023-12-08T20:26:49.392 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:26:49.392 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": { 2023-12-08T20:26:49.392 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2 2023-12-08T20:26:49.392 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:26:49.392 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": { 2023-12-08T20:26:49.392 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2 2023-12-08T20:26:49.392 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:26:49.392 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": { 2023-12-08T20:26:49.392 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 6 2023-12-08T20:26:49.393 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:26:49.393 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2023-12-08T20:26:49.393 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-08T20:26:49.393 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:26:49.393 INFO:teuthology.orchestra.run.smithi043.stdout: "overall": { 2023-12-08T20:26:49.393 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 14 2023-12-08T20:26:49.393 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-12-08T20:26:49.393 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:26:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.392+0000 7f4acbe82700 1 -- 172.21.15.43:0/495053530 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f4ab0068f60 msgr2=0x7f4ab006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.392+0000 7f4acbe82700 1 --2- 172.21.15.43:0/495053530 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f4ab0068f60 0x7f4ab006b410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40fcb60 tx=0x7f4ac000b040 comp rx=0 tx=0).stop 2023-12-08T20:26:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.392+0000 7f4acbe82700 1 -- 172.21.15.43:0/495053530 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ac40fcd00 msgr2=0x7f4ac410da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.392+0000 7f4acbe82700 1 --2- 172.21.15.43:0/495053530 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ac40fcd00 0x7f4ac410da10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4000c00 tx=0x7f4ab4009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.392+0000 7f4acbe82700 1 -- 172.21.15.43:0/495053530 shutdown_connections 2023-12-08T20:26:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.392+0000 7f4acbe82700 1 --2- 172.21.15.43:0/495053530 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f4ab0068f60 0x7f4ab006b410 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.392+0000 7f4acbe82700 1 --2- 172.21.15.43:0/495053530 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ac40fbaf0 0x7f4ac410d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:49.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.392+0000 7f4acbe82700 1 --2- 172.21.15.43:0/495053530 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ac40fcd00 0x7f4ac410da10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:49.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.392+0000 7f4acbe82700 1 -- 172.21.15.43:0/495053530 >> 172.21.15.43:0/495053530 conn(0x7f4ac40f7190 msgr2=0x7f4ac4065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:49.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.393+0000 7f4acbe82700 1 -- 172.21.15.43:0/495053530 shutdown_connections 2023-12-08T20:26:49.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.393+0000 7f4acbe82700 1 -- 172.21.15.43:0/495053530 wait complete. 2023-12-08T20:26:49.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.536+0000 7f482386a700 1 -- 172.21.15.43:0/117675417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f481c070570 msgr2=0x7f481c0709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:49.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.536+0000 7f482386a700 1 --2- 172.21.15.43:0/117675417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f481c070570 0x7f481c0709c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4818004940 tx=0x7f4818009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:49.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.537+0000 7f482386a700 1 -- 172.21.15.43:0/117675417 shutdown_connections 2023-12-08T20:26:49.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.537+0000 7f482386a700 1 --2- 172.21.15.43:0/117675417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f481c070570 0x7f481c0709c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:49.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.537+0000 7f482386a700 1 --2- 172.21.15.43:0/117675417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f481c071bc0 0x7f481c070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:49.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.537+0000 7f482386a700 1 -- 172.21.15.43:0/117675417 >> 172.21.15.43:0/117675417 conn(0x7f481c0f82d0 msgr2=0x7f481c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:49.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.537+0000 7f482386a700 1 -- 172.21.15.43:0/117675417 shutdown_connections 2023-12-08T20:26:49.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.537+0000 7f482386a700 1 -- 172.21.15.43:0/117675417 wait complete. 2023-12-08T20:26:49.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.538+0000 7f482386a700 1 Processor -- start 2023-12-08T20:26:49.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.538+0000 7f482386a700 1 -- start start 2023-12-08T20:26:49.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.538+0000 7f482386a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f481c070570 0x7f481c113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:49.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.538+0000 7f482386a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f481c071bc0 0x7f481c114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:49.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.538+0000 7f482386a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c114650 con 0x7f481c070570 2023-12-08T20:26:49.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.538+0000 7f482386a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c114ef0 con 0x7f481c071bc0 2023-12-08T20:26:49.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.539+0000 7f4820e05700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f481c071bc0 0x7f481c114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:49.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.539+0000 7f4820e05700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f481c071bc0 0x7f481c114050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.43:41578/0 (socket says 172.21.15.43:41578) 2023-12-08T20:26:49.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.539+0000 7f4820e05700 1 -- 172.21.15.43:0/1714218909 learned_addr learned my addr 172.21.15.43:0/1714218909 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:26:49.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.539+0000 7f4821606700 1 --2- 172.21.15.43:0/1714218909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f481c070570 0x7f481c113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:49.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.539+0000 7f4820e05700 1 -- 172.21.15.43:0/1714218909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f481c070570 msgr2=0x7f481c113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:49.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.539+0000 7f4820e05700 1 --2- 172.21.15.43:0/1714218909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f481c070570 0x7f481c113b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:49.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.539+0000 7f4820e05700 1 -- 172.21.15.43:0/1714218909 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4818005040 con 0x7f481c071bc0 2023-12-08T20:26:49.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.539+0000 7f4820e05700 1 --2- 172.21.15.43:0/1714218909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f481c071bc0 0x7f481c114050 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4818009fd0 tx=0x7f4818009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:49.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.540+0000 7f480dffb700 1 -- 172.21.15.43:0/1714218909 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4818021070 con 0x7f481c071bc0 2023-12-08T20:26:49.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.540+0000 7f480dffb700 1 -- 172.21.15.43:0/1714218909 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f481801c400 con 0x7f481c071bc0 2023-12-08T20:26:49.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.540+0000 7f480dffb700 1 -- 172.21.15.43:0/1714218909 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f481800e070 con 0x7f481c071bc0 2023-12-08T20:26:49.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.540+0000 7f482386a700 1 -- 172.21.15.43:0/1714218909 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481c115170 con 0x7f481c071bc0 2023-12-08T20:26:49.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.540+0000 7f482386a700 1 -- 172.21.15.43:0/1714218909 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481c115600 con 0x7f481c071bc0 2023-12-08T20:26:49.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.541+0000 7f482386a700 1 -- 172.21.15.43:0/1714218909 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481c04bb80 con 0x7f481c071bc0 2023-12-08T20:26:49.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.548+0000 7f480dffb700 1 -- 172.21.15.43:0/1714218909 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f481801ca00 con 0x7f481c071bc0 2023-12-08T20:26:49.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.548+0000 7f480dffb700 1 --2- 172.21.15.43:0/1714218909 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f4808068f60 0x7f480806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:26:49.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.549+0000 7f480dffb700 1 -- 172.21.15.43:0/1714218909 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4818088290 con 0x7f481c071bc0 2023-12-08T20:26:49.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.549+0000 7f4821606700 1 --2- 172.21.15.43:0/1714218909 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f4808068f60 0x7f480806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:26:49.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.549+0000 7f4821606700 1 --2- 172.21.15.43:0/1714218909 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f4808068f60 0x7f480806b410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4810009b80 tx=0x7f481000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:26:49.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.550+0000 7f480dffb700 1 -- 172.21.15.43:0/1714218909 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4818058280 con 0x7f481c071bc0 2023-12-08T20:26:49.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.775+0000 7f482386a700 1 -- 172.21.15.43:0/1714218909 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f481c115d90 con 0x7f4808068f60 2023-12-08T20:26:49.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.777+0000 7f480dffb700 1 -- 172.21.15.43:0/1714218909 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f481c115d90 con 0x7f4808068f60 2023-12-08T20:26:49.778 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:26:49.778 INFO:teuthology.orchestra.run.smithi043.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-08T20:26:49.778 INFO:teuthology.orchestra.run.smithi043.stdout: "in_progress": true, 2023-12-08T20:26:49.778 INFO:teuthology.orchestra.run.smithi043.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-08T20:26:49.778 INFO:teuthology.orchestra.run.smithi043.stdout: "services_complete": [], 2023-12-08T20:26:49.779 INFO:teuthology.orchestra.run.smithi043.stdout: "progress": "0/2 daemons upgraded", 2023-12-08T20:26:49.779 INFO:teuthology.orchestra.run.smithi043.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389 image on host smithi111", 2023-12-08T20:26:49.779 INFO:teuthology.orchestra.run.smithi043.stdout: "is_paused": false 2023-12-08T20:26:49.779 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:26:49.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.779+0000 7f482386a700 1 -- 172.21.15.43:0/1714218909 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f4808068f60 msgr2=0x7f480806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:49.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.779+0000 7f482386a700 1 --2- 172.21.15.43:0/1714218909 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f4808068f60 0x7f480806b410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4810009b80 tx=0x7f481000b040 comp rx=0 tx=0).stop 2023-12-08T20:26:49.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.779+0000 7f482386a700 1 -- 172.21.15.43:0/1714218909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f481c071bc0 msgr2=0x7f481c114050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:26:49.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.779+0000 7f482386a700 1 --2- 172.21.15.43:0/1714218909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f481c071bc0 0x7f481c114050 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4818009fd0 tx=0x7f4818009e30 comp rx=0 tx=0).stop 2023-12-08T20:26:49.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.779+0000 7f482386a700 1 -- 172.21.15.43:0/1714218909 shutdown_connections 2023-12-08T20:26:49.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.779+0000 7f482386a700 1 --2- 172.21.15.43:0/1714218909 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f4808068f60 0x7f480806b410 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:49.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.779+0000 7f482386a700 1 --2- 172.21.15.43:0/1714218909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f481c070570 0x7f481c113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:49.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.779+0000 7f482386a700 1 --2- 172.21.15.43:0/1714218909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f481c071bc0 0x7f481c114050 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:26:49.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.779+0000 7f482386a700 1 -- 172.21.15.43:0/1714218909 >> 172.21.15.43:0/1714218909 conn(0x7f481c0f82d0 msgr2=0x7f481c0fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:26:49.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.779+0000 7f482386a700 1 -- 172.21.15.43:0/1714218909 shutdown_connections 2023-12-08T20:26:49.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:26:49.779+0000 7f482386a700 1 -- 172.21.15.43:0/1714218909 wait complete. 2023-12-08T20:26:49.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:49 smithi111 ceph-mon[121341]: from='client.24387 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:26:49.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:49 smithi111 ceph-mon[121341]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:26:49.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:49 smithi111 ceph-mon[121341]: from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:26:49.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:49 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/495053530' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:26:49.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:49 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:26:50.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:49 smithi043 ceph-mon[111966]: from='client.24387 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:26:50.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:49 smithi043 ceph-mon[111966]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:26:50.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:49 smithi043 ceph-mon[111966]: from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:26:50.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:49 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/495053530' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:26:50.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:49 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:26:50.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:50 smithi111 ceph-mon[121341]: pgmap v168: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-08T20:26:50.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:50 smithi111 ceph-mon[121341]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:26:51.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:50 smithi043 ceph-mon[111966]: pgmap v168: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-08T20:26:51.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:50 smithi043 ceph-mon[111966]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:26:52.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:52 smithi111 ceph-mon[121341]: pgmap v169: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-08T20:26:53.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:52 smithi043 ceph-mon[111966]: pgmap v169: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-08T20:26:54.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:54 smithi111 ceph-mon[121341]: pgmap v170: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-08T20:26:55.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:54 smithi043 ceph-mon[111966]: pgmap v170: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-08T20:26:56.462 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:56 smithi111 ceph-mon[121341]: pgmap v171: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-08T20:26:56.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:56 smithi043 ceph-mon[111966]: pgmap v171: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-08T20:26:58.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:26:58 smithi111 ceph-mon[121341]: pgmap v172: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-08T20:26:59.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:26:58 smithi043 ceph-mon[111966]: pgmap v172: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-08T20:27:00.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:00 smithi111 ceph-mon[121341]: pgmap v173: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-08T20:27:01.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:00 smithi043 ceph-mon[111966]: pgmap v173: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-08T20:27:02.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:02 smithi111 ceph-mon[121341]: pgmap v174: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-08T20:27:03.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:02 smithi043 ceph-mon[111966]: pgmap v174: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-08T20:27:04.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:04 smithi111 ceph-mon[121341]: pgmap v175: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-08T20:27:04.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:04 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:27:05.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:04 smithi043 ceph-mon[111966]: pgmap v175: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-08T20:27:05.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:04 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:27:06.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:06 smithi111 ceph-mon[121341]: pgmap v176: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-08T20:27:06.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:06 smithi043 ceph-mon[111966]: pgmap v176: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-08T20:27:07.906 INFO:tasks.workunit.client.1.smithi111.stderr:Updating files: 95% (11128/11620) Updating files: 96% (11156/11620) Updating files: 97% (11272/11620) Updating files: 98% (11388/11620) Updating files: 99% (11504/11620) Updating files: 100% (11620/11620) Updating files: 100% (11620/11620), done. 2023-12-08T20:27:08.920 INFO:tasks.workunit.client.1.smithi111.stderr:Note: switching to '9dcc13bb80dcc1cdea72b04d80505b4649a2b882'. 2023-12-08T20:27:08.920 INFO:tasks.workunit.client.1.smithi111.stderr: 2023-12-08T20:27:08.921 INFO:tasks.workunit.client.1.smithi111.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-08T20:27:08.921 INFO:tasks.workunit.client.1.smithi111.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-08T20:27:08.921 INFO:tasks.workunit.client.1.smithi111.stderr:state without impacting any branches by switching back to a branch. 2023-12-08T20:27:08.921 INFO:tasks.workunit.client.1.smithi111.stderr: 2023-12-08T20:27:08.921 INFO:tasks.workunit.client.1.smithi111.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-08T20:27:08.921 INFO:tasks.workunit.client.1.smithi111.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-08T20:27:08.921 INFO:tasks.workunit.client.1.smithi111.stderr: 2023-12-08T20:27:08.921 INFO:tasks.workunit.client.1.smithi111.stderr: git switch -c 2023-12-08T20:27:08.921 INFO:tasks.workunit.client.1.smithi111.stderr: 2023-12-08T20:27:08.921 INFO:tasks.workunit.client.1.smithi111.stderr:Or undo this operation with: 2023-12-08T20:27:08.921 INFO:tasks.workunit.client.1.smithi111.stderr: 2023-12-08T20:27:08.921 INFO:tasks.workunit.client.1.smithi111.stderr: git switch - 2023-12-08T20:27:08.921 INFO:tasks.workunit.client.1.smithi111.stderr: 2023-12-08T20:27:08.922 INFO:tasks.workunit.client.1.smithi111.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-08T20:27:08.922 INFO:tasks.workunit.client.1.smithi111.stderr: 2023-12-08T20:27:08.922 INFO:tasks.workunit.client.1.smithi111.stderr:HEAD is now at 9dcc13bb80d Merge pull request #54751 from zdover23/wip-doc-2023-12-02-radosgw-multisite-starting-the-gateway 2023-12-08T20:27:08.924 DEBUG:teuthology.orchestra.run.smithi111:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-12-08T20:27:08.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:08 smithi111 ceph-mon[121341]: pgmap v177: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-08T20:27:08.988 INFO:tasks.workunit.client.1.smithi111.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-08T20:27:08.990 INFO:tasks.workunit.client.1.smithi111.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-08T20:27:08.990 INFO:tasks.workunit.client.1.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-08T20:27:09.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:08 smithi043 ceph-mon[111966]: pgmap v177: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-08T20:27:09.520 INFO:tasks.workunit.client.1.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-08T20:27:09.589 INFO:tasks.workunit.client.1.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-08T20:27:09.627 INFO:tasks.workunit.client.1.smithi111.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-08T20:27:09.629 INFO:tasks.workunit.client.1.smithi111.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-08T20:27:09.629 INFO:tasks.workunit.client.1.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-08T20:27:09.670 INFO:tasks.workunit.client.1.smithi111.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-08T20:27:09.672 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-12-08T20:27:09.672 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-12-08T20:27:09.731 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2023-12-08T20:27:09.732 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-08T20:27:09.732 DEBUG:teuthology.orchestra.run.smithi111:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2023-12-08T20:27:09.797 INFO:tasks.workunit.client.1.smithi111.stderr:+ mkdir -p fsstress 2023-12-08T20:27:09.799 INFO:tasks.workunit.client.1.smithi111.stderr:+ pushd fsstress 2023-12-08T20:27:09.799 INFO:tasks.workunit.client.1.smithi111.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-08T20:27:09.799 INFO:tasks.workunit.client.1.smithi111.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-08T20:27:10.629 INFO:tasks.workunit.client.1.smithi111.stderr:+ tar xzf ltp-full.tgz 2023-12-08T20:27:10.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:10 smithi111 ceph-mon[121341]: pgmap v178: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:27:11.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:10 smithi043 ceph-mon[111966]: pgmap v178: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:27:12.941 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:12 smithi111 ceph-mon[121341]: pgmap v179: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:27:13.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:12 smithi043 ceph-mon[111966]: pgmap v179: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:27:14.885 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:14 smithi111 ceph-mon[121341]: pgmap v180: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:27:14.885 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:14 smithi111 ceph-mon[121341]: Upgrade: Updating mgr.smithi111.mtcffu 2023-12-08T20:27:14.885 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:14 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:14.885 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:14 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.mtcffu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-08T20:27:14.885 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:14 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-08T20:27:14.885 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:14 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:27:14.885 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:14 smithi111 ceph-mon[121341]: Deploying daemon mgr.smithi111.mtcffu on smithi111 2023-12-08T20:27:15.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:14 smithi043 ceph-mon[111966]: pgmap v180: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:27:15.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:14 smithi043 ceph-mon[111966]: Upgrade: Updating mgr.smithi111.mtcffu 2023-12-08T20:27:15.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:14 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:15.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:14 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.mtcffu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-08T20:27:15.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:14 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-08T20:27:15.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:14 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:27:15.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:14 smithi043 ceph-mon[111966]: Deploying daemon mgr.smithi111.mtcffu on smithi111 2023-12-08T20:27:17.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:16 smithi111 ceph-mon[121341]: pgmap v181: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 KiB/s wr, 0 op/s 2023-12-08T20:27:17.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:16 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:17.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:16 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:17.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:16 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:27:17.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:16 smithi043 ceph-mon[111966]: pgmap v181: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 KiB/s wr, 0 op/s 2023-12-08T20:27:17.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:16 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:17.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:16 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:17.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:16 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:27:18.925 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:18 smithi111 ceph-mon[121341]: pgmap v182: 65 pgs: 65 active+clean; 18 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s wr, 99 op/s 2023-12-08T20:27:18.925 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:18 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:18.925 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:18 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:18.925 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:18 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:18.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:18 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:19.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:18 smithi043 ceph-mon[111966]: pgmap v182: 65 pgs: 65 active+clean; 18 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s wr, 99 op/s 2023-12-08T20:27:19.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:18 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:19.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:18 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:19.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:18 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:19.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:18 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:19.887 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:19 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:27:19.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.903+0000 7f3c34ba6700 1 -- 172.21.15.43:0/1780940521 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3c300fcbf0 msgr2=0x7f3c300fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:19.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.903+0000 7f3c34ba6700 1 --2- 172.21.15.43:0/1780940521 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3c300fcbf0 0x7f3c300fd000 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3c20004880 tx=0x7f3c20009e30 comp rx=0 tx=0).stop 2023-12-08T20:27:19.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.903+0000 7f3c34ba6700 1 -- 172.21.15.43:0/1780940521 shutdown_connections 2023-12-08T20:27:19.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.903+0000 7f3c34ba6700 1 --2- 172.21.15.43:0/1780940521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c300fde00 0x7f3c300fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:19.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.903+0000 7f3c34ba6700 1 --2- 172.21.15.43:0/1780940521 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3c300fcbf0 0x7f3c300fd000 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:19.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.903+0000 7f3c34ba6700 1 -- 172.21.15.43:0/1780940521 >> 172.21.15.43:0/1780940521 conn(0x7f3c300f82d0 msgr2=0x7f3c300fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:19.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.903+0000 7f3c34ba6700 1 -- 172.21.15.43:0/1780940521 shutdown_connections 2023-12-08T20:27:19.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.903+0000 7f3c34ba6700 1 -- 172.21.15.43:0/1780940521 wait complete. 2023-12-08T20:27:19.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.903+0000 7f3c34ba6700 1 Processor -- start 2023-12-08T20:27:19.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.904+0000 7f3c34ba6700 1 -- start start 2023-12-08T20:27:19.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.904+0000 7f3c34ba6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3c300fcbf0 0x7f3c3010d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:19.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.904+0000 7f3c34ba6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c300fde00 0x7f3c3010da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:19.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.904+0000 7f3c34ba6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3010e010 con 0x7f3c300fde00 2023-12-08T20:27:19.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.904+0000 7f3c34ba6700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3010e8b0 con 0x7f3c300fcbf0 2023-12-08T20:27:19.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.904+0000 7f3c2dd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c300fde00 0x7f3c3010da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:19.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.904+0000 7f3c2e59c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3c300fcbf0 0x7f3c3010d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:19.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.904+0000 7f3c2dd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c300fde00 0x7f3c3010da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49688/0 (socket says 172.21.15.43:49688) 2023-12-08T20:27:19.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.904+0000 7f3c2dd9b700 1 -- 172.21.15.43:0/1502577053 learned_addr learned my addr 172.21.15.43:0/1502577053 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:27:19.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.904+0000 7f3c2e59c700 1 -- 172.21.15.43:0/1502577053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c300fde00 msgr2=0x7f3c3010da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:19.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.904+0000 7f3c2e59c700 1 --2- 172.21.15.43:0/1502577053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c300fde00 0x7f3c3010da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:19.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.904+0000 7f3c2e59c700 1 -- 172.21.15.43:0/1502577053 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c20005040 con 0x7f3c300fcbf0 2023-12-08T20:27:19.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.905+0000 7f3c2e59c700 1 --2- 172.21.15.43:0/1502577053 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3c300fcbf0 0x7f3c3010d4d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3c20000c00 tx=0x7f3c20009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:27:19.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.905+0000 7f3c1effd700 1 -- 172.21.15.43:0/1502577053 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c2000e070 con 0x7f3c300fcbf0 2023-12-08T20:27:19.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.905+0000 7f3c1effd700 1 -- 172.21.15.43:0/1502577053 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3c2001c400 con 0x7f3c300fcbf0 2023-12-08T20:27:19.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.905+0000 7f3c34ba6700 1 -- 172.21.15.43:0/1502577053 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3010eb30 con 0x7f3c300fcbf0 2023-12-08T20:27:19.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.905+0000 7f3c1effd700 1 -- 172.21.15.43:0/1502577053 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c20012600 con 0x7f3c300fcbf0 2023-12-08T20:27:19.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.905+0000 7f3c34ba6700 1 -- 172.21.15.43:0/1502577053 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3010f010 con 0x7f3c300fcbf0 2023-12-08T20:27:19.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.906+0000 7f3c34ba6700 1 -- 172.21.15.43:0/1502577053 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3004bb80 con 0x7f3c300fcbf0 2023-12-08T20:27:19.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.907+0000 7f3c1effd700 1 -- 172.21.15.43:0/1502577053 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f3c2001c9e0 con 0x7f3c300fcbf0 2023-12-08T20:27:19.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.907+0000 7f3c1effd700 1 --2- 172.21.15.43:0/1502577053 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f3c18068f70 0x7f3c1806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:19.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.907+0000 7f3c1effd700 1 -- 172.21.15.43:0/1502577053 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3c200883f0 con 0x7f3c300fcbf0 2023-12-08T20:27:19.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.907+0000 7f3c2dd9b700 1 --2- 172.21.15.43:0/1502577053 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f3c18068f70 0x7f3c1806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:19.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.908+0000 7f3c2dd9b700 1 --2- 172.21.15.43:0/1502577053 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f3c18068f70 0x7f3c1806b420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3c240041d0 tx=0x7f3c2400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:27:19.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:19.912+0000 7f3c1effd700 1 -- 172.21.15.43:0/1502577053 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3c200583f0 con 0x7f3c300fcbf0 2023-12-08T20:27:20.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:19 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:27:20.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.243+0000 7f3c34ba6700 1 -- 172.21.15.43:0/1502577053 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c3010f480 con 0x7f3c18068f70 2023-12-08T20:27:20.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.245+0000 7f3c1effd700 1 -- 172.21.15.43:0/1502577053 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f3c3010f480 con 0x7f3c18068f70 2023-12-08T20:27:20.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.247+0000 7f3c34ba6700 1 -- 172.21.15.43:0/1502577053 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f3c18068f70 msgr2=0x7f3c1806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:20.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.247+0000 7f3c34ba6700 1 --2- 172.21.15.43:0/1502577053 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f3c18068f70 0x7f3c1806b420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3c240041d0 tx=0x7f3c2400b040 comp rx=0 tx=0).stop 2023-12-08T20:27:20.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.247+0000 7f3c34ba6700 1 -- 172.21.15.43:0/1502577053 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3c300fcbf0 msgr2=0x7f3c3010d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:20.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.247+0000 7f3c34ba6700 1 --2- 172.21.15.43:0/1502577053 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3c300fcbf0 0x7f3c3010d4d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3c20000c00 tx=0x7f3c20009e30 comp rx=0 tx=0).stop 2023-12-08T20:27:20.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.247+0000 7f3c34ba6700 1 -- 172.21.15.43:0/1502577053 shutdown_connections 2023-12-08T20:27:20.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.247+0000 7f3c34ba6700 1 --2- 172.21.15.43:0/1502577053 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f3c18068f70 0x7f3c1806b420 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:20.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.247+0000 7f3c34ba6700 1 --2- 172.21.15.43:0/1502577053 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3c300fcbf0 0x7f3c3010d4d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:20.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.247+0000 7f3c34ba6700 1 --2- 172.21.15.43:0/1502577053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c300fde00 0x7f3c3010da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:20.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.247+0000 7f3c34ba6700 1 -- 172.21.15.43:0/1502577053 >> 172.21.15.43:0/1502577053 conn(0x7f3c300f82d0 msgr2=0x7f3c30101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:20.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.248+0000 7f3c34ba6700 1 -- 172.21.15.43:0/1502577053 shutdown_connections 2023-12-08T20:27:20.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.248+0000 7f3c34ba6700 1 -- 172.21.15.43:0/1502577053 wait complete. 2023-12-08T20:27:20.261 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:27:20.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.376+0000 7f51576d2700 1 -- 172.21.15.43:0/890203285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5150066090 msgr2=0x7f51500ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:20.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.376+0000 7f51576d2700 1 --2- 172.21.15.43:0/890203285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5150066090 0x7f51500ff7a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f514c004940 tx=0x7f514c009e30 comp rx=0 tx=0).stop 2023-12-08T20:27:20.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.376+0000 7f51576d2700 1 -- 172.21.15.43:0/890203285 shutdown_connections 2023-12-08T20:27:20.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.376+0000 7f51576d2700 1 --2- 172.21.15.43:0/890203285 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51500ffd70 0x7f51501021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:20.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.376+0000 7f51576d2700 1 --2- 172.21.15.43:0/890203285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5150066090 0x7f51500ff7a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:20.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.376+0000 7f51576d2700 1 -- 172.21.15.43:0/890203285 >> 172.21.15.43:0/890203285 conn(0x7f51500f7190 msgr2=0x7f51500f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:20.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.376+0000 7f51576d2700 1 -- 172.21.15.43:0/890203285 shutdown_connections 2023-12-08T20:27:20.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.376+0000 7f51576d2700 1 -- 172.21.15.43:0/890203285 wait complete. 2023-12-08T20:27:20.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.377+0000 7f51576d2700 1 Processor -- start 2023-12-08T20:27:20.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.377+0000 7f51576d2700 1 -- start start 2023-12-08T20:27:20.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.377+0000 7f51576d2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5150066090 0x7f515010d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:20.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.377+0000 7f51576d2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51500ffd70 0x7f515010da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:20.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.377+0000 7f51576d2700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515010e010 con 0x7f51500ffd70 2023-12-08T20:27:20.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.377+0000 7f51576d2700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515010e8b0 con 0x7f5150066090 2023-12-08T20:27:20.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.377+0000 7f515546e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5150066090 0x7f515010d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:20.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.377+0000 7f5154c6d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51500ffd70 0x7f515010da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:20.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.377+0000 7f515546e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5150066090 0x7f515010d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.43:56128/0 (socket says 172.21.15.43:56128) 2023-12-08T20:27:20.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.377+0000 7f515546e700 1 -- 172.21.15.43:0/865494929 learned_addr learned my addr 172.21.15.43:0/865494929 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:27:20.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.378+0000 7f5154c6d700 1 -- 172.21.15.43:0/865494929 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5150066090 msgr2=0x7f515010d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:20.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.378+0000 7f5154c6d700 1 --2- 172.21.15.43:0/865494929 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5150066090 0x7f515010d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:20.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.378+0000 7f5154c6d700 1 -- 172.21.15.43:0/865494929 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c005040 con 0x7f51500ffd70 2023-12-08T20:27:20.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.378+0000 7f515546e700 1 --2- 172.21.15.43:0/865494929 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5150066090 0x7f515010d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T20:27:20.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.378+0000 7f5154c6d700 1 --2- 172.21.15.43:0/865494929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51500ffd70 0x7f515010da10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5150065dd0 tx=0x7f514000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:27:20.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.378+0000 7f5145ffb700 1 -- 172.21.15.43:0/865494929 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5140004e90 con 0x7f51500ffd70 2023-12-08T20:27:20.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.378+0000 7f5145ffb700 1 -- 172.21.15.43:0/865494929 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f514000f040 con 0x7f51500ffd70 2023-12-08T20:27:20.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.378+0000 7f51576d2700 1 -- 172.21.15.43:0/865494929 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515010eb30 con 0x7f51500ffd70 2023-12-08T20:27:20.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.379+0000 7f51576d2700 1 -- 172.21.15.43:0/865494929 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f515010f070 con 0x7f51500ffd70 2023-12-08T20:27:20.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.379+0000 7f5145ffb700 1 -- 172.21.15.43:0/865494929 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f514000c980 con 0x7f51500ffd70 2023-12-08T20:27:20.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.380+0000 7f51576d2700 1 -- 172.21.15.43:0/865494929 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51340052e0 con 0x7f51500ffd70 2023-12-08T20:27:20.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.381+0000 7f5145ffb700 1 -- 172.21.15.43:0/865494929 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f5140007cc0 con 0x7f51500ffd70 2023-12-08T20:27:20.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.382+0000 7f5145ffb700 1 --2- 172.21.15.43:0/865494929 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f513c069030 0x7f513c06b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:20.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.382+0000 7f5145ffb700 1 -- 172.21.15.43:0/865494929 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5140086910 con 0x7f51500ffd70 2023-12-08T20:27:20.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.382+0000 7f515546e700 1 --2- 172.21.15.43:0/865494929 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f513c069030 0x7f513c06b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:20.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.383+0000 7f515546e700 1 --2- 172.21.15.43:0/865494929 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f513c069030 0x7f513c06b4e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f514c0135e0 tx=0x7f514c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:27:20.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.386+0000 7f5145ffb700 1 -- 172.21.15.43:0/865494929 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5140056900 con 0x7f51500ffd70 2023-12-08T20:27:20.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.682+0000 7f51576d2700 1 -- 172.21.15.43:0/865494929 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5134000bf0 con 0x7f513c069030 2023-12-08T20:27:20.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.683+0000 7f5145ffb700 1 -- 172.21.15.43:0/865494929 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f5134000bf0 con 0x7f513c069030 2023-12-08T20:27:20.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.685+0000 7f51576d2700 1 -- 172.21.15.43:0/865494929 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f513c069030 msgr2=0x7f513c06b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:20.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.685+0000 7f51576d2700 1 --2- 172.21.15.43:0/865494929 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f513c069030 0x7f513c06b4e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f514c0135e0 tx=0x7f514c009e30 comp rx=0 tx=0).stop 2023-12-08T20:27:20.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.685+0000 7f51576d2700 1 -- 172.21.15.43:0/865494929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51500ffd70 msgr2=0x7f515010da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:20.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.685+0000 7f51576d2700 1 --2- 172.21.15.43:0/865494929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51500ffd70 0x7f515010da10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5150065dd0 tx=0x7f514000b040 comp rx=0 tx=0).stop 2023-12-08T20:27:20.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.686+0000 7f51576d2700 1 -- 172.21.15.43:0/865494929 shutdown_connections 2023-12-08T20:27:20.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.686+0000 7f51576d2700 1 --2- 172.21.15.43:0/865494929 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7f513c069030 0x7f513c06b4e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:20.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.686+0000 7f51576d2700 1 --2- 172.21.15.43:0/865494929 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5150066090 0x7f515010d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:20.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.686+0000 7f51576d2700 1 --2- 172.21.15.43:0/865494929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51500ffd70 0x7f515010da10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:20.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.686+0000 7f51576d2700 1 -- 172.21.15.43:0/865494929 >> 172.21.15.43:0/865494929 conn(0x7f51500f7190 msgr2=0x7f51500f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:20.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.686+0000 7f51576d2700 1 -- 172.21.15.43:0/865494929 shutdown_connections 2023-12-08T20:27:20.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.686+0000 7f51576d2700 1 -- 172.21.15.43:0/865494929 wait complete. 2023-12-08T20:27:20.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.834+0000 7feb6bcb8700 1 -- 172.21.15.43:0/4080711954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb64100050 msgr2=0x7feb64102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:20.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.834+0000 7feb6bcb8700 1 --2- 172.21.15.43:0/4080711954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb64100050 0x7feb64102430 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7feb54004940 tx=0x7feb54009e30 comp rx=0 tx=0).stop 2023-12-08T20:27:20.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.835+0000 7feb6bcb8700 1 -- 172.21.15.43:0/4080711954 shutdown_connections 2023-12-08T20:27:20.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.835+0000 7feb6bcb8700 1 --2- 172.21.15.43:0/4080711954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb64100050 0x7feb64102430 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:20.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.835+0000 7feb6bcb8700 1 --2- 172.21.15.43:0/4080711954 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feb640fd730 0x7feb640ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:20.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.835+0000 7feb6bcb8700 1 -- 172.21.15.43:0/4080711954 >> 172.21.15.43:0/4080711954 conn(0x7feb640f71b0 msgr2=0x7feb640f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:20.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.835+0000 7feb6bcb8700 1 -- 172.21.15.43:0/4080711954 shutdown_connections 2023-12-08T20:27:20.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.835+0000 7feb6bcb8700 1 -- 172.21.15.43:0/4080711954 wait complete. 2023-12-08T20:27:20.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.835+0000 7feb6bcb8700 1 Processor -- start 2023-12-08T20:27:20.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.835+0000 7feb6bcb8700 1 -- start start 2023-12-08T20:27:20.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.836+0000 7feb6bcb8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feb640fd730 0x7feb640fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:20.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.836+0000 7feb6bcb8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb64100050 0x7feb640fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:20.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.836+0000 7feb6bcb8700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb640fbc40 con 0x7feb64100050 2023-12-08T20:27:20.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.836+0000 7feb6bcb8700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb640fbdb0 con 0x7feb640fd730 2023-12-08T20:27:20.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.836+0000 7feb69253700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb64100050 0x7feb640fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:20.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.836+0000 7feb69253700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb64100050 0x7feb640fb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58348/0 (socket says 172.21.15.43:58348) 2023-12-08T20:27:20.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.836+0000 7feb69253700 1 -- 172.21.15.43:0/2995050109 learned_addr learned my addr 172.21.15.43:0/2995050109 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:27:20.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.836+0000 7feb69253700 1 -- 172.21.15.43:0/2995050109 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feb640fd730 msgr2=0x7feb640fd1c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-08T20:27:20.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.836+0000 7feb69253700 1 --2- 172.21.15.43:0/2995050109 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feb640fd730 0x7feb640fd1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:20.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.836+0000 7feb69253700 1 -- 172.21.15.43:0/2995050109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb54005040 con 0x7feb64100050 2023-12-08T20:27:20.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.836+0000 7feb69253700 1 --2- 172.21.15.43:0/2995050109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb64100050 0x7feb640fb640 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7feb54009fd0 tx=0x7feb54009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:27:20.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.837+0000 7feb5a7fc700 1 -- 172.21.15.43:0/2995050109 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb54021070 con 0x7feb64100050 2023-12-08T20:27:20.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.837+0000 7feb5a7fc700 1 -- 172.21.15.43:0/2995050109 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feb54013c60 con 0x7feb64100050 2023-12-08T20:27:20.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.837+0000 7feb6bcb8700 1 -- 172.21.15.43:0/2995050109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb640fc030 con 0x7feb64100050 2023-12-08T20:27:20.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.837+0000 7feb6bcb8700 1 -- 172.21.15.43:0/2995050109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb641154c0 con 0x7feb64100050 2023-12-08T20:27:20.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.838+0000 7feb5a7fc700 1 -- 172.21.15.43:0/2995050109 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb5400e070 con 0x7feb64100050 2023-12-08T20:27:20.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.838+0000 7feb5a7fc700 1 -- 172.21.15.43:0/2995050109 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7feb5400b4a0 con 0x7feb64100050 2023-12-08T20:27:20.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.838+0000 7feb6bcb8700 1 -- 172.21.15.43:0/2995050109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb480052e0 con 0x7feb64100050 2023-12-08T20:27:20.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.839+0000 7feb5a7fc700 1 --2- 172.21.15.43:0/2995050109 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7feb50068f60 0x7feb5006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:20.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.839+0000 7feb5a7fc700 1 -- 172.21.15.43:0/2995050109 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7feb54013dd0 con 0x7feb64100050 2023-12-08T20:27:20.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.839+0000 7feb69a54700 1 --2- 172.21.15.43:0/2995050109 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7feb50068f60 0x7feb5006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:20.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.840+0000 7feb69a54700 1 --2- 172.21.15.43:0/2995050109 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7feb50068f60 0x7feb5006b410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feb640fcf50 tx=0x7feb6000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:27:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:20.844+0000 7feb5a7fc700 1 -- 172.21.15.43:0/2995050109 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7feb54058f70 con 0x7feb64100050 2023-12-08T20:27:20.953 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:20 smithi111 ceph-mon[121341]: pgmap v183: 65 pgs: 65 active+clean; 31 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s wr, 203 op/s 2023-12-08T20:27:20.954 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:20 smithi111 ceph-mon[121341]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:27:21.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:20 smithi043 ceph-mon[111966]: pgmap v183: 65 pgs: 65 active+clean; 31 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s wr, 203 op/s 2023-12-08T20:27:21.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:20 smithi043 ceph-mon[111966]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:27:21.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.093+0000 7feb6bcb8700 1 -- 172.21.15.43:0/2995050109 --> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feb48000bf0 con 0x7feb50068f60 2023-12-08T20:27:21.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.104+0000 7feb5a7fc700 1 -- 172.21.15.43:0/2995050109 <== mgr.14208 v2:172.21.15.43:6800/3959093322 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7feb48000bf0 con 0x7feb50068f60 2023-12-08T20:27:21.106 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-08T20:27:21.107 INFO:teuthology.orchestra.run.smithi043.stdout:alertmanager.smithi043 smithi043 *:9093,9094 running (4m) 81s ago 5m - - 0.25.0 c8568f914cd2 4a24f8273198 2023-12-08T20:27:21.107 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi043 smithi043 running (5m) 81s ago 5m - - 17.2.7-119-ge2143d99 f761b6e42225 f84d492b732c 2023-12-08T20:27:21.107 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi111 smithi111 running (4m) 3s ago 4m 7428k - 17.2.7-119-ge2143d99 f761b6e42225 88b53685ae54 2023-12-08T20:27:21.107 INFO:teuthology.orchestra.run.smithi043.stdout:grafana.smithi043 smithi043 *:3000 running (4m) 81s ago 5m - - 9.4.7 954c08fa6188 503ad8a7ae04 2023-12-08T20:27:21.107 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.akrjef smithi043 running (93s) 81s ago 93s - - 17.2.7-119-ge2143d99 f761b6e42225 1c0cb8d34ef8 2023-12-08T20:27:21.107 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.pjmszb smithi043 running (97s) 81s ago 97s - - 17.2.7-119-ge2143d99 f761b6e42225 d7eee0c78093 2023-12-08T20:27:21.107 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.svpasm smithi111 running (91s) 3s ago 91s 13.6M - 17.2.7-119-ge2143d99 f761b6e42225 657d4d1cf4b2 2023-12-08T20:27:21.107 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.veeegc smithi111 running (95s) 3s ago 95s 19.5M - 17.2.7-119-ge2143d99 f761b6e42225 31f794a388ab 2023-12-08T20:27:21.107 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi043.hqcdcm smithi043 *:9283 running (6m) 82s ago 6m - - 17.2.7-119-ge2143d99 f761b6e42225 58b656e8e333 2023-12-08T20:27:21.107 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi111.mtcffu smithi111 *:8443,9283 running (5s) 3s ago 4m 48.5M - 19.0.0-44-g9dcc13bb f28f2b94f153 d2b826bdf0bf 2023-12-08T20:27:21.107 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi043 smithi043 running (6m) 82s ago 6m - 2048M 17.2.7-119-ge2143d99 f761b6e42225 fe2a56effef3 2023-12-08T20:27:21.107 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi111 smithi111 running (4m) 3s ago 4m 51.0M 2048M 17.2.7-119-ge2143d99 f761b6e42225 2ae21cf3fa1e 2023-12-08T20:27:21.107 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi043 smithi043 *:9100 running (5m) 81s ago 5m - - 1.5.0 0da6a335fe13 8e51a55a8bc8 2023-12-08T20:27:21.107 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi111 smithi111 *:9100 running (4m) 3s ago 4m 16.9M - 1.5.0 0da6a335fe13 73de1624518e 2023-12-08T20:27:21.108 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (4m) 81s ago 4m - 4300M 17.2.7-119-ge2143d99 f761b6e42225 462eeaf62b2c 2023-12-08T20:27:21.108 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi043 running (3m) 81s ago 3m - 4300M 17.2.7-119-ge2143d99 f761b6e42225 dde419c88a89 2023-12-08T20:27:21.108 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi043 running (3m) 81s ago 3m - 4300M 17.2.7-119-ge2143d99 f761b6e42225 f7e812026ef5 2023-12-08T20:27:21.108 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi111 running (3m) 3s ago 3m 110M 5323M 17.2.7-119-ge2143d99 f761b6e42225 2a738d30441c 2023-12-08T20:27:21.108 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi111 running (2m) 3s ago 2m 101M 5323M 17.2.7-119-ge2143d99 f761b6e42225 38cdb6a88694 2023-12-08T20:27:21.108 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi111 running (2m) 3s ago 2m 105M 5323M 17.2.7-119-ge2143d99 f761b6e42225 59a9ce8c1141 2023-12-08T20:27:21.108 INFO:teuthology.orchestra.run.smithi043.stdout:prometheus.smithi043 smithi043 *:9095 running (4m) 81s ago 5m - - 2.43.0 a07b618ecd1d 88bcbb698598 2023-12-08T20:27:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.106+0000 7feb6bcb8700 1 -- 172.21.15.43:0/2995050109 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7feb50068f60 msgr2=0x7feb5006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.106+0000 7feb6bcb8700 1 --2- 172.21.15.43:0/2995050109 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7feb50068f60 0x7feb5006b410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feb640fcf50 tx=0x7feb6000b040 comp rx=0 tx=0).stop 2023-12-08T20:27:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.106+0000 7feb6bcb8700 1 -- 172.21.15.43:0/2995050109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb64100050 msgr2=0x7feb640fb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.106+0000 7feb6bcb8700 1 --2- 172.21.15.43:0/2995050109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb64100050 0x7feb640fb640 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7feb54009fd0 tx=0x7feb54009e30 comp rx=0 tx=0).stop 2023-12-08T20:27:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.107+0000 7feb6bcb8700 1 -- 172.21.15.43:0/2995050109 shutdown_connections 2023-12-08T20:27:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.107+0000 7feb6bcb8700 1 --2- 172.21.15.43:0/2995050109 >> [v2:172.21.15.43:6800/3959093322,v1:172.21.15.43:6801/3959093322] conn(0x7feb50068f60 0x7feb5006b410 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.107+0000 7feb6bcb8700 1 --2- 172.21.15.43:0/2995050109 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feb640fd730 0x7feb640fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.107+0000 7feb6bcb8700 1 --2- 172.21.15.43:0/2995050109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb64100050 0x7feb640fb640 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.107+0000 7feb6bcb8700 1 -- 172.21.15.43:0/2995050109 >> 172.21.15.43:0/2995050109 conn(0x7feb640f71b0 msgr2=0x7feb640f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.107+0000 7feb6bcb8700 1 -- 172.21.15.43:0/2995050109 shutdown_connections 2023-12-08T20:27:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.107+0000 7feb6bcb8700 1 -- 172.21.15.43:0/2995050109 wait complete. 2023-12-08T20:27:21.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.256+0000 7f31905ca700 1 -- 172.21.15.43:0/2427101976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31880fa880 msgr2=0x7f31880fac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:21.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.256+0000 7f31905ca700 1 --2- 172.21.15.43:0/2427101976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31880fa880 0x7f31880fac90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f317c004880 tx=0x7f317c009e30 comp rx=0 tx=0).stop 2023-12-08T20:27:21.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.256+0000 7f31905ca700 1 -- 172.21.15.43:0/2427101976 shutdown_connections 2023-12-08T20:27:21.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.256+0000 7f31905ca700 1 --2- 172.21.15.43:0/2427101976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31880fb260 0x7f3188102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:21.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.256+0000 7f31905ca700 1 --2- 172.21.15.43:0/2427101976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31880fa880 0x7f31880fac90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:21.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.256+0000 7f31905ca700 1 -- 172.21.15.43:0/2427101976 >> 172.21.15.43:0/2427101976 conn(0x7f31880f64f0 msgr2=0x7f31880f8920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:21.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.257+0000 7f31905ca700 1 -- 172.21.15.43:0/2427101976 shutdown_connections 2023-12-08T20:27:21.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.257+0000 7f31905ca700 1 -- 172.21.15.43:0/2427101976 wait complete. 2023-12-08T20:27:21.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.257+0000 7f31905ca700 1 Processor -- start 2023-12-08T20:27:21.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.257+0000 7f31905ca700 1 -- start start 2023-12-08T20:27:21.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.258+0000 7f31905ca700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31880fa880 0x7f318810d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:21.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.258+0000 7f31905ca700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31880fb260 0x7f318810d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:21.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.258+0000 7f31905ca700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318810dfd0 con 0x7f31880fa880 2023-12-08T20:27:21.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.258+0000 7f31905ca700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318810e870 con 0x7f31880fb260 2023-12-08T20:27:21.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.258+0000 7f318e366700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31880fa880 0x7f318810d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:21.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.258+0000 7f318e366700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31880fa880 0x7f318810d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58372/0 (socket says 172.21.15.43:58372) 2023-12-08T20:27:21.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.258+0000 7f318e366700 1 -- 172.21.15.43:0/2141486356 learned_addr learned my addr 172.21.15.43:0/2141486356 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:27:21.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.258+0000 7f318db65700 1 --2- 172.21.15.43:0/2141486356 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31880fb260 0x7f318810d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:21.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.259+0000 7f318db65700 1 -- 172.21.15.43:0/2141486356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31880fa880 msgr2=0x7f318810d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:21.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.259+0000 7f318db65700 1 --2- 172.21.15.43:0/2141486356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31880fa880 0x7f318810d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:21.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.259+0000 7f318db65700 1 -- 172.21.15.43:0/2141486356 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3184005040 con 0x7f31880fb260 2023-12-08T20:27:21.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.259+0000 7f318db65700 1 --2- 172.21.15.43:0/2141486356 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31880fb260 0x7f318810d9d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f31840096d0 tx=0x7f3184009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:27:21.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.259+0000 7f317affd700 1 -- 172.21.15.43:0/2141486356 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3184017070 con 0x7f31880fb260 2023-12-08T20:27:21.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.259+0000 7f31905ca700 1 -- 172.21.15.43:0/2141486356 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317c005040 con 0x7f31880fb260 2023-12-08T20:27:21.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.259+0000 7f317affd700 1 -- 172.21.15.43:0/2141486356 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f318400f040 con 0x7f31880fb260 2023-12-08T20:27:21.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.259+0000 7f317affd700 1 -- 172.21.15.43:0/2141486356 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3184013ac0 con 0x7f31880fb260 2023-12-08T20:27:21.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.259+0000 7f31905ca700 1 -- 172.21.15.43:0/2141486356 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318810eea0 con 0x7f31880fb260 2023-12-08T20:27:21.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.260+0000 7f317affd700 1 -- 172.21.15.43:0/2141486356 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 20) v1 ==== 43075+0+0 (secure 0 0 0) 0x7f3184013ca0 con 0x7f31880fb260 2023-12-08T20:27:21.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.261+0000 7f317affd700 1 -- 172.21.15.43:0/2141486356 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f3184048ee0 con 0x7f31880fb260 2023-12-08T20:27:21.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.261+0000 7f31905ca700 1 -- 172.21.15.43:0/2141486356 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31881075b0 con 0x7f31880fb260 2023-12-08T20:27:21.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.270+0000 7f317affd700 1 -- 172.21.15.43:0/2141486356 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3184074a00 con 0x7f31880fb260 2023-12-08T20:27:21.664 INFO:tasks.workunit.client.0.smithi043.stderr:Updating files: 79% (9215/11620) Updating files: 80% (9296/11620) Updating files: 81% (9413/11620) Updating files: 82% (9529/11620) Updating files: 83% (9645/11620) Updating files: 84% (9761/11620) Updating files: 85% (9877/11620) Updating files: 86% (9994/11620) Updating files: 87% (10110/11620) Updating files: 88% (10226/11620) Updating files: 89% (10342/11620) Updating files: 90% (10458/11620) Updating files: 91% (10575/11620) Updating files: 92% (10691/11620) Updating files: 93% (10807/11620) Updating files: 94% (10923/11620) Updating files: 95% (11039/11620) Updating files: 96% (11156/11620) Updating files: 97% (11272/11620) Updating files: 98% (11388/11620) Updating files: 99% (11504/11620) Updating files: 100% (11620/11620) Updating files: 100% (11620/11620), done. 2023-12-08T20:27:21.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.720+0000 7f31905ca700 1 -- 172.21.15.43:0/2141486356 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3188105570 con 0x7f31880fb260 2023-12-08T20:27:21.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.720+0000 7f317affd700 1 -- 172.21.15.43:0/2141486356 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f318401c410 con 0x7f31880fb260 2023-12-08T20:27:21.722 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:27:21.722 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": { 2023-12-08T20:27:21.722 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2 2023-12-08T20:27:21.722 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:27:21.723 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": { 2023-12-08T20:27:21.723 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 1 2023-12-08T20:27:21.723 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:27:21.723 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": { 2023-12-08T20:27:21.723 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 6 2023-12-08T20:27:21.723 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:27:21.723 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2023-12-08T20:27:21.723 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-08T20:27:21.723 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:27:21.723 INFO:teuthology.orchestra.run.smithi043.stdout: "overall": { 2023-12-08T20:27:21.723 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 13 2023-12-08T20:27:21.723 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-12-08T20:27:21.723 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:27:21.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.724+0000 7f31905ca700 1 -- 172.21.15.43:0/2141486356 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31880fb260 msgr2=0x7f318810d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:21.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.724+0000 7f31905ca700 1 --2- 172.21.15.43:0/2141486356 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31880fb260 0x7f318810d9d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f31840096d0 tx=0x7f3184009e30 comp rx=0 tx=0).stop 2023-12-08T20:27:21.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.724+0000 7f31905ca700 1 -- 172.21.15.43:0/2141486356 shutdown_connections 2023-12-08T20:27:21.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.724+0000 7f31905ca700 1 --2- 172.21.15.43:0/2141486356 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31880fb260 0x7f318810d9d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:21.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.724+0000 7f31905ca700 1 --2- 172.21.15.43:0/2141486356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31880fa880 0x7f318810d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:21.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.724+0000 7f31905ca700 1 -- 172.21.15.43:0/2141486356 >> 172.21.15.43:0/2141486356 conn(0x7f31880f64f0 msgr2=0x7f3188100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:21.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.724+0000 7f31905ca700 1 -- 172.21.15.43:0/2141486356 shutdown_connections 2023-12-08T20:27:21.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.724+0000 7f31905ca700 1 -- 172.21.15.43:0/2141486356 wait complete. 2023-12-08T20:27:21.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.854+0000 7f17061d2700 1 -- 172.21.15.43:0/1491324384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17000fb290 msgr2=0x7f17000fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:21.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.854+0000 7f17061d2700 1 --2- 172.21.15.43:0/1491324384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17000fb290 0x7f17000fb6a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f16f0004940 tx=0x7f16f0009e30 comp rx=0 tx=0).stop 2023-12-08T20:27:21.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.854+0000 7f17061d2700 1 -- 172.21.15.43:0/1491324384 shutdown_connections 2023-12-08T20:27:21.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.854+0000 7f17061d2700 1 --2- 172.21.15.43:0/1491324384 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17000fc4a0 0x7f17000fc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:21.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.854+0000 7f17061d2700 1 --2- 172.21.15.43:0/1491324384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17000fb290 0x7f17000fb6a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:21.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.854+0000 7f17061d2700 1 -- 172.21.15.43:0/1491324384 >> 172.21.15.43:0/1491324384 conn(0x7f17000f6950 msgr2=0x7f17000f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:21.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.854+0000 7f17061d2700 1 -- 172.21.15.43:0/1491324384 shutdown_connections 2023-12-08T20:27:21.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.854+0000 7f17061d2700 1 -- 172.21.15.43:0/1491324384 wait complete. 2023-12-08T20:27:21.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.855+0000 7f17061d2700 1 Processor -- start 2023-12-08T20:27:21.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.855+0000 7f17061d2700 1 -- start start 2023-12-08T20:27:21.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.856+0000 7f17061d2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17000fb290 0x7f170010d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:21.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.856+0000 7f17061d2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17000fc4a0 0x7f170010daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:21.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.856+0000 7f17061d2700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170010e0a0 con 0x7f17000fb290 2023-12-08T20:27:21.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.856+0000 7f17061d2700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170010e940 con 0x7f17000fc4a0 2023-12-08T20:27:21.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.856+0000 7f16ff7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17000fb290 0x7f170010d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:21.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.856+0000 7f16ff7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17000fb290 0x7f170010d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58414/0 (socket says 172.21.15.43:58414) 2023-12-08T20:27:21.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.856+0000 7f16ff7fe700 1 -- 172.21.15.43:0/2916220333 learned_addr learned my addr 172.21.15.43:0/2916220333 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:27:21.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.856+0000 7f16feffd700 1 --2- 172.21.15.43:0/2916220333 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17000fc4a0 0x7f170010daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:21.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.856+0000 7f16ff7fe700 1 -- 172.21.15.43:0/2916220333 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17000fc4a0 msgr2=0x7f170010daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:21.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.856+0000 7f16ff7fe700 1 --2- 172.21.15.43:0/2916220333 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17000fc4a0 0x7f170010daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:21.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.856+0000 7f16ff7fe700 1 -- 172.21.15.43:0/2916220333 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f0005040 con 0x7f17000fb290 2023-12-08T20:27:21.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.856+0000 7f16ff7fe700 1 --2- 172.21.15.43:0/2916220333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17000fb290 0x7f170010d560 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f16f000b7d0 tx=0x7f16f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:27:21.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.857+0000 7f16e7fff700 1 -- 172.21.15.43:0/2916220333 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16f000e040 con 0x7f17000fb290 2023-12-08T20:27:21.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.857+0000 7f17061d2700 1 -- 172.21.15.43:0/2916220333 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170010ebc0 con 0x7f17000fb290 2023-12-08T20:27:21.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.857+0000 7f17061d2700 1 -- 172.21.15.43:0/2916220333 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170010f100 con 0x7f17000fb290 2023-12-08T20:27:21.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.857+0000 7f16e7fff700 1 -- 172.21.15.43:0/2916220333 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f16f000bc50 con 0x7f17000fb290 2023-12-08T20:27:21.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.857+0000 7f16e7fff700 1 -- 172.21.15.43:0/2916220333 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16f001c630 con 0x7f17000fb290 2023-12-08T20:27:21.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.858+0000 7f17061d2700 1 -- 172.21.15.43:0/2916220333 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17001053f0 con 0x7f17000fb290 2023-12-08T20:27:21.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.859+0000 7f16e7fff700 1 -- 172.21.15.43:0/2916220333 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 20) v1 ==== 43075+0+0 (secure 0 0 0) 0x7f16f0013420 con 0x7f17000fb290 2023-12-08T20:27:21.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.859+0000 7f16e7fff700 1 -- 172.21.15.43:0/2916220333 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f16f0052350 con 0x7f17000fb290 2023-12-08T20:27:21.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:21.867+0000 7f16e7fff700 1 -- 172.21.15.43:0/2916220333 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f16f004f060 con 0x7f17000fb290 2023-12-08T20:27:22.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:22 smithi111 ceph-mon[121341]: from='client.24411 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:27:22.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:22 smithi111 ceph-mon[121341]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:27:22.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:22 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:22.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:22 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:22.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:22 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:27:22.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:22 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:27:22.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:22 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:22.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:22 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:27:22.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:22 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr fail", "who": "smithi043.hqcdcm"}]: dispatch 2023-12-08T20:27:22.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:22 smithi111 ceph-mon[121341]: osdmap e46: 6 total, 6 up, 6 in 2023-12-08T20:27:22.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:22 smithi111 ceph-mon[121341]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "mgr fail", "who": "smithi043.hqcdcm"}]': finished 2023-12-08T20:27:22.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:22 smithi111 ceph-mon[121341]: mgrmap e20: smithi111.mtcffu(active, starting, since 0.0106283s) 2023-12-08T20:27:22.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:22 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/2141486356' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:27:22.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:22 smithi043 ceph-mon[111966]: from='client.24411 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:27:22.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:22 smithi043 ceph-mon[111966]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:27:22.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:22 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:22.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:22 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:22.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:22 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:27:22.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:22 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:27:22.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:22 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:27:22.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:22 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:27:22.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:22 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr fail", "who": "smithi043.hqcdcm"}]: dispatch 2023-12-08T20:27:22.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:22 smithi043 ceph-mon[111966]: osdmap e46: 6 total, 6 up, 6 in 2023-12-08T20:27:22.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:22 smithi043 ceph-mon[111966]: from='mgr.14208 172.21.15.43:0/1305736218' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "mgr fail", "who": "smithi043.hqcdcm"}]': finished 2023-12-08T20:27:22.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:22 smithi043 ceph-mon[111966]: mgrmap e20: smithi111.mtcffu(active, starting, since 0.0106283s) 2023-12-08T20:27:22.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:22 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/2141486356' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:27:22.755 INFO:tasks.workunit.client.0.smithi043.stderr:Note: switching to '9dcc13bb80dcc1cdea72b04d80505b4649a2b882'. 2023-12-08T20:27:22.755 INFO:tasks.workunit.client.0.smithi043.stderr: 2023-12-08T20:27:22.755 INFO:tasks.workunit.client.0.smithi043.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-08T20:27:22.755 INFO:tasks.workunit.client.0.smithi043.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-08T20:27:22.756 INFO:tasks.workunit.client.0.smithi043.stderr:state without impacting any branches by switching back to a branch. 2023-12-08T20:27:22.756 INFO:tasks.workunit.client.0.smithi043.stderr: 2023-12-08T20:27:22.756 INFO:tasks.workunit.client.0.smithi043.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-08T20:27:22.756 INFO:tasks.workunit.client.0.smithi043.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-08T20:27:22.756 INFO:tasks.workunit.client.0.smithi043.stderr: 2023-12-08T20:27:22.756 INFO:tasks.workunit.client.0.smithi043.stderr: git switch -c 2023-12-08T20:27:22.756 INFO:tasks.workunit.client.0.smithi043.stderr: 2023-12-08T20:27:22.756 INFO:tasks.workunit.client.0.smithi043.stderr:Or undo this operation with: 2023-12-08T20:27:22.756 INFO:tasks.workunit.client.0.smithi043.stderr: 2023-12-08T20:27:22.756 INFO:tasks.workunit.client.0.smithi043.stderr: git switch - 2023-12-08T20:27:22.756 INFO:tasks.workunit.client.0.smithi043.stderr: 2023-12-08T20:27:22.756 INFO:tasks.workunit.client.0.smithi043.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-08T20:27:22.756 INFO:tasks.workunit.client.0.smithi043.stderr: 2023-12-08T20:27:22.756 INFO:tasks.workunit.client.0.smithi043.stderr:HEAD is now at 9dcc13bb80d Merge pull request #54751 from zdover23/wip-doc-2023-12-02-radosgw-multisite-starting-the-gateway 2023-12-08T20:27:22.761 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-08T20:27:22.851 INFO:tasks.workunit.client.0.smithi043.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-08T20:27:22.853 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-08T20:27:22.853 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-08T20:27:23.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:23.092+0000 7f16e7fff700 1 -- 172.21.15.43:0/2916220333 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 21) v1 ==== 45250+0+0 (secure 0 0 0) 0x7f16f0025400 con 0x7f17000fb290 2023-12-08T20:27:23.202 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: Active manager daemon smithi111.mtcffu restarted 2023-12-08T20:27:23.202 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: Activating manager daemon smithi111.mtcffu 2023-12-08T20:27:23.202 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/crt"}]: dispatch 2023-12-08T20:27:23.202 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: osdmap e47: 6 total, 6 up, 6 in 2023-12-08T20:27:23.202 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: mgrmap e21: smithi111.mtcffu(active, starting, since 0.00626931s) 2023-12-08T20:27:23.202 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/crt"}]: dispatch 2023-12-08T20:27:23.202 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:27:23.203 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:27:23.203 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi043.pjmszb"}]: dispatch 2023-12-08T20:27:23.203 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi043.akrjef"}]: dispatch 2023-12-08T20:27:23.203 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.veeegc"}]: dispatch 2023-12-08T20:27:23.203 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.svpasm"}]: dispatch 2023-12-08T20:27:23.203 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mgr metadata", "who": "smithi111.mtcffu", "id": "smithi111.mtcffu"}]: dispatch 2023-12-08T20:27:23.203 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:27:23.203 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-08T20:27:23.203 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:27:23.203 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:27:23.203 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:27:23.203 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:27:23.203 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-08T20:27:23.203 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-08T20:27:23.204 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-08T20:27:23.204 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-08T20:27:23.204 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/key"}]: dispatch 2023-12-08T20:27:23.204 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-08T20:27:23.430 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: Active manager daemon smithi111.mtcffu restarted 2023-12-08T20:27:23.430 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: Activating manager daemon smithi111.mtcffu 2023-12-08T20:27:23.430 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.? 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/crt"}]: dispatch 2023-12-08T20:27:23.430 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: osdmap e47: 6 total, 6 up, 6 in 2023-12-08T20:27:23.430 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: mgrmap e21: smithi111.mtcffu(active, starting, since 0.00626931s) 2023-12-08T20:27:23.430 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/crt"}]: dispatch 2023-12-08T20:27:23.431 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:27:23.431 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:27:23.431 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi043.pjmszb"}]: dispatch 2023-12-08T20:27:23.431 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi043.akrjef"}]: dispatch 2023-12-08T20:27:23.431 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.veeegc"}]: dispatch 2023-12-08T20:27:23.431 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.svpasm"}]: dispatch 2023-12-08T20:27:23.431 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mgr metadata", "who": "smithi111.mtcffu", "id": "smithi111.mtcffu"}]: dispatch 2023-12-08T20:27:23.431 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:27:23.431 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-08T20:27:23.431 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:27:23.431 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:27:23.431 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:27:23.431 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:27:23.431 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-08T20:27:23.432 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-08T20:27:23.432 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-08T20:27:23.432 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-08T20:27:23.432 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/key"}]: dispatch 2023-12-08T20:27:23.432 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-08T20:27:23.596 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-08T20:27:23.846 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-08T20:27:23.898 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-08T20:27:23.899 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-08T20:27:23.899 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-08T20:27:23.942 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-08T20:27:23.946 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-12-08T20:27:23.946 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-08T20:27:23.968 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2023-12-08T20:27:23.969 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-08T20:27:23.969 DEBUG:teuthology.orchestra.run.smithi043:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2023-12-08T20:27:24.039 INFO:tasks.workunit.client.0.smithi043.stderr:+ mkdir -p fsstress 2023-12-08T20:27:24.041 INFO:tasks.workunit.client.0.smithi043.stderr:+ pushd fsstress 2023-12-08T20:27:24.041 INFO:tasks.workunit.client.0.smithi043.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-08T20:27:24.042 INFO:tasks.workunit.client.0.smithi043.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-08T20:27:24.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:24.146+0000 7f16e7fff700 1 -- 172.21.15.43:0/2916220333 <== mon.0 v2:172.21.15.43:3300/0 8 ==== mgrmap(e 22) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f16f0022d70 con 0x7f17000fb290 2023-12-08T20:27:24.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:24.147+0000 7f16e7fff700 1 --2- 172.21.15.43:0/2916220333 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f16e803c760 0x7f16e803eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:24.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:24.147+0000 7f16e7fff700 1 -- 172.21.15.43:0/2916220333 --> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f16e803f080 con 0x7f16e803c760 2023-12-08T20:27:24.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:24.155+0000 7f16feffd700 1 --2- 172.21.15.43:0/2916220333 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f16e803c760 0x7f16e803eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:24.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:24.156+0000 7f16feffd700 1 --2- 172.21.15.43:0/2916220333 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f16e803c760 0x7f16e803eb40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f16f400afd0 tx=0x7f16f4009040 comp rx=0 tx=0).ready entity=mgr.24407 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:27:24.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:24.163+0000 7f16e7fff700 1 -- 172.21.15.43:0/2916220333 <== mgr.24407 v2:172.21.15.111:6828/940639390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f16e803f080 con 0x7f16e803c760 2023-12-08T20:27:24.165 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:27:24.165 INFO:teuthology.orchestra.run.smithi043.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-08T20:27:24.165 INFO:teuthology.orchestra.run.smithi043.stdout: "in_progress": true, 2023-12-08T20:27:24.165 INFO:teuthology.orchestra.run.smithi043.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-08T20:27:24.165 INFO:teuthology.orchestra.run.smithi043.stdout: "services_complete": [], 2023-12-08T20:27:24.165 INFO:teuthology.orchestra.run.smithi043.stdout: "progress": "1/2 daemons upgraded", 2023-12-08T20:27:24.165 INFO:teuthology.orchestra.run.smithi043.stdout: "message": "", 2023-12-08T20:27:24.165 INFO:teuthology.orchestra.run.smithi043.stdout: "is_paused": false 2023-12-08T20:27:24.165 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:27:24.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:24.165+0000 7f17061d2700 1 -- 172.21.15.43:0/2916220333 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f16e803c760 msgr2=0x7f16e803eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:24.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:24.165+0000 7f17061d2700 1 --2- 172.21.15.43:0/2916220333 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f16e803c760 0x7f16e803eb40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f16f400afd0 tx=0x7f16f4009040 comp rx=0 tx=0).stop 2023-12-08T20:27:24.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:24.165+0000 7f17061d2700 1 -- 172.21.15.43:0/2916220333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17000fb290 msgr2=0x7f170010d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:24.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:24.165+0000 7f17061d2700 1 --2- 172.21.15.43:0/2916220333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17000fb290 0x7f170010d560 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f16f000b7d0 tx=0x7f16f0009e30 comp rx=0 tx=0).stop 2023-12-08T20:27:24.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:24.165+0000 7f17061d2700 1 -- 172.21.15.43:0/2916220333 shutdown_connections 2023-12-08T20:27:24.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:24.165+0000 7f17061d2700 1 --2- 172.21.15.43:0/2916220333 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f16e803c760 0x7f16e803eb40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:24.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:24.165+0000 7f17061d2700 1 --2- 172.21.15.43:0/2916220333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17000fb290 0x7f170010d560 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:24.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:24.165+0000 7f17061d2700 1 --2- 172.21.15.43:0/2916220333 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17000fc4a0 0x7f170010daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:24.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:24.165+0000 7f17061d2700 1 -- 172.21.15.43:0/2916220333 >> 172.21.15.43:0/2916220333 conn(0x7f17000f6950 msgr2=0x7f17000f8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:24.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:24.166+0000 7f17061d2700 1 -- 172.21.15.43:0/2916220333 shutdown_connections 2023-12-08T20:27:24.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:24.166+0000 7f17061d2700 1 -- 172.21.15.43:0/2916220333 wait complete. 2023-12-08T20:27:24.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:24 smithi111 ceph-mon[121341]: Manager daemon smithi111.mtcffu is now available 2023-12-08T20:27:24.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:24 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:24.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:24 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:27:24.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:24 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:27:24.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:24 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:27:24.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:24 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.mtcffu/mirror_snapshot_schedule"}]: dispatch 2023-12-08T20:27:24.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:24 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.mtcffu/mirror_snapshot_schedule"}]: dispatch 2023-12-08T20:27:24.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:24 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.mtcffu/trash_purge_schedule"}]: dispatch 2023-12-08T20:27:24.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:24 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.mtcffu/trash_purge_schedule"}]: dispatch 2023-12-08T20:27:24.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:24 smithi111 ceph-mon[121341]: Deploying cephadm binary to smithi111 2023-12-08T20:27:24.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:24 smithi111 ceph-mon[121341]: Deploying cephadm binary to smithi043 2023-12-08T20:27:24.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:24 smithi043 ceph-mon[111966]: Manager daemon smithi111.mtcffu is now available 2023-12-08T20:27:24.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:24 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:24.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:24 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:27:24.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:24 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:27:24.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:24 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:27:24.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:24 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.mtcffu/mirror_snapshot_schedule"}]: dispatch 2023-12-08T20:27:24.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:24 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.mtcffu/mirror_snapshot_schedule"}]: dispatch 2023-12-08T20:27:24.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:24 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.mtcffu/trash_purge_schedule"}]: dispatch 2023-12-08T20:27:24.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:24 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.mtcffu/trash_purge_schedule"}]: dispatch 2023-12-08T20:27:24.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:24 smithi043 ceph-mon[111966]: Deploying cephadm binary to smithi111 2023-12-08T20:27:24.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:24 smithi043 ceph-mon[111966]: Deploying cephadm binary to smithi043 2023-12-08T20:27:25.143 INFO:tasks.workunit.client.0.smithi043.stderr:+ tar xzf ltp-full.tgz 2023-12-08T20:27:25.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:25 smithi111 ceph-mon[121341]: mgrmap e22: smithi111.mtcffu(active, since 1.06224s) 2023-12-08T20:27:25.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:25 smithi111 ceph-mon[121341]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:27:25.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:25 smithi111 ceph-mon[121341]: pgmap v3: 65 pgs: 65 active+clean; 48 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:27:25.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:25 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:25.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:25 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:25.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:25 smithi043 ceph-mon[111966]: mgrmap e22: smithi111.mtcffu(active, since 1.06224s) 2023-12-08T20:27:25.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:25 smithi043 ceph-mon[111966]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:27:25.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:25 smithi043 ceph-mon[111966]: pgmap v3: 65 pgs: 65 active+clean; 48 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:27:25.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:25 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:25.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:25 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:26.701 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:26 smithi043 ceph-mon[111966]: pgmap v4: 65 pgs: 65 active+clean; 48 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:27:26.701 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:26 smithi043 ceph-mon[111966]: mgrmap e23: smithi111.mtcffu(active, since 2s) 2023-12-08T20:27:26.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:26 smithi111 ceph-mon[121341]: pgmap v4: 65 pgs: 65 active+clean; 48 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:27:26.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:26 smithi111 ceph-mon[121341]: mgrmap e23: smithi111.mtcffu(active, since 2s) 2023-12-08T20:27:27.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:27 smithi111 ceph-mon[121341]: [08/Dec/2023:20:27:25] ENGINE Bus STARTING 2023-12-08T20:27:27.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:27 smithi111 ceph-mon[121341]: [08/Dec/2023:20:27:26] ENGINE Serving on https://172.21.15.111:7150 2023-12-08T20:27:27.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:27 smithi111 ceph-mon[121341]: [08/Dec/2023:20:27:26] ENGINE Serving on http://172.21.15.111:8765 2023-12-08T20:27:27.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:27 smithi111 ceph-mon[121341]: [08/Dec/2023:20:27:26] ENGINE Bus STARTED 2023-12-08T20:27:27.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:27 smithi043 ceph-mon[111966]: [08/Dec/2023:20:27:25] ENGINE Bus STARTING 2023-12-08T20:27:27.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:27 smithi043 ceph-mon[111966]: [08/Dec/2023:20:27:26] ENGINE Serving on https://172.21.15.111:7150 2023-12-08T20:27:27.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:27 smithi043 ceph-mon[111966]: [08/Dec/2023:20:27:26] ENGINE Serving on http://172.21.15.111:8765 2023-12-08T20:27:27.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:27 smithi043 ceph-mon[111966]: [08/Dec/2023:20:27:26] ENGINE Bus STARTED 2023-12-08T20:27:28.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:28 smithi043 ceph-mon[111966]: pgmap v5: 65 pgs: 65 active+clean; 48 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:27:28.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:28 smithi043 ceph-mon[111966]: mgrmap e24: smithi111.mtcffu(active, since 4s) 2023-12-08T20:27:28.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:28 smithi111 ceph-mon[121341]: pgmap v5: 65 pgs: 65 active+clean; 48 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:27:28.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:28 smithi111 ceph-mon[121341]: mgrmap e24: smithi111.mtcffu(active, since 4s) 2023-12-08T20:27:30.364 INFO:tasks.workunit.client.1.smithi111.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-08T20:27:30.365 INFO:tasks.workunit.client.1.smithi111.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-08T20:27:30.365 INFO:tasks.workunit.client.1.smithi111.stderr:+ make 2023-12-08T20:27:30.643 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:30 smithi043 ceph-mon[111966]: pgmap v6: 65 pgs: 65 active+clean; 48 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:27:30.643 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:30 smithi043 ceph-mon[111966]: Standby manager daemon smithi043.hqcdcm started 2023-12-08T20:27:30.643 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:30 smithi043 ceph-mon[111966]: from='mgr.? 172.21.15.43:0/2268189677' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi043.hqcdcm/crt"}]: dispatch 2023-12-08T20:27:30.643 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:30 smithi043 ceph-mon[111966]: from='mgr.? 172.21.15.43:0/2268189677' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-08T20:27:30.643 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:30 smithi043 ceph-mon[111966]: from='mgr.? 172.21.15.43:0/2268189677' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi043.hqcdcm/key"}]: dispatch 2023-12-08T20:27:30.643 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:30 smithi043 ceph-mon[111966]: from='mgr.? 172.21.15.43:0/2268189677' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-08T20:27:30.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:30 smithi111 ceph-mon[121341]: pgmap v6: 65 pgs: 65 active+clean; 48 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:27:30.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:30 smithi111 ceph-mon[121341]: Standby manager daemon smithi043.hqcdcm started 2023-12-08T20:27:30.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:30 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.43:0/2268189677' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi043.hqcdcm/crt"}]: dispatch 2023-12-08T20:27:30.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:30 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.43:0/2268189677' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-08T20:27:30.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:30 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.43:0/2268189677' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi043.hqcdcm/key"}]: dispatch 2023-12-08T20:27:30.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:30 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.43:0/2268189677' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-08T20:27:31.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:31 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mgr metadata", "who": "smithi043.hqcdcm", "id": "smithi043.hqcdcm"}]: dispatch 2023-12-08T20:27:31.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:31 smithi043 ceph-mon[111966]: mgrmap e25: smithi111.mtcffu(active, since 7s), standbys: smithi043.hqcdcm 2023-12-08T20:27:31.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:31 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mgr metadata", "who": "smithi043.hqcdcm", "id": "smithi043.hqcdcm"}]: dispatch 2023-12-08T20:27:31.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:31 smithi111 ceph-mon[121341]: mgrmap e25: smithi111.mtcffu(active, since 7s), standbys: smithi043.hqcdcm 2023-12-08T20:27:32.112 INFO:tasks.workunit.client.1.smithi111.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-08T20:27:32.930 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:32 smithi111 ceph-mon[121341]: pgmap v7: 65 pgs: 65 active+clean; 60 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.8 MiB/s wr, 28 op/s 2023-12-08T20:27:33.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:32 smithi043 ceph-mon[111966]: pgmap v7: 65 pgs: 65 active+clean; 60 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.8 MiB/s wr, 28 op/s 2023-12-08T20:27:34.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:33 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:34.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:33 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:34.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:33 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:34.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:33 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:34.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:33 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:34.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:33 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:34.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:33 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:34.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:33 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:34.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:33 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:34.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:33 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:34.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:33 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:34.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:33 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:34.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:33 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:34.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:33 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:34.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:33 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:34.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:33 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:34.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:33 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:34.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:33 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:34.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:33 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:34.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:33 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:34.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:33 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:34.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:33 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:35.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:34 smithi043 ceph-mon[111966]: pgmap v8: 65 pgs: 65 active+clean; 60 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 1.4 MiB/s wr, 22 op/s 2023-12-08T20:27:35.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:34 smithi043 ceph-mon[111966]: Adjusting osd_memory_target on smithi043 to 1570M 2023-12-08T20:27:35.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:34 smithi111 ceph-mon[121341]: pgmap v8: 65 pgs: 65 active+clean; 60 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 1.4 MiB/s wr, 22 op/s 2023-12-08T20:27:35.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:34 smithi111 ceph-mon[121341]: Adjusting osd_memory_target on smithi043 to 1570M 2023-12-08T20:27:37.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:36 smithi043 ceph-mon[111966]: pgmap v9: 65 pgs: 65 active+clean; 134 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 861 op/s 2023-12-08T20:27:37.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:36 smithi111 ceph-mon[121341]: pgmap v9: 65 pgs: 65 active+clean; 134 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 861 op/s 2023-12-08T20:27:38.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:37 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:38.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:37 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:38.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:37 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:38.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:37 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:38.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:37 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:38.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:37 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:38.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:37 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:38.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:37 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:39.123 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:38 smithi111 ceph-mon[121341]: pgmap v10: 65 pgs: 65 active+clean; 134 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 785 op/s 2023-12-08T20:27:39.123 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:38 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:27:39.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:38 smithi043 ceph-mon[111966]: pgmap v10: 65 pgs: 65 active+clean; 134 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 785 op/s 2023-12-08T20:27:39.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:38 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:27:39.652 INFO:tasks.workunit.client.1.smithi111.stderr:++ readlink -f fsstress 2023-12-08T20:27:39.653 INFO:tasks.workunit.client.1.smithi111.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-08T20:27:39.653 INFO:tasks.workunit.client.1.smithi111.stderr:+ popd 2023-12-08T20:27:39.653 INFO:tasks.workunit.client.1.smithi111.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-08T20:27:39.654 INFO:tasks.workunit.client.1.smithi111.stderr:+ popd 2023-12-08T20:27:39.654 INFO:tasks.workunit.client.1.smithi111.stdout:~/cephtest/mnt.1/client.1/tmp 2023-12-08T20:27:39.654 INFO:tasks.workunit.client.1.smithi111.stderr:++ mktemp -d -p . 2023-12-08T20:27:39.830 INFO:tasks.workunit.client.1.smithi111.stderr:+ T=./tmp.okzX0mycpr 2023-12-08T20:27:39.830 INFO:tasks.workunit.client.1.smithi111.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.okzX0mycpr -l 1 -n 1000 -p 10 -v 2023-12-08T20:27:39.832 INFO:tasks.workunit.client.1.smithi111.stdout:seed = 1702873336 2023-12-08T20:27:39.837 INFO:tasks.workunit.client.1.smithi111.stdout:0/0: rename - no filename 2023-12-08T20:27:39.837 INFO:tasks.workunit.client.1.smithi111.stdout:1/0: dwrite - no filename 2023-12-08T20:27:39.837 INFO:tasks.workunit.client.1.smithi111.stdout:1/1: truncate - no filename 2023-12-08T20:27:39.837 INFO:tasks.workunit.client.1.smithi111.stdout:1/2: dread - no filename 2023-12-08T20:27:39.837 INFO:tasks.workunit.client.1.smithi111.stdout:1/3: stat - no entries 2023-12-08T20:27:39.837 INFO:tasks.workunit.client.1.smithi111.stdout:1/4: write - no filename 2023-12-08T20:27:39.838 INFO:tasks.workunit.client.1.smithi111.stdout:0/1: mknod c0 0 2023-12-08T20:27:39.841 INFO:tasks.workunit.client.1.smithi111.stdout:1/5: mkdir d0 0 2023-12-08T20:27:39.841 INFO:tasks.workunit.client.1.smithi111.stdout:1/6: fsync - no filename 2023-12-08T20:27:39.841 INFO:tasks.workunit.client.1.smithi111.stdout:1/7: dread - no filename 2023-12-08T20:27:39.841 INFO:tasks.workunit.client.1.smithi111.stdout:1/8: truncate - no filename 2023-12-08T20:27:39.843 INFO:tasks.workunit.client.1.smithi111.stdout:0/2: mkdir d1 0 2023-12-08T20:27:39.851 INFO:tasks.workunit.client.1.smithi111.stdout:2/0: creat f0 x:0 0 0 2023-12-08T20:27:39.851 INFO:tasks.workunit.client.1.smithi111.stdout:0/3: rename c0 to d1/c2 0 2023-12-08T20:27:39.851 INFO:tasks.workunit.client.1.smithi111.stdout:0/4: dread - no filename 2023-12-08T20:27:39.851 INFO:tasks.workunit.client.1.smithi111.stdout:0/5: write - no filename 2023-12-08T20:27:39.851 INFO:tasks.workunit.client.1.smithi111.stdout:4/0: chown . 543754 1 2023-12-08T20:27:39.852 INFO:tasks.workunit.client.1.smithi111.stdout:4/1: dread - no filename 2023-12-08T20:27:39.852 INFO:tasks.workunit.client.1.smithi111.stdout:4/2: chown . 14 1 2023-12-08T20:27:39.852 INFO:tasks.workunit.client.1.smithi111.stdout:4/3: write - no filename 2023-12-08T20:27:39.852 INFO:tasks.workunit.client.1.smithi111.stdout:3/0: symlink l0 0 2023-12-08T20:27:39.852 INFO:tasks.workunit.client.1.smithi111.stdout:3/1: rmdir - no directory 2023-12-08T20:27:39.852 INFO:tasks.workunit.client.1.smithi111.stdout:3/2: chown l0 440903 1 2023-12-08T20:27:39.852 INFO:tasks.workunit.client.1.smithi111.stdout:3/3: chown l0 14539 1 2023-12-08T20:27:39.854 INFO:tasks.workunit.client.1.smithi111.stdout:2/1: mkdir d1 0 2023-12-08T20:27:39.855 INFO:tasks.workunit.client.1.smithi111.stdout:0/6: creat d1/f3 x:0 0 0 2023-12-08T20:27:39.858 INFO:tasks.workunit.client.1.smithi111.stdout:4/4: creat f0 x:0 0 0 2023-12-08T20:27:39.860 INFO:tasks.workunit.client.1.smithi111.stdout:3/4: creat f1 x:0 0 0 2023-12-08T20:27:39.861 INFO:tasks.workunit.client.1.smithi111.stdout:3/5: chown f1 56 1 2023-12-08T20:27:39.862 INFO:tasks.workunit.client.1.smithi111.stdout:2/2: mkdir d1/d2 0 2023-12-08T20:27:39.864 INFO:tasks.workunit.client.1.smithi111.stdout:0/7: unlink d1/f3 0 2023-12-08T20:27:39.864 INFO:tasks.workunit.client.1.smithi111.stdout:0/8: write - no filename 2023-12-08T20:27:39.864 INFO:tasks.workunit.client.1.smithi111.stdout:0/9: chown d1/c2 10 1 2023-12-08T20:27:39.864 INFO:tasks.workunit.client.1.smithi111.stdout:0/10: write - no filename 2023-12-08T20:27:39.865 INFO:tasks.workunit.client.1.smithi111.stdout:6/0: write - no filename 2023-12-08T20:27:39.866 INFO:tasks.workunit.client.1.smithi111.stdout:6/1: dread - no filename 2023-12-08T20:27:39.866 INFO:tasks.workunit.client.1.smithi111.stdout:6/2: dread - no filename 2023-12-08T20:27:39.866 INFO:tasks.workunit.client.1.smithi111.stdout:6/3: fsync - no filename 2023-12-08T20:27:39.870 INFO:tasks.workunit.client.1.smithi111.stdout:5/0: creat f0 x:0 0 0 2023-12-08T20:27:39.870 INFO:tasks.workunit.client.1.smithi111.stdout:5/1: write f0 [589834,9725] 0 2023-12-08T20:27:39.870 INFO:tasks.workunit.client.1.smithi111.stdout:4/5: creat f1 x:0 0 0 2023-12-08T20:27:39.870 INFO:tasks.workunit.client.1.smithi111.stdout:3/6: mkdir d2 0 2023-12-08T20:27:39.870 INFO:tasks.workunit.client.1.smithi111.stdout:3/7: dread - f1 zero size 2023-12-08T20:27:39.872 INFO:tasks.workunit.client.1.smithi111.stdout:2/3: creat d1/d2/f3 x:0 0 0 2023-12-08T20:27:39.873 INFO:tasks.workunit.client.1.smithi111.stdout:0/11: mkdir d1/d4 0 2023-12-08T20:27:39.873 INFO:tasks.workunit.client.1.smithi111.stdout:0/12: fsync - no filename 2023-12-08T20:27:39.878 INFO:tasks.workunit.client.1.smithi111.stdout:6/4: mkdir d0 0 2023-12-08T20:27:39.879 INFO:tasks.workunit.client.1.smithi111.stdout:5/2: symlink l1 0 2023-12-08T20:27:39.880 INFO:tasks.workunit.client.1.smithi111.stdout:4/6: mknod c2 0 2023-12-08T20:27:39.880 INFO:tasks.workunit.client.1.smithi111.stdout:4/7: dread - f0 zero size 2023-12-08T20:27:39.882 INFO:tasks.workunit.client.1.smithi111.stdout:0/13: mknod d1/d4/c5 0 2023-12-08T20:27:39.882 INFO:tasks.workunit.client.1.smithi111.stdout:0/14: write - no filename 2023-12-08T20:27:39.882 INFO:tasks.workunit.client.1.smithi111.stdout:0/15: fdatasync - no filename 2023-12-08T20:27:39.882 INFO:tasks.workunit.client.1.smithi111.stdout:0/16: fsync - no filename 2023-12-08T20:27:39.884 INFO:tasks.workunit.client.1.smithi111.stdout:8/0: read - no filename 2023-12-08T20:27:39.886 INFO:tasks.workunit.client.1.smithi111.stdout:7/0: symlink l0 0 2023-12-08T20:27:39.886 INFO:tasks.workunit.client.1.smithi111.stdout:7/1: dwrite - no filename 2023-12-08T20:27:39.886 INFO:tasks.workunit.client.1.smithi111.stdout:7/2: stat l0 0 2023-12-08T20:27:39.886 INFO:tasks.workunit.client.1.smithi111.stdout:7/3: chown l0 46476 1 2023-12-08T20:27:39.886 INFO:tasks.workunit.client.1.smithi111.stdout:7/4: truncate - no filename 2023-12-08T20:27:39.886 INFO:tasks.workunit.client.1.smithi111.stdout:7/5: fdatasync - no filename 2023-12-08T20:27:39.886 INFO:tasks.workunit.client.1.smithi111.stdout:7/6: chown l0 15975322 1 2023-12-08T20:27:39.887 INFO:tasks.workunit.client.1.smithi111.stdout:6/5: mkdir d0/d1 0 2023-12-08T20:27:39.887 INFO:tasks.workunit.client.1.smithi111.stdout:6/6: dread - no filename 2023-12-08T20:27:39.888 INFO:tasks.workunit.client.1.smithi111.stdout:6/7: dwrite - no filename 2023-12-08T20:27:39.891 INFO:tasks.workunit.client.1.smithi111.stdout:0/17: creat d1/d4/f6 x:0 0 0 2023-12-08T20:27:39.893 INFO:tasks.workunit.client.1.smithi111.stdout:3/8: dwrite f1 [0,4194304] 0 2023-12-08T20:27:39.893 INFO:tasks.workunit.client.1.smithi111.stdout:3/9: getdents d2 0 2023-12-08T20:27:39.893 INFO:tasks.workunit.client.1.smithi111.stdout:3/10: chown f1 0 1 2023-12-08T20:27:39.893 INFO:tasks.workunit.client.1.smithi111.stdout:2/4: dwrite d1/d2/f3 [0,4194304] 0 2023-12-08T20:27:39.893 INFO:tasks.workunit.client.1.smithi111.stdout:9/0: fdatasync - no filename 2023-12-08T20:27:39.893 INFO:tasks.workunit.client.1.smithi111.stdout:9/1: dread - no filename 2023-12-08T20:27:39.893 INFO:tasks.workunit.client.1.smithi111.stdout:9/2: rmdir - no directory 2023-12-08T20:27:39.893 INFO:tasks.workunit.client.1.smithi111.stdout:9/3: dwrite - no filename 2023-12-08T20:27:39.893 INFO:tasks.workunit.client.1.smithi111.stdout:9/4: unlink - no file 2023-12-08T20:27:39.894 INFO:tasks.workunit.client.1.smithi111.stdout:8/1: creat f0 x:0 0 0 2023-12-08T20:27:39.894 INFO:tasks.workunit.client.1.smithi111.stdout:8/2: dread - f0 zero size 2023-12-08T20:27:39.895 INFO:tasks.workunit.client.1.smithi111.stdout:7/7: creat f1 x:0 0 0 2023-12-08T20:27:39.895 INFO:tasks.workunit.client.1.smithi111.stdout:7/8: rmdir - no directory 2023-12-08T20:27:39.896 INFO:tasks.workunit.client.1.smithi111.stdout:0/18: symlink d1/l7 0 2023-12-08T20:27:39.897 INFO:tasks.workunit.client.1.smithi111.stdout:0/19: stat d1/d4/f6 0 2023-12-08T20:27:39.897 INFO:tasks.workunit.client.1.smithi111.stdout:0/20: dread - d1/d4/f6 zero size 2023-12-08T20:27:39.899 INFO:tasks.workunit.client.1.smithi111.stdout:3/11: unlink l0 0 2023-12-08T20:27:39.899 INFO:tasks.workunit.client.1.smithi111.stdout:3/12: stat f1 0 2023-12-08T20:27:39.903 INFO:tasks.workunit.client.1.smithi111.stdout:2/5: mknod d1/c4 0 2023-12-08T20:27:39.905 INFO:tasks.workunit.client.1.smithi111.stdout:9/5: creat f0 x:0 0 0 2023-12-08T20:27:39.905 INFO:tasks.workunit.client.1.smithi111.stdout:9/6: chown f0 185729 1 2023-12-08T20:27:39.905 INFO:tasks.workunit.client.1.smithi111.stdout:9/7: write f0 [209775,4700] 0 2023-12-08T20:27:39.907 INFO:tasks.workunit.client.1.smithi111.stdout:8/3: mknod c1 0 2023-12-08T20:27:39.910 INFO:tasks.workunit.client.1.smithi111.stdout:3/13: dread f1 [0,4194304] 0 2023-12-08T20:27:39.910 INFO:tasks.workunit.client.1.smithi111.stdout:4/8: dwrite f1 [0,4194304] 0 2023-12-08T20:27:39.910 INFO:tasks.workunit.client.1.smithi111.stdout:4/9: write f0 [28851,6530] 0 2023-12-08T20:27:39.910 INFO:tasks.workunit.client.1.smithi111.stdout:4/10: truncate f0 168787 0 2023-12-08T20:27:39.910 INFO:tasks.workunit.client.1.smithi111.stdout:8/4: creat f2 x:0 0 0 2023-12-08T20:27:39.913 INFO:tasks.workunit.client.1.smithi111.stdout:3/14: dread f1 [0,4194304] 0 2023-12-08T20:27:39.913 INFO:tasks.workunit.client.1.smithi111.stdout:3/15: chown f1 9 1 2023-12-08T20:27:39.914 INFO:tasks.workunit.client.1.smithi111.stdout:4/11: creat f3 x:0 0 0 2023-12-08T20:27:39.914 INFO:tasks.workunit.client.1.smithi111.stdout:4/12: chown c2 10320 1 2023-12-08T20:27:39.914 INFO:tasks.workunit.client.1.smithi111.stdout:2/6: dread d1/d2/f3 [0,4194304] 0 2023-12-08T20:27:39.914 INFO:tasks.workunit.client.1.smithi111.stdout:9/8: dread f0 [0,4194304] 0 2023-12-08T20:27:39.914 INFO:tasks.workunit.client.1.smithi111.stdout:8/5: symlink l3 0 2023-12-08T20:27:39.915 INFO:tasks.workunit.client.1.smithi111.stdout:2/7: creat d1/f5 x:0 0 0 2023-12-08T20:27:39.916 INFO:tasks.workunit.client.1.smithi111.stdout:7/9: dwrite f1 [0,4194304] 0 2023-12-08T20:27:39.941 INFO:tasks.workunit.client.1.smithi111.stdout:9/9: dwrite f0 [0,4194304] 0 2023-12-08T20:27:39.942 INFO:tasks.workunit.client.1.smithi111.stdout:3/16: dwrite f1 [0,4194304] 0 2023-12-08T20:27:39.942 INFO:tasks.workunit.client.1.smithi111.stdout:2/8: dwrite d1/d2/f3 [0,4194304] 0 2023-12-08T20:27:39.944 INFO:tasks.workunit.client.1.smithi111.stdout:3/17: mkdir d2/d3 0 2023-12-08T20:27:39.944 INFO:tasks.workunit.client.1.smithi111.stdout:4/13: dread f0 [0,4194304] 0 2023-12-08T20:27:39.945 INFO:tasks.workunit.client.1.smithi111.stdout:4/14: write f1 [3255519,111569] 0 2023-12-08T20:27:39.946 INFO:tasks.workunit.client.1.smithi111.stdout:2/9: unlink d1/d2/f3 0 2023-12-08T20:27:39.948 INFO:tasks.workunit.client.1.smithi111.stdout:2/10: rename d1/f5 to d1/d2/f6 0 2023-12-08T20:27:39.952 INFO:tasks.workunit.client.1.smithi111.stdout:3/18: dread f1 [0,4194304] 0 2023-12-08T20:27:39.959 INFO:tasks.workunit.client.1.smithi111.stdout:4/15: dwrite f0 [0,4194304] 0 2023-12-08T20:27:39.960 INFO:tasks.workunit.client.1.smithi111.stdout:4/16: symlink l4 0 2023-12-08T20:27:39.975 INFO:tasks.workunit.client.1.smithi111.stdout:4/17: dread f1 [0,4194304] 0 2023-12-08T20:27:39.977 INFO:tasks.workunit.client.1.smithi111.stdout:4/18: symlink l5 0 2023-12-08T20:27:39.977 INFO:tasks.workunit.client.1.smithi111.stdout:4/19: rmdir - no directory 2023-12-08T20:27:40.052 INFO:tasks.workunit.client.1.smithi111.stdout:3/19: fsync f1 0 2023-12-08T20:27:40.053 INFO:tasks.workunit.client.1.smithi111.stdout:3/20: symlink d2/d3/l4 0 2023-12-08T20:27:40.053 INFO:tasks.workunit.client.1.smithi111.stdout:3/21: stat f1 0 2023-12-08T20:27:40.054 INFO:tasks.workunit.client.1.smithi111.stdout:3/22: unlink d2/d3/l4 0 2023-12-08T20:27:40.055 INFO:tasks.workunit.client.1.smithi111.stdout:3/23: mkdir d2/d3/d5 0 2023-12-08T20:27:40.058 INFO:tasks.workunit.client.1.smithi111.stdout:5/3: getdents . 0 2023-12-08T20:27:40.058 INFO:tasks.workunit.client.1.smithi111.stdout:5/4: chown f0 21984 1 2023-12-08T20:27:40.058 INFO:tasks.workunit.client.1.smithi111.stdout:5/5: chown l1 81011 1 2023-12-08T20:27:40.059 INFO:tasks.workunit.client.1.smithi111.stdout:5/6: mknod c2 0 2023-12-08T20:27:40.061 INFO:tasks.workunit.client.1.smithi111.stdout:5/7: mkdir d3 0 2023-12-08T20:27:40.070 INFO:tasks.workunit.client.1.smithi111.stdout:9/10: getdents . 0 2023-12-08T20:27:40.070 INFO:tasks.workunit.client.1.smithi111.stdout:9/11: chown f0 0 1 2023-12-08T20:27:40.070 INFO:tasks.workunit.client.1.smithi111.stdout:9/12: chown f0 2867 1 2023-12-08T20:27:40.072 INFO:tasks.workunit.client.1.smithi111.stdout:9/13: link f0 f1 0 2023-12-08T20:27:40.074 INFO:tasks.workunit.client.1.smithi111.stdout:9/14: mkdir d2 0 2023-12-08T20:27:40.074 INFO:tasks.workunit.client.1.smithi111.stdout:9/15: mknod d2/c3 0 2023-12-08T20:27:40.074 INFO:tasks.workunit.client.1.smithi111.stdout:7/10: write f1 [4359295,53916] 0 2023-12-08T20:27:40.078 INFO:tasks.workunit.client.1.smithi111.stdout:3/24: dwrite f1 [0,4194304] 0 2023-12-08T20:27:40.078 INFO:tasks.workunit.client.1.smithi111.stdout:3/25: fsync f1 0 2023-12-08T20:27:40.078 INFO:tasks.workunit.client.1.smithi111.stdout:7/11: write f1 [123963,91629] 0 2023-12-08T20:27:40.079 INFO:tasks.workunit.client.1.smithi111.stdout:5/8: dwrite f0 [0,4194304] 0 2023-12-08T20:27:40.079 INFO:tasks.workunit.client.1.smithi111.stdout:5/9: stat d3 0 2023-12-08T20:27:40.079 INFO:tasks.workunit.client.1.smithi111.stdout:2/11: fsync d1/d2/f6 0 2023-12-08T20:27:40.082 INFO:tasks.workunit.client.1.smithi111.stdout:5/10: mkdir d3/d4 0 2023-12-08T20:27:40.101 INFO:tasks.workunit.client.1.smithi111.stdout:7/12: dread f1 [0,4194304] 0 2023-12-08T20:27:40.102 INFO:tasks.workunit.client.1.smithi111.stdout:9/16: dwrite f0 [0,4194304] 0 2023-12-08T20:27:40.102 INFO:tasks.workunit.client.1.smithi111.stdout:9/17: chown d2/c3 576152 1 2023-12-08T20:27:40.103 INFO:tasks.workunit.client.1.smithi111.stdout:3/26: dwrite f1 [0,4194304] 0 2023-12-08T20:27:40.103 INFO:tasks.workunit.client.1.smithi111.stdout:2/12: dwrite f0 [0,4194304] 0 2023-12-08T20:27:40.117 INFO:tasks.workunit.client.1.smithi111.stdout:5/11: creat d3/d4/f5 x:0 0 0 2023-12-08T20:27:40.117 INFO:tasks.workunit.client.1.smithi111.stdout:7/13: mknod c2 0 2023-12-08T20:27:40.119 INFO:tasks.workunit.client.1.smithi111.stdout:9/18: mknod d2/c4 0 2023-12-08T20:27:40.120 INFO:tasks.workunit.client.1.smithi111.stdout:9/19: read f1 [1353673,103761] 0 2023-12-08T20:27:40.120 INFO:tasks.workunit.client.1.smithi111.stdout:9/20: stat f0 0 2023-12-08T20:27:40.120 INFO:tasks.workunit.client.1.smithi111.stdout:9/21: stat d2/c3 0 2023-12-08T20:27:40.122 INFO:tasks.workunit.client.1.smithi111.stdout:2/13: symlink d1/l7 0 2023-12-08T20:27:40.123 INFO:tasks.workunit.client.1.smithi111.stdout:5/12: mknod d3/c6 0 2023-12-08T20:27:40.125 INFO:tasks.workunit.client.1.smithi111.stdout:7/14: unlink l0 0 2023-12-08T20:27:40.125 INFO:tasks.workunit.client.1.smithi111.stdout:7/15: write f1 [4680746,22582] 0 2023-12-08T20:27:40.126 INFO:tasks.workunit.client.1.smithi111.stdout:2/14: symlink d1/l8 0 2023-12-08T20:27:40.195 INFO:tasks.workunit.client.1.smithi111.stdout:7/16: mknod c3 0 2023-12-08T20:27:40.198 INFO:tasks.workunit.client.1.smithi111.stdout:7/17: write f1 [3631793,57868] 0 2023-12-08T20:27:40.198 INFO:tasks.workunit.client.1.smithi111.stdout:9/22: truncate f1 3177938 0 2023-12-08T20:27:40.199 INFO:tasks.workunit.client.1.smithi111.stdout:2/15: truncate f0 1637873 0 2023-12-08T20:27:40.199 INFO:tasks.workunit.client.1.smithi111.stdout:2/16: chown d1/d2/f6 288613 1 2023-12-08T20:27:40.199 INFO:tasks.workunit.client.1.smithi111.stdout:2/17: truncate d1/d2/f6 86596 0 2023-12-08T20:27:40.200 INFO:tasks.workunit.client.1.smithi111.stdout:9/23: mknod d2/c5 0 2023-12-08T20:27:40.201 INFO:tasks.workunit.client.1.smithi111.stdout:2/18: symlink d1/l9 0 2023-12-08T20:27:40.201 INFO:tasks.workunit.client.1.smithi111.stdout:5/13: getdents d3 0 2023-12-08T20:27:40.202 INFO:tasks.workunit.client.1.smithi111.stdout:9/24: rmdir d2 39 2023-12-08T20:27:40.204 INFO:tasks.workunit.client.1.smithi111.stdout:5/14: stat l1 0 2023-12-08T20:27:40.207 INFO:tasks.workunit.client.1.smithi111.stdout:5/15: mkdir d3/d4/d7 0 2023-12-08T20:27:40.207 INFO:tasks.workunit.client.1.smithi111.stdout:5/16: dread - d3/d4/f5 zero size 2023-12-08T20:27:40.207 INFO:tasks.workunit.client.1.smithi111.stdout:5/17: chown l1 1 1 2023-12-08T20:27:40.217 INFO:tasks.workunit.client.1.smithi111.stdout:7/18: dwrite f1 [0,4194304] 0 2023-12-08T20:27:40.217 INFO:tasks.workunit.client.1.smithi111.stdout:7/19: chown c3 475903280 1 2023-12-08T20:27:40.384 INFO:tasks.workunit.client.1.smithi111.stdout:5/18: rename f0 to d3/d4/f8 0 2023-12-08T20:27:40.384 INFO:tasks.workunit.client.1.smithi111.stdout:7/20: creat f4 x:0 0 0 2023-12-08T20:27:40.384 INFO:tasks.workunit.client.1.smithi111.stdout:9/25: write f0 [3412014,113366] 0 2023-12-08T20:27:40.384 INFO:tasks.workunit.client.1.smithi111.stdout:7/21: write f1 [5453813,98084] 0 2023-12-08T20:27:40.385 INFO:tasks.workunit.client.1.smithi111.stdout:7/22: truncate f1 5860472 0 2023-12-08T20:27:40.385 INFO:tasks.workunit.client.1.smithi111.stdout:7/23: write f4 [995540,21068] 0 2023-12-08T20:27:40.386 INFO:tasks.workunit.client.1.smithi111.stdout:2/19: getdents d1 0 2023-12-08T20:27:40.386 INFO:tasks.workunit.client.1.smithi111.stdout:5/19: symlink d3/d4/d7/l9 0 2023-12-08T20:27:40.386 INFO:tasks.workunit.client.1.smithi111.stdout:9/26: fsync f1 0 2023-12-08T20:27:40.387 INFO:tasks.workunit.client.1.smithi111.stdout:7/24: creat f5 x:0 0 0 2023-12-08T20:27:40.390 INFO:tasks.workunit.client.1.smithi111.stdout:2/20: rename d1/c4 to d1/d2/ca 0 2023-12-08T20:27:40.390 INFO:tasks.workunit.client.1.smithi111.stdout:9/27: rename d2 to d2/d6 22 2023-12-08T20:27:40.390 INFO:tasks.workunit.client.1.smithi111.stdout:2/21: write d1/d2/f6 [479542,12692] 0 2023-12-08T20:27:40.393 INFO:tasks.workunit.client.1.smithi111.stdout:5/20: symlink d3/d4/d7/la 0 2023-12-08T20:27:40.394 INFO:tasks.workunit.client.1.smithi111.stdout:5/21: write d3/d4/f8 [2805083,104619] 0 2023-12-08T20:27:40.395 INFO:tasks.workunit.client.1.smithi111.stdout:9/28: unlink f1 0 2023-12-08T20:27:40.397 INFO:tasks.workunit.client.1.smithi111.stdout:2/22: symlink d1/lb 0 2023-12-08T20:27:40.401 INFO:tasks.workunit.client.1.smithi111.stdout:9/29: rename f0 to d2/f7 0 2023-12-08T20:27:40.401 INFO:tasks.workunit.client.1.smithi111.stdout:9/30: fdatasync d2/f7 0 2023-12-08T20:27:40.402 INFO:tasks.workunit.client.1.smithi111.stdout:2/23: mkdir d1/dc 0 2023-12-08T20:27:40.403 INFO:tasks.workunit.client.1.smithi111.stdout:9/31: mkdir d2/d8 0 2023-12-08T20:27:40.404 INFO:tasks.workunit.client.1.smithi111.stdout:2/24: mknod d1/d2/cd 0 2023-12-08T20:27:40.407 INFO:tasks.workunit.client.1.smithi111.stdout:5/22: truncate d3/d4/f8 2366483 0 2023-12-08T20:27:40.407 INFO:tasks.workunit.client.1.smithi111.stdout:5/23: rename d3 to d3/d4/d7/db 22 2023-12-08T20:27:40.408 INFO:tasks.workunit.client.1.smithi111.stdout:7/25: dwrite f4 [0,4194304] 0 2023-12-08T20:27:40.409 INFO:tasks.workunit.client.1.smithi111.stdout:5/24: creat d3/d4/fc x:0 0 0 2023-12-08T20:27:40.409 INFO:tasks.workunit.client.1.smithi111.stdout:5/25: dread - d3/d4/f5 zero size 2023-12-08T20:27:40.409 INFO:tasks.workunit.client.1.smithi111.stdout:9/32: dread d2/f7 [0,4194304] 0 2023-12-08T20:27:40.409 INFO:tasks.workunit.client.1.smithi111.stdout:2/25: dread d1/d2/f6 [0,4194304] 0 2023-12-08T20:27:40.410 INFO:tasks.workunit.client.1.smithi111.stdout:7/26: rename f4 to f6 0 2023-12-08T20:27:40.412 INFO:tasks.workunit.client.1.smithi111.stdout:2/26: mkdir d1/d2/de 0 2023-12-08T20:27:40.413 INFO:tasks.workunit.client.1.smithi111.stdout:2/27: symlink d1/dc/lf 0 2023-12-08T20:27:40.413 INFO:tasks.workunit.client.1.smithi111.stdout:9/33: dread d2/f7 [0,4194304] 0 2023-12-08T20:27:40.413 INFO:tasks.workunit.client.1.smithi111.stdout:2/28: readlink d1/dc/lf 0 2023-12-08T20:27:40.413 INFO:tasks.workunit.client.1.smithi111.stdout:9/34: chown d2/c5 4 1 2023-12-08T20:27:40.413 INFO:tasks.workunit.client.1.smithi111.stdout:7/27: fdatasync f1 0 2023-12-08T20:27:40.414 INFO:tasks.workunit.client.1.smithi111.stdout:9/35: write d2/f7 [2107736,1918] 0 2023-12-08T20:27:40.416 INFO:tasks.workunit.client.1.smithi111.stdout:5/26: getdents d3/d4 0 2023-12-08T20:27:40.416 INFO:tasks.workunit.client.1.smithi111.stdout:5/27: chown d3/c6 2 1 2023-12-08T20:27:40.416 INFO:tasks.workunit.client.1.smithi111.stdout:5/28: write d3/d4/fc [62468,80897] 0 2023-12-08T20:27:40.418 INFO:tasks.workunit.client.1.smithi111.stdout:9/36: creat d2/d8/f9 x:0 0 0 2023-12-08T20:27:40.426 INFO:tasks.workunit.client.1.smithi111.stdout:7/28: dread f6 [0,4194304] 0 2023-12-08T20:27:40.428 INFO:tasks.workunit.client.1.smithi111.stdout:7/29: symlink l7 0 2023-12-08T20:27:40.429 INFO:tasks.workunit.client.1.smithi111.stdout:2/29: rmdir d1/d2 39 2023-12-08T20:27:40.438 INFO:tasks.workunit.client.1.smithi111.stdout:7/30: truncate f1 5307843 0 2023-12-08T20:27:40.438 INFO:tasks.workunit.client.1.smithi111.stdout:7/31: write f5 [774697,71948] 0 2023-12-08T20:27:40.439 INFO:tasks.workunit.client.1.smithi111.stdout:9/37: dwrite d2/d8/f9 [0,4194304] 0 2023-12-08T20:27:40.442 INFO:tasks.workunit.client.1.smithi111.stdout:5/29: dwrite d3/d4/f8 [0,4194304] 0 2023-12-08T20:27:40.442 INFO:tasks.workunit.client.1.smithi111.stdout:5/30: readlink d3/d4/d7/l9 0 2023-12-08T20:27:40.442 INFO:tasks.workunit.client.1.smithi111.stdout:9/38: unlink d2/c3 0 2023-12-08T20:27:40.443 INFO:tasks.workunit.client.1.smithi111.stdout:5/31: symlink d3/d4/ld 0 2023-12-08T20:27:40.445 INFO:tasks.workunit.client.1.smithi111.stdout:9/39: mkdir d2/da 0 2023-12-08T20:27:40.449 INFO:tasks.workunit.client.1.smithi111.stdout:2/30: dwrite d1/d2/f6 [0,4194304] 0 2023-12-08T20:27:40.449 INFO:tasks.workunit.client.1.smithi111.stdout:5/32: dread d3/d4/fc [0,4194304] 0 2023-12-08T20:27:40.454 INFO:tasks.workunit.client.1.smithi111.stdout:9/40: dread d2/f7 [0,4194304] 0 2023-12-08T20:27:40.454 INFO:tasks.workunit.client.1.smithi111.stdout:2/31: dread f0 [0,4194304] 0 2023-12-08T20:27:40.457 INFO:tasks.workunit.client.1.smithi111.stdout:2/32: dread f0 [0,4194304] 0 2023-12-08T20:27:40.457 INFO:tasks.workunit.client.1.smithi111.stdout:2/33: readlink d1/l9 0 2023-12-08T20:27:40.457 INFO:tasks.workunit.client.1.smithi111.stdout:5/33: dread d3/d4/f8 [0,4194304] 0 2023-12-08T20:27:40.458 INFO:tasks.workunit.client.1.smithi111.stdout:5/34: dread d3/d4/fc [0,4194304] 0 2023-12-08T20:27:40.460 INFO:tasks.workunit.client.1.smithi111.stdout:9/41: symlink d2/da/lb 0 2023-12-08T20:27:40.461 INFO:tasks.workunit.client.1.smithi111.stdout:5/35: dread d3/d4/f8 [0,4194304] 0 2023-12-08T20:27:40.461 INFO:tasks.workunit.client.1.smithi111.stdout:5/36: stat d3/d4/ld 0 2023-12-08T20:27:40.462 INFO:tasks.workunit.client.1.smithi111.stdout:2/34: mkdir d1/d10 0 2023-12-08T20:27:40.462 INFO:tasks.workunit.client.1.smithi111.stdout:9/42: creat d2/da/fc x:0 0 0 2023-12-08T20:27:40.463 INFO:tasks.workunit.client.1.smithi111.stdout:5/37: link d3/c6 d3/ce 0 2023-12-08T20:27:40.465 INFO:tasks.workunit.client.1.smithi111.stdout:2/35: rmdir d1/d2/de 0 2023-12-08T20:27:40.465 INFO:tasks.workunit.client.1.smithi111.stdout:9/43: mkdir d2/d8/dd 0 2023-12-08T20:27:40.466 INFO:tasks.workunit.client.1.smithi111.stdout:9/44: read d2/d8/f9 [3961019,9341] 0 2023-12-08T20:27:40.466 INFO:tasks.workunit.client.1.smithi111.stdout:2/36: mknod d1/d10/c11 0 2023-12-08T20:27:40.466 INFO:tasks.workunit.client.1.smithi111.stdout:2/37: fdatasync d1/d2/f6 0 2023-12-08T20:27:40.469 INFO:tasks.workunit.client.1.smithi111.stdout:9/45: mknod d2/d8/dd/ce 0 2023-12-08T20:27:40.469 INFO:tasks.workunit.client.1.smithi111.stdout:7/32: dwrite f5 [0,4194304] 0 2023-12-08T20:27:40.469 INFO:tasks.workunit.client.1.smithi111.stdout:7/33: chown f6 7130928 1 2023-12-08T20:27:40.470 INFO:tasks.workunit.client.1.smithi111.stdout:9/46: symlink d2/lf 0 2023-12-08T20:27:40.472 INFO:tasks.workunit.client.1.smithi111.stdout:7/34: getdents . 0 2023-12-08T20:27:40.473 INFO:tasks.workunit.client.1.smithi111.stdout:7/35: write f6 [1433141,103674] 0 2023-12-08T20:27:40.473 INFO:tasks.workunit.client.1.smithi111.stdout:9/47: creat d2/d8/f10 x:0 0 0 2023-12-08T20:27:40.474 INFO:tasks.workunit.client.1.smithi111.stdout:9/48: chown d2/da/fc 40189812 1 2023-12-08T20:27:40.474 INFO:tasks.workunit.client.1.smithi111.stdout:9/49: read - d2/d8/f10 zero size 2023-12-08T20:27:40.474 INFO:tasks.workunit.client.1.smithi111.stdout:9/50: chown d2/da/fc 9 1 2023-12-08T20:27:40.474 INFO:tasks.workunit.client.1.smithi111.stdout:9/51: write d2/d8/f9 [4534746,49590] 0 2023-12-08T20:27:40.478 INFO:tasks.workunit.client.1.smithi111.stdout:9/52: link d2/d8/f9 d2/da/f11 0 2023-12-08T20:27:40.479 INFO:tasks.workunit.client.1.smithi111.stdout:7/36: dread f1 [4194304,4194304] 0 2023-12-08T20:27:40.481 INFO:tasks.workunit.client.1.smithi111.stdout:7/37: mknod c8 0 2023-12-08T20:27:40.482 INFO:tasks.workunit.client.1.smithi111.stdout:9/53: read d2/d8/f9 [255602,115505] 0 2023-12-08T20:27:40.483 INFO:tasks.workunit.client.1.smithi111.stdout:7/38: mknod c9 0 2023-12-08T20:27:40.483 INFO:tasks.workunit.client.1.smithi111.stdout:7/39: chown f1 47420279 1 2023-12-08T20:27:40.486 INFO:tasks.workunit.client.1.smithi111.stdout:5/38: dwrite d3/d4/f5 [0,4194304] 0 2023-12-08T20:27:40.486 INFO:tasks.workunit.client.1.smithi111.stdout:5/39: fsync d3/d4/fc 0 2023-12-08T20:27:40.491 INFO:tasks.workunit.client.1.smithi111.stdout:5/40: symlink d3/d4/lf 0 2023-12-08T20:27:40.491 INFO:tasks.workunit.client.1.smithi111.stdout:5/41: read d3/d4/fc [110925,31387] 0 2023-12-08T20:27:40.491 INFO:tasks.workunit.client.1.smithi111.stdout:7/40: dread f6 [0,4194304] 0 2023-12-08T20:27:40.492 INFO:tasks.workunit.client.1.smithi111.stdout:2/38: dwrite d1/d2/f6 [0,4194304] 0 2023-12-08T20:27:40.493 INFO:tasks.workunit.client.1.smithi111.stdout:7/41: mkdir da 0 2023-12-08T20:27:40.494 INFO:tasks.workunit.client.1.smithi111.stdout:2/39: mkdir d1/d2/d12 0 2023-12-08T20:27:40.495 INFO:tasks.workunit.client.1.smithi111.stdout:7/42: write f5 [605405,54173] 0 2023-12-08T20:27:40.496 INFO:tasks.workunit.client.1.smithi111.stdout:2/40: creat d1/f13 x:0 0 0 2023-12-08T20:27:40.496 INFO:tasks.workunit.client.1.smithi111.stdout:2/41: readlink d1/l8 0 2023-12-08T20:27:40.497 INFO:tasks.workunit.client.1.smithi111.stdout:2/42: symlink d1/dc/l14 0 2023-12-08T20:27:40.497 INFO:tasks.workunit.client.1.smithi111.stdout:2/43: truncate d1/f13 168931 0 2023-12-08T20:27:40.497 INFO:tasks.workunit.client.1.smithi111.stdout:2/44: stat d1/f13 0 2023-12-08T20:27:40.505 INFO:tasks.workunit.client.1.smithi111.stdout:9/54: dwrite d2/f7 [0,4194304] 0 2023-12-08T20:27:40.505 INFO:tasks.workunit.client.1.smithi111.stdout:9/55: stat d2/d8/f9 0 2023-12-08T20:27:40.505 INFO:tasks.workunit.client.1.smithi111.stdout:9/56: truncate d2/da/fc 389855 0 2023-12-08T20:27:40.505 INFO:tasks.workunit.client.1.smithi111.stdout:9/57: readlink d2/lf 0 2023-12-08T20:27:40.506 INFO:tasks.workunit.client.1.smithi111.stdout:9/58: symlink d2/l12 0 2023-12-08T20:27:40.506 INFO:tasks.workunit.client.1.smithi111.stdout:5/42: dwrite d3/d4/f8 [0,4194304] 0 2023-12-08T20:27:40.506 INFO:tasks.workunit.client.1.smithi111.stdout:9/59: dread d2/da/fc [0,4194304] 0 2023-12-08T20:27:40.508 INFO:tasks.workunit.client.1.smithi111.stdout:5/43: write d3/d4/f8 [3353523,100134] 0 2023-12-08T20:27:40.510 INFO:tasks.workunit.client.1.smithi111.stdout:5/44: creat d3/f10 x:0 0 0 2023-12-08T20:27:40.510 INFO:tasks.workunit.client.1.smithi111.stdout:5/45: write d3/f10 [559207,103274] 0 2023-12-08T20:27:40.512 INFO:tasks.workunit.client.1.smithi111.stdout:5/46: mknod d3/d4/c11 0 2023-12-08T20:27:40.512 INFO:tasks.workunit.client.1.smithi111.stdout:2/45: truncate d1/d2/f6 3049120 0 2023-12-08T20:27:40.514 INFO:tasks.workunit.client.1.smithi111.stdout:7/43: dread f5 [0,4194304] 0 2023-12-08T20:27:40.514 INFO:tasks.workunit.client.1.smithi111.stdout:7/44: rename da to da/db 22 2023-12-08T20:27:40.514 INFO:tasks.workunit.client.1.smithi111.stdout:7/45: truncate f5 4319083 0 2023-12-08T20:27:40.514 INFO:tasks.workunit.client.1.smithi111.stdout:5/47: mkdir d3/d12 0 2023-12-08T20:27:40.515 INFO:tasks.workunit.client.1.smithi111.stdout:5/48: write d3/d4/f5 [2477182,118942] 0 2023-12-08T20:27:40.515 INFO:tasks.workunit.client.1.smithi111.stdout:5/49: readlink d3/d4/d7/la 0 2023-12-08T20:27:40.521 INFO:tasks.workunit.client.1.smithi111.stdout:9/60: dread d2/d8/f9 [0,4194304] 0 2023-12-08T20:27:40.521 INFO:tasks.workunit.client.1.smithi111.stdout:9/61: stat d2/d8 0 2023-12-08T20:27:40.543 INFO:tasks.workunit.client.1.smithi111.stdout:7/46: dwrite f6 [0,4194304] 0 2023-12-08T20:27:40.543 INFO:tasks.workunit.client.1.smithi111.stdout:5/50: dwrite d3/f10 [0,4194304] 0 2023-12-08T20:27:40.834 INFO:tasks.workunit.client.1.smithi111.stdout:2/46: rmdir d1/d2 39 2023-12-08T20:27:40.842 INFO:tasks.workunit.client.1.smithi111.stdout:9/62: mknod d2/c13 0 2023-12-08T20:27:40.842 INFO:tasks.workunit.client.1.smithi111.stdout:9/63: chown d2/da/f11 418034 1 2023-12-08T20:27:40.843 INFO:tasks.workunit.client.1.smithi111.stdout:7/47: mknod da/cc 0 2023-12-08T20:27:40.845 INFO:tasks.workunit.client.1.smithi111.stdout:5/51: unlink d3/d4/fc 0 2023-12-08T20:27:40.846 INFO:tasks.workunit.client.1.smithi111.stdout:9/64: getdents d2/d8/dd 0 2023-12-08T20:27:40.846 INFO:tasks.workunit.client.1.smithi111.stdout:9/65: readlink d2/lf 0 2023-12-08T20:27:40.849 INFO:tasks.workunit.client.1.smithi111.stdout:2/47: truncate d1/d2/f6 490333 0 2023-12-08T20:27:40.849 INFO:tasks.workunit.client.1.smithi111.stdout:2/48: write d1/f13 [625265,8081] 0 2023-12-08T20:27:40.851 INFO:tasks.workunit.client.1.smithi111.stdout:9/66: rename d2/d8/f10 to d2/d8/f14 0 2023-12-08T20:27:40.855 INFO:tasks.workunit.client.1.smithi111.stdout:2/49: creat d1/f15 x:0 0 0 2023-12-08T20:27:40.855 INFO:tasks.workunit.client.1.smithi111.stdout:2/50: write d1/f15 [976566,128751] 0 2023-12-08T20:27:40.856 INFO:tasks.workunit.client.1.smithi111.stdout:2/51: chown d1/d2/d12 25524838 1 2023-12-08T20:27:40.857 INFO:tasks.workunit.client.1.smithi111.stdout:2/52: creat d1/d2/f16 x:0 0 0 2023-12-08T20:27:40.858 INFO:tasks.workunit.client.1.smithi111.stdout:2/53: write d1/f13 [677811,75539] 0 2023-12-08T20:27:40.858 INFO:tasks.workunit.client.1.smithi111.stdout:2/54: fsync d1/d2/f6 0 2023-12-08T20:27:40.858 INFO:tasks.workunit.client.1.smithi111.stdout:2/55: read f0 [1122323,127717] 0 2023-12-08T20:27:40.860 INFO:tasks.workunit.client.1.smithi111.stdout:2/56: rename d1/l8 to d1/d2/d12/l17 0 2023-12-08T20:27:40.862 INFO:tasks.workunit.client.1.smithi111.stdout:5/52: truncate d3/d4/f5 3415675 0 2023-12-08T20:27:40.864 INFO:tasks.workunit.client.1.smithi111.stdout:7/48: dwrite f1 [0,4194304] 0 2023-12-08T20:27:40.864 INFO:tasks.workunit.client.1.smithi111.stdout:5/53: creat d3/d4/d7/f13 x:0 0 0 2023-12-08T20:27:40.864 INFO:tasks.workunit.client.1.smithi111.stdout:5/54: truncate d3/d4/d7/f13 281481 0 2023-12-08T20:27:40.866 INFO:tasks.workunit.client.1.smithi111.stdout:7/49: rename c9 to da/cd 0 2023-12-08T20:27:40.866 INFO:tasks.workunit.client.1.smithi111.stdout:2/57: dread d1/f13 [0,4194304] 0 2023-12-08T20:27:40.867 INFO:tasks.workunit.client.1.smithi111.stdout:5/55: creat d3/f14 x:0 0 0 2023-12-08T20:27:40.867 INFO:tasks.workunit.client.1.smithi111.stdout:7/50: write f5 [1385223,71656] 0 2023-12-08T20:27:40.868 INFO:tasks.workunit.client.1.smithi111.stdout:2/58: symlink d1/d2/l18 0 2023-12-08T20:27:40.871 INFO:tasks.workunit.client.1.smithi111.stdout:9/67: dwrite d2/d8/f9 [0,4194304] 0 2023-12-08T20:27:40.880 INFO:tasks.workunit.client.1.smithi111.stdout:7/51: symlink da/le 0 2023-12-08T20:27:40.881 INFO:tasks.workunit.client.1.smithi111.stdout:9/68: rmdir d2/da 39 2023-12-08T20:27:40.881 INFO:tasks.workunit.client.1.smithi111.stdout:9/69: chown d2/da/f11 22771 1 2023-12-08T20:27:40.881 INFO:tasks.workunit.client.1.smithi111.stdout:9/70: write d2/d8/f14 [640028,14674] 0 2023-12-08T20:27:40.881 INFO:tasks.workunit.client.1.smithi111.stdout:9/71: chown d2/d8/dd/ce 781698 1 2023-12-08T20:27:40.882 INFO:tasks.workunit.client.1.smithi111.stdout:9/72: read d2/d8/f14 [568082,8741] 0 2023-12-08T20:27:40.882 INFO:tasks.workunit.client.1.smithi111.stdout:9/73: chown d2/d8 1309026185 1 2023-12-08T20:27:40.882 INFO:tasks.workunit.client.1.smithi111.stdout:9/74: write d2/da/fc [642972,31795] 0 2023-12-08T20:27:40.882 INFO:tasks.workunit.client.1.smithi111.stdout:7/52: symlink da/lf 0 2023-12-08T20:27:40.886 INFO:tasks.workunit.client.1.smithi111.stdout:9/75: link d2/c4 d2/d8/dd/c15 0 2023-12-08T20:27:40.886 INFO:tasks.workunit.client.1.smithi111.stdout:5/56: truncate d3/d4/d7/f13 194025 0 2023-12-08T20:27:40.888 INFO:tasks.workunit.client.1.smithi111.stdout:2/59: dwrite d1/f15 [0,4194304] 0 2023-12-08T20:27:40.894 INFO:tasks.workunit.client.1.smithi111.stdout:2/60: symlink d1/d10/l19 0 2023-12-08T20:27:40.894 INFO:tasks.workunit.client.1.smithi111.stdout:2/61: fsync d1/f13 0 2023-12-08T20:27:40.895 INFO:tasks.workunit.client.1.smithi111.stdout:2/62: dread f0 [0,4194304] 0 2023-12-08T20:27:40.895 INFO:tasks.workunit.client.1.smithi111.stdout:5/57: dread d3/d4/f5 [0,4194304] 0 2023-12-08T20:27:40.895 INFO:tasks.workunit.client.1.smithi111.stdout:9/76: dread d2/da/f11 [0,4194304] 0 2023-12-08T20:27:40.896 INFO:tasks.workunit.client.1.smithi111.stdout:5/58: write d3/d4/d7/f13 [179519,114245] 0 2023-12-08T20:27:40.899 INFO:tasks.workunit.client.1.smithi111.stdout:9/77: write d2/da/f11 [1820223,91604] 0 2023-12-08T20:27:40.908 INFO:tasks.workunit.client.1.smithi111.stdout:2/63: dwrite d1/f13 [0,4194304] 0 2023-12-08T20:27:40.911 INFO:tasks.workunit.client.1.smithi111.stdout:9/78: dread d2/d8/f9 [0,4194304] 0 2023-12-08T20:27:40.917 INFO:tasks.workunit.client.1.smithi111.stdout:2/64: link d1/d2/d12/l17 d1/d2/l1a 0 2023-12-08T20:27:40.917 INFO:tasks.workunit.client.1.smithi111.stdout:2/65: fdatasync f0 0 2023-12-08T20:27:40.917 INFO:tasks.workunit.client.1.smithi111.stdout:2/66: readlink d1/d10/l19 0 2023-12-08T20:27:40.917 INFO:tasks.workunit.client.1.smithi111.stdout:9/79: creat d2/d8/dd/f16 x:0 0 0 2023-12-08T20:27:40.918 INFO:tasks.workunit.client.1.smithi111.stdout:9/80: mknod d2/c17 0 2023-12-08T20:27:40.918 INFO:tasks.workunit.client.1.smithi111.stdout:5/59: dwrite d3/d4/d7/f13 [0,4194304] 0 2023-12-08T20:27:40.921 INFO:tasks.workunit.client.1.smithi111.stdout:2/67: write d1/f13 [1186254,42343] 0 2023-12-08T20:27:40.922 INFO:tasks.workunit.client.1.smithi111.stdout:5/60: rename d3/d4/d7/l9 to d3/d4/l15 0 2023-12-08T20:27:40.923 INFO:tasks.workunit.client.1.smithi111.stdout:2/68: mknod d1/d2/c1b 0 2023-12-08T20:27:40.925 INFO:tasks.workunit.client.1.smithi111.stdout:5/61: creat d3/d4/d7/f16 x:0 0 0 2023-12-08T20:27:40.926 INFO:tasks.workunit.client.1.smithi111.stdout:5/62: chown d3/d4/f8 1902 1 2023-12-08T20:27:40.927 INFO:tasks.workunit.client.1.smithi111.stdout:2/69: mknod d1/c1c 0 2023-12-08T20:27:40.928 INFO:tasks.workunit.client.1.smithi111.stdout:9/81: truncate d2/f7 3080996 0 2023-12-08T20:27:40.928 INFO:tasks.workunit.client.1.smithi111.stdout:9/82: chown d2/c13 215124 1 2023-12-08T20:27:40.932 INFO:tasks.workunit.client.1.smithi111.stdout:2/70: rename d1/d2 to d1/d1d 0 2023-12-08T20:27:40.933 INFO:tasks.workunit.client.1.smithi111.stdout:2/71: symlink d1/dc/l1e 0 2023-12-08T20:27:40.935 INFO:tasks.workunit.client.1.smithi111.stdout:2/72: rename d1/d10 to d1/d1d/d1f 0 2023-12-08T20:27:40.936 INFO:tasks.workunit.client.1.smithi111.stdout:9/83: write d2/f7 [3416794,15131] 0 2023-12-08T20:27:40.938 INFO:tasks.workunit.client.1.smithi111.stdout:2/73: creat d1/d1d/f20 x:0 0 0 2023-12-08T20:27:40.940 INFO:tasks.workunit.client.1.smithi111.stdout:2/74: rename d1/d1d/c1b to d1/d1d/c21 0 2023-12-08T20:27:40.940 INFO:tasks.workunit.client.1.smithi111.stdout:2/75: chown f0 392 1 2023-12-08T20:27:40.941 INFO:tasks.workunit.client.1.smithi111.stdout:2/76: mkdir d1/d1d/d22 0 2023-12-08T20:27:40.944 INFO:tasks.workunit.client.1.smithi111.stdout:2/77: link d1/d1d/f16 d1/d1d/d12/f23 0 2023-12-08T20:27:40.946 INFO:tasks.workunit.client.1.smithi111.stdout:2/78: mknod d1/d1d/d22/c24 0 2023-12-08T20:27:40.947 INFO:tasks.workunit.client.1.smithi111.stdout:2/79: stat d1/d1d/ca 0 2023-12-08T20:27:40.949 INFO:tasks.workunit.client.1.smithi111.stdout:2/80: rename d1/dc to d1/d1d/d1f/d25 0 2023-12-08T20:27:40.951 INFO:tasks.workunit.client.1.smithi111.stdout:2/81: creat d1/d1d/f26 x:0 0 0 2023-12-08T20:27:40.951 INFO:tasks.workunit.client.1.smithi111.stdout:2/82: truncate d1/d1d/f16 665184 0 2023-12-08T20:27:40.951 INFO:tasks.workunit.client.1.smithi111.stdout:2/83: readlink d1/lb 0 2023-12-08T20:27:40.951 INFO:tasks.workunit.client.1.smithi111.stdout:2/84: dread - d1/d1d/f26 zero size 2023-12-08T20:27:40.951 INFO:tasks.workunit.client.1.smithi111.stdout:2/85: dread - d1/d1d/f20 zero size 2023-12-08T20:27:40.952 INFO:tasks.workunit.client.1.smithi111.stdout:2/86: symlink d1/d1d/d12/l27 0 2023-12-08T20:27:40.952 INFO:tasks.workunit.client.1.smithi111.stdout:2/87: symlink d1/l28 0 2023-12-08T20:27:40.954 INFO:tasks.workunit.client.1.smithi111.stdout:9/84: dwrite d2/d8/f14 [0,4194304] 0 2023-12-08T20:27:40.954 INFO:tasks.workunit.client.1.smithi111.stdout:9/85: chown d2/da 600998 1 2023-12-08T20:27:40.954 INFO:tasks.workunit.client.1.smithi111.stdout:9/86: chown d2/da/lb 3210 1 2023-12-08T20:27:40.954 INFO:tasks.workunit.client.1.smithi111.stdout:9/87: write d2/da/fc [1660487,121071] 0 2023-12-08T20:27:40.976 INFO:tasks.workunit.client.1.smithi111.stdout:9/88: dwrite d2/da/f11 [0,4194304] 0 2023-12-08T20:27:40.976 INFO:tasks.workunit.client.1.smithi111.stdout:2/88: dwrite d1/d1d/f20 [0,4194304] 0 2023-12-08T20:27:40.979 INFO:tasks.workunit.client.1.smithi111.stdout:2/89: mkdir d1/d29 0 2023-12-08T20:27:40.980 INFO:tasks.workunit.client.1.smithi111.stdout:2/90: rename d1/l7 to d1/d29/l2a 0 2023-12-08T20:27:40.995 INFO:tasks.workunit.client.1.smithi111.stdout:9/89: dwrite d2/d8/f9 [4194304,4194304] 0 2023-12-08T20:27:41.004 INFO:tasks.workunit.client.1.smithi111.stdout:2/91: dwrite d1/f13 [4194304,4194304] 0 2023-12-08T20:27:41.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:40 smithi043 ceph-mon[111966]: pgmap v11: 65 pgs: 65 active+clean; 134 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 785 op/s 2023-12-08T20:27:41.020 INFO:tasks.workunit.client.1.smithi111.stdout:2/92: dwrite d1/f15 [0,4194304] 0 2023-12-08T20:27:41.020 INFO:tasks.workunit.client.1.smithi111.stdout:2/93: chown d1/d1d/d1f/d25/l1e 104 1 2023-12-08T20:27:41.020 INFO:tasks.workunit.client.1.smithi111.stdout:2/94: chown d1/d29/l2a 1292 1 2023-12-08T20:27:41.020 INFO:tasks.workunit.client.1.smithi111.stdout:2/95: readlink d1/d1d/d1f/d25/l1e 0 2023-12-08T20:27:41.020 INFO:tasks.workunit.client.1.smithi111.stdout:2/96: truncate d1/d1d/f20 4742113 0 2023-12-08T20:27:41.021 INFO:tasks.workunit.client.1.smithi111.stdout:2/97: creat d1/d1d/d1f/d25/f2b x:0 0 0 2023-12-08T20:27:41.022 INFO:tasks.workunit.client.1.smithi111.stdout:2/98: creat d1/d1d/d22/f2c x:0 0 0 2023-12-08T20:27:41.024 INFO:tasks.workunit.client.1.smithi111.stdout:2/99: dread d1/d1d/f6 [0,4194304] 0 2023-12-08T20:27:41.025 INFO:tasks.workunit.client.1.smithi111.stdout:2/100: unlink d1/d1d/d1f/l19 0 2023-12-08T20:27:41.026 INFO:tasks.workunit.client.1.smithi111.stdout:2/101: mkdir d1/d1d/d1f/d2d 0 2023-12-08T20:27:41.026 INFO:tasks.workunit.client.1.smithi111.stdout:2/102: chown d1/d1d 96 1 2023-12-08T20:27:41.027 INFO:tasks.workunit.client.1.smithi111.stdout:2/103: creat d1/d1d/f2e x:0 0 0 2023-12-08T20:27:41.027 INFO:tasks.workunit.client.1.smithi111.stdout:2/104: fsync d1/f15 0 2023-12-08T20:27:41.042 INFO:tasks.workunit.client.1.smithi111.stdout:2/105: dread d1/d1d/f20 [0,4194304] 0 2023-12-08T20:27:41.043 INFO:tasks.workunit.client.1.smithi111.stdout:2/106: rmdir d1/d29 39 2023-12-08T20:27:41.062 INFO:tasks.workunit.client.1.smithi111.stdout:2/107: dwrite d1/d1d/f26 [0,4194304] 0 2023-12-08T20:27:41.062 INFO:tasks.workunit.client.1.smithi111.stdout:2/108: fsync d1/d1d/f26 0 2023-12-08T20:27:41.064 INFO:tasks.workunit.client.1.smithi111.stdout:2/109: creat d1/d1d/d22/f2f x:0 0 0 2023-12-08T20:27:41.064 INFO:tasks.workunit.client.1.smithi111.stdout:2/110: mkdir d1/d1d/d22/d30 0 2023-12-08T20:27:41.065 INFO:tasks.workunit.client.1.smithi111.stdout:2/111: mknod d1/c31 0 2023-12-08T20:27:41.066 INFO:tasks.workunit.client.1.smithi111.stdout:2/112: creat d1/d1d/d1f/d2d/f32 x:0 0 0 2023-12-08T20:27:41.067 INFO:tasks.workunit.client.1.smithi111.stdout:2/113: creat d1/d1d/f33 x:0 0 0 2023-12-08T20:27:41.068 INFO:tasks.workunit.client.1.smithi111.stdout:2/114: creat d1/d1d/d22/f34 x:0 0 0 2023-12-08T20:27:41.068 INFO:tasks.workunit.client.1.smithi111.stdout:2/115: write d1/d1d/d22/f2f [214620,47320] 0 2023-12-08T20:27:41.068 INFO:tasks.workunit.client.1.smithi111.stdout:2/116: fdatasync d1/d1d/f20 0 2023-12-08T20:27:41.069 INFO:tasks.workunit.client.1.smithi111.stdout:2/117: read d1/f13 [5034822,79976] 0 2023-12-08T20:27:41.069 INFO:tasks.workunit.client.1.smithi111.stdout:2/118: dread - d1/d1d/d1f/d25/f2b zero size 2023-12-08T20:27:41.070 INFO:tasks.workunit.client.1.smithi111.stdout:2/119: symlink d1/d1d/d22/d30/l35 0 2023-12-08T20:27:41.076 INFO:tasks.workunit.client.1.smithi111.stdout:2/120: dread d1/f15 [0,4194304] 0 2023-12-08T20:27:41.076 INFO:tasks.workunit.client.1.smithi111.stdout:2/121: write d1/d1d/f20 [5450191,105215] 0 2023-12-08T20:27:41.082 INFO:tasks.workunit.client.1.smithi111.stdout:2/122: dread d1/d1d/d22/f2f [0,4194304] 0 2023-12-08T20:27:41.082 INFO:tasks.workunit.client.1.smithi111.stdout:2/123: read - d1/d1d/d1f/d25/f2b zero size 2023-12-08T20:27:41.083 INFO:tasks.workunit.client.1.smithi111.stdout:2/124: mkdir d1/d1d/d1f/d36 0 2023-12-08T20:27:41.083 INFO:tasks.workunit.client.1.smithi111.stdout:2/125: truncate d1/d1d/d22/f34 954399 0 2023-12-08T20:27:41.083 INFO:tasks.workunit.client.1.smithi111.stdout:2/126: stat d1/f15 0 2023-12-08T20:27:41.083 INFO:tasks.workunit.client.1.smithi111.stdout:2/127: read d1/d1d/f16 [53996,86300] 0 2023-12-08T20:27:41.084 INFO:tasks.workunit.client.1.smithi111.stdout:2/128: read d1/d1d/f26 [241103,72032] 0 2023-12-08T20:27:41.085 INFO:tasks.workunit.client.1.smithi111.stdout:2/129: symlink d1/d1d/d1f/d2d/l37 0 2023-12-08T20:27:41.086 INFO:tasks.workunit.client.1.smithi111.stdout:2/130: unlink d1/d1d/d1f/c11 0 2023-12-08T20:27:41.087 INFO:tasks.workunit.client.1.smithi111.stdout:2/131: mknod d1/d29/c38 0 2023-12-08T20:27:41.087 INFO:tasks.workunit.client.1.smithi111.stdout:2/132: write f0 [1025053,70433] 0 2023-12-08T20:27:41.091 INFO:tasks.workunit.client.1.smithi111.stdout:2/133: fsync d1/d1d/f33 0 2023-12-08T20:27:41.092 INFO:tasks.workunit.client.1.smithi111.stdout:2/134: creat d1/d1d/d22/f39 x:0 0 0 2023-12-08T20:27:41.094 INFO:tasks.workunit.client.1.smithi111.stdout:2/135: link d1/d1d/f2e d1/d1d/d12/f3a 0 2023-12-08T20:27:41.094 INFO:tasks.workunit.client.1.smithi111.stdout:2/136: write d1/d1d/d22/f2c [855696,100840] 0 2023-12-08T20:27:41.094 INFO:tasks.workunit.client.1.smithi111.stdout:2/137: chown d1/d1d/c21 941783775 1 2023-12-08T20:27:41.095 INFO:tasks.workunit.client.1.smithi111.stdout:2/138: symlink d1/d1d/d22/l3b 0 2023-12-08T20:27:41.096 INFO:tasks.workunit.client.1.smithi111.stdout:2/139: dread d1/d1d/f6 [0,4194304] 0 2023-12-08T20:27:41.097 INFO:tasks.workunit.client.1.smithi111.stdout:2/140: creat d1/d1d/d1f/f3c x:0 0 0 2023-12-08T20:27:41.098 INFO:tasks.workunit.client.1.smithi111.stdout:2/141: unlink d1/d1d/f6 0 2023-12-08T20:27:41.101 INFO:tasks.workunit.client.1.smithi111.stdout:2/142: read d1/d1d/f26 [675847,116621] 0 2023-12-08T20:27:41.112 INFO:tasks.workunit.client.1.smithi111.stdout:2/143: dwrite d1/d1d/d22/f34 [0,4194304] 0 2023-12-08T20:27:41.115 INFO:tasks.workunit.client.1.smithi111.stdout:2/144: mkdir d1/d1d/d1f/d25/d3d 0 2023-12-08T20:27:41.121 INFO:tasks.workunit.client.1.smithi111.stdout:2/145: dread d1/f13 [0,4194304] 0 2023-12-08T20:27:41.122 INFO:tasks.workunit.client.1.smithi111.stdout:2/146: mknod d1/d29/c3e 0 2023-12-08T20:27:41.123 INFO:tasks.workunit.client.1.smithi111.stdout:2/147: creat d1/d1d/d22/f3f x:0 0 0 2023-12-08T20:27:41.128 INFO:tasks.workunit.client.1.smithi111.stdout:2/148: truncate d1/d1d/f20 3870504 0 2023-12-08T20:27:41.128 INFO:tasks.workunit.client.1.smithi111.stdout:2/149: dread - d1/d1d/d12/f3a zero size 2023-12-08T20:27:41.128 INFO:tasks.workunit.client.1.smithi111.stdout:2/150: read - d1/d1d/d1f/d2d/f32 zero size 2023-12-08T20:27:41.128 INFO:tasks.workunit.client.1.smithi111.stdout:2/151: readlink d1/d1d/l18 0 2023-12-08T20:27:41.129 INFO:tasks.workunit.client.1.smithi111.stdout:2/152: symlink d1/d1d/d1f/d25/l40 0 2023-12-08T20:27:41.131 INFO:tasks.workunit.client.1.smithi111.stdout:2/153: mkdir d1/d1d/d1f/d25/d3d/d41 0 2023-12-08T20:27:41.131 INFO:tasks.workunit.client.1.smithi111.stdout:2/154: truncate d1/d1d/d22/f39 569600 0 2023-12-08T20:27:41.132 INFO:tasks.workunit.client.1.smithi111.stdout:2/155: symlink d1/d1d/d1f/l42 0 2023-12-08T20:27:41.134 INFO:tasks.workunit.client.1.smithi111.stdout:2/156: rename d1/d1d/l1a to d1/d1d/d1f/d25/l43 0 2023-12-08T20:27:41.134 INFO:tasks.workunit.client.1.smithi111.stdout:2/157: write f0 [1250422,53138] 0 2023-12-08T20:27:41.138 INFO:tasks.workunit.client.1.smithi111.stdout:2/158: getdents d1/d1d 0 2023-12-08T20:27:41.138 INFO:tasks.workunit.client.1.smithi111.stdout:2/159: truncate d1/d1d/d22/f2f 443362 0 2023-12-08T20:27:41.138 INFO:tasks.workunit.client.1.smithi111.stdout:2/160: write d1/d1d/d12/f3a [1015483,108733] 0 2023-12-08T20:27:41.139 INFO:tasks.workunit.client.1.smithi111.stdout:2/161: symlink d1/d1d/d1f/d2d/l44 0 2023-12-08T20:27:41.139 INFO:tasks.workunit.client.1.smithi111.stdout:2/162: write d1/d1d/d12/f23 [699212,94290] 0 2023-12-08T20:27:41.139 INFO:tasks.workunit.client.1.smithi111.stdout:2/163: symlink d1/d1d/d1f/d25/d3d/d41/l45 0 2023-12-08T20:27:41.161 INFO:tasks.workunit.client.1.smithi111.stdout:2/164: dwrite d1/d1d/f33 [0,4194304] 0 2023-12-08T20:27:41.163 INFO:tasks.workunit.client.1.smithi111.stdout:2/165: mknod d1/d1d/d1f/d25/c46 0 2023-12-08T20:27:41.180 INFO:tasks.workunit.client.1.smithi111.stdout:2/166: dwrite d1/d1d/f20 [0,4194304] 0 2023-12-08T20:27:41.181 INFO:tasks.workunit.client.1.smithi111.stdout:2/167: symlink d1/d1d/d1f/d25/l47 0 2023-12-08T20:27:41.181 INFO:tasks.workunit.client.1.smithi111.stdout:2/168: fsync d1/d1d/d22/f39 0 2023-12-08T20:27:41.181 INFO:tasks.workunit.client.1.smithi111.stdout:2/169: write f0 [2604207,14588] 0 2023-12-08T20:27:41.183 INFO:tasks.workunit.client.1.smithi111.stdout:2/170: mkdir d1/d1d/d1f/d25/d48 0 2023-12-08T20:27:41.184 INFO:tasks.workunit.client.1.smithi111.stdout:2/171: mkdir d1/d1d/d1f/d25/d3d/d49 0 2023-12-08T20:27:41.184 INFO:tasks.workunit.client.1.smithi111.stdout:2/172: chown d1/d1d/d22/f3f 0 1 2023-12-08T20:27:41.185 INFO:tasks.workunit.client.1.smithi111.stdout:2/173: fdatasync d1/d1d/d12/f23 0 2023-12-08T20:27:41.186 INFO:tasks.workunit.client.1.smithi111.stdout:2/174: truncate d1/f15 1351081 0 2023-12-08T20:27:41.187 INFO:tasks.workunit.client.1.smithi111.stdout:2/175: read d1/d1d/d12/f23 [327411,19985] 0 2023-12-08T20:27:41.187 INFO:tasks.workunit.client.1.smithi111.stdout:2/176: fsync d1/d1d/f20 0 2023-12-08T20:27:41.204 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:40 smithi111 ceph-mon[121341]: pgmap v11: 65 pgs: 65 active+clean; 134 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 785 op/s 2023-12-08T20:27:42.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:42 smithi111 ceph-mon[121341]: pgmap v12: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 8.8 MiB/s wr, 809 op/s 2023-12-08T20:27:43.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:42 smithi043 ceph-mon[111966]: pgmap v12: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 8.8 MiB/s wr, 809 op/s 2023-12-08T20:27:44.143 INFO:tasks.workunit.client.1.smithi111.stdout:2/177: sync 2023-12-08T20:27:44.146 INFO:tasks.workunit.client.1.smithi111.stdout:9/90: sync 2023-12-08T20:27:44.146 INFO:tasks.workunit.client.1.smithi111.stdout:7/53: sync 2023-12-08T20:27:44.146 INFO:tasks.workunit.client.1.smithi111.stdout:3/27: sync 2023-12-08T20:27:44.146 INFO:tasks.workunit.client.1.smithi111.stdout:8/6: sync 2023-12-08T20:27:44.146 INFO:tasks.workunit.client.1.smithi111.stdout:0/21: sync 2023-12-08T20:27:44.146 INFO:tasks.workunit.client.1.smithi111.stdout:0/22: write d1/d4/f6 [861979,95769] 0 2023-12-08T20:27:44.147 INFO:tasks.workunit.client.1.smithi111.stdout:5/63: sync 2023-12-08T20:27:44.147 INFO:tasks.workunit.client.1.smithi111.stdout:6/8: sync 2023-12-08T20:27:44.147 INFO:tasks.workunit.client.1.smithi111.stdout:5/64: dread - d3/f14 zero size 2023-12-08T20:27:44.147 INFO:tasks.workunit.client.1.smithi111.stdout:5/65: chown d3/f14 94 1 2023-12-08T20:27:44.147 INFO:tasks.workunit.client.1.smithi111.stdout:4/20: sync 2023-12-08T20:27:44.147 INFO:tasks.workunit.client.1.smithi111.stdout:1/9: sync 2023-12-08T20:27:44.147 INFO:tasks.workunit.client.1.smithi111.stdout:1/10: chown d0 15 1 2023-12-08T20:27:44.148 INFO:tasks.workunit.client.1.smithi111.stdout:3/28: rename d2/d3/d5 to d2/d3/d6 0 2023-12-08T20:27:44.148 INFO:tasks.workunit.client.1.smithi111.stdout:5/66: write d3/f10 [625694,36412] 0 2023-12-08T20:27:44.150 INFO:tasks.workunit.client.1.smithi111.stdout:7/54: rename da/lf to da/l10 0 2023-12-08T20:27:44.150 INFO:tasks.workunit.client.1.smithi111.stdout:9/91: write d2/f7 [2462910,46300] 0 2023-12-08T20:27:44.151 INFO:tasks.workunit.client.1.smithi111.stdout:8/7: mknod c4 0 2023-12-08T20:27:44.151 INFO:tasks.workunit.client.1.smithi111.stdout:8/8: read - f2 zero size 2023-12-08T20:27:44.151 INFO:tasks.workunit.client.1.smithi111.stdout:8/9: dread - f0 zero size 2023-12-08T20:27:44.151 INFO:tasks.workunit.client.1.smithi111.stdout:8/10: dread - f2 zero size 2023-12-08T20:27:44.151 INFO:tasks.workunit.client.1.smithi111.stdout:7/55: write f6 [2923953,74437] 0 2023-12-08T20:27:44.152 INFO:tasks.workunit.client.1.smithi111.stdout:6/9: creat d0/f2 x:0 0 0 2023-12-08T20:27:44.152 INFO:tasks.workunit.client.1.smithi111.stdout:6/10: truncate d0/f2 530112 0 2023-12-08T20:27:44.153 INFO:tasks.workunit.client.1.smithi111.stdout:4/21: creat f6 x:0 0 0 2023-12-08T20:27:44.155 INFO:tasks.workunit.client.1.smithi111.stdout:1/11: creat d0/f1 x:0 0 0 2023-12-08T20:27:44.155 INFO:tasks.workunit.client.1.smithi111.stdout:1/12: truncate d0/f1 940429 0 2023-12-08T20:27:44.155 INFO:tasks.workunit.client.1.smithi111.stdout:1/13: fdatasync d0/f1 0 2023-12-08T20:27:44.157 INFO:tasks.workunit.client.1.smithi111.stdout:3/29: creat d2/d3/d6/f7 x:0 0 0 2023-12-08T20:27:44.157 INFO:tasks.workunit.client.1.smithi111.stdout:3/30: stat d2/d3/d6/f7 0 2023-12-08T20:27:44.158 INFO:tasks.workunit.client.1.smithi111.stdout:5/67: creat d3/d12/f17 x:0 0 0 2023-12-08T20:27:44.160 INFO:tasks.workunit.client.1.smithi111.stdout:9/92: creat d2/d8/f18 x:0 0 0 2023-12-08T20:27:44.160 INFO:tasks.workunit.client.1.smithi111.stdout:0/23: dread d1/d4/f6 [0,4194304] 0 2023-12-08T20:27:44.160 INFO:tasks.workunit.client.1.smithi111.stdout:8/11: creat f5 x:0 0 0 2023-12-08T20:27:44.160 INFO:tasks.workunit.client.1.smithi111.stdout:8/12: chown c4 91 1 2023-12-08T20:27:44.161 INFO:tasks.workunit.client.1.smithi111.stdout:2/178: dwrite d1/d1d/f2e [0,4194304] 0 2023-12-08T20:27:44.161 INFO:tasks.workunit.client.1.smithi111.stdout:7/56: dread f5 [0,4194304] 0 2023-12-08T20:27:44.161 INFO:tasks.workunit.client.1.smithi111.stdout:4/22: creat f7 x:0 0 0 2023-12-08T20:27:44.164 INFO:tasks.workunit.client.1.smithi111.stdout:1/14: link d0/f1 d0/f2 0 2023-12-08T20:27:44.164 INFO:tasks.workunit.client.1.smithi111.stdout:3/31: creat d2/f8 x:0 0 0 2023-12-08T20:27:44.165 INFO:tasks.workunit.client.1.smithi111.stdout:5/68: symlink d3/d4/d7/l18 0 2023-12-08T20:27:44.168 INFO:tasks.workunit.client.1.smithi111.stdout:9/93: link d2/d8/dd/ce d2/d8/c19 0 2023-12-08T20:27:44.170 INFO:tasks.workunit.client.1.smithi111.stdout:8/13: rename l3 to l6 0 2023-12-08T20:27:44.174 INFO:tasks.workunit.client.1.smithi111.stdout:6/11: dwrite d0/f2 [0,4194304] 0 2023-12-08T20:27:44.174 INFO:tasks.workunit.client.1.smithi111.stdout:2/179: unlink d1/d29/l2a 0 2023-12-08T20:27:44.174 INFO:tasks.workunit.client.1.smithi111.stdout:7/57: truncate f5 4045376 0 2023-12-08T20:27:44.176 INFO:tasks.workunit.client.1.smithi111.stdout:3/32: creat d2/f9 x:0 0 0 2023-12-08T20:27:44.176 INFO:tasks.workunit.client.1.smithi111.stdout:3/33: write d2/f8 [270883,107345] 0 2023-12-08T20:27:44.180 INFO:tasks.workunit.client.1.smithi111.stdout:5/69: creat d3/d12/f19 x:0 0 0 2023-12-08T20:27:44.182 INFO:tasks.workunit.client.1.smithi111.stdout:8/14: mknod c7 0 2023-12-08T20:27:44.182 INFO:tasks.workunit.client.1.smithi111.stdout:9/94: mkdir d2/d8/dd/d1a 0 2023-12-08T20:27:44.182 INFO:tasks.workunit.client.1.smithi111.stdout:4/23: dwrite f0 [0,4194304] 0 2023-12-08T20:27:44.190 INFO:tasks.workunit.client.1.smithi111.stdout:2/180: creat d1/d1d/d1f/d25/d48/f4a x:0 0 0 2023-12-08T20:27:44.193 INFO:tasks.workunit.client.1.smithi111.stdout:7/58: mknod da/c11 0 2023-12-08T20:27:44.195 INFO:tasks.workunit.client.1.smithi111.stdout:9/95: creat d2/d8/dd/d1a/f1b x:0 0 0 2023-12-08T20:27:44.195 INFO:tasks.workunit.client.1.smithi111.stdout:9/96: dread - d2/d8/dd/f16 zero size 2023-12-08T20:27:44.195 INFO:tasks.workunit.client.1.smithi111.stdout:9/97: truncate d2/d8/dd/d1a/f1b 438714 0 2023-12-08T20:27:44.197 INFO:tasks.workunit.client.1.smithi111.stdout:4/24: unlink f3 0 2023-12-08T20:27:44.200 INFO:tasks.workunit.client.1.smithi111.stdout:6/12: dwrite d0/f2 [0,4194304] 0 2023-12-08T20:27:44.203 INFO:tasks.workunit.client.1.smithi111.stdout:4/25: mkdir d8 0 2023-12-08T20:27:44.203 INFO:tasks.workunit.client.1.smithi111.stdout:1/15: rmdir d0 39 2023-12-08T20:27:44.203 INFO:tasks.workunit.client.1.smithi111.stdout:1/16: chown d0/f1 4947154 1 2023-12-08T20:27:44.203 INFO:tasks.workunit.client.1.smithi111.stdout:1/17: fdatasync d0/f2 0 2023-12-08T20:27:44.203 INFO:tasks.workunit.client.1.smithi111.stdout:5/70: dread d3/f10 [0,4194304] 0 2023-12-08T20:27:44.203 INFO:tasks.workunit.client.1.smithi111.stdout:5/71: chown d3/ce 1980848448 1 2023-12-08T20:27:44.205 INFO:tasks.workunit.client.1.smithi111.stdout:8/15: dwrite f0 [0,4194304] 0 2023-12-08T20:27:44.205 INFO:tasks.workunit.client.1.smithi111.stdout:8/16: write f2 [341130,118791] 0 2023-12-08T20:27:44.205 INFO:tasks.workunit.client.1.smithi111.stdout:6/13: rename d0/f2 to d0/f3 0 2023-12-08T20:27:44.207 INFO:tasks.workunit.client.1.smithi111.stdout:7/59: dread f1 [0,4194304] 0 2023-12-08T20:27:44.208 INFO:tasks.workunit.client.1.smithi111.stdout:1/18: creat d0/f3 x:0 0 0 2023-12-08T20:27:44.208 INFO:tasks.workunit.client.1.smithi111.stdout:1/19: write d0/f2 [1665199,3164] 0 2023-12-08T20:27:44.208 INFO:tasks.workunit.client.1.smithi111.stdout:1/20: dread - d0/f3 zero size 2023-12-08T20:27:44.210 INFO:tasks.workunit.client.1.smithi111.stdout:5/72: symlink d3/d4/l1a 0 2023-12-08T20:27:44.210 INFO:tasks.workunit.client.1.smithi111.stdout:3/34: dwrite d2/f8 [0,4194304] 0 2023-12-08T20:27:44.214 INFO:tasks.workunit.client.1.smithi111.stdout:2/181: dwrite d1/d1d/d12/f3a [0,4194304] 0 2023-12-08T20:27:44.214 INFO:tasks.workunit.client.1.smithi111.stdout:8/17: rename c7 to c8 0 2023-12-08T20:27:44.215 INFO:tasks.workunit.client.1.smithi111.stdout:8/18: dread - f5 zero size 2023-12-08T20:27:44.216 INFO:tasks.workunit.client.1.smithi111.stdout:6/14: symlink d0/d1/l4 0 2023-12-08T20:27:44.217 INFO:tasks.workunit.client.1.smithi111.stdout:6/15: write d0/f3 [3248343,69697] 0 2023-12-08T20:27:44.221 INFO:tasks.workunit.client.1.smithi111.stdout:5/73: creat d3/d12/f1b x:0 0 0 2023-12-08T20:27:44.221 INFO:tasks.workunit.client.1.smithi111.stdout:3/35: creat d2/fa x:0 0 0 2023-12-08T20:27:44.224 INFO:tasks.workunit.client.1.smithi111.stdout:2/182: unlink d1/d1d/c21 0 2023-12-08T20:27:44.227 INFO:tasks.workunit.client.1.smithi111.stdout:5/74: mkdir d3/d4/d7/d1c 0 2023-12-08T20:27:44.227 INFO:tasks.workunit.client.1.smithi111.stdout:5/75: dread - d3/d12/f19 zero size 2023-12-08T20:27:44.227 INFO:tasks.workunit.client.1.smithi111.stdout:5/76: dread - d3/d12/f1b zero size 2023-12-08T20:27:44.228 INFO:tasks.workunit.client.1.smithi111.stdout:2/183: symlink d1/d1d/d1f/d2d/l4b 0 2023-12-08T20:27:44.231 INFO:tasks.workunit.client.1.smithi111.stdout:5/77: link d3/d12/f1b d3/d4/f1d 0 2023-12-08T20:27:44.234 INFO:tasks.workunit.client.1.smithi111.stdout:4/26: dwrite f1 [0,4194304] 0 2023-12-08T20:27:44.237 INFO:tasks.workunit.client.1.smithi111.stdout:1/21: rmdir d0 39 2023-12-08T20:27:44.239 INFO:tasks.workunit.client.1.smithi111.stdout:1/22: dread d0/f2 [0,4194304] 0 2023-12-08T20:27:44.239 INFO:tasks.workunit.client.1.smithi111.stdout:1/23: fsync d0/f1 0 2023-12-08T20:27:44.240 INFO:tasks.workunit.client.1.smithi111.stdout:8/19: getdents . 0 2023-12-08T20:27:44.244 INFO:tasks.workunit.client.1.smithi111.stdout:1/24: mkdir d0/d4 0 2023-12-08T20:27:44.244 INFO:tasks.workunit.client.1.smithi111.stdout:8/20: symlink l9 0 2023-12-08T20:27:44.246 INFO:tasks.workunit.client.1.smithi111.stdout:3/36: fsync d2/fa 0 2023-12-08T20:27:44.246 INFO:tasks.workunit.client.1.smithi111.stdout:3/37: dread - d2/d3/d6/f7 zero size 2023-12-08T20:27:44.246 INFO:tasks.workunit.client.1.smithi111.stdout:8/21: read f0 [2526469,107480] 0 2023-12-08T20:27:44.246 INFO:tasks.workunit.client.1.smithi111.stdout:8/22: chown f0 1364 1 2023-12-08T20:27:44.246 INFO:tasks.workunit.client.1.smithi111.stdout:8/23: chown l6 10576 1 2023-12-08T20:27:44.246 INFO:tasks.workunit.client.1.smithi111.stdout:8/24: readlink l9 0 2023-12-08T20:27:44.247 INFO:tasks.workunit.client.1.smithi111.stdout:6/16: dwrite d0/f3 [0,4194304] 0 2023-12-08T20:27:44.248 INFO:tasks.workunit.client.1.smithi111.stdout:6/17: read d0/f3 [3635428,31526] 0 2023-12-08T20:27:44.248 INFO:tasks.workunit.client.1.smithi111.stdout:6/18: chown d0/d1/l4 227 1 2023-12-08T20:27:44.248 INFO:tasks.workunit.client.1.smithi111.stdout:8/25: creat fa x:0 0 0 2023-12-08T20:27:44.250 INFO:tasks.workunit.client.1.smithi111.stdout:4/27: dread f1 [0,4194304] 0 2023-12-08T20:27:44.251 INFO:tasks.workunit.client.1.smithi111.stdout:5/78: dwrite d3/f10 [0,4194304] 0 2023-12-08T20:27:44.252 INFO:tasks.workunit.client.1.smithi111.stdout:8/26: symlink lb 0 2023-12-08T20:27:44.254 INFO:tasks.workunit.client.1.smithi111.stdout:4/28: rename l5 to d8/l9 0 2023-12-08T20:27:44.254 INFO:tasks.workunit.client.1.smithi111.stdout:3/38: dread f1 [0,4194304] 0 2023-12-08T20:27:44.254 INFO:tasks.workunit.client.1.smithi111.stdout:8/27: symlink lc 0 2023-12-08T20:27:44.269 INFO:tasks.workunit.client.1.smithi111.stdout:1/25: dwrite d0/f3 [0,4194304] 0 2023-12-08T20:27:44.270 INFO:tasks.workunit.client.1.smithi111.stdout:5/79: dread d3/f10 [0,4194304] 0 2023-12-08T20:27:44.270 INFO:tasks.workunit.client.1.smithi111.stdout:5/80: chown d3/d12 35238 1 2023-12-08T20:27:44.275 INFO:tasks.workunit.client.1.smithi111.stdout:1/26: mkdir d0/d5 0 2023-12-08T20:27:44.275 INFO:tasks.workunit.client.1.smithi111.stdout:1/27: write d0/f2 [2395354,99958] 0 2023-12-08T20:27:44.275 INFO:tasks.workunit.client.1.smithi111.stdout:5/81: mknod d3/d4/d7/d1c/c1e 0 2023-12-08T20:27:44.276 INFO:tasks.workunit.client.1.smithi111.stdout:4/29: dwrite f0 [0,4194304] 0 2023-12-08T20:27:44.278 INFO:tasks.workunit.client.1.smithi111.stdout:1/28: rename d0/d5 to d0/d6 0 2023-12-08T20:27:44.279 INFO:tasks.workunit.client.1.smithi111.stdout:8/28: dwrite f0 [0,4194304] 0 2023-12-08T20:27:44.280 INFO:tasks.workunit.client.1.smithi111.stdout:5/82: getdents d3/d4/d7 0 2023-12-08T20:27:44.280 INFO:tasks.workunit.client.1.smithi111.stdout:5/83: dread - d3/d4/d7/f16 zero size 2023-12-08T20:27:44.280 INFO:tasks.workunit.client.1.smithi111.stdout:4/30: write f0 [1126699,81389] 0 2023-12-08T20:27:44.281 INFO:tasks.workunit.client.1.smithi111.stdout:3/39: dwrite d2/f9 [0,4194304] 0 2023-12-08T20:27:44.282 INFO:tasks.workunit.client.1.smithi111.stdout:8/29: mkdir dd 0 2023-12-08T20:27:44.282 INFO:tasks.workunit.client.1.smithi111.stdout:8/30: chown f0 29773167 1 2023-12-08T20:27:44.282 INFO:tasks.workunit.client.1.smithi111.stdout:8/31: write fa [20127,128668] 0 2023-12-08T20:27:44.282 INFO:tasks.workunit.client.1.smithi111.stdout:4/31: read f0 [4014102,67150] 0 2023-12-08T20:27:44.283 INFO:tasks.workunit.client.1.smithi111.stdout:5/84: link d3/d4/lf d3/d4/l1f 0 2023-12-08T20:27:44.283 INFO:tasks.workunit.client.1.smithi111.stdout:5/85: fsync d3/d12/f19 0 2023-12-08T20:27:44.283 INFO:tasks.workunit.client.1.smithi111.stdout:5/86: dread - d3/d12/f1b zero size 2023-12-08T20:27:44.283 INFO:tasks.workunit.client.1.smithi111.stdout:5/87: truncate d3/f14 28272 0 2023-12-08T20:27:44.283 INFO:tasks.workunit.client.1.smithi111.stdout:5/88: write d3/d4/f8 [4624561,96387] 0 2023-12-08T20:27:44.284 INFO:tasks.workunit.client.1.smithi111.stdout:1/29: dread d0/f1 [0,4194304] 0 2023-12-08T20:27:44.288 INFO:tasks.workunit.client.1.smithi111.stdout:4/32: mkdir d8/da 0 2023-12-08T20:27:44.288 INFO:tasks.workunit.client.1.smithi111.stdout:4/33: write f1 [4604251,28223] 0 2023-12-08T20:27:44.289 INFO:tasks.workunit.client.1.smithi111.stdout:4/34: dread - f6 zero size 2023-12-08T20:27:44.290 INFO:tasks.workunit.client.1.smithi111.stdout:1/30: dread d0/f2 [0,4194304] 0 2023-12-08T20:27:44.290 INFO:tasks.workunit.client.1.smithi111.stdout:5/89: rename d3/ce to d3/d4/d7/d1c/c20 0 2023-12-08T20:27:44.290 INFO:tasks.workunit.client.1.smithi111.stdout:5/90: truncate d3/d12/f19 491849 0 2023-12-08T20:27:44.294 INFO:tasks.workunit.client.1.smithi111.stdout:4/35: mkdir d8/da/db 0 2023-12-08T20:27:44.294 INFO:tasks.workunit.client.1.smithi111.stdout:4/36: fsync f7 0 2023-12-08T20:27:44.296 INFO:tasks.workunit.client.1.smithi111.stdout:1/31: truncate d0/f3 4005051 0 2023-12-08T20:27:44.298 INFO:tasks.workunit.client.1.smithi111.stdout:8/32: dwrite f0 [4194304,4194304] 0 2023-12-08T20:27:44.300 INFO:tasks.workunit.client.1.smithi111.stdout:4/37: creat d8/da/db/fc x:0 0 0 2023-12-08T20:27:44.300 INFO:tasks.workunit.client.1.smithi111.stdout:4/38: truncate f7 1582 0 2023-12-08T20:27:44.300 INFO:tasks.workunit.client.1.smithi111.stdout:3/40: dread d2/f8 [0,4194304] 0 2023-12-08T20:27:44.304 INFO:tasks.workunit.client.1.smithi111.stdout:8/33: creat dd/fe x:0 0 0 2023-12-08T20:27:44.304 INFO:tasks.workunit.client.1.smithi111.stdout:8/34: truncate f2 1484608 0 2023-12-08T20:27:44.305 INFO:tasks.workunit.client.1.smithi111.stdout:4/39: mkdir d8/da/dd 0 2023-12-08T20:27:44.306 INFO:tasks.workunit.client.1.smithi111.stdout:3/41: rename d2/f8 to d2/d3/fb 0 2023-12-08T20:27:44.306 INFO:tasks.workunit.client.1.smithi111.stdout:8/35: dread f2 [0,4194304] 0 2023-12-08T20:27:44.309 INFO:tasks.workunit.client.1.smithi111.stdout:5/91: dwrite d3/d4/d7/f13 [0,4194304] 0 2023-12-08T20:27:44.312 INFO:tasks.workunit.client.1.smithi111.stdout:4/40: rename f7 to d8/da/dd/fe 0 2023-12-08T20:27:44.312 INFO:tasks.workunit.client.1.smithi111.stdout:4/41: rename d8/da/db to d8/da/db/df 22 2023-12-08T20:27:44.314 INFO:tasks.workunit.client.1.smithi111.stdout:3/42: symlink d2/lc 0 2023-12-08T20:27:44.316 INFO:tasks.workunit.client.1.smithi111.stdout:8/36: creat dd/ff x:0 0 0 2023-12-08T20:27:44.316 INFO:tasks.workunit.client.1.smithi111.stdout:5/92: mkdir d3/d4/d7/d1c/d21 0 2023-12-08T20:27:44.316 INFO:tasks.workunit.client.1.smithi111.stdout:8/37: chown dd 741 1 2023-12-08T20:27:44.316 INFO:tasks.workunit.client.1.smithi111.stdout:8/38: write fa [137618,41727] 0 2023-12-08T20:27:44.316 INFO:tasks.workunit.client.1.smithi111.stdout:4/42: mknod d8/da/c10 0 2023-12-08T20:27:44.317 INFO:tasks.workunit.client.1.smithi111.stdout:3/43: dread f1 [0,4194304] 0 2023-12-08T20:27:44.318 INFO:tasks.workunit.client.1.smithi111.stdout:8/39: dread f2 [0,4194304] 0 2023-12-08T20:27:44.318 INFO:tasks.workunit.client.1.smithi111.stdout:8/40: write dd/ff [76333,88676] 0 2023-12-08T20:27:44.320 INFO:tasks.workunit.client.1.smithi111.stdout:3/44: link d2/d3/fb d2/d3/d6/fd 0 2023-12-08T20:27:44.320 INFO:tasks.workunit.client.1.smithi111.stdout:3/45: stat d2/lc 0 2023-12-08T20:27:44.321 INFO:tasks.workunit.client.1.smithi111.stdout:8/41: rename c4 to dd/c10 0 2023-12-08T20:27:44.323 INFO:tasks.workunit.client.1.smithi111.stdout:3/46: rename d2/d3/d6/f7 to d2/d3/d6/fe 0 2023-12-08T20:27:44.323 INFO:tasks.workunit.client.1.smithi111.stdout:5/93: dread d3/d4/f8 [0,4194304] 0 2023-12-08T20:27:44.324 INFO:tasks.workunit.client.1.smithi111.stdout:5/94: read d3/f14 [10751,95605] 0 2023-12-08T20:27:44.324 INFO:tasks.workunit.client.1.smithi111.stdout:5/95: chown d3/d4/d7/d1c/c1e 91 1 2023-12-08T20:27:44.327 INFO:tasks.workunit.client.1.smithi111.stdout:5/96: mknod d3/d4/d7/d1c/c22 0 2023-12-08T20:27:44.327 INFO:tasks.workunit.client.1.smithi111.stdout:3/47: dread f1 [0,4194304] 0 2023-12-08T20:27:44.327 INFO:tasks.workunit.client.1.smithi111.stdout:3/48: write d2/d3/d6/fe [2302,12388] 0 2023-12-08T20:27:44.328 INFO:tasks.workunit.client.1.smithi111.stdout:5/97: mknod d3/d4/d7/d1c/c23 0 2023-12-08T20:27:44.328 INFO:tasks.workunit.client.1.smithi111.stdout:8/42: dread dd/ff [0,4194304] 0 2023-12-08T20:27:44.328 INFO:tasks.workunit.client.1.smithi111.stdout:8/43: chown lc 4 1 2023-12-08T20:27:44.328 INFO:tasks.workunit.client.1.smithi111.stdout:4/43: getdents d8/da 0 2023-12-08T20:27:44.329 INFO:tasks.workunit.client.1.smithi111.stdout:5/98: dread d3/d12/f19 [0,4194304] 0 2023-12-08T20:27:44.329 INFO:tasks.workunit.client.1.smithi111.stdout:5/99: fsync d3/d4/f1d 0 2023-12-08T20:27:44.329 INFO:tasks.workunit.client.1.smithi111.stdout:5/100: rename d3/d4/d7 to d3/d4/d7/d1c/d21/d24 22 2023-12-08T20:27:44.329 INFO:tasks.workunit.client.1.smithi111.stdout:5/101: chown d3/d4/l1a 48 1 2023-12-08T20:27:44.329 INFO:tasks.workunit.client.1.smithi111.stdout:3/49: creat d2/ff x:0 0 0 2023-12-08T20:27:44.331 INFO:tasks.workunit.client.1.smithi111.stdout:8/44: creat dd/f11 x:0 0 0 2023-12-08T20:27:44.333 INFO:tasks.workunit.client.1.smithi111.stdout:5/102: creat d3/d4/d7/f25 x:0 0 0 2023-12-08T20:27:44.333 INFO:tasks.workunit.client.1.smithi111.stdout:5/103: truncate d3/d12/f19 602994 0 2023-12-08T20:27:44.335 INFO:tasks.workunit.client.1.smithi111.stdout:5/104: symlink d3/d4/d7/d1c/l26 0 2023-12-08T20:27:44.336 INFO:tasks.workunit.client.1.smithi111.stdout:4/44: dread f1 [0,4194304] 0 2023-12-08T20:27:44.337 INFO:tasks.workunit.client.1.smithi111.stdout:4/45: dread - f6 zero size 2023-12-08T20:27:44.337 INFO:tasks.workunit.client.1.smithi111.stdout:5/105: link d3/d4/l1f d3/d4/l27 0 2023-12-08T20:27:44.337 INFO:tasks.workunit.client.1.smithi111.stdout:5/106: stat d3/d4/f5 0 2023-12-08T20:27:44.337 INFO:tasks.workunit.client.1.smithi111.stdout:5/107: chown d3/d4/l1f 5002 1 2023-12-08T20:27:44.338 INFO:tasks.workunit.client.1.smithi111.stdout:5/108: fdatasync d3/d12/f1b 0 2023-12-08T20:27:44.338 INFO:tasks.workunit.client.1.smithi111.stdout:4/46: rmdir d8/da/dd 39 2023-12-08T20:27:44.339 INFO:tasks.workunit.client.1.smithi111.stdout:4/47: mknod d8/c11 0 2023-12-08T20:27:44.341 INFO:tasks.workunit.client.1.smithi111.stdout:4/48: creat d8/f12 x:0 0 0 2023-12-08T20:27:44.341 INFO:tasks.workunit.client.1.smithi111.stdout:4/49: dread - f6 zero size 2023-12-08T20:27:44.355 INFO:tasks.workunit.client.1.smithi111.stdout:8/45: dwrite f2 [0,4194304] 0 2023-12-08T20:27:44.357 INFO:tasks.workunit.client.1.smithi111.stdout:8/46: creat dd/f12 x:0 0 0 2023-12-08T20:27:44.357 INFO:tasks.workunit.client.1.smithi111.stdout:8/47: read dd/ff [55043,68598] 0 2023-12-08T20:27:44.359 INFO:tasks.workunit.client.1.smithi111.stdout:5/109: dwrite d3/d4/d7/f25 [0,4194304] 0 2023-12-08T20:27:44.360 INFO:tasks.workunit.client.1.smithi111.stdout:8/48: rename dd/fe to dd/f13 0 2023-12-08T20:27:44.360 INFO:tasks.workunit.client.1.smithi111.stdout:8/49: chown dd/f13 10223 1 2023-12-08T20:27:44.360 INFO:tasks.workunit.client.1.smithi111.stdout:8/50: write fa [329586,80836] 0 2023-12-08T20:27:44.360 INFO:tasks.workunit.client.1.smithi111.stdout:8/51: readlink lc 0 2023-12-08T20:27:44.360 INFO:tasks.workunit.client.1.smithi111.stdout:8/52: write dd/ff [1185504,38136] 0 2023-12-08T20:27:44.360 INFO:tasks.workunit.client.1.smithi111.stdout:8/53: fsync f0 0 2023-12-08T20:27:44.366 INFO:tasks.workunit.client.1.smithi111.stdout:8/54: unlink c8 0 2023-12-08T20:27:44.366 INFO:tasks.workunit.client.1.smithi111.stdout:8/55: readlink l6 0 2023-12-08T20:27:44.366 INFO:tasks.workunit.client.1.smithi111.stdout:8/56: fsync f0 0 2023-12-08T20:27:44.366 INFO:tasks.workunit.client.1.smithi111.stdout:5/110: dread d3/d4/f5 [0,4194304] 0 2023-12-08T20:27:44.366 INFO:tasks.workunit.client.1.smithi111.stdout:8/57: readlink l9 0 2023-12-08T20:27:44.366 INFO:tasks.workunit.client.1.smithi111.stdout:5/111: dread - d3/d12/f17 zero size 2023-12-08T20:27:44.366 INFO:tasks.workunit.client.1.smithi111.stdout:5/112: write d3/d4/f8 [110779,58107] 0 2023-12-08T20:27:44.367 INFO:tasks.workunit.client.1.smithi111.stdout:5/113: chown d3/d4/lf 178 1 2023-12-08T20:27:44.369 INFO:tasks.workunit.client.1.smithi111.stdout:5/114: symlink d3/d4/l28 0 2023-12-08T20:27:44.371 INFO:tasks.workunit.client.1.smithi111.stdout:5/115: mkdir d3/d4/d7/d29 0 2023-12-08T20:27:44.371 INFO:tasks.workunit.client.1.smithi111.stdout:5/116: fdatasync d3/d12/f1b 0 2023-12-08T20:27:44.371 INFO:tasks.workunit.client.1.smithi111.stdout:5/117: truncate d3/d4/f1d 312047 0 2023-12-08T20:27:44.380 INFO:tasks.workunit.client.1.smithi111.stdout:8/58: dwrite dd/f13 [0,4194304] 0 2023-12-08T20:27:44.386 INFO:tasks.workunit.client.1.smithi111.stdout:5/118: dwrite d3/d12/f1b [0,4194304] 0 2023-12-08T20:27:44.387 INFO:tasks.workunit.client.1.smithi111.stdout:5/119: write d3/d4/f8 [2973177,55895] 0 2023-12-08T20:27:44.391 INFO:tasks.workunit.client.1.smithi111.stdout:5/120: mkdir d3/d2a 0 2023-12-08T20:27:44.393 INFO:tasks.workunit.client.1.smithi111.stdout:5/121: rename d3/d4/d7/d1c/c20 to d3/d4/c2b 0 2023-12-08T20:27:44.393 INFO:tasks.workunit.client.1.smithi111.stdout:5/122: fdatasync d3/f10 0 2023-12-08T20:27:44.395 INFO:tasks.workunit.client.1.smithi111.stdout:5/123: mkdir d3/d4/d7/d2c 0 2023-12-08T20:27:44.399 INFO:tasks.workunit.client.1.smithi111.stdout:8/59: dwrite dd/ff [0,4194304] 0 2023-12-08T20:27:44.400 INFO:tasks.workunit.client.1.smithi111.stdout:8/60: read - dd/f12 zero size 2023-12-08T20:27:44.401 INFO:tasks.workunit.client.1.smithi111.stdout:5/124: getdents d3 0 2023-12-08T20:27:44.403 INFO:tasks.workunit.client.1.smithi111.stdout:8/61: rename f0 to dd/f14 0 2023-12-08T20:27:44.405 INFO:tasks.workunit.client.1.smithi111.stdout:5/125: rename d3/d4/d7/la to d3/d4/d7/d1c/l2d 0 2023-12-08T20:27:44.405 INFO:tasks.workunit.client.1.smithi111.stdout:5/126: dread - d3/d4/d7/f16 zero size 2023-12-08T20:27:44.406 INFO:tasks.workunit.client.1.smithi111.stdout:8/62: creat dd/f15 x:0 0 0 2023-12-08T20:27:44.422 INFO:tasks.workunit.client.1.smithi111.stdout:8/63: dwrite dd/ff [0,4194304] 0 2023-12-08T20:27:44.422 INFO:tasks.workunit.client.1.smithi111.stdout:8/64: stat lc 0 2023-12-08T20:27:44.422 INFO:tasks.workunit.client.1.smithi111.stdout:5/127: dwrite d3/f14 [0,4194304] 0 2023-12-08T20:27:44.432 INFO:tasks.workunit.client.1.smithi111.stdout:8/65: dread dd/f14 [0,4194304] 0 2023-12-08T20:27:44.432 INFO:tasks.workunit.client.1.smithi111.stdout:8/66: symlink dd/l16 0 2023-12-08T20:27:44.477 INFO:tasks.workunit.client.1.smithi111.stdout:5/128: dwrite d3/d4/f1d [0,4194304] 0 2023-12-08T20:27:44.478 INFO:tasks.workunit.client.1.smithi111.stdout:8/67: dwrite dd/ff [0,4194304] 0 2023-12-08T20:27:44.478 INFO:tasks.workunit.client.1.smithi111.stdout:5/129: read d3/f10 [1521435,130459] 0 2023-12-08T20:27:44.479 INFO:tasks.workunit.client.1.smithi111.stdout:5/130: write d3/f10 [1760438,50400] 0 2023-12-08T20:27:44.479 INFO:tasks.workunit.client.1.smithi111.stdout:8/68: link dd/f12 dd/f17 0 2023-12-08T20:27:44.481 INFO:tasks.workunit.client.1.smithi111.stdout:8/69: fsync fa 0 2023-12-08T20:27:44.485 INFO:tasks.workunit.client.1.smithi111.stdout:8/70: rmdir dd 39 2023-12-08T20:27:44.486 INFO:tasks.workunit.client.1.smithi111.stdout:8/71: readlink l6 0 2023-12-08T20:27:44.486 INFO:tasks.workunit.client.1.smithi111.stdout:8/72: write dd/f15 [388063,30913] 0 2023-12-08T20:27:44.486 INFO:tasks.workunit.client.1.smithi111.stdout:8/73: read f2 [624335,52888] 0 2023-12-08T20:27:44.486 INFO:tasks.workunit.client.1.smithi111.stdout:8/74: write dd/f17 [452814,45014] 0 2023-12-08T20:27:44.486 INFO:tasks.workunit.client.1.smithi111.stdout:5/131: truncate d3/d12/f1b 3449705 0 2023-12-08T20:27:44.487 INFO:tasks.workunit.client.1.smithi111.stdout:5/132: fdatasync d3/f14 0 2023-12-08T20:27:44.487 INFO:tasks.workunit.client.1.smithi111.stdout:8/75: symlink dd/l18 0 2023-12-08T20:27:44.490 INFO:tasks.workunit.client.1.smithi111.stdout:5/133: rename d3/d4/d7/d1c/l2d to d3/d12/l2e 0 2023-12-08T20:27:44.496 INFO:tasks.workunit.client.1.smithi111.stdout:5/134: rename d3/d12/l2e to d3/d12/l2f 0 2023-12-08T20:27:44.497 INFO:tasks.workunit.client.1.smithi111.stdout:5/135: mkdir d3/d4/d7/d29/d30 0 2023-12-08T20:27:44.500 INFO:tasks.workunit.client.1.smithi111.stdout:8/76: dwrite fa [0,4194304] 0 2023-12-08T20:27:44.504 INFO:tasks.workunit.client.1.smithi111.stdout:5/136: getdents d3/d12 0 2023-12-08T20:27:44.506 INFO:tasks.workunit.client.1.smithi111.stdout:5/137: creat d3/d4/d7/d2c/f31 x:0 0 0 2023-12-08T20:27:44.508 INFO:tasks.workunit.client.1.smithi111.stdout:5/138: truncate d3/d4/f1d 2863097 0 2023-12-08T20:27:44.509 INFO:tasks.workunit.client.1.smithi111.stdout:5/139: rmdir d3/d2a 0 2023-12-08T20:27:44.547 INFO:tasks.workunit.client.1.smithi111.stdout:8/77: dwrite dd/f17 [0,4194304] 0 2023-12-08T20:27:44.550 INFO:tasks.workunit.client.1.smithi111.stdout:8/78: creat dd/f19 x:0 0 0 2023-12-08T20:27:44.550 INFO:tasks.workunit.client.1.smithi111.stdout:8/79: chown l6 10916305 1 2023-12-08T20:27:44.550 INFO:tasks.workunit.client.1.smithi111.stdout:8/80: chown dd/f12 1 1 2023-12-08T20:27:44.551 INFO:tasks.workunit.client.1.smithi111.stdout:8/81: mknod dd/c1a 0 2023-12-08T20:27:44.552 INFO:tasks.workunit.client.1.smithi111.stdout:8/82: write dd/f12 [618808,111663] 0 2023-12-08T20:27:44.552 INFO:tasks.workunit.client.1.smithi111.stdout:8/83: stat dd/f11 0 2023-12-08T20:27:44.556 INFO:tasks.workunit.client.1.smithi111.stdout:8/84: rmdir dd 39 2023-12-08T20:27:44.557 INFO:tasks.workunit.client.1.smithi111.stdout:8/85: symlink dd/l1b 0 2023-12-08T20:27:44.573 INFO:tasks.workunit.client.1.smithi111.stdout:8/86: dwrite dd/f15 [0,4194304] 0 2023-12-08T20:27:44.576 INFO:tasks.workunit.client.1.smithi111.stdout:8/87: dread dd/f14 [0,4194304] 0 2023-12-08T20:27:44.576 INFO:tasks.workunit.client.1.smithi111.stdout:8/88: fsync dd/f15 0 2023-12-08T20:27:44.577 INFO:tasks.workunit.client.1.smithi111.stdout:8/89: link dd/c1a dd/c1c 0 2023-12-08T20:27:44.582 INFO:tasks.workunit.client.1.smithi111.stdout:8/90: mknod dd/c1d 0 2023-12-08T20:27:44.582 INFO:tasks.workunit.client.1.smithi111.stdout:8/91: fdatasync f2 0 2023-12-08T20:27:44.582 INFO:tasks.workunit.client.1.smithi111.stdout:8/92: mknod dd/c1e 0 2023-12-08T20:27:44.583 INFO:tasks.workunit.client.1.smithi111.stdout:8/93: creat dd/f1f x:0 0 0 2023-12-08T20:27:44.583 INFO:tasks.workunit.client.1.smithi111.stdout:8/94: chown dd/f11 4 1 2023-12-08T20:27:44.583 INFO:tasks.workunit.client.1.smithi111.stdout:8/95: read - f5 zero size 2023-12-08T20:27:44.596 INFO:tasks.workunit.client.1.smithi111.stdout:8/96: dwrite f5 [0,4194304] 0 2023-12-08T20:27:44.599 INFO:tasks.workunit.client.1.smithi111.stdout:8/97: rename dd/f13 to dd/f20 0 2023-12-08T20:27:44.600 INFO:tasks.workunit.client.1.smithi111.stdout:8/98: write f2 [2430631,8126] 0 2023-12-08T20:27:44.600 INFO:tasks.workunit.client.1.smithi111.stdout:8/99: chown dd/l1b 48827470 1 2023-12-08T20:27:44.600 INFO:tasks.workunit.client.1.smithi111.stdout:8/100: fsync f5 0 2023-12-08T20:27:44.601 INFO:tasks.workunit.client.1.smithi111.stdout:8/101: rename dd/l1b to dd/l21 0 2023-12-08T20:27:44.616 INFO:tasks.workunit.client.1.smithi111.stdout:8/102: dwrite dd/f1f [0,4194304] 0 2023-12-08T20:27:44.619 INFO:tasks.workunit.client.1.smithi111.stdout:8/103: rename c1 to dd/c22 0 2023-12-08T20:27:44.619 INFO:tasks.workunit.client.1.smithi111.stdout:8/104: chown dd/f14 0 1 2023-12-08T20:27:44.622 INFO:tasks.workunit.client.1.smithi111.stdout:8/105: getdents dd 0 2023-12-08T20:27:44.623 INFO:tasks.workunit.client.1.smithi111.stdout:8/106: creat dd/f23 x:0 0 0 2023-12-08T20:27:44.645 INFO:tasks.workunit.client.1.smithi111.stdout:8/107: dwrite fa [4194304,4194304] 0 2023-12-08T20:27:44.649 INFO:tasks.workunit.client.1.smithi111.stdout:8/108: link dd/c1c dd/c24 0 2023-12-08T20:27:44.651 INFO:tasks.workunit.client.1.smithi111.stdout:8/109: unlink dd/l16 0 2023-12-08T20:27:44.651 INFO:tasks.workunit.client.1.smithi111.stdout:8/110: fsync dd/f15 0 2023-12-08T20:27:44.652 INFO:tasks.workunit.client.1.smithi111.stdout:8/111: write dd/f19 [617387,7356] 0 2023-12-08T20:27:44.655 INFO:tasks.workunit.client.1.smithi111.stdout:8/112: unlink dd/c24 0 2023-12-08T20:27:44.657 INFO:tasks.workunit.client.1.smithi111.stdout:8/113: link dd/f12 dd/f25 0 2023-12-08T20:27:44.672 INFO:tasks.workunit.client.1.smithi111.stdout:8/114: dwrite dd/f20 [0,4194304] 0 2023-12-08T20:27:44.673 INFO:tasks.workunit.client.1.smithi111.stdout:8/115: mknod dd/c26 0 2023-12-08T20:27:44.675 INFO:tasks.workunit.client.1.smithi111.stdout:8/116: link l6 dd/l27 0 2023-12-08T20:27:44.689 INFO:tasks.workunit.client.1.smithi111.stdout:8/117: dread dd/f17 [0,4194304] 0 2023-12-08T20:27:44.699 INFO:tasks.workunit.client.1.smithi111.stdout:8/118: dread dd/f15 [0,4194304] 0 2023-12-08T20:27:44.701 INFO:tasks.workunit.client.1.smithi111.stdout:8/119: rename dd/f11 to dd/f28 0 2023-12-08T20:27:44.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:44 smithi111 ceph-mon[121341]: pgmap v13: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 7.8 MiB/s wr, 792 op/s 2023-12-08T20:27:44.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:44 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:44.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:44 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:44.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:44 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:44.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:44 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:44.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:44 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:44.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:44 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:44.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:44 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:44.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:44 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:44.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:44 smithi111 ceph-mon[121341]: Adjusting osd_memory_target on smithi111 to 2592M 2023-12-08T20:27:44.973 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:44 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:44.973 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:44 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:27:44.973 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:44 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:27:44.973 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:44 smithi111 ceph-mon[121341]: Updating smithi043:/etc/ceph/ceph.conf 2023-12-08T20:27:44.973 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:44 smithi111 ceph-mon[121341]: Updating smithi111:/etc/ceph/ceph.conf 2023-12-08T20:27:45.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:44 smithi043 ceph-mon[111966]: pgmap v13: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 7.8 MiB/s wr, 792 op/s 2023-12-08T20:27:45.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:44 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:45.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:44 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:45.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:44 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:45.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:44 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:45.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:44 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:45.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:44 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:45.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:44 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:45.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:44 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-08T20:27:45.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:44 smithi043 ceph-mon[111966]: Adjusting osd_memory_target on smithi111 to 2592M 2023-12-08T20:27:45.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:44 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:45.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:44 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:27:45.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:44 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:27:45.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:44 smithi043 ceph-mon[111966]: Updating smithi043:/etc/ceph/ceph.conf 2023-12-08T20:27:45.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:44 smithi043 ceph-mon[111966]: Updating smithi111:/etc/ceph/ceph.conf 2023-12-08T20:27:45.683 INFO:tasks.workunit.client.1.smithi111.stdout:0/24: sync 2023-12-08T20:27:45.684 INFO:tasks.workunit.client.1.smithi111.stdout:0/25: write d1/d4/f6 [1771054,116353] 0 2023-12-08T20:27:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:45 smithi111 ceph-mon[121341]: Updating smithi111:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:27:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:45 smithi111 ceph-mon[121341]: Updating smithi043:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:27:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:45 smithi111 ceph-mon[121341]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2023-12-08T20:27:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:45 smithi111 ceph-mon[121341]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2023-12-08T20:27:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:45 smithi111 ceph-mon[121341]: Updating smithi111:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-08T20:27:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:45 smithi111 ceph-mon[121341]: Updating smithi043:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-08T20:27:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:45 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:45 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:45 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:45 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:45 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:45.992 INFO:tasks.workunit.client.1.smithi111.stdout:0/26: dread d1/d4/f6 [0,4194304] 0 2023-12-08T20:27:45.993 INFO:tasks.workunit.client.1.smithi111.stdout:0/27: link d1/c2 d1/c8 0 2023-12-08T20:27:46.004 INFO:tasks.workunit.client.1.smithi111.stdout:0/28: write d1/d4/f6 [1432376,33545] 0 2023-12-08T20:27:46.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:45 smithi043 ceph-mon[111966]: Updating smithi111:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:27:46.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:45 smithi043 ceph-mon[111966]: Updating smithi043:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:27:46.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:45 smithi043 ceph-mon[111966]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2023-12-08T20:27:46.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:45 smithi043 ceph-mon[111966]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2023-12-08T20:27:46.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:45 smithi043 ceph-mon[111966]: Updating smithi111:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-08T20:27:46.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:45 smithi043 ceph-mon[111966]: Updating smithi043:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-08T20:27:46.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:45 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:46.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:45 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:46.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:45 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:46.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:45 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:46.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:45 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:46.046 INFO:tasks.workunit.client.1.smithi111.stdout:0/29: dread d1/d4/f6 [0,4194304] 0 2023-12-08T20:27:46.048 INFO:tasks.workunit.client.1.smithi111.stdout:0/30: getdents d1/d4 0 2023-12-08T20:27:46.050 INFO:tasks.workunit.client.1.smithi111.stdout:0/31: mknod d1/d4/c9 0 2023-12-08T20:27:46.097 INFO:tasks.workunit.client.1.smithi111.stdout:0/32: dwrite d1/d4/f6 [0,4194304] 0 2023-12-08T20:27:46.098 INFO:tasks.workunit.client.1.smithi111.stdout:0/33: write d1/d4/f6 [3594730,57573] 0 2023-12-08T20:27:46.098 INFO:tasks.workunit.client.1.smithi111.stdout:0/34: chown d1/d4 764365986 1 2023-12-08T20:27:46.099 INFO:tasks.workunit.client.1.smithi111.stdout:0/35: rename d1 to d1/d4/da 22 2023-12-08T20:27:46.130 INFO:tasks.workunit.client.1.smithi111.stdout:0/36: dwrite d1/d4/f6 [0,4194304] 0 2023-12-08T20:27:46.140 INFO:tasks.workunit.client.1.smithi111.stdout:0/37: dread d1/d4/f6 [0,4194304] 0 2023-12-08T20:27:46.140 INFO:tasks.workunit.client.1.smithi111.stdout:0/38: write d1/d4/f6 [425776,59232] 0 2023-12-08T20:27:46.280 INFO:tasks.workunit.client.1.smithi111.stdout:6/19: sync 2023-12-08T20:27:46.280 INFO:tasks.workunit.client.1.smithi111.stdout:9/98: sync 2023-12-08T20:27:46.280 INFO:tasks.workunit.client.1.smithi111.stdout:2/184: sync 2023-12-08T20:27:46.280 INFO:tasks.workunit.client.1.smithi111.stdout:7/60: sync 2023-12-08T20:27:46.281 INFO:tasks.workunit.client.1.smithi111.stdout:2/185: dread d1/d1d/d22/f2f [0,4194304] 0 2023-12-08T20:27:46.281 INFO:tasks.workunit.client.1.smithi111.stdout:2/186: rename d1/d1d/d1f to d1/d1d/d1f/d25/d4c 22 2023-12-08T20:27:46.282 INFO:tasks.workunit.client.1.smithi111.stdout:9/99: truncate d2/f7 1558877 0 2023-12-08T20:27:46.287 INFO:tasks.workunit.client.1.smithi111.stdout:2/187: dread f0 [0,4194304] 0 2023-12-08T20:27:46.289 INFO:tasks.workunit.client.1.smithi111.stdout:2/188: getdents d1/d1d 0 2023-12-08T20:27:46.290 INFO:tasks.workunit.client.1.smithi111.stdout:7/61: dread f6 [0,4194304] 0 2023-12-08T20:27:46.290 INFO:tasks.workunit.client.1.smithi111.stdout:7/62: chown c2 109 1 2023-12-08T20:27:46.291 INFO:tasks.workunit.client.1.smithi111.stdout:7/63: mknod da/c12 0 2023-12-08T20:27:46.294 INFO:tasks.workunit.client.1.smithi111.stdout:7/64: mkdir da/d13 0 2023-12-08T20:27:46.294 INFO:tasks.workunit.client.1.smithi111.stdout:7/65: fsync f1 0 2023-12-08T20:27:46.296 INFO:tasks.workunit.client.1.smithi111.stdout:7/66: link da/c11 da/c14 0 2023-12-08T20:27:46.312 INFO:tasks.workunit.client.1.smithi111.stdout:6/20: dwrite d0/f3 [0,4194304] 0 2023-12-08T20:27:46.313 INFO:tasks.workunit.client.1.smithi111.stdout:2/189: dwrite d1/d1d/d22/f39 [0,4194304] 0 2023-12-08T20:27:46.316 INFO:tasks.workunit.client.1.smithi111.stdout:6/21: rename d0/f3 to d0/d1/f5 0 2023-12-08T20:27:46.318 INFO:tasks.workunit.client.1.smithi111.stdout:2/190: rename d1/d1d/d1f/d25/f2b to d1/d1d/d1f/d2d/f4d 0 2023-12-08T20:27:46.318 INFO:tasks.workunit.client.1.smithi111.stdout:2/191: chown d1/d1d/d1f/l42 0 1 2023-12-08T20:27:46.319 INFO:tasks.workunit.client.1.smithi111.stdout:7/67: dwrite f1 [0,4194304] 0 2023-12-08T20:27:46.319 INFO:tasks.workunit.client.1.smithi111.stdout:6/22: creat d0/d1/f6 x:0 0 0 2023-12-08T20:27:46.322 INFO:tasks.workunit.client.1.smithi111.stdout:6/23: write d0/d1/f5 [1054885,108781] 0 2023-12-08T20:27:46.323 INFO:tasks.workunit.client.1.smithi111.stdout:6/24: creat d0/d1/f7 x:0 0 0 2023-12-08T20:27:46.323 INFO:tasks.workunit.client.1.smithi111.stdout:6/25: truncate d0/d1/f7 182449 0 2023-12-08T20:27:46.324 INFO:tasks.workunit.client.1.smithi111.stdout:6/26: write d0/d1/f6 [855721,2621] 0 2023-12-08T20:27:46.324 INFO:tasks.workunit.client.1.smithi111.stdout:6/27: chown d0/d1/f5 83368516 1 2023-12-08T20:27:46.324 INFO:tasks.workunit.client.1.smithi111.stdout:6/28: readlink d0/d1/l4 0 2023-12-08T20:27:46.326 INFO:tasks.workunit.client.1.smithi111.stdout:6/29: fdatasync d0/d1/f5 0 2023-12-08T20:27:46.328 INFO:tasks.workunit.client.1.smithi111.stdout:7/68: dread f5 [0,4194304] 0 2023-12-08T20:27:46.344 INFO:tasks.workunit.client.1.smithi111.stdout:7/69: dwrite f1 [0,4194304] 0 2023-12-08T20:27:46.345 INFO:tasks.workunit.client.1.smithi111.stdout:7/70: symlink da/d13/l15 0 2023-12-08T20:27:46.346 INFO:tasks.workunit.client.1.smithi111.stdout:7/71: mknod da/d13/c16 0 2023-12-08T20:27:46.347 INFO:tasks.workunit.client.1.smithi111.stdout:7/72: creat da/d13/f17 x:0 0 0 2023-12-08T20:27:46.348 INFO:tasks.workunit.client.1.smithi111.stdout:7/73: rename da/c11 to da/c18 0 2023-12-08T20:27:46.349 INFO:tasks.workunit.client.1.smithi111.stdout:7/74: symlink da/d13/l19 0 2023-12-08T20:27:46.350 INFO:tasks.workunit.client.1.smithi111.stdout:7/75: dread - da/d13/f17 zero size 2023-12-08T20:27:46.350 INFO:tasks.workunit.client.1.smithi111.stdout:7/76: write f5 [2487969,21035] 0 2023-12-08T20:27:46.351 INFO:tasks.workunit.client.1.smithi111.stdout:7/77: creat da/d13/f1a x:0 0 0 2023-12-08T20:27:46.353 INFO:tasks.workunit.client.1.smithi111.stdout:7/78: creat da/f1b x:0 0 0 2023-12-08T20:27:46.354 INFO:tasks.workunit.client.1.smithi111.stdout:7/79: symlink da/l1c 0 2023-12-08T20:27:46.359 INFO:tasks.workunit.client.1.smithi111.stdout:7/80: fsync da/d13/f17 0 2023-12-08T20:27:46.359 INFO:tasks.workunit.client.1.smithi111.stdout:7/81: dread - da/f1b zero size 2023-12-08T20:27:46.360 INFO:tasks.workunit.client.1.smithi111.stdout:7/82: fsync da/d13/f1a 0 2023-12-08T20:27:46.361 INFO:tasks.workunit.client.1.smithi111.stdout:7/83: symlink da/l1d 0 2023-12-08T20:27:46.362 INFO:tasks.workunit.client.1.smithi111.stdout:7/84: read f1 [4718249,67867] 0 2023-12-08T20:27:46.363 INFO:tasks.workunit.client.1.smithi111.stdout:7/85: creat da/f1e x:0 0 0 2023-12-08T20:27:46.363 INFO:tasks.workunit.client.1.smithi111.stdout:7/86: rename da to da/d13/d1f 22 2023-12-08T20:27:46.363 INFO:tasks.workunit.client.1.smithi111.stdout:7/87: readlink da/l10 0 2023-12-08T20:27:46.508 INFO:tasks.workunit.client.1.smithi111.stdout:5/140: sync 2023-12-08T20:27:46.508 INFO:tasks.workunit.client.1.smithi111.stdout:4/50: sync 2023-12-08T20:27:46.509 INFO:tasks.workunit.client.1.smithi111.stdout:3/50: sync 2023-12-08T20:27:46.509 INFO:tasks.workunit.client.1.smithi111.stdout:8/120: sync 2023-12-08T20:27:46.509 INFO:tasks.workunit.client.1.smithi111.stdout:1/32: sync 2023-12-08T20:27:46.509 INFO:tasks.workunit.client.1.smithi111.stdout:5/141: readlink d3/d12/l2f 0 2023-12-08T20:27:46.509 INFO:tasks.workunit.client.1.smithi111.stdout:4/51: chown l4 78406 1 2023-12-08T20:27:46.509 INFO:tasks.workunit.client.1.smithi111.stdout:1/33: readlink - no filename 2023-12-08T20:27:46.509 INFO:tasks.workunit.client.1.smithi111.stdout:5/142: readlink d3/d4/l1f 0 2023-12-08T20:27:46.509 INFO:tasks.workunit.client.1.smithi111.stdout:4/52: write f0 [1825708,5928] 0 2023-12-08T20:27:46.510 INFO:tasks.workunit.client.1.smithi111.stdout:4/53: chown d8/l9 36 1 2023-12-08T20:27:46.510 INFO:tasks.workunit.client.1.smithi111.stdout:4/54: write f6 [149846,6753] 0 2023-12-08T20:27:46.510 INFO:tasks.workunit.client.1.smithi111.stdout:8/121: rmdir dd 39 2023-12-08T20:27:46.514 INFO:tasks.workunit.client.1.smithi111.stdout:5/143: link d3/f14 d3/d4/d7/d1c/f32 0 2023-12-08T20:27:46.516 INFO:tasks.workunit.client.1.smithi111.stdout:3/51: creat d2/d3/d6/f10 x:0 0 0 2023-12-08T20:27:46.517 INFO:tasks.workunit.client.1.smithi111.stdout:1/34: symlink d0/l7 0 2023-12-08T20:27:46.518 INFO:tasks.workunit.client.1.smithi111.stdout:8/122: rmdir dd 39 2023-12-08T20:27:46.518 INFO:tasks.workunit.client.1.smithi111.stdout:8/123: readlink l6 0 2023-12-08T20:27:46.519 INFO:tasks.workunit.client.1.smithi111.stdout:1/35: write d0/f3 [847358,52396] 0 2023-12-08T20:27:46.520 INFO:tasks.workunit.client.1.smithi111.stdout:8/124: creat dd/f29 x:0 0 0 2023-12-08T20:27:46.521 INFO:tasks.workunit.client.1.smithi111.stdout:1/36: creat d0/d4/f8 x:0 0 0 2023-12-08T20:27:46.524 INFO:tasks.workunit.client.1.smithi111.stdout:1/37: mknod d0/c9 0 2023-12-08T20:27:46.524 INFO:tasks.workunit.client.1.smithi111.stdout:3/52: fsync d2/d3/d6/f10 0 2023-12-08T20:27:46.527 INFO:tasks.workunit.client.1.smithi111.stdout:1/38: rename d0/f3 to d0/d4/fa 0 2023-12-08T20:27:46.530 INFO:tasks.workunit.client.1.smithi111.stdout:3/53: dread d2/d3/d6/fe [0,4194304] 0 2023-12-08T20:27:46.530 INFO:tasks.workunit.client.1.smithi111.stdout:4/55: dwrite d8/da/dd/fe [0,4194304] 0 2023-12-08T20:27:46.531 INFO:tasks.workunit.client.1.smithi111.stdout:3/54: write d2/fa [5493,125037] 0 2023-12-08T20:27:46.531 INFO:tasks.workunit.client.1.smithi111.stdout:3/55: fsync d2/ff 0 2023-12-08T20:27:46.531 INFO:tasks.workunit.client.1.smithi111.stdout:3/56: dread - d2/d3/d6/f10 zero size 2023-12-08T20:27:46.531 INFO:tasks.workunit.client.1.smithi111.stdout:1/39: dread d0/f1 [0,4194304] 0 2023-12-08T20:27:46.531 INFO:tasks.workunit.client.1.smithi111.stdout:1/40: fdatasync d0/f1 0 2023-12-08T20:27:46.535 INFO:tasks.workunit.client.1.smithi111.stdout:3/57: dread f1 [0,4194304] 0 2023-12-08T20:27:46.538 INFO:tasks.workunit.client.1.smithi111.stdout:5/144: dwrite d3/d12/f19 [0,4194304] 0 2023-12-08T20:27:46.538 INFO:tasks.workunit.client.1.smithi111.stdout:5/145: chown l1 14636 1 2023-12-08T20:27:46.538 INFO:tasks.workunit.client.1.smithi111.stdout:5/146: fdatasync d3/d4/f8 0 2023-12-08T20:27:46.538 INFO:tasks.workunit.client.1.smithi111.stdout:8/125: dwrite dd/ff [0,4194304] 0 2023-12-08T20:27:46.540 INFO:tasks.workunit.client.1.smithi111.stdout:3/58: getdents d2/d3/d6 0 2023-12-08T20:27:46.541 INFO:tasks.workunit.client.1.smithi111.stdout:3/59: dread d2/d3/d6/fe [0,4194304] 0 2023-12-08T20:27:46.541 INFO:tasks.workunit.client.1.smithi111.stdout:3/60: write d2/d3/d6/fe [70405,1469] 0 2023-12-08T20:27:46.543 INFO:tasks.workunit.client.1.smithi111.stdout:5/147: creat d3/d12/f33 x:0 0 0 2023-12-08T20:27:46.543 INFO:tasks.workunit.client.1.smithi111.stdout:5/148: readlink l1 0 2023-12-08T20:27:46.543 INFO:tasks.workunit.client.1.smithi111.stdout:5/149: getdents d3/d4/d7/d1c/d21 0 2023-12-08T20:27:46.544 INFO:tasks.workunit.client.1.smithi111.stdout:8/126: creat dd/f2a x:0 0 0 2023-12-08T20:27:46.544 INFO:tasks.workunit.client.1.smithi111.stdout:8/127: chown dd/f12 14 1 2023-12-08T20:27:46.546 INFO:tasks.workunit.client.1.smithi111.stdout:3/61: mknod d2/d3/d6/c11 0 2023-12-08T20:27:46.546 INFO:tasks.workunit.client.1.smithi111.stdout:3/62: dread - d2/d3/d6/f10 zero size 2023-12-08T20:27:46.546 INFO:tasks.workunit.client.1.smithi111.stdout:3/63: write d2/d3/d6/fe [892062,41139] 0 2023-12-08T20:27:46.546 INFO:tasks.workunit.client.1.smithi111.stdout:3/64: write d2/ff [523759,104838] 0 2023-12-08T20:27:46.546 INFO:tasks.workunit.client.1.smithi111.stdout:3/65: fsync d2/d3/d6/f10 0 2023-12-08T20:27:46.546 INFO:tasks.workunit.client.1.smithi111.stdout:3/66: write d2/d3/d6/f10 [1045134,5630] 0 2023-12-08T20:27:46.547 INFO:tasks.workunit.client.1.smithi111.stdout:5/150: symlink d3/d4/d7/l34 0 2023-12-08T20:27:46.548 INFO:tasks.workunit.client.1.smithi111.stdout:8/128: creat dd/f2b x:0 0 0 2023-12-08T20:27:46.548 INFO:tasks.workunit.client.1.smithi111.stdout:8/129: readlink dd/l27 0 2023-12-08T20:27:46.549 INFO:tasks.workunit.client.1.smithi111.stdout:3/67: mkdir d2/d12 0 2023-12-08T20:27:46.550 INFO:tasks.workunit.client.1.smithi111.stdout:1/41: dwrite d0/f2 [0,4194304] 0 2023-12-08T20:27:46.550 INFO:tasks.workunit.client.1.smithi111.stdout:1/42: chown d0/f2 11460426 1 2023-12-08T20:27:46.551 INFO:tasks.workunit.client.1.smithi111.stdout:5/151: getdents d3 0 2023-12-08T20:27:46.551 INFO:tasks.workunit.client.1.smithi111.stdout:3/68: mkdir d2/d3/d13 0 2023-12-08T20:27:46.551 INFO:tasks.workunit.client.1.smithi111.stdout:3/69: fsync f1 0 2023-12-08T20:27:46.556 INFO:tasks.workunit.client.1.smithi111.stdout:1/43: symlink d0/d6/lb 0 2023-12-08T20:27:46.557 INFO:tasks.workunit.client.1.smithi111.stdout:5/152: unlink d3/d4/c11 0 2023-12-08T20:27:46.557 INFO:tasks.workunit.client.1.smithi111.stdout:3/70: symlink d2/d12/l14 0 2023-12-08T20:27:46.557 INFO:tasks.workunit.client.1.smithi111.stdout:5/153: truncate d3/d4/f1d 1419945 0 2023-12-08T20:27:46.557 INFO:tasks.workunit.client.1.smithi111.stdout:1/44: symlink d0/d4/lc 0 2023-12-08T20:27:46.557 INFO:tasks.workunit.client.1.smithi111.stdout:1/45: fdatasync d0/d4/f8 0 2023-12-08T20:27:46.557 INFO:tasks.workunit.client.1.smithi111.stdout:3/71: mkdir d2/d15 0 2023-12-08T20:27:46.559 INFO:tasks.workunit.client.1.smithi111.stdout:1/46: symlink d0/d6/ld 0 2023-12-08T20:27:46.560 INFO:tasks.workunit.client.1.smithi111.stdout:1/47: mknod d0/d4/ce 0 2023-12-08T20:27:46.562 INFO:tasks.workunit.client.1.smithi111.stdout:1/48: rename d0/d4/f8 to d0/d4/ff 0 2023-12-08T20:27:46.563 INFO:tasks.workunit.client.1.smithi111.stdout:4/56: dwrite f6 [0,4194304] 0 2023-12-08T20:27:46.563 INFO:tasks.workunit.client.1.smithi111.stdout:4/57: chown d8/c11 7 1 2023-12-08T20:27:46.564 INFO:tasks.workunit.client.1.smithi111.stdout:8/130: dwrite dd/f15 [4194304,4194304] 0 2023-12-08T20:27:46.566 INFO:tasks.workunit.client.1.smithi111.stdout:4/58: rename d8/c11 to d8/c13 0 2023-12-08T20:27:46.566 INFO:tasks.workunit.client.1.smithi111.stdout:4/59: dread - d8/da/db/fc zero size 2023-12-08T20:27:46.566 INFO:tasks.workunit.client.1.smithi111.stdout:4/60: fdatasync d8/f12 0 2023-12-08T20:27:46.566 INFO:tasks.workunit.client.1.smithi111.stdout:1/49: write d0/f1 [293271,116800] 0 2023-12-08T20:27:46.566 INFO:tasks.workunit.client.1.smithi111.stdout:5/154: dread d3/d4/f5 [0,4194304] 0 2023-12-08T20:27:46.566 INFO:tasks.workunit.client.1.smithi111.stdout:1/50: write d0/f1 [4115831,19219] 0 2023-12-08T20:27:46.572 INFO:tasks.workunit.client.1.smithi111.stdout:8/131: rmdir dd 39 2023-12-08T20:27:46.576 INFO:tasks.workunit.client.1.smithi111.stdout:4/61: symlink d8/da/db/l14 0 2023-12-08T20:27:46.576 INFO:tasks.workunit.client.1.smithi111.stdout:4/62: write f0 [3167357,78635] 0 2023-12-08T20:27:46.577 INFO:tasks.workunit.client.1.smithi111.stdout:1/51: creat d0/d6/f10 x:0 0 0 2023-12-08T20:27:46.579 INFO:tasks.workunit.client.1.smithi111.stdout:8/132: mknod dd/c2c 0 2023-12-08T20:27:46.581 INFO:tasks.workunit.client.1.smithi111.stdout:8/133: truncate dd/f17 244802 0 2023-12-08T20:27:46.583 INFO:tasks.workunit.client.1.smithi111.stdout:5/155: dread d3/d4/f1d [0,4194304] 0 2023-12-08T20:27:46.583 INFO:tasks.workunit.client.1.smithi111.stdout:5/156: fdatasync d3/d12/f17 0 2023-12-08T20:27:46.583 INFO:tasks.workunit.client.1.smithi111.stdout:8/134: mkdir dd/d2d 0 2023-12-08T20:27:46.584 INFO:tasks.workunit.client.1.smithi111.stdout:1/52: dread d0/d4/fa [0,4194304] 0 2023-12-08T20:27:46.584 INFO:tasks.workunit.client.1.smithi111.stdout:1/53: dread - d0/d6/f10 zero size 2023-12-08T20:27:46.584 INFO:tasks.workunit.client.1.smithi111.stdout:8/135: symlink dd/d2d/l2e 0 2023-12-08T20:27:46.586 INFO:tasks.workunit.client.1.smithi111.stdout:1/54: creat d0/d6/f11 x:0 0 0 2023-12-08T20:27:46.588 INFO:tasks.workunit.client.1.smithi111.stdout:4/63: dread f6 [0,4194304] 0 2023-12-08T20:27:46.591 INFO:tasks.workunit.client.1.smithi111.stdout:1/55: mknod d0/c12 0 2023-12-08T20:27:46.591 INFO:tasks.workunit.client.1.smithi111.stdout:1/56: rename d0/d4 to d0/d4/d13 22 2023-12-08T20:27:46.591 INFO:tasks.workunit.client.1.smithi111.stdout:1/57: write d0/d4/ff [362706,93483] 0 2023-12-08T20:27:46.591 INFO:tasks.workunit.client.1.smithi111.stdout:1/58: chown d0/d4/ce 26209910 1 2023-12-08T20:27:46.593 INFO:tasks.workunit.client.1.smithi111.stdout:1/59: dread d0/d4/fa [0,4194304] 0 2023-12-08T20:27:46.594 INFO:tasks.workunit.client.1.smithi111.stdout:1/60: creat d0/d6/f14 x:0 0 0 2023-12-08T20:27:46.596 INFO:tasks.workunit.client.1.smithi111.stdout:8/136: getdents dd/d2d 0 2023-12-08T20:27:46.614 INFO:tasks.workunit.client.1.smithi111.stdout:1/61: dwrite d0/d4/fa [0,4194304] 0 2023-12-08T20:27:46.625 INFO:tasks.workunit.client.1.smithi111.stdout:1/62: dread d0/f2 [0,4194304] 0 2023-12-08T20:27:46.625 INFO:tasks.workunit.client.1.smithi111.stdout:1/63: mkdir d0/d4/d15 0 2023-12-08T20:27:46.626 INFO:tasks.workunit.client.1.smithi111.stdout:1/64: write d0/d4/fa [1513709,58833] 0 2023-12-08T20:27:46.642 INFO:tasks.workunit.client.1.smithi111.stdout:1/65: dwrite d0/f1 [0,4194304] 0 2023-12-08T20:27:46.642 INFO:tasks.workunit.client.1.smithi111.stdout:1/66: chown d0/d6/lb 59650652 1 2023-12-08T20:27:46.643 INFO:tasks.workunit.client.1.smithi111.stdout:1/67: symlink d0/d4/l16 0 2023-12-08T20:27:46.643 INFO:tasks.workunit.client.1.smithi111.stdout:1/68: readlink d0/d6/lb 0 2023-12-08T20:27:46.643 INFO:tasks.workunit.client.1.smithi111.stdout:1/69: fsync d0/d6/f11 0 2023-12-08T20:27:46.645 INFO:tasks.workunit.client.1.smithi111.stdout:1/70: creat d0/f17 x:0 0 0 2023-12-08T20:27:46.647 INFO:tasks.workunit.client.1.smithi111.stdout:1/71: link d0/d6/lb d0/l18 0 2023-12-08T20:27:46.650 INFO:tasks.workunit.client.1.smithi111.stdout:1/72: fsync d0/f17 0 2023-12-08T20:27:46.651 INFO:tasks.workunit.client.1.smithi111.stdout:1/73: fsync d0/f1 0 2023-12-08T20:27:46.653 INFO:tasks.workunit.client.1.smithi111.stdout:1/74: link d0/d6/lb d0/d4/d15/l19 0 2023-12-08T20:27:46.682 INFO:tasks.workunit.client.1.smithi111.stdout:8/137: dread fa [4194304,4194304] 0 2023-12-08T20:27:46.682 INFO:tasks.workunit.client.1.smithi111.stdout:8/138: write dd/f29 [583369,95977] 0 2023-12-08T20:27:46.683 INFO:tasks.workunit.client.1.smithi111.stdout:8/139: rmdir dd/d2d 39 2023-12-08T20:27:46.684 INFO:tasks.workunit.client.1.smithi111.stdout:8/140: symlink dd/d2d/l2f 0 2023-12-08T20:27:46.684 INFO:tasks.workunit.client.1.smithi111.stdout:8/141: stat f2 0 2023-12-08T20:27:46.684 INFO:tasks.workunit.client.1.smithi111.stdout:8/142: readlink l6 0 2023-12-08T20:27:46.691 INFO:tasks.workunit.client.1.smithi111.stdout:1/75: dwrite d0/d6/f10 [0,4194304] 0 2023-12-08T20:27:46.695 INFO:tasks.workunit.client.1.smithi111.stdout:8/143: dread dd/ff [0,4194304] 0 2023-12-08T20:27:46.698 INFO:tasks.workunit.client.1.smithi111.stdout:8/144: mknod dd/c30 0 2023-12-08T20:27:46.699 INFO:tasks.workunit.client.1.smithi111.stdout:8/145: creat dd/d2d/f31 x:0 0 0 2023-12-08T20:27:46.700 INFO:tasks.workunit.client.1.smithi111.stdout:8/146: mkdir dd/d32 0 2023-12-08T20:27:46.707 INFO:tasks.workunit.client.1.smithi111.stdout:1/76: dwrite d0/d6/f14 [0,4194304] 0 2023-12-08T20:27:46.714 INFO:tasks.workunit.client.1.smithi111.stdout:8/147: dwrite dd/f20 [0,4194304] 0 2023-12-08T20:27:46.717 INFO:tasks.workunit.client.1.smithi111.stdout:8/148: rename dd/ff to dd/d2d/f33 0 2023-12-08T20:27:46.717 INFO:tasks.workunit.client.1.smithi111.stdout:8/149: truncate dd/f28 47328 0 2023-12-08T20:27:46.718 INFO:tasks.workunit.client.1.smithi111.stdout:8/150: write dd/f20 [4196736,45255] 0 2023-12-08T20:27:46.719 INFO:tasks.workunit.client.1.smithi111.stdout:8/151: symlink dd/d32/l34 0 2023-12-08T20:27:46.719 INFO:tasks.workunit.client.1.smithi111.stdout:8/152: write dd/f2b [460294,113159] 0 2023-12-08T20:27:46.719 INFO:tasks.workunit.client.1.smithi111.stdout:8/153: chown f2 73255 1 2023-12-08T20:27:46.721 INFO:tasks.workunit.client.1.smithi111.stdout:8/154: mkdir dd/d35 0 2023-12-08T20:27:46.723 INFO:tasks.workunit.client.1.smithi111.stdout:8/155: mkdir dd/d32/d36 0 2023-12-08T20:27:46.723 INFO:tasks.workunit.client.1.smithi111.stdout:8/156: truncate dd/f25 861842 0 2023-12-08T20:27:46.724 INFO:tasks.workunit.client.1.smithi111.stdout:1/77: dwrite d0/d6/f11 [0,4194304] 0 2023-12-08T20:27:46.726 INFO:tasks.workunit.client.1.smithi111.stdout:8/157: fdatasync dd/f20 0 2023-12-08T20:27:46.727 INFO:tasks.workunit.client.1.smithi111.stdout:8/158: creat dd/d2d/f37 x:0 0 0 2023-12-08T20:27:46.727 INFO:tasks.workunit.client.1.smithi111.stdout:8/159: mknod dd/d32/c38 0 2023-12-08T20:27:46.729 INFO:tasks.workunit.client.1.smithi111.stdout:8/160: fsync dd/f1f 0 2023-12-08T20:27:46.729 INFO:tasks.workunit.client.1.smithi111.stdout:8/161: stat dd/f23 0 2023-12-08T20:27:46.730 INFO:tasks.workunit.client.1.smithi111.stdout:8/162: rmdir dd/d32 39 2023-12-08T20:27:46.731 INFO:tasks.workunit.client.1.smithi111.stdout:8/163: creat dd/d32/f39 x:0 0 0 2023-12-08T20:27:46.732 INFO:tasks.workunit.client.1.smithi111.stdout:8/164: creat dd/d2d/f3a x:0 0 0 2023-12-08T20:27:46.733 INFO:tasks.workunit.client.1.smithi111.stdout:8/165: read f2 [4185238,70621] 0 2023-12-08T20:27:46.733 INFO:tasks.workunit.client.1.smithi111.stdout:8/166: fdatasync fa 0 2023-12-08T20:27:46.734 INFO:tasks.workunit.client.1.smithi111.stdout:8/167: creat dd/d35/f3b x:0 0 0 2023-12-08T20:27:46.734 INFO:tasks.workunit.client.1.smithi111.stdout:8/168: write dd/d2d/f33 [5096058,113341] 0 2023-12-08T20:27:46.734 INFO:tasks.workunit.client.1.smithi111.stdout:8/169: chown dd/d2d/l2e 3 1 2023-12-08T20:27:46.734 INFO:tasks.workunit.client.1.smithi111.stdout:8/170: chown dd/d2d/f37 1 1 2023-12-08T20:27:46.734 INFO:tasks.workunit.client.1.smithi111.stdout:8/171: creat dd/d2d/f3c x:0 0 0 2023-12-08T20:27:46.734 INFO:tasks.workunit.client.1.smithi111.stdout:8/172: fdatasync dd/d2d/f3a 0 2023-12-08T20:27:46.735 INFO:tasks.workunit.client.1.smithi111.stdout:8/173: mkdir dd/d32/d3d 0 2023-12-08T20:27:46.737 INFO:tasks.workunit.client.1.smithi111.stdout:8/174: rename dd/f17 to dd/d32/f3e 0 2023-12-08T20:27:46.737 INFO:tasks.workunit.client.1.smithi111.stdout:8/175: chown fa 124038768 1 2023-12-08T20:27:46.737 INFO:tasks.workunit.client.1.smithi111.stdout:8/176: mknod dd/d32/d3d/c3f 0 2023-12-08T20:27:46.738 INFO:tasks.workunit.client.1.smithi111.stdout:1/78: dwrite d0/d4/ff [0,4194304] 0 2023-12-08T20:27:46.738 INFO:tasks.workunit.client.1.smithi111.stdout:8/177: chown dd/l21 1 1 2023-12-08T20:27:46.740 INFO:tasks.workunit.client.1.smithi111.stdout:1/79: creat d0/d4/d15/f1a x:0 0 0 2023-12-08T20:27:46.747 INFO:tasks.workunit.client.1.smithi111.stdout:1/80: rmdir d0 39 2023-12-08T20:27:46.750 INFO:tasks.workunit.client.1.smithi111.stdout:8/178: dwrite dd/d2d/f37 [0,4194304] 0 2023-12-08T20:27:46.750 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:46 smithi043 ceph-mon[111966]: pgmap v14: 65 pgs: 65 active+clean; 253 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8.0 MiB/s rd, 23 MiB/s wr, 826 op/s 2023-12-08T20:27:46.751 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:46 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:46.751 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:46 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:46.751 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:46 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:46.751 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:46 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:46.751 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:46 smithi043 ceph-mon[111966]: Reconfiguring node-exporter.smithi043 (dependencies changed)... 2023-12-08T20:27:46.751 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:46 smithi043 ceph-mon[111966]: Reconfiguring daemon node-exporter.smithi043 on smithi043 2023-12-08T20:27:46.753 INFO:tasks.workunit.client.1.smithi111.stdout:8/179: creat dd/d32/d3d/f40 x:0 0 0 2023-12-08T20:27:46.756 INFO:tasks.workunit.client.1.smithi111.stdout:8/180: symlink dd/l41 0 2023-12-08T20:27:46.765 INFO:tasks.workunit.client.1.smithi111.stdout:1/81: dwrite d0/d4/d15/f1a [0,4194304] 0 2023-12-08T20:27:46.767 INFO:tasks.workunit.client.1.smithi111.stdout:1/82: mkdir d0/d6/d1b 0 2023-12-08T20:27:46.770 INFO:tasks.workunit.client.1.smithi111.stdout:1/83: unlink d0/d6/ld 0 2023-12-08T20:27:46.770 INFO:tasks.workunit.client.1.smithi111.stdout:8/181: dwrite dd/f14 [0,4194304] 0 2023-12-08T20:27:46.778 INFO:tasks.workunit.client.1.smithi111.stdout:1/84: dread d0/d4/fa [0,4194304] 0 2023-12-08T20:27:46.780 INFO:tasks.workunit.client.1.smithi111.stdout:1/85: link d0/d6/f10 d0/d4/f1c 0 2023-12-08T20:27:46.780 INFO:tasks.workunit.client.1.smithi111.stdout:1/86: mknod d0/d6/c1d 0 2023-12-08T20:27:46.781 INFO:tasks.workunit.client.1.smithi111.stdout:1/87: mknod d0/c1e 0 2023-12-08T20:27:46.782 INFO:tasks.workunit.client.1.smithi111.stdout:1/88: write d0/d4/ff [1642635,93840] 0 2023-12-08T20:27:46.784 INFO:tasks.workunit.client.1.smithi111.stdout:1/89: link d0/f2 d0/f1f 0 2023-12-08T20:27:46.785 INFO:tasks.workunit.client.1.smithi111.stdout:1/90: unlink d0/d4/fa 0 2023-12-08T20:27:46.786 INFO:tasks.workunit.client.1.smithi111.stdout:1/91: write d0/d6/f14 [5057410,7270] 0 2023-12-08T20:27:46.786 INFO:tasks.workunit.client.1.smithi111.stdout:1/92: symlink d0/d4/d15/l20 0 2023-12-08T20:27:46.786 INFO:tasks.workunit.client.1.smithi111.stdout:8/182: dwrite dd/f28 [0,4194304] 0 2023-12-08T20:27:46.788 INFO:tasks.workunit.client.1.smithi111.stdout:8/183: dread dd/f25 [0,4194304] 0 2023-12-08T20:27:46.788 INFO:tasks.workunit.client.1.smithi111.stdout:8/184: chown fa 605 1 2023-12-08T20:27:46.790 INFO:tasks.workunit.client.1.smithi111.stdout:8/185: write dd/f14 [19318,17564] 0 2023-12-08T20:27:46.790 INFO:tasks.workunit.client.1.smithi111.stdout:8/186: chown dd/d2d/f33 1257683234 1 2023-12-08T20:27:46.791 INFO:tasks.workunit.client.1.smithi111.stdout:8/187: rmdir dd/d2d 39 2023-12-08T20:27:46.794 INFO:tasks.workunit.client.1.smithi111.stdout:1/93: dread d0/d6/f10 [0,4194304] 0 2023-12-08T20:27:46.795 INFO:tasks.workunit.client.1.smithi111.stdout:8/188: unlink dd/l18 0 2023-12-08T20:27:46.824 INFO:tasks.workunit.client.1.smithi111.stdout:1/94: dwrite d0/f2 [4194304,4194304] 0 2023-12-08T20:27:46.824 INFO:tasks.workunit.client.1.smithi111.stdout:1/95: chown d0/d4 359164181 1 2023-12-08T20:27:46.825 INFO:tasks.workunit.client.1.smithi111.stdout:8/189: dwrite f2 [0,4194304] 0 2023-12-08T20:27:46.826 INFO:tasks.workunit.client.1.smithi111.stdout:1/96: creat d0/d6/d1b/f21 x:0 0 0 2023-12-08T20:27:46.842 INFO:tasks.workunit.client.1.smithi111.stdout:1/97: dwrite d0/f17 [0,4194304] 0 2023-12-08T20:27:46.843 INFO:tasks.workunit.client.1.smithi111.stdout:8/190: dwrite dd/f2b [0,4194304] 0 2023-12-08T20:27:46.844 INFO:tasks.workunit.client.1.smithi111.stdout:1/98: mkdir d0/d22 0 2023-12-08T20:27:46.848 INFO:tasks.workunit.client.1.smithi111.stdout:8/191: mkdir dd/d35/d42 0 2023-12-08T20:27:46.849 INFO:tasks.workunit.client.1.smithi111.stdout:1/99: rename d0/d4/d15/f1a to d0/d22/f23 0 2023-12-08T20:27:46.851 INFO:tasks.workunit.client.1.smithi111.stdout:1/100: mknod d0/d6/d1b/c24 0 2023-12-08T20:27:46.851 INFO:tasks.workunit.client.1.smithi111.stdout:1/101: chown d0/d4/d15/l20 3340421 1 2023-12-08T20:27:46.853 INFO:tasks.workunit.client.1.smithi111.stdout:1/102: mknod d0/d4/c25 0 2023-12-08T20:27:46.854 INFO:tasks.workunit.client.1.smithi111.stdout:1/103: write d0/f1f [8891402,98011] 0 2023-12-08T20:27:46.855 INFO:tasks.workunit.client.1.smithi111.stdout:1/104: getdents d0/d4/d15 0 2023-12-08T20:27:46.856 INFO:tasks.workunit.client.1.smithi111.stdout:1/105: write d0/f1f [599196,34410] 0 2023-12-08T20:27:46.857 INFO:tasks.workunit.client.1.smithi111.stdout:1/106: write d0/d6/f11 [3517570,126518] 0 2023-12-08T20:27:46.857 INFO:tasks.workunit.client.1.smithi111.stdout:1/107: stat d0/d4/f1c 0 2023-12-08T20:27:46.857 INFO:tasks.workunit.client.1.smithi111.stdout:1/108: creat d0/d6/f26 x:0 0 0 2023-12-08T20:27:46.873 INFO:tasks.workunit.client.1.smithi111.stdout:1/109: dwrite d0/f2 [0,4194304] 0 2023-12-08T20:27:46.876 INFO:tasks.workunit.client.1.smithi111.stdout:1/110: creat d0/d6/f27 x:0 0 0 2023-12-08T20:27:46.881 INFO:tasks.workunit.client.1.smithi111.stdout:1/111: dread d0/f2 [0,4194304] 0 2023-12-08T20:27:46.894 INFO:tasks.workunit.client.1.smithi111.stdout:1/112: dwrite d0/d6/f27 [0,4194304] 0 2023-12-08T20:27:46.899 INFO:tasks.workunit.client.1.smithi111.stdout:1/113: rename d0/d6/f11 to d0/d6/f28 0 2023-12-08T20:27:46.899 INFO:tasks.workunit.client.1.smithi111.stdout:1/114: chown d0/d6/f14 50 1 2023-12-08T20:27:46.904 INFO:tasks.workunit.client.1.smithi111.stdout:1/115: truncate d0/d6/f27 18125 0 2023-12-08T20:27:46.920 INFO:tasks.workunit.client.1.smithi111.stdout:1/116: dwrite d0/d6/f27 [0,4194304] 0 2023-12-08T20:27:46.921 INFO:tasks.workunit.client.1.smithi111.stdout:1/117: write d0/d22/f23 [137856,82868] 0 2023-12-08T20:27:46.921 INFO:tasks.workunit.client.1.smithi111.stdout:1/118: rename d0/d6 to d0/d6/d29 22 2023-12-08T20:27:46.922 INFO:tasks.workunit.client.1.smithi111.stdout:1/119: mknod d0/d6/d1b/c2a 0 2023-12-08T20:27:46.922 INFO:tasks.workunit.client.1.smithi111.stdout:1/120: truncate d0/d4/f1c 4213081 0 2023-12-08T20:27:46.923 INFO:tasks.workunit.client.1.smithi111.stdout:1/121: symlink d0/d4/l2b 0 2023-12-08T20:27:46.924 INFO:tasks.workunit.client.1.smithi111.stdout:1/122: write d0/f1f [2619925,124616] 0 2023-12-08T20:27:46.925 INFO:tasks.workunit.client.1.smithi111.stdout:1/123: symlink d0/d6/l2c 0 2023-12-08T20:27:46.926 INFO:tasks.workunit.client.1.smithi111.stdout:1/124: chown d0/d6/d1b/f21 8643 1 2023-12-08T20:27:46.926 INFO:tasks.workunit.client.1.smithi111.stdout:1/125: creat d0/f2d x:0 0 0 2023-12-08T20:27:46.939 INFO:tasks.workunit.client.1.smithi111.stdout:1/126: dwrite d0/d6/f10 [0,4194304] 0 2023-12-08T20:27:46.940 INFO:tasks.workunit.client.1.smithi111.stdout:1/127: mkdir d0/d6/d1b/d2e 0 2023-12-08T20:27:46.952 INFO:tasks.workunit.client.1.smithi111.stdout:1/128: dwrite d0/d6/f14 [0,4194304] 0 2023-12-08T20:27:46.953 INFO:tasks.workunit.client.1.smithi111.stdout:1/129: creat d0/f2f x:0 0 0 2023-12-08T20:27:46.955 INFO:tasks.workunit.client.1.smithi111.stdout:1/130: creat d0/d4/d15/f30 x:0 0 0 2023-12-08T20:27:46.955 INFO:tasks.workunit.client.1.smithi111.stdout:1/131: chown d0/d6/d1b/c24 783 1 2023-12-08T20:27:46.955 INFO:tasks.workunit.client.1.smithi111.stdout:1/132: creat d0/f31 x:0 0 0 2023-12-08T20:27:46.955 INFO:tasks.workunit.client.1.smithi111.stdout:1/133: stat d0/c1e 0 2023-12-08T20:27:46.956 INFO:tasks.workunit.client.1.smithi111.stdout:1/134: mknod d0/d6/d1b/c32 0 2023-12-08T20:27:46.962 INFO:tasks.workunit.client.1.smithi111.stdout:1/135: dread d0/d6/f14 [0,4194304] 0 2023-12-08T20:27:46.964 INFO:tasks.workunit.client.1.smithi111.stdout:1/136: unlink d0/d6/f26 0 2023-12-08T20:27:46.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:46 smithi111 ceph-mon[121341]: pgmap v14: 65 pgs: 65 active+clean; 253 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8.0 MiB/s rd, 23 MiB/s wr, 826 op/s 2023-12-08T20:27:46.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:46 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:46.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:46 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:46.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:46 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:46.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:46 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:46.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:46 smithi111 ceph-mon[121341]: Reconfiguring node-exporter.smithi043 (dependencies changed)... 2023-12-08T20:27:46.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:46 smithi111 ceph-mon[121341]: Reconfiguring daemon node-exporter.smithi043 on smithi043 2023-12-08T20:27:46.970 INFO:tasks.workunit.client.1.smithi111.stdout:1/137: rename d0/d4 to d0/d6/d33 0 2023-12-08T20:27:46.970 INFO:tasks.workunit.client.1.smithi111.stdout:1/138: write d0/d6/d1b/f21 [976552,124534] 0 2023-12-08T20:27:46.970 INFO:tasks.workunit.client.1.smithi111.stdout:1/139: fdatasync d0/d6/f10 0 2023-12-08T20:27:46.984 INFO:tasks.workunit.client.1.smithi111.stdout:1/140: dwrite d0/f2 [0,4194304] 0 2023-12-08T20:27:46.987 INFO:tasks.workunit.client.1.smithi111.stdout:1/141: dread d0/d6/f14 [0,4194304] 0 2023-12-08T20:27:46.987 INFO:tasks.workunit.client.1.smithi111.stdout:1/142: dread - d0/d6/d33/d15/f30 zero size 2023-12-08T20:27:46.992 INFO:tasks.workunit.client.1.smithi111.stdout:1/143: truncate d0/d6/f28 81682 0 2023-12-08T20:27:46.993 INFO:tasks.workunit.client.1.smithi111.stdout:1/144: mkdir d0/d6/d34 0 2023-12-08T20:27:46.995 INFO:tasks.workunit.client.1.smithi111.stdout:1/145: symlink d0/l35 0 2023-12-08T20:27:46.996 INFO:tasks.workunit.client.1.smithi111.stdout:1/146: creat d0/f36 x:0 0 0 2023-12-08T20:27:46.997 INFO:tasks.workunit.client.1.smithi111.stdout:1/147: mknod d0/d6/d33/d15/c37 0 2023-12-08T20:27:46.999 INFO:tasks.workunit.client.1.smithi111.stdout:1/148: symlink d0/d6/d1b/d2e/l38 0 2023-12-08T20:27:47.000 INFO:tasks.workunit.client.1.smithi111.stdout:1/149: write d0/f17 [46013,118656] 0 2023-12-08T20:27:47.009 INFO:tasks.workunit.client.1.smithi111.stdout:1/150: dread d0/f1f [4194304,4194304] 0 2023-12-08T20:27:47.010 INFO:tasks.workunit.client.1.smithi111.stdout:1/151: symlink d0/d6/d1b/d2e/l39 0 2023-12-08T20:27:47.011 INFO:tasks.workunit.client.1.smithi111.stdout:1/152: write d0/d6/f27 [1304612,473] 0 2023-12-08T20:27:47.012 INFO:tasks.workunit.client.1.smithi111.stdout:1/153: mkdir d0/d3a 0 2023-12-08T20:27:47.013 INFO:tasks.workunit.client.1.smithi111.stdout:1/154: unlink d0/d6/d33/d15/c37 0 2023-12-08T20:27:47.030 INFO:tasks.workunit.client.1.smithi111.stdout:1/155: dwrite d0/d6/d1b/f21 [0,4194304] 0 2023-12-08T20:27:47.032 INFO:tasks.workunit.client.1.smithi111.stdout:1/156: mknod d0/d6/d1b/c3b 0 2023-12-08T20:27:47.033 INFO:tasks.workunit.client.1.smithi111.stdout:1/157: write d0/d6/d33/f1c [3542712,19231] 0 2023-12-08T20:27:47.035 INFO:tasks.workunit.client.1.smithi111.stdout:1/158: truncate d0/d6/d33/ff 1450018 0 2023-12-08T20:27:47.062 INFO:tasks.workunit.client.1.smithi111.stdout:0/39: sync 2023-12-08T20:27:47.065 INFO:tasks.workunit.client.1.smithi111.stdout:0/40: link d1/l7 d1/d4/lb 0 2023-12-08T20:27:47.065 INFO:tasks.workunit.client.1.smithi111.stdout:0/41: readlink d1/d4/lb 0 2023-12-08T20:27:47.065 INFO:tasks.workunit.client.1.smithi111.stdout:0/42: mknod d1/cc 0 2023-12-08T20:27:47.066 INFO:tasks.workunit.client.1.smithi111.stdout:0/43: write d1/d4/f6 [3951594,20058] 0 2023-12-08T20:27:47.066 INFO:tasks.workunit.client.1.smithi111.stdout:0/44: readlink d1/d4/lb 0 2023-12-08T20:27:47.068 INFO:tasks.workunit.client.1.smithi111.stdout:0/45: fdatasync d1/d4/f6 0 2023-12-08T20:27:47.071 INFO:tasks.workunit.client.1.smithi111.stdout:0/46: read d1/d4/f6 [2384802,97394] 0 2023-12-08T20:27:47.071 INFO:tasks.workunit.client.1.smithi111.stdout:0/47: chown d1/d4/c5 1653484 1 2023-12-08T20:27:47.072 INFO:tasks.workunit.client.1.smithi111.stdout:0/48: fdatasync d1/d4/f6 0 2023-12-08T20:27:47.072 INFO:tasks.workunit.client.1.smithi111.stdout:0/49: mkdir d1/dd 0 2023-12-08T20:27:47.073 INFO:tasks.workunit.client.1.smithi111.stdout:0/50: write d1/d4/f6 [3753803,31519] 0 2023-12-08T20:27:47.074 INFO:tasks.workunit.client.1.smithi111.stdout:0/51: symlink d1/le 0 2023-12-08T20:27:47.075 INFO:tasks.workunit.client.1.smithi111.stdout:0/52: mkdir d1/df 0 2023-12-08T20:27:47.076 INFO:tasks.workunit.client.1.smithi111.stdout:0/53: unlink d1/c2 0 2023-12-08T20:27:47.076 INFO:tasks.workunit.client.1.smithi111.stdout:0/54: truncate d1/d4/f6 5193926 0 2023-12-08T20:27:47.094 INFO:tasks.workunit.client.1.smithi111.stdout:0/55: dwrite d1/d4/f6 [0,4194304] 0 2023-12-08T20:27:47.094 INFO:tasks.workunit.client.1.smithi111.stdout:0/56: readlink d1/l7 0 2023-12-08T20:27:47.095 INFO:tasks.workunit.client.1.smithi111.stdout:0/57: creat d1/f10 x:0 0 0 2023-12-08T20:27:47.096 INFO:tasks.workunit.client.1.smithi111.stdout:0/58: creat d1/dd/f11 x:0 0 0 2023-12-08T20:27:47.097 INFO:tasks.workunit.client.1.smithi111.stdout:0/59: mknod d1/dd/c12 0 2023-12-08T20:27:47.098 INFO:tasks.workunit.client.1.smithi111.stdout:0/60: mknod d1/d4/c13 0 2023-12-08T20:27:47.098 INFO:tasks.workunit.client.1.smithi111.stdout:0/61: truncate d1/dd/f11 326223 0 2023-12-08T20:27:47.099 INFO:tasks.workunit.client.1.smithi111.stdout:0/62: symlink d1/l14 0 2023-12-08T20:27:47.099 INFO:tasks.workunit.client.1.smithi111.stdout:0/63: dread - d1/f10 zero size 2023-12-08T20:27:47.099 INFO:tasks.workunit.client.1.smithi111.stdout:0/64: write d1/dd/f11 [999729,39454] 0 2023-12-08T20:27:47.100 INFO:tasks.workunit.client.1.smithi111.stdout:0/65: rename d1/d4/f6 to d1/d4/f15 0 2023-12-08T20:27:47.113 INFO:tasks.workunit.client.1.smithi111.stdout:0/66: dwrite d1/d4/f15 [0,4194304] 0 2023-12-08T20:27:47.113 INFO:tasks.workunit.client.1.smithi111.stdout:0/67: dread - d1/f10 zero size 2023-12-08T20:27:47.113 INFO:tasks.workunit.client.1.smithi111.stdout:0/68: mkdir d1/df/d16 0 2023-12-08T20:27:47.114 INFO:tasks.workunit.client.1.smithi111.stdout:0/69: mknod d1/dd/c17 0 2023-12-08T20:27:47.115 INFO:tasks.workunit.client.1.smithi111.stdout:0/70: write d1/dd/f11 [521115,64449] 0 2023-12-08T20:27:47.128 INFO:tasks.workunit.client.1.smithi111.stdout:0/71: dwrite d1/d4/f15 [0,4194304] 0 2023-12-08T20:27:47.129 INFO:tasks.workunit.client.1.smithi111.stdout:0/72: creat d1/dd/f18 x:0 0 0 2023-12-08T20:27:47.136 INFO:tasks.workunit.client.1.smithi111.stdout:0/73: dread d1/d4/f15 [0,4194304] 0 2023-12-08T20:27:47.137 INFO:tasks.workunit.client.1.smithi111.stdout:0/74: symlink d1/df/d16/l19 0 2023-12-08T20:27:47.137 INFO:tasks.workunit.client.1.smithi111.stdout:0/75: chown d1 0 1 2023-12-08T20:27:47.137 INFO:tasks.workunit.client.1.smithi111.stdout:0/76: chown d1 84377261 1 2023-12-08T20:27:47.137 INFO:tasks.workunit.client.1.smithi111.stdout:0/77: symlink d1/df/l1a 0 2023-12-08T20:27:47.138 INFO:tasks.workunit.client.1.smithi111.stdout:0/78: symlink d1/l1b 0 2023-12-08T20:27:47.138 INFO:tasks.workunit.client.1.smithi111.stdout:0/79: dread - d1/f10 zero size 2023-12-08T20:27:47.138 INFO:tasks.workunit.client.1.smithi111.stdout:0/80: stat d1/d4/c9 0 2023-12-08T20:27:47.139 INFO:tasks.workunit.client.1.smithi111.stdout:0/81: mkdir d1/d4/d1c 0 2023-12-08T20:27:47.139 INFO:tasks.workunit.client.1.smithi111.stdout:0/82: chown d1 76 1 2023-12-08T20:27:47.157 INFO:tasks.workunit.client.1.smithi111.stdout:0/83: dwrite d1/dd/f11 [0,4194304] 0 2023-12-08T20:27:47.158 INFO:tasks.workunit.client.1.smithi111.stdout:0/84: readlink d1/l14 0 2023-12-08T20:27:47.166 INFO:tasks.workunit.client.1.smithi111.stdout:0/85: dread d1/dd/f11 [0,4194304] 0 2023-12-08T20:27:47.170 INFO:tasks.workunit.client.1.smithi111.stdout:0/86: symlink d1/df/d16/l1d 0 2023-12-08T20:27:47.171 INFO:tasks.workunit.client.1.smithi111.stdout:0/87: mknod d1/df/c1e 0 2023-12-08T20:27:47.172 INFO:tasks.workunit.client.1.smithi111.stdout:0/88: write d1/f10 [880714,97678] 0 2023-12-08T20:27:47.173 INFO:tasks.workunit.client.1.smithi111.stdout:0/89: write d1/dd/f18 [694449,31801] 0 2023-12-08T20:27:47.175 INFO:tasks.workunit.client.1.smithi111.stdout:0/90: mkdir d1/dd/d1f 0 2023-12-08T20:27:47.177 INFO:tasks.workunit.client.1.smithi111.stdout:0/91: symlink d1/df/l20 0 2023-12-08T20:27:47.177 INFO:tasks.workunit.client.1.smithi111.stdout:0/92: write d1/f10 [9847,60262] 0 2023-12-08T20:27:47.185 INFO:tasks.workunit.client.1.smithi111.stdout:0/93: rename d1/cc to d1/df/d16/c21 0 2023-12-08T20:27:47.188 INFO:tasks.workunit.client.1.smithi111.stdout:0/94: getdents d1/df/d16 0 2023-12-08T20:27:47.191 INFO:tasks.workunit.client.1.smithi111.stdout:0/95: link d1/df/l1a d1/d4/l22 0 2023-12-08T20:27:47.192 INFO:tasks.workunit.client.1.smithi111.stdout:0/96: rename d1 to d1/dd/d1f/d23 22 2023-12-08T20:27:47.192 INFO:tasks.workunit.client.1.smithi111.stdout:0/97: read d1/d4/f15 [1545486,68236] 0 2023-12-08T20:27:47.196 INFO:tasks.workunit.client.1.smithi111.stdout:0/98: truncate d1/f10 342634 0 2023-12-08T20:27:47.215 INFO:tasks.workunit.client.1.smithi111.stdout:0/99: dwrite d1/dd/f18 [0,4194304] 0 2023-12-08T20:27:47.224 INFO:tasks.workunit.client.1.smithi111.stdout:0/100: dread d1/dd/f18 [0,4194304] 0 2023-12-08T20:27:47.226 INFO:tasks.workunit.client.1.smithi111.stdout:0/101: rename d1/d4/d1c to d1/d4/d24 0 2023-12-08T20:27:47.228 INFO:tasks.workunit.client.1.smithi111.stdout:0/102: truncate d1/d4/f15 781164 0 2023-12-08T20:27:47.229 INFO:tasks.workunit.client.1.smithi111.stdout:0/103: rmdir d1/df/d16 39 2023-12-08T20:27:47.229 INFO:tasks.workunit.client.1.smithi111.stdout:0/104: write d1/f10 [1309699,38920] 0 2023-12-08T20:27:47.229 INFO:tasks.workunit.client.1.smithi111.stdout:0/105: fdatasync d1/dd/f18 0 2023-12-08T20:27:47.229 INFO:tasks.workunit.client.1.smithi111.stdout:2/192: sync 2023-12-08T20:27:47.229 INFO:tasks.workunit.client.1.smithi111.stdout:7/88: sync 2023-12-08T20:27:47.229 INFO:tasks.workunit.client.1.smithi111.stdout:9/100: sync 2023-12-08T20:27:47.229 INFO:tasks.workunit.client.1.smithi111.stdout:7/89: dread - da/d13/f1a zero size 2023-12-08T20:27:47.229 INFO:tasks.workunit.client.1.smithi111.stdout:6/30: sync 2023-12-08T20:27:47.229 INFO:tasks.workunit.client.1.smithi111.stdout:6/31: readlink d0/d1/l4 0 2023-12-08T20:27:47.230 INFO:tasks.workunit.client.1.smithi111.stdout:9/101: read d2/da/fc [332195,73511] 0 2023-12-08T20:27:47.230 INFO:tasks.workunit.client.1.smithi111.stdout:9/102: read d2/d8/dd/d1a/f1b [435720,20805] 0 2023-12-08T20:27:47.232 INFO:tasks.workunit.client.1.smithi111.stdout:2/193: rename d1/d1d/d1f/d2d to d1/d29/d4e 0 2023-12-08T20:27:47.232 INFO:tasks.workunit.client.1.smithi111.stdout:2/194: chown d1/d1d/d22/f34 5375065 1 2023-12-08T20:27:47.232 INFO:tasks.workunit.client.1.smithi111.stdout:2/195: write d1/d1d/d1f/f3c [118698,31230] 0 2023-12-08T20:27:47.234 INFO:tasks.workunit.client.1.smithi111.stdout:9/103: mknod d2/c1c 0 2023-12-08T20:27:47.238 INFO:tasks.workunit.client.1.smithi111.stdout:7/90: rename c3 to da/d13/c20 0 2023-12-08T20:27:47.239 INFO:tasks.workunit.client.1.smithi111.stdout:7/91: fsync da/f1e 0 2023-12-08T20:27:47.239 INFO:tasks.workunit.client.1.smithi111.stdout:7/92: fdatasync f6 0 2023-12-08T20:27:47.239 INFO:tasks.workunit.client.1.smithi111.stdout:9/104: mknod d2/da/c1d 0 2023-12-08T20:27:47.245 INFO:tasks.workunit.client.1.smithi111.stdout:7/93: mkdir da/d13/d21 0 2023-12-08T20:27:47.246 INFO:tasks.workunit.client.1.smithi111.stdout:9/105: mkdir d2/d8/dd/d1a/d1e 0 2023-12-08T20:27:47.247 INFO:tasks.workunit.client.1.smithi111.stdout:9/106: creat d2/d8/dd/d1a/d1e/f1f x:0 0 0 2023-12-08T20:27:47.248 INFO:tasks.workunit.client.1.smithi111.stdout:0/106: dwrite d1/dd/f11 [4194304,4194304] 0 2023-12-08T20:27:47.250 INFO:tasks.workunit.client.1.smithi111.stdout:9/107: rename d2/lf to d2/da/l20 0 2023-12-08T20:27:47.250 INFO:tasks.workunit.client.1.smithi111.stdout:9/108: dread - d2/d8/dd/d1a/d1e/f1f zero size 2023-12-08T20:27:47.252 INFO:tasks.workunit.client.1.smithi111.stdout:2/196: dwrite d1/d1d/d1f/d25/d48/f4a [0,4194304] 0 2023-12-08T20:27:47.261 INFO:tasks.workunit.client.1.smithi111.stdout:2/197: rmdir d1/d1d/d12 39 2023-12-08T20:27:47.261 INFO:tasks.workunit.client.1.smithi111.stdout:7/94: rmdir da 39 2023-12-08T20:27:47.262 INFO:tasks.workunit.client.1.smithi111.stdout:2/198: link d1/d1d/d1f/d25/l1e d1/d1d/d1f/d25/d48/l4f 0 2023-12-08T20:27:47.263 INFO:tasks.workunit.client.1.smithi111.stdout:7/95: mknod da/d13/d21/c22 0 2023-12-08T20:27:47.263 INFO:tasks.workunit.client.1.smithi111.stdout:7/96: write da/f1e [504217,82165] 0 2023-12-08T20:27:47.263 INFO:tasks.workunit.client.1.smithi111.stdout:7/97: write da/d13/f1a [217069,77304] 0 2023-12-08T20:27:47.263 INFO:tasks.workunit.client.1.smithi111.stdout:2/199: creat d1/d1d/d22/f50 x:0 0 0 2023-12-08T20:27:47.263 INFO:tasks.workunit.client.1.smithi111.stdout:9/109: fsync d2/d8/dd/d1a/d1e/f1f 0 2023-12-08T20:27:47.264 INFO:tasks.workunit.client.1.smithi111.stdout:0/107: dwrite d1/dd/f18 [0,4194304] 0 2023-12-08T20:27:47.265 INFO:tasks.workunit.client.1.smithi111.stdout:9/110: creat d2/d8/f21 x:0 0 0 2023-12-08T20:27:47.266 INFO:tasks.workunit.client.1.smithi111.stdout:9/111: chown d2/c17 21710 1 2023-12-08T20:27:47.273 INFO:tasks.workunit.client.1.smithi111.stdout:0/108: truncate d1/dd/f18 915488 0 2023-12-08T20:27:47.277 INFO:tasks.workunit.client.1.smithi111.stdout:0/109: dread d1/f10 [0,4194304] 0 2023-12-08T20:27:47.277 INFO:tasks.workunit.client.1.smithi111.stdout:2/200: dwrite d1/d1d/f20 [4194304,4194304] 0 2023-12-08T20:27:47.278 INFO:tasks.workunit.client.1.smithi111.stdout:0/110: dread d1/f10 [0,4194304] 0 2023-12-08T20:27:47.279 INFO:tasks.workunit.client.1.smithi111.stdout:9/112: write d2/d8/f9 [8056210,83216] 0 2023-12-08T20:27:47.279 INFO:tasks.workunit.client.1.smithi111.stdout:9/113: write d2/d8/f21 [274507,122647] 0 2023-12-08T20:27:47.281 INFO:tasks.workunit.client.1.smithi111.stdout:2/201: rename d1/d1d/d22/d30/l35 to d1/d1d/d1f/d25/d3d/d41/l51 0 2023-12-08T20:27:47.281 INFO:tasks.workunit.client.1.smithi111.stdout:2/202: readlink d1/d1d/d1f/d25/l47 0 2023-12-08T20:27:47.282 INFO:tasks.workunit.client.1.smithi111.stdout:9/114: creat d2/d8/dd/f22 x:0 0 0 2023-12-08T20:27:47.283 INFO:tasks.workunit.client.1.smithi111.stdout:2/203: creat d1/d1d/d1f/d25/d3d/d41/f52 x:0 0 0 2023-12-08T20:27:47.296 INFO:tasks.workunit.client.1.smithi111.stdout:9/115: rmdir d2/d8/dd 39 2023-12-08T20:27:47.298 INFO:tasks.workunit.client.1.smithi111.stdout:9/116: mkdir d2/d8/dd/d1a/d1e/d23 0 2023-12-08T20:27:47.300 INFO:tasks.workunit.client.1.smithi111.stdout:0/111: dwrite d1/f10 [0,4194304] 0 2023-12-08T20:27:47.301 INFO:tasks.workunit.client.1.smithi111.stdout:0/112: fsync d1/d4/f15 0 2023-12-08T20:27:47.301 INFO:tasks.workunit.client.1.smithi111.stdout:0/113: fsync d1/f10 0 2023-12-08T20:27:47.301 INFO:tasks.workunit.client.1.smithi111.stdout:2/204: dwrite d1/d1d/f20 [4194304,4194304] 0 2023-12-08T20:27:47.301 INFO:tasks.workunit.client.1.smithi111.stdout:7/98: dwrite da/d13/f1a [0,4194304] 0 2023-12-08T20:27:47.301 INFO:tasks.workunit.client.1.smithi111.stdout:7/99: truncate da/d13/f17 1020835 0 2023-12-08T20:27:47.303 INFO:tasks.workunit.client.1.smithi111.stdout:7/100: read da/f1e [407778,127635] 0 2023-12-08T20:27:47.304 INFO:tasks.workunit.client.1.smithi111.stdout:0/114: symlink d1/dd/l25 0 2023-12-08T20:27:47.306 INFO:tasks.workunit.client.1.smithi111.stdout:7/101: dread f6 [0,4194304] 0 2023-12-08T20:27:47.306 INFO:tasks.workunit.client.1.smithi111.stdout:7/102: dread da/d13/f17 [0,4194304] 0 2023-12-08T20:27:47.307 INFO:tasks.workunit.client.1.smithi111.stdout:2/205: rename d1/d1d/d12 to d1/d29/d53 0 2023-12-08T20:27:47.309 INFO:tasks.workunit.client.1.smithi111.stdout:7/103: dread f6 [0,4194304] 0 2023-12-08T20:27:47.309 INFO:tasks.workunit.client.1.smithi111.stdout:7/104: chown da/d13/f1a 137166284 1 2023-12-08T20:27:47.310 INFO:tasks.workunit.client.1.smithi111.stdout:0/115: symlink d1/df/l26 0 2023-12-08T20:27:47.311 INFO:tasks.workunit.client.1.smithi111.stdout:0/116: write d1/d4/f15 [183037,119736] 0 2023-12-08T20:27:47.314 INFO:tasks.workunit.client.1.smithi111.stdout:7/105: truncate f1 2803310 0 2023-12-08T20:27:47.314 INFO:tasks.workunit.client.1.smithi111.stdout:0/117: dread d1/dd/f18 [0,4194304] 0 2023-12-08T20:27:47.316 INFO:tasks.workunit.client.1.smithi111.stdout:0/118: stat d1/l14 0 2023-12-08T20:27:47.327 INFO:tasks.workunit.client.1.smithi111.stdout:2/206: dwrite d1/d29/d53/f3a [0,4194304] 0 2023-12-08T20:27:47.327 INFO:tasks.workunit.client.1.smithi111.stdout:2/207: dread - d1/d29/d4e/f4d zero size 2023-12-08T20:27:47.327 INFO:tasks.workunit.client.1.smithi111.stdout:2/208: chown d1/d1d/cd 792806540 1 2023-12-08T20:27:47.330 INFO:tasks.workunit.client.1.smithi111.stdout:3/72: sync 2023-12-08T20:27:47.334 INFO:tasks.workunit.client.1.smithi111.stdout:3/73: write d2/d3/fb [244394,41575] 0 2023-12-08T20:27:47.334 INFO:tasks.workunit.client.1.smithi111.stdout:3/74: getdents d2/d3/d13 0 2023-12-08T20:27:47.335 INFO:tasks.workunit.client.1.smithi111.stdout:3/75: creat d2/d3/f16 x:0 0 0 2023-12-08T20:27:47.336 INFO:tasks.workunit.client.1.smithi111.stdout:3/76: mkdir d2/d15/d17 0 2023-12-08T20:27:47.336 INFO:tasks.workunit.client.1.smithi111.stdout:7/106: dwrite f5 [0,4194304] 0 2023-12-08T20:27:47.337 INFO:tasks.workunit.client.1.smithi111.stdout:0/119: dwrite d1/dd/f18 [0,4194304] 0 2023-12-08T20:27:47.337 INFO:tasks.workunit.client.1.smithi111.stdout:7/107: mknod da/d13/c23 0 2023-12-08T20:27:47.339 INFO:tasks.workunit.client.1.smithi111.stdout:7/108: dread da/f1e [0,4194304] 0 2023-12-08T20:27:47.341 INFO:tasks.workunit.client.1.smithi111.stdout:0/120: rename d1/le to d1/d4/d24/l27 0 2023-12-08T20:27:47.343 INFO:tasks.workunit.client.1.smithi111.stdout:0/121: rmdir d1/dd 39 2023-12-08T20:27:47.350 INFO:tasks.workunit.client.1.smithi111.stdout:0/122: symlink d1/l28 0 2023-12-08T20:27:47.353 INFO:tasks.workunit.client.1.smithi111.stdout:0/123: dread d1/d4/f15 [0,4194304] 0 2023-12-08T20:27:47.354 INFO:tasks.workunit.client.1.smithi111.stdout:7/109: dread da/d13/f1a [0,4194304] 0 2023-12-08T20:27:47.355 INFO:tasks.workunit.client.1.smithi111.stdout:0/124: write d1/dd/f18 [555466,63902] 0 2023-12-08T20:27:47.355 INFO:tasks.workunit.client.1.smithi111.stdout:0/125: chown d1/df/d16/l19 7828 1 2023-12-08T20:27:47.357 INFO:tasks.workunit.client.1.smithi111.stdout:7/110: rename da/c12 to da/d13/c24 0 2023-12-08T20:27:47.364 INFO:tasks.workunit.client.1.smithi111.stdout:0/126: dread d1/f10 [0,4194304] 0 2023-12-08T20:27:47.364 INFO:tasks.workunit.client.1.smithi111.stdout:0/127: write d1/d4/f15 [693686,120497] 0 2023-12-08T20:27:47.366 INFO:tasks.workunit.client.1.smithi111.stdout:0/128: mknod d1/dd/c29 0 2023-12-08T20:27:47.367 INFO:tasks.workunit.client.1.smithi111.stdout:3/77: dwrite d2/d3/fb [4194304,4194304] 0 2023-12-08T20:27:47.369 INFO:tasks.workunit.client.1.smithi111.stdout:3/78: mknod d2/d3/d13/c18 0 2023-12-08T20:27:47.373 INFO:tasks.workunit.client.1.smithi111.stdout:0/129: dread d1/dd/f11 [0,4194304] 0 2023-12-08T20:27:47.374 INFO:tasks.workunit.client.1.smithi111.stdout:7/111: dwrite f5 [0,4194304] 0 2023-12-08T20:27:47.374 INFO:tasks.workunit.client.1.smithi111.stdout:3/79: dread d2/d3/d6/f10 [0,4194304] 0 2023-12-08T20:27:47.374 INFO:tasks.workunit.client.1.smithi111.stdout:3/80: chown d2/d3/fb 0 1 2023-12-08T20:27:47.375 INFO:tasks.workunit.client.1.smithi111.stdout:0/130: rename d1/df/l1a to d1/dd/d1f/l2a 0 2023-12-08T20:27:47.375 INFO:tasks.workunit.client.1.smithi111.stdout:0/131: fdatasync d1/f10 0 2023-12-08T20:27:47.375 INFO:tasks.workunit.client.1.smithi111.stdout:7/112: write f5 [3635718,96152] 0 2023-12-08T20:27:47.376 INFO:tasks.workunit.client.1.smithi111.stdout:7/113: stat da/d13/f1a 0 2023-12-08T20:27:47.376 INFO:tasks.workunit.client.1.smithi111.stdout:3/81: link d2/d3/d6/c11 d2/d15/c19 0 2023-12-08T20:27:47.376 INFO:tasks.workunit.client.1.smithi111.stdout:3/82: write d2/d3/d6/f10 [1607726,31634] 0 2023-12-08T20:27:47.378 INFO:tasks.workunit.client.1.smithi111.stdout:3/83: link d2/d3/d6/fe d2/d12/f1a 0 2023-12-08T20:27:47.379 INFO:tasks.workunit.client.1.smithi111.stdout:0/132: symlink d1/d4/l2b 0 2023-12-08T20:27:47.387 INFO:tasks.workunit.client.1.smithi111.stdout:3/84: dread d2/d3/d6/fd [0,4194304] 0 2023-12-08T20:27:47.387 INFO:tasks.workunit.client.1.smithi111.stdout:3/85: rename d2/d15/d17 to d2/d15/d17/d1b 22 2023-12-08T20:27:47.393 INFO:tasks.workunit.client.1.smithi111.stdout:0/133: dread d1/dd/f11 [4194304,4194304] 0 2023-12-08T20:27:47.393 INFO:tasks.workunit.client.1.smithi111.stdout:0/134: read d1/d4/f15 [759358,121520] 0 2023-12-08T20:27:47.393 INFO:tasks.workunit.client.1.smithi111.stdout:0/135: write d1/dd/f18 [3592700,95775] 0 2023-12-08T20:27:47.394 INFO:tasks.workunit.client.1.smithi111.stdout:0/136: fdatasync d1/f10 0 2023-12-08T20:27:47.395 INFO:tasks.workunit.client.1.smithi111.stdout:0/137: rmdir d1/dd 39 2023-12-08T20:27:47.396 INFO:tasks.workunit.client.1.smithi111.stdout:3/86: fsync d2/d12/f1a 0 2023-12-08T20:27:47.396 INFO:tasks.workunit.client.1.smithi111.stdout:7/114: dwrite f5 [0,4194304] 0 2023-12-08T20:27:47.397 INFO:tasks.workunit.client.1.smithi111.stdout:0/138: mkdir d1/df/d16/d2c 0 2023-12-08T20:27:47.399 INFO:tasks.workunit.client.1.smithi111.stdout:0/139: getdents d1/df 0 2023-12-08T20:27:47.402 INFO:tasks.workunit.client.1.smithi111.stdout:0/140: truncate d1/f10 3289308 0 2023-12-08T20:27:47.404 INFO:tasks.workunit.client.1.smithi111.stdout:0/141: unlink d1/d4/f15 0 2023-12-08T20:27:47.405 INFO:tasks.workunit.client.1.smithi111.stdout:0/142: write d1/dd/f11 [7061192,110423] 0 2023-12-08T20:27:47.405 INFO:tasks.workunit.client.1.smithi111.stdout:0/143: fdatasync d1/f10 0 2023-12-08T20:27:47.407 INFO:tasks.workunit.client.1.smithi111.stdout:0/144: write d1/dd/f18 [1809674,89951] 0 2023-12-08T20:27:47.417 INFO:tasks.workunit.client.1.smithi111.stdout:7/115: dwrite f6 [0,4194304] 0 2023-12-08T20:27:47.418 INFO:tasks.workunit.client.1.smithi111.stdout:7/116: write da/d13/f1a [4466187,69852] 0 2023-12-08T20:27:47.435 INFO:tasks.workunit.client.1.smithi111.stdout:3/87: dwrite d2/d3/d6/f10 [0,4194304] 0 2023-12-08T20:27:47.437 INFO:tasks.workunit.client.1.smithi111.stdout:3/88: creat d2/d3/f1c x:0 0 0 2023-12-08T20:27:47.438 INFO:tasks.workunit.client.1.smithi111.stdout:3/89: creat d2/d12/f1d x:0 0 0 2023-12-08T20:27:47.441 INFO:tasks.workunit.client.1.smithi111.stdout:3/90: dread d2/d3/d6/fe [0,4194304] 0 2023-12-08T20:27:47.441 INFO:tasks.workunit.client.1.smithi111.stdout:3/91: readlink d2/lc 0 2023-12-08T20:27:47.441 INFO:tasks.workunit.client.1.smithi111.stdout:3/92: write d2/d3/d6/fe [1194714,69879] 0 2023-12-08T20:27:47.441 INFO:tasks.workunit.client.1.smithi111.stdout:3/93: chown d2 13090071 1 2023-12-08T20:27:47.443 INFO:tasks.workunit.client.1.smithi111.stdout:0/145: dwrite d1/dd/f11 [0,4194304] 0 2023-12-08T20:27:47.451 INFO:tasks.workunit.client.1.smithi111.stdout:3/94: dread d2/f9 [0,4194304] 0 2023-12-08T20:27:47.451 INFO:tasks.workunit.client.1.smithi111.stdout:3/95: write d2/d3/f1c [207525,67027] 0 2023-12-08T20:27:47.452 INFO:tasks.workunit.client.1.smithi111.stdout:4/64: sync 2023-12-08T20:27:47.452 INFO:tasks.workunit.client.1.smithi111.stdout:5/157: sync 2023-12-08T20:27:47.453 INFO:tasks.workunit.client.1.smithi111.stdout:5/158: mknod d3/d4/d7/d1c/d21/c35 0 2023-12-08T20:27:47.453 INFO:tasks.workunit.client.1.smithi111.stdout:3/96: dread f1 [0,4194304] 0 2023-12-08T20:27:47.453 INFO:tasks.workunit.client.1.smithi111.stdout:4/65: creat d8/f15 x:0 0 0 2023-12-08T20:27:47.453 INFO:tasks.workunit.client.1.smithi111.stdout:4/66: chown d8/c13 847 1 2023-12-08T20:27:47.455 INFO:tasks.workunit.client.1.smithi111.stdout:5/159: getdents d3/d12 0 2023-12-08T20:27:47.455 INFO:tasks.workunit.client.1.smithi111.stdout:3/97: dread d2/ff [0,4194304] 0 2023-12-08T20:27:47.456 INFO:tasks.workunit.client.1.smithi111.stdout:5/160: mkdir d3/d4/d7/d36 0 2023-12-08T20:27:47.485 INFO:tasks.workunit.client.1.smithi111.stdout:5/161: dwrite d3/d4/f8 [0,4194304] 0 2023-12-08T20:27:47.485 INFO:tasks.workunit.client.1.smithi111.stdout:5/162: readlink d3/d4/d7/d1c/l26 0 2023-12-08T20:27:47.485 INFO:tasks.workunit.client.1.smithi111.stdout:3/98: dwrite d2/d3/fb [0,4194304] 0 2023-12-08T20:27:47.485 INFO:tasks.workunit.client.1.smithi111.stdout:3/99: stat d2/d3/d13 0 2023-12-08T20:27:47.485 INFO:tasks.workunit.client.1.smithi111.stdout:4/67: dwrite d8/da/dd/fe [0,4194304] 0 2023-12-08T20:27:47.486 INFO:tasks.workunit.client.1.smithi111.stdout:5/163: write d3/d4/f5 [409145,89120] 0 2023-12-08T20:27:47.486 INFO:tasks.workunit.client.1.smithi111.stdout:4/68: write d8/da/dd/fe [3175642,126152] 0 2023-12-08T20:27:47.486 INFO:tasks.workunit.client.1.smithi111.stdout:4/69: chown d8/da/c10 165849 1 2023-12-08T20:27:47.486 INFO:tasks.workunit.client.1.smithi111.stdout:3/100: mkdir d2/d3/d1e 0 2023-12-08T20:27:47.489 INFO:tasks.workunit.client.1.smithi111.stdout:5/164: symlink d3/d4/d7/d29/l37 0 2023-12-08T20:27:47.489 INFO:tasks.workunit.client.1.smithi111.stdout:5/165: fsync d3/d4/d7/f16 0 2023-12-08T20:27:47.489 INFO:tasks.workunit.client.1.smithi111.stdout:5/166: getdents d3/d4/d7/d36 0 2023-12-08T20:27:47.489 INFO:tasks.workunit.client.1.smithi111.stdout:5/167: chown d3/d4/d7/d29/d30 1519 1 2023-12-08T20:27:47.489 INFO:tasks.workunit.client.1.smithi111.stdout:5/168: fdatasync d3/d4/f8 0 2023-12-08T20:27:47.489 INFO:tasks.workunit.client.1.smithi111.stdout:5/169: stat d3/d4/d7/f25 0 2023-12-08T20:27:47.490 INFO:tasks.workunit.client.1.smithi111.stdout:4/70: symlink d8/da/l16 0 2023-12-08T20:27:47.492 INFO:tasks.workunit.client.1.smithi111.stdout:5/170: rename d3/d4/f1d to d3/d12/f38 0 2023-12-08T20:27:47.492 INFO:tasks.workunit.client.1.smithi111.stdout:5/171: chown d3/d4/d7/d29/l37 2684 1 2023-12-08T20:27:47.494 INFO:tasks.workunit.client.1.smithi111.stdout:4/71: mknod d8/c17 0 2023-12-08T20:27:47.494 INFO:tasks.workunit.client.1.smithi111.stdout:4/72: truncate d8/f15 105974 0 2023-12-08T20:27:47.495 INFO:tasks.workunit.client.1.smithi111.stdout:5/172: link d3/d4/d7/d1c/c22 d3/d4/d7/d36/c39 0 2023-12-08T20:27:47.495 INFO:tasks.workunit.client.1.smithi111.stdout:3/101: dread d2/d3/fb [4194304,4194304] 0 2023-12-08T20:27:47.495 INFO:tasks.workunit.client.1.smithi111.stdout:3/102: chown d2/d12/l14 671118 1 2023-12-08T20:27:47.495 INFO:tasks.workunit.client.1.smithi111.stdout:4/73: creat d8/f18 x:0 0 0 2023-12-08T20:27:47.496 INFO:tasks.workunit.client.1.smithi111.stdout:5/173: mknod d3/d4/c3a 0 2023-12-08T20:27:47.497 INFO:tasks.workunit.client.1.smithi111.stdout:3/103: mknod d2/d3/d13/c1f 0 2023-12-08T20:27:47.500 INFO:tasks.workunit.client.1.smithi111.stdout:4/74: creat d8/da/dd/f19 x:0 0 0 2023-12-08T20:27:47.505 INFO:tasks.workunit.client.1.smithi111.stdout:4/75: getdents d8 0 2023-12-08T20:27:47.506 INFO:tasks.workunit.client.1.smithi111.stdout:4/76: creat d8/da/dd/f1a x:0 0 0 2023-12-08T20:27:47.506 INFO:tasks.workunit.client.1.smithi111.stdout:3/104: dread d2/d3/d6/fd [4194304,4194304] 0 2023-12-08T20:27:47.506 INFO:tasks.workunit.client.1.smithi111.stdout:3/105: stat d2/ff 0 2023-12-08T20:27:47.508 INFO:tasks.workunit.client.1.smithi111.stdout:4/77: mkdir d8/da/db/d1b 0 2023-12-08T20:27:47.508 INFO:tasks.workunit.client.1.smithi111.stdout:3/106: unlink d2/lc 0 2023-12-08T20:27:47.509 INFO:tasks.workunit.client.1.smithi111.stdout:4/78: symlink d8/da/dd/l1c 0 2023-12-08T20:27:47.510 INFO:tasks.workunit.client.1.smithi111.stdout:3/107: rename d2/d12/l14 to d2/d3/l20 0 2023-12-08T20:27:47.510 INFO:tasks.workunit.client.1.smithi111.stdout:3/108: readlink d2/d3/l20 0 2023-12-08T20:27:47.513 INFO:tasks.workunit.client.1.smithi111.stdout:4/79: link d8/da/db/l14 d8/da/l1d 0 2023-12-08T20:27:47.513 INFO:tasks.workunit.client.1.smithi111.stdout:4/80: truncate d8/f12 118950 0 2023-12-08T20:27:47.513 INFO:tasks.workunit.client.1.smithi111.stdout:5/174: dread d3/f10 [0,4194304] 0 2023-12-08T20:27:47.513 INFO:tasks.workunit.client.1.smithi111.stdout:5/175: chown d3/d12/l2f 79342 1 2023-12-08T20:27:47.513 INFO:tasks.workunit.client.1.smithi111.stdout:4/81: creat d8/da/f1e x:0 0 0 2023-12-08T20:27:47.514 INFO:tasks.workunit.client.1.smithi111.stdout:5/176: creat d3/d4/d7/d29/f3b x:0 0 0 2023-12-08T20:27:47.516 INFO:tasks.workunit.client.1.smithi111.stdout:5/177: mknod d3/d4/d7/d29/d30/c3c 0 2023-12-08T20:27:47.522 INFO:tasks.workunit.client.1.smithi111.stdout:5/178: creat d3/d4/d7/d36/f3d x:0 0 0 2023-12-08T20:27:47.523 INFO:tasks.workunit.client.1.smithi111.stdout:5/179: creat d3/d4/d7/d2c/f3e x:0 0 0 2023-12-08T20:27:47.530 INFO:tasks.workunit.client.1.smithi111.stdout:5/180: getdents d3/d4/d7/d2c 0 2023-12-08T20:27:47.531 INFO:tasks.workunit.client.1.smithi111.stdout:5/181: chown d3/d4/d7/d29/d30/c3c 6453211 1 2023-12-08T20:27:47.532 INFO:tasks.workunit.client.1.smithi111.stdout:5/182: creat d3/d4/d7/d29/d30/f3f x:0 0 0 2023-12-08T20:27:47.534 INFO:tasks.workunit.client.1.smithi111.stdout:3/109: dwrite d2/d3/fb [4194304,4194304] 0 2023-12-08T20:27:47.535 INFO:tasks.workunit.client.1.smithi111.stdout:3/110: chown d2/d3/d6/f10 819413844 1 2023-12-08T20:27:47.535 INFO:tasks.workunit.client.1.smithi111.stdout:3/111: fdatasync d2/ff 0 2023-12-08T20:27:47.535 INFO:tasks.workunit.client.1.smithi111.stdout:3/112: readlink d2/d3/l20 0 2023-12-08T20:27:47.535 INFO:tasks.workunit.client.1.smithi111.stdout:3/113: chown d2/d3/d6/fe 0 1 2023-12-08T20:27:47.536 INFO:tasks.workunit.client.1.smithi111.stdout:3/114: creat d2/d15/d17/f21 x:0 0 0 2023-12-08T20:27:47.536 INFO:tasks.workunit.client.1.smithi111.stdout:3/115: truncate d2/d12/f1d 406312 0 2023-12-08T20:27:47.536 INFO:tasks.workunit.client.1.smithi111.stdout:3/116: write d2/d3/fb [6020027,37600] 0 2023-12-08T20:27:47.548 INFO:tasks.workunit.client.1.smithi111.stdout:5/183: dwrite d3/d4/d7/d1c/f32 [0,4194304] 0 2023-12-08T20:27:47.554 INFO:tasks.workunit.client.1.smithi111.stdout:3/117: dwrite d2/d3/f1c [0,4194304] 0 2023-12-08T20:27:47.555 INFO:tasks.workunit.client.1.smithi111.stdout:3/118: read d2/d3/fb [4960333,19558] 0 2023-12-08T20:27:47.556 INFO:tasks.workunit.client.1.smithi111.stdout:3/119: write f1 [1990425,53768] 0 2023-12-08T20:27:47.559 INFO:tasks.workunit.client.1.smithi111.stdout:5/184: dread d3/d4/d7/f13 [0,4194304] 0 2023-12-08T20:27:47.559 INFO:tasks.workunit.client.1.smithi111.stdout:3/120: fsync d2/d15/d17/f21 0 2023-12-08T20:27:47.559 INFO:tasks.workunit.client.1.smithi111.stdout:3/121: write d2/d12/f1d [435331,33302] 0 2023-12-08T20:27:47.559 INFO:tasks.workunit.client.1.smithi111.stdout:3/122: write f1 [2034891,43272] 0 2023-12-08T20:27:47.560 INFO:tasks.workunit.client.1.smithi111.stdout:5/185: link c2 d3/d4/d7/d1c/c40 0 2023-12-08T20:27:47.560 INFO:tasks.workunit.client.1.smithi111.stdout:5/186: dread - d3/d4/d7/f16 zero size 2023-12-08T20:27:47.560 INFO:tasks.workunit.client.1.smithi111.stdout:5/187: stat d3/d4/d7/d2c/f3e 0 2023-12-08T20:27:47.561 INFO:tasks.workunit.client.1.smithi111.stdout:3/123: getdents d2/d12 0 2023-12-08T20:27:47.563 INFO:tasks.workunit.client.1.smithi111.stdout:5/188: creat d3/d4/d7/d2c/f41 x:0 0 0 2023-12-08T20:27:47.581 INFO:tasks.workunit.client.1.smithi111.stdout:3/124: dwrite d2/d3/d6/fe [0,4194304] 0 2023-12-08T20:27:47.581 INFO:tasks.workunit.client.1.smithi111.stdout:3/125: write d2/d12/f1d [165386,128647] 0 2023-12-08T20:27:47.581 INFO:tasks.workunit.client.1.smithi111.stdout:3/126: write d2/ff [448722,110451] 0 2023-12-08T20:27:47.583 INFO:tasks.workunit.client.1.smithi111.stdout:1/159: sync 2023-12-08T20:27:47.583 INFO:tasks.workunit.client.1.smithi111.stdout:8/192: sync 2023-12-08T20:27:47.583 INFO:tasks.workunit.client.1.smithi111.stdout:1/160: chown d0/d6/d33/f1c 488942 1 2023-12-08T20:27:47.583 INFO:tasks.workunit.client.1.smithi111.stdout:8/193: creat dd/d35/f43 x:0 0 0 2023-12-08T20:27:47.584 INFO:tasks.workunit.client.1.smithi111.stdout:1/161: mknod d0/d6/d33/c3c 0 2023-12-08T20:27:47.585 INFO:tasks.workunit.client.1.smithi111.stdout:8/194: creat dd/d32/d3d/f44 x:0 0 0 2023-12-08T20:27:47.585 INFO:tasks.workunit.client.1.smithi111.stdout:8/195: chown dd/d2d/l2e 5463 1 2023-12-08T20:27:47.585 INFO:tasks.workunit.client.1.smithi111.stdout:3/127: dread d2/d12/f1d [0,4194304] 0 2023-12-08T20:27:47.585 INFO:tasks.workunit.client.1.smithi111.stdout:1/162: symlink d0/d6/d1b/l3d 0 2023-12-08T20:27:47.586 INFO:tasks.workunit.client.1.smithi111.stdout:1/163: chown d0/f2d 176560019 1 2023-12-08T20:27:47.586 INFO:tasks.workunit.client.1.smithi111.stdout:8/196: creat dd/d2d/f45 x:0 0 0 2023-12-08T20:27:47.586 INFO:tasks.workunit.client.1.smithi111.stdout:8/197: readlink l6 0 2023-12-08T20:27:47.586 INFO:tasks.workunit.client.1.smithi111.stdout:8/198: readlink dd/l27 0 2023-12-08T20:27:47.587 INFO:tasks.workunit.client.1.smithi111.stdout:3/128: symlink d2/d3/d1e/l22 0 2023-12-08T20:27:47.587 INFO:tasks.workunit.client.1.smithi111.stdout:8/199: creat dd/d32/d3d/f46 x:0 0 0 2023-12-08T20:27:47.588 INFO:tasks.workunit.client.1.smithi111.stdout:1/164: dread d0/d6/d33/ff [0,4194304] 0 2023-12-08T20:27:47.588 INFO:tasks.workunit.client.1.smithi111.stdout:3/129: creat d2/d3/d6/f23 x:0 0 0 2023-12-08T20:27:47.589 INFO:tasks.workunit.client.1.smithi111.stdout:3/130: chown d2/d3/d13/c1f 205493 1 2023-12-08T20:27:47.590 INFO:tasks.workunit.client.1.smithi111.stdout:8/200: creat dd/d35/d42/f47 x:0 0 0 2023-12-08T20:27:47.590 INFO:tasks.workunit.client.1.smithi111.stdout:3/131: write d2/d3/d6/fe [1518059,78967] 0 2023-12-08T20:27:47.591 INFO:tasks.workunit.client.1.smithi111.stdout:3/132: symlink d2/d3/d1e/l24 0 2023-12-08T20:27:47.591 INFO:tasks.workunit.client.1.smithi111.stdout:3/133: fsync d2/d15/d17/f21 0 2023-12-08T20:27:47.592 INFO:tasks.workunit.client.1.smithi111.stdout:3/134: write f1 [5133556,66187] 0 2023-12-08T20:27:47.592 INFO:tasks.workunit.client.1.smithi111.stdout:3/135: mkdir d2/d15/d17/d25 0 2023-12-08T20:27:47.593 INFO:tasks.workunit.client.1.smithi111.stdout:3/136: write d2/d3/f1c [1455206,126205] 0 2023-12-08T20:27:47.595 INFO:tasks.workunit.client.1.smithi111.stdout:3/137: link d2/d3/f1c d2/d15/d17/d25/f26 0 2023-12-08T20:27:47.595 INFO:tasks.workunit.client.1.smithi111.stdout:3/138: readlink d2/d3/l20 0 2023-12-08T20:27:47.606 INFO:tasks.workunit.client.1.smithi111.stdout:8/201: dwrite dd/f20 [0,4194304] 0 2023-12-08T20:27:47.606 INFO:tasks.workunit.client.1.smithi111.stdout:8/202: chown dd/f2a 37 1 2023-12-08T20:27:47.628 INFO:tasks.workunit.client.1.smithi111.stdout:8/203: dwrite dd/d2d/f45 [0,4194304] 0 2023-12-08T20:27:47.628 INFO:tasks.workunit.client.1.smithi111.stdout:8/204: write dd/d32/d3d/f44 [1026765,85555] 0 2023-12-08T20:27:47.630 INFO:tasks.workunit.client.1.smithi111.stdout:8/205: rmdir dd/d32 39 2023-12-08T20:27:47.631 INFO:tasks.workunit.client.1.smithi111.stdout:8/206: write dd/f2b [2623337,124229] 0 2023-12-08T20:27:47.633 INFO:tasks.workunit.client.1.smithi111.stdout:8/207: creat dd/d32/f48 x:0 0 0 2023-12-08T20:27:47.633 INFO:tasks.workunit.client.1.smithi111.stdout:8/208: getdents dd/d2d 0 2023-12-08T20:27:47.640 INFO:tasks.workunit.client.1.smithi111.stdout:8/209: dread dd/f14 [0,4194304] 0 2023-12-08T20:27:47.640 INFO:tasks.workunit.client.1.smithi111.stdout:8/210: fsync dd/d35/f3b 0 2023-12-08T20:27:47.648 INFO:tasks.workunit.client.1.smithi111.stdout:8/211: dread dd/f14 [4194304,4194304] 0 2023-12-08T20:27:47.648 INFO:tasks.workunit.client.1.smithi111.stdout:8/212: symlink dd/d35/d42/l49 0 2023-12-08T20:27:47.649 INFO:tasks.workunit.client.1.smithi111.stdout:8/213: link dd/d35/f43 dd/d2d/f4a 0 2023-12-08T20:27:47.658 INFO:tasks.workunit.client.1.smithi111.stdout:8/214: dread fa [0,4194304] 0 2023-12-08T20:27:47.658 INFO:tasks.workunit.client.1.smithi111.stdout:8/215: write dd/d32/d3d/f40 [1018384,81636] 0 2023-12-08T20:27:47.658 INFO:tasks.workunit.client.1.smithi111.stdout:8/216: mkdir dd/d32/d36/d4b 0 2023-12-08T20:27:47.672 INFO:tasks.workunit.client.1.smithi111.stdout:8/217: dwrite dd/d2d/f4a [0,4194304] 0 2023-12-08T20:27:47.675 INFO:tasks.workunit.client.1.smithi111.stdout:8/218: symlink dd/l4c 0 2023-12-08T20:27:47.676 INFO:tasks.workunit.client.1.smithi111.stdout:8/219: symlink dd/d32/d3d/l4d 0 2023-12-08T20:27:47.681 INFO:tasks.workunit.client.1.smithi111.stdout:6/32: sync 2023-12-08T20:27:47.681 INFO:tasks.workunit.client.1.smithi111.stdout:2/209: sync 2023-12-08T20:27:47.681 INFO:tasks.workunit.client.1.smithi111.stdout:7/117: sync 2023-12-08T20:27:47.681 INFO:tasks.workunit.client.1.smithi111.stdout:9/117: sync 2023-12-08T20:27:47.681 INFO:tasks.workunit.client.1.smithi111.stdout:2/210: chown d1/lb 135 1 2023-12-08T20:27:47.681 INFO:tasks.workunit.client.1.smithi111.stdout:9/118: stat d2/d8/dd/f22 0 2023-12-08T20:27:47.681 INFO:tasks.workunit.client.1.smithi111.stdout:9/119: read - d2/d8/dd/f16 zero size 2023-12-08T20:27:47.682 INFO:tasks.workunit.client.1.smithi111.stdout:9/120: mkdir d2/d8/d24 0 2023-12-08T20:27:47.683 INFO:tasks.workunit.client.1.smithi111.stdout:6/33: dread d0/d1/f6 [0,4194304] 0 2023-12-08T20:27:47.688 INFO:tasks.workunit.client.1.smithi111.stdout:7/118: dread f1 [0,4194304] 0 2023-12-08T20:27:47.690 INFO:tasks.workunit.client.1.smithi111.stdout:7/119: truncate da/d13/f17 874318 0 2023-12-08T20:27:47.697 INFO:tasks.workunit.client.1.smithi111.stdout:7/120: fsync da/d13/f17 0 2023-12-08T20:27:47.699 INFO:tasks.workunit.client.1.smithi111.stdout:7/121: mkdir da/d25 0 2023-12-08T20:27:47.705 INFO:tasks.workunit.client.1.smithi111.stdout:2/211: dwrite d1/d1d/f26 [0,4194304] 0 2023-12-08T20:27:47.705 INFO:tasks.workunit.client.1.smithi111.stdout:2/212: readlink d1/d1d/d1f/d25/l40 0 2023-12-08T20:27:47.706 INFO:tasks.workunit.client.1.smithi111.stdout:2/213: write d1/d29/d4e/f32 [92330,65035] 0 2023-12-08T20:27:47.706 INFO:tasks.workunit.client.1.smithi111.stdout:2/214: unlink d1/d1d/ca 0 2023-12-08T20:27:47.706 INFO:tasks.workunit.client.1.smithi111.stdout:2/215: write d1/d1d/d22/f2c [1900911,1907] 0 2023-12-08T20:27:47.706 INFO:tasks.workunit.client.1.smithi111.stdout:2/216: truncate d1/d29/d4e/f32 422096 0 2023-12-08T20:27:47.707 INFO:tasks.workunit.client.1.smithi111.stdout:9/121: dwrite d2/da/f11 [4194304,4194304] 0 2023-12-08T20:27:47.708 INFO:tasks.workunit.client.1.smithi111.stdout:2/217: rename d1/d1d/d1f/f3c to d1/d1d/d1f/d25/d3d/d41/f54 0 2023-12-08T20:27:47.708 INFO:tasks.workunit.client.1.smithi111.stdout:2/218: fsync d1/d1d/f16 0 2023-12-08T20:27:47.709 INFO:tasks.workunit.client.1.smithi111.stdout:6/34: dwrite d0/d1/f5 [4194304,4194304] 0 2023-12-08T20:27:47.710 INFO:tasks.workunit.client.1.smithi111.stdout:9/122: rename d2/da/l20 to d2/d8/dd/d1a/l25 0 2023-12-08T20:27:47.711 INFO:tasks.workunit.client.1.smithi111.stdout:2/219: truncate d1/d1d/f33 4056878 0 2023-12-08T20:27:47.711 INFO:tasks.workunit.client.1.smithi111.stdout:2/220: write d1/d1d/d22/f2c [618153,128363] 0 2023-12-08T20:27:47.712 INFO:tasks.workunit.client.1.smithi111.stdout:2/221: fsync d1/d1d/f16 0 2023-12-08T20:27:47.713 INFO:tasks.workunit.client.1.smithi111.stdout:6/35: creat d0/d1/f8 x:0 0 0 2023-12-08T20:27:47.713 INFO:tasks.workunit.client.1.smithi111.stdout:9/123: creat d2/d8/dd/d1a/d1e/f26 x:0 0 0 2023-12-08T20:27:47.719 INFO:tasks.workunit.client.1.smithi111.stdout:9/124: symlink d2/d8/dd/d1a/l27 0 2023-12-08T20:27:47.721 INFO:tasks.workunit.client.1.smithi111.stdout:9/125: creat d2/d8/dd/d1a/d1e/d23/f28 x:0 0 0 2023-12-08T20:27:47.721 INFO:tasks.workunit.client.1.smithi111.stdout:9/126: truncate d2/d8/dd/f22 60794 0 2023-12-08T20:27:47.722 INFO:tasks.workunit.client.1.smithi111.stdout:9/127: rename d2/d8/dd/d1a/l25 to d2/l29 0 2023-12-08T20:27:47.722 INFO:tasks.workunit.client.1.smithi111.stdout:9/128: chown d2/l29 25708242 1 2023-12-08T20:27:47.733 INFO:tasks.workunit.client.1.smithi111.stdout:6/36: dwrite d0/d1/f7 [0,4194304] 0 2023-12-08T20:27:47.733 INFO:tasks.workunit.client.1.smithi111.stdout:6/37: chown d0/d1 1 1 2023-12-08T20:27:47.733 INFO:tasks.workunit.client.1.smithi111.stdout:2/222: dwrite d1/d1d/f16 [0,4194304] 0 2023-12-08T20:27:47.733 INFO:tasks.workunit.client.1.smithi111.stdout:2/223: chown d1/d1d/d22/c24 13243216 1 2023-12-08T20:27:47.735 INFO:tasks.workunit.client.1.smithi111.stdout:6/38: symlink d0/d1/l9 0 2023-12-08T20:27:47.739 INFO:tasks.workunit.client.1.smithi111.stdout:2/224: rename d1/d1d/d1f/d25/d48 to d1/d1d/d55 0 2023-12-08T20:27:47.742 INFO:tasks.workunit.client.1.smithi111.stdout:9/129: dwrite d2/d8/dd/f22 [0,4194304] 0 2023-12-08T20:27:47.743 INFO:tasks.workunit.client.1.smithi111.stdout:2/225: mkdir d1/d1d/d1f/d25/d3d/d56 0 2023-12-08T20:27:47.746 INFO:tasks.workunit.client.1.smithi111.stdout:9/130: link d2/d8/c19 d2/d8/dd/d1a/c2a 0 2023-12-08T20:27:47.750 INFO:tasks.workunit.client.1.smithi111.stdout:6/39: rmdir d0 39 2023-12-08T20:27:47.752 INFO:tasks.workunit.client.1.smithi111.stdout:6/40: dread d0/d1/f6 [0,4194304] 0 2023-12-08T20:27:47.753 INFO:tasks.workunit.client.1.smithi111.stdout:6/41: symlink d0/d1/la 0 2023-12-08T20:27:47.755 INFO:tasks.workunit.client.1.smithi111.stdout:6/42: mknod d0/cb 0 2023-12-08T20:27:47.755 INFO:tasks.workunit.client.1.smithi111.stdout:6/43: write d0/d1/f8 [83901,98070] 0 2023-12-08T20:27:47.757 INFO:tasks.workunit.client.1.smithi111.stdout:6/44: rename d0/cb to d0/d1/cc 0 2023-12-08T20:27:47.757 INFO:tasks.workunit.client.1.smithi111.stdout:6/45: chown d0/d1/f7 114946 1 2023-12-08T20:27:47.759 INFO:tasks.workunit.client.1.smithi111.stdout:6/46: symlink d0/ld 0 2023-12-08T20:27:47.759 INFO:tasks.workunit.client.1.smithi111.stdout:6/47: chown d0/d1/f5 375823547 1 2023-12-08T20:27:47.760 INFO:tasks.workunit.client.1.smithi111.stdout:9/131: dwrite d2/d8/f21 [0,4194304] 0 2023-12-08T20:27:47.760 INFO:tasks.workunit.client.1.smithi111.stdout:9/132: fsync d2/d8/dd/f16 0 2023-12-08T20:27:47.769 INFO:tasks.workunit.client.1.smithi111.stdout:6/48: dread d0/d1/f5 [0,4194304] 0 2023-12-08T20:27:47.774 INFO:tasks.workunit.client.1.smithi111.stdout:6/49: truncate d0/d1/f5 3254579 0 2023-12-08T20:27:47.777 INFO:tasks.workunit.client.1.smithi111.stdout:9/133: dwrite d2/da/fc [0,4194304] 0 2023-12-08T20:27:47.777 INFO:tasks.workunit.client.1.smithi111.stdout:9/134: chown d2/da/fc 29445 1 2023-12-08T20:27:47.777 INFO:tasks.workunit.client.1.smithi111.stdout:6/50: fsync d0/d1/f8 0 2023-12-08T20:27:47.777 INFO:tasks.workunit.client.1.smithi111.stdout:6/51: write d0/d1/f8 [676017,123706] 0 2023-12-08T20:27:47.783 INFO:tasks.workunit.client.1.smithi111.stdout:6/52: write d0/d1/f5 [709012,62501] 0 2023-12-08T20:27:47.788 INFO:tasks.workunit.client.1.smithi111.stdout:6/53: write d0/d1/f7 [513364,64589] 0 2023-12-08T20:27:47.789 INFO:tasks.workunit.client.1.smithi111.stdout:9/135: dwrite d2/d8/dd/d1a/d1e/f26 [0,4194304] 0 2023-12-08T20:27:47.790 INFO:tasks.workunit.client.1.smithi111.stdout:6/54: dread d0/d1/f6 [0,4194304] 0 2023-12-08T20:27:47.791 INFO:tasks.workunit.client.1.smithi111.stdout:9/136: mknod d2/d8/dd/d1a/c2b 0 2023-12-08T20:27:47.793 INFO:tasks.workunit.client.1.smithi111.stdout:6/55: creat d0/d1/fe x:0 0 0 2023-12-08T20:27:47.793 INFO:tasks.workunit.client.1.smithi111.stdout:6/56: chown d0/ld 16967 1 2023-12-08T20:27:47.793 INFO:tasks.workunit.client.1.smithi111.stdout:6/57: write d0/d1/fe [709686,84905] 0 2023-12-08T20:27:47.794 INFO:tasks.workunit.client.1.smithi111.stdout:9/137: creat d2/f2c x:0 0 0 2023-12-08T20:27:47.794 INFO:tasks.workunit.client.1.smithi111.stdout:9/138: chown d2/d8/dd/d1a/d1e/f26 247814 1 2023-12-08T20:27:47.798 INFO:tasks.workunit.client.1.smithi111.stdout:9/139: rename d2/d8/d24 to d2/d8/dd/d1a/d1e/d2d 0 2023-12-08T20:27:47.803 INFO:tasks.workunit.client.1.smithi111.stdout:6/58: dread d0/d1/f7 [0,4194304] 0 2023-12-08T20:27:47.807 INFO:tasks.workunit.client.1.smithi111.stdout:6/59: dread d0/d1/f5 [0,4194304] 0 2023-12-08T20:27:47.807 INFO:tasks.workunit.client.1.smithi111.stdout:6/60: rename d0 to d0/df 22 2023-12-08T20:27:47.810 INFO:tasks.workunit.client.1.smithi111.stdout:6/61: creat d0/f10 x:0 0 0 2023-12-08T20:27:47.813 INFO:tasks.workunit.client.1.smithi111.stdout:9/140: dwrite d2/d8/dd/f22 [4194304,4194304] 0 2023-12-08T20:27:47.817 INFO:tasks.workunit.client.1.smithi111.stdout:9/141: rename d2/da/lb to d2/d8/l2e 0 2023-12-08T20:27:47.817 INFO:tasks.workunit.client.1.smithi111.stdout:6/62: rmdir d0 39 2023-12-08T20:27:47.819 INFO:tasks.workunit.client.1.smithi111.stdout:9/142: mknod d2/c2f 0 2023-12-08T20:27:47.819 INFO:tasks.workunit.client.1.smithi111.stdout:6/63: rmdir d0/d1 39 2023-12-08T20:27:47.821 INFO:tasks.workunit.client.1.smithi111.stdout:9/143: rename d2/d8/dd/d1a/d1e/f1f to d2/d8/dd/d1a/d1e/d2d/f30 0 2023-12-08T20:27:47.822 INFO:tasks.workunit.client.1.smithi111.stdout:6/64: rename d0/f10 to d0/d1/f11 0 2023-12-08T20:27:47.822 INFO:tasks.workunit.client.1.smithi111.stdout:6/65: fdatasync d0/d1/f7 0 2023-12-08T20:27:47.822 INFO:tasks.workunit.client.1.smithi111.stdout:6/66: readlink d0/d1/l9 0 2023-12-08T20:27:47.823 INFO:tasks.workunit.client.1.smithi111.stdout:6/67: write d0/d1/f6 [518754,118252] 0 2023-12-08T20:27:47.823 INFO:tasks.workunit.client.1.smithi111.stdout:6/68: write d0/d1/f5 [3610564,74253] 0 2023-12-08T20:27:47.823 INFO:tasks.workunit.client.1.smithi111.stdout:6/69: write d0/d1/f8 [785806,88481] 0 2023-12-08T20:27:47.823 INFO:tasks.workunit.client.1.smithi111.stdout:9/144: rename d2/d8/dd/f16 to d2/d8/dd/d1a/d1e/d2d/f31 0 2023-12-08T20:27:47.824 INFO:tasks.workunit.client.1.smithi111.stdout:6/70: creat d0/f12 x:0 0 0 2023-12-08T20:27:47.825 INFO:tasks.workunit.client.1.smithi111.stdout:9/145: rename d2/l12 to d2/d8/dd/d1a/d1e/d2d/l32 0 2023-12-08T20:27:47.826 INFO:tasks.workunit.client.1.smithi111.stdout:9/146: symlink d2/d8/dd/l33 0 2023-12-08T20:27:47.828 INFO:tasks.workunit.client.1.smithi111.stdout:9/147: rename d2/l29 to d2/d8/dd/l34 0 2023-12-08T20:27:47.828 INFO:tasks.workunit.client.1.smithi111.stdout:9/148: fdatasync d2/da/fc 0 2023-12-08T20:27:47.828 INFO:tasks.workunit.client.1.smithi111.stdout:9/149: dread d2/d8/dd/d1a/f1b [0,4194304] 0 2023-12-08T20:27:47.835 INFO:tasks.workunit.client.1.smithi111.stdout:6/71: getdents d0 0 2023-12-08T20:27:47.837 INFO:tasks.workunit.client.1.smithi111.stdout:6/72: creat d0/f13 x:0 0 0 2023-12-08T20:27:47.837 INFO:tasks.workunit.client.1.smithi111.stdout:6/73: readlink d0/d1/la 0 2023-12-08T20:27:47.838 INFO:tasks.workunit.client.1.smithi111.stdout:6/74: symlink d0/d1/l14 0 2023-12-08T20:27:47.839 INFO:tasks.workunit.client.1.smithi111.stdout:9/150: dread d2/d8/f14 [0,4194304] 0 2023-12-08T20:27:47.839 INFO:tasks.workunit.client.1.smithi111.stdout:6/75: mknod d0/d1/c15 0 2023-12-08T20:27:47.840 INFO:tasks.workunit.client.1.smithi111.stdout:9/151: mkdir d2/d8/dd/d1a/d1e/d2d/d35 0 2023-12-08T20:27:47.844 INFO:tasks.workunit.client.1.smithi111.stdout:9/152: write d2/d8/dd/f22 [1240603,45942] 0 2023-12-08T20:27:47.844 INFO:tasks.workunit.client.1.smithi111.stdout:9/153: stat d2/da/f11 0 2023-12-08T20:27:47.844 INFO:tasks.workunit.client.1.smithi111.stdout:9/154: fdatasync d2/d8/f18 0 2023-12-08T20:27:47.846 INFO:tasks.workunit.client.1.smithi111.stdout:9/155: creat d2/d8/f36 x:0 0 0 2023-12-08T20:27:47.846 INFO:tasks.workunit.client.1.smithi111.stdout:9/156: readlink d2/d8/dd/d1a/l27 0 2023-12-08T20:27:47.847 INFO:tasks.workunit.client.1.smithi111.stdout:9/157: rename d2/c17 to d2/da/c37 0 2023-12-08T20:27:47.849 INFO:tasks.workunit.client.1.smithi111.stdout:9/158: rename d2/c1c to d2/d8/dd/d1a/d1e/d2d/c38 0 2023-12-08T20:27:47.849 INFO:tasks.workunit.client.1.smithi111.stdout:9/159: write d2/f2c [432538,22412] 0 2023-12-08T20:27:47.850 INFO:tasks.workunit.client.1.smithi111.stdout:9/160: symlink d2/l39 0 2023-12-08T20:27:47.851 INFO:tasks.workunit.client.1.smithi111.stdout:9/161: symlink d2/d8/dd/d1a/d1e/d2d/d35/l3a 0 2023-12-08T20:27:47.851 INFO:tasks.workunit.client.1.smithi111.stdout:9/162: fsync d2/d8/dd/d1a/d1e/d23/f28 0 2023-12-08T20:27:47.852 INFO:tasks.workunit.client.1.smithi111.stdout:9/163: truncate d2/f7 923835 0 2023-12-08T20:27:47.855 INFO:tasks.workunit.client.1.smithi111.stdout:6/76: dwrite d0/d1/f6 [0,4194304] 0 2023-12-08T20:27:47.855 INFO:tasks.workunit.client.1.smithi111.stdout:6/77: stat d0/d1/l14 0 2023-12-08T20:27:47.855 INFO:tasks.workunit.client.1.smithi111.stdout:6/78: dread - d0/d1/f11 zero size 2023-12-08T20:27:47.855 INFO:tasks.workunit.client.1.smithi111.stdout:9/164: write d2/d8/dd/f22 [4626935,12784] 0 2023-12-08T20:27:47.855 INFO:tasks.workunit.client.1.smithi111.stdout:9/165: truncate d2/d8/dd/d1a/d1e/d2d/f31 909020 0 2023-12-08T20:27:47.855 INFO:tasks.workunit.client.1.smithi111.stdout:9/166: write d2/d8/dd/d1a/d1e/d2d/f30 [571567,62549] 0 2023-12-08T20:27:47.862 INFO:tasks.workunit.client.1.smithi111.stdout:9/167: link d2/d8/dd/d1a/d1e/d2d/c38 d2/d8/dd/d1a/d1e/d23/c3b 0 2023-12-08T20:27:47.862 INFO:tasks.workunit.client.1.smithi111.stdout:9/168: truncate d2/d8/dd/d1a/f1b 1434864 0 2023-12-08T20:27:47.864 INFO:tasks.workunit.client.1.smithi111.stdout:9/169: unlink d2/d8/l2e 0 2023-12-08T20:27:47.870 INFO:tasks.workunit.client.1.smithi111.stdout:6/79: dwrite d0/d1/fe [0,4194304] 0 2023-12-08T20:27:47.870 INFO:tasks.workunit.client.1.smithi111.stdout:6/80: truncate d0/d1/f8 1877035 0 2023-12-08T20:27:47.870 INFO:tasks.workunit.client.1.smithi111.stdout:6/81: stat d0/d1/l14 0 2023-12-08T20:27:47.872 INFO:tasks.workunit.client.1.smithi111.stdout:6/82: dread d0/d1/f8 [0,4194304] 0 2023-12-08T20:27:47.875 INFO:tasks.workunit.client.1.smithi111.stdout:9/170: dread d2/d8/dd/d1a/d1e/f26 [0,4194304] 0 2023-12-08T20:27:47.875 INFO:tasks.workunit.client.1.smithi111.stdout:9/171: dread - d2/d8/dd/d1a/d1e/d23/f28 zero size 2023-12-08T20:27:47.876 INFO:tasks.workunit.client.1.smithi111.stdout:9/172: mknod d2/d8/dd/d1a/c3c 0 2023-12-08T20:27:47.892 INFO:tasks.workunit.client.1.smithi111.stdout:9/173: dwrite d2/d8/f36 [0,4194304] 0 2023-12-08T20:27:47.892 INFO:tasks.workunit.client.1.smithi111.stdout:6/83: dwrite d0/d1/f7 [4194304,4194304] 0 2023-12-08T20:27:47.900 INFO:tasks.workunit.client.1.smithi111.stdout:9/174: dread d2/d8/f36 [0,4194304] 0 2023-12-08T20:27:47.903 INFO:tasks.workunit.client.1.smithi111.stdout:4/82: sync 2023-12-08T20:27:47.903 INFO:tasks.workunit.client.1.smithi111.stdout:5/189: sync 2023-12-08T20:27:47.903 INFO:tasks.workunit.client.1.smithi111.stdout:0/146: sync 2023-12-08T20:27:47.903 INFO:tasks.workunit.client.1.smithi111.stdout:4/83: dread - d8/da/f1e zero size 2023-12-08T20:27:47.904 INFO:tasks.workunit.client.1.smithi111.stdout:5/190: mknod d3/d4/d7/d2c/c42 0 2023-12-08T20:27:47.905 INFO:tasks.workunit.client.1.smithi111.stdout:5/191: write d3/d4/d7/f13 [190801,29189] 0 2023-12-08T20:27:47.906 INFO:tasks.workunit.client.1.smithi111.stdout:4/84: rename d8/da/dd to d8/da/db/d1b/d1f 0 2023-12-08T20:27:47.906 INFO:tasks.workunit.client.1.smithi111.stdout:4/85: chown d8/da 23785300 1 2023-12-08T20:27:47.907 INFO:tasks.workunit.client.1.smithi111.stdout:0/147: mkdir d1/d2d 0 2023-12-08T20:27:47.908 INFO:tasks.workunit.client.1.smithi111.stdout:4/86: creat d8/da/f20 x:0 0 0 2023-12-08T20:27:47.908 INFO:tasks.workunit.client.1.smithi111.stdout:4/87: readlink d8/l9 0 2023-12-08T20:27:47.908 INFO:tasks.workunit.client.1.smithi111.stdout:0/148: creat d1/df/d16/f2e x:0 0 0 2023-12-08T20:27:47.909 INFO:tasks.workunit.client.1.smithi111.stdout:4/88: truncate f6 2610053 0 2023-12-08T20:27:47.915 INFO:tasks.workunit.client.1.smithi111.stdout:9/175: dwrite d2/d8/dd/d1a/f1b [0,4194304] 0 2023-12-08T20:27:47.920 INFO:tasks.workunit.client.1.smithi111.stdout:9/176: creat d2/d8/dd/d1a/d1e/d2d/f3d x:0 0 0 2023-12-08T20:27:47.921 INFO:tasks.workunit.client.1.smithi111.stdout:9/177: read d2/d8/dd/d1a/d1e/d2d/f31 [374699,89114] 0 2023-12-08T20:27:47.927 INFO:tasks.workunit.client.1.smithi111.stdout:5/192: dwrite d3/d4/d7/f25 [0,4194304] 0 2023-12-08T20:27:47.927 INFO:tasks.workunit.client.1.smithi111.stdout:5/193: write d3/d12/f17 [477700,10547] 0 2023-12-08T20:27:47.927 INFO:tasks.workunit.client.1.smithi111.stdout:5/194: dread - d3/d4/d7/d36/f3d zero size 2023-12-08T20:27:47.930 INFO:tasks.workunit.client.1.smithi111.stdout:0/149: dwrite d1/dd/f18 [4194304,4194304] 0 2023-12-08T20:27:47.930 INFO:tasks.workunit.client.1.smithi111.stdout:0/150: fsync d1/dd/f11 0 2023-12-08T20:27:47.930 INFO:tasks.workunit.client.1.smithi111.stdout:0/151: chown d1/l28 429 1 2023-12-08T20:27:47.930 INFO:tasks.workunit.client.1.smithi111.stdout:9/178: dread d2/d8/dd/d1a/d1e/d2d/f30 [0,4194304] 0 2023-12-08T20:27:47.930 INFO:tasks.workunit.client.1.smithi111.stdout:9/179: chown d2/d8/dd/d1a/d1e/d2d/d35/l3a 0 1 2023-12-08T20:27:47.930 INFO:tasks.workunit.client.1.smithi111.stdout:5/195: write d3/d4/f5 [946564,86981] 0 2023-12-08T20:27:47.930 INFO:tasks.workunit.client.1.smithi111.stdout:5/196: truncate d3/d4/d7/d36/f3d 500431 0 2023-12-08T20:27:47.931 INFO:tasks.workunit.client.1.smithi111.stdout:4/89: dwrite d8/da/db/d1b/d1f/fe [0,4194304] 0 2023-12-08T20:27:47.931 INFO:tasks.workunit.client.1.smithi111.stdout:4/90: readlink d8/da/l1d 0 2023-12-08T20:27:47.931 INFO:tasks.workunit.client.1.smithi111.stdout:0/152: mkdir d1/d4/d24/d2f 0 2023-12-08T20:27:47.933 INFO:tasks.workunit.client.1.smithi111.stdout:9/180: creat d2/d8/dd/d1a/d1e/d2d/d35/f3e x:0 0 0 2023-12-08T20:27:47.933 INFO:tasks.workunit.client.1.smithi111.stdout:9/181: fsync d2/d8/f21 0 2023-12-08T20:27:47.933 INFO:tasks.workunit.client.1.smithi111.stdout:5/197: creat d3/d4/d7/d2c/f43 x:0 0 0 2023-12-08T20:27:47.935 INFO:tasks.workunit.client.1.smithi111.stdout:4/91: rmdir d8/da/db/d1b/d1f 39 2023-12-08T20:27:47.935 INFO:tasks.workunit.client.1.smithi111.stdout:4/92: fsync d8/f12 0 2023-12-08T20:27:47.937 INFO:tasks.workunit.client.1.smithi111.stdout:0/153: creat d1/f30 x:0 0 0 2023-12-08T20:27:47.937 INFO:tasks.workunit.client.1.smithi111.stdout:0/154: getdents d1/df/d16/d2c 0 2023-12-08T20:27:47.937 INFO:tasks.workunit.client.1.smithi111.stdout:0/155: dread - d1/df/d16/f2e zero size 2023-12-08T20:27:47.937 INFO:tasks.workunit.client.1.smithi111.stdout:9/182: mkdir d2/d8/dd/d3f 0 2023-12-08T20:27:47.939 INFO:tasks.workunit.client.1.smithi111.stdout:5/198: creat d3/d4/d7/d36/f44 x:0 0 0 2023-12-08T20:27:47.939 INFO:tasks.workunit.client.1.smithi111.stdout:5/199: fdatasync d3/d4/f8 0 2023-12-08T20:27:47.940 INFO:tasks.workunit.client.1.smithi111.stdout:0/156: rename d1/d4/lb to d1/df/d16/d2c/l31 0 2023-12-08T20:27:47.941 INFO:tasks.workunit.client.1.smithi111.stdout:9/183: creat d2/d8/f40 x:0 0 0 2023-12-08T20:27:47.941 INFO:tasks.workunit.client.1.smithi111.stdout:0/157: chown d1/c8 128529 1 2023-12-08T20:27:47.945 INFO:tasks.workunit.client.1.smithi111.stdout:9/184: link d2/d8/f21 d2/d8/dd/d1a/d1e/d2d/d35/f41 0 2023-12-08T20:27:47.946 INFO:tasks.workunit.client.1.smithi111.stdout:0/158: symlink d1/dd/l32 0 2023-12-08T20:27:47.946 INFO:tasks.workunit.client.1.smithi111.stdout:4/93: dread f1 [0,4194304] 0 2023-12-08T20:27:47.946 INFO:tasks.workunit.client.1.smithi111.stdout:9/185: mknod d2/d8/dd/d1a/c42 0 2023-12-08T20:27:47.947 INFO:tasks.workunit.client.1.smithi111.stdout:4/94: write f0 [2694161,119472] 0 2023-12-08T20:27:47.947 INFO:tasks.workunit.client.1.smithi111.stdout:4/95: dread - d8/da/db/d1b/d1f/f1a zero size 2023-12-08T20:27:47.948 INFO:tasks.workunit.client.1.smithi111.stdout:9/186: write d2/d8/dd/d1a/f1b [129174,82143] 0 2023-12-08T20:27:47.949 INFO:tasks.workunit.client.1.smithi111.stdout:0/159: mknod d1/dd/c33 0 2023-12-08T20:27:47.951 INFO:tasks.workunit.client.1.smithi111.stdout:0/160: link d1/df/d16/l19 d1/dd/l34 0 2023-12-08T20:27:47.952 INFO:tasks.workunit.client.1.smithi111.stdout:0/161: chown d1/d4/c13 1573261034 1 2023-12-08T20:27:47.956 INFO:tasks.workunit.client.1.smithi111.stdout:0/162: read d1/dd/f18 [3460802,29625] 0 2023-12-08T20:27:47.956 INFO:tasks.workunit.client.1.smithi111.stdout:0/163: getdents d1/d2d 0 2023-12-08T20:27:47.956 INFO:tasks.workunit.client.1.smithi111.stdout:0/164: stat d1/dd/c33 0 2023-12-08T20:27:47.958 INFO:tasks.workunit.client.1.smithi111.stdout:5/200: dwrite d3/d4/f5 [0,4194304] 0 2023-12-08T20:27:47.958 INFO:tasks.workunit.client.1.smithi111.stdout:5/201: write d3/f10 [4672133,28173] 0 2023-12-08T20:27:47.959 INFO:tasks.workunit.client.1.smithi111.stdout:0/165: dread d1/f10 [0,4194304] 0 2023-12-08T20:27:47.959 INFO:tasks.workunit.client.1.smithi111.stdout:9/187: dread d2/da/f11 [4194304,4194304] 0 2023-12-08T20:27:47.959 INFO:tasks.workunit.client.1.smithi111.stdout:9/188: readlink d2/d8/dd/d1a/l27 0 2023-12-08T20:27:47.959 INFO:tasks.workunit.client.1.smithi111.stdout:9/189: read - d2/d8/dd/d1a/d1e/d2d/d35/f3e zero size 2023-12-08T20:27:47.960 INFO:tasks.workunit.client.1.smithi111.stdout:5/202: getdents d3/d4 0 2023-12-08T20:27:47.961 INFO:tasks.workunit.client.1.smithi111.stdout:0/166: getdents d1/d4/d24 0 2023-12-08T20:27:47.963 INFO:tasks.workunit.client.1.smithi111.stdout:9/190: rename d2/d8/dd/d1a/c2a to d2/c43 0 2023-12-08T20:27:47.963 INFO:tasks.workunit.client.1.smithi111.stdout:9/191: dread - d2/d8/f40 zero size 2023-12-08T20:27:47.965 INFO:tasks.workunit.client.1.smithi111.stdout:0/167: creat d1/d4/f35 x:0 0 0 2023-12-08T20:27:47.966 INFO:tasks.workunit.client.1.smithi111.stdout:9/192: creat d2/d8/dd/f44 x:0 0 0 2023-12-08T20:27:47.981 INFO:tasks.workunit.client.1.smithi111.stdout:0/168: dread d1/dd/f11 [4194304,4194304] 0 2023-12-08T20:27:47.982 INFO:tasks.workunit.client.1.smithi111.stdout:5/203: dwrite d3/f10 [0,4194304] 0 2023-12-08T20:27:47.982 INFO:tasks.workunit.client.1.smithi111.stdout:5/204: stat d3/d4/ld 0 2023-12-08T20:27:47.985 INFO:tasks.workunit.client.1.smithi111.stdout:9/193: dwrite d2/d8/dd/d1a/f1b [4194304,4194304] 0 2023-12-08T20:27:47.987 INFO:tasks.workunit.client.1.smithi111.stdout:9/194: symlink d2/d8/dd/d1a/d1e/d2d/d35/l45 0 2023-12-08T20:27:47.987 INFO:tasks.workunit.client.1.smithi111.stdout:9/195: chown d2/d8/f18 50 1 2023-12-08T20:27:47.988 INFO:tasks.workunit.client.1.smithi111.stdout:9/196: rmdir d2/d8/dd/d1a 39 2023-12-08T20:27:47.988 INFO:tasks.workunit.client.1.smithi111.stdout:9/197: dread - d2/d8/dd/d1a/d1e/d2d/f3d zero size 2023-12-08T20:27:47.989 INFO:tasks.workunit.client.1.smithi111.stdout:9/198: chown d2/d8/dd/d1a/d1e/d2d/f3d 51 1 2023-12-08T20:27:47.989 INFO:tasks.workunit.client.1.smithi111.stdout:9/199: readlink d2/d8/dd/d1a/d1e/d2d/d35/l3a 0 2023-12-08T20:27:47.989 INFO:tasks.workunit.client.1.smithi111.stdout:9/200: fdatasync d2/d8/dd/d1a/d1e/d2d/d35/f3e 0 2023-12-08T20:27:47.989 INFO:tasks.workunit.client.1.smithi111.stdout:9/201: dread - d2/d8/dd/d1a/d1e/d23/f28 zero size 2023-12-08T20:27:47.989 INFO:tasks.workunit.client.1.smithi111.stdout:9/202: symlink d2/d8/dd/d1a/d1e/d23/l46 0 2023-12-08T20:27:47.991 INFO:tasks.workunit.client.1.smithi111.stdout:9/203: unlink d2/da/f11 0 2023-12-08T20:27:47.993 INFO:tasks.workunit.client.1.smithi111.stdout:9/204: unlink d2/d8/dd/f44 0 2023-12-08T20:27:47.995 INFO:tasks.workunit.client.1.smithi111.stdout:9/205: write d2/d8/dd/d1a/d1e/d2d/d35/f41 [969838,48728] 0 2023-12-08T20:27:47.995 INFO:tasks.workunit.client.1.smithi111.stdout:9/206: fsync d2/d8/f36 0 2023-12-08T20:27:47.995 INFO:tasks.workunit.client.1.smithi111.stdout:9/207: fsync d2/d8/dd/f22 0 2023-12-08T20:27:47.997 INFO:tasks.workunit.client.1.smithi111.stdout:9/208: symlink d2/l47 0 2023-12-08T20:27:47.998 INFO:tasks.workunit.client.1.smithi111.stdout:9/209: rename d2/d8/dd/d1a/d1e/d2d/f30 to d2/d8/dd/d1a/d1e/d23/f48 0 2023-12-08T20:27:48.000 INFO:tasks.workunit.client.1.smithi111.stdout:0/169: dwrite d1/f10 [0,4194304] 0 2023-12-08T20:27:48.000 INFO:tasks.workunit.client.1.smithi111.stdout:0/170: write d1/f30 [786226,95896] 0 2023-12-08T20:27:48.000 INFO:tasks.workunit.client.1.smithi111.stdout:0/171: truncate d1/f30 1835931 0 2023-12-08T20:27:48.000 INFO:tasks.workunit.client.1.smithi111.stdout:5/205: dwrite d3/d4/d7/d29/f3b [0,4194304] 0 2023-12-08T20:27:48.005 INFO:tasks.workunit.client.1.smithi111.stdout:0/172: chown d1/l1b 216314 1 2023-12-08T20:27:48.005 INFO:tasks.workunit.client.1.smithi111.stdout:0/173: dread - d1/d4/f35 zero size 2023-12-08T20:27:48.006 INFO:tasks.workunit.client.1.smithi111.stdout:0/174: truncate d1/df/d16/f2e 317571 0 2023-12-08T20:27:48.007 INFO:tasks.workunit.client.1.smithi111.stdout:5/206: rename d3/d4/l27 to d3/d4/d7/d1c/l45 0 2023-12-08T20:27:48.008 INFO:tasks.workunit.client.1.smithi111.stdout:5/207: mkdir d3/d4/d7/d2c/d46 0 2023-12-08T20:27:48.008 INFO:tasks.workunit.client.1.smithi111.stdout:5/208: truncate d3/d4/f5 1885307 0 2023-12-08T20:27:48.009 INFO:tasks.workunit.client.1.smithi111.stdout:5/209: write d3/d4/d7/d36/f44 [594287,671] 0 2023-12-08T20:27:48.009 INFO:tasks.workunit.client.1.smithi111.stdout:5/210: truncate d3/d12/f17 1014635 0 2023-12-08T20:27:48.010 INFO:tasks.workunit.client.1.smithi111.stdout:5/211: creat d3/d4/d7/d1c/d21/f47 x:0 0 0 2023-12-08T20:27:48.013 INFO:tasks.workunit.client.1.smithi111.stdout:9/210: dwrite d2/d8/dd/d1a/d1e/d23/f28 [0,4194304] 0 2023-12-08T20:27:48.016 INFO:tasks.workunit.client.1.smithi111.stdout:0/175: dread d1/f10 [0,4194304] 0 2023-12-08T20:27:48.017 INFO:tasks.workunit.client.1.smithi111.stdout:0/176: write d1/dd/f18 [4417788,32096] 0 2023-12-08T20:27:48.019 INFO:tasks.workunit.client.1.smithi111.stdout:0/177: write d1/dd/f11 [2665144,15200] 0 2023-12-08T20:27:48.019 INFO:tasks.workunit.client.1.smithi111.stdout:5/212: dread d3/f10 [0,4194304] 0 2023-12-08T20:27:48.022 INFO:tasks.workunit.client.1.smithi111.stdout:0/178: rename d1/df/d16/c21 to d1/d4/d24/c36 0 2023-12-08T20:27:48.022 INFO:tasks.workunit.client.1.smithi111.stdout:0/179: dread - d1/d4/f35 zero size 2023-12-08T20:27:48.028 INFO:tasks.workunit.client.1.smithi111.stdout:5/213: creat d3/d4/d7/d2c/f48 x:0 0 0 2023-12-08T20:27:48.028 INFO:tasks.workunit.client.1.smithi111.stdout:0/180: mkdir d1/dd/d1f/d37 0 2023-12-08T20:27:48.028 INFO:tasks.workunit.client.1.smithi111.stdout:0/181: chown d1/d4 18 1 2023-12-08T20:27:48.028 INFO:tasks.workunit.client.1.smithi111.stdout:3/139: sync 2023-12-08T20:27:48.028 INFO:tasks.workunit.client.1.smithi111.stdout:8/220: sync 2023-12-08T20:27:48.028 INFO:tasks.workunit.client.1.smithi111.stdout:8/221: truncate f5 5074674 0 2023-12-08T20:27:48.028 INFO:tasks.workunit.client.1.smithi111.stdout:7/122: sync 2023-12-08T20:27:48.029 INFO:tasks.workunit.client.1.smithi111.stdout:1/165: sync 2023-12-08T20:27:48.029 INFO:tasks.workunit.client.1.smithi111.stdout:1/166: write d0/d6/f28 [978114,95720] 0 2023-12-08T20:27:48.029 INFO:tasks.workunit.client.1.smithi111.stdout:1/167: chown d0/d6/d1b/d2e/l38 9 1 2023-12-08T20:27:48.031 INFO:tasks.workunit.client.1.smithi111.stdout:5/214: rename d3/d12/f19 to d3/d4/d7/d1c/f49 0 2023-12-08T20:27:48.033 INFO:tasks.workunit.client.1.smithi111.stdout:0/182: creat d1/d4/f38 x:0 0 0 2023-12-08T20:27:48.036 INFO:tasks.workunit.client.1.smithi111.stdout:7/123: mkdir da/d25/d26 0 2023-12-08T20:27:48.039 INFO:tasks.workunit.client.1.smithi111.stdout:1/168: rename d0/d6/d33/lc to d0/d6/d34/l3e 0 2023-12-08T20:27:48.040 INFO:tasks.workunit.client.1.smithi111.stdout:0/183: creat d1/d2d/f39 x:0 0 0 2023-12-08T20:27:48.041 INFO:tasks.workunit.client.1.smithi111.stdout:9/211: dwrite d2/d8/f14 [0,4194304] 0 2023-12-08T20:27:48.041 INFO:tasks.workunit.client.1.smithi111.stdout:8/222: dread dd/d35/f43 [0,4194304] 0 2023-12-08T20:27:48.041 INFO:tasks.workunit.client.1.smithi111.stdout:7/124: symlink da/l27 0 2023-12-08T20:27:48.043 INFO:tasks.workunit.client.1.smithi111.stdout:5/215: dread d3/d4/d7/d29/f3b [0,4194304] 0 2023-12-08T20:27:48.044 INFO:tasks.workunit.client.1.smithi111.stdout:7/125: rmdir da/d25 39 2023-12-08T20:27:48.044 INFO:tasks.workunit.client.1.smithi111.stdout:7/126: write da/f1b [12278,35616] 0 2023-12-08T20:27:48.047 INFO:tasks.workunit.client.1.smithi111.stdout:1/169: dread d0/f1f [0,4194304] 0 2023-12-08T20:27:48.050 INFO:tasks.workunit.client.1.smithi111.stdout:1/170: write d0/d6/d1b/f21 [984882,129451] 0 2023-12-08T20:27:48.051 INFO:tasks.workunit.client.1.smithi111.stdout:1/171: read d0/d6/d33/ff [1213808,68282] 0 2023-12-08T20:27:48.052 INFO:tasks.workunit.client.1.smithi111.stdout:3/140: dwrite d2/d3/f1c [0,4194304] 0 2023-12-08T20:27:48.053 INFO:tasks.workunit.client.1.smithi111.stdout:9/212: dread d2/d8/f21 [0,4194304] 0 2023-12-08T20:27:48.055 INFO:tasks.workunit.client.1.smithi111.stdout:3/141: truncate f1 2135345 0 2023-12-08T20:27:48.055 INFO:tasks.workunit.client.1.smithi111.stdout:3/142: chown d2/d3 13 1 2023-12-08T20:27:48.057 INFO:tasks.workunit.client.1.smithi111.stdout:9/213: mknod d2/d8/dd/d1a/d1e/d23/c49 0 2023-12-08T20:27:48.062 INFO:tasks.workunit.client.1.smithi111.stdout:5/216: rename d3/d4/d7/d1c to d3/d4/d4a 0 2023-12-08T20:27:48.062 INFO:tasks.workunit.client.1.smithi111.stdout:3/143: rmdir d2/d15/d17/d25 39 2023-12-08T20:27:48.064 INFO:tasks.workunit.client.1.smithi111.stdout:0/184: dwrite d1/dd/f11 [4194304,4194304] 0 2023-12-08T20:27:48.064 INFO:tasks.workunit.client.1.smithi111.stdout:0/185: chown d1/d4/f35 2266 1 2023-12-08T20:27:48.065 INFO:tasks.workunit.client.1.smithi111.stdout:7/127: rename da/d13/c20 to da/c28 0 2023-12-08T20:27:48.068 INFO:tasks.workunit.client.1.smithi111.stdout:3/144: truncate d2/d12/f1a 1360991 0 2023-12-08T20:27:48.075 INFO:tasks.workunit.client.1.smithi111.stdout:1/172: dwrite d0/d6/f14 [0,4194304] 0 2023-12-08T20:27:48.076 INFO:tasks.workunit.client.1.smithi111.stdout:1/173: write d0/d6/f27 [4446422,75069] 0 2023-12-08T20:27:48.077 INFO:tasks.workunit.client.1.smithi111.stdout:1/174: truncate d0/f2 2512072 0 2023-12-08T20:27:48.080 INFO:tasks.workunit.client.1.smithi111.stdout:1/175: symlink d0/d3a/l3f 0 2023-12-08T20:27:48.081 INFO:tasks.workunit.client.1.smithi111.stdout:1/176: chown d0/d6/d1b/c2a 47400990 1 2023-12-08T20:27:48.081 INFO:tasks.workunit.client.1.smithi111.stdout:1/177: dread - d0/d6/d33/d15/f30 zero size 2023-12-08T20:27:48.081 INFO:tasks.workunit.client.1.smithi111.stdout:1/178: chown d0/f2 3 1 2023-12-08T20:27:48.084 INFO:tasks.workunit.client.1.smithi111.stdout:0/186: dread d1/dd/f18 [0,4194304] 0 2023-12-08T20:27:48.086 INFO:tasks.workunit.client.1.smithi111.stdout:9/214: dwrite d2/d8/f14 [0,4194304] 0 2023-12-08T20:27:48.088 INFO:tasks.workunit.client.1.smithi111.stdout:0/187: mkdir d1/d4/d3a 0 2023-12-08T20:27:48.088 INFO:tasks.workunit.client.1.smithi111.stdout:0/188: readlink d1/l14 0 2023-12-08T20:27:48.088 INFO:tasks.workunit.client.1.smithi111.stdout:0/189: write d1/d4/f38 [443899,31108] 0 2023-12-08T20:27:48.090 INFO:tasks.workunit.client.1.smithi111.stdout:3/145: dwrite d2/d3/f16 [0,4194304] 0 2023-12-08T20:27:48.093 INFO:tasks.workunit.client.1.smithi111.stdout:3/146: mknod d2/d15/c27 0 2023-12-08T20:27:48.097 INFO:tasks.workunit.client.1.smithi111.stdout:3/147: dread d2/d12/f1a [0,4194304] 0 2023-12-08T20:27:48.098 INFO:tasks.workunit.client.1.smithi111.stdout:3/148: mknod d2/d15/d17/c28 0 2023-12-08T20:27:48.099 INFO:tasks.workunit.client.1.smithi111.stdout:3/149: symlink d2/d3/l29 0 2023-12-08T20:27:48.100 INFO:tasks.workunit.client.1.smithi111.stdout:3/150: read d2/d3/d6/f10 [1851009,51612] 0 2023-12-08T20:27:48.101 INFO:tasks.workunit.client.1.smithi111.stdout:3/151: creat d2/d15/d17/d25/f2a x:0 0 0 2023-12-08T20:27:48.102 INFO:tasks.workunit.client.1.smithi111.stdout:0/190: dwrite d1/d2d/f39 [0,4194304] 0 2023-12-08T20:27:48.102 INFO:tasks.workunit.client.1.smithi111.stdout:0/191: chown d1/d4/d24/l27 0 1 2023-12-08T20:27:48.102 INFO:tasks.workunit.client.1.smithi111.stdout:3/152: mknod d2/d12/c2b 0 2023-12-08T20:27:48.103 INFO:tasks.workunit.client.1.smithi111.stdout:0/192: write d1/d2d/f39 [743598,23952] 0 2023-12-08T20:27:48.103 INFO:tasks.workunit.client.1.smithi111.stdout:0/193: write d1/f10 [4819106,92100] 0 2023-12-08T20:27:48.104 INFO:tasks.workunit.client.1.smithi111.stdout:3/153: write d2/d3/f16 [1370264,47352] 0 2023-12-08T20:27:48.104 INFO:tasks.workunit.client.1.smithi111.stdout:0/194: creat d1/df/f3b x:0 0 0 2023-12-08T20:27:48.105 INFO:tasks.workunit.client.1.smithi111.stdout:0/195: creat d1/d2d/f3c x:0 0 0 2023-12-08T20:27:48.107 INFO:tasks.workunit.client.1.smithi111.stdout:9/215: read d2/f7 [714690,94993] 0 2023-12-08T20:27:48.107 INFO:tasks.workunit.client.1.smithi111.stdout:0/196: rename d1/l1b to d1/df/l3d 0 2023-12-08T20:27:48.113 INFO:tasks.workunit.client.1.smithi111.stdout:0/197: mknod d1/d4/d24/c3e 0 2023-12-08T20:27:48.113 INFO:tasks.workunit.client.1.smithi111.stdout:0/198: mknod d1/d2d/c3f 0 2023-12-08T20:27:48.113 INFO:tasks.workunit.client.1.smithi111.stdout:0/199: fsync d1/dd/f11 0 2023-12-08T20:27:48.113 INFO:tasks.workunit.client.1.smithi111.stdout:0/200: mknod d1/d4/d3a/c40 0 2023-12-08T20:27:48.114 INFO:tasks.workunit.client.1.smithi111.stdout:3/154: dread d2/f9 [0,4194304] 0 2023-12-08T20:27:48.116 INFO:tasks.workunit.client.1.smithi111.stdout:1/179: dwrite d0/f31 [0,4194304] 0 2023-12-08T20:27:48.116 INFO:tasks.workunit.client.1.smithi111.stdout:3/155: creat d2/d15/f2c x:0 0 0 2023-12-08T20:27:48.117 INFO:tasks.workunit.client.1.smithi111.stdout:7/128: dwrite f5 [0,4194304] 0 2023-12-08T20:27:48.118 INFO:tasks.workunit.client.1.smithi111.stdout:1/180: write d0/d6/d1b/f21 [1705727,84604] 0 2023-12-08T20:27:48.118 INFO:tasks.workunit.client.1.smithi111.stdout:1/181: readlink d0/d6/l2c 0 2023-12-08T20:27:48.119 INFO:tasks.workunit.client.1.smithi111.stdout:3/156: rmdir d2/d3/d13 39 2023-12-08T20:27:48.123 INFO:tasks.workunit.client.1.smithi111.stdout:7/129: write f5 [4136513,43299] 0 2023-12-08T20:27:48.129 INFO:tasks.workunit.client.1.smithi111.stdout:3/157: rename d2/d15/c19 to d2/d15/d17/d25/c2d 0 2023-12-08T20:27:48.129 INFO:tasks.workunit.client.1.smithi111.stdout:3/158: write d2/d15/d17/d25/f26 [4263461,62985] 0 2023-12-08T20:27:48.130 INFO:tasks.workunit.client.1.smithi111.stdout:7/130: read da/f1b [6349,83738] 0 2023-12-08T20:27:48.131 INFO:tasks.workunit.client.1.smithi111.stdout:3/159: mkdir d2/d12/d2e 0 2023-12-08T20:27:48.133 INFO:tasks.workunit.client.1.smithi111.stdout:7/131: creat da/d13/d21/f29 x:0 0 0 2023-12-08T20:27:48.135 INFO:tasks.workunit.client.1.smithi111.stdout:3/160: rmdir d2/d3/d6 39 2023-12-08T20:27:48.147 INFO:tasks.workunit.client.1.smithi111.stdout:9/216: dwrite d2/d8/dd/d1a/d1e/d2d/f31 [0,4194304] 0 2023-12-08T20:27:48.147 INFO:tasks.workunit.client.1.smithi111.stdout:9/217: truncate d2/d8/dd/d1a/d1e/d2d/f3d 834520 0 2023-12-08T20:27:48.147 INFO:tasks.workunit.client.1.smithi111.stdout:1/182: dwrite d0/d6/f10 [4194304,4194304] 0 2023-12-08T20:27:48.148 INFO:tasks.workunit.client.1.smithi111.stdout:0/201: dwrite d1/d2d/f3c [0,4194304] 0 2023-12-08T20:27:48.151 INFO:tasks.workunit.client.1.smithi111.stdout:9/218: mkdir d2/d8/dd/d1a/d1e/d2d/d4a 0 2023-12-08T20:27:48.153 INFO:tasks.workunit.client.1.smithi111.stdout:1/183: creat d0/d6/d1b/d2e/f40 x:0 0 0 2023-12-08T20:27:48.161 INFO:tasks.workunit.client.1.smithi111.stdout:1/184: dread d0/d22/f23 [0,4194304] 0 2023-12-08T20:27:48.164 INFO:tasks.workunit.client.1.smithi111.stdout:3/161: dread d2/d15/d17/d25/f26 [0,4194304] 0 2023-12-08T20:27:48.164 INFO:tasks.workunit.client.1.smithi111.stdout:9/219: truncate d2/d8/dd/d1a/d1e/d23/f28 4058303 0 2023-12-08T20:27:48.164 INFO:tasks.workunit.client.1.smithi111.stdout:9/220: readlink d2/d8/dd/d1a/l27 0 2023-12-08T20:27:48.165 INFO:tasks.workunit.client.1.smithi111.stdout:9/221: write d2/d8/f36 [2364259,43023] 0 2023-12-08T20:27:48.165 INFO:tasks.workunit.client.1.smithi111.stdout:9/222: stat d2/f2c 0 2023-12-08T20:27:48.166 INFO:tasks.workunit.client.1.smithi111.stdout:0/202: dwrite d1/df/f3b [0,4194304] 0 2023-12-08T20:27:48.166 INFO:tasks.workunit.client.1.smithi111.stdout:0/203: write d1/f10 [1013113,70002] 0 2023-12-08T20:27:48.166 INFO:tasks.workunit.client.1.smithi111.stdout:1/185: symlink d0/d6/d1b/d2e/l41 0 2023-12-08T20:27:48.169 INFO:tasks.workunit.client.1.smithi111.stdout:2/226: sync 2023-12-08T20:27:48.173 INFO:tasks.workunit.client.1.smithi111.stdout:3/162: dread d2/d3/fb [0,4194304] 0 2023-12-08T20:27:48.174 INFO:tasks.workunit.client.1.smithi111.stdout:3/163: write d2/d15/d17/d25/f26 [713313,85249] 0 2023-12-08T20:27:48.174 INFO:tasks.workunit.client.1.smithi111.stdout:0/204: link d1/f10 d1/d2d/f41 0 2023-12-08T20:27:48.175 INFO:tasks.workunit.client.1.smithi111.stdout:1/186: symlink d0/d6/l42 0 2023-12-08T20:27:48.177 INFO:tasks.workunit.client.1.smithi111.stdout:2/227: getdents d1 0 2023-12-08T20:27:48.178 INFO:tasks.workunit.client.1.smithi111.stdout:7/132: truncate f5 3802255 0 2023-12-08T20:27:48.179 INFO:tasks.workunit.client.1.smithi111.stdout:3/164: creat d2/d12/d2e/f2f x:0 0 0 2023-12-08T20:27:48.179 INFO:tasks.workunit.client.1.smithi111.stdout:3/165: chown d2/d3/d13 1790763 1 2023-12-08T20:27:48.180 INFO:tasks.workunit.client.1.smithi111.stdout:7/133: dread da/f1e [0,4194304] 0 2023-12-08T20:27:48.180 INFO:tasks.workunit.client.1.smithi111.stdout:0/205: mknod d1/dd/d1f/c42 0 2023-12-08T20:27:48.181 INFO:tasks.workunit.client.1.smithi111.stdout:1/187: creat d0/d6/d1b/f43 x:0 0 0 2023-12-08T20:27:48.182 INFO:tasks.workunit.client.1.smithi111.stdout:9/223: getdents d2/d8/dd/d1a/d1e/d2d 0 2023-12-08T20:27:48.182 INFO:tasks.workunit.client.1.smithi111.stdout:1/188: write d0/f2 [995977,41470] 0 2023-12-08T20:27:48.183 INFO:tasks.workunit.client.1.smithi111.stdout:3/166: mkdir d2/d30 0 2023-12-08T20:27:48.189 INFO:tasks.workunit.client.1.smithi111.stdout:7/134: creat da/d13/d21/f2a x:0 0 0 2023-12-08T20:27:48.192 INFO:tasks.workunit.client.1.smithi111.stdout:0/206: creat d1/dd/d1f/f43 x:0 0 0 2023-12-08T20:27:48.195 INFO:tasks.workunit.client.1.smithi111.stdout:9/224: link d2/f7 d2/d8/dd/d1a/d1e/d2d/f4b 0 2023-12-08T20:27:48.197 INFO:tasks.workunit.client.1.smithi111.stdout:1/189: mknod d0/d6/d1b/c44 0 2023-12-08T20:27:48.198 INFO:tasks.workunit.client.1.smithi111.stdout:2/228: dwrite d1/d29/d53/f23 [0,4194304] 0 2023-12-08T20:27:48.199 INFO:tasks.workunit.client.1.smithi111.stdout:2/229: chown d1/d1d/d55/f4a 14980198 1 2023-12-08T20:27:48.199 INFO:tasks.workunit.client.1.smithi111.stdout:2/230: read - d1/d1d/d22/f50 zero size 2023-12-08T20:27:48.199 INFO:tasks.workunit.client.1.smithi111.stdout:9/225: mknod d2/d8/dd/d1a/d1e/c4c 0 2023-12-08T20:27:48.201 INFO:tasks.workunit.client.1.smithi111.stdout:1/190: rename d0/f36 to d0/d22/f45 0 2023-12-08T20:27:48.206 INFO:tasks.workunit.client.1.smithi111.stdout:1/191: symlink d0/d6/d33/d15/l46 0 2023-12-08T20:27:48.206 INFO:tasks.workunit.client.1.smithi111.stdout:1/192: fsync d0/f2d 0 2023-12-08T20:27:48.207 INFO:tasks.workunit.client.1.smithi111.stdout:1/193: write d0/d6/f28 [1019714,119710] 0 2023-12-08T20:27:48.207 INFO:tasks.workunit.client.1.smithi111.stdout:1/194: mkdir d0/d6/d47 0 2023-12-08T20:27:48.207 INFO:tasks.workunit.client.1.smithi111.stdout:1/195: chown d0/f2f 4001137 1 2023-12-08T20:27:48.209 INFO:tasks.workunit.client.1.smithi111.stdout:1/196: symlink d0/l48 0 2023-12-08T20:27:48.210 INFO:tasks.workunit.client.1.smithi111.stdout:1/197: write d0/d6/d1b/d2e/f40 [5191,37726] 0 2023-12-08T20:27:48.211 INFO:tasks.workunit.client.1.smithi111.stdout:1/198: getdents d0/d6/d33 0 2023-12-08T20:27:48.212 INFO:tasks.workunit.client.1.smithi111.stdout:1/199: symlink d0/d6/l49 0 2023-12-08T20:27:48.213 INFO:tasks.workunit.client.1.smithi111.stdout:0/207: dwrite d1/d4/f35 [0,4194304] 0 2023-12-08T20:27:48.215 INFO:tasks.workunit.client.1.smithi111.stdout:3/167: dwrite d2/d15/d17/d25/f26 [4194304,4194304] 0 2023-12-08T20:27:48.218 INFO:tasks.workunit.client.1.smithi111.stdout:0/208: getdents d1/d2d 0 2023-12-08T20:27:48.220 INFO:tasks.workunit.client.1.smithi111.stdout:3/168: creat d2/d12/f31 x:0 0 0 2023-12-08T20:27:48.222 INFO:tasks.workunit.client.1.smithi111.stdout:3/169: truncate d2/ff 99008 0 2023-12-08T20:27:48.223 INFO:tasks.workunit.client.1.smithi111.stdout:9/226: dread d2/d8/dd/d1a/d1e/d2d/f31 [0,4194304] 0 2023-12-08T20:27:48.223 INFO:tasks.workunit.client.1.smithi111.stdout:7/135: dwrite da/f1e [0,4194304] 0 2023-12-08T20:27:48.223 INFO:tasks.workunit.client.1.smithi111.stdout:7/136: readlink da/l27 0 2023-12-08T20:27:48.224 INFO:tasks.workunit.client.1.smithi111.stdout:9/227: read d2/d8/dd/d1a/d1e/f26 [2134032,61648] 0 2023-12-08T20:27:48.229 INFO:tasks.workunit.client.1.smithi111.stdout:0/209: dread d1/df/f3b [0,4194304] 0 2023-12-08T20:27:48.232 INFO:tasks.workunit.client.1.smithi111.stdout:9/228: creat d2/d8/f4d x:0 0 0 2023-12-08T20:27:48.232 INFO:tasks.workunit.client.1.smithi111.stdout:9/229: chown d2/d8/f4d 103086123 1 2023-12-08T20:27:48.233 INFO:tasks.workunit.client.1.smithi111.stdout:1/200: dwrite d0/f2f [0,4194304] 0 2023-12-08T20:27:48.234 INFO:tasks.workunit.client.1.smithi111.stdout:0/210: rename d1/dd/d1f to d1/df/d44 0 2023-12-08T20:27:48.235 INFO:tasks.workunit.client.1.smithi111.stdout:9/230: truncate d2/d8/dd/d1a/d1e/d2d/f4b 182544 0 2023-12-08T20:27:48.240 INFO:tasks.workunit.client.1.smithi111.stdout:0/211: creat d1/d4/d24/f45 x:0 0 0 2023-12-08T20:27:48.241 INFO:tasks.workunit.client.1.smithi111.stdout:9/231: rmdir d2/d8/dd/d3f 0 2023-12-08T20:27:48.242 INFO:tasks.workunit.client.1.smithi111.stdout:9/232: creat d2/d8/dd/f4e x:0 0 0 2023-12-08T20:27:48.243 INFO:tasks.workunit.client.1.smithi111.stdout:1/201: dread d0/f31 [0,4194304] 0 2023-12-08T20:27:48.244 INFO:tasks.workunit.client.1.smithi111.stdout:9/233: write d2/f2c [84692,90050] 0 2023-12-08T20:27:48.245 INFO:tasks.workunit.client.1.smithi111.stdout:1/202: write d0/f1f [2425977,116573] 0 2023-12-08T20:27:48.246 INFO:tasks.workunit.client.1.smithi111.stdout:2/231: dwrite d1/d1d/f33 [4194304,4194304] 0 2023-12-08T20:27:48.246 INFO:tasks.workunit.client.1.smithi111.stdout:1/203: link d0/d6/d1b/d2e/f40 d0/d6/d47/f4a 0 2023-12-08T20:27:48.247 INFO:tasks.workunit.client.1.smithi111.stdout:7/137: dwrite da/d13/d21/f2a [0,4194304] 0 2023-12-08T20:27:48.247 INFO:tasks.workunit.client.1.smithi111.stdout:7/138: chown da/d13/c23 1986 1 2023-12-08T20:27:48.248 INFO:tasks.workunit.client.1.smithi111.stdout:3/170: write d2/ff [399311,40667] 0 2023-12-08T20:27:48.249 INFO:tasks.workunit.client.1.smithi111.stdout:3/171: write d2/d12/f1a [491286,48442] 0 2023-12-08T20:27:48.249 INFO:tasks.workunit.client.1.smithi111.stdout:3/172: write d2/d12/f31 [633243,33923] 0 2023-12-08T20:27:48.250 INFO:tasks.workunit.client.1.smithi111.stdout:3/173: stat d2/d30 0 2023-12-08T20:27:48.250 INFO:tasks.workunit.client.1.smithi111.stdout:3/174: write d2/d3/d6/fe [928423,40692] 0 2023-12-08T20:27:48.251 INFO:tasks.workunit.client.1.smithi111.stdout:1/204: dread d0/d6/d47/f4a [0,4194304] 0 2023-12-08T20:27:48.252 INFO:tasks.workunit.client.1.smithi111.stdout:2/232: symlink d1/d1d/d22/d30/l57 0 2023-12-08T20:27:48.255 INFO:tasks.workunit.client.1.smithi111.stdout:5/217: sync 2023-12-08T20:27:48.255 INFO:tasks.workunit.client.1.smithi111.stdout:4/96: sync 2023-12-08T20:27:48.255 INFO:tasks.workunit.client.1.smithi111.stdout:5/218: chown d3/d12/f33 15649456 1 2023-12-08T20:27:48.255 INFO:tasks.workunit.client.1.smithi111.stdout:5/219: dread - d3/d12/f33 zero size 2023-12-08T20:27:48.258 INFO:tasks.workunit.client.1.smithi111.stdout:7/139: dread f5 [0,4194304] 0 2023-12-08T20:27:48.258 INFO:tasks.workunit.client.1.smithi111.stdout:7/140: stat f5 0 2023-12-08T20:27:48.258 INFO:tasks.workunit.client.1.smithi111.stdout:1/205: symlink d0/d6/d1b/l4b 0 2023-12-08T20:27:48.258 INFO:tasks.workunit.client.1.smithi111.stdout:1/206: write d0/d22/f23 [4500625,53740] 0 2023-12-08T20:27:48.259 INFO:tasks.workunit.client.1.smithi111.stdout:8/223: sync 2023-12-08T20:27:48.260 INFO:tasks.workunit.client.1.smithi111.stdout:5/220: rmdir d3/d4/d7/d2c/d46 0 2023-12-08T20:27:48.260 INFO:tasks.workunit.client.1.smithi111.stdout:5/221: truncate d3/d4/d7/d2c/f3e 934133 0 2023-12-08T20:27:48.260 INFO:tasks.workunit.client.1.smithi111.stdout:6/84: sync 2023-12-08T20:27:48.260 INFO:tasks.workunit.client.1.smithi111.stdout:4/97: dread d8/f15 [0,4194304] 0 2023-12-08T20:27:48.262 INFO:tasks.workunit.client.1.smithi111.stdout:9/234: dwrite d2/d8/dd/d1a/d1e/f26 [0,4194304] 0 2023-12-08T20:27:48.264 INFO:tasks.workunit.client.1.smithi111.stdout:3/175: dread d2/d3/f1c [0,4194304] 0 2023-12-08T20:27:48.266 INFO:tasks.workunit.client.1.smithi111.stdout:7/141: creat da/d25/d26/f2b x:0 0 0 2023-12-08T20:27:48.266 INFO:tasks.workunit.client.1.smithi111.stdout:1/207: symlink d0/d6/d1b/d2e/l4c 0 2023-12-08T20:27:48.266 INFO:tasks.workunit.client.1.smithi111.stdout:5/222: mknod d3/d4/d7/c4b 0 2023-12-08T20:27:48.269 INFO:tasks.workunit.client.1.smithi111.stdout:4/98: mknod d8/da/db/d1b/c21 0 2023-12-08T20:27:48.270 INFO:tasks.workunit.client.1.smithi111.stdout:2/233: dwrite d1/d1d/d22/f34 [0,4194304] 0 2023-12-08T20:27:48.271 INFO:tasks.workunit.client.1.smithi111.stdout:2/234: readlink d1/d1d/d22/d30/l57 0 2023-12-08T20:27:48.272 INFO:tasks.workunit.client.1.smithi111.stdout:3/176: rename d2/d15/f2c to d2/d3/d13/f32 0 2023-12-08T20:27:48.274 INFO:tasks.workunit.client.1.smithi111.stdout:2/235: write d1/d1d/f20 [1257731,71441] 0 2023-12-08T20:27:48.274 INFO:tasks.workunit.client.1.smithi111.stdout:0/212: fsync d1/d4/d24/f45 0 2023-12-08T20:27:48.276 INFO:tasks.workunit.client.1.smithi111.stdout:1/208: getdents d0/d6 0 2023-12-08T20:27:48.277 INFO:tasks.workunit.client.1.smithi111.stdout:9/235: dread d2/d8/f14 [0,4194304] 0 2023-12-08T20:27:48.279 INFO:tasks.workunit.client.1.smithi111.stdout:5/223: creat d3/d4/d7/d2c/f4c x:0 0 0 2023-12-08T20:27:48.280 INFO:tasks.workunit.client.1.smithi111.stdout:1/209: write d0/f2 [306103,60347] 0 2023-12-08T20:27:48.280 INFO:tasks.workunit.client.1.smithi111.stdout:1/210: chown d0/d6/d1b/l3d 120 1 2023-12-08T20:27:48.280 INFO:tasks.workunit.client.1.smithi111.stdout:1/211: chown d0/d6/d33/ce 209957 1 2023-12-08T20:27:48.281 INFO:tasks.workunit.client.1.smithi111.stdout:4/99: creat d8/f22 x:0 0 0 2023-12-08T20:27:48.282 INFO:tasks.workunit.client.1.smithi111.stdout:3/177: mkdir d2/d33 0 2023-12-08T20:27:48.282 INFO:tasks.workunit.client.1.smithi111.stdout:3/178: stat d2/d15/d17/d25/f2a 0 2023-12-08T20:27:48.283 INFO:tasks.workunit.client.1.smithi111.stdout:2/236: mkdir d1/d1d/d55/d58 0 2023-12-08T20:27:48.284 INFO:tasks.workunit.client.1.smithi111.stdout:2/237: write d1/d1d/f26 [3478202,87970] 0 2023-12-08T20:27:48.284 INFO:tasks.workunit.client.1.smithi111.stdout:0/213: mkdir d1/d4/d24/d46 0 2023-12-08T20:27:48.284 INFO:tasks.workunit.client.1.smithi111.stdout:0/214: chown d1/dd/f18 1062849263 1 2023-12-08T20:27:48.285 INFO:tasks.workunit.client.1.smithi111.stdout:9/236: truncate d2/d8/f36 2717929 0 2023-12-08T20:27:48.286 INFO:tasks.workunit.client.1.smithi111.stdout:5/224: mknod d3/d4/d7/d29/d30/c4d 0 2023-12-08T20:27:48.287 INFO:tasks.workunit.client.1.smithi111.stdout:1/212: mkdir d0/d4d 0 2023-12-08T20:27:48.287 INFO:tasks.workunit.client.1.smithi111.stdout:1/213: chown d0/d6/f27 220861015 1 2023-12-08T20:27:48.287 INFO:tasks.workunit.client.1.smithi111.stdout:1/214: chown d0/d6/d34/l3e 0 1 2023-12-08T20:27:48.288 INFO:tasks.workunit.client.1.smithi111.stdout:4/100: rename d8/da/db/d1b/d1f/f19 to d8/da/db/d1b/d1f/f23 0 2023-12-08T20:27:48.288 INFO:tasks.workunit.client.1.smithi111.stdout:4/101: chown d8/da/db/d1b/d1f/f1a 0 1 2023-12-08T20:27:48.288 INFO:tasks.workunit.client.1.smithi111.stdout:4/102: readlink d8/da/l1d 0 2023-12-08T20:27:48.289 INFO:tasks.workunit.client.1.smithi111.stdout:3/179: creat d2/f34 x:0 0 0 2023-12-08T20:27:48.290 INFO:tasks.workunit.client.1.smithi111.stdout:2/238: rename d1/d1d/d1f/d25/c46 to d1/d1d/d1f/d25/d3d/d56/c59 0 2023-12-08T20:27:48.291 INFO:tasks.workunit.client.1.smithi111.stdout:3/180: read d2/d12/f31 [54494,103526] 0 2023-12-08T20:27:48.292 INFO:tasks.workunit.client.1.smithi111.stdout:3/181: fsync d2/d3/f16 0 2023-12-08T20:27:48.292 INFO:tasks.workunit.client.1.smithi111.stdout:3/182: readlink d2/d3/l20 0 2023-12-08T20:27:48.292 INFO:tasks.workunit.client.1.smithi111.stdout:8/224: dwrite dd/f28 [0,4194304] 0 2023-12-08T20:27:48.292 INFO:tasks.workunit.client.1.smithi111.stdout:8/225: write dd/d35/d42/f47 [15959,53348] 0 2023-12-08T20:27:48.293 INFO:tasks.workunit.client.1.smithi111.stdout:5/225: link d3/d4/d4a/l45 d3/d4/d7/d36/l4e 0 2023-12-08T20:27:48.293 INFO:tasks.workunit.client.1.smithi111.stdout:8/226: read dd/d32/d3d/f44 [879323,100455] 0 2023-12-08T20:27:48.295 INFO:tasks.workunit.client.1.smithi111.stdout:7/142: dwrite da/f1b [0,4194304] 0 2023-12-08T20:27:48.298 INFO:tasks.workunit.client.1.smithi111.stdout:0/215: dread d1/f10 [0,4194304] 0 2023-12-08T20:27:48.299 INFO:tasks.workunit.client.1.smithi111.stdout:6/85: dwrite d0/f13 [0,4194304] 0 2023-12-08T20:27:48.299 INFO:tasks.workunit.client.1.smithi111.stdout:4/103: creat d8/da/db/d1b/f24 x:0 0 0 2023-12-08T20:27:48.299 INFO:tasks.workunit.client.1.smithi111.stdout:5/226: rmdir d3/d4 39 2023-12-08T20:27:48.300 INFO:tasks.workunit.client.1.smithi111.stdout:2/239: creat d1/d29/d53/f5a x:0 0 0 2023-12-08T20:27:48.300 INFO:tasks.workunit.client.1.smithi111.stdout:2/240: chown d1/d1d/d22/l3b 62309695 1 2023-12-08T20:27:48.300 INFO:tasks.workunit.client.1.smithi111.stdout:5/227: write d3/d12/f17 [227711,13124] 0 2023-12-08T20:27:48.300 INFO:tasks.workunit.client.1.smithi111.stdout:5/228: read - d3/d12/f33 zero size 2023-12-08T20:27:48.300 INFO:tasks.workunit.client.1.smithi111.stdout:5/229: fdatasync d3/d12/f38 0 2023-12-08T20:27:48.303 INFO:tasks.workunit.client.1.smithi111.stdout:9/237: dread d2/d8/dd/d1a/d1e/d2d/f31 [0,4194304] 0 2023-12-08T20:27:48.303 INFO:tasks.workunit.client.1.smithi111.stdout:9/238: truncate d2/d8/dd/d1a/d1e/d23/f48 1370008 0 2023-12-08T20:27:48.303 INFO:tasks.workunit.client.1.smithi111.stdout:9/239: truncate d2/d8/f4d 572720 0 2023-12-08T20:27:48.303 INFO:tasks.workunit.client.1.smithi111.stdout:0/216: mkdir d1/dd/d47 0 2023-12-08T20:27:48.303 INFO:tasks.workunit.client.1.smithi111.stdout:0/217: write d1/d4/f35 [4462247,106243] 0 2023-12-08T20:27:48.303 INFO:tasks.workunit.client.1.smithi111.stdout:0/218: fdatasync d1/df/d44/f43 0 2023-12-08T20:27:48.305 INFO:tasks.workunit.client.1.smithi111.stdout:5/230: write d3/f14 [1904749,90852] 0 2023-12-08T20:27:48.308 INFO:tasks.workunit.client.1.smithi111.stdout:6/86: symlink d0/l16 0 2023-12-08T20:27:48.309 INFO:tasks.workunit.client.1.smithi111.stdout:4/104: creat d8/da/f25 x:0 0 0 2023-12-08T20:27:48.311 INFO:tasks.workunit.client.1.smithi111.stdout:1/215: dwrite d0/d6/d33/f1c [0,4194304] 0 2023-12-08T20:27:48.315 INFO:tasks.workunit.client.1.smithi111.stdout:2/241: symlink d1/d1d/d1f/d25/d3d/d41/l5b 0 2023-12-08T20:27:48.317 INFO:tasks.workunit.client.1.smithi111.stdout:9/240: creat d2/d8/f4f x:0 0 0 2023-12-08T20:27:48.318 INFO:tasks.workunit.client.1.smithi111.stdout:0/219: mknod d1/df/c48 0 2023-12-08T20:27:48.320 INFO:tasks.workunit.client.1.smithi111.stdout:6/87: symlink d0/d1/l17 0 2023-12-08T20:27:48.321 INFO:tasks.workunit.client.1.smithi111.stdout:4/105: mknod d8/da/c26 0 2023-12-08T20:27:48.321 INFO:tasks.workunit.client.1.smithi111.stdout:4/106: truncate d8/f15 997448 0 2023-12-08T20:27:48.322 INFO:tasks.workunit.client.1.smithi111.stdout:3/183: dwrite d2/d12/d2e/f2f [0,4194304] 0 2023-12-08T20:27:48.324 INFO:tasks.workunit.client.1.smithi111.stdout:2/242: creat d1/d1d/d22/d30/f5c x:0 0 0 2023-12-08T20:27:48.325 INFO:tasks.workunit.client.1.smithi111.stdout:1/216: dread d0/d6/f27 [0,4194304] 0 2023-12-08T20:27:48.325 INFO:tasks.workunit.client.1.smithi111.stdout:1/217: chown d0/d6 937 1 2023-12-08T20:27:48.325 INFO:tasks.workunit.client.1.smithi111.stdout:3/184: dread d2/fa [0,4194304] 0 2023-12-08T20:27:48.326 INFO:tasks.workunit.client.1.smithi111.stdout:9/241: creat d2/da/f50 x:0 0 0 2023-12-08T20:27:48.326 INFO:tasks.workunit.client.1.smithi111.stdout:8/227: dwrite dd/d2d/f4a [0,4194304] 0 2023-12-08T20:27:48.327 INFO:tasks.workunit.client.1.smithi111.stdout:7/143: dwrite f1 [0,4194304] 0 2023-12-08T20:27:48.328 INFO:tasks.workunit.client.1.smithi111.stdout:0/220: mkdir d1/d4/d24/d46/d49 0 2023-12-08T20:27:48.329 INFO:tasks.workunit.client.1.smithi111.stdout:6/88: truncate d0/d1/f6 3600685 0 2023-12-08T20:27:48.331 INFO:tasks.workunit.client.1.smithi111.stdout:5/231: dwrite d3/d4/d7/f25 [0,4194304] 0 2023-12-08T20:27:48.331 INFO:tasks.workunit.client.1.smithi111.stdout:4/107: dread f1 [0,4194304] 0 2023-12-08T20:27:48.331 INFO:tasks.workunit.client.1.smithi111.stdout:4/108: chown d8/da/db/d1b/d1f/f23 1 1 2023-12-08T20:27:48.331 INFO:tasks.workunit.client.1.smithi111.stdout:4/109: write d8/da/db/d1b/d1f/f1a [269742,59280] 0 2023-12-08T20:27:48.336 INFO:tasks.workunit.client.1.smithi111.stdout:3/185: dread d2/d15/d17/d25/f26 [4194304,4194304] 0 2023-12-08T20:27:48.338 INFO:tasks.workunit.client.1.smithi111.stdout:3/186: write d2/f9 [2739894,62291] 0 2023-12-08T20:27:48.341 INFO:tasks.workunit.client.1.smithi111.stdout:1/218: unlink d0/d6/d33/l16 0 2023-12-08T20:27:48.341 INFO:tasks.workunit.client.1.smithi111.stdout:2/243: creat d1/d1d/f5d x:0 0 0 2023-12-08T20:27:48.345 INFO:tasks.workunit.client.1.smithi111.stdout:8/228: mknod dd/d35/d42/c4e 0 2023-12-08T20:27:48.350 INFO:tasks.workunit.client.1.smithi111.stdout:7/144: creat da/d13/f2c x:0 0 0 2023-12-08T20:27:48.350 INFO:tasks.workunit.client.1.smithi111.stdout:7/145: fdatasync da/d13/f1a 0 2023-12-08T20:27:48.350 INFO:tasks.workunit.client.1.smithi111.stdout:5/232: creat d3/d4/d7/d36/f4f x:0 0 0 2023-12-08T20:27:48.350 INFO:tasks.workunit.client.1.smithi111.stdout:5/233: read - d3/d4/d7/f16 zero size 2023-12-08T20:27:48.350 INFO:tasks.workunit.client.1.smithi111.stdout:1/219: write d0/d6/d1b/f21 [3364572,20696] 0 2023-12-08T20:27:48.351 INFO:tasks.workunit.client.1.smithi111.stdout:9/242: dread d2/d8/dd/d1a/d1e/d2d/d35/f41 [0,4194304] 0 2023-12-08T20:27:48.351 INFO:tasks.workunit.client.1.smithi111.stdout:5/234: write d3/d4/d7/f25 [3481096,76124] 0 2023-12-08T20:27:48.351 INFO:tasks.workunit.client.1.smithi111.stdout:4/110: rename d8/l9 to d8/da/db/l27 0 2023-12-08T20:27:48.351 INFO:tasks.workunit.client.1.smithi111.stdout:4/111: chown d8/da/l1d 4 1 2023-12-08T20:27:48.352 INFO:tasks.workunit.client.1.smithi111.stdout:6/89: dwrite d0/d1/f7 [4194304,4194304] 0 2023-12-08T20:27:48.352 INFO:tasks.workunit.client.1.smithi111.stdout:0/221: dwrite d1/dd/f18 [0,4194304] 0 2023-12-08T20:27:48.354 INFO:tasks.workunit.client.1.smithi111.stdout:3/187: creat d2/d15/d17/f35 x:0 0 0 2023-12-08T20:27:48.354 INFO:tasks.workunit.client.1.smithi111.stdout:3/188: chown d2/d15 2314192 1 2023-12-08T20:27:48.354 INFO:tasks.workunit.client.1.smithi111.stdout:3/189: fdatasync d2/d3/d6/f23 0 2023-12-08T20:27:48.360 INFO:tasks.workunit.client.1.smithi111.stdout:2/244: symlink d1/d1d/d1f/d25/d3d/d56/l5e 0 2023-12-08T20:27:48.361 INFO:tasks.workunit.client.1.smithi111.stdout:7/146: mkdir da/d13/d21/d2d 0 2023-12-08T20:27:48.361 INFO:tasks.workunit.client.1.smithi111.stdout:2/245: fdatasync d1/d1d/f2e 0 2023-12-08T20:27:48.361 INFO:tasks.workunit.client.1.smithi111.stdout:1/220: symlink d0/d22/l4e 0 2023-12-08T20:27:48.362 INFO:tasks.workunit.client.1.smithi111.stdout:5/235: mknod d3/d4/c50 0 2023-12-08T20:27:48.363 INFO:tasks.workunit.client.1.smithi111.stdout:5/236: fdatasync d3/d4/f8 0 2023-12-08T20:27:48.364 INFO:tasks.workunit.client.1.smithi111.stdout:8/229: dwrite dd/d2d/f33 [0,4194304] 0 2023-12-08T20:27:48.364 INFO:tasks.workunit.client.1.smithi111.stdout:8/230: readlink dd/d32/d3d/l4d 0 2023-12-08T20:27:48.364 INFO:tasks.workunit.client.1.smithi111.stdout:5/237: write d3/d12/f17 [612498,71287] 0 2023-12-08T20:27:48.367 INFO:tasks.workunit.client.1.smithi111.stdout:6/90: mknod d0/d1/c18 0 2023-12-08T20:27:48.371 INFO:tasks.workunit.client.1.smithi111.stdout:7/147: rename f1 to da/d25/f2e 0 2023-12-08T20:27:48.372 INFO:tasks.workunit.client.1.smithi111.stdout:2/246: link d1/d1d/d1f/d25/d3d/d56/l5e d1/d1d/d22/l5f 0 2023-12-08T20:27:48.374 INFO:tasks.workunit.client.1.smithi111.stdout:1/221: creat d0/d6/d33/f4f x:0 0 0 2023-12-08T20:27:48.374 INFO:tasks.workunit.client.1.smithi111.stdout:1/222: readlink d0/d6/d1b/d2e/l38 0 2023-12-08T20:27:48.376 INFO:tasks.workunit.client.1.smithi111.stdout:9/243: dwrite d2/d8/f36 [0,4194304] 0 2023-12-08T20:27:48.377 INFO:tasks.workunit.client.1.smithi111.stdout:6/91: dread d0/d1/f5 [0,4194304] 0 2023-12-08T20:27:48.377 INFO:tasks.workunit.client.1.smithi111.stdout:6/92: write d0/d1/f8 [2724361,122986] 0 2023-12-08T20:27:48.377 INFO:tasks.workunit.client.1.smithi111.stdout:6/93: chown d0 0 1 2023-12-08T20:27:48.384 INFO:tasks.workunit.client.1.smithi111.stdout:5/238: symlink d3/d4/d7/d36/l51 0 2023-12-08T20:27:48.384 INFO:tasks.workunit.client.1.smithi111.stdout:7/148: dread f6 [0,4194304] 0 2023-12-08T20:27:48.384 INFO:tasks.workunit.client.1.smithi111.stdout:4/112: rmdir d8/da/db 39 2023-12-08T20:27:48.387 INFO:tasks.workunit.client.1.smithi111.stdout:3/190: dwrite d2/f34 [0,4194304] 0 2023-12-08T20:27:48.389 INFO:tasks.workunit.client.1.smithi111.stdout:8/231: dwrite dd/d2d/f4a [0,4194304] 0 2023-12-08T20:27:48.394 INFO:tasks.workunit.client.1.smithi111.stdout:2/247: rename d1/d29/c3e to d1/c60 0 2023-12-08T20:27:48.396 INFO:tasks.workunit.client.1.smithi111.stdout:1/223: link d0/d6/d1b/d2e/f40 d0/d6/d47/f50 0 2023-12-08T20:27:48.396 INFO:tasks.workunit.client.1.smithi111.stdout:9/244: getdents d2/d8/dd/d1a 0 2023-12-08T20:27:48.400 INFO:tasks.workunit.client.1.smithi111.stdout:6/94: symlink d0/d1/l19 0 2023-12-08T20:27:48.402 INFO:tasks.workunit.client.1.smithi111.stdout:5/239: stat d3/d4/d7/d36/c39 0 2023-12-08T20:27:48.402 INFO:tasks.workunit.client.1.smithi111.stdout:5/240: write d3/f10 [4489647,82747] 0 2023-12-08T20:27:48.403 INFO:tasks.workunit.client.1.smithi111.stdout:7/149: symlink da/d13/d21/l2f 0 2023-12-08T20:27:48.404 INFO:tasks.workunit.client.1.smithi111.stdout:4/113: symlink d8/da/db/l28 0 2023-12-08T20:27:48.406 INFO:tasks.workunit.client.1.smithi111.stdout:3/191: rmdir d2/d3/d13 39 2023-12-08T20:27:48.408 INFO:tasks.workunit.client.1.smithi111.stdout:8/232: creat dd/d32/d3d/f4f x:0 0 0 2023-12-08T20:27:48.409 INFO:tasks.workunit.client.1.smithi111.stdout:2/248: creat d1/d1d/d55/d58/f61 x:0 0 0 2023-12-08T20:27:48.409 INFO:tasks.workunit.client.1.smithi111.stdout:2/249: stat d1/d1d/d22/f50 0 2023-12-08T20:27:48.412 INFO:tasks.workunit.client.1.smithi111.stdout:9/245: rmdir d2/d8/dd/d1a/d1e 39 2023-12-08T20:27:48.413 INFO:tasks.workunit.client.1.smithi111.stdout:3/192: dread d2/d3/f16 [0,4194304] 0 2023-12-08T20:27:48.413 INFO:tasks.workunit.client.1.smithi111.stdout:6/95: mkdir d0/d1a 0 2023-12-08T20:27:48.414 INFO:tasks.workunit.client.1.smithi111.stdout:6/96: chown d0/d1/l4 524437873 1 2023-12-08T20:27:48.415 INFO:tasks.workunit.client.1.smithi111.stdout:5/241: mknod d3/d4/d7/d29/c52 0 2023-12-08T20:27:48.415 INFO:tasks.workunit.client.1.smithi111.stdout:2/250: dread d1/d1d/f20 [4194304,4194304] 0 2023-12-08T20:27:48.416 INFO:tasks.workunit.client.1.smithi111.stdout:2/251: write d1/d1d/f2e [4858208,8094] 0 2023-12-08T20:27:48.416 INFO:tasks.workunit.client.1.smithi111.stdout:5/242: write d3/d4/d7/d2c/f3e [679027,46459] 0 2023-12-08T20:27:48.417 INFO:tasks.workunit.client.1.smithi111.stdout:7/150: link da/le da/d25/l30 0 2023-12-08T20:27:48.417 INFO:tasks.workunit.client.1.smithi111.stdout:7/151: getdents da/d13/d21/d2d 0 2023-12-08T20:27:48.417 INFO:tasks.workunit.client.1.smithi111.stdout:7/152: write da/d13/f2c [1026521,39164] 0 2023-12-08T20:27:48.418 INFO:tasks.workunit.client.1.smithi111.stdout:4/114: mkdir d8/da/d29 0 2023-12-08T20:27:48.422 INFO:tasks.workunit.client.1.smithi111.stdout:8/233: mkdir dd/d32/d36/d50 0 2023-12-08T20:27:48.422 INFO:tasks.workunit.client.1.smithi111.stdout:1/224: truncate d0/d22/f23 2230486 0 2023-12-08T20:27:48.426 INFO:tasks.workunit.client.1.smithi111.stdout:3/193: mkdir d2/d3/d13/d36 0 2023-12-08T20:27:48.426 INFO:tasks.workunit.client.1.smithi111.stdout:1/225: dread d0/f31 [0,4194304] 0 2023-12-08T20:27:48.427 INFO:tasks.workunit.client.1.smithi111.stdout:6/97: mkdir d0/d1b 0 2023-12-08T20:27:48.430 INFO:tasks.workunit.client.1.smithi111.stdout:2/252: mknod d1/d1d/d1f/d25/d3d/d41/c62 0 2023-12-08T20:27:48.430 INFO:tasks.workunit.client.1.smithi111.stdout:2/253: write d1/d1d/d55/d58/f61 [166693,76435] 0 2023-12-08T20:27:48.430 INFO:tasks.workunit.client.1.smithi111.stdout:2/254: stat d1/d1d/d22/d30/f5c 0 2023-12-08T20:27:48.431 INFO:tasks.workunit.client.1.smithi111.stdout:7/153: link c2 da/d13/c31 0 2023-12-08T20:27:48.433 INFO:tasks.workunit.client.1.smithi111.stdout:4/115: creat d8/da/db/d1b/d1f/f2a x:0 0 0 2023-12-08T20:27:48.435 INFO:tasks.workunit.client.1.smithi111.stdout:8/234: dwrite dd/d32/f3e [0,4194304] 0 2023-12-08T20:27:48.435 INFO:tasks.workunit.client.1.smithi111.stdout:9/246: creat d2/d8/dd/d1a/d1e/d2d/f51 x:0 0 0 2023-12-08T20:27:48.435 INFO:tasks.workunit.client.1.smithi111.stdout:8/235: fdatasync dd/d2d/f4a 0 2023-12-08T20:27:48.435 INFO:tasks.workunit.client.1.smithi111.stdout:8/236: fsync dd/d2d/f37 0 2023-12-08T20:27:48.435 INFO:tasks.workunit.client.1.smithi111.stdout:5/243: dwrite d3/d4/d7/d36/f44 [0,4194304] 0 2023-12-08T20:27:48.437 INFO:tasks.workunit.client.1.smithi111.stdout:4/116: write f0 [687580,85957] 0 2023-12-08T20:27:48.439 INFO:tasks.workunit.client.1.smithi111.stdout:1/226: rename d0/d6/d1b to d0/d6/d33/d15/d51 0 2023-12-08T20:27:48.443 INFO:tasks.workunit.client.1.smithi111.stdout:6/98: symlink d0/d1b/l1c 0 2023-12-08T20:27:48.443 INFO:tasks.workunit.client.1.smithi111.stdout:3/194: mknod d2/d12/d2e/c37 0 2023-12-08T20:27:48.443 INFO:tasks.workunit.client.1.smithi111.stdout:8/237: creat dd/d35/f51 x:0 0 0 2023-12-08T20:27:48.447 INFO:tasks.workunit.client.1.smithi111.stdout:5/244: creat d3/d4/f53 x:0 0 0 2023-12-08T20:27:48.449 INFO:tasks.workunit.client.1.smithi111.stdout:4/117: truncate f6 2344746 0 2023-12-08T20:27:48.451 INFO:tasks.workunit.client.1.smithi111.stdout:1/227: unlink d0/d6/c1d 0 2023-12-08T20:27:48.452 INFO:tasks.workunit.client.1.smithi111.stdout:5/245: write d3/d12/f38 [196175,124082] 0 2023-12-08T20:27:48.454 INFO:tasks.workunit.client.1.smithi111.stdout:6/99: unlink d0/d1/fe 0 2023-12-08T20:27:48.455 INFO:tasks.workunit.client.1.smithi111.stdout:3/195: rename d2/d15/d17/c28 to d2/d15/d17/c38 0 2023-12-08T20:27:48.455 INFO:tasks.workunit.client.1.smithi111.stdout:3/196: chown d2/d15 51873 1 2023-12-08T20:27:48.456 INFO:tasks.workunit.client.1.smithi111.stdout:4/118: mkdir d8/da/db/d1b/d1f/d2b 0 2023-12-08T20:27:48.457 INFO:tasks.workunit.client.1.smithi111.stdout:1/228: creat d0/d6/d34/f52 x:0 0 0 2023-12-08T20:27:48.457 INFO:tasks.workunit.client.1.smithi111.stdout:5/246: mknod d3/d4/d7/d29/c54 0 2023-12-08T20:27:48.458 INFO:tasks.workunit.client.1.smithi111.stdout:6/100: creat d0/d1b/f1d x:0 0 0 2023-12-08T20:27:48.459 INFO:tasks.workunit.client.1.smithi111.stdout:3/197: symlink d2/d15/d17/d25/l39 0 2023-12-08T20:27:48.461 INFO:tasks.workunit.client.1.smithi111.stdout:1/229: unlink d0/d6/d33/d15/d51/c2a 0 2023-12-08T20:27:48.462 INFO:tasks.workunit.client.1.smithi111.stdout:6/101: write d0/d1/f5 [2775607,47518] 0 2023-12-08T20:27:48.462 INFO:tasks.workunit.client.1.smithi111.stdout:6/102: write d0/d1/f11 [1008118,112580] 0 2023-12-08T20:27:48.463 INFO:tasks.workunit.client.1.smithi111.stdout:9/247: dwrite d2/d8/dd/f4e [0,4194304] 0 2023-12-08T20:27:48.463 INFO:tasks.workunit.client.1.smithi111.stdout:3/198: creat d2/d3/d6/f3a x:0 0 0 2023-12-08T20:27:48.463 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:48 smithi043 ceph-mon[111966]: pgmap v15: 65 pgs: 65 active+clean; 253 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8.0 MiB/s rd, 16 MiB/s wr, 57 op/s 2023-12-08T20:27:48.464 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:48 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:48.464 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:48 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:48.464 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:48 smithi043 ceph-mon[111966]: Reconfiguring alertmanager.smithi043 (dependencies changed)... 2023-12-08T20:27:48.464 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:48 smithi043 ceph-mon[111966]: Reconfiguring daemon alertmanager.smithi043 on smithi043 2023-12-08T20:27:48.465 INFO:tasks.workunit.client.1.smithi111.stdout:2/255: dwrite d1/d29/d53/f3a [4194304,4194304] 0 2023-12-08T20:27:48.465 INFO:tasks.workunit.client.1.smithi111.stdout:2/256: write d1/d1d/d22/f50 [55537,38755] 0 2023-12-08T20:27:48.465 INFO:tasks.workunit.client.1.smithi111.stdout:1/230: creat d0/d6/d47/f53 x:0 0 0 2023-12-08T20:27:48.466 INFO:tasks.workunit.client.1.smithi111.stdout:8/238: dwrite dd/d32/d3d/f44 [0,4194304] 0 2023-12-08T20:27:48.470 INFO:tasks.workunit.client.1.smithi111.stdout:9/248: mknod d2/da/c52 0 2023-12-08T20:27:48.474 INFO:tasks.workunit.client.1.smithi111.stdout:3/199: rmdir d2/d30 0 2023-12-08T20:27:48.474 INFO:tasks.workunit.client.1.smithi111.stdout:8/239: dread f2 [0,4194304] 0 2023-12-08T20:27:48.475 INFO:tasks.workunit.client.1.smithi111.stdout:8/240: readlink dd/l21 0 2023-12-08T20:27:48.489 INFO:tasks.workunit.client.1.smithi111.stdout:9/249: dwrite d2/d8/f4f [0,4194304] 0 2023-12-08T20:27:48.489 INFO:tasks.workunit.client.1.smithi111.stdout:9/250: fdatasync d2/d8/f40 0 2023-12-08T20:27:48.489 INFO:tasks.workunit.client.1.smithi111.stdout:9/251: dread d2/d8/f4d [0,4194304] 0 2023-12-08T20:27:48.495 INFO:tasks.workunit.client.1.smithi111.stdout:2/257: rmdir d1/d1d/d55 39 2023-12-08T20:27:48.496 INFO:tasks.workunit.client.1.smithi111.stdout:6/103: rmdir d0/d1 39 2023-12-08T20:27:48.496 INFO:tasks.workunit.client.1.smithi111.stdout:6/104: chown d0/d1/l9 12 1 2023-12-08T20:27:48.496 INFO:tasks.workunit.client.1.smithi111.stdout:6/105: fsync d0/f13 0 2023-12-08T20:27:48.498 INFO:tasks.workunit.client.1.smithi111.stdout:4/119: rename d8/da/db/d1b to d8/da/d2c 0 2023-12-08T20:27:48.500 INFO:tasks.workunit.client.1.smithi111.stdout:1/231: truncate d0/f1 1318688 0 2023-12-08T20:27:48.502 INFO:tasks.workunit.client.1.smithi111.stdout:3/200: rmdir d2/d15/d17 39 2023-12-08T20:27:48.506 INFO:tasks.workunit.client.1.smithi111.stdout:9/252: write d2/d8/dd/d1a/d1e/d2d/f3d [1257051,47826] 0 2023-12-08T20:27:48.507 INFO:tasks.workunit.client.1.smithi111.stdout:6/106: mkdir d0/d1/d1e 0 2023-12-08T20:27:48.508 INFO:tasks.workunit.client.1.smithi111.stdout:6/107: fdatasync d0/d1/f6 0 2023-12-08T20:27:48.508 INFO:tasks.workunit.client.1.smithi111.stdout:6/108: write d0/d1b/f1d [1034452,107710] 0 2023-12-08T20:27:48.508 INFO:tasks.workunit.client.1.smithi111.stdout:6/109: fsync d0/d1/f6 0 2023-12-08T20:27:48.508 INFO:tasks.workunit.client.1.smithi111.stdout:9/253: dread d2/d8/dd/d1a/d1e/d23/f48 [0,4194304] 0 2023-12-08T20:27:48.508 INFO:tasks.workunit.client.1.smithi111.stdout:9/254: chown d2/da/c1d 3 1 2023-12-08T20:27:48.511 INFO:tasks.workunit.client.1.smithi111.stdout:5/247: rename d3/d4/d7/d2c/f48 to d3/d4/f55 0 2023-12-08T20:27:48.511 INFO:tasks.workunit.client.1.smithi111.stdout:5/248: fdatasync d3/d4/d7/d29/d30/f3f 0 2023-12-08T20:27:48.512 INFO:tasks.workunit.client.1.smithi111.stdout:5/249: readlink d3/d4/d7/d36/l51 0 2023-12-08T20:27:48.512 INFO:tasks.workunit.client.1.smithi111.stdout:4/120: unlink d8/c13 0 2023-12-08T20:27:48.512 INFO:tasks.workunit.client.1.smithi111.stdout:4/121: write f6 [2865123,22536] 0 2023-12-08T20:27:48.514 INFO:tasks.workunit.client.1.smithi111.stdout:1/232: creat d0/d3a/f54 x:0 0 0 2023-12-08T20:27:48.514 INFO:tasks.workunit.client.1.smithi111.stdout:3/201: rmdir d2/d33 0 2023-12-08T20:27:48.517 INFO:tasks.workunit.client.1.smithi111.stdout:6/110: rmdir d0/d1 39 2023-12-08T20:27:48.517 INFO:tasks.workunit.client.1.smithi111.stdout:6/111: readlink d0/d1/la 0 2023-12-08T20:27:48.517 INFO:tasks.workunit.client.1.smithi111.stdout:6/112: write d0/d1/f8 [3058939,58321] 0 2023-12-08T20:27:48.519 INFO:tasks.workunit.client.1.smithi111.stdout:8/241: rename dd/d32/d3d/f46 to dd/d32/d36/d4b/f52 0 2023-12-08T20:27:48.520 INFO:tasks.workunit.client.1.smithi111.stdout:1/233: mknod d0/d6/d33/c55 0 2023-12-08T20:27:48.521 INFO:tasks.workunit.client.1.smithi111.stdout:8/242: write dd/f1f [2394880,19087] 0 2023-12-08T20:27:48.522 INFO:tasks.workunit.client.1.smithi111.stdout:9/255: dwrite d2/f7 [0,4194304] 0 2023-12-08T20:27:48.522 INFO:tasks.workunit.client.1.smithi111.stdout:1/234: creat d0/d22/f56 x:0 0 0 2023-12-08T20:27:48.522 INFO:tasks.workunit.client.1.smithi111.stdout:1/235: chown d0/c1e 8120 1 2023-12-08T20:27:48.524 INFO:tasks.workunit.client.1.smithi111.stdout:5/250: dread d3/d4/d4a/f32 [0,4194304] 0 2023-12-08T20:27:48.524 INFO:tasks.workunit.client.1.smithi111.stdout:9/256: creat d2/d8/dd/d1a/d1e/d2d/d35/f53 x:0 0 0 2023-12-08T20:27:48.524 INFO:tasks.workunit.client.1.smithi111.stdout:3/202: dread d2/d3/d6/fe [0,4194304] 0 2023-12-08T20:27:48.525 INFO:tasks.workunit.client.1.smithi111.stdout:5/251: creat d3/d4/d7/d2c/f56 x:0 0 0 2023-12-08T20:27:48.526 INFO:tasks.workunit.client.1.smithi111.stdout:5/252: dread d3/d4/d7/d36/f3d [0,4194304] 0 2023-12-08T20:27:48.526 INFO:tasks.workunit.client.1.smithi111.stdout:9/257: unlink d2/d8/f36 0 2023-12-08T20:27:48.528 INFO:tasks.workunit.client.1.smithi111.stdout:3/203: rmdir d2/d12/d2e 39 2023-12-08T20:27:48.530 INFO:tasks.workunit.client.1.smithi111.stdout:5/253: truncate d3/d4/d4a/f49 1354359 0 2023-12-08T20:27:48.530 INFO:tasks.workunit.client.1.smithi111.stdout:5/254: truncate d3/d4/f8 5517452 0 2023-12-08T20:27:48.532 INFO:tasks.workunit.client.1.smithi111.stdout:4/122: dread d8/da/d2c/d1f/fe [0,4194304] 0 2023-12-08T20:27:48.538 INFO:tasks.workunit.client.1.smithi111.stdout:9/258: creat d2/d8/dd/d1a/d1e/f54 x:0 0 0 2023-12-08T20:27:48.538 INFO:tasks.workunit.client.1.smithi111.stdout:3/204: creat d2/d15/d17/f3b x:0 0 0 2023-12-08T20:27:48.538 INFO:tasks.workunit.client.1.smithi111.stdout:5/255: mknod d3/d4/c57 0 2023-12-08T20:27:48.539 INFO:tasks.workunit.client.1.smithi111.stdout:5/256: fdatasync d3/d4/f53 0 2023-12-08T20:27:48.540 INFO:tasks.workunit.client.1.smithi111.stdout:4/123: rename d8/da/c10 to d8/da/db/c2d 0 2023-12-08T20:27:48.541 INFO:tasks.workunit.client.1.smithi111.stdout:9/259: symlink d2/l55 0 2023-12-08T20:27:48.545 INFO:tasks.workunit.client.1.smithi111.stdout:4/124: mknod d8/da/d29/c2e 0 2023-12-08T20:27:48.546 INFO:tasks.workunit.client.1.smithi111.stdout:3/205: truncate d2/d3/d6/fe 697381 0 2023-12-08T20:27:48.549 INFO:tasks.workunit.client.1.smithi111.stdout:9/260: mkdir d2/d8/dd/d56 0 2023-12-08T20:27:48.552 INFO:tasks.workunit.client.1.smithi111.stdout:4/125: mkdir d8/da/d29/d2f 0 2023-12-08T20:27:48.552 INFO:tasks.workunit.client.1.smithi111.stdout:3/206: mknod d2/d3/d1e/c3c 0 2023-12-08T20:27:48.552 INFO:tasks.workunit.client.1.smithi111.stdout:4/126: truncate d8/da/db/fc 523678 0 2023-12-08T20:27:48.552 INFO:tasks.workunit.client.1.smithi111.stdout:3/207: rmdir d2/d3/d13 39 2023-12-08T20:27:48.553 INFO:tasks.workunit.client.1.smithi111.stdout:4/127: mkdir d8/d30 0 2023-12-08T20:27:48.556 INFO:tasks.workunit.client.1.smithi111.stdout:3/208: symlink d2/d3/l3d 0 2023-12-08T20:27:48.558 INFO:tasks.workunit.client.1.smithi111.stdout:4/128: mkdir d8/da/db/d31 0 2023-12-08T20:27:48.559 INFO:tasks.workunit.client.1.smithi111.stdout:4/129: symlink d8/l32 0 2023-12-08T20:27:48.570 INFO:tasks.workunit.client.1.smithi111.stdout:8/243: dwrite dd/d2d/f4a [0,4194304] 0 2023-12-08T20:27:48.575 INFO:tasks.workunit.client.1.smithi111.stdout:3/209: dread d2/f9 [0,4194304] 0 2023-12-08T20:27:48.575 INFO:tasks.workunit.client.1.smithi111.stdout:8/244: mknod dd/d2d/c53 0 2023-12-08T20:27:48.575 INFO:tasks.workunit.client.1.smithi111.stdout:5/257: dwrite d3/d12/f33 [0,4194304] 0 2023-12-08T20:27:48.575 INFO:tasks.workunit.client.1.smithi111.stdout:9/261: dwrite d2/d8/dd/d1a/d1e/d23/f48 [0,4194304] 0 2023-12-08T20:27:48.575 INFO:tasks.workunit.client.1.smithi111.stdout:1/236: dwrite d0/f2 [0,4194304] 0 2023-12-08T20:27:48.576 INFO:tasks.workunit.client.1.smithi111.stdout:6/113: dwrite d0/d1b/f1d [0,4194304] 0 2023-12-08T20:27:48.576 INFO:tasks.workunit.client.1.smithi111.stdout:3/210: creat d2/d3/d13/d36/f3e x:0 0 0 2023-12-08T20:27:48.576 INFO:tasks.workunit.client.1.smithi111.stdout:3/211: write d2/d3/d6/f23 [198963,4981] 0 2023-12-08T20:27:48.576 INFO:tasks.workunit.client.1.smithi111.stdout:8/245: write f2 [1906582,109598] 0 2023-12-08T20:27:48.583 INFO:tasks.workunit.client.1.smithi111.stdout:9/262: mkdir d2/d8/dd/d1a/d1e/d23/d57 0 2023-12-08T20:27:48.584 INFO:tasks.workunit.client.1.smithi111.stdout:1/237: creat d0/d4d/f57 x:0 0 0 2023-12-08T20:27:48.587 INFO:tasks.workunit.client.1.smithi111.stdout:6/114: creat d0/d1a/f1f x:0 0 0 2023-12-08T20:27:48.588 INFO:tasks.workunit.client.1.smithi111.stdout:6/115: truncate d0/f12 397720 0 2023-12-08T20:27:48.589 INFO:tasks.workunit.client.1.smithi111.stdout:3/212: symlink d2/d12/d2e/l3f 0 2023-12-08T20:27:48.590 INFO:tasks.workunit.client.1.smithi111.stdout:3/213: write d2/d3/d6/fd [1410388,46290] 0 2023-12-08T20:27:48.590 INFO:tasks.workunit.client.1.smithi111.stdout:3/214: write d2/d12/d2e/f2f [4678434,63127] 0 2023-12-08T20:27:48.595 INFO:tasks.workunit.client.1.smithi111.stdout:5/258: dwrite d3/d12/f1b [0,4194304] 0 2023-12-08T20:27:48.595 INFO:tasks.workunit.client.1.smithi111.stdout:4/130: dwrite d8/f15 [0,4194304] 0 2023-12-08T20:27:48.595 INFO:tasks.workunit.client.1.smithi111.stdout:1/238: symlink d0/d6/d33/d15/d51/l58 0 2023-12-08T20:27:48.595 INFO:tasks.workunit.client.1.smithi111.stdout:4/131: write d8/da/d2c/d1f/f23 [174654,103937] 0 2023-12-08T20:27:48.596 INFO:tasks.workunit.client.1.smithi111.stdout:4/132: dread - d8/da/d2c/d1f/f2a zero size 2023-12-08T20:27:48.596 INFO:tasks.workunit.client.1.smithi111.stdout:4/133: truncate d8/da/d2c/d1f/f23 537189 0 2023-12-08T20:27:48.598 INFO:tasks.workunit.client.1.smithi111.stdout:6/116: creat d0/f20 x:0 0 0 2023-12-08T20:27:48.598 INFO:tasks.workunit.client.1.smithi111.stdout:6/117: write d0/f12 [519029,71428] 0 2023-12-08T20:27:48.601 INFO:tasks.workunit.client.1.smithi111.stdout:8/246: rename dd/d32/d3d/f40 to dd/f54 0 2023-12-08T20:27:48.602 INFO:tasks.workunit.client.1.smithi111.stdout:8/247: write f2 [810884,109623] 0 2023-12-08T20:27:48.602 INFO:tasks.workunit.client.1.smithi111.stdout:8/248: chown dd/d2d/f3c 2441500 1 2023-12-08T20:27:48.603 INFO:tasks.workunit.client.1.smithi111.stdout:9/263: dwrite d2/d8/f40 [0,4194304] 0 2023-12-08T20:27:48.605 INFO:tasks.workunit.client.1.smithi111.stdout:5/259: rename d3/d4/d4a/c22 to d3/d4/d4a/c58 0 2023-12-08T20:27:48.606 INFO:tasks.workunit.client.1.smithi111.stdout:6/118: dread d0/d1/f5 [0,4194304] 0 2023-12-08T20:27:48.606 INFO:tasks.workunit.client.1.smithi111.stdout:5/260: read d3/d12/f1b [2018479,65872] 0 2023-12-08T20:27:48.609 INFO:tasks.workunit.client.1.smithi111.stdout:1/239: stat d0/d6/d34/l3e 0 2023-12-08T20:27:48.610 INFO:tasks.workunit.client.1.smithi111.stdout:4/134: creat d8/da/d29/f33 x:0 0 0 2023-12-08T20:27:48.610 INFO:tasks.workunit.client.1.smithi111.stdout:4/135: readlink l4 0 2023-12-08T20:27:48.610 INFO:tasks.workunit.client.1.smithi111.stdout:4/136: chown l4 28675 1 2023-12-08T20:27:48.611 INFO:tasks.workunit.client.1.smithi111.stdout:4/137: getdents d8/da/d29/d2f 0 2023-12-08T20:27:48.616 INFO:tasks.workunit.client.1.smithi111.stdout:8/249: mkdir dd/d32/d3d/d55 0 2023-12-08T20:27:48.617 INFO:tasks.workunit.client.1.smithi111.stdout:8/250: fdatasync dd/d35/d42/f47 0 2023-12-08T20:27:48.619 INFO:tasks.workunit.client.1.smithi111.stdout:9/264: truncate d2/d8/dd/d1a/d1e/f26 2602775 0 2023-12-08T20:27:48.620 INFO:tasks.workunit.client.1.smithi111.stdout:9/265: truncate d2/da/fc 4255068 0 2023-12-08T20:27:48.622 INFO:tasks.workunit.client.1.smithi111.stdout:6/119: rename d0/d1/c18 to d0/d1/c21 0 2023-12-08T20:27:48.622 INFO:tasks.workunit.client.1.smithi111.stdout:6/120: readlink d0/d1/la 0 2023-12-08T20:27:48.622 INFO:tasks.workunit.client.1.smithi111.stdout:6/121: stat d0/f20 0 2023-12-08T20:27:48.623 INFO:tasks.workunit.client.1.smithi111.stdout:5/261: mkdir d3/d4/d59 0 2023-12-08T20:27:48.624 INFO:tasks.workunit.client.1.smithi111.stdout:1/240: mkdir d0/d3a/d59 0 2023-12-08T20:27:48.626 INFO:tasks.workunit.client.1.smithi111.stdout:8/251: dread dd/f28 [0,4194304] 0 2023-12-08T20:27:48.626 INFO:tasks.workunit.client.1.smithi111.stdout:9/266: creat d2/d8/dd/d56/f58 x:0 0 0 2023-12-08T20:27:48.627 INFO:tasks.workunit.client.1.smithi111.stdout:6/122: creat d0/f22 x:0 0 0 2023-12-08T20:27:48.628 INFO:tasks.workunit.client.1.smithi111.stdout:1/241: symlink d0/d6/d33/d15/d51/d2e/l5a 0 2023-12-08T20:27:48.628 INFO:tasks.workunit.client.1.smithi111.stdout:8/252: write dd/f14 [2651690,128100] 0 2023-12-08T20:27:48.629 INFO:tasks.workunit.client.1.smithi111.stdout:9/267: creat d2/f59 x:0 0 0 2023-12-08T20:27:48.630 INFO:tasks.workunit.client.1.smithi111.stdout:4/138: write d8/f15 [4933121,81106] 0 2023-12-08T20:27:48.632 INFO:tasks.workunit.client.1.smithi111.stdout:8/253: symlink dd/d2d/l56 0 2023-12-08T20:27:48.634 INFO:tasks.workunit.client.1.smithi111.stdout:9/268: rmdir d2/d8/dd/d1a/d1e/d2d/d35 39 2023-12-08T20:27:48.636 INFO:tasks.workunit.client.1.smithi111.stdout:4/139: rmdir d8/da/d29 39 2023-12-08T20:27:48.636 INFO:tasks.workunit.client.1.smithi111.stdout:4/140: fdatasync f6 0 2023-12-08T20:27:48.636 INFO:tasks.workunit.client.1.smithi111.stdout:5/262: dwrite d3/d4/d7/d36/f3d [0,4194304] 0 2023-12-08T20:27:48.636 INFO:tasks.workunit.client.1.smithi111.stdout:8/254: truncate dd/f54 71248 0 2023-12-08T20:27:48.638 INFO:tasks.workunit.client.1.smithi111.stdout:4/141: creat d8/da/d2c/d1f/d2b/f34 x:0 0 0 2023-12-08T20:27:48.638 INFO:tasks.workunit.client.1.smithi111.stdout:4/142: fsync d8/da/d2c/f24 0 2023-12-08T20:27:48.638 INFO:tasks.workunit.client.1.smithi111.stdout:4/143: write f1 [2759481,94825] 0 2023-12-08T20:27:48.638 INFO:tasks.workunit.client.1.smithi111.stdout:4/144: write d8/da/d29/f33 [217121,128324] 0 2023-12-08T20:27:48.640 INFO:tasks.workunit.client.1.smithi111.stdout:8/255: creat dd/d32/f57 x:0 0 0 2023-12-08T20:27:48.643 INFO:tasks.workunit.client.1.smithi111.stdout:4/145: symlink d8/d30/l35 0 2023-12-08T20:27:48.643 INFO:tasks.workunit.client.1.smithi111.stdout:9/269: dread d2/d8/dd/f4e [0,4194304] 0 2023-12-08T20:27:48.643 INFO:tasks.workunit.client.1.smithi111.stdout:9/270: dread - d2/f59 zero size 2023-12-08T20:27:48.646 INFO:tasks.workunit.client.1.smithi111.stdout:8/256: link f5 dd/d32/f58 0 2023-12-08T20:27:48.646 INFO:tasks.workunit.client.1.smithi111.stdout:8/257: write dd/d32/f57 [197000,114612] 0 2023-12-08T20:27:48.646 INFO:tasks.workunit.client.1.smithi111.stdout:8/258: fsync fa 0 2023-12-08T20:27:48.647 INFO:tasks.workunit.client.1.smithi111.stdout:5/263: dread d3/d4/f8 [0,4194304] 0 2023-12-08T20:27:48.647 INFO:tasks.workunit.client.1.smithi111.stdout:4/146: symlink d8/da/l36 0 2023-12-08T20:27:48.647 INFO:tasks.workunit.client.1.smithi111.stdout:4/147: write d8/da/f1e [428434,31126] 0 2023-12-08T20:27:48.648 INFO:tasks.workunit.client.1.smithi111.stdout:5/264: write d3/d4/d7/f25 [3859080,28819] 0 2023-12-08T20:27:48.651 INFO:tasks.workunit.client.1.smithi111.stdout:1/242: rename d0/d3a to d0/d6/d33/d15/d51/d5b 0 2023-12-08T20:27:48.651 INFO:tasks.workunit.client.1.smithi111.stdout:8/259: rename dd/d32/d3d to dd/d32/d3d/d55/d59 22 2023-12-08T20:27:48.651 INFO:tasks.workunit.client.1.smithi111.stdout:1/243: read - d0/d6/d33/d15/d51/d5b/f54 zero size 2023-12-08T20:27:48.651 INFO:tasks.workunit.client.1.smithi111.stdout:8/260: write dd/d32/d3d/f4f [592529,34428] 0 2023-12-08T20:27:48.652 INFO:tasks.workunit.client.1.smithi111.stdout:4/148: rmdir d8/da/d29 39 2023-12-08T20:27:48.652 INFO:tasks.workunit.client.1.smithi111.stdout:4/149: fsync d8/da/db/fc 0 2023-12-08T20:27:48.654 INFO:tasks.workunit.client.1.smithi111.stdout:6/123: getdents d0 0 2023-12-08T20:27:48.654 INFO:tasks.workunit.client.1.smithi111.stdout:6/124: truncate d0/f22 594275 0 2023-12-08T20:27:48.659 INFO:tasks.workunit.client.1.smithi111.stdout:9/271: creat d2/d8/dd/d1a/d1e/d2d/d4a/f5a x:0 0 0 2023-12-08T20:27:48.667 INFO:tasks.workunit.client.1.smithi111.stdout:5/265: creat d3/d4/d7/d2c/f5a x:0 0 0 2023-12-08T20:27:48.668 INFO:tasks.workunit.client.1.smithi111.stdout:8/261: creat dd/d32/d3d/f5a x:0 0 0 2023-12-08T20:27:48.669 INFO:tasks.workunit.client.1.smithi111.stdout:8/262: read dd/f19 [536526,127973] 0 2023-12-08T20:27:48.672 INFO:tasks.workunit.client.1.smithi111.stdout:4/150: unlink d8/da/d2c/d1f/f23 0 2023-12-08T20:27:48.677 INFO:tasks.workunit.client.1.smithi111.stdout:1/244: dwrite d0/d6/d34/f52 [0,4194304] 0 2023-12-08T20:27:48.677 INFO:tasks.workunit.client.1.smithi111.stdout:6/125: link d0/d1/cc d0/c23 0 2023-12-08T20:27:48.678 INFO:tasks.workunit.client.1.smithi111.stdout:5/266: unlink d3/d4/d7/d29/d30/c3c 0 2023-12-08T20:27:48.679 INFO:tasks.workunit.client.1.smithi111.stdout:4/151: mknod d8/c37 0 2023-12-08T20:27:48.683 INFO:tasks.workunit.client.1.smithi111.stdout:1/245: creat d0/d6/d33/d15/d51/d2e/f5c x:0 0 0 2023-12-08T20:27:48.684 INFO:tasks.workunit.client.1.smithi111.stdout:6/126: write d0/d1a/f1f [161026,123895] 0 2023-12-08T20:27:48.684 INFO:tasks.workunit.client.1.smithi111.stdout:5/267: dread d3/d4/d7/d36/f3d [0,4194304] 0 2023-12-08T20:27:48.685 INFO:tasks.workunit.client.1.smithi111.stdout:9/272: symlink d2/d8/dd/d1a/d1e/d2d/d4a/l5b 0 2023-12-08T20:27:48.687 INFO:tasks.workunit.client.1.smithi111.stdout:4/152: mkdir d8/d38 0 2023-12-08T20:27:48.687 INFO:tasks.workunit.client.1.smithi111.stdout:4/153: read - d8/da/d2c/d1f/d2b/f34 zero size 2023-12-08T20:27:48.688 INFO:tasks.workunit.client.1.smithi111.stdout:8/263: dwrite dd/f54 [0,4194304] 0 2023-12-08T20:27:48.688 INFO:tasks.workunit.client.1.smithi111.stdout:6/127: readlink d0/d1/l19 0 2023-12-08T20:27:48.690 INFO:tasks.workunit.client.1.smithi111.stdout:4/154: creat d8/da/d29/f39 x:0 0 0 2023-12-08T20:27:48.690 INFO:tasks.workunit.client.1.smithi111.stdout:4/155: chown d8/da/f20 5 1 2023-12-08T20:27:48.691 INFO:tasks.workunit.client.1.smithi111.stdout:1/246: dread d0/d6/f10 [4194304,4194304] 0 2023-12-08T20:27:48.695 INFO:tasks.workunit.client.1.smithi111.stdout:8/264: getdents dd/d35/d42 0 2023-12-08T20:27:48.695 INFO:tasks.workunit.client.1.smithi111.stdout:8/265: chown dd/f1f 39980417 1 2023-12-08T20:27:48.695 INFO:tasks.workunit.client.1.smithi111.stdout:8/266: chown dd/d2d/f4a 12526 1 2023-12-08T20:27:48.699 INFO:tasks.workunit.client.1.smithi111.stdout:6/128: link d0/d1b/l1c d0/d1/d1e/l24 0 2023-12-08T20:27:48.699 INFO:tasks.workunit.client.1.smithi111.stdout:6/129: readlink d0/d1/d1e/l24 0 2023-12-08T20:27:48.699 INFO:tasks.workunit.client.1.smithi111.stdout:6/130: chown d0/d1a/f1f 12 1 2023-12-08T20:27:48.700 INFO:tasks.workunit.client.1.smithi111.stdout:8/267: write dd/d2d/f33 [4517859,71070] 0 2023-12-08T20:27:48.700 INFO:tasks.workunit.client.1.smithi111.stdout:6/131: readlink d0/ld 0 2023-12-08T20:27:48.706 INFO:tasks.workunit.client.1.smithi111.stdout:4/156: dread f0 [0,4194304] 0 2023-12-08T20:27:48.706 INFO:tasks.workunit.client.1.smithi111.stdout:4/157: fdatasync d8/da/d2c/d1f/d2b/f34 0 2023-12-08T20:27:48.706 INFO:tasks.workunit.client.1.smithi111.stdout:4/158: truncate d8/da/d29/f33 1366015 0 2023-12-08T20:27:48.706 INFO:tasks.workunit.client.1.smithi111.stdout:6/132: dread d0/d1/f5 [0,4194304] 0 2023-12-08T20:27:48.707 INFO:tasks.workunit.client.1.smithi111.stdout:6/133: mknod d0/c25 0 2023-12-08T20:27:48.708 INFO:tasks.workunit.client.1.smithi111.stdout:8/268: write dd/f14 [371644,24140] 0 2023-12-08T20:27:48.709 INFO:tasks.workunit.client.1.smithi111.stdout:8/269: creat dd/d32/d3d/f5b x:0 0 0 2023-12-08T20:27:48.709 INFO:tasks.workunit.client.1.smithi111.stdout:8/270: chown dd/d2d/f31 24 1 2023-12-08T20:27:48.711 INFO:tasks.workunit.client.1.smithi111.stdout:8/271: symlink dd/d32/d36/d50/l5c 0 2023-12-08T20:27:48.711 INFO:tasks.workunit.client.1.smithi111.stdout:1/247: dwrite d0/d6/d33/f4f [0,4194304] 0 2023-12-08T20:27:48.712 INFO:tasks.workunit.client.1.smithi111.stdout:5/268: dwrite d3/d4/d7/d2c/f3e [0,4194304] 0 2023-12-08T20:27:48.713 INFO:tasks.workunit.client.1.smithi111.stdout:8/272: rename dd/d32/l34 to dd/d35/l5d 0 2023-12-08T20:27:48.716 INFO:tasks.workunit.client.1.smithi111.stdout:6/134: rmdir d0/d1b 39 2023-12-08T20:27:48.716 INFO:tasks.workunit.client.1.smithi111.stdout:6/135: stat d0/ld 0 2023-12-08T20:27:48.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:48 smithi111 ceph-mon[121341]: pgmap v15: 65 pgs: 65 active+clean; 253 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8.0 MiB/s rd, 16 MiB/s wr, 57 op/s 2023-12-08T20:27:48.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:48 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:48.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:48 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:48.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:48 smithi111 ceph-mon[121341]: Reconfiguring alertmanager.smithi043 (dependencies changed)... 2023-12-08T20:27:48.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:48 smithi111 ceph-mon[121341]: Reconfiguring daemon alertmanager.smithi043 on smithi043 2023-12-08T20:27:48.724 INFO:tasks.workunit.client.1.smithi111.stdout:8/273: symlink dd/d35/d42/l5e 0 2023-12-08T20:27:48.725 INFO:tasks.workunit.client.1.smithi111.stdout:6/136: symlink d0/d1b/l26 0 2023-12-08T20:27:48.725 INFO:tasks.workunit.client.1.smithi111.stdout:6/137: chown d0/d1/c21 13 1 2023-12-08T20:27:48.727 INFO:tasks.workunit.client.1.smithi111.stdout:8/274: symlink dd/l5f 0 2023-12-08T20:27:48.728 INFO:tasks.workunit.client.1.smithi111.stdout:1/248: dwrite d0/f31 [4194304,4194304] 0 2023-12-08T20:27:48.728 INFO:tasks.workunit.client.1.smithi111.stdout:8/275: write dd/d2d/f37 [2593476,21401] 0 2023-12-08T20:27:48.730 INFO:tasks.workunit.client.1.smithi111.stdout:8/276: mknod dd/d35/c60 0 2023-12-08T20:27:48.731 INFO:tasks.workunit.client.1.smithi111.stdout:1/249: dread d0/d6/f28 [0,4194304] 0 2023-12-08T20:27:48.731 INFO:tasks.workunit.client.1.smithi111.stdout:1/250: chown d0/d6/d33/d15/d51/d2e/f40 277 1 2023-12-08T20:27:48.732 INFO:tasks.workunit.client.1.smithi111.stdout:1/251: fsync d0/d6/d33/d15/d51/d2e/f40 0 2023-12-08T20:27:48.732 INFO:tasks.workunit.client.1.smithi111.stdout:1/252: write d0/f2d [604389,113992] 0 2023-12-08T20:27:48.732 INFO:tasks.workunit.client.1.smithi111.stdout:1/253: write d0/d6/d47/f50 [109135,58763] 0 2023-12-08T20:27:48.732 INFO:tasks.workunit.client.1.smithi111.stdout:1/254: write d0/d22/f23 [570677,108457] 0 2023-12-08T20:27:48.733 INFO:tasks.workunit.client.1.smithi111.stdout:1/255: readlink d0/d6/d33/d15/d51/d5b/l3f 0 2023-12-08T20:27:48.733 INFO:tasks.workunit.client.1.smithi111.stdout:1/256: write d0/d6/f10 [7641301,70005] 0 2023-12-08T20:27:48.735 INFO:tasks.workunit.client.1.smithi111.stdout:1/257: unlink d0/d6/d33/d15/d51/d2e/l38 0 2023-12-08T20:27:48.737 INFO:tasks.workunit.client.1.smithi111.stdout:1/258: symlink d0/d6/d33/d15/d51/d2e/l5d 0 2023-12-08T20:27:48.747 INFO:tasks.workunit.client.1.smithi111.stdout:6/138: dwrite d0/f12 [0,4194304] 0 2023-12-08T20:27:48.749 INFO:tasks.workunit.client.1.smithi111.stdout:6/139: write d0/f20 [868911,15094] 0 2023-12-08T20:27:48.749 INFO:tasks.workunit.client.1.smithi111.stdout:6/140: chown d0/d1/cc 392 1 2023-12-08T20:27:48.750 INFO:tasks.workunit.client.1.smithi111.stdout:6/141: mkdir d0/d1/d27 0 2023-12-08T20:27:48.751 INFO:tasks.workunit.client.1.smithi111.stdout:8/277: dwrite dd/f15 [0,4194304] 0 2023-12-08T20:27:48.752 INFO:tasks.workunit.client.1.smithi111.stdout:8/278: write dd/f20 [3573414,123774] 0 2023-12-08T20:27:48.753 INFO:tasks.workunit.client.1.smithi111.stdout:8/279: stat dd/d32/d3d/f4f 0 2023-12-08T20:27:48.753 INFO:tasks.workunit.client.1.smithi111.stdout:8/280: fdatasync f2 0 2023-12-08T20:27:48.769 INFO:tasks.workunit.client.1.smithi111.stdout:8/281: dread dd/d32/f58 [0,4194304] 0 2023-12-08T20:27:48.773 INFO:tasks.workunit.client.1.smithi111.stdout:6/142: dwrite d0/d1/f11 [0,4194304] 0 2023-12-08T20:27:48.775 INFO:tasks.workunit.client.1.smithi111.stdout:6/143: creat d0/d1a/f28 x:0 0 0 2023-12-08T20:27:48.779 INFO:tasks.workunit.client.1.smithi111.stdout:6/144: truncate d0/d1/f11 899339 0 2023-12-08T20:27:48.781 INFO:tasks.workunit.client.1.smithi111.stdout:6/145: rmdir d0/d1b 39 2023-12-08T20:27:48.783 INFO:tasks.workunit.client.1.smithi111.stdout:6/146: link d0/d1/cc d0/d1/c29 0 2023-12-08T20:27:48.783 INFO:tasks.workunit.client.1.smithi111.stdout:6/147: fdatasync d0/f12 0 2023-12-08T20:27:48.784 INFO:tasks.workunit.client.1.smithi111.stdout:6/148: read d0/d1/f8 [1989363,109895] 0 2023-12-08T20:27:48.787 INFO:tasks.workunit.client.1.smithi111.stdout:6/149: dread d0/d1/f5 [0,4194304] 0 2023-12-08T20:27:48.788 INFO:tasks.workunit.client.1.smithi111.stdout:6/150: stat d0/d1/c21 0 2023-12-08T20:27:48.790 INFO:tasks.workunit.client.1.smithi111.stdout:7/154: sync 2023-12-08T20:27:48.790 INFO:tasks.workunit.client.1.smithi111.stdout:0/222: sync 2023-12-08T20:27:48.791 INFO:tasks.workunit.client.1.smithi111.stdout:0/223: mkdir d1/dd/d4a 0 2023-12-08T20:27:48.791 INFO:tasks.workunit.client.1.smithi111.stdout:0/224: write d1/d4/d24/f45 [58453,51830] 0 2023-12-08T20:27:48.791 INFO:tasks.workunit.client.1.smithi111.stdout:6/151: dread d0/d1/f5 [0,4194304] 0 2023-12-08T20:27:48.791 INFO:tasks.workunit.client.1.smithi111.stdout:6/152: write d0/d1a/f28 [510949,74021] 0 2023-12-08T20:27:48.791 INFO:tasks.workunit.client.1.smithi111.stdout:6/153: stat d0/d1/la 0 2023-12-08T20:27:48.793 INFO:tasks.workunit.client.1.smithi111.stdout:0/225: creat d1/d4/d3a/f4b x:0 0 0 2023-12-08T20:27:48.793 INFO:tasks.workunit.client.1.smithi111.stdout:0/226: truncate d1/df/d44/f43 587391 0 2023-12-08T20:27:48.794 INFO:tasks.workunit.client.1.smithi111.stdout:6/154: write d0/d1/f11 [329257,41410] 0 2023-12-08T20:27:48.794 INFO:tasks.workunit.client.1.smithi111.stdout:6/155: creat d0/d1a/f2a x:0 0 0 2023-12-08T20:27:48.795 INFO:tasks.workunit.client.1.smithi111.stdout:0/227: mknod d1/c4c 0 2023-12-08T20:27:48.797 INFO:tasks.workunit.client.1.smithi111.stdout:0/228: symlink d1/df/d44/d37/l4d 0 2023-12-08T20:27:48.798 INFO:tasks.workunit.client.1.smithi111.stdout:0/229: creat d1/dd/f4e x:0 0 0 2023-12-08T20:27:48.803 INFO:tasks.workunit.client.1.smithi111.stdout:0/230: write d1/d4/f35 [3673312,102531] 0 2023-12-08T20:27:48.803 INFO:tasks.workunit.client.1.smithi111.stdout:0/231: dread d1/df/d16/f2e [0,4194304] 0 2023-12-08T20:27:48.804 INFO:tasks.workunit.client.1.smithi111.stdout:7/155: dwrite da/d13/d21/f2a [0,4194304] 0 2023-12-08T20:27:48.805 INFO:tasks.workunit.client.1.smithi111.stdout:0/232: mknod d1/d4/d24/d2f/c4f 0 2023-12-08T20:27:48.805 INFO:tasks.workunit.client.1.smithi111.stdout:7/156: mkdir da/d25/d26/d32 0 2023-12-08T20:27:48.805 INFO:tasks.workunit.client.1.smithi111.stdout:7/157: write da/f1e [4823363,99231] 0 2023-12-08T20:27:48.807 INFO:tasks.workunit.client.1.smithi111.stdout:0/233: symlink d1/d4/d24/d46/l50 0 2023-12-08T20:27:48.807 INFO:tasks.workunit.client.1.smithi111.stdout:0/234: dread - d1/d4/d3a/f4b zero size 2023-12-08T20:27:48.808 INFO:tasks.workunit.client.1.smithi111.stdout:0/235: mknod d1/d4/d24/d46/c51 0 2023-12-08T20:27:48.810 INFO:tasks.workunit.client.1.smithi111.stdout:0/236: creat d1/d4/d24/d2f/f52 x:0 0 0 2023-12-08T20:27:48.810 INFO:tasks.workunit.client.1.smithi111.stdout:0/237: stat d1/df/c1e 0 2023-12-08T20:27:48.811 INFO:tasks.workunit.client.1.smithi111.stdout:0/238: creat d1/df/d16/f53 x:0 0 0 2023-12-08T20:27:48.811 INFO:tasks.workunit.client.1.smithi111.stdout:0/239: symlink d1/dd/d4a/l54 0 2023-12-08T20:27:48.818 INFO:tasks.workunit.client.1.smithi111.stdout:0/240: fsync d1/d4/f35 0 2023-12-08T20:27:48.818 INFO:tasks.workunit.client.1.smithi111.stdout:7/158: dwrite da/f1b [0,4194304] 0 2023-12-08T20:27:48.818 INFO:tasks.workunit.client.1.smithi111.stdout:7/159: read - da/d25/d26/f2b zero size 2023-12-08T20:27:48.818 INFO:tasks.workunit.client.1.smithi111.stdout:7/160: rename da to da/d13/d33 22 2023-12-08T20:27:48.819 INFO:tasks.workunit.client.1.smithi111.stdout:0/241: creat d1/d4/f55 x:0 0 0 2023-12-08T20:27:48.820 INFO:tasks.workunit.client.1.smithi111.stdout:7/161: read da/f1b [1447805,83174] 0 2023-12-08T20:27:48.820 INFO:tasks.workunit.client.1.smithi111.stdout:0/242: mkdir d1/df/d56 0 2023-12-08T20:27:48.821 INFO:tasks.workunit.client.1.smithi111.stdout:7/162: getdents da/d25 0 2023-12-08T20:27:48.822 INFO:tasks.workunit.client.1.smithi111.stdout:7/163: write f6 [2376471,80943] 0 2023-12-08T20:27:48.822 INFO:tasks.workunit.client.1.smithi111.stdout:0/243: creat d1/f57 x:0 0 0 2023-12-08T20:27:48.823 INFO:tasks.workunit.client.1.smithi111.stdout:7/164: write da/f1b [3627543,37128] 0 2023-12-08T20:27:48.823 INFO:tasks.workunit.client.1.smithi111.stdout:0/244: mkdir d1/d4/d24/d46/d58 0 2023-12-08T20:27:48.825 INFO:tasks.workunit.client.1.smithi111.stdout:7/165: mknod da/d13/d21/d2d/c34 0 2023-12-08T20:27:48.826 INFO:tasks.workunit.client.1.smithi111.stdout:0/245: creat d1/d4/d24/d2f/f59 x:0 0 0 2023-12-08T20:27:48.826 INFO:tasks.workunit.client.1.smithi111.stdout:0/246: chown d1/dd/f18 2 1 2023-12-08T20:27:48.827 INFO:tasks.workunit.client.1.smithi111.stdout:0/247: read d1/d4/d24/f45 [56513,123976] 0 2023-12-08T20:27:48.828 INFO:tasks.workunit.client.1.smithi111.stdout:0/248: chown d1/dd/c33 0 1 2023-12-08T20:27:48.829 INFO:tasks.workunit.client.1.smithi111.stdout:0/249: creat d1/d4/d24/d46/d49/f5a x:0 0 0 2023-12-08T20:27:48.830 INFO:tasks.workunit.client.1.smithi111.stdout:0/250: link d1/dd/l32 d1/d4/d24/d46/d49/l5b 0 2023-12-08T20:27:48.831 INFO:tasks.workunit.client.1.smithi111.stdout:0/251: fdatasync d1/d4/f55 0 2023-12-08T20:27:48.832 INFO:tasks.workunit.client.1.smithi111.stdout:0/252: mkdir d1/df/d44/d37/d5c 0 2023-12-08T20:27:48.834 INFO:tasks.workunit.client.1.smithi111.stdout:0/253: creat d1/dd/d47/f5d x:0 0 0 2023-12-08T20:27:48.838 INFO:tasks.workunit.client.1.smithi111.stdout:0/254: mknod d1/d4/c5e 0 2023-12-08T20:27:48.841 INFO:tasks.workunit.client.1.smithi111.stdout:0/255: link d1/df/d44/l2a d1/d4/l5f 0 2023-12-08T20:27:48.857 INFO:tasks.workunit.client.1.smithi111.stdout:7/166: dwrite da/f1e [4194304,4194304] 0 2023-12-08T20:27:48.857 INFO:tasks.workunit.client.1.smithi111.stdout:0/256: dwrite d1/f57 [0,4194304] 0 2023-12-08T20:27:48.857 INFO:tasks.workunit.client.1.smithi111.stdout:0/257: readlink d1/df/l20 0 2023-12-08T20:27:48.857 INFO:tasks.workunit.client.1.smithi111.stdout:0/258: dread - d1/df/d16/f53 zero size 2023-12-08T20:27:48.858 INFO:tasks.workunit.client.1.smithi111.stdout:0/259: write d1/df/d44/f43 [1284185,116842] 0 2023-12-08T20:27:48.859 INFO:tasks.workunit.client.1.smithi111.stdout:7/167: creat da/d13/d21/d2d/f35 x:0 0 0 2023-12-08T20:27:48.865 INFO:tasks.workunit.client.1.smithi111.stdout:0/260: truncate d1/d2d/f39 2476008 0 2023-12-08T20:27:48.865 INFO:tasks.workunit.client.1.smithi111.stdout:0/261: read d1/df/d44/f43 [457146,22953] 0 2023-12-08T20:27:48.866 INFO:tasks.workunit.client.1.smithi111.stdout:0/262: fdatasync d1/dd/f18 0 2023-12-08T20:27:48.866 INFO:tasks.workunit.client.1.smithi111.stdout:7/168: creat da/d13/d21/d2d/f36 x:0 0 0 2023-12-08T20:27:48.867 INFO:tasks.workunit.client.1.smithi111.stdout:7/169: write da/d13/f17 [1792285,47705] 0 2023-12-08T20:27:48.868 INFO:tasks.workunit.client.1.smithi111.stdout:0/263: creat d1/d4/d24/f60 x:0 0 0 2023-12-08T20:27:48.870 INFO:tasks.workunit.client.1.smithi111.stdout:0/264: stat d1/df/d16/l19 0 2023-12-08T20:27:48.877 INFO:tasks.workunit.client.1.smithi111.stdout:0/265: dread d1/df/d44/f43 [0,4194304] 0 2023-12-08T20:27:48.877 INFO:tasks.workunit.client.1.smithi111.stdout:0/266: chown d1/df/l26 35539 1 2023-12-08T20:27:48.878 INFO:tasks.workunit.client.1.smithi111.stdout:0/267: write d1/dd/f18 [3478277,57249] 0 2023-12-08T20:27:48.892 INFO:tasks.workunit.client.1.smithi111.stdout:7/170: dwrite da/f1b [4194304,4194304] 0 2023-12-08T20:27:48.892 INFO:tasks.workunit.client.1.smithi111.stdout:7/171: write da/d13/d21/d2d/f35 [823739,7951] 0 2023-12-08T20:27:48.895 INFO:tasks.workunit.client.1.smithi111.stdout:0/268: dread d1/dd/f18 [4194304,4194304] 0 2023-12-08T20:27:48.895 INFO:tasks.workunit.client.1.smithi111.stdout:0/269: chown d1/d2d/f41 11450041 1 2023-12-08T20:27:48.898 INFO:tasks.workunit.client.1.smithi111.stdout:7/172: unlink da/d13/d21/d2d/f35 0 2023-12-08T20:27:48.898 INFO:tasks.workunit.client.1.smithi111.stdout:0/270: mknod d1/d4/d3a/c61 0 2023-12-08T20:27:48.898 INFO:tasks.workunit.client.1.smithi111.stdout:7/173: creat da/d25/d26/f37 x:0 0 0 2023-12-08T20:27:48.898 INFO:tasks.workunit.client.1.smithi111.stdout:7/174: readlink da/le 0 2023-12-08T20:27:48.899 INFO:tasks.workunit.client.1.smithi111.stdout:7/175: mkdir da/d38 0 2023-12-08T20:27:48.899 INFO:tasks.workunit.client.1.smithi111.stdout:7/176: dread - da/d13/d21/f29 zero size 2023-12-08T20:27:48.900 INFO:tasks.workunit.client.1.smithi111.stdout:0/271: mknod d1/d4/c62 0 2023-12-08T20:27:48.900 INFO:tasks.workunit.client.1.smithi111.stdout:0/272: chown d1/dd/d47 233813 1 2023-12-08T20:27:48.901 INFO:tasks.workunit.client.1.smithi111.stdout:7/177: symlink da/d13/l39 0 2023-12-08T20:27:48.901 INFO:tasks.workunit.client.1.smithi111.stdout:0/273: creat d1/df/d56/f63 x:0 0 0 2023-12-08T20:27:48.902 INFO:tasks.workunit.client.1.smithi111.stdout:7/178: creat da/d25/f3a x:0 0 0 2023-12-08T20:27:48.903 INFO:tasks.workunit.client.1.smithi111.stdout:0/274: symlink d1/d4/d24/d46/d58/l64 0 2023-12-08T20:27:48.903 INFO:tasks.workunit.client.1.smithi111.stdout:7/179: creat da/d25/f3b x:0 0 0 2023-12-08T20:27:48.903 INFO:tasks.workunit.client.1.smithi111.stdout:7/180: readlink da/d13/l19 0 2023-12-08T20:27:48.905 INFO:tasks.workunit.client.1.smithi111.stdout:0/275: mkdir d1/d4/d24/d46/d58/d65 0 2023-12-08T20:27:48.906 INFO:tasks.workunit.client.1.smithi111.stdout:0/276: symlink d1/df/d16/l66 0 2023-12-08T20:27:48.908 INFO:tasks.workunit.client.1.smithi111.stdout:0/277: creat d1/df/d44/d37/d5c/f67 x:0 0 0 2023-12-08T20:27:48.908 INFO:tasks.workunit.client.1.smithi111.stdout:0/278: readlink d1/dd/d4a/l54 0 2023-12-08T20:27:48.909 INFO:tasks.workunit.client.1.smithi111.stdout:0/279: dread d1/d4/d24/f45 [0,4194304] 0 2023-12-08T20:27:48.911 INFO:tasks.workunit.client.1.smithi111.stdout:0/280: unlink d1/f30 0 2023-12-08T20:27:48.914 INFO:tasks.workunit.client.1.smithi111.stdout:0/281: unlink d1/d4/d3a/c61 0 2023-12-08T20:27:48.914 INFO:tasks.workunit.client.1.smithi111.stdout:0/282: readlink d1/d4/l2b 0 2023-12-08T20:27:48.919 INFO:tasks.workunit.client.1.smithi111.stdout:7/181: dwrite da/d13/d21/f29 [0,4194304] 0 2023-12-08T20:27:48.919 INFO:tasks.workunit.client.1.smithi111.stdout:7/182: write da/d25/d26/f37 [56805,70174] 0 2023-12-08T20:27:48.919 INFO:tasks.workunit.client.1.smithi111.stdout:7/183: truncate da/d25/f3a 199811 0 2023-12-08T20:27:48.928 INFO:tasks.workunit.client.1.smithi111.stdout:0/283: dwrite d1/f57 [0,4194304] 0 2023-12-08T20:27:48.928 INFO:tasks.workunit.client.1.smithi111.stdout:0/284: write d1/df/d16/f53 [555944,109454] 0 2023-12-08T20:27:48.930 INFO:tasks.workunit.client.1.smithi111.stdout:0/285: link d1/d4/d24/c36 d1/df/d16/c68 0 2023-12-08T20:27:48.936 INFO:tasks.workunit.client.1.smithi111.stdout:0/286: dread d1/df/d16/f53 [0,4194304] 0 2023-12-08T20:27:48.936 INFO:tasks.workunit.client.1.smithi111.stdout:0/287: fsync d1/dd/f18 0 2023-12-08T20:27:48.936 INFO:tasks.workunit.client.1.smithi111.stdout:0/288: chown d1/d4/d3a 12004 1 2023-12-08T20:27:48.939 INFO:tasks.workunit.client.1.smithi111.stdout:0/289: dread d1/dd/f18 [4194304,4194304] 0 2023-12-08T20:27:48.941 INFO:tasks.workunit.client.1.smithi111.stdout:0/290: mkdir d1/d69 0 2023-12-08T20:27:48.941 INFO:tasks.workunit.client.1.smithi111.stdout:0/291: chown d1/d2d/f39 8 1 2023-12-08T20:27:48.942 INFO:tasks.workunit.client.1.smithi111.stdout:0/292: dread d1/df/d16/f2e [0,4194304] 0 2023-12-08T20:27:48.950 INFO:tasks.workunit.client.1.smithi111.stdout:0/293: dread d1/dd/f18 [0,4194304] 0 2023-12-08T20:27:48.950 INFO:tasks.workunit.client.1.smithi111.stdout:0/294: dread - d1/dd/d47/f5d zero size 2023-12-08T20:27:48.950 INFO:tasks.workunit.client.1.smithi111.stdout:0/295: truncate d1/d4/d24/f60 428032 0 2023-12-08T20:27:48.951 INFO:tasks.workunit.client.1.smithi111.stdout:2/258: sync 2023-12-08T20:27:48.951 INFO:tasks.workunit.client.1.smithi111.stdout:3/215: sync 2023-12-08T20:27:48.951 INFO:tasks.workunit.client.1.smithi111.stdout:3/216: write d2/d12/f31 [1514838,107402] 0 2023-12-08T20:27:48.951 INFO:tasks.workunit.client.1.smithi111.stdout:3/217: dread d2/d3/d6/f23 [0,4194304] 0 2023-12-08T20:27:48.952 INFO:tasks.workunit.client.1.smithi111.stdout:0/296: link d1/d4/d24/d46/l50 d1/dd/l6a 0 2023-12-08T20:27:48.952 INFO:tasks.workunit.client.1.smithi111.stdout:0/297: chown d1/d4/d24/f45 1 1 2023-12-08T20:27:48.952 INFO:tasks.workunit.client.1.smithi111.stdout:0/298: write d1/df/d56/f63 [464221,76042] 0 2023-12-08T20:27:48.952 INFO:tasks.workunit.client.1.smithi111.stdout:0/299: truncate d1/dd/d47/f5d 1039808 0 2023-12-08T20:27:48.953 INFO:tasks.workunit.client.1.smithi111.stdout:2/259: getdents d1/d1d 0 2023-12-08T20:27:48.955 INFO:tasks.workunit.client.1.smithi111.stdout:3/218: link d2/d15/c27 d2/d15/d17/d25/c40 0 2023-12-08T20:27:48.958 INFO:tasks.workunit.client.1.smithi111.stdout:0/300: creat d1/d4/d24/f6b x:0 0 0 2023-12-08T20:27:48.974 INFO:tasks.workunit.client.1.smithi111.stdout:3/219: dwrite d2/ff [0,4194304] 0 2023-12-08T20:27:48.998 INFO:tasks.workunit.client.1.smithi111.stdout:0/301: link d1/df/d44/c42 d1/df/d16/d2c/c6c 0 2023-12-08T20:27:48.998 INFO:tasks.workunit.client.1.smithi111.stdout:0/302: chown d1/d4/d24/d46/l50 11 1 2023-12-08T20:27:49.006 INFO:tasks.workunit.client.1.smithi111.stdout:3/220: rename d2/d15/d17/d25/c40 to d2/d3/d6/c41 0 2023-12-08T20:27:49.006 INFO:tasks.workunit.client.1.smithi111.stdout:3/221: stat d2/d3/d6/fe 0 2023-12-08T20:27:49.007 INFO:tasks.workunit.client.1.smithi111.stdout:2/260: creat d1/d1d/d1f/d25/d3d/f63 x:0 0 0 2023-12-08T20:27:49.007 INFO:tasks.workunit.client.1.smithi111.stdout:2/261: dread - d1/d1d/d1f/d25/d3d/d41/f52 zero size 2023-12-08T20:27:49.007 INFO:tasks.workunit.client.1.smithi111.stdout:2/262: chown d1/d29/d53/f23 15 1 2023-12-08T20:27:49.011 INFO:tasks.workunit.client.1.smithi111.stdout:2/263: mkdir d1/d1d/d1f/d25/d3d/d64 0 2023-12-08T20:27:49.011 INFO:tasks.workunit.client.1.smithi111.stdout:2/264: creat d1/d1d/d55/d58/f65 x:0 0 0 2023-12-08T20:27:49.020 INFO:tasks.workunit.client.1.smithi111.stdout:2/265: dread d1/d1d/f33 [4194304,4194304] 0 2023-12-08T20:27:49.031 INFO:tasks.workunit.client.1.smithi111.stdout:0/303: rmdir d1/df/d16 39 2023-12-08T20:27:49.031 INFO:tasks.workunit.client.1.smithi111.stdout:0/304: readlink d1/d4/d24/d46/l50 0 2023-12-08T20:27:49.031 INFO:tasks.workunit.client.1.smithi111.stdout:0/305: write d1/d4/d24/d46/d49/f5a [877173,1410] 0 2023-12-08T20:27:49.031 INFO:tasks.workunit.client.1.smithi111.stdout:0/306: chown d1/dd/d4a/l54 3392 1 2023-12-08T20:27:49.031 INFO:tasks.workunit.client.1.smithi111.stdout:0/307: write d1/d4/d24/d2f/f52 [450610,17361] 0 2023-12-08T20:27:49.032 INFO:tasks.workunit.client.1.smithi111.stdout:0/308: chown d1/l28 521214 1 2023-12-08T20:27:49.034 INFO:tasks.workunit.client.1.smithi111.stdout:0/309: dread d1/d2d/f41 [0,4194304] 0 2023-12-08T20:27:49.036 INFO:tasks.workunit.client.1.smithi111.stdout:0/310: creat d1/d4/d24/d46/d58/f6d x:0 0 0 2023-12-08T20:27:49.037 INFO:tasks.workunit.client.1.smithi111.stdout:0/311: truncate d1/d2d/f3c 1792649 0 2023-12-08T20:27:49.038 INFO:tasks.workunit.client.1.smithi111.stdout:2/266: dwrite d1/d1d/d1f/d25/d3d/d41/f52 [0,4194304] 0 2023-12-08T20:27:49.039 INFO:tasks.workunit.client.1.smithi111.stdout:0/312: mkdir d1/d4/d24/d46/d49/d6e 0 2023-12-08T20:27:49.042 INFO:tasks.workunit.client.1.smithi111.stdout:0/313: dread d1/dd/f18 [4194304,4194304] 0 2023-12-08T20:27:49.042 INFO:tasks.workunit.client.1.smithi111.stdout:0/314: rename d1/d4/d24/d46 to d1/d4/d24/d46/d58/d6f 22 2023-12-08T20:27:49.042 INFO:tasks.workunit.client.1.smithi111.stdout:0/315: fsync d1/d4/d3a/f4b 0 2023-12-08T20:27:49.042 INFO:tasks.workunit.client.1.smithi111.stdout:0/316: stat d1/dd/c33 0 2023-12-08T20:27:49.043 INFO:tasks.workunit.client.1.smithi111.stdout:0/317: read d1/d4/d24/f60 [9265,101551] 0 2023-12-08T20:27:49.043 INFO:tasks.workunit.client.1.smithi111.stdout:0/318: chown d1/d4/d24/l27 79 1 2023-12-08T20:27:49.043 INFO:tasks.workunit.client.1.smithi111.stdout:0/319: fdatasync d1/f10 0 2023-12-08T20:27:49.043 INFO:tasks.workunit.client.1.smithi111.stdout:0/320: dread - d1/df/d44/d37/d5c/f67 zero size 2023-12-08T20:27:49.043 INFO:tasks.workunit.client.1.smithi111.stdout:0/321: dread - d1/d4/d24/d2f/f59 zero size 2023-12-08T20:27:49.045 INFO:tasks.workunit.client.1.smithi111.stdout:0/322: unlink d1/d4/d24/d2f/f52 0 2023-12-08T20:27:49.050 INFO:tasks.workunit.client.1.smithi111.stdout:3/222: symlink d2/l42 0 2023-12-08T20:27:49.061 INFO:tasks.workunit.client.1.smithi111.stdout:3/223: dread d2/d3/f16 [0,4194304] 0 2023-12-08T20:27:49.063 INFO:tasks.workunit.client.1.smithi111.stdout:0/323: dwrite d1/dd/f4e [0,4194304] 0 2023-12-08T20:27:49.064 INFO:tasks.workunit.client.1.smithi111.stdout:2/267: dwrite d1/d29/d53/f5a [0,4194304] 0 2023-12-08T20:27:49.064 INFO:tasks.workunit.client.1.smithi111.stdout:2/268: truncate d1/d1d/f5d 335323 0 2023-12-08T20:27:49.075 INFO:tasks.workunit.client.1.smithi111.stdout:3/224: dread d2/d3/d6/fd [0,4194304] 0 2023-12-08T20:27:49.077 INFO:tasks.workunit.client.1.smithi111.stdout:3/225: creat d2/d15/d17/f43 x:0 0 0 2023-12-08T20:27:49.078 INFO:tasks.workunit.client.1.smithi111.stdout:3/226: mkdir d2/d3/d13/d36/d44 0 2023-12-08T20:27:49.081 INFO:tasks.workunit.client.1.smithi111.stdout:3/227: unlink d2/d12/d2e/f2f 0 2023-12-08T20:27:49.084 INFO:tasks.workunit.client.1.smithi111.stdout:3/228: symlink d2/d15/d17/d25/l45 0 2023-12-08T20:27:49.084 INFO:tasks.workunit.client.1.smithi111.stdout:3/229: truncate d2/d3/d6/f3a 922929 0 2023-12-08T20:27:49.090 INFO:tasks.workunit.client.1.smithi111.stdout:2/269: dwrite d1/d1d/d22/f2c [0,4194304] 0 2023-12-08T20:27:49.090 INFO:tasks.workunit.client.1.smithi111.stdout:2/270: mknod d1/d1d/d55/c66 0 2023-12-08T20:27:49.104 INFO:tasks.workunit.client.1.smithi111.stdout:2/271: dwrite d1/d29/d53/f5a [4194304,4194304] 0 2023-12-08T20:27:49.110 INFO:tasks.workunit.client.1.smithi111.stdout:2/272: unlink d1/d1d/d22/f34 0 2023-12-08T20:27:49.110 INFO:tasks.workunit.client.1.smithi111.stdout:2/273: getdents d1/d29 0 2023-12-08T20:27:49.110 INFO:tasks.workunit.client.1.smithi111.stdout:2/274: mkdir d1/d1d/d1f/d25/d67 0 2023-12-08T20:27:49.110 INFO:tasks.workunit.client.1.smithi111.stdout:2/275: mkdir d1/d1d/d68 0 2023-12-08T20:27:49.112 INFO:tasks.workunit.client.1.smithi111.stdout:2/276: rename d1/d1d/d22/f3f to d1/d1d/d22/f69 0 2023-12-08T20:27:49.112 INFO:tasks.workunit.client.1.smithi111.stdout:2/277: read d1/d29/d4e/f32 [275621,107487] 0 2023-12-08T20:27:49.114 INFO:tasks.workunit.client.1.smithi111.stdout:2/278: rename d1/d1d/d1f/d25/l1e to d1/d1d/d55/l6a 0 2023-12-08T20:27:49.115 INFO:tasks.workunit.client.1.smithi111.stdout:2/279: rmdir d1/d1d/d55 39 2023-12-08T20:27:49.121 INFO:tasks.workunit.client.1.smithi111.stdout:4/159: sync 2023-12-08T20:27:49.121 INFO:tasks.workunit.client.1.smithi111.stdout:9/273: sync 2023-12-08T20:27:49.123 INFO:tasks.workunit.client.1.smithi111.stdout:4/160: getdents d8/da/d29 0 2023-12-08T20:27:49.124 INFO:tasks.workunit.client.1.smithi111.stdout:4/161: creat d8/da/d2c/d1f/d2b/f3a x:0 0 0 2023-12-08T20:27:49.127 INFO:tasks.workunit.client.1.smithi111.stdout:4/162: unlink c2 0 2023-12-08T20:27:49.128 INFO:tasks.workunit.client.1.smithi111.stdout:4/163: creat d8/da/f3b x:0 0 0 2023-12-08T20:27:49.128 INFO:tasks.workunit.client.1.smithi111.stdout:4/164: fsync f6 0 2023-12-08T20:27:49.128 INFO:tasks.workunit.client.1.smithi111.stdout:4/165: truncate d8/da/f25 417698 0 2023-12-08T20:27:49.129 INFO:tasks.workunit.client.1.smithi111.stdout:4/166: creat d8/d30/f3c x:0 0 0 2023-12-08T20:27:49.130 INFO:tasks.workunit.client.1.smithi111.stdout:4/167: creat d8/da/d2c/d1f/d2b/f3d x:0 0 0 2023-12-08T20:27:49.132 INFO:tasks.workunit.client.1.smithi111.stdout:4/168: creat d8/da/d2c/d1f/d2b/f3e x:0 0 0 2023-12-08T20:27:49.133 INFO:tasks.workunit.client.1.smithi111.stdout:4/169: dread d8/f12 [0,4194304] 0 2023-12-08T20:27:49.136 INFO:tasks.workunit.client.1.smithi111.stdout:2/280: dwrite d1/d1d/d22/f39 [0,4194304] 0 2023-12-08T20:27:49.136 INFO:tasks.workunit.client.1.smithi111.stdout:9/274: dread d2/d8/f4f [0,4194304] 0 2023-12-08T20:27:49.136 INFO:tasks.workunit.client.1.smithi111.stdout:2/281: stat d1/d1d/d22/d30/l57 0 2023-12-08T20:27:49.136 INFO:tasks.workunit.client.1.smithi111.stdout:2/282: fdatasync d1/d29/d53/f23 0 2023-12-08T20:27:49.138 INFO:tasks.workunit.client.1.smithi111.stdout:2/283: symlink d1/d1d/d1f/d25/d3d/d41/l6b 0 2023-12-08T20:27:49.139 INFO:tasks.workunit.client.1.smithi111.stdout:9/275: symlink d2/d8/dd/d1a/d1e/d2d/d4a/l5c 0 2023-12-08T20:27:49.140 INFO:tasks.workunit.client.1.smithi111.stdout:2/284: write d1/d1d/d22/f39 [2107148,56919] 0 2023-12-08T20:27:49.142 INFO:tasks.workunit.client.1.smithi111.stdout:4/170: dread d8/f15 [0,4194304] 0 2023-12-08T20:27:49.144 INFO:tasks.workunit.client.1.smithi111.stdout:4/171: dread d8/da/d29/f33 [0,4194304] 0 2023-12-08T20:27:49.144 INFO:tasks.workunit.client.1.smithi111.stdout:4/172: stat d8/da/f3b 0 2023-12-08T20:27:49.145 INFO:tasks.workunit.client.1.smithi111.stdout:4/173: truncate f0 2843203 0 2023-12-08T20:27:49.145 INFO:tasks.workunit.client.1.smithi111.stdout:4/174: truncate d8/da/f25 857002 0 2023-12-08T20:27:49.145 INFO:tasks.workunit.client.1.smithi111.stdout:4/175: write d8/da/d2c/d1f/d2b/f34 [612911,50006] 0 2023-12-08T20:27:49.147 INFO:tasks.workunit.client.1.smithi111.stdout:4/176: creat d8/da/db/d31/f3f x:0 0 0 2023-12-08T20:27:49.148 INFO:tasks.workunit.client.1.smithi111.stdout:4/177: chown d8/d30/f3c 63275605 1 2023-12-08T20:27:49.148 INFO:tasks.workunit.client.1.smithi111.stdout:4/178: fdatasync f1 0 2023-12-08T20:27:49.148 INFO:tasks.workunit.client.1.smithi111.stdout:4/179: truncate d8/da/d2c/f24 499030 0 2023-12-08T20:27:49.148 INFO:tasks.workunit.client.1.smithi111.stdout:4/180: getdents d8/da/d29/d2f 0 2023-12-08T20:27:49.149 INFO:tasks.workunit.client.1.smithi111.stdout:4/181: dread - d8/d30/f3c zero size 2023-12-08T20:27:49.149 INFO:tasks.workunit.client.1.smithi111.stdout:4/182: getdents d8 0 2023-12-08T20:27:49.161 INFO:tasks.workunit.client.1.smithi111.stdout:4/183: rmdir d8/da/d29/d2f 0 2023-12-08T20:27:49.161 INFO:tasks.workunit.client.1.smithi111.stdout:2/285: dwrite d1/f13 [4194304,4194304] 0 2023-12-08T20:27:49.161 INFO:tasks.workunit.client.1.smithi111.stdout:2/286: write d1/d1d/f26 [1723713,12048] 0 2023-12-08T20:27:49.163 INFO:tasks.workunit.client.1.smithi111.stdout:4/184: dread f0 [0,4194304] 0 2023-12-08T20:27:49.165 INFO:tasks.workunit.client.1.smithi111.stdout:4/185: dread d8/da/d29/f33 [0,4194304] 0 2023-12-08T20:27:49.174 INFO:tasks.workunit.client.1.smithi111.stdout:2/287: dwrite d1/f13 [4194304,4194304] 0 2023-12-08T20:27:49.174 INFO:tasks.workunit.client.1.smithi111.stdout:2/288: chown d1/d1d/d1f/d25/d67 246782 1 2023-12-08T20:27:49.174 INFO:tasks.workunit.client.1.smithi111.stdout:2/289: write d1/d1d/d55/d58/f65 [618022,131059] 0 2023-12-08T20:27:49.174 INFO:tasks.workunit.client.1.smithi111.stdout:2/290: truncate d1/d1d/d22/d30/f5c 11365 0 2023-12-08T20:27:49.174 INFO:tasks.workunit.client.1.smithi111.stdout:2/291: read d1/d1d/d22/f50 [60374,15106] 0 2023-12-08T20:27:49.182 INFO:tasks.workunit.client.1.smithi111.stdout:4/186: dwrite f6 [0,4194304] 0 2023-12-08T20:27:49.182 INFO:tasks.workunit.client.1.smithi111.stdout:4/187: getdents d8/da/db 0 2023-12-08T20:27:49.194 INFO:tasks.workunit.client.1.smithi111.stdout:4/188: dwrite d8/da/d2c/d1f/d2b/f3e [0,4194304] 0 2023-12-08T20:27:49.194 INFO:tasks.workunit.client.1.smithi111.stdout:4/189: readlink l4 0 2023-12-08T20:27:49.196 INFO:tasks.workunit.client.1.smithi111.stdout:4/190: mkdir d8/da/d2c/d1f/d40 0 2023-12-08T20:27:49.198 INFO:tasks.workunit.client.1.smithi111.stdout:4/191: symlink d8/da/d2c/d1f/d40/l41 0 2023-12-08T20:27:49.198 INFO:tasks.workunit.client.1.smithi111.stdout:4/192: getdents d8/da/d2c 0 2023-12-08T20:27:49.198 INFO:tasks.workunit.client.1.smithi111.stdout:4/193: chown d8 26664 1 2023-12-08T20:27:49.338 INFO:tasks.workunit.client.1.smithi111.stdout:5/269: sync 2023-12-08T20:27:49.338 INFO:tasks.workunit.client.1.smithi111.stdout:1/259: sync 2023-12-08T20:27:49.339 INFO:tasks.workunit.client.1.smithi111.stdout:5/270: rename d3/d12/f33 to d3/d4/f5b 0 2023-12-08T20:27:49.340 INFO:tasks.workunit.client.1.smithi111.stdout:5/271: mknod d3/d4/c5c 0 2023-12-08T20:27:49.341 INFO:tasks.workunit.client.1.smithi111.stdout:5/272: write d3/d4/f5b [2656276,13219] 0 2023-12-08T20:27:49.364 INFO:tasks.workunit.client.1.smithi111.stdout:5/273: dwrite d3/d4/f8 [4194304,4194304] 0 2023-12-08T20:27:49.365 INFO:tasks.workunit.client.1.smithi111.stdout:5/274: mknod d3/d12/c5d 0 2023-12-08T20:27:49.365 INFO:tasks.workunit.client.1.smithi111.stdout:5/275: chown d3/d4/c3a 3 1 2023-12-08T20:27:49.388 INFO:tasks.workunit.client.1.smithi111.stdout:5/276: dwrite d3/d12/f1b [0,4194304] 0 2023-12-08T20:27:49.403 INFO:tasks.workunit.client.1.smithi111.stdout:5/277: dwrite d3/d4/d7/d2c/f4c [0,4194304] 0 2023-12-08T20:27:49.404 INFO:tasks.workunit.client.1.smithi111.stdout:5/278: write d3/d4/f8 [6118090,123725] 0 2023-12-08T20:27:49.417 INFO:tasks.workunit.client.1.smithi111.stdout:5/279: dwrite d3/d4/d7/f16 [0,4194304] 0 2023-12-08T20:27:49.417 INFO:tasks.workunit.client.1.smithi111.stdout:5/280: write d3/d4/d7/d36/f4f [253356,55013] 0 2023-12-08T20:27:49.563 INFO:tasks.workunit.client.1.smithi111.stdout:8/282: sync 2023-12-08T20:27:49.564 INFO:tasks.workunit.client.1.smithi111.stdout:6/156: sync 2023-12-08T20:27:49.564 INFO:tasks.workunit.client.1.smithi111.stdout:6/157: stat d0/d1/f6 0 2023-12-08T20:27:49.565 INFO:tasks.workunit.client.1.smithi111.stdout:6/158: creat d0/d1/d1e/f2b x:0 0 0 2023-12-08T20:27:49.568 INFO:tasks.workunit.client.1.smithi111.stdout:6/159: write d0/d1/f6 [549238,15726] 0 2023-12-08T20:27:49.569 INFO:tasks.workunit.client.1.smithi111.stdout:6/160: creat d0/d1/f2c x:0 0 0 2023-12-08T20:27:49.570 INFO:tasks.workunit.client.1.smithi111.stdout:6/161: chown d0/f13 2609676 1 2023-12-08T20:27:49.572 INFO:tasks.workunit.client.1.smithi111.stdout:6/162: creat d0/d1/d27/f2d x:0 0 0 2023-12-08T20:27:49.573 INFO:tasks.workunit.client.1.smithi111.stdout:6/163: getdents d0/d1b 0 2023-12-08T20:27:49.574 INFO:tasks.workunit.client.1.smithi111.stdout:6/164: mkdir d0/d1/d2e 0 2023-12-08T20:27:49.576 INFO:tasks.workunit.client.1.smithi111.stdout:6/165: link d0/d1/d27/f2d d0/d1/d27/f2f 0 2023-12-08T20:27:49.577 INFO:tasks.workunit.client.1.smithi111.stdout:8/283: dwrite dd/f20 [0,4194304] 0 2023-12-08T20:27:49.578 INFO:tasks.workunit.client.1.smithi111.stdout:8/284: symlink dd/d32/d3d/l61 0 2023-12-08T20:27:49.589 INFO:tasks.workunit.client.1.smithi111.stdout:6/166: dread d0/d1/f6 [0,4194304] 0 2023-12-08T20:27:49.591 INFO:tasks.workunit.client.1.smithi111.stdout:8/285: dwrite dd/d35/f3b [0,4194304] 0 2023-12-08T20:27:49.591 INFO:tasks.workunit.client.1.smithi111.stdout:8/286: chown dd/d35/d42 145459 1 2023-12-08T20:27:49.603 INFO:tasks.workunit.client.1.smithi111.stdout:8/287: dread dd/f2b [0,4194304] 0 2023-12-08T20:27:49.603 INFO:tasks.workunit.client.1.smithi111.stdout:8/288: stat dd/d35/d42/f47 0 2023-12-08T20:27:49.605 INFO:tasks.workunit.client.1.smithi111.stdout:6/167: dwrite d0/d1/f5 [4194304,4194304] 0 2023-12-08T20:27:49.622 INFO:tasks.workunit.client.1.smithi111.stdout:8/289: dwrite dd/d35/f3b [0,4194304] 0 2023-12-08T20:27:49.641 INFO:tasks.workunit.client.1.smithi111.stdout:6/168: dwrite d0/d1b/f1d [0,4194304] 0 2023-12-08T20:27:49.641 INFO:tasks.workunit.client.1.smithi111.stdout:8/290: dwrite dd/f23 [0,4194304] 0 2023-12-08T20:27:49.643 INFO:tasks.workunit.client.1.smithi111.stdout:8/291: mkdir dd/d2d/d62 0 2023-12-08T20:27:49.644 INFO:tasks.workunit.client.1.smithi111.stdout:8/292: mknod dd/d32/d3d/c63 0 2023-12-08T20:27:49.647 INFO:tasks.workunit.client.1.smithi111.stdout:8/293: creat dd/d32/d36/d4b/f64 x:0 0 0 2023-12-08T20:27:49.649 INFO:tasks.workunit.client.1.smithi111.stdout:8/294: truncate dd/f1f 3659937 0 2023-12-08T20:27:49.650 INFO:tasks.workunit.client.1.smithi111.stdout:8/295: creat dd/d32/d36/d50/f65 x:0 0 0 2023-12-08T20:27:49.652 INFO:tasks.workunit.client.1.smithi111.stdout:6/169: dwrite d0/d1/d1e/f2b [0,4194304] 0 2023-12-08T20:27:49.655 INFO:tasks.workunit.client.1.smithi111.stdout:6/170: mknod d0/c30 0 2023-12-08T20:27:49.661 INFO:tasks.workunit.client.1.smithi111.stdout:8/296: dread dd/f25 [0,4194304] 0 2023-12-08T20:27:49.663 INFO:tasks.workunit.client.1.smithi111.stdout:8/297: link dd/d35/d42/c4e dd/d35/d42/c66 0 2023-12-08T20:27:49.663 INFO:tasks.workunit.client.1.smithi111.stdout:8/298: write dd/f2a [780506,71969] 0 2023-12-08T20:27:49.664 INFO:tasks.workunit.client.1.smithi111.stdout:8/299: stat dd/c1d 0 2023-12-08T20:27:49.668 INFO:tasks.workunit.client.1.smithi111.stdout:6/171: dwrite d0/d1a/f28 [0,4194304] 0 2023-12-08T20:27:49.672 INFO:tasks.workunit.client.1.smithi111.stdout:6/172: creat d0/d1a/f31 x:0 0 0 2023-12-08T20:27:49.673 INFO:tasks.workunit.client.1.smithi111.stdout:6/173: creat d0/f32 x:0 0 0 2023-12-08T20:27:49.681 INFO:tasks.workunit.client.1.smithi111.stdout:8/300: dwrite dd/f1f [4194304,4194304] 0 2023-12-08T20:27:49.683 INFO:tasks.workunit.client.1.smithi111.stdout:8/301: rename dd/l41 to dd/d2d/l67 0 2023-12-08T20:27:49.690 INFO:tasks.workunit.client.1.smithi111.stdout:6/174: dwrite d0/d1a/f31 [0,4194304] 0 2023-12-08T20:27:49.714 INFO:tasks.workunit.client.1.smithi111.stdout:6/175: dwrite d0/d1/f8 [0,4194304] 0 2023-12-08T20:27:49.714 INFO:tasks.workunit.client.1.smithi111.stdout:6/176: dread - d0/f32 zero size 2023-12-08T20:27:49.715 INFO:tasks.workunit.client.1.smithi111.stdout:6/177: truncate d0/d1/f6 1109685 0 2023-12-08T20:27:49.716 INFO:tasks.workunit.client.1.smithi111.stdout:6/178: symlink d0/d1/d27/l33 0 2023-12-08T20:27:49.718 INFO:tasks.workunit.client.1.smithi111.stdout:6/179: dread d0/d1/f11 [0,4194304] 0 2023-12-08T20:27:49.720 INFO:tasks.workunit.client.1.smithi111.stdout:6/180: mknod d0/d1/c34 0 2023-12-08T20:27:49.720 INFO:tasks.workunit.client.1.smithi111.stdout:6/181: write d0/f20 [956957,110682] 0 2023-12-08T20:27:49.721 INFO:tasks.workunit.client.1.smithi111.stdout:6/182: link d0/d1/d27/f2d d0/d1b/f35 0 2023-12-08T20:27:49.722 INFO:tasks.workunit.client.1.smithi111.stdout:6/183: mkdir d0/d1/d27/d36 0 2023-12-08T20:27:49.737 INFO:tasks.workunit.client.1.smithi111.stdout:7/184: sync 2023-12-08T20:27:49.739 INFO:tasks.workunit.client.1.smithi111.stdout:6/184: dwrite d0/f20 [0,4194304] 0 2023-12-08T20:27:49.740 INFO:tasks.workunit.client.1.smithi111.stdout:6/185: chown d0/d1/l19 124143 1 2023-12-08T20:27:49.742 INFO:tasks.workunit.client.1.smithi111.stdout:6/186: symlink d0/l37 0 2023-12-08T20:27:49.749 INFO:tasks.workunit.client.1.smithi111.stdout:6/187: dread d0/d1/d1e/f2b [0,4194304] 0 2023-12-08T20:27:49.750 INFO:tasks.workunit.client.1.smithi111.stdout:6/188: dread d0/d1a/f1f [0,4194304] 0 2023-12-08T20:27:49.750 INFO:tasks.workunit.client.1.smithi111.stdout:6/189: dread - d0/d1/d27/f2f zero size 2023-12-08T20:27:49.751 INFO:tasks.workunit.client.1.smithi111.stdout:6/190: mknod d0/d1/c38 0 2023-12-08T20:27:49.751 INFO:tasks.workunit.client.1.smithi111.stdout:6/191: chown d0/d1b/f35 3388597 1 2023-12-08T20:27:49.752 INFO:tasks.workunit.client.1.smithi111.stdout:6/192: dread d0/d1a/f1f [0,4194304] 0 2023-12-08T20:27:49.752 INFO:tasks.workunit.client.1.smithi111.stdout:6/193: fdatasync d0/d1b/f35 0 2023-12-08T20:27:49.752 INFO:tasks.workunit.client.1.smithi111.stdout:6/194: write d0/f13 [3408359,55726] 0 2023-12-08T20:27:49.754 INFO:tasks.workunit.client.1.smithi111.stdout:6/195: rmdir d0/d1a 39 2023-12-08T20:27:49.754 INFO:tasks.workunit.client.1.smithi111.stdout:6/196: fdatasync d0/d1a/f2a 0 2023-12-08T20:27:49.755 INFO:tasks.workunit.client.1.smithi111.stdout:6/197: write d0/d1/f7 [182947,129450] 0 2023-12-08T20:27:49.757 INFO:tasks.workunit.client.1.smithi111.stdout:6/198: rename d0/d1/d27/l33 to d0/d1/l39 0 2023-12-08T20:27:49.757 INFO:tasks.workunit.client.1.smithi111.stdout:6/199: dread - d0/d1/d27/f2d zero size 2023-12-08T20:27:49.757 INFO:tasks.workunit.client.1.smithi111.stdout:6/200: truncate d0/f20 4473400 0 2023-12-08T20:27:49.757 INFO:tasks.workunit.client.1.smithi111.stdout:6/201: dread - d0/d1/f2c zero size 2023-12-08T20:27:49.757 INFO:tasks.workunit.client.1.smithi111.stdout:6/202: truncate d0/d1/f5 5985951 0 2023-12-08T20:27:49.760 INFO:tasks.workunit.client.1.smithi111.stdout:6/203: dread d0/d1/f11 [0,4194304] 0 2023-12-08T20:27:49.760 INFO:tasks.workunit.client.1.smithi111.stdout:6/204: write d0/d1/d27/f2d [28122,1170] 0 2023-12-08T20:27:49.849 INFO:tasks.workunit.client.1.smithi111.stdout:0/324: sync 2023-12-08T20:27:49.857 INFO:tasks.workunit.client.1.smithi111.stdout:0/325: dread d1/df/f3b [0,4194304] 0 2023-12-08T20:27:49.857 INFO:tasks.workunit.client.1.smithi111.stdout:0/326: chown d1/d2d/c3f 72019346 1 2023-12-08T20:27:49.859 INFO:tasks.workunit.client.1.smithi111.stdout:0/327: truncate d1/d2d/f41 3473019 0 2023-12-08T20:27:49.859 INFO:tasks.workunit.client.1.smithi111.stdout:0/328: chown d1/df/d44 26401 1 2023-12-08T20:27:49.859 INFO:tasks.workunit.client.1.smithi111.stdout:0/329: write d1/df/d16/f2e [1110787,14476] 0 2023-12-08T20:27:49.860 INFO:tasks.workunit.client.1.smithi111.stdout:0/330: mkdir d1/df/d44/d37/d5c/d70 0 2023-12-08T20:27:49.861 INFO:tasks.workunit.client.1.smithi111.stdout:0/331: mknod d1/df/d44/d37/c71 0 2023-12-08T20:27:49.875 INFO:tasks.workunit.client.1.smithi111.stdout:0/332: dwrite d1/d2d/f41 [0,4194304] 0 2023-12-08T20:27:49.991 INFO:tasks.workunit.client.1.smithi111.stdout:4/194: sync 2023-12-08T20:27:49.992 INFO:tasks.workunit.client.1.smithi111.stdout:3/230: sync 2023-12-08T20:27:49.992 INFO:tasks.workunit.client.1.smithi111.stdout:2/292: sync 2023-12-08T20:27:49.992 INFO:tasks.workunit.client.1.smithi111.stdout:2/293: read d1/d1d/f16 [716403,22718] 0 2023-12-08T20:27:49.993 INFO:tasks.workunit.client.1.smithi111.stdout:3/231: unlink d2/d12/f31 0 2023-12-08T20:27:49.994 INFO:tasks.workunit.client.1.smithi111.stdout:4/195: creat d8/da/d2c/d1f/d40/f42 x:0 0 0 2023-12-08T20:27:49.995 INFO:tasks.workunit.client.1.smithi111.stdout:2/294: creat d1/d1d/d1f/d25/d3d/d41/f6c x:0 0 0 2023-12-08T20:27:49.995 INFO:tasks.workunit.client.1.smithi111.stdout:3/232: getdents d2/d3/d13 0 2023-12-08T20:27:50.000 INFO:tasks.workunit.client.1.smithi111.stdout:2/295: rmdir d1/d1d/d1f/d25/d3d/d49 0 2023-12-08T20:27:50.001 INFO:tasks.workunit.client.1.smithi111.stdout:3/233: mknod d2/d3/d13/c46 0 2023-12-08T20:27:50.002 INFO:tasks.workunit.client.1.smithi111.stdout:2/296: mknod d1/d1d/d55/d58/c6d 0 2023-12-08T20:27:50.004 INFO:tasks.workunit.client.1.smithi111.stdout:3/234: mkdir d2/d3/d13/d36/d47 0 2023-12-08T20:27:50.004 INFO:tasks.workunit.client.1.smithi111.stdout:3/235: truncate d2/d3/f16 4843364 0 2023-12-08T20:27:50.006 INFO:tasks.workunit.client.1.smithi111.stdout:3/236: creat d2/d12/d2e/f48 x:0 0 0 2023-12-08T20:27:50.009 INFO:tasks.workunit.client.1.smithi111.stdout:4/196: dwrite d8/da/d2c/f24 [0,4194304] 0 2023-12-08T20:27:50.009 INFO:tasks.workunit.client.1.smithi111.stdout:4/197: dread - d8/f18 zero size 2023-12-08T20:27:50.019 INFO:tasks.workunit.client.1.smithi111.stdout:9/276: sync 2023-12-08T20:27:50.028 INFO:tasks.workunit.client.1.smithi111.stdout:3/237: dwrite d2/d3/d6/fd [0,4194304] 0 2023-12-08T20:27:50.028 INFO:tasks.workunit.client.1.smithi111.stdout:4/198: dwrite d8/da/d2c/d1f/f2a [0,4194304] 0 2023-12-08T20:27:50.028 INFO:tasks.workunit.client.1.smithi111.stdout:4/199: write d8/f22 [498801,122345] 0 2023-12-08T20:27:50.029 INFO:tasks.workunit.client.1.smithi111.stdout:3/238: symlink d2/l49 0 2023-12-08T20:27:50.032 INFO:tasks.workunit.client.1.smithi111.stdout:3/239: mkdir d2/d12/d4a 0 2023-12-08T20:27:50.033 INFO:tasks.workunit.client.1.smithi111.stdout:4/200: write d8/da/d2c/d1f/d2b/f3e [1858219,76605] 0 2023-12-08T20:27:50.035 INFO:tasks.workunit.client.1.smithi111.stdout:4/201: mknod d8/d38/c43 0 2023-12-08T20:27:50.038 INFO:tasks.workunit.client.1.smithi111.stdout:4/202: creat d8/da/d2c/d1f/d40/f44 x:0 0 0 2023-12-08T20:27:50.038 INFO:tasks.workunit.client.1.smithi111.stdout:9/277: dwrite d2/d8/f14 [0,4194304] 0 2023-12-08T20:27:50.039 INFO:tasks.workunit.client.1.smithi111.stdout:9/278: unlink d2/d8/c19 0 2023-12-08T20:27:50.040 INFO:tasks.workunit.client.1.smithi111.stdout:9/279: chown d2/c2f 666605 1 2023-12-08T20:27:50.040 INFO:tasks.workunit.client.1.smithi111.stdout:4/203: read d8/da/d2c/f24 [2327256,6418] 0 2023-12-08T20:27:50.040 INFO:tasks.workunit.client.1.smithi111.stdout:3/240: dread f1 [0,4194304] 0 2023-12-08T20:27:50.040 INFO:tasks.workunit.client.1.smithi111.stdout:3/241: write d2/d15/d17/f21 [767309,50176] 0 2023-12-08T20:27:50.041 INFO:tasks.workunit.client.1.smithi111.stdout:4/204: rename d8/d38/c43 to d8/da/d2c/d1f/c45 0 2023-12-08T20:27:50.046 INFO:tasks.workunit.client.1.smithi111.stdout:3/242: creat d2/d12/f4b x:0 0 0 2023-12-08T20:27:50.046 INFO:tasks.workunit.client.1.smithi111.stdout:3/243: chown d2/d3/d13/d36/f3e 446272690 1 2023-12-08T20:27:50.047 INFO:tasks.workunit.client.1.smithi111.stdout:3/244: read d2/d12/f1a [250589,125930] 0 2023-12-08T20:27:50.048 INFO:tasks.workunit.client.1.smithi111.stdout:3/245: dread d2/d3/d6/f23 [0,4194304] 0 2023-12-08T20:27:50.048 INFO:tasks.workunit.client.1.smithi111.stdout:3/246: read - d2/d15/d17/f35 zero size 2023-12-08T20:27:50.056 INFO:tasks.workunit.client.1.smithi111.stdout:9/280: dwrite d2/d8/dd/f4e [0,4194304] 0 2023-12-08T20:27:50.071 INFO:tasks.workunit.client.1.smithi111.stdout:3/247: dwrite d2/d3/fb [0,4194304] 0 2023-12-08T20:27:50.071 INFO:tasks.workunit.client.1.smithi111.stdout:3/248: write d2/d3/d6/fe [1487392,113255] 0 2023-12-08T20:27:50.073 INFO:tasks.workunit.client.1.smithi111.stdout:9/281: dwrite d2/f2c [0,4194304] 0 2023-12-08T20:27:50.073 INFO:tasks.workunit.client.1.smithi111.stdout:9/282: write d2/f59 [428781,33405] 0 2023-12-08T20:27:50.077 INFO:tasks.workunit.client.1.smithi111.stdout:9/283: truncate d2/d8/dd/d1a/d1e/d2d/f4b 2757185 0 2023-12-08T20:27:50.077 INFO:tasks.workunit.client.1.smithi111.stdout:9/284: getdents d2/d8/dd/d1a/d1e/d23 0 2023-12-08T20:27:50.095 INFO:tasks.workunit.client.1.smithi111.stdout:3/249: dwrite d2/d12/f1a [0,4194304] 0 2023-12-08T20:27:50.096 INFO:tasks.workunit.client.1.smithi111.stdout:3/250: mknod d2/d12/c4c 0 2023-12-08T20:27:50.098 INFO:tasks.workunit.client.1.smithi111.stdout:9/285: dwrite d2/d8/f21 [0,4194304] 0 2023-12-08T20:27:50.098 INFO:tasks.workunit.client.1.smithi111.stdout:3/251: rename d2/d3/d13/c1f to d2/d3/d13/d36/d47/c4d 0 2023-12-08T20:27:50.104 INFO:tasks.workunit.client.1.smithi111.stdout:3/252: mkdir d2/d15/d17/d25/d4e 0 2023-12-08T20:27:50.104 INFO:tasks.workunit.client.1.smithi111.stdout:3/253: fdatasync d2/d3/d6/f23 0 2023-12-08T20:27:50.111 INFO:tasks.workunit.client.1.smithi111.stdout:9/286: dwrite d2/d8/f21 [0,4194304] 0 2023-12-08T20:27:50.115 INFO:tasks.workunit.client.1.smithi111.stdout:5/281: sync 2023-12-08T20:27:50.115 INFO:tasks.workunit.client.1.smithi111.stdout:1/260: sync 2023-12-08T20:27:50.115 INFO:tasks.workunit.client.1.smithi111.stdout:7/185: sync 2023-12-08T20:27:50.115 INFO:tasks.workunit.client.1.smithi111.stdout:0/333: sync 2023-12-08T20:27:50.115 INFO:tasks.workunit.client.1.smithi111.stdout:6/205: sync 2023-12-08T20:27:50.115 INFO:tasks.workunit.client.1.smithi111.stdout:0/334: stat d1/df/d16/f2e 0 2023-12-08T20:27:50.115 INFO:tasks.workunit.client.1.smithi111.stdout:5/282: fdatasync d3/d4/d4a/d21/f47 0 2023-12-08T20:27:50.115 INFO:tasks.workunit.client.1.smithi111.stdout:7/186: truncate da/d25/d26/f37 732811 0 2023-12-08T20:27:50.116 INFO:tasks.workunit.client.1.smithi111.stdout:0/335: read - d1/df/d44/d37/d5c/f67 zero size 2023-12-08T20:27:50.116 INFO:tasks.workunit.client.1.smithi111.stdout:8/302: sync 2023-12-08T20:27:50.116 INFO:tasks.workunit.client.1.smithi111.stdout:0/336: write d1/d4/f55 [343159,14002] 0 2023-12-08T20:27:50.116 INFO:tasks.workunit.client.1.smithi111.stdout:7/187: write f6 [5103168,16550] 0 2023-12-08T20:27:50.117 INFO:tasks.workunit.client.1.smithi111.stdout:1/261: mkdir d0/d6/d33/d15/d51/d5b/d5e 0 2023-12-08T20:27:50.117 INFO:tasks.workunit.client.1.smithi111.stdout:1/262: chown d0/f1 64941006 1 2023-12-08T20:27:50.118 INFO:tasks.workunit.client.1.smithi111.stdout:6/206: mknod d0/d1/d1e/c3a 0 2023-12-08T20:27:50.118 INFO:tasks.workunit.client.1.smithi111.stdout:1/263: read d0/d6/f14 [4976035,68461] 0 2023-12-08T20:27:50.118 INFO:tasks.workunit.client.1.smithi111.stdout:1/264: truncate d0/d22/f56 191748 0 2023-12-08T20:27:50.118 INFO:tasks.workunit.client.1.smithi111.stdout:6/207: write d0/d1a/f2a [864060,10131] 0 2023-12-08T20:27:50.122 INFO:tasks.workunit.client.1.smithi111.stdout:5/283: symlink d3/l5e 0 2023-12-08T20:27:50.122 INFO:tasks.workunit.client.1.smithi111.stdout:5/284: stat d3/d12/c5d 0 2023-12-08T20:27:50.122 INFO:tasks.workunit.client.1.smithi111.stdout:0/337: unlink d1/df/d16/l1d 0 2023-12-08T20:27:50.122 INFO:tasks.workunit.client.1.smithi111.stdout:9/287: dread d2/d8/dd/d1a/d1e/d23/f28 [0,4194304] 0 2023-12-08T20:27:50.122 INFO:tasks.workunit.client.1.smithi111.stdout:8/303: symlink dd/d32/d36/d4b/l68 0 2023-12-08T20:27:50.123 INFO:tasks.workunit.client.1.smithi111.stdout:1/265: creat d0/d6/d34/f5f x:0 0 0 2023-12-08T20:27:50.123 INFO:tasks.workunit.client.1.smithi111.stdout:1/266: read d0/d6/f28 [117424,101543] 0 2023-12-08T20:27:50.123 INFO:tasks.workunit.client.1.smithi111.stdout:6/208: mknod d0/d1/d27/d36/c3b 0 2023-12-08T20:27:50.124 INFO:tasks.workunit.client.1.smithi111.stdout:0/338: symlink d1/df/d44/d37/d5c/d70/l72 0 2023-12-08T20:27:50.125 INFO:tasks.workunit.client.1.smithi111.stdout:9/288: rename d2/d8/f4f to d2/d8/f5d 0 2023-12-08T20:27:50.125 INFO:tasks.workunit.client.1.smithi111.stdout:9/289: truncate d2/d8/dd/d1a/d1e/d2d/f4b 2791532 0 2023-12-08T20:27:50.125 INFO:tasks.workunit.client.1.smithi111.stdout:0/339: write d1/d2d/f3c [1264899,2027] 0 2023-12-08T20:27:50.125 INFO:tasks.workunit.client.1.smithi111.stdout:3/254: dwrite d2/d3/d6/f10 [4194304,4194304] 0 2023-12-08T20:27:50.125 INFO:tasks.workunit.client.1.smithi111.stdout:0/340: read d1/dd/f4e [1431344,13272] 0 2023-12-08T20:27:50.129 INFO:tasks.workunit.client.1.smithi111.stdout:1/267: mkdir d0/d6/d33/d60 0 2023-12-08T20:27:50.129 INFO:tasks.workunit.client.1.smithi111.stdout:6/209: creat d0/d1/f3c x:0 0 0 2023-12-08T20:27:50.129 INFO:tasks.workunit.client.1.smithi111.stdout:7/188: dread f6 [0,4194304] 0 2023-12-08T20:27:50.130 INFO:tasks.workunit.client.1.smithi111.stdout:9/290: creat d2/d8/f5e x:0 0 0 2023-12-08T20:27:50.132 INFO:tasks.workunit.client.1.smithi111.stdout:0/341: creat d1/d4/f73 x:0 0 0 2023-12-08T20:27:50.134 INFO:tasks.workunit.client.1.smithi111.stdout:1/268: mkdir d0/d6/d33/d15/d51/d2e/d61 0 2023-12-08T20:27:50.134 INFO:tasks.workunit.client.1.smithi111.stdout:6/210: mknod d0/d1/d27/c3d 0 2023-12-08T20:27:50.136 INFO:tasks.workunit.client.1.smithi111.stdout:7/189: mkdir da/d25/d26/d3c 0 2023-12-08T20:27:50.138 INFO:tasks.workunit.client.1.smithi111.stdout:0/342: symlink d1/d4/d3a/l74 0 2023-12-08T20:27:50.139 INFO:tasks.workunit.client.1.smithi111.stdout:1/269: mknod d0/d6/d33/d15/d51/d5b/c62 0 2023-12-08T20:27:50.141 INFO:tasks.workunit.client.1.smithi111.stdout:9/291: truncate d2/d8/f9 7339983 0 2023-12-08T20:27:50.141 INFO:tasks.workunit.client.1.smithi111.stdout:9/292: chown d2/d8/dd/f4e 49 1 2023-12-08T20:27:50.141 INFO:tasks.workunit.client.1.smithi111.stdout:9/293: chown d2/d8/dd/d1a/d1e/d23/d57 1649 1 2023-12-08T20:27:50.142 INFO:tasks.workunit.client.1.smithi111.stdout:3/255: dwrite d2/d15/d17/f21 [0,4194304] 0 2023-12-08T20:27:50.142 INFO:tasks.workunit.client.1.smithi111.stdout:3/256: fsync d2/d15/d17/d25/f26 0 2023-12-08T20:27:50.143 INFO:tasks.workunit.client.1.smithi111.stdout:8/304: dwrite dd/d2d/f4a [0,4194304] 0 2023-12-08T20:27:50.145 INFO:tasks.workunit.client.1.smithi111.stdout:1/270: rename d0/d22/f56 to d0/d6/d33/d15/d51/d5b/d5e/f63 0 2023-12-08T20:27:50.147 INFO:tasks.workunit.client.1.smithi111.stdout:1/271: write d0/d6/f27 [601611,107459] 0 2023-12-08T20:27:50.150 INFO:tasks.workunit.client.1.smithi111.stdout:3/257: creat d2/d15/d17/d25/d4e/f4f x:0 0 0 2023-12-08T20:27:50.156 INFO:tasks.workunit.client.1.smithi111.stdout:8/305: mknod dd/d32/d36/d4b/c69 0 2023-12-08T20:27:50.156 INFO:tasks.workunit.client.1.smithi111.stdout:6/211: getdents d0/d1/d27/d36 0 2023-12-08T20:27:50.157 INFO:tasks.workunit.client.1.smithi111.stdout:6/212: readlink d0/d1/l39 0 2023-12-08T20:27:50.157 INFO:tasks.workunit.client.1.smithi111.stdout:6/213: truncate d0/d1/d27/f2d 535967 0 2023-12-08T20:27:50.164 INFO:tasks.workunit.client.1.smithi111.stdout:9/294: rename d2/d8/dd/l34 to d2/d8/dd/d1a/d1e/l5f 0 2023-12-08T20:27:50.166 INFO:tasks.workunit.client.1.smithi111.stdout:1/272: creat d0/d6/d33/f64 x:0 0 0 2023-12-08T20:27:50.166 INFO:tasks.workunit.client.1.smithi111.stdout:1/273: write d0/f2d [305079,64936] 0 2023-12-08T20:27:50.167 INFO:tasks.workunit.client.1.smithi111.stdout:1/274: getdents d0/d6/d33/d15/d51/d2e/d61 0 2023-12-08T20:27:50.168 INFO:tasks.workunit.client.1.smithi111.stdout:8/306: getdents dd 0 2023-12-08T20:27:50.168 INFO:tasks.workunit.client.1.smithi111.stdout:8/307: write dd/d2d/f45 [4488612,18345] 0 2023-12-08T20:27:50.170 INFO:tasks.workunit.client.1.smithi111.stdout:9/295: creat d2/d8/dd/d1a/d1e/d2d/d35/f60 x:0 0 0 2023-12-08T20:27:50.172 INFO:tasks.workunit.client.1.smithi111.stdout:1/275: mknod d0/d6/d47/c65 0 2023-12-08T20:27:50.172 INFO:tasks.workunit.client.1.smithi111.stdout:1/276: write d0/d6/d33/d15/f30 [263044,129592] 0 2023-12-08T20:27:50.172 INFO:tasks.workunit.client.1.smithi111.stdout:1/277: chown d0/d6/d47/c65 179 1 2023-12-08T20:27:50.172 INFO:tasks.workunit.client.1.smithi111.stdout:1/278: chown d0/d6/d33/d15/d51/d5b/c62 147 1 2023-12-08T20:27:50.173 INFO:tasks.workunit.client.1.smithi111.stdout:8/308: creat dd/d32/d3d/f6a x:0 0 0 2023-12-08T20:27:50.177 INFO:tasks.workunit.client.1.smithi111.stdout:1/279: rename d0/d6/d33/c3c to d0/d6/d33/d15/d51/c66 0 2023-12-08T20:27:50.179 INFO:tasks.workunit.client.1.smithi111.stdout:1/280: creat d0/d6/d47/f67 x:0 0 0 2023-12-08T20:27:50.180 INFO:tasks.workunit.client.1.smithi111.stdout:1/281: symlink d0/l68 0 2023-12-08T20:27:50.181 INFO:tasks.workunit.client.1.smithi111.stdout:3/258: dwrite f1 [0,4194304] 0 2023-12-08T20:27:50.182 INFO:tasks.workunit.client.1.smithi111.stdout:3/259: symlink d2/d3/d13/d36/l50 0 2023-12-08T20:27:50.189 INFO:tasks.workunit.client.1.smithi111.stdout:0/343: dwrite d1/d4/d3a/f4b [0,4194304] 0 2023-12-08T20:27:50.192 INFO:tasks.workunit.client.1.smithi111.stdout:6/214: dwrite d0/d1/f3c [0,4194304] 0 2023-12-08T20:27:50.192 INFO:tasks.workunit.client.1.smithi111.stdout:7/190: dwrite da/d25/f3a [0,4194304] 0 2023-12-08T20:27:50.192 INFO:tasks.workunit.client.1.smithi111.stdout:6/215: chown d0/f32 103715554 1 2023-12-08T20:27:50.199 INFO:tasks.workunit.client.1.smithi111.stdout:9/296: dwrite d2/f7 [0,4194304] 0 2023-12-08T20:27:50.199 INFO:tasks.workunit.client.1.smithi111.stdout:3/260: dwrite d2/d12/f1d [0,4194304] 0 2023-12-08T20:27:50.200 INFO:tasks.workunit.client.1.smithi111.stdout:3/261: write d2/d12/f1d [1111288,24599] 0 2023-12-08T20:27:50.200 INFO:tasks.workunit.client.1.smithi111.stdout:3/262: dread - d2/d15/d17/f3b zero size 2023-12-08T20:27:50.200 INFO:tasks.workunit.client.1.smithi111.stdout:6/216: dread d0/d1/f5 [0,4194304] 0 2023-12-08T20:27:50.201 INFO:tasks.workunit.client.1.smithi111.stdout:7/191: dread da/d13/f2c [0,4194304] 0 2023-12-08T20:27:50.201 INFO:tasks.workunit.client.1.smithi111.stdout:9/297: rmdir d2/d8/dd/d56 39 2023-12-08T20:27:50.201 INFO:tasks.workunit.client.1.smithi111.stdout:9/298: fdatasync d2/d8/dd/d1a/d1e/d2d/d35/f3e 0 2023-12-08T20:27:50.201 INFO:tasks.workunit.client.1.smithi111.stdout:9/299: chown d2/d8/dd/d1a/d1e/d23/c49 41139256 1 2023-12-08T20:27:50.202 INFO:tasks.workunit.client.1.smithi111.stdout:6/217: dread d0/d1a/f2a [0,4194304] 0 2023-12-08T20:27:50.205 INFO:tasks.workunit.client.1.smithi111.stdout:3/263: mkdir d2/d3/d51 0 2023-12-08T20:27:50.206 INFO:tasks.workunit.client.1.smithi111.stdout:7/192: mkdir da/d25/d3d 0 2023-12-08T20:27:50.207 INFO:tasks.workunit.client.1.smithi111.stdout:6/218: creat d0/d1/d27/d36/f3e x:0 0 0 2023-12-08T20:27:50.210 INFO:tasks.workunit.client.1.smithi111.stdout:3/264: rename d2/d3/d1e/c3c to d2/d12/c52 0 2023-12-08T20:27:50.211 INFO:tasks.workunit.client.1.smithi111.stdout:7/193: stat da/cd 0 2023-12-08T20:27:50.213 INFO:tasks.workunit.client.1.smithi111.stdout:6/219: link d0/c30 d0/d1a/c3f 0 2023-12-08T20:27:50.215 INFO:tasks.workunit.client.1.smithi111.stdout:3/265: mknod d2/d15/d17/d25/c53 0 2023-12-08T20:27:50.215 INFO:tasks.workunit.client.1.smithi111.stdout:3/266: dread - d2/d3/d13/d36/f3e zero size 2023-12-08T20:27:50.216 INFO:tasks.workunit.client.1.smithi111.stdout:7/194: unlink da/d13/d21/d2d/f36 0 2023-12-08T20:27:50.217 INFO:tasks.workunit.client.1.smithi111.stdout:9/300: dwrite d2/d8/dd/f22 [4194304,4194304] 0 2023-12-08T20:27:50.218 INFO:tasks.workunit.client.1.smithi111.stdout:9/301: dread d2/d8/f4d [0,4194304] 0 2023-12-08T20:27:50.218 INFO:tasks.workunit.client.1.smithi111.stdout:9/302: dread - d2/d8/dd/d1a/d1e/d2d/d35/f60 zero size 2023-12-08T20:27:50.218 INFO:tasks.workunit.client.1.smithi111.stdout:9/303: dread - d2/d8/dd/d1a/d1e/f54 zero size 2023-12-08T20:27:50.220 INFO:tasks.workunit.client.1.smithi111.stdout:6/220: creat d0/d1/d27/f40 x:0 0 0 2023-12-08T20:27:50.221 INFO:tasks.workunit.client.1.smithi111.stdout:7/195: mkdir da/d25/d26/d32/d3e 0 2023-12-08T20:27:50.221 INFO:tasks.workunit.client.1.smithi111.stdout:7/196: fsync da/d25/d26/f2b 0 2023-12-08T20:27:50.222 INFO:tasks.workunit.client.1.smithi111.stdout:9/304: symlink d2/l61 0 2023-12-08T20:27:50.222 INFO:tasks.workunit.client.1.smithi111.stdout:9/305: getdents d2/d8/dd/d1a/d1e/d23 0 2023-12-08T20:27:50.223 INFO:tasks.workunit.client.1.smithi111.stdout:6/221: creat d0/d1a/f41 x:0 0 0 2023-12-08T20:27:50.224 INFO:tasks.workunit.client.1.smithi111.stdout:7/197: rename da/d13/c23 to da/d25/d26/d32/c3f 0 2023-12-08T20:27:50.226 INFO:tasks.workunit.client.1.smithi111.stdout:7/198: creat da/f40 x:0 0 0 2023-12-08T20:27:50.227 INFO:tasks.workunit.client.1.smithi111.stdout:9/306: mkdir d2/d8/dd/d1a/d1e/d2d/d4a/d62 0 2023-12-08T20:27:50.227 INFO:tasks.workunit.client.1.smithi111.stdout:9/307: stat d2/d8/dd/d1a/d1e/d2d/d4a 0 2023-12-08T20:27:50.228 INFO:tasks.workunit.client.1.smithi111.stdout:7/199: creat da/d25/d26/f41 x:0 0 0 2023-12-08T20:27:50.229 INFO:tasks.workunit.client.1.smithi111.stdout:7/200: write da/f1b [6615177,72575] 0 2023-12-08T20:27:50.229 INFO:tasks.workunit.client.1.smithi111.stdout:7/201: write da/d13/f17 [2818934,108675] 0 2023-12-08T20:27:50.229 INFO:tasks.workunit.client.1.smithi111.stdout:7/202: chown da/d13/l15 6713444 1 2023-12-08T20:27:50.229 INFO:tasks.workunit.client.1.smithi111.stdout:9/308: unlink d2/d8/dd/ce 0 2023-12-08T20:27:50.233 INFO:tasks.workunit.client.1.smithi111.stdout:7/203: creat da/d25/d26/d32/d3e/f42 x:0 0 0 2023-12-08T20:27:50.235 INFO:tasks.workunit.client.1.smithi111.stdout:9/309: creat d2/d8/dd/d1a/d1e/f63 x:0 0 0 2023-12-08T20:27:50.235 INFO:tasks.workunit.client.1.smithi111.stdout:9/310: stat d2/d8/f4d 0 2023-12-08T20:27:50.245 INFO:tasks.workunit.client.1.smithi111.stdout:9/311: dread d2/d8/dd/d1a/d1e/d23/f48 [0,4194304] 0 2023-12-08T20:27:50.249 INFO:tasks.workunit.client.1.smithi111.stdout:9/312: rmdir d2/d8/dd/d1a/d1e/d2d/d4a 39 2023-12-08T20:27:50.252 INFO:tasks.workunit.client.1.smithi111.stdout:9/313: mknod d2/d8/dd/c64 0 2023-12-08T20:27:50.253 INFO:tasks.workunit.client.1.smithi111.stdout:9/314: mknod d2/d8/dd/d1a/d1e/d2d/d35/c65 0 2023-12-08T20:27:50.256 INFO:tasks.workunit.client.1.smithi111.stdout:9/315: mkdir d2/d8/dd/d1a/d66 0 2023-12-08T20:27:50.259 INFO:tasks.workunit.client.1.smithi111.stdout:9/316: rmdir d2/d8 39 2023-12-08T20:27:50.260 INFO:tasks.workunit.client.1.smithi111.stdout:9/317: creat d2/f67 x:0 0 0 2023-12-08T20:27:50.261 INFO:tasks.workunit.client.1.smithi111.stdout:9/318: chown d2/d8/dd/d1a/d1e/d2d/d35/c65 200565 1 2023-12-08T20:27:50.262 INFO:tasks.workunit.client.1.smithi111.stdout:9/319: creat d2/da/f68 x:0 0 0 2023-12-08T20:27:50.263 INFO:tasks.workunit.client.1.smithi111.stdout:9/320: creat d2/d8/dd/f69 x:0 0 0 2023-12-08T20:27:50.264 INFO:tasks.workunit.client.1.smithi111.stdout:9/321: rename d2/d8/dd/d1a/d1e/d2d/f3d to d2/d8/dd/d1a/d1e/d2d/d35/f6a 0 2023-12-08T20:27:50.265 INFO:tasks.workunit.client.1.smithi111.stdout:9/322: mkdir d2/d8/dd/d1a/d1e/d2d/d35/d6b 0 2023-12-08T20:27:50.267 INFO:tasks.workunit.client.1.smithi111.stdout:9/323: link d2/f67 d2/d8/dd/f6c 0 2023-12-08T20:27:50.267 INFO:tasks.workunit.client.1.smithi111.stdout:9/324: dread - d2/d8/f5e zero size 2023-12-08T20:27:50.267 INFO:tasks.workunit.client.1.smithi111.stdout:9/325: mknod d2/d8/dd/d1a/d1e/d23/c6d 0 2023-12-08T20:27:50.267 INFO:tasks.workunit.client.1.smithi111.stdout:9/326: dread - d2/d8/dd/d1a/d1e/f63 zero size 2023-12-08T20:27:50.270 INFO:tasks.workunit.client.1.smithi111.stdout:9/327: rename d2/c4 to d2/d8/dd/d1a/d1e/d2d/d4a/c6e 0 2023-12-08T20:27:50.270 INFO:tasks.workunit.client.1.smithi111.stdout:9/328: write d2/d8/dd/f6c [119453,86513] 0 2023-12-08T20:27:50.270 INFO:tasks.workunit.client.1.smithi111.stdout:9/329: dread - d2/d8/f18 zero size 2023-12-08T20:27:50.270 INFO:tasks.workunit.client.1.smithi111.stdout:9/330: chown d2/d8/dd/d1a/d1e/d2d/d4a/d62 10 1 2023-12-08T20:27:50.271 INFO:tasks.workunit.client.1.smithi111.stdout:9/331: fdatasync d2/d8/dd/d1a/f1b 0 2023-12-08T20:27:50.271 INFO:tasks.workunit.client.1.smithi111.stdout:9/332: chown d2/d8/dd/d1a/d1e/f26 66005 1 2023-12-08T20:27:50.282 INFO:tasks.workunit.client.1.smithi111.stdout:9/333: dwrite d2/d8/dd/d56/f58 [0,4194304] 0 2023-12-08T20:27:50.284 INFO:tasks.workunit.client.1.smithi111.stdout:9/334: creat d2/d8/dd/d1a/f6f x:0 0 0 2023-12-08T20:27:50.284 INFO:tasks.workunit.client.1.smithi111.stdout:9/335: fdatasync d2/d8/dd/d1a/d1e/d23/f28 0 2023-12-08T20:27:50.285 INFO:tasks.workunit.client.1.smithi111.stdout:9/336: mknod d2/da/c70 0 2023-12-08T20:27:50.286 INFO:tasks.workunit.client.1.smithi111.stdout:9/337: mkdir d2/d8/dd/d1a/d1e/d2d/d35/d71 0 2023-12-08T20:27:50.287 INFO:tasks.workunit.client.1.smithi111.stdout:9/338: read - d2/d8/dd/f69 zero size 2023-12-08T20:27:50.287 INFO:tasks.workunit.client.1.smithi111.stdout:9/339: dread d2/d8/f4d [0,4194304] 0 2023-12-08T20:27:50.288 INFO:tasks.workunit.client.1.smithi111.stdout:9/340: creat d2/d8/dd/d56/f72 x:0 0 0 2023-12-08T20:27:50.295 INFO:tasks.workunit.client.1.smithi111.stdout:9/341: dread d2/d8/f5d [0,4194304] 0 2023-12-08T20:27:50.295 INFO:tasks.workunit.client.1.smithi111.stdout:9/342: readlink d2/d8/dd/d1a/d1e/d2d/l32 0 2023-12-08T20:27:50.317 INFO:tasks.workunit.client.1.smithi111.stdout:9/343: dwrite d2/d8/dd/f22 [4194304,4194304] 0 2023-12-08T20:27:50.318 INFO:tasks.workunit.client.1.smithi111.stdout:9/344: link d2/d8/dd/d1a/d1e/d2d/d35/f53 d2/d8/dd/d56/f73 0 2023-12-08T20:27:50.319 INFO:tasks.workunit.client.1.smithi111.stdout:9/345: mkdir d2/d8/dd/d1a/d74 0 2023-12-08T20:27:50.320 INFO:tasks.workunit.client.1.smithi111.stdout:9/346: rmdir d2/d8/dd/d1a/d1e/d2d 39 2023-12-08T20:27:50.320 INFO:tasks.workunit.client.1.smithi111.stdout:9/347: write d2/d8/dd/d1a/d1e/f54 [860719,112158] 0 2023-12-08T20:27:50.320 INFO:tasks.workunit.client.1.smithi111.stdout:9/348: chown d2/d8/dd/d56 2682065 1 2023-12-08T20:27:50.320 INFO:tasks.workunit.client.1.smithi111.stdout:9/349: chown d2/d8/dd/f22 3532881 1 2023-12-08T20:27:50.320 INFO:tasks.workunit.client.1.smithi111.stdout:9/350: chown d2/d8/f18 2406 1 2023-12-08T20:27:50.320 INFO:tasks.workunit.client.1.smithi111.stdout:9/351: chown d2/d8/dd/d1a/d1e/d2d/d35/d6b 0 1 2023-12-08T20:27:50.326 INFO:tasks.workunit.client.1.smithi111.stdout:9/352: dread d2/d8/dd/d1a/d1e/d2d/d35/f41 [0,4194304] 0 2023-12-08T20:27:50.327 INFO:tasks.workunit.client.1.smithi111.stdout:9/353: getdents d2/d8/dd/d1a/d1e/d23 0 2023-12-08T20:27:50.327 INFO:tasks.workunit.client.1.smithi111.stdout:9/354: chown d2/d8/dd/d1a 92016 1 2023-12-08T20:27:50.327 INFO:tasks.workunit.client.1.smithi111.stdout:9/355: symlink d2/d8/dd/d1a/d1e/d2d/d35/l75 0 2023-12-08T20:27:50.328 INFO:tasks.workunit.client.1.smithi111.stdout:9/356: symlink d2/d8/dd/d1a/d74/l76 0 2023-12-08T20:27:50.337 INFO:tasks.workunit.client.1.smithi111.stdout:9/357: dread d2/d8/f40 [0,4194304] 0 2023-12-08T20:27:50.337 INFO:tasks.workunit.client.1.smithi111.stdout:9/358: truncate d2/da/f68 187734 0 2023-12-08T20:27:50.340 INFO:tasks.workunit.client.1.smithi111.stdout:9/359: link d2/l55 d2/d8/dd/d1a/d1e/d2d/d4a/l77 0 2023-12-08T20:27:50.341 INFO:tasks.workunit.client.1.smithi111.stdout:9/360: rename d2/d8/dd/d1a/d1e/d2d/d4a/l5b to d2/d8/dd/d1a/d1e/d2d/d4a/l78 0 2023-12-08T20:27:50.353 INFO:tasks.workunit.client.1.smithi111.stdout:9/361: dwrite d2/d8/f21 [4194304,4194304] 0 2023-12-08T20:27:50.353 INFO:tasks.workunit.client.1.smithi111.stdout:9/362: write d2/d8/dd/d1a/d1e/d2d/d4a/f5a [224419,56641] 0 2023-12-08T20:27:50.355 INFO:tasks.workunit.client.1.smithi111.stdout:9/363: rename d2/d8/f5e to d2/d8/dd/d1a/d1e/d2d/d35/d6b/f79 0 2023-12-08T20:27:50.356 INFO:tasks.workunit.client.1.smithi111.stdout:9/364: creat d2/d8/dd/d1a/d74/f7a x:0 0 0 2023-12-08T20:27:50.358 INFO:tasks.workunit.client.1.smithi111.stdout:9/365: symlink d2/d8/dd/d1a/d1e/d2d/d35/l7b 0 2023-12-08T20:27:50.359 INFO:tasks.workunit.client.1.smithi111.stdout:9/366: mknod d2/d8/dd/d1a/d1e/d2d/d4a/d62/c7c 0 2023-12-08T20:27:50.359 INFO:tasks.workunit.client.1.smithi111.stdout:9/367: write d2/d8/f14 [4626236,51694] 0 2023-12-08T20:27:50.361 INFO:tasks.workunit.client.1.smithi111.stdout:9/368: rmdir d2/d8/dd/d1a/d1e/d23/d57 0 2023-12-08T20:27:50.362 INFO:tasks.workunit.client.1.smithi111.stdout:9/369: symlink d2/d8/dd/d1a/d74/l7d 0 2023-12-08T20:27:50.362 INFO:tasks.workunit.client.1.smithi111.stdout:9/370: stat d2/d8/dd/d1a/d1e/f63 0 2023-12-08T20:27:50.362 INFO:tasks.workunit.client.1.smithi111.stdout:9/371: truncate d2/f67 436750 0 2023-12-08T20:27:50.363 INFO:tasks.workunit.client.1.smithi111.stdout:9/372: symlink d2/d8/dd/l7e 0 2023-12-08T20:27:50.364 INFO:tasks.workunit.client.1.smithi111.stdout:9/373: creat d2/d8/dd/d1a/f7f x:0 0 0 2023-12-08T20:27:50.365 INFO:tasks.workunit.client.1.smithi111.stdout:9/374: creat d2/d8/dd/d1a/f80 x:0 0 0 2023-12-08T20:27:50.366 INFO:tasks.workunit.client.1.smithi111.stdout:9/375: rename d2/d8/dd/d1a/f1b to d2/d8/dd/d1a/d1e/d23/f81 0 2023-12-08T20:27:50.368 INFO:tasks.workunit.client.1.smithi111.stdout:9/376: creat d2/d8/dd/d1a/d74/f82 x:0 0 0 2023-12-08T20:27:50.368 INFO:tasks.workunit.client.1.smithi111.stdout:9/377: write d2/d8/dd/d56/f72 [505237,47342] 0 2023-12-08T20:27:50.368 INFO:tasks.workunit.client.1.smithi111.stdout:9/378: fdatasync d2/d8/dd/d1a/d1e/f26 0 2023-12-08T20:27:50.369 INFO:tasks.workunit.client.1.smithi111.stdout:9/379: mknod d2/d8/c83 0 2023-12-08T20:27:50.370 INFO:tasks.workunit.client.1.smithi111.stdout:9/380: mknod d2/d8/dd/c84 0 2023-12-08T20:27:50.371 INFO:tasks.workunit.client.1.smithi111.stdout:9/381: unlink d2/d8/f21 0 2023-12-08T20:27:50.399 INFO:tasks.workunit.client.1.smithi111.stdout:5/285: sync 2023-12-08T20:27:50.400 INFO:tasks.workunit.client.1.smithi111.stdout:8/309: sync 2023-12-08T20:27:50.400 INFO:tasks.workunit.client.1.smithi111.stdout:2/297: sync 2023-12-08T20:27:50.400 INFO:tasks.workunit.client.1.smithi111.stdout:4/205: sync 2023-12-08T20:27:50.400 INFO:tasks.workunit.client.1.smithi111.stdout:8/310: chown dd/d32/d3d/f4f 281 1 2023-12-08T20:27:50.400 INFO:tasks.workunit.client.1.smithi111.stdout:2/298: dread - d1/d29/d4e/f4d zero size 2023-12-08T20:27:50.400 INFO:tasks.workunit.client.1.smithi111.stdout:4/206: unlink d8/da/c26 0 2023-12-08T20:27:50.403 INFO:tasks.workunit.client.1.smithi111.stdout:5/286: link d3/d4/d7/f25 d3/d4/d4a/f5f 0 2023-12-08T20:27:50.404 INFO:tasks.workunit.client.1.smithi111.stdout:5/287: write d3/d4/d4a/f49 [400618,14196] 0 2023-12-08T20:27:50.404 INFO:tasks.workunit.client.1.smithi111.stdout:5/288: fsync d3/d4/d7/d29/d30/f3f 0 2023-12-08T20:27:50.404 INFO:tasks.workunit.client.1.smithi111.stdout:2/299: rmdir d1/d29/d53 39 2023-12-08T20:27:50.405 INFO:tasks.workunit.client.1.smithi111.stdout:8/311: mkdir dd/d32/d3d/d6b 0 2023-12-08T20:27:50.407 INFO:tasks.workunit.client.1.smithi111.stdout:4/207: dread d8/da/d2c/d1f/f2a [0,4194304] 0 2023-12-08T20:27:50.408 INFO:tasks.workunit.client.1.smithi111.stdout:4/208: stat d8/da/db/c2d 0 2023-12-08T20:27:50.408 INFO:tasks.workunit.client.1.smithi111.stdout:4/209: fsync d8/da/f20 0 2023-12-08T20:27:50.408 INFO:tasks.workunit.client.1.smithi111.stdout:4/210: readlink d8/da/db/l28 0 2023-12-08T20:27:50.408 INFO:tasks.workunit.client.1.smithi111.stdout:4/211: rename d8/da/d2c/d1f/d2b to d8/da/d2c/d1f/d2b/d46 22 2023-12-08T20:27:50.408 INFO:tasks.workunit.client.1.smithi111.stdout:5/289: mknod d3/d4/d4a/c60 0 2023-12-08T20:27:50.408 INFO:tasks.workunit.client.1.smithi111.stdout:5/290: fsync d3/d4/d7/d36/f44 0 2023-12-08T20:27:50.410 INFO:tasks.workunit.client.1.smithi111.stdout:2/300: creat d1/d1d/d55/d58/f6e x:0 0 0 2023-12-08T20:27:50.410 INFO:tasks.workunit.client.1.smithi111.stdout:2/301: fdatasync d1/d29/d53/f5a 0 2023-12-08T20:27:50.411 INFO:tasks.workunit.client.1.smithi111.stdout:4/212: symlink d8/da/d2c/d1f/d2b/l47 0 2023-12-08T20:27:50.411 INFO:tasks.workunit.client.1.smithi111.stdout:4/213: readlink d8/da/l1d 0 2023-12-08T20:27:50.411 INFO:tasks.workunit.client.1.smithi111.stdout:4/214: chown d8/da/d2c/d1f 41 1 2023-12-08T20:27:50.412 INFO:tasks.workunit.client.1.smithi111.stdout:4/215: truncate d8/da/d29/f39 577357 0 2023-12-08T20:27:50.414 INFO:tasks.workunit.client.1.smithi111.stdout:2/302: symlink d1/d1d/d1f/d36/l6f 0 2023-12-08T20:27:50.414 INFO:tasks.workunit.client.1.smithi111.stdout:8/312: dread f2 [0,4194304] 0 2023-12-08T20:27:50.415 INFO:tasks.workunit.client.1.smithi111.stdout:4/216: mknod d8/da/c48 0 2023-12-08T20:27:50.415 INFO:tasks.workunit.client.1.smithi111.stdout:4/217: fsync d8/f18 0 2023-12-08T20:27:50.415 INFO:tasks.workunit.client.1.smithi111.stdout:4/218: write d8/da/f3b [604382,87622] 0 2023-12-08T20:27:50.415 INFO:tasks.workunit.client.1.smithi111.stdout:4/219: chown d8/da/l36 215141147 1 2023-12-08T20:27:50.415 INFO:tasks.workunit.client.1.smithi111.stdout:4/220: truncate d8/da/d2c/d1f/d40/f44 927042 0 2023-12-08T20:27:50.416 INFO:tasks.workunit.client.1.smithi111.stdout:5/291: truncate d3/d4/d4a/f49 971718 0 2023-12-08T20:27:50.419 INFO:tasks.workunit.client.1.smithi111.stdout:2/303: creat d1/f70 x:0 0 0 2023-12-08T20:27:50.421 INFO:tasks.workunit.client.1.smithi111.stdout:4/221: rmdir d8/da/d2c/d1f/d40 39 2023-12-08T20:27:50.423 INFO:tasks.workunit.client.1.smithi111.stdout:5/292: mknod d3/d4/d7/d36/c61 0 2023-12-08T20:27:50.425 INFO:tasks.workunit.client.1.smithi111.stdout:2/304: creat d1/d1d/d22/f71 x:0 0 0 2023-12-08T20:27:50.425 INFO:tasks.workunit.client.1.smithi111.stdout:8/313: dread dd/d2d/f45 [0,4194304] 0 2023-12-08T20:27:50.425 INFO:tasks.workunit.client.1.smithi111.stdout:2/305: dread - d1/d1d/d1f/d25/d3d/d41/f6c zero size 2023-12-08T20:27:50.428 INFO:tasks.workunit.client.1.smithi111.stdout:4/222: dread d8/f15 [0,4194304] 0 2023-12-08T20:27:50.430 INFO:tasks.workunit.client.1.smithi111.stdout:2/306: creat d1/d1d/d55/f72 x:0 0 0 2023-12-08T20:27:50.431 INFO:tasks.workunit.client.1.smithi111.stdout:8/314: mknod dd/d32/d36/d4b/c6c 0 2023-12-08T20:27:50.432 INFO:tasks.workunit.client.1.smithi111.stdout:4/223: creat d8/d30/f49 x:0 0 0 2023-12-08T20:27:50.432 INFO:tasks.workunit.client.1.smithi111.stdout:4/224: dread d8/da/d29/f39 [0,4194304] 0 2023-12-08T20:27:50.433 INFO:tasks.workunit.client.1.smithi111.stdout:2/307: truncate d1/d1d/f2e 6915543 0 2023-12-08T20:27:50.433 INFO:tasks.workunit.client.1.smithi111.stdout:8/315: dread dd/f29 [0,4194304] 0 2023-12-08T20:27:50.433 INFO:tasks.workunit.client.1.smithi111.stdout:8/316: dread - dd/d32/f48 zero size 2023-12-08T20:27:50.435 INFO:tasks.workunit.client.1.smithi111.stdout:8/317: write dd/f28 [2145139,75409] 0 2023-12-08T20:27:50.435 INFO:tasks.workunit.client.1.smithi111.stdout:4/225: creat d8/d38/f4a x:0 0 0 2023-12-08T20:27:50.435 INFO:tasks.workunit.client.1.smithi111.stdout:4/226: fdatasync d8/f22 0 2023-12-08T20:27:50.436 INFO:tasks.workunit.client.1.smithi111.stdout:4/227: dread d8/da/d2c/d1f/d40/f44 [0,4194304] 0 2023-12-08T20:27:50.436 INFO:tasks.workunit.client.1.smithi111.stdout:4/228: write d8/da/f20 [898412,89643] 0 2023-12-08T20:27:50.439 INFO:tasks.workunit.client.1.smithi111.stdout:8/318: symlink dd/d32/l6d 0 2023-12-08T20:27:50.439 INFO:tasks.workunit.client.1.smithi111.stdout:2/308: mkdir d1/d1d/d68/d73 0 2023-12-08T20:27:50.441 INFO:tasks.workunit.client.1.smithi111.stdout:4/229: mkdir d8/da/d2c/d1f/d2b/d4b 0 2023-12-08T20:27:50.442 INFO:tasks.workunit.client.1.smithi111.stdout:5/293: dwrite d3/f14 [0,4194304] 0 2023-12-08T20:27:50.443 INFO:tasks.workunit.client.1.smithi111.stdout:5/294: write d3/d4/d7/d36/f3d [1582947,52261] 0 2023-12-08T20:27:50.444 INFO:tasks.workunit.client.1.smithi111.stdout:5/295: read d3/d4/f5 [354328,58176] 0 2023-12-08T20:27:50.444 INFO:tasks.workunit.client.1.smithi111.stdout:8/319: unlink lb 0 2023-12-08T20:27:50.446 INFO:tasks.workunit.client.1.smithi111.stdout:2/309: creat d1/d1d/d1f/d25/d3d/d41/f74 x:0 0 0 2023-12-08T20:27:50.446 INFO:tasks.workunit.client.1.smithi111.stdout:2/310: fdatasync d1/d1d/d22/f39 0 2023-12-08T20:27:50.446 INFO:tasks.workunit.client.1.smithi111.stdout:2/311: chown d1/d1d/d1f/d25/d3d/d41/l5b 1 1 2023-12-08T20:27:50.447 INFO:tasks.workunit.client.1.smithi111.stdout:4/230: unlink d8/d38/f4a 0 2023-12-08T20:27:50.447 INFO:tasks.workunit.client.1.smithi111.stdout:4/231: chown d8/da/d2c 302 1 2023-12-08T20:27:50.450 INFO:tasks.workunit.client.1.smithi111.stdout:5/296: getdents d3/d4/d4a/d21 0 2023-12-08T20:27:50.450 INFO:tasks.workunit.client.1.smithi111.stdout:4/232: dread d8/da/d2c/d1f/f2a [0,4194304] 0 2023-12-08T20:27:50.451 INFO:tasks.workunit.client.1.smithi111.stdout:8/320: mknod dd/d32/d3d/d6b/c6e 0 2023-12-08T20:27:50.451 INFO:tasks.workunit.client.1.smithi111.stdout:4/233: chown d8/da/d2c/d1f/d40/l41 118 1 2023-12-08T20:27:50.451 INFO:tasks.workunit.client.1.smithi111.stdout:2/312: mknod d1/d1d/d1f/d25/d3d/c75 0 2023-12-08T20:27:50.452 INFO:tasks.workunit.client.1.smithi111.stdout:8/321: dread dd/d32/d3d/f4f [0,4194304] 0 2023-12-08T20:27:50.452 INFO:tasks.workunit.client.1.smithi111.stdout:8/322: truncate dd/d2d/f3c 966264 0 2023-12-08T20:27:50.454 INFO:tasks.workunit.client.1.smithi111.stdout:5/297: rename d3/d4/d7/d29/c54 to d3/d4/d7/c62 0 2023-12-08T20:27:50.456 INFO:tasks.workunit.client.1.smithi111.stdout:4/234: link d8/da/d29/f39 d8/da/db/d31/f4c 0 2023-12-08T20:27:50.456 INFO:tasks.workunit.client.1.smithi111.stdout:2/313: creat d1/d1d/d22/f76 x:0 0 0 2023-12-08T20:27:50.458 INFO:tasks.workunit.client.1.smithi111.stdout:8/323: rename dd/f25 to dd/d32/d3d/d6b/f6f 0 2023-12-08T20:27:50.458 INFO:tasks.workunit.client.1.smithi111.stdout:2/314: dread d1/d1d/d55/d58/f65 [0,4194304] 0 2023-12-08T20:27:50.458 INFO:tasks.workunit.client.1.smithi111.stdout:2/315: chown d1/d1d/d22/d30/f5c 201411203 1 2023-12-08T20:27:50.458 INFO:tasks.workunit.client.1.smithi111.stdout:5/298: mkdir d3/d12/d63 0 2023-12-08T20:27:50.458 INFO:tasks.workunit.client.1.smithi111.stdout:5/299: stat d3/d4/d4a/f32 0 2023-12-08T20:27:50.460 INFO:tasks.workunit.client.1.smithi111.stdout:4/235: link d8/da/f1e d8/da/db/f4d 0 2023-12-08T20:27:50.460 INFO:tasks.workunit.client.1.smithi111.stdout:4/236: stat d8 0 2023-12-08T20:27:50.460 INFO:tasks.workunit.client.1.smithi111.stdout:4/237: truncate d8/da/f20 1484120 0 2023-12-08T20:27:50.462 INFO:tasks.workunit.client.1.smithi111.stdout:5/300: rename d3/d12/d63 to d3/d4/d7/d36/d64 0 2023-12-08T20:27:50.462 INFO:tasks.workunit.client.1.smithi111.stdout:8/324: write dd/d32/f58 [84992,112366] 0 2023-12-08T20:27:50.462 INFO:tasks.workunit.client.1.smithi111.stdout:8/325: readlink l6 0 2023-12-08T20:27:50.462 INFO:tasks.workunit.client.1.smithi111.stdout:8/326: chown dd/l4c 7713 1 2023-12-08T20:27:50.463 INFO:tasks.workunit.client.1.smithi111.stdout:4/238: creat d8/da/db/f4e x:0 0 0 2023-12-08T20:27:50.463 INFO:tasks.workunit.client.1.smithi111.stdout:4/239: write d8/f12 [536874,29615] 0 2023-12-08T20:27:50.463 INFO:tasks.workunit.client.1.smithi111.stdout:8/327: getdents dd/d32/d36/d50 0 2023-12-08T20:27:50.463 INFO:tasks.workunit.client.1.smithi111.stdout:8/328: fsync dd/d32/d3d/f5b 0 2023-12-08T20:27:50.465 INFO:tasks.workunit.client.1.smithi111.stdout:4/240: mknod d8/da/db/c4f 0 2023-12-08T20:27:50.472 INFO:tasks.workunit.client.1.smithi111.stdout:4/241: write d8/da/d2c/f24 [1179746,51487] 0 2023-12-08T20:27:50.472 INFO:tasks.workunit.client.1.smithi111.stdout:4/242: write d8/da/d2c/d1f/f1a [426651,2925] 0 2023-12-08T20:27:50.475 INFO:tasks.workunit.client.1.smithi111.stdout:2/316: dwrite d1/f70 [0,4194304] 0 2023-12-08T20:27:50.475 INFO:tasks.workunit.client.1.smithi111.stdout:2/317: chown d1/d1d/d1f/d25/d3d/d41/f54 2 1 2023-12-08T20:27:50.476 INFO:tasks.workunit.client.1.smithi111.stdout:8/329: dread dd/d35/f3b [0,4194304] 0 2023-12-08T20:27:50.477 INFO:tasks.workunit.client.1.smithi111.stdout:8/330: stat dd/d2d/f31 0 2023-12-08T20:27:50.480 INFO:tasks.workunit.client.1.smithi111.stdout:4/243: symlink d8/da/d2c/d1f/d40/l50 0 2023-12-08T20:27:50.480 INFO:tasks.workunit.client.1.smithi111.stdout:4/244: write d8/da/db/d31/f3f [50326,27387] 0 2023-12-08T20:27:50.480 INFO:tasks.workunit.client.1.smithi111.stdout:4/245: dread d8/da/d29/f39 [0,4194304] 0 2023-12-08T20:27:50.481 INFO:tasks.workunit.client.1.smithi111.stdout:4/246: dread - d8/d30/f49 zero size 2023-12-08T20:27:50.481 INFO:tasks.workunit.client.1.smithi111.stdout:4/247: write d8/f18 [81330,103928] 0 2023-12-08T20:27:50.481 INFO:tasks.workunit.client.1.smithi111.stdout:4/248: write d8/da/d2c/d1f/f1a [1074878,48973] 0 2023-12-08T20:27:50.481 INFO:tasks.workunit.client.1.smithi111.stdout:4/249: read f1 [2442365,48403] 0 2023-12-08T20:27:50.481 INFO:tasks.workunit.client.1.smithi111.stdout:2/318: symlink d1/d1d/d1f/d25/d67/l77 0 2023-12-08T20:27:50.481 INFO:tasks.workunit.client.1.smithi111.stdout:2/319: truncate d1/d1d/d55/d58/f61 596116 0 2023-12-08T20:27:50.482 INFO:tasks.workunit.client.1.smithi111.stdout:5/301: dwrite d3/d4/f8 [4194304,4194304] 0 2023-12-08T20:27:50.482 INFO:tasks.workunit.client.1.smithi111.stdout:5/302: truncate d3/d4/d7/d29/f3b 4294713 0 2023-12-08T20:27:50.482 INFO:tasks.workunit.client.1.smithi111.stdout:8/331: mknod dd/c70 0 2023-12-08T20:27:50.485 INFO:tasks.workunit.client.1.smithi111.stdout:4/250: rmdir d8/da/db/d31 39 2023-12-08T20:27:50.485 INFO:tasks.workunit.client.1.smithi111.stdout:4/251: chown d8/da/d2c/d1f 79939 1 2023-12-08T20:27:50.486 INFO:tasks.workunit.client.1.smithi111.stdout:4/252: chown d8/da/d2c/d1f/c45 13774956 1 2023-12-08T20:27:50.486 INFO:tasks.workunit.client.1.smithi111.stdout:4/253: readlink d8/da/d2c/d1f/d40/l41 0 2023-12-08T20:27:50.487 INFO:tasks.workunit.client.1.smithi111.stdout:2/320: creat d1/d1d/d1f/d25/f78 x:0 0 0 2023-12-08T20:27:50.499 INFO:tasks.workunit.client.1.smithi111.stdout:5/303: mknod d3/d4/d7/c65 0 2023-12-08T20:27:50.500 INFO:tasks.workunit.client.1.smithi111.stdout:8/332: unlink dd/c2c 0 2023-12-08T20:27:50.501 INFO:tasks.workunit.client.1.smithi111.stdout:2/321: mknod d1/d1d/d1f/d25/d3d/c79 0 2023-12-08T20:27:50.501 INFO:tasks.workunit.client.1.smithi111.stdout:8/333: read f2 [1746667,97930] 0 2023-12-08T20:27:50.503 INFO:tasks.workunit.client.1.smithi111.stdout:4/254: dwrite d8/da/d2c/d1f/d40/f42 [0,4194304] 0 2023-12-08T20:27:50.503 INFO:tasks.workunit.client.1.smithi111.stdout:5/304: rmdir d3/d4/d59 0 2023-12-08T20:27:50.503 INFO:tasks.workunit.client.1.smithi111.stdout:5/305: read - d3/d4/d7/d29/d30/f3f zero size 2023-12-08T20:27:50.503 INFO:tasks.workunit.client.1.smithi111.stdout:5/306: stat d3/d4/d4a/c60 0 2023-12-08T20:27:50.503 INFO:tasks.workunit.client.1.smithi111.stdout:5/307: chown c2 1124094 1 2023-12-08T20:27:50.504 INFO:tasks.workunit.client.1.smithi111.stdout:2/322: rename d1/d1d/d1f/d25/d3d/d41/f54 to d1/d1d/d1f/d25/d3d/d56/f7a 0 2023-12-08T20:27:50.505 INFO:tasks.workunit.client.1.smithi111.stdout:8/334: mknod dd/d32/d3d/c71 0 2023-12-08T20:27:50.509 INFO:tasks.workunit.client.1.smithi111.stdout:4/255: mknod d8/da/d2c/d1f/d40/c51 0 2023-12-08T20:27:50.511 INFO:tasks.workunit.client.1.smithi111.stdout:5/308: creat d3/d4/d7/f66 x:0 0 0 2023-12-08T20:27:50.512 INFO:tasks.workunit.client.1.smithi111.stdout:2/323: creat d1/d29/d53/f7b x:0 0 0 2023-12-08T20:27:50.512 INFO:tasks.workunit.client.1.smithi111.stdout:5/309: read d3/d4/d7/d36/f44 [788493,97765] 0 2023-12-08T20:27:50.512 INFO:tasks.workunit.client.1.smithi111.stdout:5/310: chown d3/d4/l15 0 1 2023-12-08T20:27:50.513 INFO:tasks.workunit.client.1.smithi111.stdout:8/335: mkdir dd/d32/d3d/d6b/d72 0 2023-12-08T20:27:50.514 INFO:tasks.workunit.client.1.smithi111.stdout:5/311: fdatasync d3/d4/d7/d36/f3d 0 2023-12-08T20:27:50.517 INFO:tasks.workunit.client.1.smithi111.stdout:8/336: mknod dd/d35/d42/c73 0 2023-12-08T20:27:50.518 INFO:tasks.workunit.client.1.smithi111.stdout:5/312: mkdir d3/d12/d67 0 2023-12-08T20:27:50.519 INFO:tasks.workunit.client.1.smithi111.stdout:8/337: mknod dd/d2d/d62/c74 0 2023-12-08T20:27:50.519 INFO:tasks.workunit.client.1.smithi111.stdout:1/282: sync 2023-12-08T20:27:50.521 INFO:tasks.workunit.client.1.smithi111.stdout:5/313: creat d3/d4/d7/d36/f68 x:0 0 0 2023-12-08T20:27:50.525 INFO:tasks.workunit.client.1.smithi111.stdout:8/338: link dd/d32/d3d/d6b/f6f dd/d32/d3d/f75 0 2023-12-08T20:27:50.526 INFO:tasks.workunit.client.1.smithi111.stdout:8/339: write dd/d35/f3b [3899381,109727] 0 2023-12-08T20:27:50.528 INFO:tasks.workunit.client.1.smithi111.stdout:1/283: unlink d0/d6/d33/c55 0 2023-12-08T20:27:50.529 INFO:tasks.workunit.client.1.smithi111.stdout:1/284: fsync d0/f1f 0 2023-12-08T20:27:50.530 INFO:tasks.workunit.client.1.smithi111.stdout:1/285: dread d0/d6/d33/d15/d51/d5b/d5e/f63 [0,4194304] 0 2023-12-08T20:27:50.530 INFO:tasks.workunit.client.1.smithi111.stdout:1/286: write d0/d6/d33/d15/d51/d5b/f54 [22099,130437] 0 2023-12-08T20:27:50.530 INFO:tasks.workunit.client.1.smithi111.stdout:1/287: chown d0/d6/d33/d15/d51/d5b/c62 17357 1 2023-12-08T20:27:50.530 INFO:tasks.workunit.client.1.smithi111.stdout:2/324: getdents d1/d1d/d1f/d25/d3d/d41 0 2023-12-08T20:27:50.533 INFO:tasks.workunit.client.1.smithi111.stdout:4/256: dwrite f6 [0,4194304] 0 2023-12-08T20:27:50.537 INFO:tasks.workunit.client.1.smithi111.stdout:2/325: rmdir d1/d1d/d1f/d25/d3d/d41 39 2023-12-08T20:27:50.537 INFO:tasks.workunit.client.1.smithi111.stdout:0/344: sync 2023-12-08T20:27:50.537 INFO:tasks.workunit.client.1.smithi111.stdout:6/222: sync 2023-12-08T20:27:50.537 INFO:tasks.workunit.client.1.smithi111.stdout:3/267: sync 2023-12-08T20:27:50.537 INFO:tasks.workunit.client.1.smithi111.stdout:0/345: truncate d1/df/d56/f63 925047 0 2023-12-08T20:27:50.537 INFO:tasks.workunit.client.1.smithi111.stdout:7/204: sync 2023-12-08T20:27:50.537 INFO:tasks.workunit.client.1.smithi111.stdout:0/346: truncate d1/d4/f73 78350 0 2023-12-08T20:27:50.537 INFO:tasks.workunit.client.1.smithi111.stdout:4/257: rename d8/da/d2c/f24 to d8/da/d2c/d1f/f52 0 2023-12-08T20:27:50.537 INFO:tasks.workunit.client.1.smithi111.stdout:4/258: fdatasync d8/da/db/fc 0 2023-12-08T20:27:50.537 INFO:tasks.workunit.client.1.smithi111.stdout:9/382: sync 2023-12-08T20:27:50.537 INFO:tasks.workunit.client.1.smithi111.stdout:6/223: dread d0/f20 [4194304,4194304] 0 2023-12-08T20:27:50.539 INFO:tasks.workunit.client.1.smithi111.stdout:2/326: symlink d1/d1d/d1f/d25/d3d/d64/l7c 0 2023-12-08T20:27:50.539 INFO:tasks.workunit.client.1.smithi111.stdout:0/347: symlink d1/df/d44/d37/l75 0 2023-12-08T20:27:50.539 INFO:tasks.workunit.client.1.smithi111.stdout:2/327: stat d1/d1d/f33 0 2023-12-08T20:27:50.545 INFO:tasks.workunit.client.1.smithi111.stdout:4/259: rename d8/da/f20 to d8/da/d2c/d1f/d2b/d4b/f53 0 2023-12-08T20:27:50.545 INFO:tasks.workunit.client.1.smithi111.stdout:9/383: creat d2/d8/dd/d56/f85 x:0 0 0 2023-12-08T20:27:50.545 INFO:tasks.workunit.client.1.smithi111.stdout:0/348: dread d1/d4/d24/f60 [0,4194304] 0 2023-12-08T20:27:50.547 INFO:tasks.workunit.client.1.smithi111.stdout:2/328: getdents d1/d1d/d22/d30 0 2023-12-08T20:27:50.548 INFO:tasks.workunit.client.1.smithi111.stdout:2/329: dread - d1/d1d/d1f/d25/d3d/f63 zero size 2023-12-08T20:27:50.549 INFO:tasks.workunit.client.1.smithi111.stdout:3/268: dread d2/d3/d6/f10 [0,4194304] 0 2023-12-08T20:27:50.549 INFO:tasks.workunit.client.1.smithi111.stdout:3/269: readlink d2/d3/d1e/l22 0 2023-12-08T20:27:50.549 INFO:tasks.workunit.client.1.smithi111.stdout:3/270: chown d2/fa 146 1 2023-12-08T20:27:50.551 INFO:tasks.workunit.client.1.smithi111.stdout:7/205: rename da/d13/c16 to da/d25/d3d/c43 0 2023-12-08T20:27:50.552 INFO:tasks.workunit.client.1.smithi111.stdout:4/260: symlink d8/d30/l54 0 2023-12-08T20:27:50.553 INFO:tasks.workunit.client.1.smithi111.stdout:8/340: getdents dd/d35/d42 0 2023-12-08T20:27:50.554 INFO:tasks.workunit.client.1.smithi111.stdout:5/314: dwrite d3/d4/d4a/f32 [0,4194304] 0 2023-12-08T20:27:50.554 INFO:tasks.workunit.client.1.smithi111.stdout:1/288: dwrite d0/d6/f10 [0,4194304] 0 2023-12-08T20:27:50.554 INFO:tasks.workunit.client.1.smithi111.stdout:9/384: symlink d2/d8/l86 0 2023-12-08T20:27:50.556 INFO:tasks.workunit.client.1.smithi111.stdout:6/224: dwrite d0/d1/f3c [0,4194304] 0 2023-12-08T20:27:50.556 INFO:tasks.workunit.client.1.smithi111.stdout:6/225: chown d0/d1/d27/c3d 24 1 2023-12-08T20:27:50.556 INFO:tasks.workunit.client.1.smithi111.stdout:0/349: symlink d1/d4/d24/d46/d49/l76 0 2023-12-08T20:27:50.559 INFO:tasks.workunit.client.1.smithi111.stdout:3/271: creat d2/d3/d1e/f54 x:0 0 0 2023-12-08T20:27:50.561 INFO:tasks.workunit.client.1.smithi111.stdout:7/206: rename da/l27 to da/d25/l44 0 2023-12-08T20:27:50.561 INFO:tasks.workunit.client.1.smithi111.stdout:7/207: chown da/d25/d26/d32 231653358 1 2023-12-08T20:27:50.561 INFO:tasks.workunit.client.1.smithi111.stdout:7/208: fdatasync da/d25/d26/d32/d3e/f42 0 2023-12-08T20:27:50.561 INFO:tasks.workunit.client.1.smithi111.stdout:7/209: stat da/f40 0 2023-12-08T20:27:50.561 INFO:tasks.workunit.client.1.smithi111.stdout:7/210: stat da/d13/d21/d2d 0 2023-12-08T20:27:50.565 INFO:tasks.workunit.client.1.smithi111.stdout:4/261: creat d8/da/d2c/d1f/d40/f55 x:0 0 0 2023-12-08T20:27:50.565 INFO:tasks.workunit.client.1.smithi111.stdout:8/341: symlink dd/d2d/d62/l76 0 2023-12-08T20:27:50.569 INFO:tasks.workunit.client.1.smithi111.stdout:5/315: creat d3/d4/d4a/d21/f69 x:0 0 0 2023-12-08T20:27:50.574 INFO:tasks.workunit.client.1.smithi111.stdout:1/289: unlink d0/d6/d33/f1c 0 2023-12-08T20:27:50.574 INFO:tasks.workunit.client.1.smithi111.stdout:1/290: chown d0/d6/d47 1540927 1 2023-12-08T20:27:50.574 INFO:tasks.workunit.client.1.smithi111.stdout:1/291: fsync d0/f2d 0 2023-12-08T20:27:50.574 INFO:tasks.workunit.client.1.smithi111.stdout:1/292: write d0/d6/d47/f4a [871174,107043] 0 2023-12-08T20:27:50.575 INFO:tasks.workunit.client.1.smithi111.stdout:1/293: chown d0/d6/f10 3476 1 2023-12-08T20:27:50.575 INFO:tasks.workunit.client.1.smithi111.stdout:2/330: dwrite d1/d1d/d22/d30/f5c [0,4194304] 0 2023-12-08T20:27:50.575 INFO:tasks.workunit.client.1.smithi111.stdout:7/211: dread f6 [0,4194304] 0 2023-12-08T20:27:50.575 INFO:tasks.workunit.client.1.smithi111.stdout:9/385: write d2/d8/dd/d1a/d1e/d2d/d35/f60 [840449,29898] 0 2023-12-08T20:27:50.575 INFO:tasks.workunit.client.1.smithi111.stdout:9/386: readlink d2/d8/dd/d1a/d1e/d2d/d4a/l77 0 2023-12-08T20:27:50.578 INFO:tasks.workunit.client.1.smithi111.stdout:6/226: rmdir d0/d1/d2e 0 2023-12-08T20:27:50.578 INFO:tasks.workunit.client.1.smithi111.stdout:6/227: fsync d0/d1/d27/d36/f3e 0 2023-12-08T20:27:50.580 INFO:tasks.workunit.client.1.smithi111.stdout:0/350: rename d1/df/d16/l66 to d1/df/d44/d37/d5c/l77 0 2023-12-08T20:27:50.581 INFO:tasks.workunit.client.1.smithi111.stdout:8/342: symlink dd/d35/d42/l77 0 2023-12-08T20:27:50.581 INFO:tasks.workunit.client.1.smithi111.stdout:8/343: readlink dd/d2d/l56 0 2023-12-08T20:27:50.582 INFO:tasks.workunit.client.1.smithi111.stdout:8/344: stat f5 0 2023-12-08T20:27:50.582 INFO:tasks.workunit.client.1.smithi111.stdout:3/272: dwrite d2/d3/f1c [0,4194304] 0 2023-12-08T20:27:50.583 INFO:tasks.workunit.client.1.smithi111.stdout:2/331: rmdir d1/d1d/d1f/d25/d67 39 2023-12-08T20:27:50.583 INFO:tasks.workunit.client.1.smithi111.stdout:2/332: write d1/d1d/d22/f50 [473269,17043] 0 2023-12-08T20:27:50.587 INFO:tasks.workunit.client.1.smithi111.stdout:0/351: rename d1/d4/d3a/c40 to d1/df/d44/d37/d5c/c78 0 2023-12-08T20:27:50.588 INFO:tasks.workunit.client.1.smithi111.stdout:0/352: chown d1/df 296920 1 2023-12-08T20:27:50.591 INFO:tasks.workunit.client.1.smithi111.stdout:8/345: creat dd/d2d/f78 x:0 0 0 2023-12-08T20:27:50.594 INFO:tasks.workunit.client.1.smithi111.stdout:3/273: rename d2/d3/d1e/f54 to d2/d3/d13/d36/f55 0 2023-12-08T20:27:50.594 INFO:tasks.workunit.client.1.smithi111.stdout:9/387: unlink d2/d8/dd/d1a/d1e/d2d/d35/l7b 0 2023-12-08T20:27:50.600 INFO:tasks.workunit.client.1.smithi111.stdout:8/346: mknod dd/d32/d36/c79 0 2023-12-08T20:27:50.601 INFO:tasks.workunit.client.1.smithi111.stdout:6/228: dread d0/d1b/f1d [0,4194304] 0 2023-12-08T20:27:50.602 INFO:tasks.workunit.client.1.smithi111.stdout:8/347: mkdir dd/d35/d7a 0 2023-12-08T20:27:50.602 INFO:tasks.workunit.client.1.smithi111.stdout:8/348: fdatasync dd/d32/f48 0 2023-12-08T20:27:50.604 INFO:tasks.workunit.client.1.smithi111.stdout:9/388: mknod d2/c87 0 2023-12-08T20:27:50.604 INFO:tasks.workunit.client.1.smithi111.stdout:9/389: stat d2/d8/dd/d1a/d1e/d2d/f51 0 2023-12-08T20:27:50.605 INFO:tasks.workunit.client.1.smithi111.stdout:6/229: creat d0/d1/d1e/f42 x:0 0 0 2023-12-08T20:27:50.605 INFO:tasks.workunit.client.1.smithi111.stdout:8/349: mknod dd/d32/c7b 0 2023-12-08T20:27:50.609 INFO:tasks.workunit.client.1.smithi111.stdout:6/230: rename d0/ld to d0/d1/d27/d36/l43 0 2023-12-08T20:27:50.611 INFO:tasks.workunit.client.1.smithi111.stdout:4/262: dwrite d8/f12 [0,4194304] 0 2023-12-08T20:27:50.611 INFO:tasks.workunit.client.1.smithi111.stdout:3/274: dwrite d2/d12/d2e/f48 [0,4194304] 0 2023-12-08T20:27:50.611 INFO:tasks.workunit.client.1.smithi111.stdout:1/294: dwrite d0/d22/f23 [0,4194304] 0 2023-12-08T20:27:50.611 INFO:tasks.workunit.client.1.smithi111.stdout:1/295: write d0/d6/d47/f67 [150238,100071] 0 2023-12-08T20:27:50.612 INFO:tasks.workunit.client.1.smithi111.stdout:1/296: write d0/d6/f14 [43580,54182] 0 2023-12-08T20:27:50.613 INFO:tasks.workunit.client.1.smithi111.stdout:1/297: chown d0/d6/d34/f52 10 1 2023-12-08T20:27:50.613 INFO:tasks.workunit.client.1.smithi111.stdout:1/298: readlink d0/d6/d33/d15/d51/l4b 0 2023-12-08T20:27:50.613 INFO:tasks.workunit.client.1.smithi111.stdout:1/299: write d0/d6/d33/d15/d51/d2e/f40 [1924645,91088] 0 2023-12-08T20:27:50.614 INFO:tasks.workunit.client.1.smithi111.stdout:4/263: dread d8/da/d2c/d1f/d2b/d4b/f53 [0,4194304] 0 2023-12-08T20:27:50.617 INFO:tasks.workunit.client.1.smithi111.stdout:7/212: dwrite da/f1b [4194304,4194304] 0 2023-12-08T20:27:50.622 INFO:tasks.workunit.client.1.smithi111.stdout:3/275: unlink d2/d15/d17/d25/f2a 0 2023-12-08T20:27:50.622 INFO:tasks.workunit.client.1.smithi111.stdout:1/300: creat d0/d6/d33/d15/d51/d2e/f69 x:0 0 0 2023-12-08T20:27:50.623 INFO:tasks.workunit.client.1.smithi111.stdout:4/264: symlink d8/d30/l56 0 2023-12-08T20:27:50.632 INFO:tasks.workunit.client.1.smithi111.stdout:3/276: rmdir d2/d12 39 2023-12-08T20:27:50.637 INFO:tasks.workunit.client.1.smithi111.stdout:1/301: link d0/c9 d0/c6a 0 2023-12-08T20:27:50.639 INFO:tasks.workunit.client.1.smithi111.stdout:3/277: write d2/d3/f1c [7905852,41586] 0 2023-12-08T20:27:50.642 INFO:tasks.workunit.client.1.smithi111.stdout:7/213: dwrite da/d25/f2e [4194304,4194304] 0 2023-12-08T20:27:50.643 INFO:tasks.workunit.client.1.smithi111.stdout:2/333: dwrite d1/d1d/d22/f76 [0,4194304] 0 2023-12-08T20:27:50.643 INFO:tasks.workunit.client.1.smithi111.stdout:1/302: mknod d0/d6/d33/d15/d51/d2e/d61/c6b 0 2023-12-08T20:27:50.643 INFO:tasks.workunit.client.1.smithi111.stdout:9/390: dwrite d2/d8/dd/d1a/d1e/d2d/f31 [0,4194304] 0 2023-12-08T20:27:50.643 INFO:tasks.workunit.client.1.smithi111.stdout:1/303: write d0/d6/d33/d15/d51/d5b/f54 [239696,104748] 0 2023-12-08T20:27:50.644 INFO:tasks.workunit.client.1.smithi111.stdout:8/350: dwrite dd/d32/f58 [4194304,4194304] 0 2023-12-08T20:27:50.644 INFO:tasks.workunit.client.1.smithi111.stdout:8/351: chown dd/f2a 27689769 1 2023-12-08T20:27:50.645 INFO:tasks.workunit.client.1.smithi111.stdout:8/352: dread dd/d35/d42/f47 [0,4194304] 0 2023-12-08T20:27:50.645 INFO:tasks.workunit.client.1.smithi111.stdout:8/353: write dd/d32/d3d/f5b [72843,63710] 0 2023-12-08T20:27:50.645 INFO:tasks.workunit.client.1.smithi111.stdout:0/353: rmdir d1/df 39 2023-12-08T20:27:50.654 INFO:tasks.workunit.client.1.smithi111.stdout:2/334: creat d1/d1d/d22/f7d x:0 0 0 2023-12-08T20:27:50.654 INFO:tasks.workunit.client.1.smithi111.stdout:2/335: readlink d1/d29/d4e/l37 0 2023-12-08T20:27:50.654 INFO:tasks.workunit.client.1.smithi111.stdout:2/336: fsync d1/d1d/d55/d58/f61 0 2023-12-08T20:27:50.656 INFO:tasks.workunit.client.1.smithi111.stdout:8/354: creat dd/d32/d3d/f7c x:0 0 0 2023-12-08T20:27:50.657 INFO:tasks.workunit.client.1.smithi111.stdout:0/354: readlink d1/df/d16/l19 0 2023-12-08T20:27:50.657 INFO:tasks.workunit.client.1.smithi111.stdout:6/231: dwrite d0/f12 [4194304,4194304] 0 2023-12-08T20:27:50.666 INFO:tasks.workunit.client.1.smithi111.stdout:3/278: dwrite d2/fa [0,4194304] 0 2023-12-08T20:27:50.667 INFO:tasks.workunit.client.1.smithi111.stdout:3/279: truncate d2/d15/d17/f35 187610 0 2023-12-08T20:27:50.668 INFO:tasks.workunit.client.1.smithi111.stdout:1/304: dwrite d0/d6/d33/f64 [0,4194304] 0 2023-12-08T20:27:50.673 INFO:tasks.workunit.client.1.smithi111.stdout:2/337: link d1/d1d/d1f/d25/l43 d1/d1d/d1f/d25/d67/l7e 0 2023-12-08T20:27:50.673 INFO:tasks.workunit.client.1.smithi111.stdout:2/338: stat d1/d29/d4e/l44 0 2023-12-08T20:27:50.674 INFO:tasks.workunit.client.1.smithi111.stdout:9/391: mkdir d2/d8/dd/d1a/d1e/d2d/d35/d88 0 2023-12-08T20:27:50.676 INFO:tasks.workunit.client.1.smithi111.stdout:8/355: link dd/d32/f39 dd/d32/d36/f7d 0 2023-12-08T20:27:50.676 INFO:tasks.workunit.client.1.smithi111.stdout:8/356: write dd/d32/d36/f7d [895025,3109] 0 2023-12-08T20:27:50.676 INFO:tasks.workunit.client.1.smithi111.stdout:8/357: chown dd/d32/d36/d4b/f64 60 1 2023-12-08T20:27:50.678 INFO:tasks.workunit.client.1.smithi111.stdout:0/355: rename d1/dd/c33 to d1/d4/d24/d46/c79 0 2023-12-08T20:27:50.678 INFO:tasks.workunit.client.1.smithi111.stdout:0/356: write d1/df/d56/f63 [1179337,56980] 0 2023-12-08T20:27:50.678 INFO:tasks.workunit.client.1.smithi111.stdout:0/357: chown d1/df/d44/d37 9 1 2023-12-08T20:27:50.679 INFO:tasks.workunit.client.1.smithi111.stdout:6/232: mknod d0/d1/d1e/c44 0 2023-12-08T20:27:50.683 INFO:tasks.workunit.client.1.smithi111.stdout:6/233: dread d0/d1/f11 [0,4194304] 0 2023-12-08T20:27:50.683 INFO:tasks.workunit.client.1.smithi111.stdout:6/234: chown d0/d1/d27/d36/f3e 3779 1 2023-12-08T20:27:50.683 INFO:tasks.workunit.client.1.smithi111.stdout:3/280: mknod d2/d3/d13/d36/d44/c56 0 2023-12-08T20:27:50.685 INFO:tasks.workunit.client.1.smithi111.stdout:6/235: write d0/d1/f8 [1527297,96594] 0 2023-12-08T20:27:50.688 INFO:tasks.workunit.client.1.smithi111.stdout:1/305: mkdir d0/d6/d33/d6c 0 2023-12-08T20:27:50.690 INFO:tasks.workunit.client.1.smithi111.stdout:8/358: mknod dd/d35/d42/c7e 0 2023-12-08T20:27:50.692 INFO:tasks.workunit.client.1.smithi111.stdout:2/339: rename d1/d1d/d1f/d25/d3d/d41/l51 to d1/d1d/d55/l7f 0 2023-12-08T20:27:50.694 INFO:tasks.workunit.client.1.smithi111.stdout:0/358: creat d1/df/d56/f7a x:0 0 0 2023-12-08T20:27:50.696 INFO:tasks.workunit.client.1.smithi111.stdout:6/236: link d0/d1/c34 d0/d1/d27/d36/c45 0 2023-12-08T20:27:50.696 INFO:tasks.workunit.client.1.smithi111.stdout:6/237: fsync d0/d1/d27/f40 0 2023-12-08T20:27:50.698 INFO:tasks.workunit.client.1.smithi111.stdout:1/306: symlink d0/d6/d33/l6d 0 2023-12-08T20:27:50.700 INFO:tasks.workunit.client.1.smithi111.stdout:9/392: unlink d2/c43 0 2023-12-08T20:27:50.702 INFO:tasks.workunit.client.1.smithi111.stdout:8/359: getdents dd/d32/d36/d4b 0 2023-12-08T20:27:50.702 INFO:tasks.workunit.client.1.smithi111.stdout:8/360: read dd/d32/f57 [81330,101982] 0 2023-12-08T20:27:50.703 INFO:tasks.workunit.client.1.smithi111.stdout:2/340: rmdir d1/d1d/d1f 39 2023-12-08T20:27:50.706 INFO:tasks.workunit.client.1.smithi111.stdout:0/359: rmdir d1/d4/d3a 39 2023-12-08T20:27:50.709 INFO:tasks.workunit.client.1.smithi111.stdout:1/307: getdents d0/d6/d33/d15/d51/d5b/d5e 0 2023-12-08T20:27:50.709 INFO:tasks.workunit.client.1.smithi111.stdout:1/308: truncate d0/d6/d33/d15/d51/f43 965653 0 2023-12-08T20:27:50.712 INFO:tasks.workunit.client.1.smithi111.stdout:9/393: mknod d2/d8/dd/d1a/d1e/c89 0 2023-12-08T20:27:50.712 INFO:tasks.workunit.client.1.smithi111.stdout:9/394: chown d2/d8/dd/d1a/d1e/d23/c6d 1533845 1 2023-12-08T20:27:50.712 INFO:tasks.workunit.client.1.smithi111.stdout:9/395: chown d2/d8/dd/d1a/d1e/d2d/d35 0 1 2023-12-08T20:27:50.712 INFO:tasks.workunit.client.1.smithi111.stdout:9/396: getdents d2/d8/dd/d1a/d1e/d2d/d35/d88 0 2023-12-08T20:27:50.712 INFO:tasks.workunit.client.1.smithi111.stdout:0/360: mkdir d1/df/d16/d2c/d7b 0 2023-12-08T20:27:50.714 INFO:tasks.workunit.client.1.smithi111.stdout:9/397: symlink d2/d8/l8a 0 2023-12-08T20:27:50.716 INFO:tasks.workunit.client.1.smithi111.stdout:0/361: write d1/dd/f4e [2408626,56871] 0 2023-12-08T20:27:50.717 INFO:tasks.workunit.client.1.smithi111.stdout:9/398: dread d2/d8/dd/d1a/d1e/d2d/d4a/f5a [0,4194304] 0 2023-12-08T20:27:50.719 INFO:tasks.workunit.client.1.smithi111.stdout:2/341: dwrite d1/d29/d53/f7b [0,4194304] 0 2023-12-08T20:27:50.719 INFO:tasks.workunit.client.1.smithi111.stdout:0/362: dread d1/df/d56/f63 [0,4194304] 0 2023-12-08T20:27:50.722 INFO:tasks.workunit.client.1.smithi111.stdout:0/363: dread d1/df/d56/f63 [0,4194304] 0 2023-12-08T20:27:50.725 INFO:tasks.workunit.client.1.smithi111.stdout:1/309: dwrite d0/f1 [0,4194304] 0 2023-12-08T20:27:50.727 INFO:tasks.workunit.client.1.smithi111.stdout:2/342: creat d1/d1d/d1f/d25/d3d/d64/f80 x:0 0 0 2023-12-08T20:27:50.727 INFO:tasks.workunit.client.1.smithi111.stdout:2/343: read - d1/d1d/d22/f71 zero size 2023-12-08T20:27:50.728 INFO:tasks.workunit.client.1.smithi111.stdout:0/364: dread d1/df/d44/f43 [0,4194304] 0 2023-12-08T20:27:50.728 INFO:tasks.workunit.client.1.smithi111.stdout:0/365: stat d1/d2d 0 2023-12-08T20:27:50.728 INFO:tasks.workunit.client.1.smithi111.stdout:0/366: readlink d1/d4/l2b 0 2023-12-08T20:27:50.728 INFO:tasks.workunit.client.1.smithi111.stdout:2/344: write d1/d1d/f26 [2312252,108191] 0 2023-12-08T20:27:50.729 INFO:tasks.workunit.client.1.smithi111.stdout:1/310: creat d0/d6/d33/d15/d51/f6e x:0 0 0 2023-12-08T20:27:50.730 INFO:tasks.workunit.client.1.smithi111.stdout:0/367: creat d1/d4/d24/d46/d49/d6e/f7c x:0 0 0 2023-12-08T20:27:50.730 INFO:tasks.workunit.client.1.smithi111.stdout:0/368: dread - d1/d4/d24/d46/d58/f6d zero size 2023-12-08T20:27:50.732 INFO:tasks.workunit.client.1.smithi111.stdout:2/345: rmdir d1/d1d/d22 39 2023-12-08T20:27:50.739 INFO:tasks.workunit.client.1.smithi111.stdout:1/311: link d0/d6/d33/d15/d51/f21 d0/d4d/f6f 0 2023-12-08T20:27:50.739 INFO:tasks.workunit.client.1.smithi111.stdout:0/369: write d1/dd/d47/f5d [602660,30773] 0 2023-12-08T20:27:50.739 INFO:tasks.workunit.client.1.smithi111.stdout:0/370: stat d1/d2d 0 2023-12-08T20:27:50.739 INFO:tasks.workunit.client.1.smithi111.stdout:9/399: dwrite d2/d8/dd/f22 [0,4194304] 0 2023-12-08T20:27:50.739 INFO:tasks.workunit.client.1.smithi111.stdout:0/371: dread d1/d4/d24/f60 [0,4194304] 0 2023-12-08T20:27:50.739 INFO:tasks.workunit.client.1.smithi111.stdout:2/346: symlink d1/d1d/d55/l81 0 2023-12-08T20:27:50.740 INFO:tasks.workunit.client.1.smithi111.stdout:1/312: creat d0/f70 x:0 0 0 2023-12-08T20:27:50.740 INFO:tasks.workunit.client.1.smithi111.stdout:1/313: write d0/f17 [4589990,64325] 0 2023-12-08T20:27:50.740 INFO:tasks.workunit.client.1.smithi111.stdout:0/372: creat d1/d4/d24/d2f/f7d x:0 0 0 2023-12-08T20:27:50.740 INFO:tasks.workunit.client.1.smithi111.stdout:2/347: creat d1/d29/d53/f82 x:0 0 0 2023-12-08T20:27:50.742 INFO:tasks.workunit.client.1.smithi111.stdout:1/314: write d0/f1f [3498186,26616] 0 2023-12-08T20:27:50.745 INFO:tasks.workunit.client.1.smithi111.stdout:0/373: mkdir d1/df/d16/d2c/d7e 0 2023-12-08T20:27:50.748 INFO:tasks.workunit.client.1.smithi111.stdout:2/348: rmdir d1/d1d/d1f/d25/d3d/d41 39 2023-12-08T20:27:50.748 INFO:tasks.workunit.client.1.smithi111.stdout:1/315: creat d0/f71 x:0 0 0 2023-12-08T20:27:50.757 INFO:tasks.workunit.client.1.smithi111.stdout:9/400: dwrite d2/f7 [0,4194304] 0 2023-12-08T20:27:50.759 INFO:tasks.workunit.client.1.smithi111.stdout:2/349: dread d1/d1d/d22/f39 [0,4194304] 0 2023-12-08T20:27:50.759 INFO:tasks.workunit.client.1.smithi111.stdout:2/350: chown d1/c1c 2043 1 2023-12-08T20:27:50.759 INFO:tasks.workunit.client.1.smithi111.stdout:2/351: stat d1/d29/d4e 0 2023-12-08T20:27:50.760 INFO:tasks.workunit.client.1.smithi111.stdout:9/401: link d2/d8/dd/f4e d2/d8/dd/d1a/d1e/f8b 0 2023-12-08T20:27:50.760 INFO:tasks.workunit.client.1.smithi111.stdout:0/374: dread d1/dd/d47/f5d [0,4194304] 0 2023-12-08T20:27:50.763 INFO:tasks.workunit.client.1.smithi111.stdout:2/352: creat d1/d1d/d55/f83 x:0 0 0 2023-12-08T20:27:50.763 INFO:tasks.workunit.client.1.smithi111.stdout:2/353: getdents d1/d29 0 2023-12-08T20:27:50.763 INFO:tasks.workunit.client.1.smithi111.stdout:9/402: mkdir d2/d8/d8c 0 2023-12-08T20:27:50.763 INFO:tasks.workunit.client.1.smithi111.stdout:1/316: dread d0/f2f [0,4194304] 0 2023-12-08T20:27:50.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:50 smithi043 ceph-mon[111966]: pgmap v16: 65 pgs: 65 active+clean; 253 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8.0 MiB/s rd, 16 MiB/s wr, 57 op/s 2023-12-08T20:27:50.764 INFO:tasks.workunit.client.1.smithi111.stdout:9/403: dread d2/da/f68 [0,4194304] 0 2023-12-08T20:27:50.765 INFO:tasks.workunit.client.1.smithi111.stdout:1/317: write d0/d6/d33/f4f [3839752,100934] 0 2023-12-08T20:27:50.765 INFO:tasks.workunit.client.1.smithi111.stdout:1/318: write d0/d6/d34/f5f [185047,77399] 0 2023-12-08T20:27:50.767 INFO:tasks.workunit.client.1.smithi111.stdout:0/375: mkdir d1/d4/d24/d46/d49/d7f 0 2023-12-08T20:27:50.767 INFO:tasks.workunit.client.1.smithi111.stdout:2/354: link d1/d29/c38 d1/d29/d4e/c84 0 2023-12-08T20:27:50.767 INFO:tasks.workunit.client.1.smithi111.stdout:2/355: truncate d1/d29/d4e/f4d 700465 0 2023-12-08T20:27:50.768 INFO:tasks.workunit.client.1.smithi111.stdout:9/404: write d2/f59 [693401,53712] 0 2023-12-08T20:27:50.768 INFO:tasks.workunit.client.1.smithi111.stdout:9/405: readlink d2/d8/dd/d1a/d1e/d2d/d4a/l5c 0 2023-12-08T20:27:50.769 INFO:tasks.workunit.client.1.smithi111.stdout:1/319: symlink d0/d6/d33/d15/d51/d5b/l72 0 2023-12-08T20:27:50.770 INFO:tasks.workunit.client.1.smithi111.stdout:0/376: mknod d1/d4/d24/d46/d49/d7f/c80 0 2023-12-08T20:27:50.770 INFO:tasks.workunit.client.1.smithi111.stdout:1/320: dread d0/d6/d33/d15/d51/f43 [0,4194304] 0 2023-12-08T20:27:50.771 INFO:tasks.workunit.client.1.smithi111.stdout:9/406: truncate d2/d8/dd/d1a/d1e/d23/f81 4573521 0 2023-12-08T20:27:50.772 INFO:tasks.workunit.client.1.smithi111.stdout:2/356: unlink d1/d1d/d1f/d25/l14 0 2023-12-08T20:27:50.773 INFO:tasks.workunit.client.1.smithi111.stdout:0/377: creat d1/df/d44/d37/d5c/d70/f81 x:0 0 0 2023-12-08T20:27:50.774 INFO:tasks.workunit.client.1.smithi111.stdout:9/407: getdents d2/d8/dd/d1a 0 2023-12-08T20:27:50.777 INFO:tasks.workunit.client.1.smithi111.stdout:2/357: getdents d1/d1d/d1f/d25/d3d/d56 0 2023-12-08T20:27:50.777 INFO:tasks.workunit.client.1.smithi111.stdout:2/358: write d1/d29/d4e/f32 [1035758,33631] 0 2023-12-08T20:27:50.778 INFO:tasks.workunit.client.1.smithi111.stdout:2/359: chown d1/d1d/d1f/d25/d3d 2204329 1 2023-12-08T20:27:50.779 INFO:tasks.workunit.client.1.smithi111.stdout:0/378: getdents d1/d4/d24/d46/d49/d7f 0 2023-12-08T20:27:50.786 INFO:tasks.workunit.client.1.smithi111.stdout:1/321: dread d0/f1f [0,4194304] 0 2023-12-08T20:27:50.786 INFO:tasks.workunit.client.1.smithi111.stdout:0/379: creat d1/df/d16/d2c/d7e/f82 x:0 0 0 2023-12-08T20:27:50.788 INFO:tasks.workunit.client.1.smithi111.stdout:0/380: dread d1/d4/d24/f60 [0,4194304] 0 2023-12-08T20:27:50.790 INFO:tasks.workunit.client.1.smithi111.stdout:1/322: unlink d0/d6/l49 0 2023-12-08T20:27:50.792 INFO:tasks.workunit.client.1.smithi111.stdout:0/381: rmdir d1/dd/d47 39 2023-12-08T20:27:50.792 INFO:tasks.workunit.client.1.smithi111.stdout:0/382: write d1/d4/d24/f45 [532256,9711] 0 2023-12-08T20:27:50.792 INFO:tasks.workunit.client.1.smithi111.stdout:0/383: write d1/d4/d24/f45 [57207,52366] 0 2023-12-08T20:27:50.793 INFO:tasks.workunit.client.1.smithi111.stdout:0/384: truncate d1/dd/f11 658862 0 2023-12-08T20:27:50.793 INFO:tasks.workunit.client.1.smithi111.stdout:0/385: truncate d1/df/d16/d2c/d7e/f82 409029 0 2023-12-08T20:27:50.794 INFO:tasks.workunit.client.1.smithi111.stdout:0/386: mkdir d1/d2d/d83 0 2023-12-08T20:27:50.794 INFO:tasks.workunit.client.1.smithi111.stdout:0/387: readlink d1/d4/l2b 0 2023-12-08T20:27:50.796 INFO:tasks.workunit.client.1.smithi111.stdout:0/388: creat d1/dd/d4a/f84 x:0 0 0 2023-12-08T20:27:50.797 INFO:tasks.workunit.client.1.smithi111.stdout:0/389: symlink d1/dd/d47/l85 0 2023-12-08T20:27:50.799 INFO:tasks.workunit.client.1.smithi111.stdout:0/390: rmdir d1/df/d44/d37/d5c/d70 39 2023-12-08T20:27:50.800 INFO:tasks.workunit.client.1.smithi111.stdout:1/323: dread d0/f31 [0,4194304] 0 2023-12-08T20:27:50.800 INFO:tasks.workunit.client.1.smithi111.stdout:1/324: fdatasync d0/d6/d33/d15/d51/f43 0 2023-12-08T20:27:50.800 INFO:tasks.workunit.client.1.smithi111.stdout:1/325: readlink d0/d6/d33/l6d 0 2023-12-08T20:27:50.800 INFO:tasks.workunit.client.1.smithi111.stdout:9/408: dwrite d2/d8/dd/d1a/d1e/f63 [0,4194304] 0 2023-12-08T20:27:50.802 INFO:tasks.workunit.client.1.smithi111.stdout:1/326: creat d0/d6/d33/d15/d51/f73 x:0 0 0 2023-12-08T20:27:50.802 INFO:tasks.workunit.client.1.smithi111.stdout:9/409: write d2/d8/f5d [196501,130094] 0 2023-12-08T20:27:50.802 INFO:tasks.workunit.client.1.smithi111.stdout:9/410: chown d2/d8/dd/d1a/f7f 2 1 2023-12-08T20:27:50.802 INFO:tasks.workunit.client.1.smithi111.stdout:9/411: chown d2/d8/dd/d1a/c2b 32627 1 2023-12-08T20:27:50.803 INFO:tasks.workunit.client.1.smithi111.stdout:0/391: write d1/d2d/f39 [1465024,47016] 0 2023-12-08T20:27:50.803 INFO:tasks.workunit.client.1.smithi111.stdout:0/392: dread - d1/d4/d24/d46/d58/f6d zero size 2023-12-08T20:27:50.803 INFO:tasks.workunit.client.1.smithi111.stdout:0/393: write d1/df/f3b [4634989,92470] 0 2023-12-08T20:27:50.803 INFO:tasks.workunit.client.1.smithi111.stdout:0/394: fsync d1/d2d/f41 0 2023-12-08T20:27:50.804 INFO:tasks.workunit.client.1.smithi111.stdout:1/327: symlink d0/d6/d33/d15/d51/d5b/d59/l74 0 2023-12-08T20:27:50.808 INFO:tasks.workunit.client.1.smithi111.stdout:0/395: creat d1/df/d16/f86 x:0 0 0 2023-12-08T20:27:50.808 INFO:tasks.workunit.client.1.smithi111.stdout:0/396: dread - d1/d4/d24/d46/d49/d6e/f7c zero size 2023-12-08T20:27:50.809 INFO:tasks.workunit.client.1.smithi111.stdout:2/360: dwrite d1/d1d/d22/f69 [0,4194304] 0 2023-12-08T20:27:50.810 INFO:tasks.workunit.client.1.smithi111.stdout:1/328: mkdir d0/d6/d33/d6c/d75 0 2023-12-08T20:27:50.811 INFO:tasks.workunit.client.1.smithi111.stdout:9/412: mknod d2/d8/dd/d1a/d1e/d2d/d35/c8d 0 2023-12-08T20:27:50.813 INFO:tasks.workunit.client.1.smithi111.stdout:0/397: creat d1/df/d16/d2c/d7b/f87 x:0 0 0 2023-12-08T20:27:50.813 INFO:tasks.workunit.client.1.smithi111.stdout:0/398: write d1/dd/f11 [553863,21835] 0 2023-12-08T20:27:50.816 INFO:tasks.workunit.client.1.smithi111.stdout:2/361: creat d1/d29/d53/f85 x:0 0 0 2023-12-08T20:27:50.820 INFO:tasks.workunit.client.1.smithi111.stdout:1/329: symlink d0/d6/d33/d15/l76 0 2023-12-08T20:27:50.820 INFO:tasks.workunit.client.1.smithi111.stdout:1/330: rename d0 to d0/d6/d33/d60/d77 22 2023-12-08T20:27:50.820 INFO:tasks.workunit.client.1.smithi111.stdout:9/413: rmdir d2/d8/dd/d1a/d1e/d2d 39 2023-12-08T20:27:50.823 INFO:tasks.workunit.client.1.smithi111.stdout:9/414: rename d2/d8/f14 to d2/d8/dd/d1a/d74/f8e 0 2023-12-08T20:27:50.823 INFO:tasks.workunit.client.1.smithi111.stdout:1/331: mkdir d0/d6/d33/d15/d51/d78 0 2023-12-08T20:27:50.834 INFO:tasks.workunit.client.1.smithi111.stdout:9/415: dread d2/d8/dd/d1a/d1e/d23/f81 [0,4194304] 0 2023-12-08T20:27:50.836 INFO:tasks.workunit.client.1.smithi111.stdout:9/416: truncate d2/d8/dd/d1a/d74/f8e 2855065 0 2023-12-08T20:27:50.837 INFO:tasks.workunit.client.1.smithi111.stdout:0/399: dwrite d1/d4/d24/d46/d58/f6d [0,4194304] 0 2023-12-08T20:27:50.837 INFO:tasks.workunit.client.1.smithi111.stdout:0/400: fdatasync d1/dd/f18 0 2023-12-08T20:27:50.838 INFO:tasks.workunit.client.1.smithi111.stdout:1/332: dwrite d0/d6/d47/f53 [0,4194304] 0 2023-12-08T20:27:50.840 INFO:tasks.workunit.client.1.smithi111.stdout:0/401: symlink d1/d4/d24/d2f/l88 0 2023-12-08T20:27:50.844 INFO:tasks.workunit.client.1.smithi111.stdout:0/402: rmdir d1/df 39 2023-12-08T20:27:50.846 INFO:tasks.workunit.client.1.smithi111.stdout:0/403: link d1/l28 d1/d4/d24/d46/d49/d6e/l89 0 2023-12-08T20:27:50.846 INFO:tasks.workunit.client.1.smithi111.stdout:0/404: chown d1/dd/c29 14 1 2023-12-08T20:27:50.847 INFO:tasks.workunit.client.1.smithi111.stdout:0/405: read d1/dd/f11 [254605,34869] 0 2023-12-08T20:27:50.850 INFO:tasks.workunit.client.1.smithi111.stdout:0/406: creat d1/df/d44/d37/f8a x:0 0 0 2023-12-08T20:27:50.870 INFO:tasks.workunit.client.1.smithi111.stdout:9/417: dwrite d2/d8/dd/d56/f72 [0,4194304] 0 2023-12-08T20:27:50.871 INFO:tasks.workunit.client.1.smithi111.stdout:1/333: dwrite d0/d6/d33/f64 [0,4194304] 0 2023-12-08T20:27:50.871 INFO:tasks.workunit.client.1.smithi111.stdout:0/407: dwrite d1/d4/d24/d2f/f7d [0,4194304] 0 2023-12-08T20:27:50.871 INFO:tasks.workunit.client.1.smithi111.stdout:0/408: read - d1/df/d44/d37/d5c/d70/f81 zero size 2023-12-08T20:27:50.871 INFO:tasks.workunit.client.1.smithi111.stdout:0/409: write d1/d4/f38 [869180,101264] 0 2023-12-08T20:27:50.871 INFO:tasks.workunit.client.1.smithi111.stdout:0/410: stat d1/d4/d24/d46/d58/d65 0 2023-12-08T20:27:50.874 INFO:tasks.workunit.client.1.smithi111.stdout:9/418: mkdir d2/d8/dd/d1a/d1e/d2d/d8f 0 2023-12-08T20:27:50.878 INFO:tasks.workunit.client.1.smithi111.stdout:9/419: creat d2/d8/dd/d1a/d1e/d2d/d35/d6b/f90 x:0 0 0 2023-12-08T20:27:50.880 INFO:tasks.workunit.client.1.smithi111.stdout:9/420: mkdir d2/d8/dd/d1a/d1e/d2d/d8f/d91 0 2023-12-08T20:27:50.880 INFO:tasks.workunit.client.1.smithi111.stdout:9/421: write d2/d8/dd/d1a/d74/f8e [2862717,119723] 0 2023-12-08T20:27:50.882 INFO:tasks.workunit.client.1.smithi111.stdout:0/411: dread d1/d2d/f41 [0,4194304] 0 2023-12-08T20:27:50.882 INFO:tasks.workunit.client.1.smithi111.stdout:9/422: symlink d2/d8/dd/d1a/d1e/d2d/l92 0 2023-12-08T20:27:50.883 INFO:tasks.workunit.client.1.smithi111.stdout:0/412: mkdir d1/d69/d8b 0 2023-12-08T20:27:50.883 INFO:tasks.workunit.client.1.smithi111.stdout:0/413: readlink d1/d4/d24/d2f/l88 0 2023-12-08T20:27:50.884 INFO:tasks.workunit.client.1.smithi111.stdout:9/423: creat d2/d8/dd/d1a/d66/f93 x:0 0 0 2023-12-08T20:27:50.885 INFO:tasks.workunit.client.1.smithi111.stdout:0/414: truncate d1/d2d/f39 1561370 0 2023-12-08T20:27:50.885 INFO:tasks.workunit.client.1.smithi111.stdout:1/334: dwrite d0/d6/f14 [4194304,4194304] 0 2023-12-08T20:27:50.886 INFO:tasks.workunit.client.1.smithi111.stdout:9/424: creat d2/d8/d8c/f94 x:0 0 0 2023-12-08T20:27:50.887 INFO:tasks.workunit.client.1.smithi111.stdout:0/415: mkdir d1/d4/d3a/d8c 0 2023-12-08T20:27:50.887 INFO:tasks.workunit.client.1.smithi111.stdout:0/416: dread - d1/df/d56/f7a zero size 2023-12-08T20:27:50.888 INFO:tasks.workunit.client.1.smithi111.stdout:0/417: stat d1/dd/d4a 0 2023-12-08T20:27:50.888 INFO:tasks.workunit.client.1.smithi111.stdout:0/418: fsync d1/d4/d24/d2f/f7d 0 2023-12-08T20:27:50.888 INFO:tasks.workunit.client.1.smithi111.stdout:0/419: chown d1/d4/d24/c3e 504051905 1 2023-12-08T20:27:50.889 INFO:tasks.workunit.client.1.smithi111.stdout:9/425: creat d2/d8/dd/d1a/d1e/d2d/d35/f95 x:0 0 0 2023-12-08T20:27:50.889 INFO:tasks.workunit.client.1.smithi111.stdout:0/420: rmdir d1/df/d44/d37/d5c/d70 39 2023-12-08T20:27:50.892 INFO:tasks.workunit.client.1.smithi111.stdout:9/426: rmdir d2/d8/dd/d1a/d1e/d2d/d8f/d91 0 2023-12-08T20:27:50.892 INFO:tasks.workunit.client.1.smithi111.stdout:9/427: fdatasync d2/d8/dd/d1a/d74/f7a 0 2023-12-08T20:27:50.894 INFO:tasks.workunit.client.1.smithi111.stdout:0/421: creat d1/df/d16/d2c/f8d x:0 0 0 2023-12-08T20:27:50.895 INFO:tasks.workunit.client.1.smithi111.stdout:9/428: mkdir d2/d8/d8c/d96 0 2023-12-08T20:27:50.896 INFO:tasks.workunit.client.1.smithi111.stdout:9/429: symlink d2/d8/dd/l97 0 2023-12-08T20:27:50.897 INFO:tasks.workunit.client.1.smithi111.stdout:9/430: mknod d2/da/c98 0 2023-12-08T20:27:50.900 INFO:tasks.workunit.client.1.smithi111.stdout:1/335: dwrite d0/d6/d33/d15/d51/d2e/f5c [0,4194304] 0 2023-12-08T20:27:50.900 INFO:tasks.workunit.client.1.smithi111.stdout:1/336: fdatasync d0/d6/d33/ff 0 2023-12-08T20:27:50.900 INFO:tasks.workunit.client.1.smithi111.stdout:1/337: truncate d0/d6/f28 1589425 0 2023-12-08T20:27:50.903 INFO:tasks.workunit.client.1.smithi111.stdout:1/338: mkdir d0/d6/d33/d15/d51/d2e/d61/d79 0 2023-12-08T20:27:50.905 INFO:tasks.workunit.client.1.smithi111.stdout:1/339: symlink d0/d6/d33/d15/d51/d78/l7a 0 2023-12-08T20:27:50.905 INFO:tasks.workunit.client.1.smithi111.stdout:1/340: truncate d0/f70 363972 0 2023-12-08T20:27:50.907 INFO:tasks.workunit.client.1.smithi111.stdout:1/341: mknod d0/d6/d33/d6c/d75/c7b 0 2023-12-08T20:27:50.907 INFO:tasks.workunit.client.1.smithi111.stdout:1/342: write d0/d6/d47/f4a [2956843,118953] 0 2023-12-08T20:27:50.907 INFO:tasks.workunit.client.1.smithi111.stdout:1/343: chown d0/d6/d33/d15/d51/d78 1 1 2023-12-08T20:27:50.908 INFO:tasks.workunit.client.1.smithi111.stdout:1/344: creat d0/d6/d33/d15/d51/d78/f7c x:0 0 0 2023-12-08T20:27:50.908 INFO:tasks.workunit.client.1.smithi111.stdout:1/345: chown d0/d6/d33/d15/d51/d2e/l5a 15780 1 2023-12-08T20:27:50.909 INFO:tasks.workunit.client.1.smithi111.stdout:7/214: sync 2023-12-08T20:27:50.910 INFO:tasks.workunit.client.1.smithi111.stdout:3/281: sync 2023-12-08T20:27:50.910 INFO:tasks.workunit.client.1.smithi111.stdout:5/316: sync 2023-12-08T20:27:50.910 INFO:tasks.workunit.client.1.smithi111.stdout:3/282: write d2/d15/d17/f35 [363006,3356] 0 2023-12-08T20:27:50.910 INFO:tasks.workunit.client.1.smithi111.stdout:5/317: write d3/d4/d7/d36/f68 [98066,45108] 0 2023-12-08T20:27:50.910 INFO:tasks.workunit.client.1.smithi111.stdout:1/346: dread d0/d6/d34/f5f [0,4194304] 0 2023-12-08T20:27:50.910 INFO:tasks.workunit.client.1.smithi111.stdout:7/215: stat da/d13/c24 0 2023-12-08T20:27:50.910 INFO:tasks.workunit.client.1.smithi111.stdout:1/347: write d0/f17 [4495524,48638] 0 2023-12-08T20:27:50.912 INFO:tasks.workunit.client.1.smithi111.stdout:4/265: sync 2023-12-08T20:27:50.912 INFO:tasks.workunit.client.1.smithi111.stdout:7/216: write da/d25/d26/f37 [377231,53538] 0 2023-12-08T20:27:50.912 INFO:tasks.workunit.client.1.smithi111.stdout:5/318: creat d3/d4/d7/d36/d64/f6a x:0 0 0 2023-12-08T20:27:50.912 INFO:tasks.workunit.client.1.smithi111.stdout:5/319: stat d3/d4/f55 0 2023-12-08T20:27:50.912 INFO:tasks.workunit.client.1.smithi111.stdout:1/348: fdatasync d0/f17 0 2023-12-08T20:27:50.912 INFO:tasks.workunit.client.1.smithi111.stdout:1/349: chown d0/d6/f27 13 1 2023-12-08T20:27:50.913 INFO:tasks.workunit.client.1.smithi111.stdout:3/283: rename d2/d3/d13/c18 to d2/c57 0 2023-12-08T20:27:50.914 INFO:tasks.workunit.client.1.smithi111.stdout:1/350: read d0/d6/f14 [3618691,99369] 0 2023-12-08T20:27:50.915 INFO:tasks.workunit.client.1.smithi111.stdout:4/266: creat d8/da/d29/f57 x:0 0 0 2023-12-08T20:27:50.915 INFO:tasks.workunit.client.1.smithi111.stdout:7/217: creat da/d13/f45 x:0 0 0 2023-12-08T20:27:50.915 INFO:tasks.workunit.client.1.smithi111.stdout:7/218: truncate da/d25/d26/f2b 298226 0 2023-12-08T20:27:50.917 INFO:tasks.workunit.client.1.smithi111.stdout:5/320: creat d3/f6b x:0 0 0 2023-12-08T20:27:50.917 INFO:tasks.workunit.client.1.smithi111.stdout:1/351: mknod d0/d6/d33/d15/d51/d78/c7d 0 2023-12-08T20:27:50.922 INFO:tasks.workunit.client.1.smithi111.stdout:1/352: symlink d0/d6/d33/d15/d51/d5b/l7e 0 2023-12-08T20:27:50.922 INFO:tasks.workunit.client.1.smithi111.stdout:1/353: readlink d0/l7 0 2023-12-08T20:27:50.926 INFO:tasks.workunit.client.1.smithi111.stdout:3/284: dread d2/d12/f1d [0,4194304] 0 2023-12-08T20:27:50.926 INFO:tasks.workunit.client.1.smithi111.stdout:1/354: creat d0/d6/d33/d60/f7f x:0 0 0 2023-12-08T20:27:50.933 INFO:tasks.workunit.client.1.smithi111.stdout:4/267: dread f6 [0,4194304] 0 2023-12-08T20:27:50.934 INFO:tasks.workunit.client.1.smithi111.stdout:4/268: stat d8/da/d2c/d1f/f52 0 2023-12-08T20:27:50.938 INFO:tasks.workunit.client.1.smithi111.stdout:4/269: creat d8/da/d2c/d1f/f58 x:0 0 0 2023-12-08T20:27:50.938 INFO:tasks.workunit.client.1.smithi111.stdout:4/270: fsync d8/d30/f49 0 2023-12-08T20:27:50.939 INFO:tasks.workunit.client.1.smithi111.stdout:4/271: fdatasync d8/da/d2c/d1f/d2b/f3e 0 2023-12-08T20:27:50.951 INFO:tasks.workunit.client.1.smithi111.stdout:7/219: dwrite da/d25/d26/f2b [0,4194304] 0 2023-12-08T20:27:50.953 INFO:tasks.workunit.client.1.smithi111.stdout:5/321: dwrite d3/d4/d7/d29/d30/f3f [0,4194304] 0 2023-12-08T20:27:50.954 INFO:tasks.workunit.client.1.smithi111.stdout:4/272: dwrite d8/da/f25 [0,4194304] 0 2023-12-08T20:27:50.957 INFO:tasks.workunit.client.1.smithi111.stdout:5/322: link d3/d4/d7/d29/c52 d3/d4/d7/d29/d30/c6c 0 2023-12-08T20:27:50.957 INFO:tasks.workunit.client.1.smithi111.stdout:5/323: write d3/d4/d4a/d21/f69 [956546,104911] 0 2023-12-08T20:27:50.962 INFO:tasks.workunit.client.1.smithi111.stdout:4/273: mknod d8/d38/c59 0 2023-12-08T20:27:50.962 INFO:tasks.workunit.client.1.smithi111.stdout:4/274: fdatasync d8/da/d2c/d1f/d2b/d4b/f53 0 2023-12-08T20:27:50.964 INFO:tasks.workunit.client.1.smithi111.stdout:5/324: mkdir d3/d6d 0 2023-12-08T20:27:50.964 INFO:tasks.workunit.client.1.smithi111.stdout:5/325: chown d3/d4/d7/d2c/f41 2001 1 2023-12-08T20:27:50.965 INFO:tasks.workunit.client.1.smithi111.stdout:4/275: unlink l4 0 2023-12-08T20:27:50.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:50 smithi111 ceph-mon[121341]: pgmap v16: 65 pgs: 65 active+clean; 253 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8.0 MiB/s rd, 16 MiB/s wr, 57 op/s 2023-12-08T20:27:50.967 INFO:tasks.workunit.client.1.smithi111.stdout:5/326: truncate d3/d4/d7/f16 4009309 0 2023-12-08T20:27:50.971 INFO:tasks.workunit.client.1.smithi111.stdout:5/327: dread d3/d4/d7/d36/f3d [0,4194304] 0 2023-12-08T20:27:50.971 INFO:tasks.workunit.client.1.smithi111.stdout:5/328: chown d3/d4/d7/d36/f4f 18047217 1 2023-12-08T20:27:50.971 INFO:tasks.workunit.client.1.smithi111.stdout:5/329: fsync d3/f10 0 2023-12-08T20:27:50.972 INFO:tasks.workunit.client.1.smithi111.stdout:5/330: creat d3/f6e x:0 0 0 2023-12-08T20:27:50.974 INFO:tasks.workunit.client.1.smithi111.stdout:5/331: link d3/d4/d7/d36/f3d d3/d4/d4a/f6f 0 2023-12-08T20:27:50.974 INFO:tasks.workunit.client.1.smithi111.stdout:5/332: fsync d3/d4/d4a/f5f 0 2023-12-08T20:27:50.974 INFO:tasks.workunit.client.1.smithi111.stdout:5/333: readlink d3/d4/lf 0 2023-12-08T20:27:50.974 INFO:tasks.workunit.client.1.smithi111.stdout:4/276: dread f1 [0,4194304] 0 2023-12-08T20:27:50.975 INFO:tasks.workunit.client.1.smithi111.stdout:5/334: symlink d3/d4/d7/d29/d30/l70 0 2023-12-08T20:27:50.977 INFO:tasks.workunit.client.1.smithi111.stdout:4/277: rename d8/da/f1e to d8/d38/f5a 0 2023-12-08T20:27:50.981 INFO:tasks.workunit.client.1.smithi111.stdout:1/355: dwrite d0/d6/d33/f4f [0,4194304] 0 2023-12-08T20:27:50.984 INFO:tasks.workunit.client.1.smithi111.stdout:1/356: rmdir d0/d22 39 2023-12-08T20:27:50.984 INFO:tasks.workunit.client.1.smithi111.stdout:1/357: creat d0/d6/d33/d15/d51/d78/f80 x:0 0 0 2023-12-08T20:27:50.986 INFO:tasks.workunit.client.1.smithi111.stdout:4/278: dread f6 [0,4194304] 0 2023-12-08T20:27:50.988 INFO:tasks.workunit.client.1.smithi111.stdout:4/279: rename d8/da/l1d to d8/da/l5b 0 2023-12-08T20:27:50.992 INFO:tasks.workunit.client.1.smithi111.stdout:3/285: dwrite d2/d12/f1d [0,4194304] 0 2023-12-08T20:27:50.992 INFO:tasks.workunit.client.1.smithi111.stdout:7/220: dwrite da/d25/f2e [0,4194304] 0 2023-12-08T20:27:50.993 INFO:tasks.workunit.client.1.smithi111.stdout:3/286: getdents d2/d15/d17 0 2023-12-08T20:27:50.995 INFO:tasks.workunit.client.1.smithi111.stdout:7/221: unlink da/d13/d21/d2d/c34 0 2023-12-08T20:27:50.996 INFO:tasks.workunit.client.1.smithi111.stdout:3/287: creat d2/d15/d17/d25/f58 x:0 0 0 2023-12-08T20:27:50.996 INFO:tasks.workunit.client.1.smithi111.stdout:3/288: truncate d2/d15/d17/f3b 518424 0 2023-12-08T20:27:50.996 INFO:tasks.workunit.client.1.smithi111.stdout:3/289: chown d2/d3/d6/fd 5316 1 2023-12-08T20:27:50.997 INFO:tasks.workunit.client.1.smithi111.stdout:7/222: rename da/d13/f17 to da/f46 0 2023-12-08T20:27:50.997 INFO:tasks.workunit.client.1.smithi111.stdout:7/223: chown da/d25/d3d/c43 3517405 1 2023-12-08T20:27:51.001 INFO:tasks.workunit.client.1.smithi111.stdout:3/290: symlink d2/d3/d13/d36/d44/l59 0 2023-12-08T20:27:51.001 INFO:tasks.workunit.client.1.smithi111.stdout:7/224: symlink da/l47 0 2023-12-08T20:27:51.001 INFO:tasks.workunit.client.1.smithi111.stdout:7/225: chown da/d25/d26/f37 172 1 2023-12-08T20:27:51.001 INFO:tasks.workunit.client.1.smithi111.stdout:7/226: chown da/d13/d21 5 1 2023-12-08T20:27:51.002 INFO:tasks.workunit.client.1.smithi111.stdout:7/227: stat da/d25/l30 0 2023-12-08T20:27:51.003 INFO:tasks.workunit.client.1.smithi111.stdout:7/228: symlink da/d25/d3d/l48 0 2023-12-08T20:27:51.003 INFO:tasks.workunit.client.1.smithi111.stdout:7/229: write da/d25/f3b [452034,41866] 0 2023-12-08T20:27:51.003 INFO:tasks.workunit.client.1.smithi111.stdout:7/230: fdatasync da/f1e 0 2023-12-08T20:27:51.004 INFO:tasks.workunit.client.1.smithi111.stdout:7/231: rmdir da/d25/d26 39 2023-12-08T20:27:51.005 INFO:tasks.workunit.client.1.smithi111.stdout:7/232: creat da/d13/f49 x:0 0 0 2023-12-08T20:27:51.007 INFO:tasks.workunit.client.1.smithi111.stdout:7/233: truncate da/d25/d26/f37 218574 0 2023-12-08T20:27:51.007 INFO:tasks.workunit.client.1.smithi111.stdout:7/234: fsync da/d13/f2c 0 2023-12-08T20:27:51.008 INFO:tasks.workunit.client.1.smithi111.stdout:7/235: creat da/d25/f4a x:0 0 0 2023-12-08T20:27:51.009 INFO:tasks.workunit.client.1.smithi111.stdout:7/236: read da/f1e [3084281,103383] 0 2023-12-08T20:27:51.010 INFO:tasks.workunit.client.1.smithi111.stdout:1/358: dwrite d0/d6/d33/d15/d51/d5b/f54 [0,4194304] 0 2023-12-08T20:27:51.010 INFO:tasks.workunit.client.1.smithi111.stdout:7/237: creat da/d25/d26/d3c/f4b x:0 0 0 2023-12-08T20:27:51.011 INFO:tasks.workunit.client.1.smithi111.stdout:1/359: write d0/d6/d47/f53 [4076678,54500] 0 2023-12-08T20:27:51.011 INFO:tasks.workunit.client.1.smithi111.stdout:1/360: write d0/d6/d47/f67 [894242,84818] 0 2023-12-08T20:27:51.013 INFO:tasks.workunit.client.1.smithi111.stdout:7/238: write da/d25/f2e [3427063,43754] 0 2023-12-08T20:27:51.016 INFO:tasks.workunit.client.1.smithi111.stdout:1/361: link d0/d6/d33/d15/d51/d2e/l5a d0/l81 0 2023-12-08T20:27:51.017 INFO:tasks.workunit.client.1.smithi111.stdout:7/239: creat da/d13/f4c x:0 0 0 2023-12-08T20:27:51.018 INFO:tasks.workunit.client.1.smithi111.stdout:1/362: creat d0/d6/d34/f82 x:0 0 0 2023-12-08T20:27:51.020 INFO:tasks.workunit.client.1.smithi111.stdout:7/240: truncate da/d25/d26/f37 1162682 0 2023-12-08T20:27:51.021 INFO:tasks.workunit.client.1.smithi111.stdout:1/363: symlink d0/d6/d33/d60/l83 0 2023-12-08T20:27:51.022 INFO:tasks.workunit.client.1.smithi111.stdout:3/291: dwrite d2/d3/d6/fd [8388608,4194304] 0 2023-12-08T20:27:51.022 INFO:tasks.workunit.client.1.smithi111.stdout:1/364: write d0/f31 [4424126,76249] 0 2023-12-08T20:27:51.024 INFO:tasks.workunit.client.1.smithi111.stdout:7/241: rename f5 to da/d25/d26/f4d 0 2023-12-08T20:27:51.031 INFO:tasks.workunit.client.1.smithi111.stdout:1/365: dread d0/f17 [0,4194304] 0 2023-12-08T20:27:51.032 INFO:tasks.workunit.client.1.smithi111.stdout:7/242: getdents da/d25/d26 0 2023-12-08T20:27:51.034 INFO:tasks.workunit.client.1.smithi111.stdout:1/366: creat d0/d6/d33/d15/d51/d2e/d61/d79/f84 x:0 0 0 2023-12-08T20:27:51.035 INFO:tasks.workunit.client.1.smithi111.stdout:7/243: mknod da/d25/d3d/c4e 0 2023-12-08T20:27:51.035 INFO:tasks.workunit.client.1.smithi111.stdout:7/244: rename da to da/d25/d3d/d4f 22 2023-12-08T20:27:51.035 INFO:tasks.workunit.client.1.smithi111.stdout:7/245: fsync da/d25/d26/d3c/f4b 0 2023-12-08T20:27:51.036 INFO:tasks.workunit.client.1.smithi111.stdout:7/246: creat da/d13/d21/f50 x:0 0 0 2023-12-08T20:27:51.036 INFO:tasks.workunit.client.1.smithi111.stdout:3/292: dwrite d2/fa [0,4194304] 0 2023-12-08T20:27:51.039 INFO:tasks.workunit.client.1.smithi111.stdout:7/247: creat da/d25/d3d/f51 x:0 0 0 2023-12-08T20:27:51.045 INFO:tasks.workunit.client.1.smithi111.stdout:1/367: truncate d0/f31 8009154 0 2023-12-08T20:27:51.048 INFO:tasks.workunit.client.1.smithi111.stdout:7/248: rename da/d13/f2c to da/d13/d21/d2d/f52 0 2023-12-08T20:27:51.049 INFO:tasks.workunit.client.1.smithi111.stdout:1/368: creat d0/d6/d33/d60/f85 x:0 0 0 2023-12-08T20:27:51.050 INFO:tasks.workunit.client.1.smithi111.stdout:3/293: symlink d2/d3/d13/l5a 0 2023-12-08T20:27:51.051 INFO:tasks.workunit.client.1.smithi111.stdout:3/294: truncate d2/d3/fb 4553306 0 2023-12-08T20:27:51.064 INFO:tasks.workunit.client.1.smithi111.stdout:1/369: dread d0/f31 [4194304,4194304] 0 2023-12-08T20:27:51.065 INFO:tasks.workunit.client.1.smithi111.stdout:1/370: mkdir d0/d6/d33/d15/d51/d5b/d5e/d86 0 2023-12-08T20:27:51.065 INFO:tasks.workunit.client.1.smithi111.stdout:1/371: chown d0/d6/d33/d60 4079348 1 2023-12-08T20:27:51.065 INFO:tasks.workunit.client.1.smithi111.stdout:1/372: chown d0/f2f 5702 1 2023-12-08T20:27:51.068 INFO:tasks.workunit.client.1.smithi111.stdout:1/373: dread d0/d6/d33/d15/f30 [0,4194304] 0 2023-12-08T20:27:51.068 INFO:tasks.workunit.client.1.smithi111.stdout:1/374: truncate d0/d6/d34/f52 1979265 0 2023-12-08T20:27:51.068 INFO:tasks.workunit.client.1.smithi111.stdout:1/375: write d0/d6/d33/d15/d51/f21 [1660672,31154] 0 2023-12-08T20:27:51.070 INFO:tasks.workunit.client.1.smithi111.stdout:1/376: mknod d0/d6/d33/d15/d51/d5b/d5e/d86/c87 0 2023-12-08T20:27:51.070 INFO:tasks.workunit.client.1.smithi111.stdout:1/377: truncate d0/d22/f45 482985 0 2023-12-08T20:27:51.070 INFO:tasks.workunit.client.1.smithi111.stdout:1/378: chown d0/d6/d47/f50 2066342463 1 2023-12-08T20:27:51.071 INFO:tasks.workunit.client.1.smithi111.stdout:1/379: mknod d0/d6/d33/d15/c88 0 2023-12-08T20:27:51.073 INFO:tasks.workunit.client.1.smithi111.stdout:3/295: dwrite d2/d15/d17/f35 [0,4194304] 0 2023-12-08T20:27:51.078 INFO:tasks.workunit.client.1.smithi111.stdout:7/249: dwrite f6 [4194304,4194304] 0 2023-12-08T20:27:51.078 INFO:tasks.workunit.client.1.smithi111.stdout:7/250: dread - da/f40 zero size 2023-12-08T20:27:51.078 INFO:tasks.workunit.client.1.smithi111.stdout:7/251: dread - da/d13/f49 zero size 2023-12-08T20:27:51.080 INFO:tasks.workunit.client.1.smithi111.stdout:7/252: symlink da/d25/d26/d32/d3e/l53 0 2023-12-08T20:27:51.081 INFO:tasks.workunit.client.1.smithi111.stdout:7/253: creat da/f54 x:0 0 0 2023-12-08T20:27:51.083 INFO:tasks.workunit.client.1.smithi111.stdout:7/254: symlink da/d25/d26/d3c/l55 0 2023-12-08T20:27:51.083 INFO:tasks.workunit.client.1.smithi111.stdout:1/380: dread d0/d6/f10 [4194304,4194304] 0 2023-12-08T20:27:51.083 INFO:tasks.workunit.client.1.smithi111.stdout:1/381: dread - d0/d6/d34/f82 zero size 2023-12-08T20:27:51.085 INFO:tasks.workunit.client.1.smithi111.stdout:1/382: mkdir d0/d6/d33/d6c/d75/d89 0 2023-12-08T20:27:51.092 INFO:tasks.workunit.client.1.smithi111.stdout:1/383: write d0/d6/d33/d15/d51/f21 [1837414,74392] 0 2023-12-08T20:27:51.093 INFO:tasks.workunit.client.1.smithi111.stdout:1/384: read d0/d22/f23 [1622431,50950] 0 2023-12-08T20:27:51.094 INFO:tasks.workunit.client.1.smithi111.stdout:1/385: symlink d0/d6/d33/d6c/d75/l8a 0 2023-12-08T20:27:51.095 INFO:tasks.workunit.client.1.smithi111.stdout:3/296: dwrite d2/d12/f1a [0,4194304] 0 2023-12-08T20:27:51.095 INFO:tasks.workunit.client.1.smithi111.stdout:6/238: sync 2023-12-08T20:27:51.096 INFO:tasks.workunit.client.1.smithi111.stdout:6/239: chown d0/d1/d27/d36/l43 209 1 2023-12-08T20:27:51.097 INFO:tasks.workunit.client.1.smithi111.stdout:3/297: rename d2/d3/d13/c46 to d2/d12/d4a/c5b 0 2023-12-08T20:27:51.097 INFO:tasks.workunit.client.1.smithi111.stdout:6/240: rename d0/d1 to d0/d1/d27/d36/d46 22 2023-12-08T20:27:51.097 INFO:tasks.workunit.client.1.smithi111.stdout:6/241: chown d0/d1/d1e/l24 38288 1 2023-12-08T20:27:51.098 INFO:tasks.workunit.client.1.smithi111.stdout:3/298: creat d2/d15/d17/f5c x:0 0 0 2023-12-08T20:27:51.099 INFO:tasks.workunit.client.1.smithi111.stdout:6/242: dread d0/d1a/f2a [0,4194304] 0 2023-12-08T20:27:51.099 INFO:tasks.workunit.client.1.smithi111.stdout:6/243: chown d0/d1/f6 27 1 2023-12-08T20:27:51.099 INFO:tasks.workunit.client.1.smithi111.stdout:3/299: mkdir d2/d12/d4a/d5d 0 2023-12-08T20:27:51.101 INFO:tasks.workunit.client.1.smithi111.stdout:6/244: creat d0/d1b/f47 x:0 0 0 2023-12-08T20:27:51.103 INFO:tasks.workunit.client.1.smithi111.stdout:6/245: mknod d0/d1/d27/d36/c48 0 2023-12-08T20:27:51.106 INFO:tasks.workunit.client.1.smithi111.stdout:6/246: rename d0/d1a/f41 to d0/d1b/f49 0 2023-12-08T20:27:51.106 INFO:tasks.workunit.client.1.smithi111.stdout:7/255: dwrite da/d25/d26/f41 [0,4194304] 0 2023-12-08T20:27:51.106 INFO:tasks.workunit.client.1.smithi111.stdout:7/256: truncate da/d13/f4c 730197 0 2023-12-08T20:27:51.109 INFO:tasks.workunit.client.1.smithi111.stdout:3/300: dread f1 [0,4194304] 0 2023-12-08T20:27:51.109 INFO:tasks.workunit.client.1.smithi111.stdout:6/247: creat d0/f4a x:0 0 0 2023-12-08T20:27:51.109 INFO:tasks.workunit.client.1.smithi111.stdout:6/248: truncate d0/d1/d27/f2d 1528273 0 2023-12-08T20:27:51.110 INFO:tasks.workunit.client.1.smithi111.stdout:6/249: symlink d0/d1/d27/d36/l4b 0 2023-12-08T20:27:51.111 INFO:tasks.workunit.client.1.smithi111.stdout:1/386: dwrite d0/d6/d33/d15/d51/d2e/f5c [4194304,4194304] 0 2023-12-08T20:27:51.114 INFO:tasks.workunit.client.1.smithi111.stdout:1/387: dread d0/f2f [0,4194304] 0 2023-12-08T20:27:51.122 INFO:tasks.workunit.client.1.smithi111.stdout:1/388: mkdir d0/d6/d33/d8b 0 2023-12-08T20:27:51.122 INFO:tasks.workunit.client.1.smithi111.stdout:1/389: fdatasync d0/d6/d33/d15/d51/d78/f7c 0 2023-12-08T20:27:51.128 INFO:tasks.workunit.client.1.smithi111.stdout:1/390: dread d0/d6/d33/d15/d51/d2e/f5c [0,4194304] 0 2023-12-08T20:27:51.129 INFO:tasks.workunit.client.1.smithi111.stdout:1/391: creat d0/d4d/f8c x:0 0 0 2023-12-08T20:27:51.129 INFO:tasks.workunit.client.1.smithi111.stdout:1/392: fsync d0/d6/d33/f64 0 2023-12-08T20:27:51.130 INFO:tasks.workunit.client.1.smithi111.stdout:1/393: link d0/d6/d47/f67 d0/d6/d33/d15/f8d 0 2023-12-08T20:27:51.130 INFO:tasks.workunit.client.1.smithi111.stdout:3/301: dwrite d2/d12/f4b [0,4194304] 0 2023-12-08T20:27:51.131 INFO:tasks.workunit.client.1.smithi111.stdout:7/257: dwrite da/d13/f1a [0,4194304] 0 2023-12-08T20:27:51.136 INFO:tasks.workunit.client.1.smithi111.stdout:3/302: mkdir d2/d15/d17/d5e 0 2023-12-08T20:27:51.137 INFO:tasks.workunit.client.1.smithi111.stdout:3/303: fsync d2/d12/f4b 0 2023-12-08T20:27:51.137 INFO:tasks.workunit.client.1.smithi111.stdout:3/304: symlink d2/d3/d1e/l5f 0 2023-12-08T20:27:51.142 INFO:tasks.workunit.client.1.smithi111.stdout:3/305: rename d2/f9 to d2/d15/f60 0 2023-12-08T20:27:51.143 INFO:tasks.workunit.client.1.smithi111.stdout:3/306: chown d2/d12/d2e/c37 0 1 2023-12-08T20:27:51.143 INFO:tasks.workunit.client.1.smithi111.stdout:1/394: rmdir d0/d6/d33 39 2023-12-08T20:27:51.143 INFO:tasks.workunit.client.1.smithi111.stdout:1/395: mkdir d0/d8e 0 2023-12-08T20:27:51.144 INFO:tasks.workunit.client.1.smithi111.stdout:7/258: dwrite da/d25/d26/f2b [0,4194304] 0 2023-12-08T20:27:51.144 INFO:tasks.workunit.client.1.smithi111.stdout:1/396: rename d0/d6/d33/d6c/d75/c7b to d0/c8f 0 2023-12-08T20:27:51.144 INFO:tasks.workunit.client.1.smithi111.stdout:1/397: truncate d0/d6/d34/f82 884600 0 2023-12-08T20:27:51.144 INFO:tasks.workunit.client.1.smithi111.stdout:3/307: write d2/d15/d17/f35 [1686849,45139] 0 2023-12-08T20:27:51.145 INFO:tasks.workunit.client.1.smithi111.stdout:7/259: creat da/d25/d26/d32/f56 x:0 0 0 2023-12-08T20:27:51.146 INFO:tasks.workunit.client.1.smithi111.stdout:1/398: unlink d0/d6/d33/d15/d51/d5b/c62 0 2023-12-08T20:27:51.146 INFO:tasks.workunit.client.1.smithi111.stdout:1/399: write d0/d22/f45 [1170765,54159] 0 2023-12-08T20:27:51.146 INFO:tasks.workunit.client.1.smithi111.stdout:3/308: creat d2/d15/d17/d25/d4e/f61 x:0 0 0 2023-12-08T20:27:51.147 INFO:tasks.workunit.client.1.smithi111.stdout:7/260: creat da/d25/d26/d32/f57 x:0 0 0 2023-12-08T20:27:51.147 INFO:tasks.workunit.client.1.smithi111.stdout:1/400: creat d0/d6/d33/d15/d51/d2e/d61/d79/f90 x:0 0 0 2023-12-08T20:27:51.148 INFO:tasks.workunit.client.1.smithi111.stdout:3/309: mkdir d2/d15/d17/d5e/d62 0 2023-12-08T20:27:51.149 INFO:tasks.workunit.client.1.smithi111.stdout:7/261: mkdir da/d25/d3d/d58 0 2023-12-08T20:27:51.155 INFO:tasks.workunit.client.1.smithi111.stdout:7/262: write da/f1e [1285825,130068] 0 2023-12-08T20:27:51.157 INFO:tasks.workunit.client.1.smithi111.stdout:7/263: mkdir da/d13/d21/d2d/d59 0 2023-12-08T20:27:51.157 INFO:tasks.workunit.client.1.smithi111.stdout:7/264: chown da/d13/c24 471744 1 2023-12-08T20:27:51.157 INFO:tasks.workunit.client.1.smithi111.stdout:7/265: chown da/d38 156 1 2023-12-08T20:27:51.159 INFO:tasks.workunit.client.1.smithi111.stdout:1/401: dwrite d0/d6/d33/d15/d51/d2e/d61/d79/f84 [0,4194304] 0 2023-12-08T20:27:51.164 INFO:tasks.workunit.client.1.smithi111.stdout:1/402: unlink d0/d6/d47/f67 0 2023-12-08T20:27:51.165 INFO:tasks.workunit.client.1.smithi111.stdout:3/310: rmdir d2/d15 39 2023-12-08T20:27:51.166 INFO:tasks.workunit.client.1.smithi111.stdout:3/311: read d2/d3/d6/f3a [338430,108886] 0 2023-12-08T20:27:51.166 INFO:tasks.workunit.client.1.smithi111.stdout:3/312: chown d2/d12 18606 1 2023-12-08T20:27:51.167 INFO:tasks.workunit.client.1.smithi111.stdout:3/313: symlink d2/d15/d17/d5e/l63 0 2023-12-08T20:27:51.174 INFO:tasks.workunit.client.1.smithi111.stdout:3/314: mknod d2/d3/c64 0 2023-12-08T20:27:51.174 INFO:tasks.workunit.client.1.smithi111.stdout:7/266: dwrite da/d25/d26/f41 [0,4194304] 0 2023-12-08T20:27:51.186 INFO:tasks.workunit.client.1.smithi111.stdout:1/403: dwrite d0/d6/d33/d15/d51/f21 [0,4194304] 0 2023-12-08T20:27:51.186 INFO:tasks.workunit.client.1.smithi111.stdout:2/362: sync 2023-12-08T20:27:51.186 INFO:tasks.workunit.client.1.smithi111.stdout:8/361: sync 2023-12-08T20:27:51.186 INFO:tasks.workunit.client.1.smithi111.stdout:0/422: sync 2023-12-08T20:27:51.187 INFO:tasks.workunit.client.1.smithi111.stdout:0/423: readlink d1/d4/d3a/l74 0 2023-12-08T20:27:51.187 INFO:tasks.workunit.client.1.smithi111.stdout:0/424: fdatasync d1/df/d16/d2c/d7b/f87 0 2023-12-08T20:27:51.187 INFO:tasks.workunit.client.1.smithi111.stdout:0/425: fdatasync d1/d4/f55 0 2023-12-08T20:27:51.187 INFO:tasks.workunit.client.1.smithi111.stdout:1/404: fsync d0/d6/d33/d15/d51/f21 0 2023-12-08T20:27:51.187 INFO:tasks.workunit.client.1.smithi111.stdout:2/363: symlink d1/d1d/d22/l86 0 2023-12-08T20:27:51.191 INFO:tasks.workunit.client.1.smithi111.stdout:3/315: dwrite d2/d3/d13/d36/f3e [0,4194304] 0 2023-12-08T20:27:51.192 INFO:tasks.workunit.client.1.smithi111.stdout:8/362: creat dd/d35/d7a/f7f x:0 0 0 2023-12-08T20:27:51.192 INFO:tasks.workunit.client.1.smithi111.stdout:8/363: truncate dd/d2d/f3a 701576 0 2023-12-08T20:27:51.192 INFO:tasks.workunit.client.1.smithi111.stdout:0/426: rename d1/d4/c5e to d1/d4/d24/d2f/c8e 0 2023-12-08T20:27:51.192 INFO:tasks.workunit.client.1.smithi111.stdout:0/427: dread - d1/dd/d4a/f84 zero size 2023-12-08T20:27:51.194 INFO:tasks.workunit.client.1.smithi111.stdout:0/428: dread d1/df/d16/f53 [0,4194304] 0 2023-12-08T20:27:51.195 INFO:tasks.workunit.client.1.smithi111.stdout:2/364: dread d1/d1d/d55/d58/f61 [0,4194304] 0 2023-12-08T20:27:51.195 INFO:tasks.workunit.client.1.smithi111.stdout:2/365: fsync d1/d29/d53/f7b 0 2023-12-08T20:27:51.196 INFO:tasks.workunit.client.1.smithi111.stdout:2/366: read - d1/d1d/d55/f83 zero size 2023-12-08T20:27:51.197 INFO:tasks.workunit.client.1.smithi111.stdout:3/316: rename d2/d15/d17/f21 to d2/d12/f65 0 2023-12-08T20:27:51.198 INFO:tasks.workunit.client.1.smithi111.stdout:2/367: dread d1/d1d/d55/d58/f61 [0,4194304] 0 2023-12-08T20:27:51.198 INFO:tasks.workunit.client.1.smithi111.stdout:0/429: symlink d1/df/d44/d37/d5c/l8f 0 2023-12-08T20:27:51.198 INFO:tasks.workunit.client.1.smithi111.stdout:0/430: write d1/dd/d47/f5d [1974200,88827] 0 2023-12-08T20:27:51.199 INFO:tasks.workunit.client.1.smithi111.stdout:3/317: read d2/ff [257346,121460] 0 2023-12-08T20:27:51.199 INFO:tasks.workunit.client.1.smithi111.stdout:8/364: rename dd/d2d/l67 to dd/d35/d7a/l80 0 2023-12-08T20:27:51.200 INFO:tasks.workunit.client.1.smithi111.stdout:0/431: symlink d1/d4/d3a/d8c/l90 0 2023-12-08T20:27:51.202 INFO:tasks.workunit.client.1.smithi111.stdout:0/432: truncate d1/df/d16/f86 628136 0 2023-12-08T20:27:51.202 INFO:tasks.workunit.client.1.smithi111.stdout:3/318: creat d2/d3/d13/d36/d47/f66 x:0 0 0 2023-12-08T20:27:51.204 INFO:tasks.workunit.client.1.smithi111.stdout:8/365: truncate dd/d35/f43 93855 0 2023-12-08T20:27:51.206 INFO:tasks.workunit.client.1.smithi111.stdout:0/433: creat d1/dd/d47/f91 x:0 0 0 2023-12-08T20:27:51.211 INFO:tasks.workunit.client.1.smithi111.stdout:8/366: mknod dd/d35/d7a/c81 0 2023-12-08T20:27:51.211 INFO:tasks.workunit.client.1.smithi111.stdout:8/367: creat dd/d32/d3d/d55/f82 x:0 0 0 2023-12-08T20:27:51.211 INFO:tasks.workunit.client.1.smithi111.stdout:8/368: write dd/f29 [1262241,32441] 0 2023-12-08T20:27:51.211 INFO:tasks.workunit.client.1.smithi111.stdout:8/369: mkdir dd/d2d/d62/d83 0 2023-12-08T20:27:51.211 INFO:tasks.workunit.client.1.smithi111.stdout:8/370: truncate dd/d32/d3d/f5b 268499 0 2023-12-08T20:27:51.211 INFO:tasks.workunit.client.1.smithi111.stdout:8/371: stat dd/d32/d36/c79 0 2023-12-08T20:27:51.212 INFO:tasks.workunit.client.1.smithi111.stdout:1/405: dwrite d0/d6/d33/d15/d51/d5b/f54 [0,4194304] 0 2023-12-08T20:27:51.216 INFO:tasks.workunit.client.1.smithi111.stdout:8/372: dread dd/d32/f3e [0,4194304] 0 2023-12-08T20:27:51.216 INFO:tasks.workunit.client.1.smithi111.stdout:8/373: fsync dd/d35/d42/f47 0 2023-12-08T20:27:51.216 INFO:tasks.workunit.client.1.smithi111.stdout:8/374: fsync dd/f2b 0 2023-12-08T20:27:51.216 INFO:tasks.workunit.client.1.smithi111.stdout:8/375: truncate dd/d32/d3d/f7c 620725 0 2023-12-08T20:27:51.219 INFO:tasks.workunit.client.1.smithi111.stdout:2/368: dwrite d1/d1d/f26 [0,4194304] 0 2023-12-08T20:27:51.219 INFO:tasks.workunit.client.1.smithi111.stdout:2/369: chown d1/d1d/d1f/d25/d3d/d56/l5e 9841335 1 2023-12-08T20:27:51.224 INFO:tasks.workunit.client.1.smithi111.stdout:2/370: symlink d1/d1d/d1f/d25/l87 0 2023-12-08T20:27:51.226 INFO:tasks.workunit.client.1.smithi111.stdout:2/371: mknod d1/d1d/d55/d58/c88 0 2023-12-08T20:27:51.228 INFO:tasks.workunit.client.1.smithi111.stdout:2/372: creat d1/d1d/d22/f89 x:0 0 0 2023-12-08T20:27:51.231 INFO:tasks.workunit.client.1.smithi111.stdout:1/406: dwrite d0/d6/f10 [0,4194304] 0 2023-12-08T20:27:51.239 INFO:tasks.workunit.client.1.smithi111.stdout:2/373: dread d1/d29/d53/f23 [0,4194304] 0 2023-12-08T20:27:51.240 INFO:tasks.workunit.client.1.smithi111.stdout:2/374: creat d1/d1d/d1f/d25/d3d/d56/f8a x:0 0 0 2023-12-08T20:27:51.241 INFO:tasks.workunit.client.1.smithi111.stdout:2/375: creat d1/d1d/d1f/d25/d3d/d41/f8b x:0 0 0 2023-12-08T20:27:51.242 INFO:tasks.workunit.client.1.smithi111.stdout:8/376: dwrite dd/d32/d36/f7d [0,4194304] 0 2023-12-08T20:27:51.245 INFO:tasks.workunit.client.1.smithi111.stdout:2/376: write d1/d1d/f33 [7493985,25634] 0 2023-12-08T20:27:51.245 INFO:tasks.workunit.client.1.smithi111.stdout:2/377: read - d1/d29/d53/f85 zero size 2023-12-08T20:27:51.246 INFO:tasks.workunit.client.1.smithi111.stdout:0/434: dwrite d1/df/d16/d2c/d7b/f87 [0,4194304] 0 2023-12-08T20:27:51.249 INFO:tasks.workunit.client.1.smithi111.stdout:0/435: write d1/d4/d24/d46/d58/f6d [43118,96174] 0 2023-12-08T20:27:51.249 INFO:tasks.workunit.client.1.smithi111.stdout:0/436: truncate d1/d4/d24/f6b 36539 0 2023-12-08T20:27:51.249 INFO:tasks.workunit.client.1.smithi111.stdout:1/407: dwrite d0/d6/d33/d15/d51/d2e/f5c [4194304,4194304] 0 2023-12-08T20:27:51.252 INFO:tasks.workunit.client.1.smithi111.stdout:0/437: write d1/d4/f35 [4344360,104007] 0 2023-12-08T20:27:51.252 INFO:tasks.workunit.client.1.smithi111.stdout:1/408: mknod d0/d6/d33/d60/c91 0 2023-12-08T20:27:51.252 INFO:tasks.workunit.client.1.smithi111.stdout:1/409: write d0/d6/d33/d15/d51/f6e [940181,29462] 0 2023-12-08T20:27:51.252 INFO:tasks.workunit.client.1.smithi111.stdout:1/410: write d0/d6/d33/d15/d51/d78/f80 [848454,39721] 0 2023-12-08T20:27:51.253 INFO:tasks.workunit.client.1.smithi111.stdout:1/411: mknod d0/d8e/c92 0 2023-12-08T20:27:51.256 INFO:tasks.workunit.client.1.smithi111.stdout:1/412: creat d0/d6/d33/d15/d51/d2e/d61/f93 x:0 0 0 2023-12-08T20:27:51.263 INFO:tasks.workunit.client.1.smithi111.stdout:1/413: write d0/d6/f10 [4022512,46981] 0 2023-12-08T20:27:51.263 INFO:tasks.workunit.client.1.smithi111.stdout:1/414: dread - d0/d6/d33/d60/f85 zero size 2023-12-08T20:27:51.264 INFO:tasks.workunit.client.1.smithi111.stdout:8/377: dwrite dd/d32/d3d/f44 [0,4194304] 0 2023-12-08T20:27:51.268 INFO:tasks.workunit.client.1.smithi111.stdout:8/378: rmdir dd/d32/d3d 39 2023-12-08T20:27:51.268 INFO:tasks.workunit.client.1.smithi111.stdout:2/378: dwrite d1/d1d/d55/f72 [0,4194304] 0 2023-12-08T20:27:51.270 INFO:tasks.workunit.client.1.smithi111.stdout:8/379: mknod dd/d32/d3d/d55/c84 0 2023-12-08T20:27:51.271 INFO:tasks.workunit.client.1.smithi111.stdout:2/379: mknod d1/d29/d53/c8c 0 2023-12-08T20:27:51.274 INFO:tasks.workunit.client.1.smithi111.stdout:8/380: creat dd/d32/d3d/f85 x:0 0 0 2023-12-08T20:27:51.275 INFO:tasks.workunit.client.1.smithi111.stdout:2/380: truncate d1/d29/d53/f5a 5229042 0 2023-12-08T20:27:51.276 INFO:tasks.workunit.client.1.smithi111.stdout:8/381: mknod dd/d35/d7a/c86 0 2023-12-08T20:27:51.276 INFO:tasks.workunit.client.1.smithi111.stdout:0/438: dwrite d1/dd/f11 [0,4194304] 0 2023-12-08T20:27:51.276 INFO:tasks.workunit.client.1.smithi111.stdout:0/439: write d1/d4/d24/f6b [391012,5810] 0 2023-12-08T20:27:51.276 INFO:tasks.workunit.client.1.smithi111.stdout:0/440: fdatasync d1/df/d56/f7a 0 2023-12-08T20:27:51.276 INFO:tasks.workunit.client.1.smithi111.stdout:0/441: rename d1/d4/d24/d46/d58/d65 to d1/d4/d24/d46/d58/d65/d92 22 2023-12-08T20:27:51.276 INFO:tasks.workunit.client.1.smithi111.stdout:2/381: mknod d1/d1d/d22/d30/c8d 0 2023-12-08T20:27:51.278 INFO:tasks.workunit.client.1.smithi111.stdout:1/415: dwrite d0/f2d [0,4194304] 0 2023-12-08T20:27:51.278 INFO:tasks.workunit.client.1.smithi111.stdout:8/382: unlink dd/d32/d3d/d55/c84 0 2023-12-08T20:27:51.279 INFO:tasks.workunit.client.1.smithi111.stdout:0/442: read d1/d4/d24/d46/d58/f6d [2605324,20828] 0 2023-12-08T20:27:51.286 INFO:tasks.workunit.client.1.smithi111.stdout:2/382: symlink d1/d29/d4e/l8e 0 2023-12-08T20:27:51.290 INFO:tasks.workunit.client.1.smithi111.stdout:1/416: mknod d0/d6/d33/c94 0 2023-12-08T20:27:51.290 INFO:tasks.workunit.client.1.smithi111.stdout:1/417: write d0/d6/d33/d15/d51/d2e/d61/f93 [35550,111500] 0 2023-12-08T20:27:51.291 INFO:tasks.workunit.client.1.smithi111.stdout:8/383: link dd/d35/c60 dd/d2d/d62/d83/c87 0 2023-12-08T20:27:51.292 INFO:tasks.workunit.client.1.smithi111.stdout:0/443: mknod d1/d4/d24/d46/d58/c93 0 2023-12-08T20:27:51.293 INFO:tasks.workunit.client.1.smithi111.stdout:2/383: truncate d1/d1d/d22/f2c 1307278 0 2023-12-08T20:27:51.293 INFO:tasks.workunit.client.1.smithi111.stdout:2/384: chown d1/c1c 364131 1 2023-12-08T20:27:51.295 INFO:tasks.workunit.client.1.smithi111.stdout:1/418: creat d0/d6/d33/d15/d51/d78/f95 x:0 0 0 2023-12-08T20:27:51.296 INFO:tasks.workunit.client.1.smithi111.stdout:8/384: unlink dd/d35/d42/l77 0 2023-12-08T20:27:51.297 INFO:tasks.workunit.client.1.smithi111.stdout:8/385: chown dd/d32/d36/d4b/c6c 9 1 2023-12-08T20:27:51.297 INFO:tasks.workunit.client.1.smithi111.stdout:8/386: stat dd/d32/f3e 0 2023-12-08T20:27:51.297 INFO:tasks.workunit.client.1.smithi111.stdout:0/444: creat d1/dd/d47/f94 x:0 0 0 2023-12-08T20:27:51.298 INFO:tasks.workunit.client.1.smithi111.stdout:0/445: write d1/df/d56/f63 [42250,113240] 0 2023-12-08T20:27:51.298 INFO:tasks.workunit.client.1.smithi111.stdout:2/385: symlink d1/d1d/d55/l8f 0 2023-12-08T20:27:51.300 INFO:tasks.workunit.client.1.smithi111.stdout:5/335: sync 2023-12-08T20:27:51.300 INFO:tasks.workunit.client.1.smithi111.stdout:9/431: sync 2023-12-08T20:27:51.301 INFO:tasks.workunit.client.1.smithi111.stdout:5/336: truncate d3/d4/f53 1017620 0 2023-12-08T20:27:51.301 INFO:tasks.workunit.client.1.smithi111.stdout:6/250: sync 2023-12-08T20:27:51.301 INFO:tasks.workunit.client.1.smithi111.stdout:4/280: sync 2023-12-08T20:27:51.302 INFO:tasks.workunit.client.1.smithi111.stdout:1/419: creat d0/d6/d34/f96 x:0 0 0 2023-12-08T20:27:51.303 INFO:tasks.workunit.client.1.smithi111.stdout:8/387: creat dd/d32/d3d/f88 x:0 0 0 2023-12-08T20:27:51.304 INFO:tasks.workunit.client.1.smithi111.stdout:8/388: truncate dd/d32/d3d/f5a 181058 0 2023-12-08T20:27:51.305 INFO:tasks.workunit.client.1.smithi111.stdout:0/446: mkdir d1/d4/d24/d46/d49/d7f/d95 0 2023-12-08T20:27:51.307 INFO:tasks.workunit.client.1.smithi111.stdout:9/432: creat d2/d8/dd/d1a/d1e/d2d/d35/d88/f99 x:0 0 0 2023-12-08T20:27:51.307 INFO:tasks.workunit.client.1.smithi111.stdout:5/337: dread d3/d12/f38 [0,4194304] 0 2023-12-08T20:27:51.308 INFO:tasks.workunit.client.1.smithi111.stdout:0/447: read d1/f57 [3104341,9625] 0 2023-12-08T20:27:51.309 INFO:tasks.workunit.client.1.smithi111.stdout:6/251: symlink d0/d1/d27/d36/l4c 0 2023-12-08T20:27:51.309 INFO:tasks.workunit.client.1.smithi111.stdout:6/252: chown d0/d1/l14 1581 1 2023-12-08T20:27:51.311 INFO:tasks.workunit.client.1.smithi111.stdout:4/281: mkdir d8/da/d29/d5c 0 2023-12-08T20:27:51.311 INFO:tasks.workunit.client.1.smithi111.stdout:1/420: stat d0/d6/d33/d15/f30 0 2023-12-08T20:27:51.312 INFO:tasks.workunit.client.1.smithi111.stdout:8/389: getdents dd 0 2023-12-08T20:27:51.317 INFO:tasks.workunit.client.1.smithi111.stdout:0/448: creat d1/d4/d3a/d8c/f96 x:0 0 0 2023-12-08T20:27:51.319 INFO:tasks.workunit.client.1.smithi111.stdout:4/282: symlink d8/da/db/d31/l5d 0 2023-12-08T20:27:51.320 INFO:tasks.workunit.client.1.smithi111.stdout:1/421: mknod d0/d6/d33/d60/c97 0 2023-12-08T20:27:51.321 INFO:tasks.workunit.client.1.smithi111.stdout:5/338: dread d3/d4/d7/f13 [0,4194304] 0 2023-12-08T20:27:51.322 INFO:tasks.workunit.client.1.smithi111.stdout:8/390: creat dd/d32/d3d/d55/f89 x:0 0 0 2023-12-08T20:27:51.322 INFO:tasks.workunit.client.1.smithi111.stdout:8/391: readlink dd/d32/d3d/l4d 0 2023-12-08T20:27:51.324 INFO:tasks.workunit.client.1.smithi111.stdout:4/283: getdents d8/da/d2c/d1f/d40 0 2023-12-08T20:27:51.324 INFO:tasks.workunit.client.1.smithi111.stdout:4/284: readlink d8/da/db/l28 0 2023-12-08T20:27:51.326 INFO:tasks.workunit.client.1.smithi111.stdout:1/422: creat d0/d6/d33/d15/f98 x:0 0 0 2023-12-08T20:27:51.328 INFO:tasks.workunit.client.1.smithi111.stdout:5/339: symlink d3/d4/d7/d36/l71 0 2023-12-08T20:27:51.329 INFO:tasks.workunit.client.1.smithi111.stdout:0/449: dread d1/df/f3b [0,4194304] 0 2023-12-08T20:27:51.329 INFO:tasks.workunit.client.1.smithi111.stdout:8/392: getdents dd/d2d 0 2023-12-08T20:27:51.330 INFO:tasks.workunit.client.1.smithi111.stdout:7/267: sync 2023-12-08T20:27:51.331 INFO:tasks.workunit.client.1.smithi111.stdout:3/319: sync 2023-12-08T20:27:51.331 INFO:tasks.workunit.client.1.smithi111.stdout:2/386: dwrite d1/d29/d4e/f4d [0,4194304] 0 2023-12-08T20:27:51.332 INFO:tasks.workunit.client.1.smithi111.stdout:6/253: dwrite d0/d1a/f31 [0,4194304] 0 2023-12-08T20:27:51.332 INFO:tasks.workunit.client.1.smithi111.stdout:9/433: dwrite d2/d8/dd/d1a/d1e/d2d/f51 [0,4194304] 0 2023-12-08T20:27:51.332 INFO:tasks.workunit.client.1.smithi111.stdout:2/387: write d1/d1d/d22/f76 [4026609,22643] 0 2023-12-08T20:27:51.334 INFO:tasks.workunit.client.1.smithi111.stdout:5/340: truncate d3/d4/d7/d36/f3d 2709776 0 2023-12-08T20:27:51.335 INFO:tasks.workunit.client.1.smithi111.stdout:0/450: getdents d1/d4/d24/d46/d49 0 2023-12-08T20:27:51.336 INFO:tasks.workunit.client.1.smithi111.stdout:0/451: fdatasync d1/df/d44/d37/d5c/d70/f81 0 2023-12-08T20:27:51.336 INFO:tasks.workunit.client.1.smithi111.stdout:0/452: fdatasync d1/d4/f73 0 2023-12-08T20:27:51.336 INFO:tasks.workunit.client.1.smithi111.stdout:0/453: dread - d1/df/d56/f7a zero size 2023-12-08T20:27:51.336 INFO:tasks.workunit.client.1.smithi111.stdout:0/454: write d1/d4/f55 [1357640,66834] 0 2023-12-08T20:27:51.336 INFO:tasks.workunit.client.1.smithi111.stdout:0/455: readlink d1/df/d16/l19 0 2023-12-08T20:27:51.337 INFO:tasks.workunit.client.1.smithi111.stdout:8/393: unlink dd/d32/d3d/d6b/c6e 0 2023-12-08T20:27:51.340 INFO:tasks.workunit.client.1.smithi111.stdout:7/268: mknod da/d13/c5a 0 2023-12-08T20:27:51.341 INFO:tasks.workunit.client.1.smithi111.stdout:7/269: chown da/d13/f4c 31322773 1 2023-12-08T20:27:51.341 INFO:tasks.workunit.client.1.smithi111.stdout:4/285: rmdir d8/da/db 39 2023-12-08T20:27:51.341 INFO:tasks.workunit.client.1.smithi111.stdout:7/270: dread da/d13/f4c [0,4194304] 0 2023-12-08T20:27:51.341 INFO:tasks.workunit.client.1.smithi111.stdout:3/320: symlink d2/d12/l67 0 2023-12-08T20:27:51.342 INFO:tasks.workunit.client.1.smithi111.stdout:3/321: stat d2/d3/c64 0 2023-12-08T20:27:51.342 INFO:tasks.workunit.client.1.smithi111.stdout:3/322: write d2/d3/d13/d36/d47/f66 [184281,47526] 0 2023-12-08T20:27:51.346 INFO:tasks.workunit.client.1.smithi111.stdout:1/423: link d0/d6/d33/d15/l76 d0/d6/d47/l99 0 2023-12-08T20:27:51.350 INFO:tasks.workunit.client.1.smithi111.stdout:5/341: symlink d3/d4/l72 0 2023-12-08T20:27:51.350 INFO:tasks.workunit.client.1.smithi111.stdout:0/456: creat d1/df/f97 x:0 0 0 2023-12-08T20:27:51.352 INFO:tasks.workunit.client.1.smithi111.stdout:8/394: symlink dd/d32/d3d/d55/l8a 0 2023-12-08T20:27:51.352 INFO:tasks.workunit.client.1.smithi111.stdout:8/395: read dd/d35/f43 [82167,18461] 0 2023-12-08T20:27:51.352 INFO:tasks.workunit.client.1.smithi111.stdout:8/396: fdatasync dd/d2d/f31 0 2023-12-08T20:27:51.353 INFO:tasks.workunit.client.1.smithi111.stdout:4/286: creat d8/da/d2c/f5e x:0 0 0 2023-12-08T20:27:51.355 INFO:tasks.workunit.client.1.smithi111.stdout:7/271: mknod da/d25/d26/d3c/c5b 0 2023-12-08T20:27:51.358 INFO:tasks.workunit.client.1.smithi111.stdout:3/323: rmdir d2/d3/d13/d36 39 2023-12-08T20:27:51.358 INFO:tasks.workunit.client.1.smithi111.stdout:3/324: dread - d2/d15/d17/f5c zero size 2023-12-08T20:27:51.362 INFO:tasks.workunit.client.1.smithi111.stdout:1/424: rename d0/d6/d33/d15/d51/d2e/d61/d79/f84 to d0/d6/d33/d6c/f9a 0 2023-12-08T20:27:51.363 INFO:tasks.workunit.client.1.smithi111.stdout:6/254: link d0/d1/c29 d0/c4d 0 2023-12-08T20:27:51.365 INFO:tasks.workunit.client.1.smithi111.stdout:0/457: symlink d1/d2d/d83/l98 0 2023-12-08T20:27:51.366 INFO:tasks.workunit.client.1.smithi111.stdout:8/397: mkdir dd/d2d/d8b 0 2023-12-08T20:27:51.366 INFO:tasks.workunit.client.1.smithi111.stdout:8/398: chown dd/d32/d3d/f88 31388296 1 2023-12-08T20:27:51.367 INFO:tasks.workunit.client.1.smithi111.stdout:7/272: truncate da/d13/f4c 573942 0 2023-12-08T20:27:51.367 INFO:tasks.workunit.client.1.smithi111.stdout:7/273: chown da/d25/d26 519892 1 2023-12-08T20:27:51.367 INFO:tasks.workunit.client.1.smithi111.stdout:7/274: chown da/d13 29 1 2023-12-08T20:27:51.367 INFO:tasks.workunit.client.1.smithi111.stdout:7/275: chown da/d25/d26/d32/c3f 635422820 1 2023-12-08T20:27:51.369 INFO:tasks.workunit.client.1.smithi111.stdout:3/325: creat d2/d15/d17/f68 x:0 0 0 2023-12-08T20:27:51.369 INFO:tasks.workunit.client.1.smithi111.stdout:3/326: readlink d2/d3/d13/d36/d44/l59 0 2023-12-08T20:27:51.369 INFO:tasks.workunit.client.1.smithi111.stdout:3/327: readlink d2/d3/l3d 0 2023-12-08T20:27:51.369 INFO:tasks.workunit.client.1.smithi111.stdout:6/255: symlink d0/d1/d27/d36/l4e 0 2023-12-08T20:27:51.370 INFO:tasks.workunit.client.1.smithi111.stdout:8/399: mkdir dd/d2d/d62/d8c 0 2023-12-08T20:27:51.372 INFO:tasks.workunit.client.1.smithi111.stdout:7/276: rename da/d13/d21/d2d to da/d5c 0 2023-12-08T20:27:51.372 INFO:tasks.workunit.client.1.smithi111.stdout:7/277: chown da/d25/d3d/c43 562955527 1 2023-12-08T20:27:51.374 INFO:tasks.workunit.client.1.smithi111.stdout:1/425: dread d0/d4d/f6f [0,4194304] 0 2023-12-08T20:27:51.374 INFO:tasks.workunit.client.1.smithi111.stdout:3/328: truncate d2/d15/d17/d25/f26 32291 0 2023-12-08T20:27:51.377 INFO:tasks.workunit.client.1.smithi111.stdout:6/256: dread d0/d1/f5 [0,4194304] 0 2023-12-08T20:27:51.377 INFO:tasks.workunit.client.1.smithi111.stdout:6/257: chown d0/d1/d27/d36/l4c 0 1 2023-12-08T20:27:51.378 INFO:tasks.workunit.client.1.smithi111.stdout:6/258: readlink d0/d1/l19 0 2023-12-08T20:27:51.378 INFO:tasks.workunit.client.1.smithi111.stdout:4/287: dwrite d8/da/d2c/d1f/d2b/f34 [0,4194304] 0 2023-12-08T20:27:51.378 INFO:tasks.workunit.client.1.smithi111.stdout:4/288: write d8/da/d2c/d1f/d40/f44 [1356598,91756] 0 2023-12-08T20:27:51.378 INFO:tasks.workunit.client.1.smithi111.stdout:3/329: unlink d2/ff 0 2023-12-08T20:27:51.379 INFO:tasks.workunit.client.1.smithi111.stdout:0/458: dread d1/dd/f4e [0,4194304] 0 2023-12-08T20:27:51.379 INFO:tasks.workunit.client.1.smithi111.stdout:5/342: dwrite d3/d4/d7/d2c/f5a [0,4194304] 0 2023-12-08T20:27:51.379 INFO:tasks.workunit.client.1.smithi111.stdout:0/459: chown d1/d4/d3a/d8c 190 1 2023-12-08T20:27:51.379 INFO:tasks.workunit.client.1.smithi111.stdout:5/343: fsync d3/d4/d7/d2c/f3e 0 2023-12-08T20:27:51.380 INFO:tasks.workunit.client.1.smithi111.stdout:1/426: creat d0/d22/f9b x:0 0 0 2023-12-08T20:27:51.380 INFO:tasks.workunit.client.1.smithi111.stdout:1/427: fsync d0/d6/d33/d15/d51/d2e/f5c 0 2023-12-08T20:27:51.389 INFO:tasks.workunit.client.1.smithi111.stdout:4/289: symlink d8/da/d2c/d1f/d2b/d4b/l5f 0 2023-12-08T20:27:51.390 INFO:tasks.workunit.client.1.smithi111.stdout:3/330: mkdir d2/d3/d13/d36/d69 0 2023-12-08T20:27:51.390 INFO:tasks.workunit.client.1.smithi111.stdout:3/331: dread - d2/d15/d17/d25/f58 zero size 2023-12-08T20:27:51.391 INFO:tasks.workunit.client.1.smithi111.stdout:1/428: dread d0/d6/d33/f64 [0,4194304] 0 2023-12-08T20:27:51.393 INFO:tasks.workunit.client.1.smithi111.stdout:4/290: dread d8/da/db/d31/f3f [0,4194304] 0 2023-12-08T20:27:51.393 INFO:tasks.workunit.client.1.smithi111.stdout:4/291: fdatasync d8/da/f25 0 2023-12-08T20:27:51.393 INFO:tasks.workunit.client.1.smithi111.stdout:4/292: getdents d8 0 2023-12-08T20:27:51.395 INFO:tasks.workunit.client.1.smithi111.stdout:3/332: creat d2/d12/d4a/d5d/f6a x:0 0 0 2023-12-08T20:27:51.396 INFO:tasks.workunit.client.1.smithi111.stdout:1/429: readlink d0/d6/d33/d15/l19 0 2023-12-08T20:27:51.399 INFO:tasks.workunit.client.1.smithi111.stdout:4/293: creat d8/da/d2c/d1f/d40/f60 x:0 0 0 2023-12-08T20:27:51.400 INFO:tasks.workunit.client.1.smithi111.stdout:8/400: dwrite dd/d32/d36/f7d [4194304,4194304] 0 2023-12-08T20:27:51.401 INFO:tasks.workunit.client.1.smithi111.stdout:3/333: creat d2/d3/d13/d36/d69/f6b x:0 0 0 2023-12-08T20:27:51.402 INFO:tasks.workunit.client.1.smithi111.stdout:1/430: link d0/d6/d33/d15/d51/d2e/l39 d0/d6/d33/d6c/d75/l9c 0 2023-12-08T20:27:51.405 INFO:tasks.workunit.client.1.smithi111.stdout:8/401: mkdir dd/d2d/d8b/d8d 0 2023-12-08T20:27:51.406 INFO:tasks.workunit.client.1.smithi111.stdout:8/402: write dd/f14 [8948372,80946] 0 2023-12-08T20:27:51.406 INFO:tasks.workunit.client.1.smithi111.stdout:3/334: rename d2/d3/d13/l5a to d2/d15/l6c 0 2023-12-08T20:27:51.406 INFO:tasks.workunit.client.1.smithi111.stdout:3/335: readlink d2/d15/d17/d5e/l63 0 2023-12-08T20:27:51.406 INFO:tasks.workunit.client.1.smithi111.stdout:6/259: dwrite d0/d1a/f31 [4194304,4194304] 0 2023-12-08T20:27:51.406 INFO:tasks.workunit.client.1.smithi111.stdout:6/260: readlink d0/d1/l39 0 2023-12-08T20:27:51.407 INFO:tasks.workunit.client.1.smithi111.stdout:3/336: creat d2/d12/d4a/f6d x:0 0 0 2023-12-08T20:27:51.408 INFO:tasks.workunit.client.1.smithi111.stdout:3/337: read d2/d12/f1a [2667446,25982] 0 2023-12-08T20:27:51.409 INFO:tasks.workunit.client.1.smithi111.stdout:8/403: rename dd/d32/d36/d50/l5c to dd/d2d/d62/d8c/l8e 0 2023-12-08T20:27:51.409 INFO:tasks.workunit.client.1.smithi111.stdout:8/404: fdatasync dd/d2d/f3a 0 2023-12-08T20:27:51.411 INFO:tasks.workunit.client.1.smithi111.stdout:1/431: dread d0/d6/d33/d15/d51/d5b/f54 [0,4194304] 0 2023-12-08T20:27:51.411 INFO:tasks.workunit.client.1.smithi111.stdout:1/432: readlink d0/d6/d33/l2b 0 2023-12-08T20:27:51.413 INFO:tasks.workunit.client.1.smithi111.stdout:6/261: creat d0/d1/d1e/f4f x:0 0 0 2023-12-08T20:27:51.413 INFO:tasks.workunit.client.1.smithi111.stdout:0/460: dwrite d1/d4/f73 [0,4194304] 0 2023-12-08T20:27:51.413 INFO:tasks.workunit.client.1.smithi111.stdout:5/344: dwrite d3/d4/d7/d29/f3b [0,4194304] 0 2023-12-08T20:27:51.413 INFO:tasks.workunit.client.1.smithi111.stdout:0/461: fsync d1/dd/d47/f91 0 2023-12-08T20:27:51.414 INFO:tasks.workunit.client.1.smithi111.stdout:4/294: dwrite d8/da/d2c/d1f/d40/f55 [0,4194304] 0 2023-12-08T20:27:51.414 INFO:tasks.workunit.client.1.smithi111.stdout:4/295: chown f1 893499914 1 2023-12-08T20:27:51.414 INFO:tasks.workunit.client.1.smithi111.stdout:3/338: unlink f1 0 2023-12-08T20:27:51.415 INFO:tasks.workunit.client.1.smithi111.stdout:3/339: chown d2/d15/d17/d25/f58 13103381 1 2023-12-08T20:27:51.416 INFO:tasks.workunit.client.1.smithi111.stdout:8/405: link dd/d2d/l56 dd/d32/d3d/d6b/l8f 0 2023-12-08T20:27:51.417 INFO:tasks.workunit.client.1.smithi111.stdout:1/433: creat d0/d6/d33/d60/f9d x:0 0 0 2023-12-08T20:27:51.420 INFO:tasks.workunit.client.1.smithi111.stdout:6/262: link d0/c23 d0/d1b/c50 0 2023-12-08T20:27:51.422 INFO:tasks.workunit.client.1.smithi111.stdout:0/462: rmdir d1/dd/d4a 39 2023-12-08T20:27:51.422 INFO:tasks.workunit.client.1.smithi111.stdout:0/463: stat d1/d2d/f41 0 2023-12-08T20:27:51.424 INFO:tasks.workunit.client.1.smithi111.stdout:3/340: dread d2/f34 [0,4194304] 0 2023-12-08T20:27:51.424 INFO:tasks.workunit.client.1.smithi111.stdout:3/341: dread - d2/d12/d4a/f6d zero size 2023-12-08T20:27:51.424 INFO:tasks.workunit.client.1.smithi111.stdout:3/342: fdatasync d2/d15/d17/d25/f58 0 2023-12-08T20:27:51.424 INFO:tasks.workunit.client.1.smithi111.stdout:5/345: mkdir d3/d4/d7/d29/d73 0 2023-12-08T20:27:51.432 INFO:tasks.workunit.client.1.smithi111.stdout:4/296: unlink d8/d30/l35 0 2023-12-08T20:27:51.434 INFO:tasks.workunit.client.1.smithi111.stdout:8/406: unlink dd/d35/d42/l5e 0 2023-12-08T20:27:51.435 INFO:tasks.workunit.client.1.smithi111.stdout:1/434: creat d0/d6/d33/d60/f9e x:0 0 0 2023-12-08T20:27:51.437 INFO:tasks.workunit.client.1.smithi111.stdout:6/263: truncate d0/d1/f11 228822 0 2023-12-08T20:27:51.438 INFO:tasks.workunit.client.1.smithi111.stdout:0/464: symlink d1/d4/d3a/l99 0 2023-12-08T20:27:51.438 INFO:tasks.workunit.client.1.smithi111.stdout:1/435: dread d0/d6/d33/d15/f30 [0,4194304] 0 2023-12-08T20:27:51.440 INFO:tasks.workunit.client.1.smithi111.stdout:3/343: rename d2/d3/l3d to d2/d15/d17/d5e/l6e 0 2023-12-08T20:27:51.442 INFO:tasks.workunit.client.1.smithi111.stdout:4/297: unlink d8/da/d2c/d1f/f2a 0 2023-12-08T20:27:51.443 INFO:tasks.workunit.client.1.smithi111.stdout:0/465: creat d1/d4/d24/d46/d58/d65/f9a x:0 0 0 2023-12-08T20:27:51.444 INFO:tasks.workunit.client.1.smithi111.stdout:1/436: creat d0/d6/d33/d15/d51/d5b/d5e/f9f x:0 0 0 2023-12-08T20:27:51.444 INFO:tasks.workunit.client.1.smithi111.stdout:1/437: truncate d0/d6/d34/f96 853605 0 2023-12-08T20:27:51.449 INFO:tasks.workunit.client.1.smithi111.stdout:5/346: rename d3/d4/l15 to d3/d6d/l74 0 2023-12-08T20:27:51.450 INFO:tasks.workunit.client.1.smithi111.stdout:3/344: rmdir d2/d3/d1e 39 2023-12-08T20:27:51.450 INFO:tasks.workunit.client.1.smithi111.stdout:3/345: fsync d2/d12/f65 0 2023-12-08T20:27:51.451 INFO:tasks.workunit.client.1.smithi111.stdout:4/298: dread f1 [0,4194304] 0 2023-12-08T20:27:51.452 INFO:tasks.workunit.client.1.smithi111.stdout:5/347: dread d3/d4/d4a/d21/f69 [0,4194304] 0 2023-12-08T20:27:51.453 INFO:tasks.workunit.client.1.smithi111.stdout:0/466: mkdir d1/d4/d24/d46/d49/d7f/d95/d9b 0 2023-12-08T20:27:51.454 INFO:tasks.workunit.client.1.smithi111.stdout:8/407: dwrite dd/f54 [0,4194304] 0 2023-12-08T20:27:51.456 INFO:tasks.workunit.client.1.smithi111.stdout:6/264: rename d0/d1/l17 to d0/d1/d27/l51 0 2023-12-08T20:27:51.458 INFO:tasks.workunit.client.1.smithi111.stdout:3/346: creat d2/d12/d4a/f6f x:0 0 0 2023-12-08T20:27:51.458 INFO:tasks.workunit.client.1.smithi111.stdout:3/347: dread - d2/d15/d17/f68 zero size 2023-12-08T20:27:51.458 INFO:tasks.workunit.client.1.smithi111.stdout:3/348: readlink d2/d15/l6c 0 2023-12-08T20:27:51.459 INFO:tasks.workunit.client.1.smithi111.stdout:6/265: dread d0/d1/d27/f2d [0,4194304] 0 2023-12-08T20:27:51.459 INFO:tasks.workunit.client.1.smithi111.stdout:6/266: chown d0/d1/c21 1 1 2023-12-08T20:27:51.459 INFO:tasks.workunit.client.1.smithi111.stdout:1/438: dwrite d0/d6/f10 [0,4194304] 0 2023-12-08T20:27:51.460 INFO:tasks.workunit.client.1.smithi111.stdout:5/348: unlink d3/d4/d7/d36/c39 0 2023-12-08T20:27:51.461 INFO:tasks.workunit.client.1.smithi111.stdout:0/467: creat d1/d69/d8b/f9c x:0 0 0 2023-12-08T20:27:51.461 INFO:tasks.workunit.client.1.smithi111.stdout:0/468: dread - d1/df/d44/d37/f8a zero size 2023-12-08T20:27:51.463 INFO:tasks.workunit.client.1.smithi111.stdout:8/408: creat dd/f90 x:0 0 0 2023-12-08T20:27:51.467 INFO:tasks.workunit.client.1.smithi111.stdout:3/349: rename d2/d3/d13/d36/d47 to d2/d3/d13/d36/d69/d70 0 2023-12-08T20:27:51.468 INFO:tasks.workunit.client.1.smithi111.stdout:1/439: mkdir d0/d6/d33/d15/d51/d5b/d5e/da0 0 2023-12-08T20:27:51.469 INFO:tasks.workunit.client.1.smithi111.stdout:0/469: dread d1/df/f3b [0,4194304] 0 2023-12-08T20:27:51.469 INFO:tasks.workunit.client.1.smithi111.stdout:0/470: truncate d1/d4/d24/d2f/f59 886848 0 2023-12-08T20:27:51.469 INFO:tasks.workunit.client.1.smithi111.stdout:0/471: read d1/d4/f38 [963988,40998] 0 2023-12-08T20:27:51.469 INFO:tasks.workunit.client.1.smithi111.stdout:5/349: creat d3/d6d/f75 x:0 0 0 2023-12-08T20:27:51.471 INFO:tasks.workunit.client.1.smithi111.stdout:5/350: read d3/d4/d7/d2c/f4c [177031,117318] 0 2023-12-08T20:27:51.471 INFO:tasks.workunit.client.1.smithi111.stdout:8/409: mknod dd/d32/d36/c91 0 2023-12-08T20:27:51.471 INFO:tasks.workunit.client.1.smithi111.stdout:8/410: dread - dd/d32/d3d/f88 zero size 2023-12-08T20:27:51.472 INFO:tasks.workunit.client.1.smithi111.stdout:4/299: dwrite d8/da/d2c/d1f/d40/f44 [0,4194304] 0 2023-12-08T20:27:51.472 INFO:tasks.workunit.client.1.smithi111.stdout:4/300: stat d8/d38/f5a 0 2023-12-08T20:27:51.473 INFO:tasks.workunit.client.1.smithi111.stdout:6/267: link d0/l16 d0/d1/d27/d36/l52 0 2023-12-08T20:27:51.474 INFO:tasks.workunit.client.1.smithi111.stdout:3/350: mknod d2/c71 0 2023-12-08T20:27:51.475 INFO:tasks.workunit.client.1.smithi111.stdout:1/440: mkdir d0/d6/d33/d6c/da1 0 2023-12-08T20:27:51.477 INFO:tasks.workunit.client.1.smithi111.stdout:0/472: rmdir d1/d4/d24/d2f 39 2023-12-08T20:27:51.480 INFO:tasks.workunit.client.1.smithi111.stdout:5/351: rename d3/d4/d7/d29/f3b to d3/d4/d7/d29/d30/f76 0 2023-12-08T20:27:51.481 INFO:tasks.workunit.client.1.smithi111.stdout:8/411: symlink dd/d2d/d62/l92 0 2023-12-08T20:27:51.481 INFO:tasks.workunit.client.1.smithi111.stdout:8/412: chown dd/d35/d42/c7e 109 1 2023-12-08T20:27:51.485 INFO:tasks.workunit.client.1.smithi111.stdout:4/301: link d8/da/d2c/d1f/d40/f42 d8/da/d2c/d1f/d2b/f61 0 2023-12-08T20:27:51.486 INFO:tasks.workunit.client.1.smithi111.stdout:6/268: symlink d0/d1/d1e/l53 0 2023-12-08T20:27:51.488 INFO:tasks.workunit.client.1.smithi111.stdout:6/269: write d0/f20 [359517,26736] 0 2023-12-08T20:27:51.488 INFO:tasks.workunit.client.1.smithi111.stdout:3/351: mkdir d2/d3/d1e/d72 0 2023-12-08T20:27:51.489 INFO:tasks.workunit.client.1.smithi111.stdout:1/441: mknod d0/d6/d33/d60/ca2 0 2023-12-08T20:27:51.489 INFO:tasks.workunit.client.1.smithi111.stdout:1/442: read d0/f70 [185181,2743] 0 2023-12-08T20:27:51.490 INFO:tasks.workunit.client.1.smithi111.stdout:0/473: symlink d1/df/d16/d2c/d7e/l9d 0 2023-12-08T20:27:51.492 INFO:tasks.workunit.client.1.smithi111.stdout:5/352: dwrite d3/d4/d4a/d21/f69 [0,4194304] 0 2023-12-08T20:27:51.492 INFO:tasks.workunit.client.1.smithi111.stdout:4/302: link d8/da/db/c2d d8/c62 0 2023-12-08T20:27:51.493 INFO:tasks.workunit.client.1.smithi111.stdout:3/352: getdents d2/d3 0 2023-12-08T20:27:51.496 INFO:tasks.workunit.client.1.smithi111.stdout:0/474: creat d1/df/d44/d37/d5c/f9e x:0 0 0 2023-12-08T20:27:51.502 INFO:tasks.workunit.client.1.smithi111.stdout:5/353: rename d3/d4/c3a to d3/d4/d7/d2c/c77 0 2023-12-08T20:27:51.504 INFO:tasks.workunit.client.1.smithi111.stdout:4/303: symlink d8/da/d2c/d1f/l63 0 2023-12-08T20:27:51.505 INFO:tasks.workunit.client.1.smithi111.stdout:0/475: rename d1/dd/d47/f5d to d1/dd/d47/f9f 0 2023-12-08T20:27:51.506 INFO:tasks.workunit.client.1.smithi111.stdout:0/476: write d1/d4/d3a/f4b [1852143,111135] 0 2023-12-08T20:27:51.507 INFO:tasks.workunit.client.1.smithi111.stdout:5/354: creat d3/d4/d7/d2c/f78 x:0 0 0 2023-12-08T20:27:51.508 INFO:tasks.workunit.client.1.smithi111.stdout:4/304: mkdir d8/da/d29/d5c/d64 0 2023-12-08T20:27:51.509 INFO:tasks.workunit.client.1.smithi111.stdout:3/353: rename d2/d3/d13/f32 to d2/d15/d17/d25/d4e/f73 0 2023-12-08T20:27:51.511 INFO:tasks.workunit.client.1.smithi111.stdout:0/477: link d1/dd/l32 d1/df/d16/d2c/la0 0 2023-12-08T20:27:51.512 INFO:tasks.workunit.client.1.smithi111.stdout:0/478: write d1/d4/d3a/f4b [1408658,46086] 0 2023-12-08T20:27:51.513 INFO:tasks.workunit.client.1.smithi111.stdout:5/355: link d3/d4/d4a/d21/c35 d3/d4/d4a/d21/c79 0 2023-12-08T20:27:51.513 INFO:tasks.workunit.client.1.smithi111.stdout:5/356: write d3/f6e [147951,26437] 0 2023-12-08T20:27:51.513 INFO:tasks.workunit.client.1.smithi111.stdout:5/357: dread - d3/d4/d7/d2c/f56 zero size 2023-12-08T20:27:51.513 INFO:tasks.workunit.client.1.smithi111.stdout:5/358: read - d3/d4/d7/d2c/f56 zero size 2023-12-08T20:27:51.515 INFO:tasks.workunit.client.1.smithi111.stdout:4/305: mknod d8/da/db/d31/c65 0 2023-12-08T20:27:51.515 INFO:tasks.workunit.client.1.smithi111.stdout:4/306: write d8/f22 [554698,23965] 0 2023-12-08T20:27:51.516 INFO:tasks.workunit.client.1.smithi111.stdout:3/354: getdents d2/d12 0 2023-12-08T20:27:51.516 INFO:tasks.workunit.client.1.smithi111.stdout:3/355: stat d2/d15/d17/d5e/l63 0 2023-12-08T20:27:51.518 INFO:tasks.workunit.client.1.smithi111.stdout:0/479: rename d1/df/d44/l2a to d1/df/d16/la1 0 2023-12-08T20:27:51.518 INFO:tasks.workunit.client.1.smithi111.stdout:4/307: dread d8/da/d2c/d1f/f1a [0,4194304] 0 2023-12-08T20:27:51.519 INFO:tasks.workunit.client.1.smithi111.stdout:4/308: link d8/f18 d8/da/f66 0 2023-12-08T20:27:51.527 INFO:tasks.workunit.client.1.smithi111.stdout:5/359: dwrite d3/d4/d7/f16 [0,4194304] 0 2023-12-08T20:27:51.540 INFO:tasks.workunit.client.1.smithi111.stdout:5/360: dread d3/d4/f8 [4194304,4194304] 0 2023-12-08T20:27:51.540 INFO:tasks.workunit.client.1.smithi111.stdout:5/361: chown d3/d4/d7/d36 28 1 2023-12-08T20:27:51.540 INFO:tasks.workunit.client.1.smithi111.stdout:5/362: write d3/d4/d7/d36/d64/f6a [659103,4704] 0 2023-12-08T20:27:51.540 INFO:tasks.workunit.client.1.smithi111.stdout:5/363: write d3/d4/d7/d2c/f3e [1558693,93624] 0 2023-12-08T20:27:51.541 INFO:tasks.workunit.client.1.smithi111.stdout:5/364: fsync d3/d4/d7/d2c/f56 0 2023-12-08T20:27:51.544 INFO:tasks.workunit.client.1.smithi111.stdout:3/356: dwrite d2/d3/d13/d36/f3e [0,4194304] 0 2023-12-08T20:27:51.544 INFO:tasks.workunit.client.1.smithi111.stdout:4/309: dread d8/f15 [0,4194304] 0 2023-12-08T20:27:51.544 INFO:tasks.workunit.client.1.smithi111.stdout:0/480: dwrite d1/d4/d24/d2f/f59 [0,4194304] 0 2023-12-08T20:27:51.547 INFO:tasks.workunit.client.1.smithi111.stdout:4/310: creat d8/da/d2c/d1f/d2b/d4b/f67 x:0 0 0 2023-12-08T20:27:51.547 INFO:tasks.workunit.client.1.smithi111.stdout:5/365: dread d3/d4/d4a/f49 [0,4194304] 0 2023-12-08T20:27:51.547 INFO:tasks.workunit.client.1.smithi111.stdout:5/366: chown d3/c6 0 1 2023-12-08T20:27:51.548 INFO:tasks.workunit.client.1.smithi111.stdout:3/357: creat d2/d12/d2e/f74 x:0 0 0 2023-12-08T20:27:51.550 INFO:tasks.workunit.client.1.smithi111.stdout:3/358: fdatasync d2/d12/d4a/f6f 0 2023-12-08T20:27:51.552 INFO:tasks.workunit.client.1.smithi111.stdout:4/311: symlink d8/da/d2c/d1f/d2b/d4b/l68 0 2023-12-08T20:27:51.553 INFO:tasks.workunit.client.1.smithi111.stdout:4/312: fsync d8/da/d29/f57 0 2023-12-08T20:27:51.554 INFO:tasks.workunit.client.1.smithi111.stdout:5/367: rename d3/d4/d7/f66 to d3/d4/d4a/f7a 0 2023-12-08T20:27:51.554 INFO:tasks.workunit.client.1.smithi111.stdout:0/481: dread d1/d4/d24/d2f/f7d [0,4194304] 0 2023-12-08T20:27:51.554 INFO:tasks.workunit.client.1.smithi111.stdout:5/368: stat d3/d4/f55 0 2023-12-08T20:27:51.554 INFO:tasks.workunit.client.1.smithi111.stdout:0/482: chown d1/d4/l2b 27 1 2023-12-08T20:27:51.554 INFO:tasks.workunit.client.1.smithi111.stdout:0/483: fdatasync d1/df/d56/f7a 0 2023-12-08T20:27:51.563 INFO:tasks.workunit.client.1.smithi111.stdout:3/359: dwrite d2/d15/d17/d25/d4e/f73 [0,4194304] 0 2023-12-08T20:27:51.565 INFO:tasks.workunit.client.1.smithi111.stdout:3/360: dread d2/d3/d6/f23 [0,4194304] 0 2023-12-08T20:27:51.565 INFO:tasks.workunit.client.1.smithi111.stdout:3/361: dread - d2/d3/d13/d36/f55 zero size 2023-12-08T20:27:51.566 INFO:tasks.workunit.client.1.smithi111.stdout:3/362: dread d2/d3/d6/f3a [0,4194304] 0 2023-12-08T20:27:51.566 INFO:tasks.workunit.client.1.smithi111.stdout:3/363: truncate d2/d3/d13/d36/d69/f6b 590566 0 2023-12-08T20:27:51.566 INFO:tasks.workunit.client.1.smithi111.stdout:3/364: chown d2/d3/d13/d36/d69/d70/f66 3418802 1 2023-12-08T20:27:51.568 INFO:tasks.workunit.client.1.smithi111.stdout:3/365: creat d2/d3/d13/d36/d69/f75 x:0 0 0 2023-12-08T20:27:51.571 INFO:tasks.workunit.client.1.smithi111.stdout:3/366: link d2/d3/d13/d36/d69/d70/c4d d2/d12/d4a/d5d/c76 0 2023-12-08T20:27:51.571 INFO:tasks.workunit.client.1.smithi111.stdout:3/367: fdatasync d2/f34 0 2023-12-08T20:27:51.571 INFO:tasks.workunit.client.1.smithi111.stdout:4/313: dwrite d8/d30/f3c [0,4194304] 0 2023-12-08T20:27:51.572 INFO:tasks.workunit.client.1.smithi111.stdout:3/368: link d2/d3/d13/d36/d69/d70/c4d d2/d3/d1e/d72/c77 0 2023-12-08T20:27:51.575 INFO:tasks.workunit.client.1.smithi111.stdout:3/369: write d2/d3/d13/d36/f3e [3292652,10428] 0 2023-12-08T20:27:51.575 INFO:tasks.workunit.client.1.smithi111.stdout:3/370: chown d2/d3/f16 24867885 1 2023-12-08T20:27:51.576 INFO:tasks.workunit.client.1.smithi111.stdout:0/484: dwrite d1/d4/d3a/d8c/f96 [0,4194304] 0 2023-12-08T20:27:51.576 INFO:tasks.workunit.client.1.smithi111.stdout:0/485: chown d1/d4/d24/d46/d49/l5b 120433861 1 2023-12-08T20:27:51.576 INFO:tasks.workunit.client.1.smithi111.stdout:4/314: getdents d8/da/db 0 2023-12-08T20:27:51.577 INFO:tasks.workunit.client.1.smithi111.stdout:5/369: dwrite d3/d4/d7/d29/d30/f76 [0,4194304] 0 2023-12-08T20:27:51.577 INFO:tasks.workunit.client.1.smithi111.stdout:5/370: fsync d3/d4/f55 0 2023-12-08T20:27:51.578 INFO:tasks.workunit.client.1.smithi111.stdout:3/371: creat d2/d15/d17/d25/d4e/f78 x:0 0 0 2023-12-08T20:27:51.580 INFO:tasks.workunit.client.1.smithi111.stdout:0/486: dread d1/d2d/f3c [0,4194304] 0 2023-12-08T20:27:51.580 INFO:tasks.workunit.client.1.smithi111.stdout:0/487: write d1/df/d44/d37/d5c/f9e [550225,111455] 0 2023-12-08T20:27:51.581 INFO:tasks.workunit.client.1.smithi111.stdout:0/488: fdatasync d1/f10 0 2023-12-08T20:27:51.584 INFO:tasks.workunit.client.1.smithi111.stdout:4/315: mkdir d8/da/d29/d69 0 2023-12-08T20:27:51.584 INFO:tasks.workunit.client.1.smithi111.stdout:4/316: truncate d8/da/d2c/d1f/d2b/f3a 122446 0 2023-12-08T20:27:51.591 INFO:tasks.workunit.client.1.smithi111.stdout:0/489: symlink d1/d4/d24/d2f/la2 0 2023-12-08T20:27:51.591 INFO:tasks.workunit.client.1.smithi111.stdout:0/490: chown d1/d4/d24/d46/d49/d6e 12157 1 2023-12-08T20:27:51.593 INFO:tasks.workunit.client.1.smithi111.stdout:0/491: creat d1/d69/d8b/fa3 x:0 0 0 2023-12-08T20:27:51.593 INFO:tasks.workunit.client.1.smithi111.stdout:0/492: write d1/dd/d4a/f84 [215164,15330] 0 2023-12-08T20:27:51.595 INFO:tasks.workunit.client.1.smithi111.stdout:0/493: rename d1/df/d56/f7a to d1/d4/d24/d46/d58/fa4 0 2023-12-08T20:27:51.595 INFO:tasks.workunit.client.1.smithi111.stdout:0/494: fdatasync d1/d4/d24/d2f/f59 0 2023-12-08T20:27:51.598 INFO:tasks.workunit.client.1.smithi111.stdout:0/495: rmdir d1/df/d16/d2c 39 2023-12-08T20:27:51.600 INFO:tasks.workunit.client.1.smithi111.stdout:5/371: dwrite d3/d4/d7/d2c/f78 [0,4194304] 0 2023-12-08T20:27:51.600 INFO:tasks.workunit.client.1.smithi111.stdout:4/317: dwrite d8/da/d2c/d1f/fe [4194304,4194304] 0 2023-12-08T20:27:51.600 INFO:tasks.workunit.client.1.smithi111.stdout:0/496: rename d1/d4/d24/d2f/l88 to d1/df/d16/d2c/d7e/la5 0 2023-12-08T20:27:51.605 INFO:tasks.workunit.client.1.smithi111.stdout:4/318: creat d8/da/d2c/d1f/f6a x:0 0 0 2023-12-08T20:27:51.605 INFO:tasks.workunit.client.1.smithi111.stdout:4/319: dread - d8/da/d2c/d1f/d2b/d4b/f67 zero size 2023-12-08T20:27:51.606 INFO:tasks.workunit.client.1.smithi111.stdout:4/320: chown d8/da/d2c/d1f/d2b 6169 1 2023-12-08T20:27:51.606 INFO:tasks.workunit.client.1.smithi111.stdout:4/321: readlink d8/da/d2c/d1f/l1c 0 2023-12-08T20:27:51.607 INFO:tasks.workunit.client.1.smithi111.stdout:4/322: creat d8/da/db/f6b x:0 0 0 2023-12-08T20:27:51.607 INFO:tasks.workunit.client.1.smithi111.stdout:4/323: truncate d8/da/d2c/d1f/d40/f60 987329 0 2023-12-08T20:27:51.608 INFO:tasks.workunit.client.1.smithi111.stdout:4/324: fsync d8/da/d2c/d1f/d2b/d4b/f67 0 2023-12-08T20:27:51.620 INFO:tasks.workunit.client.1.smithi111.stdout:7/278: sync 2023-12-08T20:27:51.620 INFO:tasks.workunit.client.1.smithi111.stdout:2/388: sync 2023-12-08T20:27:51.620 INFO:tasks.workunit.client.1.smithi111.stdout:9/434: sync 2023-12-08T20:27:51.620 INFO:tasks.workunit.client.1.smithi111.stdout:7/279: fsync da/f1e 0 2023-12-08T20:27:51.622 INFO:tasks.workunit.client.1.smithi111.stdout:5/372: dwrite d3/d4/d7/f16 [0,4194304] 0 2023-12-08T20:27:51.622 INFO:tasks.workunit.client.1.smithi111.stdout:5/373: chown d3/d4/d7/d29 6543049 1 2023-12-08T20:27:51.622 INFO:tasks.workunit.client.1.smithi111.stdout:5/374: chown d3/d4/d7/d36/c61 498827 1 2023-12-08T20:27:51.623 INFO:tasks.workunit.client.1.smithi111.stdout:2/389: rename d1/d1d/d55/d58 to d1/d29/d53/d90 0 2023-12-08T20:27:51.624 INFO:tasks.workunit.client.1.smithi111.stdout:5/375: link d3/d4/d7/c4b d3/d4/d7/d2c/c7b 0 2023-12-08T20:27:51.626 INFO:tasks.workunit.client.1.smithi111.stdout:5/376: creat d3/d4/d7/d36/f7c x:0 0 0 2023-12-08T20:27:51.627 INFO:tasks.workunit.client.1.smithi111.stdout:2/390: write d1/d1d/d22/f39 [519192,94043] 0 2023-12-08T20:27:51.628 INFO:tasks.workunit.client.1.smithi111.stdout:4/325: dwrite d8/da/db/fc [0,4194304] 0 2023-12-08T20:27:51.628 INFO:tasks.workunit.client.1.smithi111.stdout:0/497: dwrite d1/df/d44/d37/d5c/d70/f81 [0,4194304] 0 2023-12-08T20:27:51.629 INFO:tasks.workunit.client.1.smithi111.stdout:5/377: symlink d3/d12/d67/l7d 0 2023-12-08T20:27:51.629 INFO:tasks.workunit.client.1.smithi111.stdout:5/378: dread - d3/f6b zero size 2023-12-08T20:27:51.630 INFO:tasks.workunit.client.1.smithi111.stdout:2/391: mkdir d1/d29/d53/d91 0 2023-12-08T20:27:51.631 INFO:tasks.workunit.client.1.smithi111.stdout:7/280: dread da/f1e [4194304,4194304] 0 2023-12-08T20:27:51.635 INFO:tasks.workunit.client.1.smithi111.stdout:0/498: creat d1/d4/d24/d46/d49/d7f/fa6 x:0 0 0 2023-12-08T20:27:51.635 INFO:tasks.workunit.client.1.smithi111.stdout:0/499: write d1/df/d44/f43 [2034505,110858] 0 2023-12-08T20:27:51.639 INFO:tasks.workunit.client.1.smithi111.stdout:9/435: dwrite d2/d8/dd/d1a/d1e/d2d/d35/d6b/f79 [0,4194304] 0 2023-12-08T20:27:51.641 INFO:tasks.workunit.client.1.smithi111.stdout:0/500: creat d1/df/d44/d37/fa7 x:0 0 0 2023-12-08T20:27:51.647 INFO:tasks.workunit.client.1.smithi111.stdout:2/392: dwrite d1/d1d/d22/f71 [0,4194304] 0 2023-12-08T20:27:51.650 INFO:tasks.workunit.client.1.smithi111.stdout:7/281: dread da/f1b [4194304,4194304] 0 2023-12-08T20:27:51.650 INFO:tasks.workunit.client.1.smithi111.stdout:7/282: truncate da/d25/f4a 891581 0 2023-12-08T20:27:51.654 INFO:tasks.workunit.client.1.smithi111.stdout:2/393: mkdir d1/d1d/d1f/d36/d92 0 2023-12-08T20:27:51.654 INFO:tasks.workunit.client.1.smithi111.stdout:7/283: creat da/d25/f5d x:0 0 0 2023-12-08T20:27:51.655 INFO:tasks.workunit.client.1.smithi111.stdout:5/379: dwrite d3/d4/d7/d2c/f56 [0,4194304] 0 2023-12-08T20:27:51.656 INFO:tasks.workunit.client.1.smithi111.stdout:2/394: creat d1/d1d/d1f/d36/d92/f93 x:0 0 0 2023-12-08T20:27:51.656 INFO:tasks.workunit.client.1.smithi111.stdout:2/395: write d1/d1d/d55/f83 [957857,113386] 0 2023-12-08T20:27:51.656 INFO:tasks.workunit.client.1.smithi111.stdout:2/396: dread - d1/d1d/d1f/d36/d92/f93 zero size 2023-12-08T20:27:51.656 INFO:tasks.workunit.client.1.smithi111.stdout:2/397: truncate d1/d29/d53/f82 172411 0 2023-12-08T20:27:51.657 INFO:tasks.workunit.client.1.smithi111.stdout:7/284: creat da/d25/d3d/d58/f5e x:0 0 0 2023-12-08T20:27:51.661 INFO:tasks.workunit.client.1.smithi111.stdout:5/380: creat d3/d12/f7e x:0 0 0 2023-12-08T20:27:51.661 INFO:tasks.workunit.client.1.smithi111.stdout:5/381: readlink d3/d6d/l74 0 2023-12-08T20:27:51.661 INFO:tasks.workunit.client.1.smithi111.stdout:5/382: truncate d3/d4/f55 101721 0 2023-12-08T20:27:51.661 INFO:tasks.workunit.client.1.smithi111.stdout:5/383: fdatasync d3/d4/d7/f13 0 2023-12-08T20:27:51.661 INFO:tasks.workunit.client.1.smithi111.stdout:2/398: truncate d1/d29/d53/f3a 4752385 0 2023-12-08T20:27:51.663 INFO:tasks.workunit.client.1.smithi111.stdout:7/285: rename da/d13/d21/f2a to da/f5f 0 2023-12-08T20:27:51.663 INFO:tasks.workunit.client.1.smithi111.stdout:7/286: read da/d25/d26/f37 [880608,52421] 0 2023-12-08T20:27:51.664 INFO:tasks.workunit.client.1.smithi111.stdout:5/384: rmdir d3/d4/d7/d2c 39 2023-12-08T20:27:51.666 INFO:tasks.workunit.client.1.smithi111.stdout:2/399: mknod d1/d1d/d22/c94 0 2023-12-08T20:27:51.667 INFO:tasks.workunit.client.1.smithi111.stdout:0/501: dwrite d1/d4/d24/d46/d49/d6e/f7c [0,4194304] 0 2023-12-08T20:27:51.667 INFO:tasks.workunit.client.1.smithi111.stdout:9/436: dwrite d2/f7 [4194304,4194304] 0 2023-12-08T20:27:51.668 INFO:tasks.workunit.client.1.smithi111.stdout:0/502: read d1/df/d56/f63 [704607,6038] 0 2023-12-08T20:27:51.668 INFO:tasks.workunit.client.1.smithi111.stdout:2/400: creat d1/d29/f95 x:0 0 0 2023-12-08T20:27:51.673 INFO:tasks.workunit.client.1.smithi111.stdout:9/437: symlink d2/d8/dd/d1a/d66/l9a 0 2023-12-08T20:27:51.675 INFO:tasks.workunit.client.1.smithi111.stdout:0/503: creat d1/d4/d24/d46/fa8 x:0 0 0 2023-12-08T20:27:51.677 INFO:tasks.workunit.client.1.smithi111.stdout:2/401: getdents d1/d29/d53 0 2023-12-08T20:27:51.677 INFO:tasks.workunit.client.1.smithi111.stdout:5/385: dread d3/d4/d7/d2c/f5a [0,4194304] 0 2023-12-08T20:27:51.677 INFO:tasks.workunit.client.1.smithi111.stdout:5/386: fsync d3/d4/f53 0 2023-12-08T20:27:51.678 INFO:tasks.workunit.client.1.smithi111.stdout:2/402: mkdir d1/d1d/d1f/d25/d96 0 2023-12-08T20:27:51.678 INFO:tasks.workunit.client.1.smithi111.stdout:2/403: chown d1/lb 78 1 2023-12-08T20:27:51.678 INFO:tasks.workunit.client.1.smithi111.stdout:2/404: chown d1/d1d/d1f/d25/l40 164 1 2023-12-08T20:27:51.681 INFO:tasks.workunit.client.1.smithi111.stdout:7/287: dread f6 [4194304,4194304] 0 2023-12-08T20:27:51.681 INFO:tasks.workunit.client.1.smithi111.stdout:7/288: chown da/c14 0 1 2023-12-08T20:27:51.681 INFO:tasks.workunit.client.1.smithi111.stdout:7/289: write da/d25/d26/d3c/f4b [840335,114748] 0 2023-12-08T20:27:51.681 INFO:tasks.workunit.client.1.smithi111.stdout:0/504: dread d1/d4/f38 [0,4194304] 0 2023-12-08T20:27:51.682 INFO:tasks.workunit.client.1.smithi111.stdout:2/405: creat d1/d29/d53/d90/f97 x:0 0 0 2023-12-08T20:27:51.685 INFO:tasks.workunit.client.1.smithi111.stdout:5/387: truncate d3/d4/d7/d2c/f56 3714443 0 2023-12-08T20:27:51.685 INFO:tasks.workunit.client.1.smithi111.stdout:5/388: write d3/d4/d7/f16 [4322796,4084] 0 2023-12-08T20:27:51.687 INFO:tasks.workunit.client.1.smithi111.stdout:0/505: mkdir d1/d4/d24/da9 0 2023-12-08T20:27:51.687 INFO:tasks.workunit.client.1.smithi111.stdout:0/506: fsync d1/d2d/f41 0 2023-12-08T20:27:51.688 INFO:tasks.workunit.client.1.smithi111.stdout:2/406: symlink d1/d1d/d1f/d36/l98 0 2023-12-08T20:27:51.688 INFO:tasks.workunit.client.1.smithi111.stdout:2/407: chown d1/d1d/d1f/d25/d3d/d56/c59 26 1 2023-12-08T20:27:51.691 INFO:tasks.workunit.client.1.smithi111.stdout:0/507: mkdir d1/df/d44/daa 0 2023-12-08T20:27:51.691 INFO:tasks.workunit.client.1.smithi111.stdout:0/508: stat d1/df/l26 0 2023-12-08T20:27:51.691 INFO:tasks.workunit.client.1.smithi111.stdout:0/509: fdatasync d1/d4/f38 0 2023-12-08T20:27:51.692 INFO:tasks.workunit.client.1.smithi111.stdout:9/438: dwrite d2/d8/f18 [0,4194304] 0 2023-12-08T20:27:51.693 INFO:tasks.workunit.client.1.smithi111.stdout:2/408: unlink d1/d1d/d1f/d25/l43 0 2023-12-08T20:27:51.694 INFO:tasks.workunit.client.1.smithi111.stdout:0/510: mkdir d1/d2d/d83/dab 0 2023-12-08T20:27:51.694 INFO:tasks.workunit.client.1.smithi111.stdout:0/511: readlink d1/df/d44/d37/d5c/d70/l72 0 2023-12-08T20:27:51.699 INFO:tasks.workunit.client.1.smithi111.stdout:9/439: rename d2/d8/dd/d1a/d1e/d23 to d2/d8/d9b 0 2023-12-08T20:27:51.700 INFO:tasks.workunit.client.1.smithi111.stdout:2/409: dread f0 [0,4194304] 0 2023-12-08T20:27:51.701 INFO:tasks.workunit.client.1.smithi111.stdout:0/512: write d1/d2d/f39 [558042,76166] 0 2023-12-08T20:27:51.704 INFO:tasks.workunit.client.1.smithi111.stdout:2/410: rename d1/d1d/d55/c66 to d1/d1d/d1f/d25/d3d/d64/c99 0 2023-12-08T20:27:51.707 INFO:tasks.workunit.client.1.smithi111.stdout:5/389: dwrite d3/d4/f53 [0,4194304] 0 2023-12-08T20:27:51.708 INFO:tasks.workunit.client.1.smithi111.stdout:7/290: dwrite da/f1e [0,4194304] 0 2023-12-08T20:27:51.708 INFO:tasks.workunit.client.1.smithi111.stdout:7/291: fsync da/d13/f1a 0 2023-12-08T20:27:51.708 INFO:tasks.workunit.client.1.smithi111.stdout:9/440: link d2/d8/dd/d1a/d1e/d2d/d35/c65 d2/d8/dd/d56/c9c 0 2023-12-08T20:27:51.711 INFO:tasks.workunit.client.1.smithi111.stdout:5/390: mknod d3/d4/d7/d29/c7f 0 2023-12-08T20:27:51.711 INFO:tasks.workunit.client.1.smithi111.stdout:0/513: dread d1/d2d/f39 [0,4194304] 0 2023-12-08T20:27:51.712 INFO:tasks.workunit.client.1.smithi111.stdout:0/514: fsync d1/dd/d4a/f84 0 2023-12-08T20:27:51.713 INFO:tasks.workunit.client.1.smithi111.stdout:7/292: mknod da/d25/c60 0 2023-12-08T20:27:51.719 INFO:tasks.workunit.client.1.smithi111.stdout:5/391: creat d3/d4/d7/d36/d64/f80 x:0 0 0 2023-12-08T20:27:51.719 INFO:tasks.workunit.client.1.smithi111.stdout:5/392: chown d3/d4/f5 146556 1 2023-12-08T20:27:51.720 INFO:tasks.workunit.client.1.smithi111.stdout:0/515: mkdir d1/df/d44/d37/dac 0 2023-12-08T20:27:51.721 INFO:tasks.workunit.client.1.smithi111.stdout:7/293: mkdir da/d5c/d59/d61 0 2023-12-08T20:27:51.721 INFO:tasks.workunit.client.1.smithi111.stdout:0/516: dread d1/df/d16/f53 [0,4194304] 0 2023-12-08T20:27:51.721 INFO:tasks.workunit.client.1.smithi111.stdout:0/517: readlink d1/d4/l5f 0 2023-12-08T20:27:51.722 INFO:tasks.workunit.client.1.smithi111.stdout:5/393: creat d3/d6d/f81 x:0 0 0 2023-12-08T20:27:51.723 INFO:tasks.workunit.client.1.smithi111.stdout:7/294: getdents da/d25/d26/d32/d3e 0 2023-12-08T20:27:51.725 INFO:tasks.workunit.client.1.smithi111.stdout:0/518: rename d1/dd/l34 to d1/df/d44/d37/dac/lad 0 2023-12-08T20:27:51.726 INFO:tasks.workunit.client.1.smithi111.stdout:7/295: stat c2 0 2023-12-08T20:27:51.727 INFO:tasks.workunit.client.1.smithi111.stdout:0/519: creat d1/df/d16/fae x:0 0 0 2023-12-08T20:27:51.729 INFO:tasks.workunit.client.1.smithi111.stdout:7/296: rename da/d25/d26/d32/d3e/l53 to da/d5c/d59/l62 0 2023-12-08T20:27:51.729 INFO:tasks.workunit.client.1.smithi111.stdout:0/520: creat d1/d4/faf x:0 0 0 2023-12-08T20:27:51.733 INFO:tasks.workunit.client.1.smithi111.stdout:0/521: dread d1/dd/f4e [0,4194304] 0 2023-12-08T20:27:51.735 INFO:tasks.workunit.client.1.smithi111.stdout:0/522: mkdir d1/dd/db0 0 2023-12-08T20:27:51.735 INFO:tasks.workunit.client.1.smithi111.stdout:0/523: truncate d1/d4/d24/d46/d58/fa4 754809 0 2023-12-08T20:27:51.738 INFO:tasks.workunit.client.1.smithi111.stdout:0/524: dread d1/d2d/f41 [0,4194304] 0 2023-12-08T20:27:51.739 INFO:tasks.workunit.client.1.smithi111.stdout:5/394: dwrite d3/d12/f7e [0,4194304] 0 2023-12-08T20:27:51.739 INFO:tasks.workunit.client.1.smithi111.stdout:5/395: read - d3/d4/d7/d36/f7c zero size 2023-12-08T20:27:51.741 INFO:tasks.workunit.client.1.smithi111.stdout:0/525: rename d1/df/d44/d37/d5c/f9e to d1/df/d16/d2c/d7e/fb1 0 2023-12-08T20:27:51.744 INFO:tasks.workunit.client.1.smithi111.stdout:5/396: unlink d3/d4/d7/d2c/f56 0 2023-12-08T20:27:51.745 INFO:tasks.workunit.client.1.smithi111.stdout:7/297: rmdir da/d25 39 2023-12-08T20:27:51.745 INFO:tasks.workunit.client.1.smithi111.stdout:7/298: truncate da/d25/d3d/f51 848024 0 2023-12-08T20:27:51.746 INFO:tasks.workunit.client.1.smithi111.stdout:0/526: truncate d1/d4/f35 3366753 0 2023-12-08T20:27:51.748 INFO:tasks.workunit.client.1.smithi111.stdout:0/527: mkdir d1/df/d44/daa/db2 0 2023-12-08T20:27:51.749 INFO:tasks.workunit.client.1.smithi111.stdout:0/528: symlink d1/d4/d24/d46/d49/lb3 0 2023-12-08T20:27:51.751 INFO:tasks.workunit.client.1.smithi111.stdout:0/529: getdents d1/d2d 0 2023-12-08T20:27:51.761 INFO:tasks.workunit.client.1.smithi111.stdout:5/397: dread d3/d12/f7e [0,4194304] 0 2023-12-08T20:27:51.765 INFO:tasks.workunit.client.1.smithi111.stdout:5/398: mkdir d3/d4/d7/d36/d82 0 2023-12-08T20:27:51.765 INFO:tasks.workunit.client.1.smithi111.stdout:5/399: truncate d3/d4/d7/d36/f7c 563119 0 2023-12-08T20:27:51.765 INFO:tasks.workunit.client.1.smithi111.stdout:5/400: chown d3/d12 129598 1 2023-12-08T20:27:51.766 INFO:tasks.workunit.client.1.smithi111.stdout:5/401: creat d3/d4/d7/d2c/f83 x:0 0 0 2023-12-08T20:27:51.766 INFO:tasks.workunit.client.1.smithi111.stdout:0/530: dwrite d1/d2d/f41 [4194304,4194304] 0 2023-12-08T20:27:51.769 INFO:tasks.workunit.client.1.smithi111.stdout:5/402: mkdir d3/d4/d7/d2c/d84 0 2023-12-08T20:27:51.769 INFO:tasks.workunit.client.1.smithi111.stdout:5/403: readlink d3/d4/d7/d36/l51 0 2023-12-08T20:27:51.769 INFO:tasks.workunit.client.1.smithi111.stdout:0/531: creat d1/df/d16/fb4 x:0 0 0 2023-12-08T20:27:51.769 INFO:tasks.workunit.client.1.smithi111.stdout:5/404: rmdir d3/d4 39 2023-12-08T20:27:51.771 INFO:tasks.workunit.client.1.smithi111.stdout:5/405: rename d3/d6d/f75 to d3/d4/d7/d36/d82/f85 0 2023-12-08T20:27:51.771 INFO:tasks.workunit.client.1.smithi111.stdout:0/532: symlink d1/d4/lb5 0 2023-12-08T20:27:51.773 INFO:tasks.workunit.client.1.smithi111.stdout:5/406: rename d3/d4/d7/d2c/f43 to d3/d4/d7/d36/d64/f86 0 2023-12-08T20:27:51.774 INFO:tasks.workunit.client.1.smithi111.stdout:0/533: mknod d1/df/d44/daa/cb6 0 2023-12-08T20:27:51.774 INFO:tasks.workunit.client.1.smithi111.stdout:7/299: dwrite da/d25/d26/d3c/f4b [0,4194304] 0 2023-12-08T20:27:51.775 INFO:tasks.workunit.client.1.smithi111.stdout:7/300: write da/d25/f4a [379528,122685] 0 2023-12-08T20:27:51.775 INFO:tasks.workunit.client.1.smithi111.stdout:0/534: mkdir d1/d4/d24/d46/db7 0 2023-12-08T20:27:51.779 INFO:tasks.workunit.client.1.smithi111.stdout:0/535: mkdir d1/d4/d24/d46/d49/d7f/d95/db8 0 2023-12-08T20:27:51.780 INFO:tasks.workunit.client.1.smithi111.stdout:0/536: chown d1/dd/d47 0 1 2023-12-08T20:27:51.782 INFO:tasks.workunit.client.1.smithi111.stdout:0/537: rmdir d1/dd/db0 0 2023-12-08T20:27:51.783 INFO:tasks.workunit.client.1.smithi111.stdout:0/538: dread d1/df/d16/d2c/d7e/f82 [0,4194304] 0 2023-12-08T20:27:51.784 INFO:tasks.workunit.client.1.smithi111.stdout:7/301: dread da/d25/d26/f37 [0,4194304] 0 2023-12-08T20:27:51.785 INFO:tasks.workunit.client.1.smithi111.stdout:0/539: rmdir d1/d4/d24/d46/d49/d7f/d95/d9b 0 2023-12-08T20:27:51.786 INFO:tasks.workunit.client.1.smithi111.stdout:7/302: unlink da/d13/l19 0 2023-12-08T20:27:51.787 INFO:tasks.workunit.client.1.smithi111.stdout:5/407: dwrite d3/d4/f8 [0,4194304] 0 2023-12-08T20:27:51.787 INFO:tasks.workunit.client.1.smithi111.stdout:0/540: mkdir d1/d4/d24/d46/db7/db9 0 2023-12-08T20:27:51.788 INFO:tasks.workunit.client.1.smithi111.stdout:7/303: creat da/d25/d26/d32/f63 x:0 0 0 2023-12-08T20:27:51.790 INFO:tasks.workunit.client.1.smithi111.stdout:5/408: creat d3/d12/f87 x:0 0 0 2023-12-08T20:27:51.791 INFO:tasks.workunit.client.1.smithi111.stdout:5/409: write d3/d4/d4a/f49 [704468,54392] 0 2023-12-08T20:27:51.791 INFO:tasks.workunit.client.1.smithi111.stdout:0/541: mkdir d1/df/d16/d2c/d7b/dba 0 2023-12-08T20:27:51.793 INFO:tasks.workunit.client.1.smithi111.stdout:7/304: mkdir da/d64 0 2023-12-08T20:27:51.794 INFO:tasks.workunit.client.1.smithi111.stdout:0/542: creat d1/df/d16/d2c/fbb x:0 0 0 2023-12-08T20:27:51.795 INFO:tasks.workunit.client.1.smithi111.stdout:7/305: mknod da/d5c/d59/d61/c65 0 2023-12-08T20:27:51.798 INFO:tasks.workunit.client.1.smithi111.stdout:7/306: rename da/f54 to da/d25/d3d/d58/f66 0 2023-12-08T20:27:51.798 INFO:tasks.workunit.client.1.smithi111.stdout:7/307: chown da/d25/d26/d32/d3e/f42 17546530 1 2023-12-08T20:27:51.798 INFO:tasks.workunit.client.1.smithi111.stdout:7/308: write da/d25/d26/d32/f63 [997372,60432] 0 2023-12-08T20:27:51.799 INFO:tasks.workunit.client.1.smithi111.stdout:0/543: mknod d1/d4/cbc 0 2023-12-08T20:27:51.800 INFO:tasks.workunit.client.1.smithi111.stdout:7/309: creat da/d13/d21/f67 x:0 0 0 2023-12-08T20:27:51.800 INFO:tasks.workunit.client.1.smithi111.stdout:7/310: fdatasync da/f40 0 2023-12-08T20:27:51.800 INFO:tasks.workunit.client.1.smithi111.stdout:7/311: truncate da/d13/f4c 624936 0 2023-12-08T20:27:51.801 INFO:tasks.workunit.client.1.smithi111.stdout:0/544: creat d1/dd/d47/fbd x:0 0 0 2023-12-08T20:27:51.801 INFO:tasks.workunit.client.1.smithi111.stdout:7/312: truncate da/d25/d26/f41 1335779 0 2023-12-08T20:27:51.802 INFO:tasks.workunit.client.1.smithi111.stdout:0/545: getdents d1/d69/d8b 0 2023-12-08T20:27:51.803 INFO:tasks.workunit.client.1.smithi111.stdout:7/313: mknod da/d38/c68 0 2023-12-08T20:27:51.804 INFO:tasks.workunit.client.1.smithi111.stdout:5/410: dwrite d3/d12/f38 [0,4194304] 0 2023-12-08T20:27:51.804 INFO:tasks.workunit.client.1.smithi111.stdout:0/546: unlink d1/d4/d24/d2f/f59 0 2023-12-08T20:27:51.806 INFO:tasks.workunit.client.1.smithi111.stdout:5/411: dread d3/d4/d4a/f6f [0,4194304] 0 2023-12-08T20:27:51.806 INFO:tasks.workunit.client.1.smithi111.stdout:0/547: dread d1/df/d16/d2c/d7e/f82 [0,4194304] 0 2023-12-08T20:27:51.808 INFO:tasks.workunit.client.1.smithi111.stdout:5/412: symlink d3/d4/d7/d2c/d84/l88 0 2023-12-08T20:27:51.811 INFO:tasks.workunit.client.1.smithi111.stdout:0/548: rename d1/d4/d24/d46/d49/d6e/f7c to d1/df/d16/d2c/d7b/dba/fbe 0 2023-12-08T20:27:51.813 INFO:tasks.workunit.client.1.smithi111.stdout:5/413: creat d3/d4/d7/f89 x:0 0 0 2023-12-08T20:27:51.816 INFO:tasks.workunit.client.1.smithi111.stdout:0/549: creat d1/df/d16/d2c/d7b/fbf x:0 0 0 2023-12-08T20:27:51.816 INFO:tasks.workunit.client.1.smithi111.stdout:0/550: dread - d1/df/d16/d2c/fbb zero size 2023-12-08T20:27:51.816 INFO:tasks.workunit.client.1.smithi111.stdout:0/551: fsync d1/d4/d3a/d8c/f96 0 2023-12-08T20:27:51.817 INFO:tasks.workunit.client.1.smithi111.stdout:5/414: mkdir d3/d4/d7/d36/d64/d8a 0 2023-12-08T20:27:51.819 INFO:tasks.workunit.client.1.smithi111.stdout:0/552: symlink d1/df/d16/lc0 0 2023-12-08T20:27:51.819 INFO:tasks.workunit.client.1.smithi111.stdout:0/553: chown d1/d4/l5f 0 1 2023-12-08T20:27:51.820 INFO:tasks.workunit.client.1.smithi111.stdout:5/415: creat d3/d4/d7/f8b x:0 0 0 2023-12-08T20:27:51.822 INFO:tasks.workunit.client.1.smithi111.stdout:0/554: creat d1/d4/d24/d46/d49/d6e/fc1 x:0 0 0 2023-12-08T20:27:51.822 INFO:tasks.workunit.client.1.smithi111.stdout:0/555: dread - d1/df/d16/d2c/d7b/fbf zero size 2023-12-08T20:27:51.822 INFO:tasks.workunit.client.1.smithi111.stdout:0/556: readlink d1/d4/d3a/d8c/l90 0 2023-12-08T20:27:51.823 INFO:tasks.workunit.client.1.smithi111.stdout:5/416: truncate d3/f6e 41107 0 2023-12-08T20:27:51.825 INFO:tasks.workunit.client.1.smithi111.stdout:7/314: getdents da/d25/d3d/d58 0 2023-12-08T20:27:51.829 INFO:tasks.workunit.client.1.smithi111.stdout:7/315: rename da/d25/d26/d32/f63 to da/d13/f69 0 2023-12-08T20:27:51.829 INFO:tasks.workunit.client.1.smithi111.stdout:7/316: chown da/d25/d26/f41 3147 1 2023-12-08T20:27:51.829 INFO:tasks.workunit.client.1.smithi111.stdout:7/317: fsync da/d13/f4c 0 2023-12-08T20:27:51.839 INFO:tasks.workunit.client.1.smithi111.stdout:7/318: creat da/d38/f6a x:0 0 0 2023-12-08T20:27:51.839 INFO:tasks.workunit.client.1.smithi111.stdout:7/319: write da/d13/f4c [786892,130706] 0 2023-12-08T20:27:51.839 INFO:tasks.workunit.client.1.smithi111.stdout:7/320: chown da/d5c/d59/d61 14 1 2023-12-08T20:27:51.841 INFO:tasks.workunit.client.1.smithi111.stdout:7/321: unlink da/d25/d26/d32/f57 0 2023-12-08T20:27:51.841 INFO:tasks.workunit.client.1.smithi111.stdout:0/557: dwrite d1/d4/d24/d46/d58/d65/f9a [0,4194304] 0 2023-12-08T20:27:51.841 INFO:tasks.workunit.client.1.smithi111.stdout:0/558: chown d1/d4/d24/d46/d49/d7f/fa6 3 1 2023-12-08T20:27:51.841 INFO:tasks.workunit.client.1.smithi111.stdout:0/559: readlink d1/d4/d24/d46/d49/lb3 0 2023-12-08T20:27:51.844 INFO:tasks.workunit.client.1.smithi111.stdout:7/322: unlink da/d25/d26/d3c/l55 0 2023-12-08T20:27:51.847 INFO:tasks.workunit.client.1.smithi111.stdout:0/560: write d1/d4/d3a/f4b [432584,126710] 0 2023-12-08T20:27:51.847 INFO:tasks.workunit.client.1.smithi111.stdout:5/417: dwrite d3/f6b [0,4194304] 0 2023-12-08T20:27:51.847 INFO:tasks.workunit.client.1.smithi111.stdout:7/323: mknod da/d25/d3d/c6b 0 2023-12-08T20:27:51.849 INFO:tasks.workunit.client.1.smithi111.stdout:5/418: write d3/d12/f38 [557242,11298] 0 2023-12-08T20:27:51.849 INFO:tasks.workunit.client.1.smithi111.stdout:5/419: chown d3/d12/f38 141 1 2023-12-08T20:27:51.862 INFO:tasks.workunit.client.1.smithi111.stdout:7/324: truncate da/d25/f2e 5187265 0 2023-12-08T20:27:51.864 INFO:tasks.workunit.client.1.smithi111.stdout:7/325: mknod da/d25/d3d/c6c 0 2023-12-08T20:27:51.864 INFO:tasks.workunit.client.1.smithi111.stdout:7/326: chown f6 8381634 1 2023-12-08T20:27:51.866 INFO:tasks.workunit.client.1.smithi111.stdout:7/327: mknod da/d13/d21/c6d 0 2023-12-08T20:27:51.866 INFO:tasks.workunit.client.1.smithi111.stdout:7/328: write da/d13/f4c [821211,58442] 0 2023-12-08T20:27:51.868 INFO:tasks.workunit.client.1.smithi111.stdout:7/329: mkdir da/d5c/d6e 0 2023-12-08T20:27:51.868 INFO:tasks.workunit.client.1.smithi111.stdout:7/330: readlink da/d13/d21/l2f 0 2023-12-08T20:27:51.868 INFO:tasks.workunit.client.1.smithi111.stdout:7/331: dread - da/d13/f45 zero size 2023-12-08T20:27:51.869 INFO:tasks.workunit.client.1.smithi111.stdout:0/561: dwrite d1/d4/d24/d46/fa8 [0,4194304] 0 2023-12-08T20:27:51.873 INFO:tasks.workunit.client.1.smithi111.stdout:0/562: rename d1/df/d16/d2c/fbb to d1/df/d56/fc2 0 2023-12-08T20:27:51.874 INFO:tasks.workunit.client.1.smithi111.stdout:5/420: dwrite d3/d4/d7/d36/d82/f85 [0,4194304] 0 2023-12-08T20:27:51.877 INFO:tasks.workunit.client.1.smithi111.stdout:7/332: dread da/d25/d26/f4d [0,4194304] 0 2023-12-08T20:27:51.880 INFO:tasks.workunit.client.1.smithi111.stdout:5/421: mknod d3/d4/d4a/d21/c8c 0 2023-12-08T20:27:51.881 INFO:tasks.workunit.client.1.smithi111.stdout:5/422: dread d3/d4/d4a/f6f [0,4194304] 0 2023-12-08T20:27:51.881 INFO:tasks.workunit.client.1.smithi111.stdout:7/333: symlink da/l6f 0 2023-12-08T20:27:51.885 INFO:tasks.workunit.client.1.smithi111.stdout:5/423: truncate d3/d4/d4a/f5f 2178234 0 2023-12-08T20:27:51.889 INFO:tasks.workunit.client.1.smithi111.stdout:1/443: sync 2023-12-08T20:27:51.889 INFO:tasks.workunit.client.1.smithi111.stdout:8/413: sync 2023-12-08T20:27:51.889 INFO:tasks.workunit.client.1.smithi111.stdout:6/270: sync 2023-12-08T20:27:51.889 INFO:tasks.workunit.client.1.smithi111.stdout:6/271: chown d0/d1/l9 610 1 2023-12-08T20:27:51.889 INFO:tasks.workunit.client.1.smithi111.stdout:8/414: write dd/f12 [2768833,116423] 0 2023-12-08T20:27:51.889 INFO:tasks.workunit.client.1.smithi111.stdout:8/415: write dd/d2d/f31 [534165,67798] 0 2023-12-08T20:27:51.889 INFO:tasks.workunit.client.1.smithi111.stdout:8/416: readlink dd/d35/d7a/l80 0 2023-12-08T20:27:51.893 INFO:tasks.workunit.client.1.smithi111.stdout:1/444: mkdir d0/d6/d33/d15/d51/d5b/d59/da3 0 2023-12-08T20:27:51.893 INFO:tasks.workunit.client.1.smithi111.stdout:6/272: truncate d0/d1/f3c 3412635 0 2023-12-08T20:27:51.895 INFO:tasks.workunit.client.1.smithi111.stdout:8/417: rename dd/f23 to dd/d2d/d62/f93 0 2023-12-08T20:27:51.895 INFO:tasks.workunit.client.1.smithi111.stdout:8/418: chown dd/d32/d36/d50 110 1 2023-12-08T20:27:51.896 INFO:tasks.workunit.client.1.smithi111.stdout:6/273: mknod d0/d1b/c54 0 2023-12-08T20:27:51.896 INFO:tasks.workunit.client.1.smithi111.stdout:6/274: fsync d0/d1/f2c 0 2023-12-08T20:27:51.897 INFO:tasks.workunit.client.1.smithi111.stdout:6/275: chown d0/f32 36371580 1 2023-12-08T20:27:51.897 INFO:tasks.workunit.client.1.smithi111.stdout:6/276: readlink d0/d1/d27/d36/l52 0 2023-12-08T20:27:51.897 INFO:tasks.workunit.client.1.smithi111.stdout:6/277: dread d0/d1/d27/f2f [0,4194304] 0 2023-12-08T20:27:51.897 INFO:tasks.workunit.client.1.smithi111.stdout:6/278: write d0/d1/f2c [558310,117252] 0 2023-12-08T20:27:51.898 INFO:tasks.workunit.client.1.smithi111.stdout:8/419: creat dd/d32/d36/f94 x:0 0 0 2023-12-08T20:27:51.899 INFO:tasks.workunit.client.1.smithi111.stdout:8/420: truncate dd/f90 849782 0 2023-12-08T20:27:51.899 INFO:tasks.workunit.client.1.smithi111.stdout:6/279: fsync d0/f22 0 2023-12-08T20:27:51.901 INFO:tasks.workunit.client.1.smithi111.stdout:8/421: rename dd/l27 to dd/d32/d3d/d55/l95 0 2023-12-08T20:27:51.903 INFO:tasks.workunit.client.1.smithi111.stdout:8/422: rmdir dd/d2d/d8b 39 2023-12-08T20:27:51.904 INFO:tasks.workunit.client.1.smithi111.stdout:1/445: dread d0/d6/d33/d6c/f9a [0,4194304] 0 2023-12-08T20:27:51.904 INFO:tasks.workunit.client.1.smithi111.stdout:5/424: dwrite d3/d4/d7/d36/f4f [0,4194304] 0 2023-12-08T20:27:51.904 INFO:tasks.workunit.client.1.smithi111.stdout:5/425: dread - d3/d4/d4a/d21/f47 zero size 2023-12-08T20:27:51.904 INFO:tasks.workunit.client.1.smithi111.stdout:7/334: dwrite da/d13/d21/f29 [0,4194304] 0 2023-12-08T20:27:51.905 INFO:tasks.workunit.client.1.smithi111.stdout:0/563: dwrite d1/df/d56/f63 [0,4194304] 0 2023-12-08T20:27:51.905 INFO:tasks.workunit.client.1.smithi111.stdout:1/446: mknod d0/d6/d33/d6c/da1/ca4 0 2023-12-08T20:27:51.914 INFO:tasks.workunit.client.1.smithi111.stdout:5/426: unlink d3/d4/d7/d36/c61 0 2023-12-08T20:27:51.915 INFO:tasks.workunit.client.1.smithi111.stdout:5/427: write d3/d4/d7/d2c/f41 [161197,66899] 0 2023-12-08T20:27:51.915 INFO:tasks.workunit.client.1.smithi111.stdout:5/428: stat d3/d6d/f81 0 2023-12-08T20:27:51.915 INFO:tasks.workunit.client.1.smithi111.stdout:5/429: truncate d3/d4/d4a/f49 1298849 0 2023-12-08T20:27:51.915 INFO:tasks.workunit.client.1.smithi111.stdout:7/335: mknod da/d13/c70 0 2023-12-08T20:27:51.915 INFO:tasks.workunit.client.1.smithi111.stdout:7/336: dread - da/d25/f5d zero size 2023-12-08T20:27:51.917 INFO:tasks.workunit.client.1.smithi111.stdout:7/337: dread da/d25/d26/f37 [0,4194304] 0 2023-12-08T20:27:51.929 INFO:tasks.workunit.client.1.smithi111.stdout:0/564: dwrite d1/d4/d24/d46/d49/d6e/fc1 [0,4194304] 0 2023-12-08T20:27:51.929 INFO:tasks.workunit.client.1.smithi111.stdout:8/423: dwrite dd/d32/d3d/f5a [0,4194304] 0 2023-12-08T20:27:51.930 INFO:tasks.workunit.client.1.smithi111.stdout:8/424: truncate dd/d35/d7a/f7f 972193 0 2023-12-08T20:27:51.930 INFO:tasks.workunit.client.1.smithi111.stdout:6/280: rename d0/d1/f3c to d0/f55 0 2023-12-08T20:27:51.931 INFO:tasks.workunit.client.1.smithi111.stdout:5/430: dread d3/f10 [0,4194304] 0 2023-12-08T20:27:51.933 INFO:tasks.workunit.client.1.smithi111.stdout:7/338: rmdir da/d25/d26/d32 39 2023-12-08T20:27:51.935 INFO:tasks.workunit.client.1.smithi111.stdout:7/339: write da/f5f [4177127,124161] 0 2023-12-08T20:27:51.937 INFO:tasks.workunit.client.1.smithi111.stdout:7/340: read da/d25/d26/d3c/f4b [2302080,86785] 0 2023-12-08T20:27:51.937 INFO:tasks.workunit.client.1.smithi111.stdout:0/565: rmdir d1/df/d16/d2c/d7e 39 2023-12-08T20:27:51.941 INFO:tasks.workunit.client.1.smithi111.stdout:8/425: getdents dd/d35/d42 0 2023-12-08T20:27:51.943 INFO:tasks.workunit.client.1.smithi111.stdout:6/281: mkdir d0/d1/d27/d56 0 2023-12-08T20:27:51.943 INFO:tasks.workunit.client.1.smithi111.stdout:6/282: chown d0/d1/c34 451 1 2023-12-08T20:27:51.945 INFO:tasks.workunit.client.1.smithi111.stdout:7/341: creat da/d64/f71 x:0 0 0 2023-12-08T20:27:51.946 INFO:tasks.workunit.client.1.smithi111.stdout:0/566: symlink d1/d4/d24/d46/d49/d7f/d95/db8/lc3 0 2023-12-08T20:27:51.947 INFO:tasks.workunit.client.1.smithi111.stdout:0/567: fsync d1/d4/d24/d2f/f7d 0 2023-12-08T20:27:51.947 INFO:tasks.workunit.client.1.smithi111.stdout:0/568: truncate d1/dd/f11 4820073 0 2023-12-08T20:27:51.947 INFO:tasks.workunit.client.1.smithi111.stdout:0/569: write d1/df/d44/d37/d5c/d70/f81 [4427038,9806] 0 2023-12-08T20:27:51.947 INFO:tasks.workunit.client.1.smithi111.stdout:0/570: chown d1/d2d/d83 120 1 2023-12-08T20:27:51.947 INFO:tasks.workunit.client.1.smithi111.stdout:0/571: stat d1/df/d44/d37/d5c/d70/f81 0 2023-12-08T20:27:51.947 INFO:tasks.workunit.client.1.smithi111.stdout:1/447: dwrite d0/d6/f27 [0,4194304] 0 2023-12-08T20:27:51.947 INFO:tasks.workunit.client.1.smithi111.stdout:1/448: chown d0/d6/d33/d15/d51/d2e/d61/f93 14 1 2023-12-08T20:27:51.948 INFO:tasks.workunit.client.1.smithi111.stdout:1/449: chown d0/d6/d33/d15/d51/d2e/d61/f93 5727 1 2023-12-08T20:27:51.948 INFO:tasks.workunit.client.1.smithi111.stdout:8/426: mkdir dd/d96 0 2023-12-08T20:27:51.948 INFO:tasks.workunit.client.1.smithi111.stdout:1/450: write d0/d6/d33/d15/d51/d2e/f40 [2349508,52207] 0 2023-12-08T20:27:51.948 INFO:tasks.workunit.client.1.smithi111.stdout:5/431: dwrite d3/d4/d7/d36/f3d [0,4194304] 0 2023-12-08T20:27:51.948 INFO:tasks.workunit.client.1.smithi111.stdout:5/432: dread - d3/d4/d7/d36/d64/f80 zero size 2023-12-08T20:27:51.949 INFO:tasks.workunit.client.1.smithi111.stdout:6/283: rename d0/d1/l19 to d0/d1b/l57 0 2023-12-08T20:27:51.949 INFO:tasks.workunit.client.1.smithi111.stdout:6/284: chown d0/d1/d1e/l24 203318245 1 2023-12-08T20:27:51.950 INFO:tasks.workunit.client.1.smithi111.stdout:4/326: sync 2023-12-08T20:27:51.950 INFO:tasks.workunit.client.1.smithi111.stdout:2/411: sync 2023-12-08T20:27:51.950 INFO:tasks.workunit.client.1.smithi111.stdout:9/441: sync 2023-12-08T20:27:51.950 INFO:tasks.workunit.client.1.smithi111.stdout:3/372: sync 2023-12-08T20:27:51.950 INFO:tasks.workunit.client.1.smithi111.stdout:9/442: chown d2/d8/dd/d1a/d1e/d2d/d4a/l5c 1695177895 1 2023-12-08T20:27:51.950 INFO:tasks.workunit.client.1.smithi111.stdout:3/373: truncate d2/d15/d17/d25/d4e/f61 647902 0 2023-12-08T20:27:51.950 INFO:tasks.workunit.client.1.smithi111.stdout:9/443: truncate d2/d8/dd/d1a/f6f 804643 0 2023-12-08T20:27:51.950 INFO:tasks.workunit.client.1.smithi111.stdout:4/327: read d8/d38/f5a [103288,122976] 0 2023-12-08T20:27:51.952 INFO:tasks.workunit.client.1.smithi111.stdout:7/342: mknod da/d25/d26/c72 0 2023-12-08T20:27:51.954 INFO:tasks.workunit.client.1.smithi111.stdout:0/572: mkdir d1/dd/d4a/dc4 0 2023-12-08T20:27:51.958 INFO:tasks.workunit.client.1.smithi111.stdout:8/427: rename dd/d2d/l56 to dd/d2d/d8b/l97 0 2023-12-08T20:27:51.958 INFO:tasks.workunit.client.1.smithi111.stdout:8/428: fdatasync dd/f14 0 2023-12-08T20:27:51.958 INFO:tasks.workunit.client.1.smithi111.stdout:2/412: mknod d1/d1d/d1f/d25/d67/c9a 0 2023-12-08T20:27:51.958 INFO:tasks.workunit.client.1.smithi111.stdout:3/374: mknod d2/d3/d51/c79 0 2023-12-08T20:27:51.959 INFO:tasks.workunit.client.1.smithi111.stdout:9/444: creat d2/f9d x:0 0 0 2023-12-08T20:27:51.959 INFO:tasks.workunit.client.1.smithi111.stdout:9/445: fdatasync d2/d8/dd/d1a/d1e/d2d/d35/d88/f99 0 2023-12-08T20:27:51.960 INFO:tasks.workunit.client.1.smithi111.stdout:7/343: symlink da/d5c/d59/d61/l73 0 2023-12-08T20:27:51.960 INFO:tasks.workunit.client.1.smithi111.stdout:7/344: stat da/d13/f1a 0 2023-12-08T20:27:51.960 INFO:tasks.workunit.client.1.smithi111.stdout:5/433: dread d3/d4/f5b [0,4194304] 0 2023-12-08T20:27:51.961 INFO:tasks.workunit.client.1.smithi111.stdout:5/434: write d3/d12/f17 [1705326,126590] 0 2023-12-08T20:27:51.961 INFO:tasks.workunit.client.1.smithi111.stdout:0/573: creat d1/d69/fc5 x:0 0 0 2023-12-08T20:27:51.961 INFO:tasks.workunit.client.1.smithi111.stdout:0/574: fdatasync d1/df/d16/d2c/d7b/dba/fbe 0 2023-12-08T20:27:51.961 INFO:tasks.workunit.client.1.smithi111.stdout:8/429: creat dd/d32/d3d/d6b/f98 x:0 0 0 2023-12-08T20:27:51.962 INFO:tasks.workunit.client.1.smithi111.stdout:8/430: read dd/d2d/f31 [492361,107215] 0 2023-12-08T20:27:51.963 INFO:tasks.workunit.client.1.smithi111.stdout:6/285: mknod d0/c58 0 2023-12-08T20:27:51.963 INFO:tasks.workunit.client.1.smithi111.stdout:6/286: stat d0/d1/l9 0 2023-12-08T20:27:51.963 INFO:tasks.workunit.client.1.smithi111.stdout:6/287: chown d0/d1/d27/c3d 1520 1 2023-12-08T20:27:51.967 INFO:tasks.workunit.client.1.smithi111.stdout:3/375: creat d2/d3/d13/d36/d69/f7a x:0 0 0 2023-12-08T20:27:51.967 INFO:tasks.workunit.client.1.smithi111.stdout:2/413: rename d1/d1d/d55/f83 to d1/d1d/d68/d73/f9b 0 2023-12-08T20:27:51.967 INFO:tasks.workunit.client.1.smithi111.stdout:2/414: dread - d1/d1d/d1f/d25/d3d/d41/f74 zero size 2023-12-08T20:27:51.967 INFO:tasks.workunit.client.1.smithi111.stdout:9/446: creat d2/d8/d8c/d96/f9e x:0 0 0 2023-12-08T20:27:51.969 INFO:tasks.workunit.client.1.smithi111.stdout:7/345: creat da/d38/f74 x:0 0 0 2023-12-08T20:27:51.969 INFO:tasks.workunit.client.1.smithi111.stdout:7/346: stat da/d13/f45 0 2023-12-08T20:27:51.970 INFO:tasks.workunit.client.1.smithi111.stdout:0/575: link d1/dd/c12 d1/df/d16/d2c/d7e/cc6 0 2023-12-08T20:27:51.970 INFO:tasks.workunit.client.1.smithi111.stdout:1/451: dwrite d0/d6/d34/f96 [0,4194304] 0 2023-12-08T20:27:51.970 INFO:tasks.workunit.client.1.smithi111.stdout:1/452: chown d0/f70 1165 1 2023-12-08T20:27:51.971 INFO:tasks.workunit.client.1.smithi111.stdout:3/376: getdents d2/d3/d1e/d72 0 2023-12-08T20:27:51.972 INFO:tasks.workunit.client.1.smithi111.stdout:8/431: rename dd/d2d/f37 to dd/d35/f99 0 2023-12-08T20:27:51.973 INFO:tasks.workunit.client.1.smithi111.stdout:2/415: mknod d1/d1d/c9c 0 2023-12-08T20:27:51.973 INFO:tasks.workunit.client.1.smithi111.stdout:2/416: dread - d1/d1d/d22/f7d zero size 2023-12-08T20:27:51.975 INFO:tasks.workunit.client.1.smithi111.stdout:0/576: creat d1/df/d56/fc7 x:0 0 0 2023-12-08T20:27:51.980 INFO:tasks.workunit.client.1.smithi111.stdout:4/328: dwrite d8/da/d2c/d1f/d2b/f34 [0,4194304] 0 2023-12-08T20:27:51.981 INFO:tasks.workunit.client.1.smithi111.stdout:3/377: creat d2/d3/d13/d36/d44/f7b x:0 0 0 2023-12-08T20:27:51.981 INFO:tasks.workunit.client.1.smithi111.stdout:1/453: mknod d0/d6/d33/d6c/ca5 0 2023-12-08T20:27:51.981 INFO:tasks.workunit.client.1.smithi111.stdout:1/454: chown d0/d6/d33/d15/d51/c44 2 1 2023-12-08T20:27:51.982 INFO:tasks.workunit.client.1.smithi111.stdout:1/455: stat d0/d6/d33/d15/d51/l4b 0 2023-12-08T20:27:51.983 INFO:tasks.workunit.client.1.smithi111.stdout:2/417: symlink d1/d1d/d68/d73/l9d 0 2023-12-08T20:27:51.983 INFO:tasks.workunit.client.1.smithi111.stdout:7/347: dread da/d25/d26/f2b [0,4194304] 0 2023-12-08T20:27:51.983 INFO:tasks.workunit.client.1.smithi111.stdout:0/577: unlink d1/dd/d47/f9f 0 2023-12-08T20:27:51.987 INFO:tasks.workunit.client.1.smithi111.stdout:3/378: creat d2/d3/d13/d36/d44/f7c x:0 0 0 2023-12-08T20:27:51.988 INFO:tasks.workunit.client.1.smithi111.stdout:3/379: read d2/d12/f1d [3665543,55669] 0 2023-12-08T20:27:51.992 INFO:tasks.workunit.client.1.smithi111.stdout:1/456: rename d0/d6/d33/d15/d51/d5b/d5e/f63 to d0/d6/d33/d15/d51/d2e/fa6 0 2023-12-08T20:27:51.993 INFO:tasks.workunit.client.1.smithi111.stdout:1/457: stat d0/d6/d33/d15/d51/d2e/f5c 0 2023-12-08T20:27:51.993 INFO:tasks.workunit.client.1.smithi111.stdout:1/458: fdatasync d0/d6/d33/f4f 0 2023-12-08T20:27:51.993 INFO:tasks.workunit.client.1.smithi111.stdout:7/348: dread da/d25/f2e [0,4194304] 0 2023-12-08T20:27:51.993 INFO:tasks.workunit.client.1.smithi111.stdout:7/349: dread - da/d38/f6a zero size 2023-12-08T20:27:51.993 INFO:tasks.workunit.client.1.smithi111.stdout:4/329: dread d8/da/d2c/d1f/d2b/f61 [0,4194304] 0 2023-12-08T20:27:51.998 INFO:tasks.workunit.client.1.smithi111.stdout:2/418: creat d1/d29/d53/d91/f9e x:0 0 0 2023-12-08T20:27:51.999 INFO:tasks.workunit.client.1.smithi111.stdout:3/380: creat d2/d3/d13/d36/d69/f7d x:0 0 0 2023-12-08T20:27:51.999 INFO:tasks.workunit.client.1.smithi111.stdout:3/381: write d2/d3/d6/f23 [497548,40915] 0 2023-12-08T20:27:52.001 INFO:tasks.workunit.client.1.smithi111.stdout:1/459: mknod d0/d6/d33/d8b/ca7 0 2023-12-08T20:27:52.002 INFO:tasks.workunit.client.1.smithi111.stdout:9/447: dwrite d2/d8/dd/d56/f58 [4194304,4194304] 0 2023-12-08T20:27:52.002 INFO:tasks.workunit.client.1.smithi111.stdout:7/350: mkdir da/d25/d26/d3c/d75 0 2023-12-08T20:27:52.002 INFO:tasks.workunit.client.1.smithi111.stdout:7/351: fdatasync da/f46 0 2023-12-08T20:27:52.002 INFO:tasks.workunit.client.1.smithi111.stdout:7/352: readlink da/d13/l15 0 2023-12-08T20:27:52.003 INFO:tasks.workunit.client.1.smithi111.stdout:3/382: dread d2/d3/d13/d36/d69/d70/f66 [0,4194304] 0 2023-12-08T20:27:52.003 INFO:tasks.workunit.client.1.smithi111.stdout:3/383: stat d2/d3/d13/d36/d44 0 2023-12-08T20:27:52.004 INFO:tasks.workunit.client.1.smithi111.stdout:5/435: dwrite d3/d12/f1b [0,4194304] 0 2023-12-08T20:27:52.005 INFO:tasks.workunit.client.1.smithi111.stdout:2/419: mkdir d1/d1d/d1f/d25/d3d/d9f 0 2023-12-08T20:27:52.005 INFO:tasks.workunit.client.1.smithi111.stdout:2/420: chown d1/d1d/d22/d30/f5c 109 1 2023-12-08T20:27:52.005 INFO:tasks.workunit.client.1.smithi111.stdout:0/578: dwrite d1/df/f97 [0,4194304] 0 2023-12-08T20:27:52.005 INFO:tasks.workunit.client.1.smithi111.stdout:0/579: stat d1/d4/d24/d46/db7/db9 0 2023-12-08T20:27:52.005 INFO:tasks.workunit.client.1.smithi111.stdout:0/580: chown d1/df 33620 1 2023-12-08T20:27:52.007 INFO:tasks.workunit.client.1.smithi111.stdout:2/421: read d1/d1d/f5d [39973,14150] 0 2023-12-08T20:27:52.007 INFO:tasks.workunit.client.1.smithi111.stdout:8/432: dwrite dd/d32/d36/d4b/f52 [0,4194304] 0 2023-12-08T20:27:52.007 INFO:tasks.workunit.client.1.smithi111.stdout:1/460: mknod d0/d6/ca8 0 2023-12-08T20:27:52.007 INFO:tasks.workunit.client.1.smithi111.stdout:1/461: write d0/d6/d33/d15/d51/d5b/d5e/f9f [235900,108356] 0 2023-12-08T20:27:52.011 INFO:tasks.workunit.client.1.smithi111.stdout:2/422: read d1/d29/d53/f5a [1000280,115769] 0 2023-12-08T20:27:52.011 INFO:tasks.workunit.client.1.smithi111.stdout:2/423: rename d1/d29/d4e to d1/d29/d4e/da0 22 2023-12-08T20:27:52.011 INFO:tasks.workunit.client.1.smithi111.stdout:9/448: creat d2/d8/dd/d1a/d74/f9f x:0 0 0 2023-12-08T20:27:52.011 INFO:tasks.workunit.client.1.smithi111.stdout:9/449: chown d2/d8/dd/d1a/d1e/d2d/d35/f60 652 1 2023-12-08T20:27:52.011 INFO:tasks.workunit.client.1.smithi111.stdout:9/450: truncate d2/d8/dd/d1a/d74/f82 357140 0 2023-12-08T20:27:52.012 INFO:tasks.workunit.client.1.smithi111.stdout:7/353: link da/d25/l30 da/d25/d26/d32/d3e/l76 0 2023-12-08T20:27:52.012 INFO:tasks.workunit.client.1.smithi111.stdout:7/354: dread - da/d25/d26/d32/f56 zero size 2023-12-08T20:27:52.012 INFO:tasks.workunit.client.1.smithi111.stdout:7/355: write da/d13/f49 [921442,25114] 0 2023-12-08T20:27:52.016 INFO:tasks.workunit.client.1.smithi111.stdout:5/436: dread d3/d4/d7/d29/d30/f3f [0,4194304] 0 2023-12-08T20:27:52.016 INFO:tasks.workunit.client.1.smithi111.stdout:5/437: write d3/d4/d7/d2c/f3e [4556298,35728] 0 2023-12-08T20:27:52.016 INFO:tasks.workunit.client.1.smithi111.stdout:0/581: creat d1/dd/d47/fc8 x:0 0 0 2023-12-08T20:27:52.018 INFO:tasks.workunit.client.1.smithi111.stdout:4/330: dwrite d8/da/f66 [0,4194304] 0 2023-12-08T20:27:52.019 INFO:tasks.workunit.client.1.smithi111.stdout:4/331: fdatasync f0 0 2023-12-08T20:27:52.019 INFO:tasks.workunit.client.1.smithi111.stdout:3/384: dwrite d2/d15/d17/d25/f58 [0,4194304] 0 2023-12-08T20:27:52.020 INFO:tasks.workunit.client.1.smithi111.stdout:8/433: truncate dd/f2a 704578 0 2023-12-08T20:27:52.022 INFO:tasks.workunit.client.1.smithi111.stdout:1/462: creat d0/d6/d33/d15/d51/d2e/fa9 x:0 0 0 2023-12-08T20:27:52.022 INFO:tasks.workunit.client.1.smithi111.stdout:1/463: write d0/d6/d33/d15/d51/d2e/d61/d79/f90 [58503,60012] 0 2023-12-08T20:27:52.023 INFO:tasks.workunit.client.1.smithi111.stdout:2/424: creat d1/d1d/d68/fa1 x:0 0 0 2023-12-08T20:27:52.024 INFO:tasks.workunit.client.1.smithi111.stdout:9/451: creat d2/d8/dd/d56/fa0 x:0 0 0 2023-12-08T20:27:52.027 INFO:tasks.workunit.client.1.smithi111.stdout:7/356: rename da/d25/c60 to da/d25/d26/d3c/d75/c77 0 2023-12-08T20:27:52.029 INFO:tasks.workunit.client.1.smithi111.stdout:5/438: mkdir d3/d8d 0 2023-12-08T20:27:52.029 INFO:tasks.workunit.client.1.smithi111.stdout:5/439: dread - d3/d4/d7/f8b zero size 2023-12-08T20:27:52.029 INFO:tasks.workunit.client.1.smithi111.stdout:5/440: write d3/d4/d7/d36/d64/f80 [343172,24304] 0 2023-12-08T20:27:52.030 INFO:tasks.workunit.client.1.smithi111.stdout:0/582: mknod d1/df/d44/d37/cc9 0 2023-12-08T20:27:52.035 INFO:tasks.workunit.client.1.smithi111.stdout:4/332: creat d8/da/d29/d5c/d64/f6c x:0 0 0 2023-12-08T20:27:52.102 INFO:tasks.workunit.client.1.smithi111.stdout:3/385: symlink d2/d12/l7e 0 2023-12-08T20:27:52.102 INFO:tasks.workunit.client.1.smithi111.stdout:3/386: read - d2/d3/d13/d36/d69/f7d zero size 2023-12-08T20:27:52.102 INFO:tasks.workunit.client.1.smithi111.stdout:9/452: dwrite d2/d8/dd/d1a/d1e/f54 [0,4194304] 0 2023-12-08T20:27:52.102 INFO:tasks.workunit.client.1.smithi111.stdout:8/434: symlink dd/d32/l9a 0 2023-12-08T20:27:52.102 INFO:tasks.workunit.client.1.smithi111.stdout:1/464: creat d0/d6/d33/d15/d51/d5b/d5e/faa x:0 0 0 2023-12-08T20:27:52.102 INFO:tasks.workunit.client.1.smithi111.stdout:2/425: mkdir d1/d1d/d1f/d25/d3d/da2 0 2023-12-08T20:27:52.102 INFO:tasks.workunit.client.1.smithi111.stdout:2/426: getdents d1/d1d/d1f/d25/d3d/d9f 0 2023-12-08T20:27:52.103 INFO:tasks.workunit.client.1.smithi111.stdout:7/357: mknod da/d25/d26/d32/d3e/c78 0 2023-12-08T20:27:52.103 INFO:tasks.workunit.client.1.smithi111.stdout:8/435: dread dd/d32/d3d/d6b/f6f [0,4194304] 0 2023-12-08T20:27:52.103 INFO:tasks.workunit.client.1.smithi111.stdout:5/441: rename d3/d4/d4a/d21/f69 to d3/d4/f8e 0 2023-12-08T20:27:52.103 INFO:tasks.workunit.client.1.smithi111.stdout:0/583: dwrite d1/df/d16/d2c/d7b/f87 [0,4194304] 0 2023-12-08T20:27:52.103 INFO:tasks.workunit.client.1.smithi111.stdout:4/333: creat d8/da/db/f6d x:0 0 0 2023-12-08T20:27:52.103 INFO:tasks.workunit.client.1.smithi111.stdout:3/387: mknod d2/d12/d4a/d5d/c7f 0 2023-12-08T20:27:52.103 INFO:tasks.workunit.client.1.smithi111.stdout:3/388: write d2/d12/f65 [4685865,103713] 0 2023-12-08T20:27:52.103 INFO:tasks.workunit.client.1.smithi111.stdout:9/453: mkdir d2/d8/dd/d56/da1 0 2023-12-08T20:27:52.103 INFO:tasks.workunit.client.1.smithi111.stdout:2/427: symlink d1/d1d/d68/la3 0 2023-12-08T20:27:52.103 INFO:tasks.workunit.client.1.smithi111.stdout:7/358: symlink da/d13/l79 0 2023-12-08T20:27:52.103 INFO:tasks.workunit.client.1.smithi111.stdout:8/436: getdents dd/d32/d36 0 2023-12-08T20:27:52.103 INFO:tasks.workunit.client.1.smithi111.stdout:5/442: rename d3/d4/d7/d36/d64/f6a to d3/d8d/f8f 0 2023-12-08T20:27:52.103 INFO:tasks.workunit.client.1.smithi111.stdout:0/584: creat d1/df/d16/d2c/d7b/fca x:0 0 0 2023-12-08T20:27:52.103 INFO:tasks.workunit.client.1.smithi111.stdout:4/334: mkdir d8/da/d29/d6e 0 2023-12-08T20:27:52.103 INFO:tasks.workunit.client.1.smithi111.stdout:9/454: mknod d2/d8/dd/d1a/d1e/d2d/d8f/ca2 0 2023-12-08T20:27:52.104 INFO:tasks.workunit.client.1.smithi111.stdout:2/428: creat d1/d1d/d1f/d25/fa4 x:0 0 0 2023-12-08T20:27:52.104 INFO:tasks.workunit.client.1.smithi111.stdout:8/437: mkdir dd/d2d/d8b/d9b 0 2023-12-08T20:27:52.104 INFO:tasks.workunit.client.1.smithi111.stdout:1/465: dwrite d0/d22/f45 [0,4194304] 0 2023-12-08T20:27:52.104 INFO:tasks.workunit.client.1.smithi111.stdout:8/438: read dd/f15 [3870396,7305] 0 2023-12-08T20:27:52.104 INFO:tasks.workunit.client.1.smithi111.stdout:8/439: fsync dd/d2d/f45 0 2023-12-08T20:27:52.104 INFO:tasks.workunit.client.1.smithi111.stdout:8/440: truncate dd/d35/f51 553433 0 2023-12-08T20:27:52.104 INFO:tasks.workunit.client.1.smithi111.stdout:3/389: dwrite d2/d12/f65 [0,4194304] 0 2023-12-08T20:27:52.104 INFO:tasks.workunit.client.1.smithi111.stdout:1/466: write d0/f2f [2981509,87956] 0 2023-12-08T20:27:52.104 INFO:tasks.workunit.client.1.smithi111.stdout:5/443: mkdir d3/d4/d7/d29/d73/d90 0 2023-12-08T20:27:52.104 INFO:tasks.workunit.client.1.smithi111.stdout:5/444: stat d3/d4/d7/d36/d64 0 2023-12-08T20:27:52.104 INFO:tasks.workunit.client.1.smithi111.stdout:4/335: creat d8/da/d2c/d1f/f6f x:0 0 0 2023-12-08T20:27:52.104 INFO:tasks.workunit.client.1.smithi111.stdout:4/336: write d8/da/db/d31/f4c [844202,91708] 0 2023-12-08T20:27:52.104 INFO:tasks.workunit.client.1.smithi111.stdout:2/429: dread d1/d1d/f26 [0,4194304] 0 2023-12-08T20:27:52.104 INFO:tasks.workunit.client.1.smithi111.stdout:2/430: chown d1/d1d/d1f/d25/d3d/d41/l6b 2 1 2023-12-08T20:27:52.104 INFO:tasks.workunit.client.1.smithi111.stdout:2/431: chown d1/d29/d53/f82 0 1 2023-12-08T20:27:52.104 INFO:tasks.workunit.client.1.smithi111.stdout:5/445: read d3/d4/f5 [1309925,82477] 0 2023-12-08T20:27:52.105 INFO:tasks.workunit.client.1.smithi111.stdout:3/390: dread d2/d3/d13/d36/d69/d70/f66 [0,4194304] 0 2023-12-08T20:27:52.105 INFO:tasks.workunit.client.1.smithi111.stdout:5/446: write d3/d4/d7/d29/d30/f3f [1614053,1455] 0 2023-12-08T20:27:52.105 INFO:tasks.workunit.client.1.smithi111.stdout:3/391: write d2/d3/d6/f10 [5352212,8263] 0 2023-12-08T20:27:52.105 INFO:tasks.workunit.client.1.smithi111.stdout:3/392: readlink d2/d15/d17/d25/l45 0 2023-12-08T20:27:52.105 INFO:tasks.workunit.client.1.smithi111.stdout:8/441: rmdir dd/d35/d42 39 2023-12-08T20:27:52.105 INFO:tasks.workunit.client.1.smithi111.stdout:8/442: dread dd/d32/d3d/d6b/f6f [0,4194304] 0 2023-12-08T20:27:52.105 INFO:tasks.workunit.client.1.smithi111.stdout:8/443: getdents dd/d35/d42 0 2023-12-08T20:27:52.105 INFO:tasks.workunit.client.1.smithi111.stdout:7/359: rmdir da/d13 39 2023-12-08T20:27:52.106 INFO:tasks.workunit.client.1.smithi111.stdout:1/467: mkdir d0/d6/d33/d15/d51/d5b/d5e/d86/dab 0 2023-12-08T20:27:52.106 INFO:tasks.workunit.client.1.smithi111.stdout:8/444: dwrite dd/d2d/f33 [0,4194304] 0 2023-12-08T20:27:52.106 INFO:tasks.workunit.client.1.smithi111.stdout:4/337: mknod d8/d38/c70 0 2023-12-08T20:27:52.106 INFO:tasks.workunit.client.1.smithi111.stdout:2/432: mknod d1/d1d/d1f/d25/d3d/da2/ca5 0 2023-12-08T20:27:52.106 INFO:tasks.workunit.client.1.smithi111.stdout:5/447: creat d3/d4/d4a/d21/f91 x:0 0 0 2023-12-08T20:27:52.107 INFO:tasks.workunit.client.1.smithi111.stdout:3/393: creat d2/f80 x:0 0 0 2023-12-08T20:27:52.114 INFO:tasks.workunit.client.1.smithi111.stdout:7/360: mkdir da/d25/d26/d3c/d7a 0 2023-12-08T20:27:52.114 INFO:tasks.workunit.client.1.smithi111.stdout:7/361: chown da/l10 118066 1 2023-12-08T20:27:52.114 INFO:tasks.workunit.client.1.smithi111.stdout:7/362: write da/d25/d26/d32/f56 [259874,29575] 0 2023-12-08T20:27:52.115 INFO:tasks.workunit.client.1.smithi111.stdout:1/468: mkdir d0/d6/d33/d15/d51/d2e/d61/d79/dac 0 2023-12-08T20:27:52.117 INFO:tasks.workunit.client.1.smithi111.stdout:8/445: mknod dd/d32/d36/d50/c9c 0 2023-12-08T20:27:52.119 INFO:tasks.workunit.client.1.smithi111.stdout:4/338: unlink d8/da/db/f6d 0 2023-12-08T20:27:52.120 INFO:tasks.workunit.client.1.smithi111.stdout:4/339: truncate d8/da/d29/d5c/d64/f6c 646164 0 2023-12-08T20:27:52.120 INFO:tasks.workunit.client.1.smithi111.stdout:4/340: stat d8/da/d29 0 2023-12-08T20:27:52.120 INFO:tasks.workunit.client.1.smithi111.stdout:4/341: readlink d8/l32 0 2023-12-08T20:27:52.120 INFO:tasks.workunit.client.1.smithi111.stdout:4/342: fdatasync d8/da/d2c/d1f/d2b/d4b/f53 0 2023-12-08T20:27:52.120 INFO:tasks.workunit.client.1.smithi111.stdout:4/343: truncate d8/da/d2c/d1f/f6f 909685 0 2023-12-08T20:27:52.120 INFO:tasks.workunit.client.1.smithi111.stdout:2/433: truncate d1/d1d/d22/f76 1136128 0 2023-12-08T20:27:52.121 INFO:tasks.workunit.client.1.smithi111.stdout:5/448: creat d3/d8d/f92 x:0 0 0 2023-12-08T20:27:52.122 INFO:tasks.workunit.client.1.smithi111.stdout:3/394: mkdir d2/d3/d13/d36/d69/d81 0 2023-12-08T20:27:52.126 INFO:tasks.workunit.client.1.smithi111.stdout:7/363: rmdir da/d25/d26/d3c/d7a 0 2023-12-08T20:27:52.126 INFO:tasks.workunit.client.1.smithi111.stdout:7/364: truncate da/d25/d26/d32/f56 983194 0 2023-12-08T20:27:52.126 INFO:tasks.workunit.client.1.smithi111.stdout:7/365: chown f6 1615 1 2023-12-08T20:27:52.127 INFO:tasks.workunit.client.1.smithi111.stdout:1/469: symlink d0/d6/d33/d15/d51/d5b/d5e/da0/lad 0 2023-12-08T20:27:52.135 INFO:tasks.workunit.client.1.smithi111.stdout:8/446: creat dd/d32/d36/d4b/f9d x:0 0 0 2023-12-08T20:27:52.135 INFO:tasks.workunit.client.1.smithi111.stdout:2/434: dwrite d1/d1d/d22/f71 [0,4194304] 0 2023-12-08T20:27:52.135 INFO:tasks.workunit.client.1.smithi111.stdout:8/447: write dd/d35/d7a/f7f [55248,118334] 0 2023-12-08T20:27:52.135 INFO:tasks.workunit.client.1.smithi111.stdout:4/344: mknod d8/da/d2c/d1f/d2b/c71 0 2023-12-08T20:27:52.135 INFO:tasks.workunit.client.1.smithi111.stdout:5/449: truncate d3/f6b 3703184 0 2023-12-08T20:27:52.137 INFO:tasks.workunit.client.1.smithi111.stdout:1/470: symlink d0/d6/d33/d15/d51/d5b/d5e/lae 0 2023-12-08T20:27:52.139 INFO:tasks.workunit.client.1.smithi111.stdout:2/435: rename d1/d1d/d1f/d36/d92/f93 to d1/d1d/d1f/d25/d96/fa6 0 2023-12-08T20:27:52.140 INFO:tasks.workunit.client.1.smithi111.stdout:8/448: mknod dd/d2d/d62/c9e 0 2023-12-08T20:27:52.141 INFO:tasks.workunit.client.1.smithi111.stdout:8/449: read dd/d32/d3d/f7c [204997,122788] 0 2023-12-08T20:27:52.141 INFO:tasks.workunit.client.1.smithi111.stdout:8/450: write dd/d32/f57 [905310,48268] 0 2023-12-08T20:27:52.141 INFO:tasks.workunit.client.1.smithi111.stdout:1/471: symlink d0/d6/d33/d15/d51/d5b/d5e/da0/laf 0 2023-12-08T20:27:52.141 INFO:tasks.workunit.client.1.smithi111.stdout:1/472: truncate d0/d4d/f8c 807792 0 2023-12-08T20:27:52.142 INFO:tasks.workunit.client.1.smithi111.stdout:1/473: fdatasync d0/f71 0 2023-12-08T20:27:52.142 INFO:tasks.workunit.client.1.smithi111.stdout:5/450: dread d3/d4/f8 [4194304,4194304] 0 2023-12-08T20:27:52.144 INFO:tasks.workunit.client.1.smithi111.stdout:4/345: rename d8/d38/c59 to d8/da/d2c/d1f/d2b/c72 0 2023-12-08T20:27:52.146 INFO:tasks.workunit.client.1.smithi111.stdout:2/436: mknod d1/d1d/d22/ca7 0 2023-12-08T20:27:52.146 INFO:tasks.workunit.client.1.smithi111.stdout:2/437: readlink d1/d1d/d55/l8f 0 2023-12-08T20:27:52.146 INFO:tasks.workunit.client.1.smithi111.stdout:4/346: write d8/da/d29/f39 [81834,7095] 0 2023-12-08T20:27:52.148 INFO:tasks.workunit.client.1.smithi111.stdout:8/451: mknod dd/d35/d42/c9f 0 2023-12-08T20:27:52.150 INFO:tasks.workunit.client.1.smithi111.stdout:5/451: mknod d3/d4/d7/d29/d73/c93 0 2023-12-08T20:27:52.150 INFO:tasks.workunit.client.1.smithi111.stdout:5/452: chown d3/d12/f7e 1 1 2023-12-08T20:27:52.153 INFO:tasks.workunit.client.1.smithi111.stdout:4/347: mkdir d8/da/d2c/d1f/d40/d73 0 2023-12-08T20:27:52.153 INFO:tasks.workunit.client.1.smithi111.stdout:4/348: read d8/da/d2c/d1f/d2b/f3a [17327,50979] 0 2023-12-08T20:27:52.155 INFO:tasks.workunit.client.1.smithi111.stdout:8/452: creat dd/d35/d7a/fa0 x:0 0 0 2023-12-08T20:27:52.155 INFO:tasks.workunit.client.1.smithi111.stdout:5/453: symlink d3/d4/d7/l94 0 2023-12-08T20:27:52.156 INFO:tasks.workunit.client.1.smithi111.stdout:8/453: dread dd/d2d/f4a [0,4194304] 0 2023-12-08T20:27:52.162 INFO:tasks.workunit.client.1.smithi111.stdout:1/474: dwrite d0/f2d [0,4194304] 0 2023-12-08T20:27:52.162 INFO:tasks.workunit.client.1.smithi111.stdout:1/475: write d0/d6/d33/d15/d51/f43 [1151199,121258] 0 2023-12-08T20:27:52.162 INFO:tasks.workunit.client.1.smithi111.stdout:1/476: read - d0/d4d/f57 zero size 2023-12-08T20:27:52.163 INFO:tasks.workunit.client.1.smithi111.stdout:5/454: dread d3/d4/f55 [0,4194304] 0 2023-12-08T20:27:52.163 INFO:tasks.workunit.client.1.smithi111.stdout:4/349: link d8/da/d2c/d1f/d40/l41 d8/da/d29/d5c/d64/l74 0 2023-12-08T20:27:52.163 INFO:tasks.workunit.client.1.smithi111.stdout:8/454: truncate dd/d32/d36/f7d 48155 0 2023-12-08T20:27:52.163 INFO:tasks.workunit.client.1.smithi111.stdout:5/455: mknod d3/d6d/c95 0 2023-12-08T20:27:52.163 INFO:tasks.workunit.client.1.smithi111.stdout:5/456: chown d3/d4/d7/d2c/f4c 14600 1 2023-12-08T20:27:52.168 INFO:tasks.workunit.client.1.smithi111.stdout:4/350: creat d8/da/f75 x:0 0 0 2023-12-08T20:27:52.169 INFO:tasks.workunit.client.1.smithi111.stdout:4/351: write d8/da/db/f4d [392665,76820] 0 2023-12-08T20:27:52.170 INFO:tasks.workunit.client.1.smithi111.stdout:2/438: dwrite d1/d1d/f26 [0,4194304] 0 2023-12-08T20:27:52.170 INFO:tasks.workunit.client.1.smithi111.stdout:2/439: mknod d1/d1d/d55/ca8 0 2023-12-08T20:27:52.171 INFO:tasks.workunit.client.1.smithi111.stdout:2/440: rmdir d1/d1d/d22/d30 39 2023-12-08T20:27:52.172 INFO:tasks.workunit.client.1.smithi111.stdout:5/457: dread d3/d4/d7/d36/f4f [0,4194304] 0 2023-12-08T20:27:52.172 INFO:tasks.workunit.client.1.smithi111.stdout:4/352: dread d8/da/d29/d5c/d64/f6c [0,4194304] 0 2023-12-08T20:27:52.172 INFO:tasks.workunit.client.1.smithi111.stdout:4/353: chown d8/da/d2c/d1f/d2b/d4b/f53 2000 1 2023-12-08T20:27:52.177 INFO:tasks.workunit.client.1.smithi111.stdout:5/458: mkdir d3/d4/d7/d36/d64/d96 0 2023-12-08T20:27:52.180 INFO:tasks.workunit.client.1.smithi111.stdout:4/354: truncate d8/da/d2c/d1f/f52 3164498 0 2023-12-08T20:27:52.180 INFO:tasks.workunit.client.1.smithi111.stdout:5/459: creat d3/d4/d7/d2c/f97 x:0 0 0 2023-12-08T20:27:52.182 INFO:tasks.workunit.client.1.smithi111.stdout:4/355: truncate d8/da/d29/f33 253885 0 2023-12-08T20:27:52.182 INFO:tasks.workunit.client.1.smithi111.stdout:4/356: chown d8/da/d2c/d1f/d40/f55 1 1 2023-12-08T20:27:52.184 INFO:tasks.workunit.client.1.smithi111.stdout:5/460: mkdir d3/d4/d7/d36/d64/d98 0 2023-12-08T20:27:52.184 INFO:tasks.workunit.client.1.smithi111.stdout:5/461: dread - d3/d12/f87 zero size 2023-12-08T20:27:52.185 INFO:tasks.workunit.client.1.smithi111.stdout:1/477: dwrite d0/d6/d33/d15/d51/d5b/d5e/faa [0,4194304] 0 2023-12-08T20:27:52.186 INFO:tasks.workunit.client.1.smithi111.stdout:5/462: rename d3/d4/d7/d29/d30/c4d to d3/d8d/c99 0 2023-12-08T20:27:52.188 INFO:tasks.workunit.client.1.smithi111.stdout:2/441: rmdir d1/d1d/d1f/d25 39 2023-12-08T20:27:52.189 INFO:tasks.workunit.client.1.smithi111.stdout:8/455: dwrite dd/d2d/f45 [0,4194304] 0 2023-12-08T20:27:52.195 INFO:tasks.workunit.client.1.smithi111.stdout:1/478: mkdir d0/d8e/db0 0 2023-12-08T20:27:52.195 INFO:tasks.workunit.client.1.smithi111.stdout:2/442: mknod d1/ca9 0 2023-12-08T20:27:52.195 INFO:tasks.workunit.client.1.smithi111.stdout:8/456: mknod dd/d35/ca1 0 2023-12-08T20:27:52.197 INFO:tasks.workunit.client.1.smithi111.stdout:8/457: creat dd/d96/fa2 x:0 0 0 2023-12-08T20:27:52.197 INFO:tasks.workunit.client.1.smithi111.stdout:8/458: chown dd/d32/d36/d4b/c6c 15029658 1 2023-12-08T20:27:52.198 INFO:tasks.workunit.client.1.smithi111.stdout:1/479: write d0/d6/d33/ff [835560,11323] 0 2023-12-08T20:27:52.214 INFO:tasks.workunit.client.1.smithi111.stdout:8/459: rename dd/d35/d42/f47 to dd/d32/d3d/d55/fa3 0 2023-12-08T20:27:52.214 INFO:tasks.workunit.client.1.smithi111.stdout:8/460: mkdir dd/d2d/d8b/d8d/da4 0 2023-12-08T20:27:52.214 INFO:tasks.workunit.client.1.smithi111.stdout:8/461: creat dd/d35/d42/fa5 x:0 0 0 2023-12-08T20:27:52.214 INFO:tasks.workunit.client.1.smithi111.stdout:8/462: fsync dd/d2d/f31 0 2023-12-08T20:27:52.214 INFO:tasks.workunit.client.1.smithi111.stdout:8/463: write dd/d2d/f31 [744572,121648] 0 2023-12-08T20:27:52.214 INFO:tasks.workunit.client.1.smithi111.stdout:5/463: dwrite d3/d4/d4a/d21/f91 [0,4194304] 0 2023-12-08T20:27:52.214 INFO:tasks.workunit.client.1.smithi111.stdout:4/357: dwrite d8/da/f75 [0,4194304] 0 2023-12-08T20:27:52.216 INFO:tasks.workunit.client.1.smithi111.stdout:4/358: getdents d8 0 2023-12-08T20:27:52.218 INFO:tasks.workunit.client.1.smithi111.stdout:2/443: dwrite d1/d1d/d1f/d25/d3d/d41/f74 [0,4194304] 0 2023-12-08T20:27:52.219 INFO:tasks.workunit.client.1.smithi111.stdout:1/480: write d0/d6/d33/d15/d51/d5b/d5e/faa [4653317,112210] 0 2023-12-08T20:27:52.233 INFO:tasks.workunit.client.1.smithi111.stdout:8/464: dwrite dd/f14 [0,4194304] 0 2023-12-08T20:27:52.233 INFO:tasks.workunit.client.1.smithi111.stdout:8/465: dread - dd/d32/d3d/f88 zero size 2023-12-08T20:27:52.240 INFO:tasks.workunit.client.1.smithi111.stdout:1/481: creat d0/d4d/fb1 x:0 0 0 2023-12-08T20:27:52.242 INFO:tasks.workunit.client.1.smithi111.stdout:1/482: mknod d0/d6/d33/d6c/d75/d89/cb2 0 2023-12-08T20:27:52.242 INFO:tasks.workunit.client.1.smithi111.stdout:1/483: fdatasync d0/d6/d33/d15/f98 0 2023-12-08T20:27:52.244 INFO:tasks.workunit.client.1.smithi111.stdout:5/464: dwrite d3/d4/d7/d36/f68 [0,4194304] 0 2023-12-08T20:27:52.244 INFO:tasks.workunit.client.1.smithi111.stdout:2/444: dwrite d1/f13 [0,4194304] 0 2023-12-08T20:27:52.244 INFO:tasks.workunit.client.1.smithi111.stdout:1/484: creat d0/d6/d33/d15/d51/d5b/fb3 x:0 0 0 2023-12-08T20:27:52.244 INFO:tasks.workunit.client.1.smithi111.stdout:1/485: chown d0/d6/d33/d15/d51/d5b/d5e/lae 401 1 2023-12-08T20:27:52.244 INFO:tasks.workunit.client.1.smithi111.stdout:4/359: dwrite d8/da/d2c/d1f/d2b/f3d [0,4194304] 0 2023-12-08T20:27:52.252 INFO:tasks.workunit.client.1.smithi111.stdout:1/486: dread d0/d6/d47/f50 [0,4194304] 0 2023-12-08T20:27:52.252 INFO:tasks.workunit.client.1.smithi111.stdout:1/487: readlink d0/d6/d34/l3e 0 2023-12-08T20:27:52.253 INFO:tasks.workunit.client.1.smithi111.stdout:1/488: symlink d0/lb4 0 2023-12-08T20:27:52.254 INFO:tasks.workunit.client.1.smithi111.stdout:1/489: truncate d0/f31 1585153 0 2023-12-08T20:27:52.257 INFO:tasks.workunit.client.1.smithi111.stdout:8/466: dwrite dd/d2d/f3c [0,4194304] 0 2023-12-08T20:27:52.257 INFO:tasks.workunit.client.1.smithi111.stdout:8/467: stat dd/d2d/d62 0 2023-12-08T20:27:52.257 INFO:tasks.workunit.client.1.smithi111.stdout:8/468: chown dd/d32/d36/f7d 2574 1 2023-12-08T20:27:52.260 INFO:tasks.workunit.client.1.smithi111.stdout:6/288: sync 2023-12-08T20:27:52.262 INFO:tasks.workunit.client.1.smithi111.stdout:1/490: rmdir d0/d6/d33/d15/d51/d2e/d61 39 2023-12-08T20:27:52.267 INFO:tasks.workunit.client.1.smithi111.stdout:8/469: truncate dd/d32/d36/d4b/f52 3935659 0 2023-12-08T20:27:52.267 INFO:tasks.workunit.client.1.smithi111.stdout:1/491: dread d0/d6/d47/f50 [0,4194304] 0 2023-12-08T20:27:52.267 INFO:tasks.workunit.client.1.smithi111.stdout:1/492: readlink d0/d6/d33/d60/l83 0 2023-12-08T20:27:52.267 INFO:tasks.workunit.client.1.smithi111.stdout:5/465: dwrite d3/d4/d7/d36/d64/f86 [0,4194304] 0 2023-12-08T20:27:52.268 INFO:tasks.workunit.client.1.smithi111.stdout:8/470: symlink dd/d35/d42/la6 0 2023-12-08T20:27:52.269 INFO:tasks.workunit.client.1.smithi111.stdout:1/493: truncate d0/d6/d33/d15/d51/f6e 959736 0 2023-12-08T20:27:52.269 INFO:tasks.workunit.client.1.smithi111.stdout:2/445: dwrite d1/d29/f95 [0,4194304] 0 2023-12-08T20:27:52.270 INFO:tasks.workunit.client.1.smithi111.stdout:5/466: dread d3/d4/d7/d2c/f41 [0,4194304] 0 2023-12-08T20:27:52.271 INFO:tasks.workunit.client.1.smithi111.stdout:5/467: stat d3/d4/d4a/c23 0 2023-12-08T20:27:52.272 INFO:tasks.workunit.client.1.smithi111.stdout:1/494: dread d0/d6/d33/d15/d51/f43 [0,4194304] 0 2023-12-08T20:27:52.276 INFO:tasks.workunit.client.1.smithi111.stdout:5/468: symlink d3/d4/d7/d29/d73/l9a 0 2023-12-08T20:27:52.277 INFO:tasks.workunit.client.1.smithi111.stdout:1/495: mkdir d0/d6/d33/d8b/db5 0 2023-12-08T20:27:52.279 INFO:tasks.workunit.client.1.smithi111.stdout:5/469: creat d3/d4/d7/d29/f9b x:0 0 0 2023-12-08T20:27:52.279 INFO:tasks.workunit.client.1.smithi111.stdout:5/470: dread - d3/d4/d7/f8b zero size 2023-12-08T20:27:52.280 INFO:tasks.workunit.client.1.smithi111.stdout:5/471: fsync d3/d4/d4a/f7a 0 2023-12-08T20:27:52.282 INFO:tasks.workunit.client.1.smithi111.stdout:5/472: mknod d3/d4/d7/d2c/d84/c9c 0 2023-12-08T20:27:52.284 INFO:tasks.workunit.client.1.smithi111.stdout:5/473: creat d3/d4/d7/d29/d30/f9d x:0 0 0 2023-12-08T20:27:52.285 INFO:tasks.workunit.client.1.smithi111.stdout:5/474: write d3/d4/f5b [4054831,129137] 0 2023-12-08T20:27:52.288 INFO:tasks.workunit.client.1.smithi111.stdout:5/475: link d3/d4/d7/d2c/f4c d3/d4/d7/d29/d73/f9e 0 2023-12-08T20:27:52.288 INFO:tasks.workunit.client.1.smithi111.stdout:5/476: fsync d3/d4/d7/d36/f68 0 2023-12-08T20:27:52.288 INFO:tasks.workunit.client.1.smithi111.stdout:5/477: dread - d3/d6d/f81 zero size 2023-12-08T20:27:52.290 INFO:tasks.workunit.client.1.smithi111.stdout:8/471: dwrite dd/d32/f48 [0,4194304] 0 2023-12-08T20:27:52.290 INFO:tasks.workunit.client.1.smithi111.stdout:8/472: write dd/d2d/f78 [370937,81941] 0 2023-12-08T20:27:52.290 INFO:tasks.workunit.client.1.smithi111.stdout:8/473: fdatasync dd/d32/d36/d4b/f9d 0 2023-12-08T20:27:52.290 INFO:tasks.workunit.client.1.smithi111.stdout:8/474: dread - dd/d32/d3d/d55/f82 zero size 2023-12-08T20:27:52.292 INFO:tasks.workunit.client.1.smithi111.stdout:5/478: creat d3/d4/d7/d36/d64/d8a/f9f x:0 0 0 2023-12-08T20:27:52.295 INFO:tasks.workunit.client.1.smithi111.stdout:8/475: truncate dd/d32/d3d/f5a 1264410 0 2023-12-08T20:27:52.298 INFO:tasks.workunit.client.1.smithi111.stdout:5/479: creat d3/d4/d7/d29/d73/fa0 x:0 0 0 2023-12-08T20:27:52.301 INFO:tasks.workunit.client.1.smithi111.stdout:5/480: creat d3/d4/d7/d29/d73/d90/fa1 x:0 0 0 2023-12-08T20:27:52.304 INFO:tasks.workunit.client.1.smithi111.stdout:2/446: dwrite d1/d29/d53/d90/f6e [0,4194304] 0 2023-12-08T20:27:52.304 INFO:tasks.workunit.client.1.smithi111.stdout:2/447: chown d1/d1d/d68/d73/l9d 1356689509 1 2023-12-08T20:27:52.305 INFO:tasks.workunit.client.1.smithi111.stdout:1/496: dwrite d0/d6/d33/d15/f98 [0,4194304] 0 2023-12-08T20:27:52.305 INFO:tasks.workunit.client.1.smithi111.stdout:1/497: write d0/d6/d33/f64 [4354198,59463] 0 2023-12-08T20:27:52.305 INFO:tasks.workunit.client.1.smithi111.stdout:5/481: dread d3/d4/d4a/f5f [0,4194304] 0 2023-12-08T20:27:52.307 INFO:tasks.workunit.client.1.smithi111.stdout:2/448: creat d1/d1d/d1f/d25/d67/faa x:0 0 0 2023-12-08T20:27:52.309 INFO:tasks.workunit.client.1.smithi111.stdout:5/482: mknod d3/d4/d7/d36/d64/d96/ca2 0 2023-12-08T20:27:52.310 INFO:tasks.workunit.client.1.smithi111.stdout:2/449: mknod d1/d1d/d1f/d25/d3d/d41/cab 0 2023-12-08T20:27:52.310 INFO:tasks.workunit.client.1.smithi111.stdout:2/450: stat d1/d1d/d55/l8f 0 2023-12-08T20:27:52.310 INFO:tasks.workunit.client.1.smithi111.stdout:2/451: truncate d1/d1d/d1f/d25/d3d/d56/f7a 1082341 0 2023-12-08T20:27:52.311 INFO:tasks.workunit.client.1.smithi111.stdout:5/483: creat d3/d12/d67/fa3 x:0 0 0 2023-12-08T20:27:52.342 INFO:tasks.workunit.client.1.smithi111.stdout:0/585: sync 2023-12-08T20:27:52.343 INFO:tasks.workunit.client.1.smithi111.stdout:9/455: sync 2023-12-08T20:27:52.343 INFO:tasks.workunit.client.1.smithi111.stdout:9/456: fdatasync d2/d8/dd/d1a/d1e/d2d/d35/d88/f99 0 2023-12-08T20:27:52.343 INFO:tasks.workunit.client.1.smithi111.stdout:0/586: mkdir d1/dd/d4a/dcb 0 2023-12-08T20:27:52.352 INFO:tasks.workunit.client.1.smithi111.stdout:0/587: dread d1/d4/d24/d46/d58/d65/f9a [0,4194304] 0 2023-12-08T20:27:52.355 INFO:tasks.workunit.client.1.smithi111.stdout:9/457: dwrite d2/d8/dd/d1a/d66/f93 [0,4194304] 0 2023-12-08T20:27:52.380 INFO:tasks.workunit.client.1.smithi111.stdout:0/588: dwrite d1/d2d/f41 [0,4194304] 0 2023-12-08T20:27:52.380 INFO:tasks.workunit.client.1.smithi111.stdout:9/458: dwrite d2/f2c [4194304,4194304] 0 2023-12-08T20:27:52.380 INFO:tasks.workunit.client.1.smithi111.stdout:9/459: truncate d2/d8/dd/d1a/f6f 896990 0 2023-12-08T20:27:52.381 INFO:tasks.workunit.client.1.smithi111.stdout:0/589: rename d1/d4/d24/d46/d58/fa4 to d1/df/d16/d2c/d7e/fcc 0 2023-12-08T20:27:52.382 INFO:tasks.workunit.client.1.smithi111.stdout:0/590: readlink d1/df/d16/d2c/la0 0 2023-12-08T20:27:52.383 INFO:tasks.workunit.client.1.smithi111.stdout:0/591: write d1/df/f3b [4395569,76028] 0 2023-12-08T20:27:52.384 INFO:tasks.workunit.client.1.smithi111.stdout:9/460: mknod d2/d8/dd/d1a/d1e/d2d/d35/d6b/ca3 0 2023-12-08T20:27:52.385 INFO:tasks.workunit.client.1.smithi111.stdout:0/592: link d1/d4/d24/d46/fa8 d1/d2d/d83/fcd 0 2023-12-08T20:27:52.385 INFO:tasks.workunit.client.1.smithi111.stdout:0/593: chown d1/d4/d24/d46/d49/d7f/d95 47 1 2023-12-08T20:27:52.385 INFO:tasks.workunit.client.1.smithi111.stdout:0/594: dread - d1/df/d44/d37/fa7 zero size 2023-12-08T20:27:52.385 INFO:tasks.workunit.client.1.smithi111.stdout:0/595: chown d1/df/d44/d37/d5c/c78 24115423 1 2023-12-08T20:27:52.390 INFO:tasks.workunit.client.1.smithi111.stdout:0/596: mkdir d1/df/d44/d37/dac/dce 0 2023-12-08T20:27:52.391 INFO:tasks.workunit.client.1.smithi111.stdout:0/597: mknod d1/d4/d24/d46/db7/ccf 0 2023-12-08T20:27:52.392 INFO:tasks.workunit.client.1.smithi111.stdout:0/598: rename d1/df/d44/f43 to d1/df/fd0 0 2023-12-08T20:27:52.392 INFO:tasks.workunit.client.1.smithi111.stdout:0/599: readlink d1/d4/d24/d46/d49/l5b 0 2023-12-08T20:27:52.396 INFO:tasks.workunit.client.1.smithi111.stdout:0/600: write d1/d4/f73 [748276,60096] 0 2023-12-08T20:27:52.396 INFO:tasks.workunit.client.1.smithi111.stdout:0/601: chown d1/d2d/d83 2 1 2023-12-08T20:27:52.396 INFO:tasks.workunit.client.1.smithi111.stdout:0/602: write d1/d4/d24/d46/d49/d6e/fc1 [3919832,95235] 0 2023-12-08T20:27:52.397 INFO:tasks.workunit.client.1.smithi111.stdout:0/603: write d1/df/d16/d2c/d7b/fca [484947,80828] 0 2023-12-08T20:27:52.398 INFO:tasks.workunit.client.1.smithi111.stdout:0/604: dread d1/dd/f11 [4194304,4194304] 0 2023-12-08T20:27:52.398 INFO:tasks.workunit.client.1.smithi111.stdout:9/461: dwrite d2/f2c [4194304,4194304] 0 2023-12-08T20:27:52.398 INFO:tasks.workunit.client.1.smithi111.stdout:0/605: creat d1/d4/d3a/d8c/fd1 x:0 0 0 2023-12-08T20:27:52.400 INFO:tasks.workunit.client.1.smithi111.stdout:9/462: creat d2/d8/dd/d1a/d1e/d2d/d4a/d62/fa4 x:0 0 0 2023-12-08T20:27:52.400 INFO:tasks.workunit.client.1.smithi111.stdout:9/463: readlink d2/d8/d9b/l46 0 2023-12-08T20:27:52.400 INFO:tasks.workunit.client.1.smithi111.stdout:0/606: creat d1/d69/fd2 x:0 0 0 2023-12-08T20:27:52.401 INFO:tasks.workunit.client.1.smithi111.stdout:9/464: symlink d2/d8/dd/d1a/d1e/d2d/d8f/la5 0 2023-12-08T20:27:52.401 INFO:tasks.workunit.client.1.smithi111.stdout:9/465: fdatasync d2/d8/dd/d1a/d1e/d2d/f51 0 2023-12-08T20:27:52.402 INFO:tasks.workunit.client.1.smithi111.stdout:9/466: mknod d2/d8/dd/d1a/d1e/d2d/d4a/d62/ca6 0 2023-12-08T20:27:52.404 INFO:tasks.workunit.client.1.smithi111.stdout:9/467: symlink d2/d8/dd/d1a/d1e/d2d/la7 0 2023-12-08T20:27:52.405 INFO:tasks.workunit.client.1.smithi111.stdout:9/468: rename d2/d8/dd/d1a/d1e/d2d/d35/d6b/f79 to d2/da/fa8 0 2023-12-08T20:27:52.422 INFO:tasks.workunit.client.1.smithi111.stdout:0/607: dwrite d1/d4/d3a/d8c/f96 [4194304,4194304] 0 2023-12-08T20:27:52.425 INFO:tasks.workunit.client.1.smithi111.stdout:0/608: symlink d1/d4/d24/d46/d58/d65/ld3 0 2023-12-08T20:27:52.426 INFO:tasks.workunit.client.1.smithi111.stdout:9/469: dwrite d2/d8/dd/f6c [0,4194304] 0 2023-12-08T20:27:52.426 INFO:tasks.workunit.client.1.smithi111.stdout:0/609: symlink d1/df/d44/d37/ld4 0 2023-12-08T20:27:52.439 INFO:tasks.workunit.client.1.smithi111.stdout:0/610: rename d1/df/d16/d2c/d7e/fb1 to d1/d4/d24/d46/d49/d7f/fd5 0 2023-12-08T20:27:52.441 INFO:tasks.workunit.client.1.smithi111.stdout:9/470: dwrite d2/d8/dd/d1a/d74/f82 [0,4194304] 0 2023-12-08T20:27:52.447 INFO:tasks.workunit.client.1.smithi111.stdout:0/611: dread d1/df/d56/f63 [0,4194304] 0 2023-12-08T20:27:52.448 INFO:tasks.workunit.client.1.smithi111.stdout:0/612: write d1/df/fd0 [2822551,109746] 0 2023-12-08T20:27:52.448 INFO:tasks.workunit.client.1.smithi111.stdout:0/613: fsync d1/df/d56/f63 0 2023-12-08T20:27:52.448 INFO:tasks.workunit.client.1.smithi111.stdout:9/471: dread d2/d8/d9b/f28 [0,4194304] 0 2023-12-08T20:27:52.448 INFO:tasks.workunit.client.1.smithi111.stdout:9/472: fdatasync d2/d8/dd/d1a/d1e/d2d/d35/f3e 0 2023-12-08T20:27:52.448 INFO:tasks.workunit.client.1.smithi111.stdout:9/473: fdatasync d2/d8/dd/d1a/d1e/d2d/d35/d6b/f90 0 2023-12-08T20:27:52.449 INFO:tasks.workunit.client.1.smithi111.stdout:9/474: unlink d2/d8/dd/d1a/l27 0 2023-12-08T20:27:52.449 INFO:tasks.workunit.client.1.smithi111.stdout:9/475: write d2/d8/d8c/f94 [829892,96943] 0 2023-12-08T20:27:52.450 INFO:tasks.workunit.client.1.smithi111.stdout:9/476: creat d2/d8/dd/d1a/d1e/d2d/d4a/fa9 x:0 0 0 2023-12-08T20:27:52.451 INFO:tasks.workunit.client.1.smithi111.stdout:9/477: creat d2/d8/dd/d1a/d1e/d2d/d8f/faa x:0 0 0 2023-12-08T20:27:52.452 INFO:tasks.workunit.client.1.smithi111.stdout:9/478: truncate d2/f59 206685 0 2023-12-08T20:27:52.453 INFO:tasks.workunit.client.1.smithi111.stdout:9/479: creat d2/d8/dd/d1a/d1e/d2d/d4a/fab x:0 0 0 2023-12-08T20:27:52.454 INFO:tasks.workunit.client.1.smithi111.stdout:0/614: dread d1/f57 [0,4194304] 0 2023-12-08T20:27:52.454 INFO:tasks.workunit.client.1.smithi111.stdout:9/480: write d2/d8/f9 [2756632,35364] 0 2023-12-08T20:27:52.455 INFO:tasks.workunit.client.1.smithi111.stdout:0/615: truncate d1/d4/d24/d46/d58/f6d 4105538 0 2023-12-08T20:27:52.455 INFO:tasks.workunit.client.1.smithi111.stdout:0/616: readlink d1/df/l20 0 2023-12-08T20:27:52.457 INFO:tasks.workunit.client.1.smithi111.stdout:9/481: mknod d2/d8/dd/d1a/d1e/d2d/cac 0 2023-12-08T20:27:52.458 INFO:tasks.workunit.client.1.smithi111.stdout:9/482: creat d2/d8/dd/d56/fad x:0 0 0 2023-12-08T20:27:52.458 INFO:tasks.workunit.client.1.smithi111.stdout:9/483: chown d2/da/fc 233 1 2023-12-08T20:27:52.460 INFO:tasks.workunit.client.1.smithi111.stdout:9/484: symlink d2/d8/lae 0 2023-12-08T20:27:52.461 INFO:tasks.workunit.client.1.smithi111.stdout:9/485: symlink d2/d8/dd/d1a/d74/laf 0 2023-12-08T20:27:52.469 INFO:tasks.workunit.client.1.smithi111.stdout:0/617: dwrite d1/df/d16/d2c/f8d [0,4194304] 0 2023-12-08T20:27:52.471 INFO:tasks.workunit.client.1.smithi111.stdout:9/486: dread d2/d8/dd/d56/f72 [0,4194304] 0 2023-12-08T20:27:52.471 INFO:tasks.workunit.client.1.smithi111.stdout:9/487: fdatasync d2/d8/dd/d1a/d1e/d2d/f51 0 2023-12-08T20:27:52.474 INFO:tasks.workunit.client.1.smithi111.stdout:0/618: mkdir d1/d2d/d83/dd6 0 2023-12-08T20:27:52.475 INFO:tasks.workunit.client.1.smithi111.stdout:0/619: dread d1/df/d16/d2c/d7e/fcc [0,4194304] 0 2023-12-08T20:27:52.475 INFO:tasks.workunit.client.1.smithi111.stdout:0/620: write d1/df/d16/d2c/d7b/f87 [5073264,8629] 0 2023-12-08T20:27:52.475 INFO:tasks.workunit.client.1.smithi111.stdout:0/621: chown d1/dd/f11 15004662 1 2023-12-08T20:27:52.476 INFO:tasks.workunit.client.1.smithi111.stdout:9/488: creat d2/d8/dd/fb0 x:0 0 0 2023-12-08T20:27:52.476 INFO:tasks.workunit.client.1.smithi111.stdout:0/622: getdents d1/d4/d24/d46/d49/d7f/d95/db8 0 2023-12-08T20:27:52.477 INFO:tasks.workunit.client.1.smithi111.stdout:0/623: write d1/d4/d3a/f4b [2612905,27841] 0 2023-12-08T20:27:52.477 INFO:tasks.workunit.client.1.smithi111.stdout:0/624: readlink d1/df/d16/d2c/la0 0 2023-12-08T20:27:52.480 INFO:tasks.workunit.client.1.smithi111.stdout:3/395: sync 2023-12-08T20:27:52.480 INFO:tasks.workunit.client.1.smithi111.stdout:7/366: sync 2023-12-08T20:27:52.482 INFO:tasks.workunit.client.1.smithi111.stdout:0/625: creat d1/df/d16/d2c/d7b/fd7 x:0 0 0 2023-12-08T20:27:52.482 INFO:tasks.workunit.client.1.smithi111.stdout:0/626: truncate d1/df/d44/d37/f8a 44139 0 2023-12-08T20:27:52.482 INFO:tasks.workunit.client.1.smithi111.stdout:3/396: rmdir d2/d15/d17/d25 39 2023-12-08T20:27:52.482 INFO:tasks.workunit.client.1.smithi111.stdout:3/397: write d2/d12/f1a [4841731,88736] 0 2023-12-08T20:27:52.483 INFO:tasks.workunit.client.1.smithi111.stdout:0/627: creat d1/d4/d24/d46/d49/d7f/d95/fd8 x:0 0 0 2023-12-08T20:27:52.483 INFO:tasks.workunit.client.1.smithi111.stdout:0/628: write d1/df/d16/fae [536318,71058] 0 2023-12-08T20:27:52.483 INFO:tasks.workunit.client.1.smithi111.stdout:0/629: truncate d1/df/d16/fb4 384671 0 2023-12-08T20:27:52.484 INFO:tasks.workunit.client.1.smithi111.stdout:7/367: dread da/d5c/f52 [0,4194304] 0 2023-12-08T20:27:52.485 INFO:tasks.workunit.client.1.smithi111.stdout:0/630: mknod d1/df/d16/d2c/cd9 0 2023-12-08T20:27:52.486 INFO:tasks.workunit.client.1.smithi111.stdout:0/631: getdents d1/d4/d24/d46/d49/d6e 0 2023-12-08T20:27:52.487 INFO:tasks.workunit.client.1.smithi111.stdout:0/632: readlink d1/df/d44/d37/d5c/d70/l72 0 2023-12-08T20:27:52.487 INFO:tasks.workunit.client.1.smithi111.stdout:0/633: dread - d1/df/d16/d2c/d7b/fd7 zero size 2023-12-08T20:27:52.489 INFO:tasks.workunit.client.1.smithi111.stdout:0/634: getdents d1/df/d44/d37 0 2023-12-08T20:27:52.489 INFO:tasks.workunit.client.1.smithi111.stdout:9/489: dwrite d2/d8/dd/d1a/d66/f93 [0,4194304] 0 2023-12-08T20:27:52.491 INFO:tasks.workunit.client.1.smithi111.stdout:7/368: dread da/d25/d26/f4d [0,4194304] 0 2023-12-08T20:27:52.491 INFO:tasks.workunit.client.1.smithi111.stdout:7/369: write da/d5c/f52 [1229675,45549] 0 2023-12-08T20:27:52.492 INFO:tasks.workunit.client.1.smithi111.stdout:0/635: creat d1/dd/d47/fda x:0 0 0 2023-12-08T20:27:52.492 INFO:tasks.workunit.client.1.smithi111.stdout:0/636: chown d1/d4/d24/d46/d58/d65/f9a 4664415 1 2023-12-08T20:27:52.492 INFO:tasks.workunit.client.1.smithi111.stdout:0/637: fdatasync d1/df/d44/d37/d5c/d70/f81 0 2023-12-08T20:27:52.493 INFO:tasks.workunit.client.1.smithi111.stdout:9/490: link d2/d8/dd/d56/c9c d2/d8/d8c/d96/cb1 0 2023-12-08T20:27:52.493 INFO:tasks.workunit.client.1.smithi111.stdout:9/491: stat d2/da/c52 0 2023-12-08T20:27:52.494 INFO:tasks.workunit.client.1.smithi111.stdout:7/370: mknod da/d25/d3d/c7b 0 2023-12-08T20:27:52.495 INFO:tasks.workunit.client.1.smithi111.stdout:0/638: mknod d1/d4/d24/d46/db7/cdb 0 2023-12-08T20:27:52.496 INFO:tasks.workunit.client.1.smithi111.stdout:7/371: rmdir da/d5c/d59 39 2023-12-08T20:27:52.497 INFO:tasks.workunit.client.1.smithi111.stdout:7/372: fsync da/d25/d3d/d58/f5e 0 2023-12-08T20:27:52.498 INFO:tasks.workunit.client.1.smithi111.stdout:0/639: truncate d1/d4/f73 141811 0 2023-12-08T20:27:52.498 INFO:tasks.workunit.client.1.smithi111.stdout:7/373: write da/d25/f3b [144601,25459] 0 2023-12-08T20:27:52.499 INFO:tasks.workunit.client.1.smithi111.stdout:9/492: mknod d2/d8/dd/d1a/d1e/d2d/d35/d71/cb2 0 2023-12-08T20:27:52.500 INFO:tasks.workunit.client.1.smithi111.stdout:7/374: symlink da/d13/l7c 0 2023-12-08T20:27:52.501 INFO:tasks.workunit.client.1.smithi111.stdout:9/493: dread - d2/d8/dd/d1a/d1e/d2d/d35/f53 zero size 2023-12-08T20:27:52.503 INFO:tasks.workunit.client.1.smithi111.stdout:9/494: creat d2/d8/d8c/d96/fb3 x:0 0 0 2023-12-08T20:27:52.511 INFO:tasks.workunit.client.1.smithi111.stdout:0/640: dread d1/d4/d3a/d8c/f96 [0,4194304] 0 2023-12-08T20:27:52.521 INFO:tasks.workunit.client.1.smithi111.stdout:0/641: dread d1/df/d16/d2c/f8d [0,4194304] 0 2023-12-08T20:27:52.524 INFO:tasks.workunit.client.1.smithi111.stdout:0/642: rename d1/d2d/f3c to d1/df/d44/daa/fdc 0 2023-12-08T20:27:52.524 INFO:tasks.workunit.client.1.smithi111.stdout:7/375: dwrite da/d13/d21/f67 [0,4194304] 0 2023-12-08T20:27:52.525 INFO:tasks.workunit.client.1.smithi111.stdout:9/495: dwrite d2/d8/dd/d1a/d1e/d2d/f51 [0,4194304] 0 2023-12-08T20:27:52.525 INFO:tasks.workunit.client.1.smithi111.stdout:9/496: chown d2/d8/dd/d1a/d1e/d2d/d35/d71/cb2 10 1 2023-12-08T20:27:52.525 INFO:tasks.workunit.client.1.smithi111.stdout:9/497: truncate d2/d8/dd/d1a/f7f 796041 0 2023-12-08T20:27:52.526 INFO:tasks.workunit.client.1.smithi111.stdout:0/643: write d1/d4/d24/d2f/f7d [3073325,11631] 0 2023-12-08T20:27:52.527 INFO:tasks.workunit.client.1.smithi111.stdout:7/376: symlink da/l7d 0 2023-12-08T20:27:52.528 INFO:tasks.workunit.client.1.smithi111.stdout:7/377: truncate da/d25/d3d/d58/f66 892070 0 2023-12-08T20:27:52.528 INFO:tasks.workunit.client.1.smithi111.stdout:7/378: chown da/d25/d26/d32/f56 3115097 1 2023-12-08T20:27:52.531 INFO:tasks.workunit.client.1.smithi111.stdout:0/644: dread d1/df/d16/d2c/f8d [0,4194304] 0 2023-12-08T20:27:52.531 INFO:tasks.workunit.client.1.smithi111.stdout:0/645: chown d1/dd 159309 1 2023-12-08T20:27:52.534 INFO:tasks.workunit.client.1.smithi111.stdout:0/646: link d1/df/d44/daa/cb6 d1/df/cdd 0 2023-12-08T20:27:52.536 INFO:tasks.workunit.client.1.smithi111.stdout:0/647: rename d1/df/d16/d2c/cd9 to d1/d4/d24/d46/d49/d7f/d95/db8/cde 0 2023-12-08T20:27:52.537 INFO:tasks.workunit.client.1.smithi111.stdout:0/648: read d1/df/d16/f2e [830169,108839] 0 2023-12-08T20:27:52.538 INFO:tasks.workunit.client.1.smithi111.stdout:0/649: write d1/df/d16/f86 [14276,105781] 0 2023-12-08T20:27:52.539 INFO:tasks.workunit.client.1.smithi111.stdout:0/650: mkdir d1/d4/d24/d46/d49/d7f/ddf 0 2023-12-08T20:27:52.540 INFO:tasks.workunit.client.1.smithi111.stdout:0/651: getdents d1/d4/d3a 0 2023-12-08T20:27:52.546 INFO:tasks.workunit.client.1.smithi111.stdout:9/498: dwrite d2/d8/d9b/f81 [0,4194304] 0 2023-12-08T20:27:52.546 INFO:tasks.workunit.client.1.smithi111.stdout:9/499: dread - d2/d8/dd/d56/f73 zero size 2023-12-08T20:27:52.546 INFO:tasks.workunit.client.1.smithi111.stdout:9/500: fsync d2/d8/dd/d56/fad 0 2023-12-08T20:27:52.546 INFO:tasks.workunit.client.1.smithi111.stdout:7/379: dwrite da/d13/f1a [0,4194304] 0 2023-12-08T20:27:52.546 INFO:tasks.workunit.client.1.smithi111.stdout:7/380: readlink da/l1c 0 2023-12-08T20:27:52.549 INFO:tasks.workunit.client.1.smithi111.stdout:9/501: rename d2/d8/dd/d1a/d1e/d2d/d4a/fa9 to d2/d8/dd/fb4 0 2023-12-08T20:27:52.550 INFO:tasks.workunit.client.1.smithi111.stdout:0/652: dread d1/d4/d3a/f4b [0,4194304] 0 2023-12-08T20:27:52.553 INFO:tasks.workunit.client.1.smithi111.stdout:0/653: unlink d1/d4/lb5 0 2023-12-08T20:27:52.554 INFO:tasks.workunit.client.1.smithi111.stdout:0/654: write d1/df/f3b [4323013,123862] 0 2023-12-08T20:27:52.558 INFO:tasks.workunit.client.1.smithi111.stdout:9/502: dread d2/d8/dd/d1a/d1e/d2d/d35/f41 [4194304,4194304] 0 2023-12-08T20:27:52.560 INFO:tasks.workunit.client.1.smithi111.stdout:9/503: symlink d2/d8/dd/d1a/d1e/d2d/d35/lb5 0 2023-12-08T20:27:52.561 INFO:tasks.workunit.client.1.smithi111.stdout:9/504: creat d2/d8/fb6 x:0 0 0 2023-12-08T20:27:52.563 INFO:tasks.workunit.client.1.smithi111.stdout:9/505: link d2/da/fc d2/d8/dd/d1a/d1e/d2d/d4a/d62/fb7 0 2023-12-08T20:27:52.565 INFO:tasks.workunit.client.1.smithi111.stdout:0/655: dread d1/df/f3b [0,4194304] 0 2023-12-08T20:27:52.567 INFO:tasks.workunit.client.1.smithi111.stdout:0/656: rename d1/d4/d24/d46/d49/d6e/l89 to d1/df/d16/d2c/le0 0 2023-12-08T20:27:52.574 INFO:tasks.workunit.client.1.smithi111.stdout:9/506: getdents d2/d8/dd/d1a/d1e/d2d/d35 0 2023-12-08T20:27:52.574 INFO:tasks.workunit.client.1.smithi111.stdout:9/507: chown d2/c5 11584071 1 2023-12-08T20:27:52.574 INFO:tasks.workunit.client.1.smithi111.stdout:9/508: chown d2/d8/dd/d1a/d1e/d2d/d4a/f5a 6 1 2023-12-08T20:27:52.575 INFO:tasks.workunit.client.1.smithi111.stdout:0/657: dread d1/d4/d24/d46/d58/d65/f9a [0,4194304] 0 2023-12-08T20:27:52.577 INFO:tasks.workunit.client.1.smithi111.stdout:0/658: write d1/dd/f4e [844877,49022] 0 2023-12-08T20:27:52.577 INFO:tasks.workunit.client.1.smithi111.stdout:0/659: fdatasync d1/df/f3b 0 2023-12-08T20:27:52.580 INFO:tasks.workunit.client.1.smithi111.stdout:0/660: mknod d1/d4/d3a/d8c/ce1 0 2023-12-08T20:27:52.581 INFO:tasks.workunit.client.1.smithi111.stdout:0/661: creat d1/d4/d24/d46/d49/d7f/d95/db8/fe2 x:0 0 0 2023-12-08T20:27:52.582 INFO:tasks.workunit.client.1.smithi111.stdout:0/662: rename d1/df/d44/d37/l4d to d1/df/d16/le3 0 2023-12-08T20:27:52.583 INFO:tasks.workunit.client.1.smithi111.stdout:0/663: creat d1/df/fe4 x:0 0 0 2023-12-08T20:27:52.583 INFO:tasks.workunit.client.1.smithi111.stdout:0/664: write d1/d4/d24/d46/d58/f6d [4266680,63464] 0 2023-12-08T20:27:52.585 INFO:tasks.workunit.client.1.smithi111.stdout:0/665: link d1/d4/d24/d46/l50 d1/dd/le5 0 2023-12-08T20:27:52.585 INFO:tasks.workunit.client.1.smithi111.stdout:0/666: truncate d1/df/d16/fb4 1100123 0 2023-12-08T20:27:52.586 INFO:tasks.workunit.client.1.smithi111.stdout:9/509: dwrite d2/d8/dd/d1a/d74/f82 [4194304,4194304] 0 2023-12-08T20:27:52.589 INFO:tasks.workunit.client.1.smithi111.stdout:9/510: unlink d2/da/c52 0 2023-12-08T20:27:52.594 INFO:tasks.workunit.client.1.smithi111.stdout:9/511: link d2/d8/d8c/f94 d2/d8/dd/d1a/d1e/d2d/fb8 0 2023-12-08T20:27:52.598 INFO:tasks.workunit.client.1.smithi111.stdout:9/512: truncate d2/d8/d9b/f81 678361 0 2023-12-08T20:27:52.600 INFO:tasks.workunit.client.1.smithi111.stdout:0/667: dwrite d1/d69/fc5 [0,4194304] 0 2023-12-08T20:27:52.603 INFO:tasks.workunit.client.1.smithi111.stdout:0/668: fsync d1/dd/f4e 0 2023-12-08T20:27:52.603 INFO:tasks.workunit.client.1.smithi111.stdout:9/513: mkdir d2/d8/dd/d1a/d1e/d2d/db9 0 2023-12-08T20:27:52.604 INFO:tasks.workunit.client.1.smithi111.stdout:0/669: unlink d1/d4/d24/d46/d49/l5b 0 2023-12-08T20:27:52.604 INFO:tasks.workunit.client.1.smithi111.stdout:0/670: readlink d1/dd/l32 0 2023-12-08T20:27:52.609 INFO:tasks.workunit.client.1.smithi111.stdout:9/514: symlink d2/d8/lba 0 2023-12-08T20:27:52.609 INFO:tasks.workunit.client.1.smithi111.stdout:9/515: chown d2/d8/dd/d1a/d1e/d2d/l32 1 1 2023-12-08T20:27:52.609 INFO:tasks.workunit.client.1.smithi111.stdout:9/516: write d2/d8/dd/d1a/d1e/d2d/d35/f53 [212558,31347] 0 2023-12-08T20:27:52.609 INFO:tasks.workunit.client.1.smithi111.stdout:0/671: mknod d1/df/d44/daa/db2/ce6 0 2023-12-08T20:27:52.609 INFO:tasks.workunit.client.1.smithi111.stdout:0/672: unlink d1/d4/d24/d46/d49/d7f/d95/db8/lc3 0 2023-12-08T20:27:52.613 INFO:tasks.workunit.client.1.smithi111.stdout:9/517: dread d2/d8/f18 [0,4194304] 0 2023-12-08T20:27:52.613 INFO:tasks.workunit.client.1.smithi111.stdout:9/518: chown d2/d8/dd/d1a/d1e/d2d/d35/l3a 2 1 2023-12-08T20:27:52.613 INFO:tasks.workunit.client.1.smithi111.stdout:9/519: dread - d2/d8/dd/fb4 zero size 2023-12-08T20:27:52.615 INFO:tasks.workunit.client.1.smithi111.stdout:9/520: mkdir d2/d8/d8c/dbb 0 2023-12-08T20:27:52.634 INFO:tasks.workunit.client.1.smithi111.stdout:0/673: dwrite d1/df/fe4 [0,4194304] 0 2023-12-08T20:27:52.634 INFO:tasks.workunit.client.1.smithi111.stdout:9/521: dwrite d2/d8/dd/d56/f85 [0,4194304] 0 2023-12-08T20:27:52.636 INFO:tasks.workunit.client.1.smithi111.stdout:0/674: unlink d1/df/fe4 0 2023-12-08T20:27:52.637 INFO:tasks.workunit.client.1.smithi111.stdout:0/675: read d1/df/fd0 [289800,31795] 0 2023-12-08T20:27:52.639 INFO:tasks.workunit.client.1.smithi111.stdout:0/676: dread d1/d4/f55 [0,4194304] 0 2023-12-08T20:27:52.643 INFO:tasks.workunit.client.1.smithi111.stdout:9/522: dread d2/d8/dd/f4e [0,4194304] 0 2023-12-08T20:27:52.643 INFO:tasks.workunit.client.1.smithi111.stdout:9/523: read d2/d8/dd/d56/f58 [1599547,66438] 0 2023-12-08T20:27:52.644 INFO:tasks.workunit.client.1.smithi111.stdout:9/524: readlink d2/d8/dd/d1a/d1e/d2d/d35/l3a 0 2023-12-08T20:27:52.661 INFO:tasks.workunit.client.1.smithi111.stdout:0/677: dwrite d1/d4/f55 [0,4194304] 0 2023-12-08T20:27:52.662 INFO:tasks.workunit.client.1.smithi111.stdout:9/525: dwrite d2/d8/dd/d1a/d1e/d2d/d35/f3e [0,4194304] 0 2023-12-08T20:27:52.663 INFO:tasks.workunit.client.1.smithi111.stdout:0/678: creat d1/df/d16/d2c/fe7 x:0 0 0 2023-12-08T20:27:52.666 INFO:tasks.workunit.client.1.smithi111.stdout:9/526: rmdir d2/d8/dd/d1a/d74 39 2023-12-08T20:27:52.666 INFO:tasks.workunit.client.1.smithi111.stdout:9/527: stat d2/d8/dd/d1a/d1e/d2d/d35/f53 0 2023-12-08T20:27:52.667 INFO:tasks.workunit.client.1.smithi111.stdout:9/528: truncate d2/d8/dd/d1a/d1e/d2d/fb8 91370 0 2023-12-08T20:27:52.690 INFO:tasks.workunit.client.1.smithi111.stdout:0/679: dwrite d1/dd/d47/fc8 [0,4194304] 0 2023-12-08T20:27:52.691 INFO:tasks.workunit.client.1.smithi111.stdout:9/529: dwrite d2/d8/dd/d1a/d1e/d2d/d35/f6a [0,4194304] 0 2023-12-08T20:27:52.692 INFO:tasks.workunit.client.1.smithi111.stdout:0/680: creat d1/df/d16/d2c/d7e/fe8 x:0 0 0 2023-12-08T20:27:52.695 INFO:tasks.workunit.client.1.smithi111.stdout:9/530: symlink d2/d8/dd/d1a/d1e/d2d/lbc 0 2023-12-08T20:27:52.696 INFO:tasks.workunit.client.1.smithi111.stdout:9/531: dread - d2/d8/dd/d1a/d1e/d2d/d35/d88/f99 zero size 2023-12-08T20:27:52.700 INFO:tasks.workunit.client.1.smithi111.stdout:0/681: dread d1/d4/f35 [0,4194304] 0 2023-12-08T20:27:52.700 INFO:tasks.workunit.client.1.smithi111.stdout:0/682: dread - d1/df/d16/d2c/fe7 zero size 2023-12-08T20:27:52.700 INFO:tasks.workunit.client.1.smithi111.stdout:0/683: write d1/dd/f11 [4995951,38190] 0 2023-12-08T20:27:52.700 INFO:tasks.workunit.client.1.smithi111.stdout:0/684: fsync d1/d2d/f39 0 2023-12-08T20:27:52.701 INFO:tasks.workunit.client.1.smithi111.stdout:0/685: creat d1/dd/d47/fe9 x:0 0 0 2023-12-08T20:27:52.702 INFO:tasks.workunit.client.1.smithi111.stdout:0/686: mkdir d1/df/dea 0 2023-12-08T20:27:52.702 INFO:tasks.workunit.client.1.smithi111.stdout:0/687: readlink d1/df/l26 0 2023-12-08T20:27:52.704 INFO:tasks.workunit.client.1.smithi111.stdout:0/688: rmdir d1/df/d16/d2c 39 2023-12-08T20:27:52.704 INFO:tasks.workunit.client.1.smithi111.stdout:0/689: readlink d1/d4/d24/l27 0 2023-12-08T20:27:52.704 INFO:tasks.workunit.client.1.smithi111.stdout:0/690: fsync d1/dd/d47/fc8 0 2023-12-08T20:27:52.704 INFO:tasks.workunit.client.1.smithi111.stdout:9/532: rmdir d2 39 2023-12-08T20:27:52.706 INFO:tasks.workunit.client.1.smithi111.stdout:6/289: sync 2023-12-08T20:27:52.706 INFO:tasks.workunit.client.1.smithi111.stdout:4/360: sync 2023-12-08T20:27:52.707 INFO:tasks.workunit.client.1.smithi111.stdout:8/476: sync 2023-12-08T20:27:52.707 INFO:tasks.workunit.client.1.smithi111.stdout:4/361: chown d8/da/d29 5 1 2023-12-08T20:27:52.707 INFO:tasks.workunit.client.1.smithi111.stdout:6/290: write d0/d1/d1e/f42 [213826,25916] 0 2023-12-08T20:27:52.707 INFO:tasks.workunit.client.1.smithi111.stdout:6/291: fdatasync d0/d1/d27/f2f 0 2023-12-08T20:27:52.707 INFO:tasks.workunit.client.1.smithi111.stdout:6/292: chown d0/d1/la 716934 1 2023-12-08T20:27:52.707 INFO:tasks.workunit.client.1.smithi111.stdout:9/533: write d2/d8/dd/d1a/d1e/f63 [832614,91709] 0 2023-12-08T20:27:52.707 INFO:tasks.workunit.client.1.smithi111.stdout:9/534: write d2/d8/d8c/d96/fb3 [745231,120619] 0 2023-12-08T20:27:52.707 INFO:tasks.workunit.client.1.smithi111.stdout:9/535: getdents d2/d8/dd/d1a/d1e/d2d/d35 0 2023-12-08T20:27:52.707 INFO:tasks.workunit.client.1.smithi111.stdout:0/691: creat d1/d4/d24/d46/d58/feb x:0 0 0 2023-12-08T20:27:52.707 INFO:tasks.workunit.client.1.smithi111.stdout:0/692: write d1/d4/d3a/d8c/fd1 [525169,2835] 0 2023-12-08T20:27:52.707 INFO:tasks.workunit.client.1.smithi111.stdout:0/693: read - d1/d4/faf zero size 2023-12-08T20:27:52.707 INFO:tasks.workunit.client.1.smithi111.stdout:8/477: write dd/d2d/f33 [2736630,55785] 0 2023-12-08T20:27:52.708 INFO:tasks.workunit.client.1.smithi111.stdout:4/362: symlink d8/da/d29/d5c/d64/l76 0 2023-12-08T20:27:52.708 INFO:tasks.workunit.client.1.smithi111.stdout:6/293: link d0/d1/d27/d36/c45 d0/d1/d27/d36/c59 0 2023-12-08T20:27:52.709 INFO:tasks.workunit.client.1.smithi111.stdout:9/536: symlink d2/d8/dd/d56/lbd 0 2023-12-08T20:27:52.710 INFO:tasks.workunit.client.1.smithi111.stdout:0/694: creat d1/d4/d24/d46/d49/d7f/d95/db8/fec x:0 0 0 2023-12-08T20:27:52.710 INFO:tasks.workunit.client.1.smithi111.stdout:0/695: chown d1/df 9046 1 2023-12-08T20:27:52.710 INFO:tasks.workunit.client.1.smithi111.stdout:0/696: dread - d1/d4/d24/d46/d49/d7f/d95/db8/fec zero size 2023-12-08T20:27:52.711 INFO:tasks.workunit.client.1.smithi111.stdout:8/478: mkdir dd/d32/da7 0 2023-12-08T20:27:52.711 INFO:tasks.workunit.client.1.smithi111.stdout:8/479: truncate dd/d32/d3d/f88 240101 0 2023-12-08T20:27:52.711 INFO:tasks.workunit.client.1.smithi111.stdout:4/363: rmdir d8/da/db/d31 39 2023-12-08T20:27:52.712 INFO:tasks.workunit.client.1.smithi111.stdout:6/294: unlink d0/d1/d1e/l24 0 2023-12-08T20:27:52.712 INFO:tasks.workunit.client.1.smithi111.stdout:6/295: truncate d0/d1b/f49 739417 0 2023-12-08T20:27:52.713 INFO:tasks.workunit.client.1.smithi111.stdout:0/697: unlink d1/dd/f11 0 2023-12-08T20:27:52.713 INFO:tasks.workunit.client.1.smithi111.stdout:0/698: chown d1/d4/cbc 36587 1 2023-12-08T20:27:52.718 INFO:tasks.workunit.client.1.smithi111.stdout:6/296: mkdir d0/d1/d27/d56/d5a 0 2023-12-08T20:27:52.718 INFO:tasks.workunit.client.1.smithi111.stdout:0/699: symlink d1/d4/d24/led 0 2023-12-08T20:27:52.720 INFO:tasks.workunit.client.1.smithi111.stdout:4/364: rename d8/da/d29/d5c/d64 to d8/da/db/d31/d77 0 2023-12-08T20:27:52.723 INFO:tasks.workunit.client.1.smithi111.stdout:0/700: unlink d1/df/d56/fc2 0 2023-12-08T20:27:52.724 INFO:tasks.workunit.client.1.smithi111.stdout:0/701: stat d1/df/d44/daa/db2/ce6 0 2023-12-08T20:27:52.725 INFO:tasks.workunit.client.1.smithi111.stdout:6/297: creat d0/d1/d27/d56/d5a/f5b x:0 0 0 2023-12-08T20:27:52.725 INFO:tasks.workunit.client.1.smithi111.stdout:0/702: dread d1/df/d16/d2c/d7b/fca [0,4194304] 0 2023-12-08T20:27:52.730 INFO:tasks.workunit.client.1.smithi111.stdout:6/298: creat d0/d1/d27/f5c x:0 0 0 2023-12-08T20:27:52.730 INFO:tasks.workunit.client.1.smithi111.stdout:0/703: symlink d1/d4/d24/d46/d49/d6e/lee 0 2023-12-08T20:27:52.730 INFO:tasks.workunit.client.1.smithi111.stdout:6/299: rename d0/d1/d27/d56/d5a/f5b to d0/d1/d27/f5d 0 2023-12-08T20:27:52.732 INFO:tasks.workunit.client.1.smithi111.stdout:8/480: dwrite dd/f2a [0,4194304] 0 2023-12-08T20:27:52.732 INFO:tasks.workunit.client.1.smithi111.stdout:9/537: dwrite d2/f59 [0,4194304] 0 2023-12-08T20:27:52.732 INFO:tasks.workunit.client.1.smithi111.stdout:0/704: creat d1/dd/d47/fef x:0 0 0 2023-12-08T20:27:52.732 INFO:tasks.workunit.client.1.smithi111.stdout:0/705: chown d1/df/c1e 140 1 2023-12-08T20:27:52.732 INFO:tasks.workunit.client.1.smithi111.stdout:8/481: dread dd/d32/f39 [0,4194304] 0 2023-12-08T20:27:52.733 INFO:tasks.workunit.client.1.smithi111.stdout:8/482: write dd/f1f [1775750,7454] 0 2023-12-08T20:27:52.735 INFO:tasks.workunit.client.1.smithi111.stdout:8/483: write dd/d35/f3b [2771786,40107] 0 2023-12-08T20:27:52.742 INFO:tasks.workunit.client.1.smithi111.stdout:9/538: symlink d2/d8/lbe 0 2023-12-08T20:27:52.743 INFO:tasks.workunit.client.1.smithi111.stdout:0/706: mkdir d1/d69/d8b/df0 0 2023-12-08T20:27:52.744 INFO:tasks.workunit.client.1.smithi111.stdout:0/707: chown d1/d4/f73 111542477 1 2023-12-08T20:27:52.744 INFO:tasks.workunit.client.1.smithi111.stdout:8/484: creat dd/d32/d3d/d55/fa8 x:0 0 0 2023-12-08T20:27:52.744 INFO:tasks.workunit.client.1.smithi111.stdout:8/485: write dd/d2d/f4a [833829,380] 0 2023-12-08T20:27:52.744 INFO:tasks.workunit.client.1.smithi111.stdout:8/486: fdatasync dd/d35/d42/fa5 0 2023-12-08T20:27:52.745 INFO:tasks.workunit.client.1.smithi111.stdout:9/539: mkdir d2/d8/dd/d1a/d74/dbf 0 2023-12-08T20:27:52.745 INFO:tasks.workunit.client.1.smithi111.stdout:9/540: readlink d2/d8/d9b/l46 0 2023-12-08T20:27:52.747 INFO:tasks.workunit.client.1.smithi111.stdout:6/300: getdents d0/d1/d27 0 2023-12-08T20:27:52.747 INFO:tasks.workunit.client.1.smithi111.stdout:6/301: write d0/d1/f11 [227725,26561] 0 2023-12-08T20:27:52.748 INFO:tasks.workunit.client.1.smithi111.stdout:8/487: creat dd/d2d/d8b/d8d/da4/fa9 x:0 0 0 2023-12-08T20:27:52.749 INFO:tasks.workunit.client.1.smithi111.stdout:9/541: chown d2/c2f 127540 1 2023-12-08T20:27:52.749 INFO:tasks.workunit.client.1.smithi111.stdout:6/302: write d0/d1a/f28 [3720439,67148] 0 2023-12-08T20:27:52.750 INFO:tasks.workunit.client.1.smithi111.stdout:9/542: dread d2/d8/dd/d1a/d1e/d2d/d35/f53 [0,4194304] 0 2023-12-08T20:27:52.751 INFO:tasks.workunit.client.1.smithi111.stdout:8/488: mkdir dd/d2d/d62/d83/daa 0 2023-12-08T20:27:52.751 INFO:tasks.workunit.client.1.smithi111.stdout:8/489: dread - dd/d32/d3d/f85 zero size 2023-12-08T20:27:52.751 INFO:tasks.workunit.client.1.smithi111.stdout:8/490: truncate dd/d32/d3d/d6b/f98 960283 0 2023-12-08T20:27:52.751 INFO:tasks.workunit.client.1.smithi111.stdout:8/491: chown dd/d32/f3e 0 1 2023-12-08T20:27:52.751 INFO:tasks.workunit.client.1.smithi111.stdout:9/543: write d2/d8/dd/d1a/d74/f8e [2843314,52577] 0 2023-12-08T20:27:52.751 INFO:tasks.workunit.client.1.smithi111.stdout:9/544: write d2/d8/dd/f69 [136641,39764] 0 2023-12-08T20:27:52.751 INFO:tasks.workunit.client.1.smithi111.stdout:9/545: stat d2/d8/dd/d1a/d1e/d2d/fb8 0 2023-12-08T20:27:52.752 INFO:tasks.workunit.client.1.smithi111.stdout:6/303: mknod d0/d1/d27/d56/d5a/c5e 0 2023-12-08T20:27:52.754 INFO:tasks.workunit.client.1.smithi111.stdout:8/492: mknod dd/d2d/d62/d83/cab 0 2023-12-08T20:27:52.754 INFO:tasks.workunit.client.1.smithi111.stdout:8/493: chown dd/d32/f3e 1020720 1 2023-12-08T20:27:52.754 INFO:tasks.workunit.client.1.smithi111.stdout:8/494: stat dd/d32/f48 0 2023-12-08T20:27:52.757 INFO:tasks.workunit.client.1.smithi111.stdout:6/304: link d0/f13 d0/d1/d27/f5f 0 2023-12-08T20:27:52.760 INFO:tasks.workunit.client.1.smithi111.stdout:9/546: rename d2/d8/dd/d1a/d1e/f63 to d2/d8/dd/d1a/d1e/d2d/fc0 0 2023-12-08T20:27:52.762 INFO:tasks.workunit.client.1.smithi111.stdout:8/495: dread dd/f54 [0,4194304] 0 2023-12-08T20:27:52.762 INFO:tasks.workunit.client.1.smithi111.stdout:8/496: fdatasync dd/d32/d3d/d55/fa8 0 2023-12-08T20:27:52.764 INFO:tasks.workunit.client.1.smithi111.stdout:9/547: creat d2/d8/dd/d1a/d1e/d2d/db9/fc1 x:0 0 0 2023-12-08T20:27:52.765 INFO:tasks.workunit.client.1.smithi111.stdout:8/497: rename dd/d32/d3d/f4f to dd/d35/d7a/fac 0 2023-12-08T20:27:52.767 INFO:tasks.workunit.client.1.smithi111.stdout:8/498: rename dd/d32/d3d/l61 to dd/d32/d3d/lad 0 2023-12-08T20:27:52.767 INFO:tasks.workunit.client.1.smithi111.stdout:8/499: read - dd/d32/d36/f94 zero size 2023-12-08T20:27:52.784 INFO:tasks.workunit.client.1.smithi111.stdout:1/498: sync 2023-12-08T20:27:52.784 INFO:tasks.workunit.client.1.smithi111.stdout:3/398: sync 2023-12-08T20:27:52.784 INFO:tasks.workunit.client.1.smithi111.stdout:5/484: sync 2023-12-08T20:27:52.784 INFO:tasks.workunit.client.1.smithi111.stdout:2/452: sync 2023-12-08T20:27:52.785 INFO:tasks.workunit.client.1.smithi111.stdout:3/399: creat d2/d12/d4a/d5d/f82 x:0 0 0 2023-12-08T20:27:52.786 INFO:tasks.workunit.client.1.smithi111.stdout:5/485: link d3/f14 d3/d6d/fa4 0 2023-12-08T20:27:52.786 INFO:tasks.workunit.client.1.smithi111.stdout:2/453: symlink d1/d1d/d68/lac 0 2023-12-08T20:27:52.789 INFO:tasks.workunit.client.1.smithi111.stdout:5/486: rmdir d3/d4/d7/d36/d64/d98 0 2023-12-08T20:27:52.790 INFO:tasks.workunit.client.1.smithi111.stdout:5/487: chown d3/d4/d4a/d21/f91 107265 1 2023-12-08T20:27:52.790 INFO:tasks.workunit.client.1.smithi111.stdout:2/454: symlink d1/d29/d4e/lad 0 2023-12-08T20:27:52.790 INFO:tasks.workunit.client.1.smithi111.stdout:5/488: stat d3/d12/f1b 0 2023-12-08T20:27:52.790 INFO:tasks.workunit.client.1.smithi111.stdout:2/455: fsync f0 0 2023-12-08T20:27:52.790 INFO:tasks.workunit.client.1.smithi111.stdout:5/489: dread - d3/d4/d7/d36/d64/d8a/f9f zero size 2023-12-08T20:27:52.791 INFO:tasks.workunit.client.1.smithi111.stdout:0/708: dwrite d1/d4/d24/d46/d49/d7f/fd5 [0,4194304] 0 2023-12-08T20:27:52.792 INFO:tasks.workunit.client.1.smithi111.stdout:5/490: mkdir d3/d4/d4a/d21/da5 0 2023-12-08T20:27:52.792 INFO:tasks.workunit.client.1.smithi111.stdout:5/491: fsync d3/d4/d7/d36/d64/f80 0 2023-12-08T20:27:52.792 INFO:tasks.workunit.client.1.smithi111.stdout:2/456: mknod d1/d1d/d22/d30/cae 0 2023-12-08T20:27:52.792 INFO:tasks.workunit.client.1.smithi111.stdout:9/548: dwrite d2/f2c [0,4194304] 0 2023-12-08T20:27:52.793 INFO:tasks.workunit.client.1.smithi111.stdout:9/549: chown d2/d8/dd/d1a/d1e/d2d/d4a/l5c 143 1 2023-12-08T20:27:52.795 INFO:tasks.workunit.client.1.smithi111.stdout:0/709: mknod d1/df/d16/d2c/d7b/dba/cf1 0 2023-12-08T20:27:52.795 INFO:tasks.workunit.client.1.smithi111.stdout:0/710: write d1/d4/d24/d46/d49/f5a [1654450,15627] 0 2023-12-08T20:27:52.795 INFO:tasks.workunit.client.1.smithi111.stdout:0/711: stat d1/dd/d47/fda 0 2023-12-08T20:27:52.796 INFO:tasks.workunit.client.1.smithi111.stdout:8/500: dwrite dd/d32/d3d/f5b [0,4194304] 0 2023-12-08T20:27:52.797 INFO:tasks.workunit.client.1.smithi111.stdout:5/492: symlink d3/d4/d7/d36/d64/d8a/la6 0 2023-12-08T20:27:52.797 INFO:tasks.workunit.client.1.smithi111.stdout:5/493: stat d3/d12/f7e 0 2023-12-08T20:27:52.797 INFO:tasks.workunit.client.1.smithi111.stdout:5/494: chown d3/d4/d7/d29/f9b 93196 1 2023-12-08T20:27:52.798 INFO:tasks.workunit.client.1.smithi111.stdout:2/457: mknod d1/d29/caf 0 2023-12-08T20:27:52.800 INFO:tasks.workunit.client.1.smithi111.stdout:9/550: creat d2/d8/dd/d1a/d74/dbf/fc2 x:0 0 0 2023-12-08T20:27:52.805 INFO:tasks.workunit.client.1.smithi111.stdout:8/501: link dd/d2d/d8b/d8d/da4/fa9 dd/d2d/d8b/fae 0 2023-12-08T20:27:52.805 INFO:tasks.workunit.client.1.smithi111.stdout:8/502: stat dd/d32/d3d/f7c 0 2023-12-08T20:27:52.807 INFO:tasks.workunit.client.1.smithi111.stdout:5/495: symlink d3/d6d/la7 0 2023-12-08T20:27:52.808 INFO:tasks.workunit.client.1.smithi111.stdout:3/400: dwrite d2/d3/d13/d36/d69/f7d [0,4194304] 0 2023-12-08T20:27:52.808 INFO:tasks.workunit.client.1.smithi111.stdout:1/499: dwrite d0/d6/d33/d6c/f9a [0,4194304] 0 2023-12-08T20:27:52.809 INFO:tasks.workunit.client.1.smithi111.stdout:2/458: unlink d1/d1d/d22/c94 0 2023-12-08T20:27:52.809 INFO:tasks.workunit.client.1.smithi111.stdout:1/500: write d0/d6/f14 [7254126,77510] 0 2023-12-08T20:27:52.810 INFO:tasks.workunit.client.1.smithi111.stdout:8/503: write dd/f14 [81161,86194] 0 2023-12-08T20:27:52.810 INFO:tasks.workunit.client.1.smithi111.stdout:3/401: write d2/d15/d17/d25/d4e/f73 [2449724,91419] 0 2023-12-08T20:27:52.810 INFO:tasks.workunit.client.1.smithi111.stdout:9/551: symlink d2/d8/dd/d1a/lc3 0 2023-12-08T20:27:52.815 INFO:tasks.workunit.client.1.smithi111.stdout:1/501: dread d0/d6/d47/f4a [0,4194304] 0 2023-12-08T20:27:52.815 INFO:tasks.workunit.client.1.smithi111.stdout:5/496: mknod d3/d12/ca8 0 2023-12-08T20:27:52.815 INFO:tasks.workunit.client.1.smithi111.stdout:5/497: fsync d3/d12/f87 0 2023-12-08T20:27:52.815 INFO:tasks.workunit.client.1.smithi111.stdout:5/498: truncate d3/d4/d7/f8b 626426 0 2023-12-08T20:27:52.820 INFO:tasks.workunit.client.1.smithi111.stdout:8/504: dread dd/d2d/f33 [0,4194304] 0 2023-12-08T20:27:52.820 INFO:tasks.workunit.client.1.smithi111.stdout:8/505: write dd/d2d/f3a [1726240,71301] 0 2023-12-08T20:27:52.820 INFO:tasks.workunit.client.1.smithi111.stdout:8/506: truncate dd/d32/d3d/d55/f89 426325 0 2023-12-08T20:27:52.821 INFO:tasks.workunit.client.1.smithi111.stdout:9/552: stat d2/d8/dd/d1a/d1e/d2d/d4a/c6e 0 2023-12-08T20:27:52.821 INFO:tasks.workunit.client.1.smithi111.stdout:9/553: write d2/d8/dd/d1a/d1e/d2d/fb8 [600847,129874] 0 2023-12-08T20:27:52.826 INFO:tasks.workunit.client.1.smithi111.stdout:1/502: rmdir d0/d6/d33/d15/d51/d2e/d61 39 2023-12-08T20:27:52.827 INFO:tasks.workunit.client.1.smithi111.stdout:5/499: truncate d3/d4/d7/f16 1529339 0 2023-12-08T20:27:52.827 INFO:tasks.workunit.client.1.smithi111.stdout:1/503: chown d0/f1f 1092 1 2023-12-08T20:27:52.827 INFO:tasks.workunit.client.1.smithi111.stdout:1/504: readlink d0/d6/lb 0 2023-12-08T20:27:52.828 INFO:tasks.workunit.client.1.smithi111.stdout:1/505: mkdir d0/d8e/db6 0 2023-12-08T20:27:52.828 INFO:tasks.workunit.client.1.smithi111.stdout:1/506: chown d0/d8e/c92 9 1 2023-12-08T20:27:52.828 INFO:tasks.workunit.client.1.smithi111.stdout:1/507: fdatasync d0/d6/d34/f82 0 2023-12-08T20:27:52.828 INFO:tasks.workunit.client.1.smithi111.stdout:1/508: read d0/d6/d33/d15/d51/f6e [565673,114232] 0 2023-12-08T20:27:52.829 INFO:tasks.workunit.client.1.smithi111.stdout:1/509: write d0/d22/f9b [895802,130262] 0 2023-12-08T20:27:52.829 INFO:tasks.workunit.client.1.smithi111.stdout:5/500: mknod d3/d4/d4a/d21/ca9 0 2023-12-08T20:27:52.829 INFO:tasks.workunit.client.1.smithi111.stdout:5/501: dread - d3/d4/d7/d29/d73/d90/fa1 zero size 2023-12-08T20:27:52.831 INFO:tasks.workunit.client.1.smithi111.stdout:2/459: dwrite d1/f13 [0,4194304] 0 2023-12-08T20:27:52.831 INFO:tasks.workunit.client.1.smithi111.stdout:8/507: dread dd/d32/d3d/f5b [0,4194304] 0 2023-12-08T20:27:52.831 INFO:tasks.workunit.client.1.smithi111.stdout:8/508: write dd/d32/d3d/f5a [1542278,99175] 0 2023-12-08T20:27:52.833 INFO:tasks.workunit.client.1.smithi111.stdout:5/502: rmdir d3/d12/d67 39 2023-12-08T20:27:52.835 INFO:tasks.workunit.client.1.smithi111.stdout:8/509: write dd/f12 [2475589,92873] 0 2023-12-08T20:27:52.836 INFO:tasks.workunit.client.1.smithi111.stdout:3/402: dwrite d2/d3/fb [0,4194304] 0 2023-12-08T20:27:52.844 INFO:tasks.workunit.client.1.smithi111.stdout:9/554: dwrite d2/da/fc [0,4194304] 0 2023-12-08T20:27:52.848 INFO:tasks.workunit.client.1.smithi111.stdout:5/503: creat d3/d4/d4a/d21/faa x:0 0 0 2023-12-08T20:27:52.848 INFO:tasks.workunit.client.1.smithi111.stdout:5/504: write d3/d4/d7/d29/d30/f9d [951756,5855] 0 2023-12-08T20:27:52.848 INFO:tasks.workunit.client.1.smithi111.stdout:5/505: fsync d3/d4/d7/f8b 0 2023-12-08T20:27:52.849 INFO:tasks.workunit.client.1.smithi111.stdout:1/510: dwrite d0/f2d [0,4194304] 0 2023-12-08T20:27:52.849 INFO:tasks.workunit.client.1.smithi111.stdout:8/510: mknod dd/d2d/d62/d83/daa/caf 0 2023-12-08T20:27:52.850 INFO:tasks.workunit.client.1.smithi111.stdout:8/511: write dd/f54 [4738591,92862] 0 2023-12-08T20:27:52.850 INFO:tasks.workunit.client.1.smithi111.stdout:8/512: chown dd/d32/d3d/d55/l8a 44660487 1 2023-12-08T20:27:52.850 INFO:tasks.workunit.client.1.smithi111.stdout:8/513: chown dd/d35/d7a/fac 517 1 2023-12-08T20:27:52.850 INFO:tasks.workunit.client.1.smithi111.stdout:2/460: dwrite d1/d1d/d1f/d25/fa4 [0,4194304] 0 2023-12-08T20:27:52.853 INFO:tasks.workunit.client.1.smithi111.stdout:3/403: link d2/d15/d17/d5e/l6e d2/d15/d17/d25/l83 0 2023-12-08T20:27:52.854 INFO:tasks.workunit.client.1.smithi111.stdout:3/404: write d2/d3/d13/d36/d69/f7a [72844,16975] 0 2023-12-08T20:27:52.855 INFO:tasks.workunit.client.1.smithi111.stdout:9/555: rmdir d2/d8/dd/d1a/d1e/d2d/d8f 39 2023-12-08T20:27:52.855 INFO:tasks.workunit.client.1.smithi111.stdout:1/511: dread d0/d6/d34/f52 [0,4194304] 0 2023-12-08T20:27:52.858 INFO:tasks.workunit.client.1.smithi111.stdout:5/506: dread d3/d4/d7/d36/f68 [0,4194304] 0 2023-12-08T20:27:52.860 INFO:tasks.workunit.client.1.smithi111.stdout:8/514: link dd/d32/d3d/d55/f89 dd/d32/d3d/d55/fb0 0 2023-12-08T20:27:52.861 INFO:tasks.workunit.client.1.smithi111.stdout:8/515: dread dd/d32/d36/f7d [0,4194304] 0 2023-12-08T20:27:52.861 INFO:tasks.workunit.client.1.smithi111.stdout:3/405: link d2/d12/c4c d2/d3/d13/d36/d44/c84 0 2023-12-08T20:27:52.861 INFO:tasks.workunit.client.1.smithi111.stdout:3/406: readlink d2/d12/d2e/l3f 0 2023-12-08T20:27:52.861 INFO:tasks.workunit.client.1.smithi111.stdout:3/407: fdatasync d2/d3/d6/fd 0 2023-12-08T20:27:52.863 INFO:tasks.workunit.client.1.smithi111.stdout:1/512: unlink d0/d6/d33/d6c/da1/ca4 0 2023-12-08T20:27:52.865 INFO:tasks.workunit.client.1.smithi111.stdout:5/507: rename d3/d4/d7/d36/d64/f80 to d3/d4/d7/d2c/d84/fab 0 2023-12-08T20:27:52.865 INFO:tasks.workunit.client.1.smithi111.stdout:5/508: dread - d3/d4/d4a/d21/f47 zero size 2023-12-08T20:27:52.866 INFO:tasks.workunit.client.1.smithi111.stdout:8/516: creat dd/d2d/d8b/d8d/da4/fb1 x:0 0 0 2023-12-08T20:27:52.866 INFO:tasks.workunit.client.1.smithi111.stdout:8/517: dread dd/d32/d3d/d6b/f98 [0,4194304] 0 2023-12-08T20:27:52.867 INFO:tasks.workunit.client.1.smithi111.stdout:3/408: symlink d2/d15/d17/d25/d4e/l85 0 2023-12-08T20:27:52.867 INFO:tasks.workunit.client.1.smithi111.stdout:3/409: write d2/d15/d17/f68 [917406,38520] 0 2023-12-08T20:27:52.867 INFO:tasks.workunit.client.1.smithi111.stdout:3/410: stat d2/d3/d13/d36/d44/f7b 0 2023-12-08T20:27:52.867 INFO:tasks.workunit.client.1.smithi111.stdout:1/513: creat d0/d6/fb7 x:0 0 0 2023-12-08T20:27:52.867 INFO:tasks.workunit.client.1.smithi111.stdout:1/514: truncate d0/d4d/fb1 490318 0 2023-12-08T20:27:52.867 INFO:tasks.workunit.client.1.smithi111.stdout:1/515: fsync d0/d6/d33/d15/d51/d2e/d61/d79/f90 0 2023-12-08T20:27:52.868 INFO:tasks.workunit.client.1.smithi111.stdout:1/516: chown d0/d6/d33/d15/d51/d78/f95 70 1 2023-12-08T20:27:52.868 INFO:tasks.workunit.client.1.smithi111.stdout:5/509: creat d3/d4/fac x:0 0 0 2023-12-08T20:27:52.868 INFO:tasks.workunit.client.1.smithi111.stdout:5/510: stat d3/d4/f5b 0 2023-12-08T20:27:52.868 INFO:tasks.workunit.client.1.smithi111.stdout:5/511: chown d3/d4/d4a/l45 0 1 2023-12-08T20:27:52.869 INFO:tasks.workunit.client.1.smithi111.stdout:3/411: link d2/d3/d6/c41 d2/d12/d4a/c86 0 2023-12-08T20:27:52.869 INFO:tasks.workunit.client.1.smithi111.stdout:3/412: readlink d2/d3/d13/d36/d44/l59 0 2023-12-08T20:27:52.871 INFO:tasks.workunit.client.1.smithi111.stdout:1/517: mkdir d0/d6/d33/d15/d51/d5b/d59/db8 0 2023-12-08T20:27:52.874 INFO:tasks.workunit.client.1.smithi111.stdout:1/518: rmdir d0/d6/d33/d15/d51/d2e/d61 39 2023-12-08T20:27:52.875 INFO:tasks.workunit.client.1.smithi111.stdout:1/519: chown d0/d6/d33/d15/d51/d78 1443 1 2023-12-08T20:27:52.877 INFO:tasks.workunit.client.1.smithi111.stdout:1/520: dread d0/d6/d33/d15/d51/d2e/fa6 [0,4194304] 0 2023-12-08T20:27:52.878 INFO:tasks.workunit.client.1.smithi111.stdout:9/556: dwrite d2/d8/d9b/f81 [0,4194304] 0 2023-12-08T20:27:52.878 INFO:tasks.workunit.client.1.smithi111.stdout:1/521: getdents d0/d6/d33/d6c/d75 0 2023-12-08T20:27:52.878 INFO:tasks.workunit.client.1.smithi111.stdout:1/522: dread - d0/d6/d33/d15/d51/d2e/fa9 zero size 2023-12-08T20:27:52.881 INFO:tasks.workunit.client.1.smithi111.stdout:9/557: link d2/l55 d2/d8/dd/d1a/d74/dbf/lc4 0 2023-12-08T20:27:52.881 INFO:tasks.workunit.client.1.smithi111.stdout:1/523: symlink d0/d6/d33/d8b/db5/lb9 0 2023-12-08T20:27:52.882 INFO:tasks.workunit.client.1.smithi111.stdout:9/558: link d2/d8/dd/fb0 d2/d8/d8c/dbb/fc5 0 2023-12-08T20:27:52.883 INFO:tasks.workunit.client.1.smithi111.stdout:9/559: stat d2/f59 0 2023-12-08T20:27:52.883 INFO:tasks.workunit.client.1.smithi111.stdout:9/560: write d2/d8/dd/d1a/d1e/d2d/d35/d88/f99 [356009,10993] 0 2023-12-08T20:27:52.884 INFO:tasks.workunit.client.1.smithi111.stdout:1/524: unlink d0/d6/f27 0 2023-12-08T20:27:52.890 INFO:tasks.workunit.client.1.smithi111.stdout:5/512: dwrite d3/d4/d7/d36/f3d [0,4194304] 0 2023-12-08T20:27:52.891 INFO:tasks.workunit.client.1.smithi111.stdout:8/518: dwrite dd/d32/d3d/f7c [0,4194304] 0 2023-12-08T20:27:52.891 INFO:tasks.workunit.client.1.smithi111.stdout:8/519: chown dd/d2d/f31 14865 1 2023-12-08T20:27:52.891 INFO:tasks.workunit.client.1.smithi111.stdout:8/520: stat dd/d32/d36/d4b/l68 0 2023-12-08T20:27:52.891 INFO:tasks.workunit.client.1.smithi111.stdout:5/513: write d3/d8d/f92 [100852,50436] 0 2023-12-08T20:27:52.891 INFO:tasks.workunit.client.1.smithi111.stdout:8/521: creat dd/d32/da7/fb2 x:0 0 0 2023-12-08T20:27:52.891 INFO:tasks.workunit.client.1.smithi111.stdout:5/514: unlink d3/d4/d7/d2c/c42 0 2023-12-08T20:27:52.892 INFO:tasks.workunit.client.1.smithi111.stdout:8/522: creat dd/fb3 x:0 0 0 2023-12-08T20:27:52.892 INFO:tasks.workunit.client.1.smithi111.stdout:8/523: truncate dd/d32/d3d/d55/fa8 499646 0 2023-12-08T20:27:52.895 INFO:tasks.workunit.client.1.smithi111.stdout:8/524: mkdir dd/d35/d42/db4 0 2023-12-08T20:27:52.896 INFO:tasks.workunit.client.1.smithi111.stdout:8/525: creat dd/d35/d42/fb5 x:0 0 0 2023-12-08T20:27:52.897 INFO:tasks.workunit.client.1.smithi111.stdout:8/526: symlink dd/d2d/d62/lb6 0 2023-12-08T20:27:52.897 INFO:tasks.workunit.client.1.smithi111.stdout:8/527: stat dd/d32/d3d/f85 0 2023-12-08T20:27:52.898 INFO:tasks.workunit.client.1.smithi111.stdout:8/528: mknod dd/d35/cb7 0 2023-12-08T20:27:52.900 INFO:tasks.workunit.client.1.smithi111.stdout:8/529: symlink dd/d2d/lb8 0 2023-12-08T20:27:52.902 INFO:tasks.workunit.client.1.smithi111.stdout:8/530: symlink dd/d32/lb9 0 2023-12-08T20:27:52.903 INFO:tasks.workunit.client.1.smithi111.stdout:8/531: mknod dd/d2d/d8b/d9b/cba 0 2023-12-08T20:27:52.903 INFO:tasks.workunit.client.1.smithi111.stdout:3/413: dwrite d2/f34 [0,4194304] 0 2023-12-08T20:27:52.904 INFO:tasks.workunit.client.1.smithi111.stdout:5/515: dwrite d3/d12/f38 [0,4194304] 0 2023-12-08T20:27:52.906 INFO:tasks.workunit.client.1.smithi111.stdout:3/414: truncate d2/d3/f16 1158550 0 2023-12-08T20:27:52.906 INFO:tasks.workunit.client.1.smithi111.stdout:3/415: readlink d2/l42 0 2023-12-08T20:27:52.906 INFO:tasks.workunit.client.1.smithi111.stdout:3/416: readlink d2/l49 0 2023-12-08T20:27:52.906 INFO:tasks.workunit.client.1.smithi111.stdout:3/417: truncate d2/d3/d13/d36/d69/f75 935659 0 2023-12-08T20:27:52.907 INFO:tasks.workunit.client.1.smithi111.stdout:5/516: rename l1 to d3/d4/d7/d29/d73/lad 0 2023-12-08T20:27:52.908 INFO:tasks.workunit.client.1.smithi111.stdout:5/517: read d3/d4/d7/d29/d30/f76 [2540930,107489] 0 2023-12-08T20:27:52.909 INFO:tasks.workunit.client.1.smithi111.stdout:5/518: stat d3/d12/d67 0 2023-12-08T20:27:52.909 INFO:tasks.workunit.client.1.smithi111.stdout:5/519: chown d3/f6b 2 1 2023-12-08T20:27:52.910 INFO:tasks.workunit.client.1.smithi111.stdout:3/418: creat d2/d15/f87 x:0 0 0 2023-12-08T20:27:52.910 INFO:tasks.workunit.client.1.smithi111.stdout:3/419: dread d2/d3/d13/d36/d69/d70/f66 [0,4194304] 0 2023-12-08T20:27:52.910 INFO:tasks.workunit.client.1.smithi111.stdout:3/420: chown d2/d15/d17/d5e/l63 48559313 1 2023-12-08T20:27:52.911 INFO:tasks.workunit.client.1.smithi111.stdout:5/520: link d3/d4/d7/d2c/f4c d3/d4/d7/fae 0 2023-12-08T20:27:52.912 INFO:tasks.workunit.client.1.smithi111.stdout:5/521: creat d3/d4/d7/d36/d64/faf x:0 0 0 2023-12-08T20:27:52.914 INFO:tasks.workunit.client.1.smithi111.stdout:5/522: read d3/d4/d7/f13 [2030760,48043] 0 2023-12-08T20:27:52.914 INFO:tasks.workunit.client.1.smithi111.stdout:8/532: dread dd/f2a [0,4194304] 0 2023-12-08T20:27:52.914 INFO:tasks.workunit.client.1.smithi111.stdout:8/533: dread - dd/d2d/d8b/fae zero size 2023-12-08T20:27:52.915 INFO:tasks.workunit.client.1.smithi111.stdout:8/534: link dd/d32/d3d/f5a dd/fbb 0 2023-12-08T20:27:52.916 INFO:tasks.workunit.client.1.smithi111.stdout:5/523: dread d3/d4/d4a/f49 [0,4194304] 0 2023-12-08T20:27:52.917 INFO:tasks.workunit.client.1.smithi111.stdout:8/535: getdents dd/d32/d3d 0 2023-12-08T20:27:52.918 INFO:tasks.workunit.client.1.smithi111.stdout:5/524: link d3/d4/c50 d3/d12/cb0 0 2023-12-08T20:27:52.919 INFO:tasks.workunit.client.1.smithi111.stdout:9/561: fsync d2/d8/dd/fb0 0 2023-12-08T20:27:52.919 INFO:tasks.workunit.client.1.smithi111.stdout:9/562: fdatasync d2/f7 0 2023-12-08T20:27:52.920 INFO:tasks.workunit.client.1.smithi111.stdout:3/421: dread d2/d12/f1a [0,4194304] 0 2023-12-08T20:27:52.921 INFO:tasks.workunit.client.1.smithi111.stdout:8/536: rename dd/d32/d36/c91 to dd/d32/d3d/d55/cbc 0 2023-12-08T20:27:52.921 INFO:tasks.workunit.client.1.smithi111.stdout:8/537: chown dd/d2d/d62/d83/daa 0 1 2023-12-08T20:27:52.921 INFO:tasks.workunit.client.1.smithi111.stdout:8/538: read dd/d35/d7a/f7f [39261,84724] 0 2023-12-08T20:27:52.922 INFO:tasks.workunit.client.1.smithi111.stdout:9/563: symlink d2/d8/dd/d1a/d74/dbf/lc6 0 2023-12-08T20:27:52.922 INFO:tasks.workunit.client.1.smithi111.stdout:9/564: read - d2/d8/dd/d1a/d1e/d2d/d35/f95 zero size 2023-12-08T20:27:52.922 INFO:tasks.workunit.client.1.smithi111.stdout:8/539: write fa [2452167,64885] 0 2023-12-08T20:27:52.922 INFO:tasks.workunit.client.1.smithi111.stdout:3/422: truncate d2/d15/f60 743655 0 2023-12-08T20:27:52.923 INFO:tasks.workunit.client.1.smithi111.stdout:3/423: chown d2/d15/d17/f5c 1 1 2023-12-08T20:27:52.923 INFO:tasks.workunit.client.1.smithi111.stdout:3/424: write d2/d12/d4a/f6d [833040,42572] 0 2023-12-08T20:27:52.924 INFO:tasks.workunit.client.1.smithi111.stdout:5/525: rename d3/d4/d7/f25 to d3/d4/d7/d29/d73/d90/fb1 0 2023-12-08T20:27:52.925 INFO:tasks.workunit.client.1.smithi111.stdout:9/565: symlink d2/d8/dd/d1a/d1e/d2d/d35/d88/lc7 0 2023-12-08T20:27:52.927 INFO:tasks.workunit.client.1.smithi111.stdout:3/425: mkdir d2/d3/d51/d88 0 2023-12-08T20:27:52.927 INFO:tasks.workunit.client.1.smithi111.stdout:3/426: write d2/d15/d17/d25/d4e/f4f [879755,96678] 0 2023-12-08T20:27:52.929 INFO:tasks.workunit.client.1.smithi111.stdout:5/526: creat d3/d12/fb2 x:0 0 0 2023-12-08T20:27:52.929 INFO:tasks.workunit.client.1.smithi111.stdout:5/527: readlink d3/d4/l72 0 2023-12-08T20:27:52.931 INFO:tasks.workunit.client.1.smithi111.stdout:3/427: unlink d2/d3/d13/d36/d44/c56 0 2023-12-08T20:27:52.933 INFO:tasks.workunit.client.1.smithi111.stdout:5/528: getdents d3/d4/d4a 0 2023-12-08T20:27:52.936 INFO:tasks.workunit.client.1.smithi111.stdout:5/529: link d3/d4/d4a/f6f d3/d4/d4a/fb3 0 2023-12-08T20:27:52.938 INFO:tasks.workunit.client.1.smithi111.stdout:9/566: dwrite d2/da/f50 [0,4194304] 0 2023-12-08T20:27:52.938 INFO:tasks.workunit.client.1.smithi111.stdout:9/567: fsync d2/f2c 0 2023-12-08T20:27:52.945 INFO:tasks.workunit.client.1.smithi111.stdout:8/540: dwrite dd/d2d/d8b/d8d/da4/fb1 [0,4194304] 0 2023-12-08T20:27:52.950 INFO:tasks.workunit.client.1.smithi111.stdout:9/568: symlink d2/lc8 0 2023-12-08T20:27:52.952 INFO:tasks.workunit.client.1.smithi111.stdout:9/569: mknod d2/d8/dd/d1a/d1e/d2d/d35/d71/cc9 0 2023-12-08T20:27:52.953 INFO:tasks.workunit.client.1.smithi111.stdout:9/570: creat d2/d8/dd/d1a/d74/dbf/fca x:0 0 0 2023-12-08T20:27:52.955 INFO:tasks.workunit.client.1.smithi111.stdout:3/428: dwrite d2/d3/fb [0,4194304] 0 2023-12-08T20:27:52.959 INFO:tasks.workunit.client.1.smithi111.stdout:9/571: mknod d2/d8/dd/d1a/d1e/d2d/d4a/d62/ccb 0 2023-12-08T20:27:52.959 INFO:tasks.workunit.client.1.smithi111.stdout:9/572: chown d2/d8/d8c/d96/fb3 4 1 2023-12-08T20:27:52.959 INFO:tasks.workunit.client.1.smithi111.stdout:9/573: write d2/d8/dd/d1a/d74/dbf/fc2 [778498,116275] 0 2023-12-08T20:27:52.964 INFO:tasks.workunit.client.1.smithi111.stdout:8/541: dwrite dd/d2d/d8b/d8d/da4/fa9 [0,4194304] 0 2023-12-08T20:27:52.964 INFO:tasks.workunit.client.1.smithi111.stdout:8/542: read - dd/d32/da7/fb2 zero size 2023-12-08T20:27:52.965 INFO:tasks.workunit.client.1.smithi111.stdout:5/530: dwrite d3/d4/d4a/f32 [0,4194304] 0 2023-12-08T20:27:52.965 INFO:tasks.workunit.client.1.smithi111.stdout:5/531: write d3/d6d/f81 [50508,37811] 0 2023-12-08T20:27:52.965 INFO:tasks.workunit.client.1.smithi111.stdout:5/532: chown d3/d4/d7/d2c/f97 360532 1 2023-12-08T20:27:52.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:52 smithi111 ceph-mon[121341]: pgmap v17: 65 pgs: 65 active+clean; 717 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 49 MiB/s rd, 86 MiB/s wr, 582 op/s 2023-12-08T20:27:52.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:52 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:52.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:52 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:52.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:52 smithi111 ceph-mon[121341]: Reconfiguring grafana.smithi043 (dependencies changed)... 2023-12-08T20:27:52.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:52 smithi111 ceph-mon[121341]: Reconfiguring daemon grafana.smithi043 on smithi043 2023-12-08T20:27:52.967 INFO:tasks.workunit.client.1.smithi111.stdout:9/574: dread d2/d8/dd/d1a/d74/dbf/fc2 [0,4194304] 0 2023-12-08T20:27:52.968 INFO:tasks.workunit.client.1.smithi111.stdout:8/543: symlink dd/d32/d3d/lbd 0 2023-12-08T20:27:52.969 INFO:tasks.workunit.client.1.smithi111.stdout:8/544: dread dd/f90 [0,4194304] 0 2023-12-08T20:27:52.971 INFO:tasks.workunit.client.1.smithi111.stdout:5/533: rmdir d3/d4/d7/d2c/d84 39 2023-12-08T20:27:52.971 INFO:tasks.workunit.client.1.smithi111.stdout:5/534: dread - d3/d4/d4a/f7a zero size 2023-12-08T20:27:52.986 INFO:tasks.workunit.client.1.smithi111.stdout:8/545: dwrite dd/d32/d3d/f75 [0,4194304] 0 2023-12-08T20:27:52.986 INFO:tasks.workunit.client.1.smithi111.stdout:8/546: dread - dd/d32/d3d/f85 zero size 2023-12-08T20:27:52.986 INFO:tasks.workunit.client.1.smithi111.stdout:5/535: mkdir d3/d4/d7/d36/d82/db4 0 2023-12-08T20:27:52.986 INFO:tasks.workunit.client.1.smithi111.stdout:8/547: rename f5 to dd/d2d/d8b/d8d/da4/fbe 0 2023-12-08T20:27:52.987 INFO:tasks.workunit.client.1.smithi111.stdout:5/536: rename d3/d4/d4a/f32 to d3/d4/d7/d29/d30/fb5 0 2023-12-08T20:27:52.988 INFO:tasks.workunit.client.1.smithi111.stdout:8/548: creat dd/d2d/fbf x:0 0 0 2023-12-08T20:27:52.990 INFO:tasks.workunit.client.1.smithi111.stdout:5/537: rename d3/d12/c5d to d3/d4/d7/d36/d82/cb6 0 2023-12-08T20:27:52.991 INFO:tasks.workunit.client.1.smithi111.stdout:8/549: symlink dd/d2d/d62/d83/daa/lc0 0 2023-12-08T20:27:52.991 INFO:tasks.workunit.client.1.smithi111.stdout:8/550: stat dd/d32/d3d/d55/fa8 0 2023-12-08T20:27:52.992 INFO:tasks.workunit.client.1.smithi111.stdout:5/538: truncate d3/d4/d4a/d21/f91 667279 0 2023-12-08T20:27:52.992 INFO:tasks.workunit.client.1.smithi111.stdout:8/551: rmdir dd/d2d/d8b/d8d 39 2023-12-08T20:27:52.994 INFO:tasks.workunit.client.1.smithi111.stdout:5/539: creat d3/d4/d7/d36/d82/db4/fb7 x:0 0 0 2023-12-08T20:27:52.994 INFO:tasks.workunit.client.1.smithi111.stdout:5/540: truncate d3/d12/d67/fa3 480853 0 2023-12-08T20:27:52.995 INFO:tasks.workunit.client.1.smithi111.stdout:8/552: rmdir dd/d35/d42 39 2023-12-08T20:27:52.995 INFO:tasks.workunit.client.1.smithi111.stdout:8/553: readlink dd/d32/d3d/l4d 0 2023-12-08T20:27:52.996 INFO:tasks.workunit.client.1.smithi111.stdout:8/554: symlink dd/d35/d42/db4/lc1 0 2023-12-08T20:27:52.998 INFO:tasks.workunit.client.1.smithi111.stdout:8/555: rename dd/d2d/d62/d83/c87 to dd/d2d/d62/d83/cc2 0 2023-12-08T20:27:52.999 INFO:tasks.workunit.client.1.smithi111.stdout:8/556: getdents dd/d32/d3d/d55 0 2023-12-08T20:27:53.001 INFO:tasks.workunit.client.1.smithi111.stdout:7/381: sync 2023-12-08T20:27:53.001 INFO:tasks.workunit.client.1.smithi111.stdout:7/382: dread - da/d25/d3d/d58/f5e zero size 2023-12-08T20:27:53.001 INFO:tasks.workunit.client.1.smithi111.stdout:7/383: truncate da/f40 351919 0 2023-12-08T20:27:53.002 INFO:tasks.workunit.client.1.smithi111.stdout:7/384: dread da/d25/d3d/d58/f66 [0,4194304] 0 2023-12-08T20:27:53.003 INFO:tasks.workunit.client.1.smithi111.stdout:7/385: link da/d13/c70 da/c7e 0 2023-12-08T20:27:53.008 INFO:tasks.workunit.client.1.smithi111.stdout:8/557: dread dd/d32/d3d/d6b/f6f [0,4194304] 0 2023-12-08T20:27:53.010 INFO:tasks.workunit.client.1.smithi111.stdout:5/541: write d3/d4/d4a/d21/f91 [9904,10096] 0 2023-12-08T20:27:53.010 INFO:tasks.workunit.client.1.smithi111.stdout:5/542: dread - d3/d12/fb2 zero size 2023-12-08T20:27:53.010 INFO:tasks.workunit.client.1.smithi111.stdout:8/558: mkdir dd/d35/d7a/dc3 0 2023-12-08T20:27:53.010 INFO:tasks.workunit.client.1.smithi111.stdout:5/543: dread d3/d8d/f92 [0,4194304] 0 2023-12-08T20:27:53.011 INFO:tasks.workunit.client.1.smithi111.stdout:8/559: symlink dd/d2d/d62/lc4 0 2023-12-08T20:27:53.012 INFO:tasks.workunit.client.1.smithi111.stdout:5/544: unlink d3/d4/d7/fae 0 2023-12-08T20:27:53.013 INFO:tasks.workunit.client.1.smithi111.stdout:5/545: link c2 d3/d4/d4a/d21/da5/cb8 0 2023-12-08T20:27:53.013 INFO:tasks.workunit.client.1.smithi111.stdout:8/560: write dd/d32/d3d/f5a [166192,8866] 0 2023-12-08T20:27:53.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:52 smithi043 ceph-mon[111966]: pgmap v17: 65 pgs: 65 active+clean; 717 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 49 MiB/s rd, 86 MiB/s wr, 582 op/s 2023-12-08T20:27:53.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:52 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:53.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:52 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:27:53.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:52 smithi043 ceph-mon[111966]: Reconfiguring grafana.smithi043 (dependencies changed)... 2023-12-08T20:27:53.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:52 smithi043 ceph-mon[111966]: Reconfiguring daemon grafana.smithi043 on smithi043 2023-12-08T20:27:53.014 INFO:tasks.workunit.client.1.smithi111.stdout:5/546: unlink d3/d4/d7/d36/f4f 0 2023-12-08T20:27:53.016 INFO:tasks.workunit.client.1.smithi111.stdout:8/561: creat dd/d2d/d62/d83/fc5 x:0 0 0 2023-12-08T20:27:53.016 INFO:tasks.workunit.client.1.smithi111.stdout:8/562: read dd/d32/d3d/d55/fa3 [51362,73556] 0 2023-12-08T20:27:53.016 INFO:tasks.workunit.client.1.smithi111.stdout:7/386: dwrite da/d13/f4c [0,4194304] 0 2023-12-08T20:27:53.016 INFO:tasks.workunit.client.1.smithi111.stdout:7/387: read - da/d38/f74 zero size 2023-12-08T20:27:53.017 INFO:tasks.workunit.client.1.smithi111.stdout:5/547: rename d3/d4/d7/d29/d73/fa0 to d3/d12/fb9 0 2023-12-08T20:27:53.017 INFO:tasks.workunit.client.1.smithi111.stdout:5/548: chown d3/d12/fb9 1 1 2023-12-08T20:27:53.021 INFO:tasks.workunit.client.1.smithi111.stdout:7/388: truncate da/d25/d3d/f51 1010 0 2023-12-08T20:27:53.021 INFO:tasks.workunit.client.1.smithi111.stdout:8/563: rename dd/l4c to dd/d96/lc6 0 2023-12-08T20:27:53.021 INFO:tasks.workunit.client.1.smithi111.stdout:8/564: write dd/d32/d36/f7d [564519,17218] 0 2023-12-08T20:27:53.022 INFO:tasks.workunit.client.1.smithi111.stdout:7/389: rmdir da/d25/d3d 39 2023-12-08T20:27:53.022 INFO:tasks.workunit.client.1.smithi111.stdout:7/390: fdatasync da/f1b 0 2023-12-08T20:27:53.022 INFO:tasks.workunit.client.1.smithi111.stdout:7/391: stat f6 0 2023-12-08T20:27:53.022 INFO:tasks.workunit.client.1.smithi111.stdout:8/565: dread dd/d32/d3d/f88 [0,4194304] 0 2023-12-08T20:27:53.025 INFO:tasks.workunit.client.1.smithi111.stdout:7/392: dread da/d13/f49 [0,4194304] 0 2023-12-08T20:27:53.031 INFO:tasks.workunit.client.1.smithi111.stdout:5/549: dwrite d3/d4/d7/d36/f44 [4194304,4194304] 0 2023-12-08T20:27:53.033 INFO:tasks.workunit.client.1.smithi111.stdout:5/550: creat d3/d4/d7/d29/fba x:0 0 0 2023-12-08T20:27:53.033 INFO:tasks.workunit.client.1.smithi111.stdout:5/551: readlink d3/d4/d7/d29/d73/lad 0 2023-12-08T20:27:53.035 INFO:tasks.workunit.client.1.smithi111.stdout:5/552: symlink d3/d4/d7/d36/lbb 0 2023-12-08T20:27:53.037 INFO:tasks.workunit.client.1.smithi111.stdout:5/553: rename d3/d12/f1b to d3/fbc 0 2023-12-08T20:27:53.038 INFO:tasks.workunit.client.1.smithi111.stdout:5/554: mkdir d3/d12/dbd 0 2023-12-08T20:27:53.039 INFO:tasks.workunit.client.1.smithi111.stdout:5/555: dread d3/d4/d7/d2c/f41 [0,4194304] 0 2023-12-08T20:27:53.046 INFO:tasks.workunit.client.1.smithi111.stdout:5/556: dread d3/d12/f7e [0,4194304] 0 2023-12-08T20:27:53.046 INFO:tasks.workunit.client.1.smithi111.stdout:5/557: write d3/d4/d7/d2c/f97 [337270,42898] 0 2023-12-08T20:27:53.047 INFO:tasks.workunit.client.1.smithi111.stdout:8/566: dwrite dd/f90 [0,4194304] 0 2023-12-08T20:27:53.049 INFO:tasks.workunit.client.1.smithi111.stdout:7/393: dwrite da/d13/d21/f67 [0,4194304] 0 2023-12-08T20:27:53.059 INFO:tasks.workunit.client.1.smithi111.stdout:7/394: rmdir da/d13/d21 39 2023-12-08T20:27:53.061 INFO:tasks.workunit.client.1.smithi111.stdout:7/395: creat da/d13/f7f x:0 0 0 2023-12-08T20:27:53.063 INFO:tasks.workunit.client.1.smithi111.stdout:7/396: read da/d25/d26/d3c/f4b [3970301,128479] 0 2023-12-08T20:27:53.063 INFO:tasks.workunit.client.1.smithi111.stdout:7/397: write da/d13/d21/f50 [16295,91048] 0 2023-12-08T20:27:53.064 INFO:tasks.workunit.client.1.smithi111.stdout:5/558: dwrite d3/d4/d7/d2c/f78 [0,4194304] 0 2023-12-08T20:27:53.066 INFO:tasks.workunit.client.1.smithi111.stdout:8/567: dwrite dd/d2d/f4a [0,4194304] 0 2023-12-08T20:27:53.066 INFO:tasks.workunit.client.1.smithi111.stdout:8/568: dread - dd/d32/d36/d4b/f64 zero size 2023-12-08T20:27:53.066 INFO:tasks.workunit.client.1.smithi111.stdout:5/559: mkdir d3/d4/d7/d36/d82/db4/dbe 0 2023-12-08T20:27:53.076 INFO:tasks.workunit.client.1.smithi111.stdout:8/569: dread fa [0,4194304] 0 2023-12-08T20:27:53.077 INFO:tasks.workunit.client.1.smithi111.stdout:8/570: fdatasync dd/f12 0 2023-12-08T20:27:53.077 INFO:tasks.workunit.client.1.smithi111.stdout:8/571: symlink dd/d2d/d62/lc7 0 2023-12-08T20:27:53.079 INFO:tasks.workunit.client.1.smithi111.stdout:8/572: dread dd/d2d/f31 [0,4194304] 0 2023-12-08T20:27:53.083 INFO:tasks.workunit.client.1.smithi111.stdout:5/560: dwrite d3/d4/d7/d36/f7c [0,4194304] 0 2023-12-08T20:27:53.089 INFO:tasks.workunit.client.1.smithi111.stdout:5/561: link d3/d4/d4a/d21/da5/cb8 d3/d4/d7/d36/d64/d8a/cbf 0 2023-12-08T20:27:53.096 INFO:tasks.workunit.client.1.smithi111.stdout:8/573: dwrite dd/f1f [8388608,4194304] 0 2023-12-08T20:27:53.106 INFO:tasks.workunit.client.1.smithi111.stdout:4/365: sync 2023-12-08T20:27:53.107 INFO:tasks.workunit.client.1.smithi111.stdout:6/305: sync 2023-12-08T20:27:53.107 INFO:tasks.workunit.client.1.smithi111.stdout:0/712: sync 2023-12-08T20:27:53.107 INFO:tasks.workunit.client.1.smithi111.stdout:5/562: dwrite d3/f14 [0,4194304] 0 2023-12-08T20:27:53.108 INFO:tasks.workunit.client.1.smithi111.stdout:0/713: mknod d1/d4/d24/da9/cf2 0 2023-12-08T20:27:53.109 INFO:tasks.workunit.client.1.smithi111.stdout:6/306: creat d0/d1a/f60 x:0 0 0 2023-12-08T20:27:53.110 INFO:tasks.workunit.client.1.smithi111.stdout:5/563: mkdir d3/d4/d7/d29/d30/dc0 0 2023-12-08T20:27:53.111 INFO:tasks.workunit.client.1.smithi111.stdout:0/714: creat d1/d2d/d83/ff3 x:0 0 0 2023-12-08T20:27:53.112 INFO:tasks.workunit.client.1.smithi111.stdout:6/307: link d0/d1/d27/f5c d0/d1/d1e/f61 0 2023-12-08T20:27:53.113 INFO:tasks.workunit.client.1.smithi111.stdout:6/308: readlink d0/l37 0 2023-12-08T20:27:53.113 INFO:tasks.workunit.client.1.smithi111.stdout:0/715: mknod d1/d4/d24/d46/d49/d7f/cf4 0 2023-12-08T20:27:53.115 INFO:tasks.workunit.client.1.smithi111.stdout:6/309: creat d0/d1/d27/d56/f62 x:0 0 0 2023-12-08T20:27:53.115 INFO:tasks.workunit.client.1.smithi111.stdout:6/310: chown d0/d1/d27/f2f 75 1 2023-12-08T20:27:53.117 INFO:tasks.workunit.client.1.smithi111.stdout:0/716: rename d1/dd/l25 to d1/d4/d3a/d8c/lf5 0 2023-12-08T20:27:53.117 INFO:tasks.workunit.client.1.smithi111.stdout:5/564: dread d3/d12/f38 [0,4194304] 0 2023-12-08T20:27:53.118 INFO:tasks.workunit.client.1.smithi111.stdout:6/311: rename d0/d1/l9 to d0/d1/l63 0 2023-12-08T20:27:53.120 INFO:tasks.workunit.client.1.smithi111.stdout:0/717: creat d1/df/d44/d37/d5c/d70/ff6 x:0 0 0 2023-12-08T20:27:53.120 INFO:tasks.workunit.client.1.smithi111.stdout:0/718: chown d1/d4/d24/d46/d49/d6e/lee 81 1 2023-12-08T20:27:53.120 INFO:tasks.workunit.client.1.smithi111.stdout:0/719: readlink d1/df/d44/d37/ld4 0 2023-12-08T20:27:53.120 INFO:tasks.workunit.client.1.smithi111.stdout:0/720: fdatasync d1/df/d44/d37/d5c/d70/ff6 0 2023-12-08T20:27:53.121 INFO:tasks.workunit.client.1.smithi111.stdout:0/721: truncate d1/dd/d47/fef 518022 0 2023-12-08T20:27:53.122 INFO:tasks.workunit.client.1.smithi111.stdout:5/565: creat d3/d4/d7/d36/d64/fc1 x:0 0 0 2023-12-08T20:27:53.124 INFO:tasks.workunit.client.1.smithi111.stdout:6/312: unlink d0/d1/d27/d36/l43 0 2023-12-08T20:27:53.125 INFO:tasks.workunit.client.1.smithi111.stdout:5/566: read d3/f10 [188118,125565] 0 2023-12-08T20:27:53.127 INFO:tasks.workunit.client.1.smithi111.stdout:5/567: creat d3/d12/fc2 x:0 0 0 2023-12-08T20:27:53.129 INFO:tasks.workunit.client.1.smithi111.stdout:5/568: mknod d3/d6d/cc3 0 2023-12-08T20:27:53.130 INFO:tasks.workunit.client.1.smithi111.stdout:5/569: mknod d3/d4/cc4 0 2023-12-08T20:27:53.137 INFO:tasks.workunit.client.1.smithi111.stdout:4/366: dwrite d8/f15 [0,4194304] 0 2023-12-08T20:27:53.141 INFO:tasks.workunit.client.1.smithi111.stdout:5/570: dread d3/d4/d7/d2c/f4c [0,4194304] 0 2023-12-08T20:27:53.143 INFO:tasks.workunit.client.1.smithi111.stdout:5/571: mknod d3/d4/d7/d36/d82/db4/dbe/cc5 0 2023-12-08T20:27:53.145 INFO:tasks.workunit.client.1.smithi111.stdout:5/572: mkdir d3/d4/d7/d36/d82/db4/dbe/dc6 0 2023-12-08T20:27:53.145 INFO:tasks.workunit.client.1.smithi111.stdout:5/573: chown d3/d4/l72 565 1 2023-12-08T20:27:53.145 INFO:tasks.workunit.client.1.smithi111.stdout:5/574: readlink d3/d4/d7/d36/d64/d8a/la6 0 2023-12-08T20:27:53.147 INFO:tasks.workunit.client.1.smithi111.stdout:0/722: dwrite d1/dd/f4e [0,4194304] 0 2023-12-08T20:27:53.147 INFO:tasks.workunit.client.1.smithi111.stdout:0/723: dread d1/df/d16/fb4 [0,4194304] 0 2023-12-08T20:27:53.147 INFO:tasks.workunit.client.1.smithi111.stdout:0/724: readlink d1/df/d16/d2c/d7e/la5 0 2023-12-08T20:27:53.148 INFO:tasks.workunit.client.1.smithi111.stdout:6/313: dwrite d0/d1/d1e/f2b [0,4194304] 0 2023-12-08T20:27:53.155 INFO:tasks.workunit.client.1.smithi111.stdout:0/725: rename d1/df/d16/c68 to d1/d2d/d83/cf7 0 2023-12-08T20:27:53.155 INFO:tasks.workunit.client.1.smithi111.stdout:0/726: read - d1/d69/d8b/f9c zero size 2023-12-08T20:27:53.155 INFO:tasks.workunit.client.1.smithi111.stdout:0/727: fsync d1/dd/d4a/f84 0 2023-12-08T20:27:53.155 INFO:tasks.workunit.client.1.smithi111.stdout:5/575: truncate d3/d4/d7/d36/f7c 367827 0 2023-12-08T20:27:53.155 INFO:tasks.workunit.client.1.smithi111.stdout:5/576: chown d3/d12/cb0 1993848 1 2023-12-08T20:27:53.156 INFO:tasks.workunit.client.1.smithi111.stdout:5/577: rename d3/d4/d7/d36/d64/faf to d3/d4/d7/d36/d82/db4/dbe/dc6/fc7 0 2023-12-08T20:27:53.156 INFO:tasks.workunit.client.1.smithi111.stdout:5/578: unlink d3/d4/d7/d29/d30/c6c 0 2023-12-08T20:27:53.163 INFO:tasks.workunit.client.1.smithi111.stdout:5/579: dread d3/d4/d7/d29/d73/f9e [0,4194304] 0 2023-12-08T20:27:53.165 INFO:tasks.workunit.client.1.smithi111.stdout:4/367: dwrite d8/da/d2c/f5e [0,4194304] 0 2023-12-08T20:27:53.165 INFO:tasks.workunit.client.1.smithi111.stdout:4/368: getdents d8/da/d29/d6e 0 2023-12-08T20:27:53.169 INFO:tasks.workunit.client.1.smithi111.stdout:5/580: write d3/d4/d7/d36/d82/f85 [3856643,115725] 0 2023-12-08T20:27:53.169 INFO:tasks.workunit.client.1.smithi111.stdout:6/314: dwrite d0/d1a/f2a [0,4194304] 0 2023-12-08T20:27:53.169 INFO:tasks.workunit.client.1.smithi111.stdout:5/581: write d3/d4/d7/d29/d30/fb5 [4896768,80015] 0 2023-12-08T20:27:53.169 INFO:tasks.workunit.client.1.smithi111.stdout:5/582: chown d3/d4/d7/f13 105505 1 2023-12-08T20:27:53.170 INFO:tasks.workunit.client.1.smithi111.stdout:6/315: write d0/d1a/f60 [559409,99628] 0 2023-12-08T20:27:53.173 INFO:tasks.workunit.client.1.smithi111.stdout:5/583: rename d3/d12/ca8 to d3/d4/d7/d2c/cc8 0 2023-12-08T20:27:53.173 INFO:tasks.workunit.client.1.smithi111.stdout:6/316: rmdir d0/d1/d1e 39 2023-12-08T20:27:53.173 INFO:tasks.workunit.client.1.smithi111.stdout:0/728: dwrite d1/df/d44/d37/d5c/d70/ff6 [0,4194304] 0 2023-12-08T20:27:53.178 INFO:tasks.workunit.client.1.smithi111.stdout:5/584: link d3/d4/d7/d29/l37 d3/d4/d4a/lc9 0 2023-12-08T20:27:53.178 INFO:tasks.workunit.client.1.smithi111.stdout:6/317: rmdir d0/d1/d27/d56/d5a 39 2023-12-08T20:27:53.179 INFO:tasks.workunit.client.1.smithi111.stdout:5/585: read d3/f14 [864350,119529] 0 2023-12-08T20:27:53.181 INFO:tasks.workunit.client.1.smithi111.stdout:5/586: symlink d3/d12/dbd/lca 0 2023-12-08T20:27:53.182 INFO:tasks.workunit.client.1.smithi111.stdout:5/587: mknod d3/d4/ccb 0 2023-12-08T20:27:53.183 INFO:tasks.workunit.client.1.smithi111.stdout:5/588: symlink d3/d4/d7/d2c/lcc 0 2023-12-08T20:27:53.194 INFO:tasks.workunit.client.1.smithi111.stdout:5/589: dread d3/f10 [0,4194304] 0 2023-12-08T20:27:53.194 INFO:tasks.workunit.client.1.smithi111.stdout:5/590: truncate d3/d4/f8e 4831046 0 2023-12-08T20:27:53.194 INFO:tasks.workunit.client.1.smithi111.stdout:4/369: dwrite d8/da/db/d31/f4c [0,4194304] 0 2023-12-08T20:27:53.194 INFO:tasks.workunit.client.1.smithi111.stdout:0/729: dwrite d1/d4/d24/f6b [0,4194304] 0 2023-12-08T20:27:53.194 INFO:tasks.workunit.client.1.smithi111.stdout:0/730: write d1/df/d16/d2c/d7e/fe8 [332914,46270] 0 2023-12-08T20:27:53.194 INFO:tasks.workunit.client.1.smithi111.stdout:0/731: dread - d1/df/d44/d37/fa7 zero size 2023-12-08T20:27:53.194 INFO:tasks.workunit.client.1.smithi111.stdout:0/732: readlink d1/d4/l22 0 2023-12-08T20:27:53.195 INFO:tasks.workunit.client.1.smithi111.stdout:4/370: write d8/da/db/fc [1657187,114668] 0 2023-12-08T20:27:53.196 INFO:tasks.workunit.client.1.smithi111.stdout:4/371: fsync f1 0 2023-12-08T20:27:53.210 INFO:tasks.workunit.client.1.smithi111.stdout:5/591: dwrite d3/d4/d7/d2c/f5a [0,4194304] 0 2023-12-08T20:27:53.214 INFO:tasks.workunit.client.1.smithi111.stdout:0/733: creat d1/d4/d24/d46/ff8 x:0 0 0 2023-12-08T20:27:53.214 INFO:tasks.workunit.client.1.smithi111.stdout:0/734: chown d1/f57 43063 1 2023-12-08T20:27:53.214 INFO:tasks.workunit.client.1.smithi111.stdout:0/735: write d1/dd/d4a/f84 [288883,118383] 0 2023-12-08T20:27:53.215 INFO:tasks.workunit.client.1.smithi111.stdout:0/736: read d1/df/f97 [2201521,113042] 0 2023-12-08T20:27:53.215 INFO:tasks.workunit.client.1.smithi111.stdout:0/737: chown d1/df/d44/d37/dac/dce 127910861 1 2023-12-08T20:27:53.217 INFO:tasks.workunit.client.1.smithi111.stdout:0/738: getdents d1/d4/d24/d2f 0 2023-12-08T20:27:53.219 INFO:tasks.workunit.client.1.smithi111.stdout:0/739: creat d1/df/d44/d37/dac/ff9 x:0 0 0 2023-12-08T20:27:53.220 INFO:tasks.workunit.client.1.smithi111.stdout:0/740: rename d1/df/d44/d37/cc9 to d1/d4/d24/d46/d49/d7f/ddf/cfa 0 2023-12-08T20:27:53.220 INFO:tasks.workunit.client.1.smithi111.stdout:0/741: truncate d1/df/d56/fc7 680783 0 2023-12-08T20:27:53.221 INFO:tasks.workunit.client.1.smithi111.stdout:6/318: dwrite d0/d1a/f2a [4194304,4194304] 0 2023-12-08T20:27:53.221 INFO:tasks.workunit.client.1.smithi111.stdout:6/319: fsync d0/d1/d27/f5c 0 2023-12-08T20:27:53.222 INFO:tasks.workunit.client.1.smithi111.stdout:6/320: write d0/d1/f8 [943043,89727] 0 2023-12-08T20:27:53.223 INFO:tasks.workunit.client.1.smithi111.stdout:6/321: chown d0/d1b/l57 82959 1 2023-12-08T20:27:53.223 INFO:tasks.workunit.client.1.smithi111.stdout:6/322: readlink d0/l37 0 2023-12-08T20:27:53.224 INFO:tasks.workunit.client.1.smithi111.stdout:6/323: stat d0/c30 0 2023-12-08T20:27:53.224 INFO:tasks.workunit.client.1.smithi111.stdout:6/324: stat d0/d1a/f2a 0 2023-12-08T20:27:53.226 INFO:tasks.workunit.client.1.smithi111.stdout:6/325: creat d0/d1/f64 x:0 0 0 2023-12-08T20:27:53.229 INFO:tasks.workunit.client.1.smithi111.stdout:5/592: dwrite d3/d4/d7/f8b [0,4194304] 0 2023-12-08T20:27:53.235 INFO:tasks.workunit.client.1.smithi111.stdout:0/742: dwrite d1/df/d16/f53 [0,4194304] 0 2023-12-08T20:27:53.239 INFO:tasks.workunit.client.1.smithi111.stdout:5/593: dread d3/d4/d7/d36/d64/f86 [0,4194304] 0 2023-12-08T20:27:53.240 INFO:tasks.workunit.client.1.smithi111.stdout:6/326: dwrite d0/d1/d27/f2d [0,4194304] 0 2023-12-08T20:27:53.241 INFO:tasks.workunit.client.1.smithi111.stdout:5/594: creat d3/d8d/fcd x:0 0 0 2023-12-08T20:27:53.241 INFO:tasks.workunit.client.1.smithi111.stdout:5/595: chown d3/d4/d7/d29/d73/d90/fb1 72383088 1 2023-12-08T20:27:53.244 INFO:tasks.workunit.client.1.smithi111.stdout:6/327: rmdir d0/d1/d27/d56/d5a 39 2023-12-08T20:27:53.245 INFO:tasks.workunit.client.1.smithi111.stdout:6/328: write d0/d1a/f28 [654303,106406] 0 2023-12-08T20:27:53.245 INFO:tasks.workunit.client.1.smithi111.stdout:6/329: chown d0/d1 117 1 2023-12-08T20:27:53.246 INFO:tasks.workunit.client.1.smithi111.stdout:6/330: fsync d0/f22 0 2023-12-08T20:27:53.247 INFO:tasks.workunit.client.1.smithi111.stdout:5/596: link d3/d4/d7/f16 d3/d12/fce 0 2023-12-08T20:27:53.247 INFO:tasks.workunit.client.1.smithi111.stdout:2/461: sync 2023-12-08T20:27:53.248 INFO:tasks.workunit.client.1.smithi111.stdout:3/429: sync 2023-12-08T20:27:53.248 INFO:tasks.workunit.client.1.smithi111.stdout:3/430: fsync d2/d3/d13/d36/d69/d70/f66 0 2023-12-08T20:27:53.249 INFO:tasks.workunit.client.1.smithi111.stdout:3/431: mknod d2/d15/c89 0 2023-12-08T20:27:53.251 INFO:tasks.workunit.client.1.smithi111.stdout:2/462: write d1/d1d/d22/d30/f5c [446552,94574] 0 2023-12-08T20:27:53.251 INFO:tasks.workunit.client.1.smithi111.stdout:2/463: readlink d1/d1d/d1f/d25/d3d/d41/l5b 0 2023-12-08T20:27:53.252 INFO:tasks.workunit.client.1.smithi111.stdout:3/432: unlink d2/d3/d6/c41 0 2023-12-08T20:27:53.252 INFO:tasks.workunit.client.1.smithi111.stdout:1/525: sync 2023-12-08T20:27:53.252 INFO:tasks.workunit.client.1.smithi111.stdout:3/433: stat d2/d15/d17/d25/f26 0 2023-12-08T20:27:53.252 INFO:tasks.workunit.client.1.smithi111.stdout:3/434: write d2/d12/d4a/d5d/f6a [781246,81656] 0 2023-12-08T20:27:53.253 INFO:tasks.workunit.client.1.smithi111.stdout:9/575: sync 2023-12-08T20:27:53.254 INFO:tasks.workunit.client.1.smithi111.stdout:3/435: mknod d2/d3/d6/c8a 0 2023-12-08T20:27:53.258 INFO:tasks.workunit.client.1.smithi111.stdout:9/576: link d2/d8/dd/d1a/d74/dbf/fc2 d2/d8/fcc 0 2023-12-08T20:27:53.258 INFO:tasks.workunit.client.1.smithi111.stdout:9/577: creat d2/fcd x:0 0 0 2023-12-08T20:27:53.258 INFO:tasks.workunit.client.1.smithi111.stdout:3/436: write d2/d15/d17/f35 [1562556,117461] 0 2023-12-08T20:27:53.260 INFO:tasks.workunit.client.1.smithi111.stdout:3/437: unlink d2/d3/d13/d36/d44/f7b 0 2023-12-08T20:27:53.267 INFO:tasks.workunit.client.1.smithi111.stdout:0/743: dwrite d1/df/f3b [0,4194304] 0 2023-12-08T20:27:53.270 INFO:tasks.workunit.client.1.smithi111.stdout:1/526: dread d0/d6/d33/d15/f30 [0,4194304] 0 2023-12-08T20:27:53.270 INFO:tasks.workunit.client.1.smithi111.stdout:1/527: write d0/d4d/fb1 [943205,5282] 0 2023-12-08T20:27:53.273 INFO:tasks.workunit.client.1.smithi111.stdout:0/744: symlink d1/d4/d24/d46/d49/d7f/d95/lfb 0 2023-12-08T20:27:53.274 INFO:tasks.workunit.client.1.smithi111.stdout:1/528: creat d0/d6/d33/d15/d51/d78/fba x:0 0 0 2023-12-08T20:27:53.274 INFO:tasks.workunit.client.1.smithi111.stdout:1/529: write d0/d4d/f57 [654000,102250] 0 2023-12-08T20:27:53.276 INFO:tasks.workunit.client.1.smithi111.stdout:6/331: dwrite d0/f55 [0,4194304] 0 2023-12-08T20:27:53.276 INFO:tasks.workunit.client.1.smithi111.stdout:6/332: stat d0/d1/d27/l51 0 2023-12-08T20:27:53.276 INFO:tasks.workunit.client.1.smithi111.stdout:6/333: stat d0/d1/f64 0 2023-12-08T20:27:53.277 INFO:tasks.workunit.client.1.smithi111.stdout:1/530: truncate d0/d4d/f8c 155018 0 2023-12-08T20:27:53.278 INFO:tasks.workunit.client.1.smithi111.stdout:0/745: link d1/df/d44/d37/d5c/d70/ff6 d1/df/d44/d37/d5c/ffc 0 2023-12-08T20:27:53.280 INFO:tasks.workunit.client.1.smithi111.stdout:0/746: link d1/df/d16/d2c/d7b/f87 d1/df/d44/ffd 0 2023-12-08T20:27:53.280 INFO:tasks.workunit.client.1.smithi111.stdout:0/747: fsync d1/dd/d47/fbd 0 2023-12-08T20:27:53.280 INFO:tasks.workunit.client.1.smithi111.stdout:0/748: readlink d1/df/d44/d37/l75 0 2023-12-08T20:27:53.283 INFO:tasks.workunit.client.1.smithi111.stdout:5/597: dwrite d3/d12/f7e [0,4194304] 0 2023-12-08T20:27:53.284 INFO:tasks.workunit.client.1.smithi111.stdout:5/598: chown d3/d4/c50 538 1 2023-12-08T20:27:53.284 INFO:tasks.workunit.client.1.smithi111.stdout:2/464: dwrite d1/d1d/d1f/d25/d3d/f63 [0,4194304] 0 2023-12-08T20:27:53.285 INFO:tasks.workunit.client.1.smithi111.stdout:9/578: dwrite d2/d8/dd/d1a/d1e/d2d/d35/f60 [0,4194304] 0 2023-12-08T20:27:53.287 INFO:tasks.workunit.client.1.smithi111.stdout:5/599: unlink d3/d4/d7/d36/f68 0 2023-12-08T20:27:53.288 INFO:tasks.workunit.client.1.smithi111.stdout:3/438: dwrite d2/d12/d2e/f48 [0,4194304] 0 2023-12-08T20:27:53.288 INFO:tasks.workunit.client.1.smithi111.stdout:3/439: dread - d2/d15/d17/f5c zero size 2023-12-08T20:27:53.288 INFO:tasks.workunit.client.1.smithi111.stdout:3/440: fdatasync d2/d3/d6/fd 0 2023-12-08T20:27:53.289 INFO:tasks.workunit.client.1.smithi111.stdout:9/579: dread d2/d8/dd/d1a/d1e/d2d/d35/d88/f99 [0,4194304] 0 2023-12-08T20:27:53.295 INFO:tasks.workunit.client.1.smithi111.stdout:2/465: rename d1/d1d/d68/la3 to d1/d1d/d68/lb0 0 2023-12-08T20:27:53.297 INFO:tasks.workunit.client.1.smithi111.stdout:0/749: dwrite d1/df/f3b [0,4194304] 0 2023-12-08T20:27:53.302 INFO:tasks.workunit.client.1.smithi111.stdout:3/441: rename d2/d3/d1e/d72 to d2/d3/d6/d8b 0 2023-12-08T20:27:53.304 INFO:tasks.workunit.client.1.smithi111.stdout:9/580: creat d2/da/fce x:0 0 0 2023-12-08T20:27:53.305 INFO:tasks.workunit.client.1.smithi111.stdout:2/466: dread d1/d1d/d22/f69 [0,4194304] 0 2023-12-08T20:27:53.306 INFO:tasks.workunit.client.1.smithi111.stdout:0/750: mknod d1/dd/d47/cfe 0 2023-12-08T20:27:53.308 INFO:tasks.workunit.client.1.smithi111.stdout:0/751: creat d1/df/d56/fff x:0 0 0 2023-12-08T20:27:53.309 INFO:tasks.workunit.client.1.smithi111.stdout:9/581: truncate d2/d8/dd/d1a/d74/f8e 752898 0 2023-12-08T20:27:53.311 INFO:tasks.workunit.client.1.smithi111.stdout:9/582: creat d2/d8/dd/d1a/d1e/d2d/d4a/d62/fcf x:0 0 0 2023-12-08T20:27:53.311 INFO:tasks.workunit.client.1.smithi111.stdout:9/583: fdatasync d2/d8/d9b/f48 0 2023-12-08T20:27:53.311 INFO:tasks.workunit.client.1.smithi111.stdout:9/584: stat d2/d8/dd/f69 0 2023-12-08T20:27:53.311 INFO:tasks.workunit.client.1.smithi111.stdout:9/585: chown d2/d8/dd/d1a/d74 61115134 1 2023-12-08T20:27:53.312 INFO:tasks.workunit.client.1.smithi111.stdout:9/586: truncate d2/d8/fcc 1068115 0 2023-12-08T20:27:53.312 INFO:tasks.workunit.client.1.smithi111.stdout:0/752: write d1/d4/d24/d46/d49/d7f/fd5 [883042,55216] 0 2023-12-08T20:27:53.312 INFO:tasks.workunit.client.1.smithi111.stdout:9/587: mknod d2/d8/d8c/dbb/cd0 0 2023-12-08T20:27:53.318 INFO:tasks.workunit.client.1.smithi111.stdout:5/600: dwrite d3/d4/d7/d29/f9b [0,4194304] 0 2023-12-08T20:27:53.319 INFO:tasks.workunit.client.1.smithi111.stdout:0/753: creat d1/f100 x:0 0 0 2023-12-08T20:27:53.319 INFO:tasks.workunit.client.1.smithi111.stdout:0/754: fdatasync d1/d4/f35 0 2023-12-08T20:27:53.319 INFO:tasks.workunit.client.1.smithi111.stdout:5/601: chown d3/d4/d7/c4b 271 1 2023-12-08T20:27:53.319 INFO:tasks.workunit.client.1.smithi111.stdout:5/602: readlink d3/d4/d7/d36/l4e 0 2023-12-08T20:27:53.319 INFO:tasks.workunit.client.1.smithi111.stdout:0/755: dread - d1/d4/d24/d46/d49/d7f/d95/db8/fe2 zero size 2023-12-08T20:27:53.319 INFO:tasks.workunit.client.1.smithi111.stdout:0/756: chown d1/dd/f4e 35 1 2023-12-08T20:27:53.319 INFO:tasks.workunit.client.1.smithi111.stdout:0/757: write d1/df/d16/fae [1476915,93754] 0 2023-12-08T20:27:53.327 INFO:tasks.workunit.client.1.smithi111.stdout:3/442: dwrite d2/d3/f16 [0,4194304] 0 2023-12-08T20:27:53.327 INFO:tasks.workunit.client.1.smithi111.stdout:3/443: fsync d2/d3/fb 0 2023-12-08T20:27:53.329 INFO:tasks.workunit.client.1.smithi111.stdout:5/603: rename d3/d12/fce to d3/d4/d4a/fcf 0 2023-12-08T20:27:53.330 INFO:tasks.workunit.client.1.smithi111.stdout:3/444: creat d2/d12/f8c x:0 0 0 2023-12-08T20:27:53.331 INFO:tasks.workunit.client.1.smithi111.stdout:5/604: mknod d3/d4/d7/cd0 0 2023-12-08T20:27:53.331 INFO:tasks.workunit.client.1.smithi111.stdout:5/605: chown d3/d4/d4a/c23 6786 1 2023-12-08T20:27:53.331 INFO:tasks.workunit.client.1.smithi111.stdout:2/467: dwrite d1/d29/d53/d90/f6e [0,4194304] 0 2023-12-08T20:27:53.332 INFO:tasks.workunit.client.1.smithi111.stdout:2/468: fsync d1/d29/d53/d91/f9e 0 2023-12-08T20:27:53.332 INFO:tasks.workunit.client.1.smithi111.stdout:5/606: creat d3/d4/d7/d29/d30/fd1 x:0 0 0 2023-12-08T20:27:53.333 INFO:tasks.workunit.client.1.smithi111.stdout:9/588: dwrite d2/d8/dd/d1a/f80 [0,4194304] 0 2023-12-08T20:27:53.333 INFO:tasks.workunit.client.1.smithi111.stdout:9/589: chown d2/f7 773284 1 2023-12-08T20:27:53.334 INFO:tasks.workunit.client.1.smithi111.stdout:2/469: link d1/d1d/d22/l3b d1/d1d/d1f/d36/lb1 0 2023-12-08T20:27:53.336 INFO:tasks.workunit.client.1.smithi111.stdout:5/607: symlink d3/d4/ld2 0 2023-12-08T20:27:53.342 INFO:tasks.workunit.client.1.smithi111.stdout:2/470: creat d1/d1d/d1f/d36/d92/fb2 x:0 0 0 2023-12-08T20:27:53.343 INFO:tasks.workunit.client.1.smithi111.stdout:5/608: mkdir d3/d4/d7/d29/d30/dd3 0 2023-12-08T20:27:53.344 INFO:tasks.workunit.client.1.smithi111.stdout:3/445: dwrite d2/d15/d17/f68 [0,4194304] 0 2023-12-08T20:27:53.345 INFO:tasks.workunit.client.1.smithi111.stdout:5/609: symlink d3/d8d/ld4 0 2023-12-08T20:27:53.348 INFO:tasks.workunit.client.1.smithi111.stdout:3/446: mknod d2/d3/d13/d36/c8d 0 2023-12-08T20:27:53.350 INFO:tasks.workunit.client.1.smithi111.stdout:5/610: rmdir d3/d4/d7/d36/d82/db4 39 2023-12-08T20:27:53.350 INFO:tasks.workunit.client.1.smithi111.stdout:5/611: chown d3/d4/d4a/d21 488 1 2023-12-08T20:27:53.351 INFO:tasks.workunit.client.1.smithi111.stdout:3/447: link d2/d3/d6/c11 d2/d15/d17/d5e/c8e 0 2023-12-08T20:27:53.353 INFO:tasks.workunit.client.1.smithi111.stdout:5/612: mknod d3/d6d/cd5 0 2023-12-08T20:27:53.354 INFO:tasks.workunit.client.1.smithi111.stdout:3/448: mkdir d2/d3/d13/d36/d44/d8f 0 2023-12-08T20:27:53.354 INFO:tasks.workunit.client.1.smithi111.stdout:3/449: write d2/d15/d17/d25/f26 [776631,31063] 0 2023-12-08T20:27:53.355 INFO:tasks.workunit.client.1.smithi111.stdout:5/613: mkdir d3/d4/d7/d29/dd6 0 2023-12-08T20:27:53.355 INFO:tasks.workunit.client.1.smithi111.stdout:5/614: stat d3/d12 0 2023-12-08T20:27:53.356 INFO:tasks.workunit.client.1.smithi111.stdout:3/450: getdents d2/d3/d51 0 2023-12-08T20:27:53.357 INFO:tasks.workunit.client.1.smithi111.stdout:5/615: mknod d3/d4/d7/d29/d30/dd3/cd7 0 2023-12-08T20:27:53.358 INFO:tasks.workunit.client.1.smithi111.stdout:3/451: creat d2/d3/d13/d36/d69/d70/f90 x:0 0 0 2023-12-08T20:27:53.360 INFO:tasks.workunit.client.1.smithi111.stdout:5/616: link d3/d4/d4a/l45 d3/d4/d7/d29/d30/dd3/ld8 0 2023-12-08T20:27:53.370 INFO:tasks.workunit.client.1.smithi111.stdout:5/617: dread d3/d8d/f92 [0,4194304] 0 2023-12-08T20:27:53.370 INFO:tasks.workunit.client.1.smithi111.stdout:5/618: chown d3/d4/d7/d29/d30/f9d 30167 1 2023-12-08T20:27:53.370 INFO:tasks.workunit.client.1.smithi111.stdout:5/619: chown d3/d4/f8 264574342 1 2023-12-08T20:27:53.371 INFO:tasks.workunit.client.1.smithi111.stdout:5/620: creat d3/d4/d7/d2c/fd9 x:0 0 0 2023-12-08T20:27:53.372 INFO:tasks.workunit.client.1.smithi111.stdout:5/621: creat d3/d4/d7/d36/d82/fda x:0 0 0 2023-12-08T20:27:53.373 INFO:tasks.workunit.client.1.smithi111.stdout:5/622: rename d3/d4/d4a/f49 to d3/d4/d7/d29/d30/dd3/fdb 0 2023-12-08T20:27:53.376 INFO:tasks.workunit.client.1.smithi111.stdout:3/452: dwrite d2/d3/d6/fd [0,4194304] 0 2023-12-08T20:27:53.376 INFO:tasks.workunit.client.1.smithi111.stdout:3/453: fsync d2/d3/d13/d36/d69/f75 0 2023-12-08T20:27:53.377 INFO:tasks.workunit.client.1.smithi111.stdout:3/454: creat d2/d3/d13/d36/d44/d8f/f91 x:0 0 0 2023-12-08T20:27:53.378 INFO:tasks.workunit.client.1.smithi111.stdout:3/455: fdatasync d2/d3/d13/d36/f3e 0 2023-12-08T20:27:53.378 INFO:tasks.workunit.client.1.smithi111.stdout:3/456: write d2/f80 [668129,19336] 0 2023-12-08T20:27:53.382 INFO:tasks.workunit.client.1.smithi111.stdout:5/623: dread d3/d4/d7/d2c/f4c [0,4194304] 0 2023-12-08T20:27:53.384 INFO:tasks.workunit.client.1.smithi111.stdout:5/624: link d3/d4/d4a/d21/faa d3/d4/d7/d29/d73/d90/fdc 0 2023-12-08T20:27:53.384 INFO:tasks.workunit.client.1.smithi111.stdout:5/625: write d3/d4/d7/d2c/f83 [878538,113120] 0 2023-12-08T20:27:53.386 INFO:tasks.workunit.client.1.smithi111.stdout:5/626: creat d3/d4/d4a/d21/fdd x:0 0 0 2023-12-08T20:27:53.386 INFO:tasks.workunit.client.1.smithi111.stdout:3/457: dread d2/d3/d6/fd [0,4194304] 0 2023-12-08T20:27:53.386 INFO:tasks.workunit.client.1.smithi111.stdout:5/627: creat d3/d4/d7/d36/fde x:0 0 0 2023-12-08T20:27:53.387 INFO:tasks.workunit.client.1.smithi111.stdout:3/458: symlink d2/d3/d13/d36/d44/d8f/l92 0 2023-12-08T20:27:53.388 INFO:tasks.workunit.client.1.smithi111.stdout:5/628: getdents d3/d4/d7 0 2023-12-08T20:27:53.402 INFO:tasks.workunit.client.1.smithi111.stdout:7/398: sync 2023-12-08T20:27:53.402 INFO:tasks.workunit.client.1.smithi111.stdout:5/629: dwrite d3/d4/d7/d36/d82/db4/fb7 [0,4194304] 0 2023-12-08T20:27:53.402 INFO:tasks.workunit.client.1.smithi111.stdout:5/630: stat d3/d4/f8e 0 2023-12-08T20:27:53.402 INFO:tasks.workunit.client.1.smithi111.stdout:5/631: fdatasync d3/d8d/fcd 0 2023-12-08T20:27:53.403 INFO:tasks.workunit.client.1.smithi111.stdout:7/399: write da/d64/f71 [531840,52495] 0 2023-12-08T20:27:53.408 INFO:tasks.workunit.client.1.smithi111.stdout:7/400: mkdir da/d38/d80 0 2023-12-08T20:27:53.408 INFO:tasks.workunit.client.1.smithi111.stdout:7/401: fdatasync da/d13/d21/f67 0 2023-12-08T20:27:53.408 INFO:tasks.workunit.client.1.smithi111.stdout:7/402: mknod da/d25/d26/d3c/c81 0 2023-12-08T20:27:53.409 INFO:tasks.workunit.client.1.smithi111.stdout:7/403: mknod da/d13/d21/c82 0 2023-12-08T20:27:53.410 INFO:tasks.workunit.client.1.smithi111.stdout:7/404: truncate da/d25/d26/f2b 1282382 0 2023-12-08T20:27:53.410 INFO:tasks.workunit.client.1.smithi111.stdout:7/405: readlink da/d13/l39 0 2023-12-08T20:27:53.415 INFO:tasks.workunit.client.1.smithi111.stdout:5/632: dwrite d3/d12/f17 [0,4194304] 0 2023-12-08T20:27:53.427 INFO:tasks.workunit.client.1.smithi111.stdout:7/406: write da/d25/d26/f2b [912261,76328] 0 2023-12-08T20:27:53.431 INFO:tasks.workunit.client.1.smithi111.stdout:7/407: truncate da/d13/f69 188273 0 2023-12-08T20:27:53.432 INFO:tasks.workunit.client.1.smithi111.stdout:5/633: dwrite d3/d4/d7/d29/d73/d90/fdc [0,4194304] 0 2023-12-08T20:27:53.432 INFO:tasks.workunit.client.1.smithi111.stdout:7/408: getdents da/d25/d3d 0 2023-12-08T20:27:53.432 INFO:tasks.workunit.client.1.smithi111.stdout:7/409: symlink da/d5c/d59/d61/l83 0 2023-12-08T20:27:53.433 INFO:tasks.workunit.client.1.smithi111.stdout:7/410: symlink da/d38/d80/l84 0 2023-12-08T20:27:53.447 INFO:tasks.workunit.client.1.smithi111.stdout:5/634: dwrite d3/d4/d7/d29/d73/d90/fa1 [0,4194304] 0 2023-12-08T20:27:53.447 INFO:tasks.workunit.client.1.smithi111.stdout:7/411: dwrite da/d13/f4c [0,4194304] 0 2023-12-08T20:27:53.447 INFO:tasks.workunit.client.1.smithi111.stdout:7/412: getdents da/d25/d3d 0 2023-12-08T20:27:53.450 INFO:tasks.workunit.client.1.smithi111.stdout:5/635: mkdir d3/d12/d67/ddf 0 2023-12-08T20:27:53.450 INFO:tasks.workunit.client.1.smithi111.stdout:5/636: dread - d3/d4/d7/d36/fde zero size 2023-12-08T20:27:53.450 INFO:tasks.workunit.client.1.smithi111.stdout:5/637: stat d3/d12 0 2023-12-08T20:27:53.450 INFO:tasks.workunit.client.1.smithi111.stdout:5/638: write d3/d4/d7/d29/f9b [5195468,14496] 0 2023-12-08T20:27:53.451 INFO:tasks.workunit.client.1.smithi111.stdout:5/639: mknod d3/d6d/ce0 0 2023-12-08T20:27:53.451 INFO:tasks.workunit.client.1.smithi111.stdout:5/640: truncate d3/d12/f7e 4722848 0 2023-12-08T20:27:53.451 INFO:tasks.workunit.client.1.smithi111.stdout:5/641: write d3/d4/d7/d2c/f97 [888896,23965] 0 2023-12-08T20:27:53.452 INFO:tasks.workunit.client.1.smithi111.stdout:5/642: fsync d3/d4/d7/d29/d73/d90/fa1 0 2023-12-08T20:27:53.463 INFO:tasks.workunit.client.1.smithi111.stdout:7/413: dwrite da/d25/f5d [0,4194304] 0 2023-12-08T20:27:53.466 INFO:tasks.workunit.client.1.smithi111.stdout:7/414: creat da/d25/d3d/f85 x:0 0 0 2023-12-08T20:27:53.468 INFO:tasks.workunit.client.1.smithi111.stdout:5/643: dwrite d3/f6b [4194304,4194304] 0 2023-12-08T20:27:53.471 INFO:tasks.workunit.client.1.smithi111.stdout:5/644: write d3/d4/d4a/fb3 [3752315,29756] 0 2023-12-08T20:27:53.477 INFO:tasks.workunit.client.1.smithi111.stdout:5/645: dread d3/d4/d4a/f5f [0,4194304] 0 2023-12-08T20:27:53.477 INFO:tasks.workunit.client.1.smithi111.stdout:5/646: write d3/d4/d7/d2c/f97 [777097,112959] 0 2023-12-08T20:27:53.477 INFO:tasks.workunit.client.1.smithi111.stdout:5/647: read - d3/d4/d4a/f7a zero size 2023-12-08T20:27:53.478 INFO:tasks.workunit.client.1.smithi111.stdout:5/648: write d3/d4/d7/d29/d73/d90/fb1 [1647773,25707] 0 2023-12-08T20:27:53.479 INFO:tasks.workunit.client.1.smithi111.stdout:5/649: rmdir d3/d12/dbd 39 2023-12-08T20:27:53.480 INFO:tasks.workunit.client.1.smithi111.stdout:5/650: read d3/d4/d7/d2c/f83 [88670,94198] 0 2023-12-08T20:27:53.481 INFO:tasks.workunit.client.1.smithi111.stdout:5/651: rename d3/d4/d7/d36/d64/d8a/f9f to d3/d4/d7/d29/d30/dc0/fe1 0 2023-12-08T20:27:53.482 INFO:tasks.workunit.client.1.smithi111.stdout:5/652: creat d3/d4/d7/d2c/fe2 x:0 0 0 2023-12-08T20:27:53.482 INFO:tasks.workunit.client.1.smithi111.stdout:5/653: write d3/d4/d7/d2c/fe2 [935479,10196] 0 2023-12-08T20:27:53.483 INFO:tasks.workunit.client.1.smithi111.stdout:7/415: dwrite da/d25/d26/f41 [0,4194304] 0 2023-12-08T20:27:53.485 INFO:tasks.workunit.client.1.smithi111.stdout:7/416: creat da/d5c/d6e/f86 x:0 0 0 2023-12-08T20:27:53.501 INFO:tasks.workunit.client.1.smithi111.stdout:7/417: dwrite da/d25/d26/f41 [0,4194304] 0 2023-12-08T20:27:53.502 INFO:tasks.workunit.client.1.smithi111.stdout:7/418: write da/d25/d26/d3c/f4b [4394175,116990] 0 2023-12-08T20:27:53.503 INFO:tasks.workunit.client.1.smithi111.stdout:7/419: mkdir da/d25/d26/d32/d87 0 2023-12-08T20:27:53.503 INFO:tasks.workunit.client.1.smithi111.stdout:7/420: getdents da/d25/d26/d3c/d75 0 2023-12-08T20:27:53.504 INFO:tasks.workunit.client.1.smithi111.stdout:7/421: rmdir da/d13/d21 39 2023-12-08T20:27:53.504 INFO:tasks.workunit.client.1.smithi111.stdout:7/422: read da/d25/d3d/d58/f66 [843696,12224] 0 2023-12-08T20:27:53.512 INFO:tasks.workunit.client.1.smithi111.stdout:7/423: dread da/d25/f3a [0,4194304] 0 2023-12-08T20:27:53.514 INFO:tasks.workunit.client.1.smithi111.stdout:7/424: rename da/d13/c70 to da/d13/d21/c88 0 2023-12-08T20:27:53.515 INFO:tasks.workunit.client.1.smithi111.stdout:7/425: mkdir da/d13/d21/d89 0 2023-12-08T20:27:53.516 INFO:tasks.workunit.client.1.smithi111.stdout:7/426: creat da/d5c/f8a x:0 0 0 2023-12-08T20:27:53.518 INFO:tasks.workunit.client.1.smithi111.stdout:7/427: rename da/d25/d26/d3c to da/d64/d8b 0 2023-12-08T20:27:53.518 INFO:tasks.workunit.client.1.smithi111.stdout:7/428: mknod da/d38/d80/c8c 0 2023-12-08T20:27:53.519 INFO:tasks.workunit.client.1.smithi111.stdout:7/429: write da/d25/f2e [4823108,49] 0 2023-12-08T20:27:53.519 INFO:tasks.workunit.client.1.smithi111.stdout:7/430: read - da/d25/d3d/f85 zero size 2023-12-08T20:27:53.521 INFO:tasks.workunit.client.1.smithi111.stdout:7/431: dread da/d13/f49 [0,4194304] 0 2023-12-08T20:27:53.521 INFO:tasks.workunit.client.1.smithi111.stdout:7/432: truncate da/d25/d3d/f51 553997 0 2023-12-08T20:27:53.523 INFO:tasks.workunit.client.1.smithi111.stdout:7/433: symlink da/d13/l8d 0 2023-12-08T20:27:53.523 INFO:tasks.workunit.client.1.smithi111.stdout:7/434: fsync da/f46 0 2023-12-08T20:27:53.523 INFO:tasks.workunit.client.1.smithi111.stdout:7/435: rmdir da/d13/d21 39 2023-12-08T20:27:53.523 INFO:tasks.workunit.client.1.smithi111.stdout:7/436: creat da/d25/d26/d32/f8e x:0 0 0 2023-12-08T20:27:53.540 INFO:tasks.workunit.client.1.smithi111.stdout:7/437: dwrite da/d25/d26/d32/f56 [0,4194304] 0 2023-12-08T20:27:53.541 INFO:tasks.workunit.client.1.smithi111.stdout:7/438: fsync da/d13/f7f 0 2023-12-08T20:27:53.541 INFO:tasks.workunit.client.1.smithi111.stdout:7/439: chown da/d64/d8b/d75/c77 443302 1 2023-12-08T20:27:53.544 INFO:tasks.workunit.client.1.smithi111.stdout:7/440: link da/d5c/d6e/f86 da/d38/f8f 0 2023-12-08T20:27:53.545 INFO:tasks.workunit.client.1.smithi111.stdout:7/441: rename da/d5c/f8a to da/d25/d26/d32/f90 0 2023-12-08T20:27:53.548 INFO:tasks.workunit.client.1.smithi111.stdout:7/442: link da/d25/d3d/f51 da/d13/f91 0 2023-12-08T20:27:53.549 INFO:tasks.workunit.client.1.smithi111.stdout:7/443: dread da/d13/f91 [0,4194304] 0 2023-12-08T20:27:53.558 INFO:tasks.workunit.client.1.smithi111.stdout:8/574: sync 2023-12-08T20:27:53.558 INFO:tasks.workunit.client.1.smithi111.stdout:4/372: sync 2023-12-08T20:27:53.558 INFO:tasks.workunit.client.1.smithi111.stdout:8/575: chown dd/d2d/d62 13450 1 2023-12-08T20:27:53.558 INFO:tasks.workunit.client.1.smithi111.stdout:4/373: fsync d8/da/d2c/d1f/d40/f60 0 2023-12-08T20:27:53.560 INFO:tasks.workunit.client.1.smithi111.stdout:8/576: creat dd/d32/d36/d50/fc8 x:0 0 0 2023-12-08T20:27:53.560 INFO:tasks.workunit.client.1.smithi111.stdout:8/577: chown dd/d2d/f45 173363 1 2023-12-08T20:27:53.566 INFO:tasks.workunit.client.1.smithi111.stdout:7/444: dwrite da/d25/f3b [0,4194304] 0 2023-12-08T20:27:53.573 INFO:tasks.workunit.client.1.smithi111.stdout:8/578: rmdir dd 39 2023-12-08T20:27:53.573 INFO:tasks.workunit.client.1.smithi111.stdout:8/579: write dd/d96/fa2 [308781,97162] 0 2023-12-08T20:27:53.574 INFO:tasks.workunit.client.1.smithi111.stdout:8/580: mkdir dd/dc9 0 2023-12-08T20:27:53.574 INFO:tasks.workunit.client.1.smithi111.stdout:8/581: read - dd/d32/d3d/f6a zero size 2023-12-08T20:27:53.575 INFO:tasks.workunit.client.1.smithi111.stdout:8/582: creat dd/d35/d42/db4/fca x:0 0 0 2023-12-08T20:27:53.583 INFO:tasks.workunit.client.1.smithi111.stdout:4/374: dwrite d8/da/d2c/d1f/d40/f55 [4194304,4194304] 0 2023-12-08T20:27:53.583 INFO:tasks.workunit.client.1.smithi111.stdout:7/445: dwrite da/d25/d26/d32/d3e/f42 [0,4194304] 0 2023-12-08T20:27:53.583 INFO:tasks.workunit.client.1.smithi111.stdout:7/446: chown da/d13/f69 97 1 2023-12-08T20:27:53.586 INFO:tasks.workunit.client.1.smithi111.stdout:4/375: dread d8/da/f3b [0,4194304] 0 2023-12-08T20:27:53.586 INFO:tasks.workunit.client.1.smithi111.stdout:7/447: rmdir da/d5c/d6e 39 2023-12-08T20:27:53.587 INFO:tasks.workunit.client.1.smithi111.stdout:7/448: chown da/d25/d3d/f85 6899599 1 2023-12-08T20:27:53.587 INFO:tasks.workunit.client.1.smithi111.stdout:7/449: mknod da/d5c/d59/c92 0 2023-12-08T20:27:53.587 INFO:tasks.workunit.client.1.smithi111.stdout:7/450: chown da/d25/f5d 56015 1 2023-12-08T20:27:53.588 INFO:tasks.workunit.client.1.smithi111.stdout:8/583: dread f2 [0,4194304] 0 2023-12-08T20:27:53.589 INFO:tasks.workunit.client.1.smithi111.stdout:7/451: rename da/l7d to da/d25/d26/d32/l93 0 2023-12-08T20:27:53.590 INFO:tasks.workunit.client.1.smithi111.stdout:7/452: read da/d13/d21/f67 [2927264,34190] 0 2023-12-08T20:27:53.594 INFO:tasks.workunit.client.1.smithi111.stdout:7/453: unlink da/d25/d3d/d58/f66 0 2023-12-08T20:27:53.595 INFO:tasks.workunit.client.1.smithi111.stdout:7/454: fdatasync da/d25/d26/d32/f8e 0 2023-12-08T20:27:53.610 INFO:tasks.workunit.client.1.smithi111.stdout:4/376: dwrite d8/da/d2c/d1f/f6a [0,4194304] 0 2023-12-08T20:27:53.611 INFO:tasks.workunit.client.1.smithi111.stdout:8/584: dwrite dd/f2b [0,4194304] 0 2023-12-08T20:27:53.621 INFO:tasks.workunit.client.1.smithi111.stdout:4/377: write d8/da/f75 [3100495,18175] 0 2023-12-08T20:27:53.623 INFO:tasks.workunit.client.1.smithi111.stdout:4/378: creat d8/da/d29/f78 x:0 0 0 2023-12-08T20:27:53.624 INFO:tasks.workunit.client.1.smithi111.stdout:4/379: creat d8/d30/f79 x:0 0 0 2023-12-08T20:27:53.625 INFO:tasks.workunit.client.1.smithi111.stdout:8/585: dwrite dd/f14 [0,4194304] 0 2023-12-08T20:27:53.625 INFO:tasks.workunit.client.1.smithi111.stdout:4/380: symlink d8/da/d29/l7a 0 2023-12-08T20:27:53.627 INFO:tasks.workunit.client.1.smithi111.stdout:4/381: mknod d8/d38/c7b 0 2023-12-08T20:27:53.645 INFO:tasks.workunit.client.1.smithi111.stdout:8/586: dwrite dd/d35/d7a/fac [0,4194304] 0 2023-12-08T20:27:53.646 INFO:tasks.workunit.client.1.smithi111.stdout:4/382: dwrite d8/d30/f79 [0,4194304] 0 2023-12-08T20:27:53.647 INFO:tasks.workunit.client.1.smithi111.stdout:4/383: write d8/da/f66 [3534712,26883] 0 2023-12-08T20:27:53.647 INFO:tasks.workunit.client.1.smithi111.stdout:4/384: fdatasync f1 0 2023-12-08T20:27:53.647 INFO:tasks.workunit.client.1.smithi111.stdout:4/385: readlink d8/da/l5b 0 2023-12-08T20:27:53.649 INFO:tasks.workunit.client.1.smithi111.stdout:8/587: link dd/d32/d3d/c71 dd/d32/d3d/ccb 0 2023-12-08T20:27:53.649 INFO:tasks.workunit.client.1.smithi111.stdout:8/588: stat dd/d2d 0 2023-12-08T20:27:53.649 INFO:tasks.workunit.client.1.smithi111.stdout:8/589: chown dd/d32/d3d/f88 30558 1 2023-12-08T20:27:53.652 INFO:tasks.workunit.client.1.smithi111.stdout:8/590: dread dd/d32/f3e [0,4194304] 0 2023-12-08T20:27:53.654 INFO:tasks.workunit.client.1.smithi111.stdout:8/591: rename dd/d32/d3d/d55/l8a to dd/d96/lcc 0 2023-12-08T20:27:53.655 INFO:tasks.workunit.client.1.smithi111.stdout:8/592: write dd/d2d/f78 [688176,20358] 0 2023-12-08T20:27:53.656 INFO:tasks.workunit.client.1.smithi111.stdout:8/593: creat dd/d2d/d62/fcd x:0 0 0 2023-12-08T20:27:53.657 INFO:tasks.workunit.client.1.smithi111.stdout:4/386: dread f1 [0,4194304] 0 2023-12-08T20:27:53.657 INFO:tasks.workunit.client.1.smithi111.stdout:4/387: write d8/da/f75 [3805956,18270] 0 2023-12-08T20:27:53.659 INFO:tasks.workunit.client.1.smithi111.stdout:8/594: unlink f2 0 2023-12-08T20:27:53.659 INFO:tasks.workunit.client.1.smithi111.stdout:8/595: write dd/d2d/f3c [4321633,71905] 0 2023-12-08T20:27:53.659 INFO:tasks.workunit.client.1.smithi111.stdout:8/596: getdents dd/d32/d3d/d6b/d72 0 2023-12-08T20:27:53.660 INFO:tasks.workunit.client.1.smithi111.stdout:4/388: rename d8/da/db/d31/c65 to d8/da/c7c 0 2023-12-08T20:27:53.663 INFO:tasks.workunit.client.1.smithi111.stdout:8/597: rename dd/d32/c7b to dd/dc9/cce 0 2023-12-08T20:27:53.663 INFO:tasks.workunit.client.1.smithi111.stdout:8/598: fdatasync dd/d32/d3d/d55/fb0 0 2023-12-08T20:27:53.663 INFO:tasks.workunit.client.1.smithi111.stdout:8/599: chown dd/d2d/l2e 32 1 2023-12-08T20:27:53.668 INFO:tasks.workunit.client.1.smithi111.stdout:4/389: dread d8/da/d2c/d1f/d40/f55 [0,4194304] 0 2023-12-08T20:27:53.671 INFO:tasks.workunit.client.1.smithi111.stdout:4/390: mkdir d8/d30/d7d 0 2023-12-08T20:27:53.671 INFO:tasks.workunit.client.1.smithi111.stdout:4/391: getdents d8/d30/d7d 0 2023-12-08T20:27:53.672 INFO:tasks.workunit.client.1.smithi111.stdout:4/392: symlink d8/da/d29/d5c/l7e 0 2023-12-08T20:27:53.673 INFO:tasks.workunit.client.1.smithi111.stdout:4/393: dread d8/da/d2c/d1f/d2b/f3a [0,4194304] 0 2023-12-08T20:27:53.674 INFO:tasks.workunit.client.1.smithi111.stdout:4/394: rmdir d8 39 2023-12-08T20:27:53.674 INFO:tasks.workunit.client.1.smithi111.stdout:4/395: write d8/da/d2c/d1f/d40/f60 [1313356,103743] 0 2023-12-08T20:27:53.679 INFO:tasks.workunit.client.1.smithi111.stdout:4/396: rename d8/d38 to d8/da/db/d7f 0 2023-12-08T20:27:53.679 INFO:tasks.workunit.client.1.smithi111.stdout:4/397: fsync d8/da/d2c/d1f/d2b/f3e 0 2023-12-08T20:27:53.679 INFO:tasks.workunit.client.1.smithi111.stdout:4/398: write f6 [4495209,124498] 0 2023-12-08T20:27:53.679 INFO:tasks.workunit.client.1.smithi111.stdout:8/600: dwrite dd/d35/d42/fa5 [0,4194304] 0 2023-12-08T20:27:53.681 INFO:tasks.workunit.client.1.smithi111.stdout:4/399: write d8/da/db/d31/f4c [2684154,62425] 0 2023-12-08T20:27:53.690 INFO:tasks.workunit.client.1.smithi111.stdout:8/601: rename dd/d32/d3d/f75 to dd/d2d/d62/d83/fcf 0 2023-12-08T20:27:53.694 INFO:tasks.workunit.client.1.smithi111.stdout:8/602: unlink dd/f19 0 2023-12-08T20:27:53.694 INFO:tasks.workunit.client.1.smithi111.stdout:4/400: dwrite f0 [0,4194304] 0 2023-12-08T20:27:53.699 INFO:tasks.workunit.client.1.smithi111.stdout:4/401: rmdir d8/da/d2c/d1f/d2b/d4b 39 2023-12-08T20:27:53.699 INFO:tasks.workunit.client.1.smithi111.stdout:8/603: getdents dd/d2d/d8b 0 2023-12-08T20:27:53.701 INFO:tasks.workunit.client.1.smithi111.stdout:8/604: mknod dd/d2d/d62/d83/cd0 0 2023-12-08T20:27:53.703 INFO:tasks.workunit.client.1.smithi111.stdout:8/605: creat dd/d35/d42/fd1 x:0 0 0 2023-12-08T20:27:53.705 INFO:tasks.workunit.client.1.smithi111.stdout:8/606: mknod dd/d2d/d8b/d8d/da4/cd2 0 2023-12-08T20:27:53.706 INFO:tasks.workunit.client.1.smithi111.stdout:8/607: symlink dd/d32/d36/ld3 0 2023-12-08T20:27:53.708 INFO:tasks.workunit.client.1.smithi111.stdout:4/402: dread d8/d30/f3c [0,4194304] 0 2023-12-08T20:27:53.709 INFO:tasks.workunit.client.1.smithi111.stdout:4/403: chown d8/da/d2c/f5e 10972 1 2023-12-08T20:27:53.710 INFO:tasks.workunit.client.1.smithi111.stdout:8/608: getdents dd/d35/d42 0 2023-12-08T20:27:53.711 INFO:tasks.workunit.client.1.smithi111.stdout:8/609: mkdir dd/d32/d3d/dd4 0 2023-12-08T20:27:53.717 INFO:tasks.workunit.client.1.smithi111.stdout:4/404: dread d8/f12 [0,4194304] 0 2023-12-08T20:27:53.717 INFO:tasks.workunit.client.1.smithi111.stdout:4/405: fsync d8/f22 0 2023-12-08T20:27:53.717 INFO:tasks.workunit.client.1.smithi111.stdout:4/406: write d8/da/d2c/d1f/f58 [882789,71815] 0 2023-12-08T20:27:53.721 INFO:tasks.workunit.client.1.smithi111.stdout:8/610: dread dd/f2b [0,4194304] 0 2023-12-08T20:27:53.721 INFO:tasks.workunit.client.1.smithi111.stdout:4/407: dread d8/da/db/f4d [0,4194304] 0 2023-12-08T20:27:53.722 INFO:tasks.workunit.client.1.smithi111.stdout:4/408: mkdir d8/da/d29/d80 0 2023-12-08T20:27:53.722 INFO:tasks.workunit.client.1.smithi111.stdout:4/409: read d8/da/d2c/d1f/f58 [660525,80183] 0 2023-12-08T20:27:53.723 INFO:tasks.workunit.client.1.smithi111.stdout:4/410: chown d8/da/d29/d5c 49 1 2023-12-08T20:27:53.728 INFO:tasks.workunit.client.1.smithi111.stdout:8/611: dread dd/d2d/d8b/fae [0,4194304] 0 2023-12-08T20:27:53.734 INFO:tasks.workunit.client.1.smithi111.stdout:8/612: dread dd/d32/d36/d4b/f52 [0,4194304] 0 2023-12-08T20:27:53.735 INFO:tasks.workunit.client.1.smithi111.stdout:1/531: sync 2023-12-08T20:27:53.735 INFO:tasks.workunit.client.1.smithi111.stdout:6/334: sync 2023-12-08T20:27:53.736 INFO:tasks.workunit.client.1.smithi111.stdout:8/613: dread dd/d32/f57 [0,4194304] 0 2023-12-08T20:27:53.736 INFO:tasks.workunit.client.1.smithi111.stdout:6/335: write d0/f12 [3813853,118801] 0 2023-12-08T20:27:53.737 INFO:tasks.workunit.client.1.smithi111.stdout:1/532: creat d0/d6/d33/d15/d51/d2e/d61/fbb x:0 0 0 2023-12-08T20:27:53.738 INFO:tasks.workunit.client.1.smithi111.stdout:6/336: creat d0/d1/f65 x:0 0 0 2023-12-08T20:27:53.762 INFO:tasks.workunit.client.1.smithi111.stdout:8/614: dwrite dd/f29 [0,4194304] 0 2023-12-08T20:27:53.762 INFO:tasks.workunit.client.1.smithi111.stdout:6/337: dwrite d0/d1a/f28 [4194304,4194304] 0 2023-12-08T20:27:53.762 INFO:tasks.workunit.client.1.smithi111.stdout:1/533: dwrite d0/d6/d47/f4a [0,4194304] 0 2023-12-08T20:27:53.762 INFO:tasks.workunit.client.1.smithi111.stdout:1/534: chown d0/d6/d33/d15/d51/d2e/d61/f93 237121402 1 2023-12-08T20:27:53.762 INFO:tasks.workunit.client.1.smithi111.stdout:1/535: truncate d0/d6/d33/d60/f7f 549825 0 2023-12-08T20:27:53.765 INFO:tasks.workunit.client.1.smithi111.stdout:1/536: mknod d0/d8e/cbc 0 2023-12-08T20:27:53.774 INFO:tasks.workunit.client.1.smithi111.stdout:6/338: dread d0/d1/f8 [0,4194304] 0 2023-12-08T20:27:53.784 INFO:tasks.workunit.client.1.smithi111.stdout:1/537: dwrite d0/d22/f9b [0,4194304] 0 2023-12-08T20:27:53.784 INFO:tasks.workunit.client.1.smithi111.stdout:1/538: dread - d0/d6/d33/d60/f9e zero size 2023-12-08T20:27:53.787 INFO:tasks.workunit.client.1.smithi111.stdout:1/539: mkdir d0/d6/d33/d15/d51/d5b/d5e/d86/dbd 0 2023-12-08T20:27:53.788 INFO:tasks.workunit.client.1.smithi111.stdout:1/540: symlink d0/d6/d33/d15/d51/d78/lbe 0 2023-12-08T20:27:53.789 INFO:tasks.workunit.client.1.smithi111.stdout:1/541: mknod d0/d6/d33/d15/d51/d5b/d59/da3/cbf 0 2023-12-08T20:27:53.797 INFO:tasks.workunit.client.1.smithi111.stdout:6/339: dwrite d0/d1/d27/f40 [0,4194304] 0 2023-12-08T20:27:53.797 INFO:tasks.workunit.client.1.smithi111.stdout:6/340: chown d0/d1/d1e/f61 6878 1 2023-12-08T20:27:53.797 INFO:tasks.workunit.client.1.smithi111.stdout:6/341: write d0/f32 [954873,130412] 0 2023-12-08T20:27:53.798 INFO:tasks.workunit.client.1.smithi111.stdout:1/542: dread d0/d6/d33/d15/d51/d5b/f54 [0,4194304] 0 2023-12-08T20:27:53.798 INFO:tasks.workunit.client.1.smithi111.stdout:1/543: chown d0/c9 214206 1 2023-12-08T20:27:53.822 INFO:tasks.workunit.client.1.smithi111.stdout:1/544: dwrite d0/d6/d33/d15/d51/d5b/d5e/faa [0,4194304] 0 2023-12-08T20:27:53.826 INFO:tasks.workunit.client.1.smithi111.stdout:1/545: getdents d0/d6/d33/d8b/db5 0 2023-12-08T20:27:53.826 INFO:tasks.workunit.client.1.smithi111.stdout:1/546: readlink d0/d6/d33/d6c/d75/l9c 0 2023-12-08T20:27:53.826 INFO:tasks.workunit.client.1.smithi111.stdout:1/547: symlink d0/d6/d33/d15/d51/d2e/lc0 0 2023-12-08T20:27:53.828 INFO:tasks.workunit.client.1.smithi111.stdout:9/590: sync 2023-12-08T20:27:53.828 INFO:tasks.workunit.client.1.smithi111.stdout:0/758: sync 2023-12-08T20:27:53.829 INFO:tasks.workunit.client.1.smithi111.stdout:0/759: mkdir d1/df/d44/daa/d101 0 2023-12-08T20:27:53.830 INFO:tasks.workunit.client.1.smithi111.stdout:0/760: write d1/d4/d24/d46/d49/d7f/fd5 [585181,26489] 0 2023-12-08T20:27:53.831 INFO:tasks.workunit.client.1.smithi111.stdout:9/591: rename d2/d8/dd/d1a/c2b to d2/d8/dd/d1a/d1e/d2d/cd1 0 2023-12-08T20:27:53.831 INFO:tasks.workunit.client.1.smithi111.stdout:9/592: fdatasync d2/d8/dd/d56/f73 0 2023-12-08T20:27:53.833 INFO:tasks.workunit.client.1.smithi111.stdout:0/761: mkdir d1/df/d56/d102 0 2023-12-08T20:27:53.836 INFO:tasks.workunit.client.1.smithi111.stdout:9/593: rename d2/d8/dd/d1a/d1e/d2d/fb8 to d2/d8/dd/d1a/d1e/d2d/d4a/d62/fd2 0 2023-12-08T20:27:53.837 INFO:tasks.workunit.client.1.smithi111.stdout:9/594: creat d2/d8/dd/d1a/d1e/d2d/d8f/fd3 x:0 0 0 2023-12-08T20:27:53.839 INFO:tasks.workunit.client.1.smithi111.stdout:9/595: getdents d2/d8/dd/d56 0 2023-12-08T20:27:53.842 INFO:tasks.workunit.client.1.smithi111.stdout:0/762: dread d1/d2d/f41 [0,4194304] 0 2023-12-08T20:27:53.843 INFO:tasks.workunit.client.1.smithi111.stdout:1/548: dwrite d0/d6/d47/f50 [4194304,4194304] 0 2023-12-08T20:27:53.845 INFO:tasks.workunit.client.1.smithi111.stdout:0/763: mknod d1/d69/d8b/c103 0 2023-12-08T20:27:53.845 INFO:tasks.workunit.client.1.smithi111.stdout:9/596: mknod d2/d8/dd/d1a/d1e/d2d/cd4 0 2023-12-08T20:27:53.847 INFO:tasks.workunit.client.1.smithi111.stdout:0/764: mkdir d1/df/d16/d2c/d7e/d104 0 2023-12-08T20:27:53.847 INFO:tasks.workunit.client.1.smithi111.stdout:0/765: readlink d1/df/d44/d37/d5c/d70/l72 0 2023-12-08T20:27:53.847 INFO:tasks.workunit.client.1.smithi111.stdout:0/766: write d1/df/d16/fae [2179070,60837] 0 2023-12-08T20:27:53.858 INFO:tasks.workunit.client.1.smithi111.stdout:0/767: dread d1/d4/d24/d46/fa8 [0,4194304] 0 2023-12-08T20:27:53.862 INFO:tasks.workunit.client.1.smithi111.stdout:0/768: mknod d1/df/dea/c105 0 2023-12-08T20:27:53.864 INFO:tasks.workunit.client.1.smithi111.stdout:0/769: symlink d1/df/d16/d2c/d7e/l106 0 2023-12-08T20:27:53.864 INFO:tasks.workunit.client.1.smithi111.stdout:0/770: write d1/f57 [4902173,60017] 0 2023-12-08T20:27:53.864 INFO:tasks.workunit.client.1.smithi111.stdout:0/771: chown d1/dd/d4a/l54 0 1 2023-12-08T20:27:53.864 INFO:tasks.workunit.client.1.smithi111.stdout:1/549: dwrite d0/d6/d33/f4f [0,4194304] 0 2023-12-08T20:27:53.864 INFO:tasks.workunit.client.1.smithi111.stdout:9/597: dwrite d2/d8/dd/d1a/d1e/d2d/d35/f41 [4194304,4194304] 0 2023-12-08T20:27:53.866 INFO:tasks.workunit.client.1.smithi111.stdout:1/550: rename d0/d6/d33/d15/d51/d2e/f40 to d0/d6/d33/d15/d51/d5b/fc1 0 2023-12-08T20:27:53.867 INFO:tasks.workunit.client.1.smithi111.stdout:9/598: getdents d2/d8/dd/d1a/d1e/d2d/d4a/d62 0 2023-12-08T20:27:53.875 INFO:tasks.workunit.client.1.smithi111.stdout:9/599: dread d2/d8/d9b/f28 [0,4194304] 0 2023-12-08T20:27:53.875 INFO:tasks.workunit.client.1.smithi111.stdout:9/600: write d2/d8/dd/d56/fad [1032350,71327] 0 2023-12-08T20:27:53.877 INFO:tasks.workunit.client.1.smithi111.stdout:9/601: mkdir d2/d8/dd/d1a/d1e/d2d/db9/dd5 0 2023-12-08T20:27:53.879 INFO:tasks.workunit.client.1.smithi111.stdout:9/602: write d2/da/fa8 [1666713,32333] 0 2023-12-08T20:27:53.880 INFO:tasks.workunit.client.1.smithi111.stdout:9/603: stat d2/d8/dd/d1a/d74/dbf/fc2 0 2023-12-08T20:27:53.882 INFO:tasks.workunit.client.1.smithi111.stdout:9/604: mkdir d2/d8/dd/d1a/d1e/d2d/d4a/dd6 0 2023-12-08T20:27:53.882 INFO:tasks.workunit.client.1.smithi111.stdout:1/551: dwrite d0/d6/d34/f96 [0,4194304] 0 2023-12-08T20:27:53.883 INFO:tasks.workunit.client.1.smithi111.stdout:9/605: dread d2/d8/dd/d1a/d1e/d2d/d35/d88/f99 [0,4194304] 0 2023-12-08T20:27:53.888 INFO:tasks.workunit.client.1.smithi111.stdout:1/552: creat d0/d8e/fc2 x:0 0 0 2023-12-08T20:27:53.888 INFO:tasks.workunit.client.1.smithi111.stdout:1/553: stat d0/d6/d33/d15/d51/d5b/fb3 0 2023-12-08T20:27:53.888 INFO:tasks.workunit.client.1.smithi111.stdout:1/554: write d0/d4d/f8c [834600,90985] 0 2023-12-08T20:27:53.889 INFO:tasks.workunit.client.1.smithi111.stdout:1/555: mkdir d0/d6/d33/d15/d51/d2e/d61/d79/dc3 0 2023-12-08T20:27:53.889 INFO:tasks.workunit.client.1.smithi111.stdout:1/556: readlink d0/l35 0 2023-12-08T20:27:53.891 INFO:tasks.workunit.client.1.smithi111.stdout:1/557: symlink d0/d6/d33/lc4 0 2023-12-08T20:27:53.908 INFO:tasks.workunit.client.1.smithi111.stdout:9/606: dwrite d2/d8/dd/d1a/d74/f8e [0,4194304] 0 2023-12-08T20:27:53.909 INFO:tasks.workunit.client.1.smithi111.stdout:9/607: creat d2/d8/dd/d1a/d1e/d2d/d4a/d62/fd7 x:0 0 0 2023-12-08T20:27:53.910 INFO:tasks.workunit.client.1.smithi111.stdout:1/558: dwrite d0/d8e/fc2 [0,4194304] 0 2023-12-08T20:27:53.911 INFO:tasks.workunit.client.1.smithi111.stdout:9/608: symlink d2/d8/d8c/d96/ld8 0 2023-12-08T20:27:53.913 INFO:tasks.workunit.client.1.smithi111.stdout:1/559: creat d0/d6/d33/d15/d51/d5b/d5e/d86/fc5 x:0 0 0 2023-12-08T20:27:53.918 INFO:tasks.workunit.client.1.smithi111.stdout:1/560: unlink d0/d6/d33/d15/d51/d2e/fa6 0 2023-12-08T20:27:53.920 INFO:tasks.workunit.client.1.smithi111.stdout:1/561: creat d0/d6/d33/d15/d51/d2e/d61/d79/fc6 x:0 0 0 2023-12-08T20:27:53.922 INFO:tasks.workunit.client.1.smithi111.stdout:1/562: unlink d0/d6/d33/d15/d51/c66 0 2023-12-08T20:27:53.924 INFO:tasks.workunit.client.1.smithi111.stdout:1/563: creat d0/d8e/fc7 x:0 0 0 2023-12-08T20:27:53.928 INFO:tasks.workunit.client.1.smithi111.stdout:1/564: rename d0/d6/d33/d15/l76 to d0/d6/d33/d15/d51/d2e/d61/lc8 0 2023-12-08T20:27:53.928 INFO:tasks.workunit.client.1.smithi111.stdout:1/565: write d0/d6/f14 [7891735,93259] 0 2023-12-08T20:27:53.935 INFO:tasks.workunit.client.1.smithi111.stdout:9/609: getdents d2/d8/d8c/d96 0 2023-12-08T20:27:53.937 INFO:tasks.workunit.client.1.smithi111.stdout:9/610: truncate d2/d8/dd/d1a/d1e/d2d/d4a/f5a 80105 0 2023-12-08T20:27:53.937 INFO:tasks.workunit.client.1.smithi111.stdout:9/611: write d2/d8/dd/d1a/d1e/d2d/d35/f41 [8946791,58205] 0 2023-12-08T20:27:53.939 INFO:tasks.workunit.client.1.smithi111.stdout:9/612: creat d2/d8/dd/d1a/d66/fd9 x:0 0 0 2023-12-08T20:27:53.939 INFO:tasks.workunit.client.1.smithi111.stdout:9/613: truncate d2/d8/dd/d1a/d1e/d2d/d8f/faa 603511 0 2023-12-08T20:27:53.941 INFO:tasks.workunit.client.1.smithi111.stdout:9/614: creat d2/d8/fda x:0 0 0 2023-12-08T20:27:53.943 INFO:tasks.workunit.client.1.smithi111.stdout:9/615: creat d2/d8/dd/d1a/d74/fdb x:0 0 0 2023-12-08T20:27:53.947 INFO:tasks.workunit.client.1.smithi111.stdout:1/566: rename d0/d6/d33/d15/d51/d2e/d61/lc8 to d0/d4d/lc9 0 2023-12-08T20:27:53.947 INFO:tasks.workunit.client.1.smithi111.stdout:1/567: write d0/d6/f28 [1008378,35645] 0 2023-12-08T20:27:53.949 INFO:tasks.workunit.client.1.smithi111.stdout:1/568: symlink d0/d8e/db0/lca 0 2023-12-08T20:27:53.958 INFO:tasks.workunit.client.1.smithi111.stdout:9/616: dwrite d2/d8/dd/d1a/f80 [4194304,4194304] 0 2023-12-08T20:27:53.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:53 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:27:53.978 INFO:tasks.workunit.client.1.smithi111.stdout:9/617: dwrite d2/d8/dd/d1a/d1e/f8b [4194304,4194304] 0 2023-12-08T20:27:54.002 INFO:tasks.workunit.client.1.smithi111.stdout:9/618: dwrite d2/d8/dd/d1a/d1e/f54 [0,4194304] 0 2023-12-08T20:27:54.007 INFO:tasks.workunit.client.1.smithi111.stdout:9/619: symlink d2/d8/dd/d56/ldc 0 2023-12-08T20:27:54.008 INFO:tasks.workunit.client.1.smithi111.stdout:9/620: link d2/d8/c83 d2/cdd 0 2023-12-08T20:27:54.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:53 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:27:54.024 INFO:tasks.workunit.client.1.smithi111.stdout:3/459: sync 2023-12-08T20:27:54.024 INFO:tasks.workunit.client.1.smithi111.stdout:7/455: sync 2023-12-08T20:27:54.025 INFO:tasks.workunit.client.1.smithi111.stdout:2/471: sync 2023-12-08T20:27:54.025 INFO:tasks.workunit.client.1.smithi111.stdout:5/654: sync 2023-12-08T20:27:54.025 INFO:tasks.workunit.client.1.smithi111.stdout:7/456: mknod da/d25/d3d/c94 0 2023-12-08T20:27:54.027 INFO:tasks.workunit.client.1.smithi111.stdout:9/621: dwrite d2/d8/dd/d1a/d1e/d2d/d4a/d62/fb7 [0,4194304] 0 2023-12-08T20:27:54.027 INFO:tasks.workunit.client.1.smithi111.stdout:9/622: stat d2/d8/d8c/d96/f9e 0 2023-12-08T20:27:54.027 INFO:tasks.workunit.client.1.smithi111.stdout:2/472: creat d1/d29/d4e/fb3 x:0 0 0 2023-12-08T20:27:54.027 INFO:tasks.workunit.client.1.smithi111.stdout:2/473: fdatasync d1/d1d/d22/f76 0 2023-12-08T20:27:54.030 INFO:tasks.workunit.client.1.smithi111.stdout:5/655: symlink d3/le3 0 2023-12-08T20:27:54.030 INFO:tasks.workunit.client.1.smithi111.stdout:2/474: truncate d1/d29/d4e/f4d 3616886 0 2023-12-08T20:27:54.030 INFO:tasks.workunit.client.1.smithi111.stdout:9/623: dread d2/d8/f18 [0,4194304] 0 2023-12-08T20:27:54.031 INFO:tasks.workunit.client.1.smithi111.stdout:2/475: rmdir d1/d1d/d1f 39 2023-12-08T20:27:54.032 INFO:tasks.workunit.client.1.smithi111.stdout:9/624: mknod d2/d8/d8c/cde 0 2023-12-08T20:27:54.032 INFO:tasks.workunit.client.1.smithi111.stdout:5/656: dread d3/d4/d7/d2c/d84/fab [0,4194304] 0 2023-12-08T20:27:54.033 INFO:tasks.workunit.client.1.smithi111.stdout:2/476: mknod d1/d1d/d1f/cb4 0 2023-12-08T20:27:54.034 INFO:tasks.workunit.client.1.smithi111.stdout:9/625: symlink d2/d8/dd/d1a/d1e/d2d/db9/dd5/ldf 0 2023-12-08T20:27:54.034 INFO:tasks.workunit.client.1.smithi111.stdout:5/657: truncate d3/f6b 3832391 0 2023-12-08T20:27:54.035 INFO:tasks.workunit.client.1.smithi111.stdout:2/477: mknod d1/d1d/d1f/d25/d3d/d56/cb5 0 2023-12-08T20:27:54.035 INFO:tasks.workunit.client.1.smithi111.stdout:2/478: chown d1/d29/d53/f82 2040232575 1 2023-12-08T20:27:54.037 INFO:tasks.workunit.client.1.smithi111.stdout:5/658: mknod d3/d4/d7/d36/d82/db4/dbe/ce4 0 2023-12-08T20:27:54.038 INFO:tasks.workunit.client.1.smithi111.stdout:2/479: symlink d1/d1d/d1f/d25/d96/lb6 0 2023-12-08T20:27:54.042 INFO:tasks.workunit.client.1.smithi111.stdout:7/457: rename da/le to da/d5c/l95 0 2023-12-08T20:27:54.042 INFO:tasks.workunit.client.1.smithi111.stdout:7/458: fdatasync da/d64/f71 0 2023-12-08T20:27:54.046 INFO:tasks.workunit.client.1.smithi111.stdout:9/626: rename d2/d8/dd/d1a/d1e/d2d/d35/c65 to d2/d8/d8c/ce0 0 2023-12-08T20:27:54.046 INFO:tasks.workunit.client.1.smithi111.stdout:9/627: write d2/d8/dd/d1a/d1e/d2d/d4a/d62/fd7 [760754,20941] 0 2023-12-08T20:27:54.047 INFO:tasks.workunit.client.1.smithi111.stdout:7/459: symlink da/d64/d8b/l96 0 2023-12-08T20:27:54.047 INFO:tasks.workunit.client.1.smithi111.stdout:7/460: write da/d38/f74 [128881,57308] 0 2023-12-08T20:27:54.050 INFO:tasks.workunit.client.1.smithi111.stdout:5/659: rename d3/d4/d7/d36/d82/db4/dbe/dc6/fc7 to d3/d4/d7/d29/fe5 0 2023-12-08T20:27:54.058 INFO:tasks.workunit.client.1.smithi111.stdout:7/461: dread da/d25/f3a [0,4194304] 0 2023-12-08T20:27:54.060 INFO:tasks.workunit.client.1.smithi111.stdout:7/462: mkdir da/d25/d26/d32/d3e/d97 0 2023-12-08T20:27:54.061 INFO:tasks.workunit.client.1.smithi111.stdout:5/660: dread d3/d4/d7/d2c/f5a [0,4194304] 0 2023-12-08T20:27:54.062 INFO:tasks.workunit.client.1.smithi111.stdout:2/480: dwrite d1/d1d/d1f/d25/d3d/d64/f80 [0,4194304] 0 2023-12-08T20:27:54.062 INFO:tasks.workunit.client.1.smithi111.stdout:2/481: fsync d1/f15 0 2023-12-08T20:27:54.062 INFO:tasks.workunit.client.1.smithi111.stdout:2/482: write d1/d1d/d1f/d25/d67/faa [217000,110135] 0 2023-12-08T20:27:54.062 INFO:tasks.workunit.client.1.smithi111.stdout:9/628: dwrite d2/d8/dd/d1a/f7f [0,4194304] 0 2023-12-08T20:27:54.062 INFO:tasks.workunit.client.1.smithi111.stdout:7/463: link da/d13/f7f da/d25/d26/f98 0 2023-12-08T20:27:54.064 INFO:tasks.workunit.client.1.smithi111.stdout:5/661: unlink d3/d4/d7/d2c/f83 0 2023-12-08T20:27:54.067 INFO:tasks.workunit.client.1.smithi111.stdout:2/483: mknod d1/d1d/d1f/d36/d92/cb7 0 2023-12-08T20:27:54.067 INFO:tasks.workunit.client.1.smithi111.stdout:2/484: write d1/d1d/d1f/d25/d3d/d41/f52 [4561647,67787] 0 2023-12-08T20:27:54.070 INFO:tasks.workunit.client.1.smithi111.stdout:9/629: getdents d2/d8 0 2023-12-08T20:27:54.072 INFO:tasks.workunit.client.1.smithi111.stdout:7/464: creat da/d64/d8b/d75/f99 x:0 0 0 2023-12-08T20:27:54.074 INFO:tasks.workunit.client.1.smithi111.stdout:5/662: link d3/d4/d7/d29/d30/f76 d3/d4/d7/d2c/fe6 0 2023-12-08T20:27:54.075 INFO:tasks.workunit.client.1.smithi111.stdout:5/663: read d3/d4/d7/d36/f7c [166461,3424] 0 2023-12-08T20:27:54.076 INFO:tasks.workunit.client.1.smithi111.stdout:2/485: dread d1/d29/d53/f23 [0,4194304] 0 2023-12-08T20:27:54.076 INFO:tasks.workunit.client.1.smithi111.stdout:2/486: chown d1/d1d/d1f/d25/d3d/da2 32303 1 2023-12-08T20:27:54.076 INFO:tasks.workunit.client.1.smithi111.stdout:2/487: fdatasync d1/d1d/d1f/d25/f78 0 2023-12-08T20:27:54.076 INFO:tasks.workunit.client.1.smithi111.stdout:5/664: write d3/d4/d7/d29/d73/d90/fa1 [159526,30195] 0 2023-12-08T20:27:54.076 INFO:tasks.workunit.client.1.smithi111.stdout:5/665: truncate d3/d4/d4a/d21/f91 775812 0 2023-12-08T20:27:54.076 INFO:tasks.workunit.client.1.smithi111.stdout:7/465: dread da/d13/f49 [0,4194304] 0 2023-12-08T20:27:54.076 INFO:tasks.workunit.client.1.smithi111.stdout:7/466: dread - da/d38/f8f zero size 2023-12-08T20:27:54.077 INFO:tasks.workunit.client.1.smithi111.stdout:9/630: creat d2/fe1 x:0 0 0 2023-12-08T20:27:54.077 INFO:tasks.workunit.client.1.smithi111.stdout:2/488: mknod d1/d29/d53/cb8 0 2023-12-08T20:27:54.081 INFO:tasks.workunit.client.1.smithi111.stdout:5/666: creat d3/d4/d7/d29/d30/dc0/fe7 x:0 0 0 2023-12-08T20:27:54.081 INFO:tasks.workunit.client.1.smithi111.stdout:5/667: stat d3/d4 0 2023-12-08T20:27:54.084 INFO:tasks.workunit.client.1.smithi111.stdout:7/467: rename da/d25/d26/d32/c3f to da/d64/c9a 0 2023-12-08T20:27:54.089 INFO:tasks.workunit.client.1.smithi111.stdout:2/489: mkdir d1/d1d/d1f/d25/d3d/d41/db9 0 2023-12-08T20:27:54.089 INFO:tasks.workunit.client.1.smithi111.stdout:2/490: chown d1/d29/d4e/l4b 28 1 2023-12-08T20:27:54.089 INFO:tasks.workunit.client.1.smithi111.stdout:2/491: chown d1/d1d/d1f/d25/d3d/d56/f7a 1343167901 1 2023-12-08T20:27:54.089 INFO:tasks.workunit.client.1.smithi111.stdout:2/492: fsync d1/d1d/d22/f76 0 2023-12-08T20:27:54.089 INFO:tasks.workunit.client.1.smithi111.stdout:7/468: link da/d25/d26/f41 da/d13/f9b 0 2023-12-08T20:27:54.091 INFO:tasks.workunit.client.1.smithi111.stdout:7/469: creat da/d25/d26/f9c x:0 0 0 2023-12-08T20:27:54.092 INFO:tasks.workunit.client.1.smithi111.stdout:7/470: write da/f46 [3584116,34375] 0 2023-12-08T20:27:54.093 INFO:tasks.workunit.client.1.smithi111.stdout:7/471: truncate da/d25/f2e 4172491 0 2023-12-08T20:27:54.093 INFO:tasks.workunit.client.1.smithi111.stdout:2/493: write d1/d1d/f20 [5127556,257] 0 2023-12-08T20:27:54.095 INFO:tasks.workunit.client.1.smithi111.stdout:7/472: rename da/d13/c24 to da/d64/d8b/d75/c9d 0 2023-12-08T20:27:54.097 INFO:tasks.workunit.client.1.smithi111.stdout:5/668: dwrite d3/d4/d7/d2c/f97 [0,4194304] 0 2023-12-08T20:27:54.098 INFO:tasks.workunit.client.1.smithi111.stdout:9/631: dwrite d2/d8/dd/d1a/d74/dbf/fca [0,4194304] 0 2023-12-08T20:27:54.098 INFO:tasks.workunit.client.1.smithi111.stdout:9/632: write d2/d8/dd/fb0 [1005501,19653] 0 2023-12-08T20:27:54.099 INFO:tasks.workunit.client.1.smithi111.stdout:5/669: getdents d3/d8d 0 2023-12-08T20:27:54.101 INFO:tasks.workunit.client.1.smithi111.stdout:9/633: creat d2/d8/dd/d1a/d1e/d2d/d35/d71/fe2 x:0 0 0 2023-12-08T20:27:54.103 INFO:tasks.workunit.client.1.smithi111.stdout:5/670: creat d3/d4/d7/d29/dd6/fe8 x:0 0 0 2023-12-08T20:27:54.104 INFO:tasks.workunit.client.1.smithi111.stdout:9/634: rmdir d2/d8/dd/d1a 39 2023-12-08T20:27:54.105 INFO:tasks.workunit.client.1.smithi111.stdout:5/671: symlink d3/d4/d7/d29/d73/le9 0 2023-12-08T20:27:54.107 INFO:tasks.workunit.client.1.smithi111.stdout:9/635: creat d2/d8/dd/d1a/d1e/d2d/fe3 x:0 0 0 2023-12-08T20:27:54.107 INFO:tasks.workunit.client.1.smithi111.stdout:9/636: write d2/da/fc [1384541,127738] 0 2023-12-08T20:27:54.108 INFO:tasks.workunit.client.1.smithi111.stdout:5/672: unlink d3/d4/l28 0 2023-12-08T20:27:54.108 INFO:tasks.workunit.client.1.smithi111.stdout:5/673: chown d3/d4/d7/d2c/fe2 6967 1 2023-12-08T20:27:54.108 INFO:tasks.workunit.client.1.smithi111.stdout:5/674: getdents d3/d4/d7 0 2023-12-08T20:27:54.109 INFO:tasks.workunit.client.1.smithi111.stdout:9/637: symlink d2/da/le4 0 2023-12-08T20:27:54.111 INFO:tasks.workunit.client.1.smithi111.stdout:9/638: creat d2/d8/dd/d1a/d1e/d2d/fe5 x:0 0 0 2023-12-08T20:27:54.114 INFO:tasks.workunit.client.1.smithi111.stdout:7/473: rename da/d64/d8b to da/d13/d9e 0 2023-12-08T20:27:54.116 INFO:tasks.workunit.client.1.smithi111.stdout:7/474: mkdir da/d13/d9e/d75/d9f 0 2023-12-08T20:27:54.119 INFO:tasks.workunit.client.1.smithi111.stdout:7/475: rmdir da/d13/d21 39 2023-12-08T20:27:54.127 INFO:tasks.workunit.client.1.smithi111.stdout:5/675: dwrite d3/d12/fb9 [0,4194304] 0 2023-12-08T20:27:54.129 INFO:tasks.workunit.client.1.smithi111.stdout:7/476: dread da/d25/f3a [0,4194304] 0 2023-12-08T20:27:54.130 INFO:tasks.workunit.client.1.smithi111.stdout:5/676: mkdir d3/d4/d4a/d21/dea 0 2023-12-08T20:27:54.131 INFO:tasks.workunit.client.1.smithi111.stdout:7/477: mknod da/d25/d26/d32/d3e/d97/ca0 0 2023-12-08T20:27:54.133 INFO:tasks.workunit.client.1.smithi111.stdout:9/639: dwrite d2/d8/d8c/d96/fb3 [0,4194304] 0 2023-12-08T20:27:54.139 INFO:tasks.workunit.client.1.smithi111.stdout:2/494: dwrite d1/d1d/d1f/d25/d3d/d56/f7a [0,4194304] 0 2023-12-08T20:27:54.139 INFO:tasks.workunit.client.1.smithi111.stdout:2/495: truncate d1/d1d/d68/fa1 800201 0 2023-12-08T20:27:54.139 INFO:tasks.workunit.client.1.smithi111.stdout:2/496: chown d1/d1d/d55/ca8 363837830 1 2023-12-08T20:27:54.140 INFO:tasks.workunit.client.1.smithi111.stdout:2/497: dread - d1/d29/d53/d90/f97 zero size 2023-12-08T20:27:54.143 INFO:tasks.workunit.client.1.smithi111.stdout:2/498: mknod d1/d1d/d1f/d25/d3d/d9f/cba 0 2023-12-08T20:27:54.143 INFO:tasks.workunit.client.1.smithi111.stdout:7/478: dread da/d25/d26/f4d [0,4194304] 0 2023-12-08T20:27:54.144 INFO:tasks.workunit.client.1.smithi111.stdout:2/499: creat d1/d29/d53/d91/fbb x:0 0 0 2023-12-08T20:27:54.145 INFO:tasks.workunit.client.1.smithi111.stdout:7/479: dread da/d25/f4a [0,4194304] 0 2023-12-08T20:27:54.150 INFO:tasks.workunit.client.1.smithi111.stdout:9/640: dwrite d2/d8/dd/d1a/d1e/f8b [0,4194304] 0 2023-12-08T20:27:54.152 INFO:tasks.workunit.client.1.smithi111.stdout:5/677: dwrite d3/d4/d7/d36/d64/f86 [0,4194304] 0 2023-12-08T20:27:54.163 INFO:tasks.workunit.client.1.smithi111.stdout:5/678: creat d3/d4/d7/d29/d30/dc0/feb x:0 0 0 2023-12-08T20:27:54.165 INFO:tasks.workunit.client.1.smithi111.stdout:5/679: rename d3/d4/d7/d29/c52 to d3/d4/d7/d36/d82/db4/dbe/cec 0 2023-12-08T20:27:54.166 INFO:tasks.workunit.client.1.smithi111.stdout:5/680: unlink d3/d4/ccb 0 2023-12-08T20:27:54.168 INFO:tasks.workunit.client.1.smithi111.stdout:5/681: link d3/d4/d7/d29/d30/l70 d3/d4/d7/d36/d82/db4/dbe/dc6/led 0 2023-12-08T20:27:54.168 INFO:tasks.workunit.client.1.smithi111.stdout:5/682: fsync d3/d4/d7/d2c/f4c 0 2023-12-08T20:27:54.168 INFO:tasks.workunit.client.1.smithi111.stdout:7/480: dwrite da/d25/d3d/f85 [0,4194304] 0 2023-12-08T20:27:54.168 INFO:tasks.workunit.client.1.smithi111.stdout:5/683: write d3/d4/d4a/d21/f47 [270292,104229] 0 2023-12-08T20:27:54.168 INFO:tasks.workunit.client.1.smithi111.stdout:5/684: read - d3/d12/fb2 zero size 2023-12-08T20:27:54.168 INFO:tasks.workunit.client.1.smithi111.stdout:5/685: chown d3/d4/d4a/d21/fdd 44038191 1 2023-12-08T20:27:54.168 INFO:tasks.workunit.client.1.smithi111.stdout:5/686: write d3/d4/d7/d29/d30/fd1 [899724,25651] 0 2023-12-08T20:27:54.169 INFO:tasks.workunit.client.1.smithi111.stdout:7/481: creat da/d13/d21/d89/fa1 x:0 0 0 2023-12-08T20:27:54.170 INFO:tasks.workunit.client.1.smithi111.stdout:7/482: write da/d13/d21/f67 [4367512,5822] 0 2023-12-08T20:27:54.170 INFO:tasks.workunit.client.1.smithi111.stdout:5/687: mknod d3/d4/d4a/d21/da5/cee 0 2023-12-08T20:27:54.171 INFO:tasks.workunit.client.1.smithi111.stdout:5/688: write d3/fbc [662545,125252] 0 2023-12-08T20:27:54.171 INFO:tasks.workunit.client.1.smithi111.stdout:5/689: getdents d3/d4/d7/d36/d82/db4 0 2023-12-08T20:27:54.171 INFO:tasks.workunit.client.1.smithi111.stdout:5/690: dread - d3/d12/f87 zero size 2023-12-08T20:27:54.174 INFO:tasks.workunit.client.1.smithi111.stdout:5/691: mknod d3/d4/d4a/d21/cef 0 2023-12-08T20:27:54.174 INFO:tasks.workunit.client.1.smithi111.stdout:9/641: dwrite d2/d8/f18 [0,4194304] 0 2023-12-08T20:27:54.174 INFO:tasks.workunit.client.1.smithi111.stdout:7/483: fdatasync da/d38/f74 0 2023-12-08T20:27:54.174 INFO:tasks.workunit.client.1.smithi111.stdout:2/500: dwrite d1/d29/d53/f5a [0,4194304] 0 2023-12-08T20:27:54.174 INFO:tasks.workunit.client.1.smithi111.stdout:7/484: read da/d13/f69 [175160,63049] 0 2023-12-08T20:27:54.176 INFO:tasks.workunit.client.1.smithi111.stdout:5/692: symlink d3/d4/d7/d36/d82/db4/dbe/dc6/lf0 0 2023-12-08T20:27:54.177 INFO:tasks.workunit.client.1.smithi111.stdout:9/642: creat d2/d8/dd/d1a/d1e/d2d/d35/d88/fe6 x:0 0 0 2023-12-08T20:27:54.179 INFO:tasks.workunit.client.1.smithi111.stdout:5/693: write d3/d4/d4a/d21/faa [1303476,22352] 0 2023-12-08T20:27:54.196 INFO:tasks.workunit.client.1.smithi111.stdout:6/342: sync 2023-12-08T20:27:54.196 INFO:tasks.workunit.client.1.smithi111.stdout:8/615: sync 2023-12-08T20:27:54.196 INFO:tasks.workunit.client.1.smithi111.stdout:4/411: sync 2023-12-08T20:27:54.196 INFO:tasks.workunit.client.1.smithi111.stdout:8/616: read dd/d2d/f78 [408699,75939] 0 2023-12-08T20:27:54.225 INFO:tasks.workunit.client.1.smithi111.stdout:8/617: symlink dd/d32/da7/ld5 0 2023-12-08T20:27:54.225 INFO:tasks.workunit.client.1.smithi111.stdout:6/343: rename d0/l16 to d0/d1/d27/l66 0 2023-12-08T20:27:54.226 INFO:tasks.workunit.client.1.smithi111.stdout:6/344: truncate d0/d1/d1e/f4f 725708 0 2023-12-08T20:27:54.226 INFO:tasks.workunit.client.1.smithi111.stdout:6/345: stat d0/d1b/c54 0 2023-12-08T20:27:54.230 INFO:tasks.workunit.client.1.smithi111.stdout:6/346: creat d0/d1/f67 x:0 0 0 2023-12-08T20:27:54.232 INFO:tasks.workunit.client.1.smithi111.stdout:6/347: unlink d0/c25 0 2023-12-08T20:27:54.232 INFO:tasks.workunit.client.1.smithi111.stdout:7/485: dwrite da/d25/f3b [0,4194304] 0 2023-12-08T20:27:54.234 INFO:tasks.workunit.client.1.smithi111.stdout:7/486: mknod da/d13/d9e/d75/d9f/ca2 0 2023-12-08T20:27:54.235 INFO:tasks.workunit.client.1.smithi111.stdout:2/501: dwrite d1/d1d/d1f/d25/d3d/f63 [0,4194304] 0 2023-12-08T20:27:54.236 INFO:tasks.workunit.client.1.smithi111.stdout:6/348: rename d0/d1/d27/d56/d5a to d0/d68 0 2023-12-08T20:27:54.238 INFO:tasks.workunit.client.1.smithi111.stdout:2/502: truncate d1/d1d/d68/d73/f9b 597375 0 2023-12-08T20:27:54.239 INFO:tasks.workunit.client.1.smithi111.stdout:9/643: dwrite d2/d8/dd/d1a/d74/f8e [4194304,4194304] 0 2023-12-08T20:27:54.239 INFO:tasks.workunit.client.1.smithi111.stdout:9/644: readlink d2/d8/dd/d1a/d1e/d2d/lbc 0 2023-12-08T20:27:54.239 INFO:tasks.workunit.client.1.smithi111.stdout:2/503: write d1/d1d/f16 [3151940,105550] 0 2023-12-08T20:27:54.239 INFO:tasks.workunit.client.1.smithi111.stdout:4/412: dwrite d8/da/d2c/d1f/f6a [0,4194304] 0 2023-12-08T20:27:54.239 INFO:tasks.workunit.client.1.smithi111.stdout:4/413: fdatasync d8/f22 0 2023-12-08T20:27:54.240 INFO:tasks.workunit.client.1.smithi111.stdout:4/414: chown d8/da/d2c/d1f/fe 22 1 2023-12-08T20:27:54.240 INFO:tasks.workunit.client.1.smithi111.stdout:6/349: symlink d0/d68/l69 0 2023-12-08T20:27:54.243 INFO:tasks.workunit.client.1.smithi111.stdout:9/645: rename d2/d8/d9b to d2/d8/dd/d1a/d1e/de7 0 2023-12-08T20:27:54.248 INFO:tasks.workunit.client.1.smithi111.stdout:8/618: dwrite dd/d32/d3d/d55/fa3 [0,4194304] 0 2023-12-08T20:27:54.248 INFO:tasks.workunit.client.1.smithi111.stdout:8/619: chown dd/d2d/d62/d83/cc2 334768 1 2023-12-08T20:27:54.248 INFO:tasks.workunit.client.1.smithi111.stdout:2/504: link d1/d1d/f5d d1/fbc 0 2023-12-08T20:27:54.248 INFO:tasks.workunit.client.1.smithi111.stdout:4/415: rmdir d8/da/d29/d80 0 2023-12-08T20:27:54.248 INFO:tasks.workunit.client.1.smithi111.stdout:4/416: rename d8/da/d2c to d8/da/d2c/d1f/d2b/d81 22 2023-12-08T20:27:54.248 INFO:tasks.workunit.client.1.smithi111.stdout:9/646: creat d2/d8/dd/d1a/d1e/d2d/d8f/fe8 x:0 0 0 2023-12-08T20:27:54.249 INFO:tasks.workunit.client.1.smithi111.stdout:9/647: readlink d2/d8/dd/d1a/d66/l9a 0 2023-12-08T20:27:54.250 INFO:tasks.workunit.client.1.smithi111.stdout:8/620: truncate dd/f20 3976854 0 2023-12-08T20:27:54.251 INFO:tasks.workunit.client.1.smithi111.stdout:2/505: mkdir d1/d29/d53/d91/dbd 0 2023-12-08T20:27:54.253 INFO:tasks.workunit.client.1.smithi111.stdout:4/417: creat d8/d30/f82 x:0 0 0 2023-12-08T20:27:54.254 INFO:tasks.workunit.client.1.smithi111.stdout:9/648: creat d2/d8/dd/d56/fe9 x:0 0 0 2023-12-08T20:27:54.254 INFO:tasks.workunit.client.1.smithi111.stdout:9/649: write d2/d8/dd/fb4 [963302,110454] 0 2023-12-08T20:27:54.254 INFO:tasks.workunit.client.1.smithi111.stdout:7/487: dwrite da/d13/f7f [0,4194304] 0 2023-12-08T20:27:54.255 INFO:tasks.workunit.client.1.smithi111.stdout:8/621: mknod dd/d2d/d8b/d8d/cd6 0 2023-12-08T20:27:54.255 INFO:tasks.workunit.client.1.smithi111.stdout:8/622: write dd/d35/d42/db4/fca [865629,71918] 0 2023-12-08T20:27:54.255 INFO:tasks.workunit.client.1.smithi111.stdout:4/418: read d8/da/d29/f39 [2438900,79476] 0 2023-12-08T20:27:54.256 INFO:tasks.workunit.client.1.smithi111.stdout:6/350: dwrite d0/d1/d1e/f61 [0,4194304] 0 2023-12-08T20:27:54.258 INFO:tasks.workunit.client.1.smithi111.stdout:2/506: rename d1/d1d/d1f/d25/fa4 to d1/d1d/d1f/d36/d92/fbe 0 2023-12-08T20:27:54.259 INFO:tasks.workunit.client.1.smithi111.stdout:6/351: dread d0/f32 [0,4194304] 0 2023-12-08T20:27:54.260 INFO:tasks.workunit.client.1.smithi111.stdout:9/650: symlink d2/d8/dd/d1a/d1e/d2d/d35/d6b/lea 0 2023-12-08T20:27:54.267 INFO:tasks.workunit.client.1.smithi111.stdout:7/488: link da/d13/l7c da/d64/la3 0 2023-12-08T20:27:54.267 INFO:tasks.workunit.client.1.smithi111.stdout:7/489: write da/d13/d21/f50 [1136623,104475] 0 2023-12-08T20:27:54.268 INFO:tasks.workunit.client.1.smithi111.stdout:7/490: dread da/d64/f71 [0,4194304] 0 2023-12-08T20:27:54.269 INFO:tasks.workunit.client.1.smithi111.stdout:7/491: write da/d13/f1a [1845440,106353] 0 2023-12-08T20:27:54.269 INFO:tasks.workunit.client.1.smithi111.stdout:7/492: chown da/d25/d3d/c43 18824 1 2023-12-08T20:27:54.270 INFO:tasks.workunit.client.1.smithi111.stdout:7/493: read da/d13/f1a [2282099,39169] 0 2023-12-08T20:27:54.272 INFO:tasks.workunit.client.1.smithi111.stdout:4/419: creat d8/da/d2c/d1f/f83 x:0 0 0 2023-12-08T20:27:54.273 INFO:tasks.workunit.client.1.smithi111.stdout:2/507: dread d1/d29/d53/f5a [0,4194304] 0 2023-12-08T20:27:54.275 INFO:tasks.workunit.client.1.smithi111.stdout:9/651: creat d2/d8/dd/d1a/d1e/d2d/d4a/d62/feb x:0 0 0 2023-12-08T20:27:54.275 INFO:tasks.workunit.client.1.smithi111.stdout:9/652: fdatasync d2/d8/dd/d56/f58 0 2023-12-08T20:27:54.276 INFO:tasks.workunit.client.1.smithi111.stdout:2/508: mkdir d1/d29/d4e/dbf 0 2023-12-08T20:27:54.277 INFO:tasks.workunit.client.1.smithi111.stdout:2/509: symlink d1/d1d/d22/lc0 0 2023-12-08T20:27:54.277 INFO:tasks.workunit.client.1.smithi111.stdout:6/352: rmdir d0 39 2023-12-08T20:27:54.278 INFO:tasks.workunit.client.1.smithi111.stdout:6/353: readlink d0/d1/la 0 2023-12-08T20:27:54.279 INFO:tasks.workunit.client.1.smithi111.stdout:6/354: symlink d0/d1b/l6a 0 2023-12-08T20:27:54.280 INFO:tasks.workunit.client.1.smithi111.stdout:4/420: dread d8/da/d2c/d1f/d2b/d4b/f53 [0,4194304] 0 2023-12-08T20:27:54.281 INFO:tasks.workunit.client.1.smithi111.stdout:6/355: creat d0/f6b x:0 0 0 2023-12-08T20:27:54.282 INFO:tasks.workunit.client.1.smithi111.stdout:8/623: dwrite dd/d32/d36/d50/fc8 [0,4194304] 0 2023-12-08T20:27:54.282 INFO:tasks.workunit.client.1.smithi111.stdout:8/624: write dd/d35/d42/fb5 [144479,57593] 0 2023-12-08T20:27:54.284 INFO:tasks.workunit.client.1.smithi111.stdout:6/356: mknod d0/d1/d27/d36/c6c 0 2023-12-08T20:27:54.284 INFO:tasks.workunit.client.1.smithi111.stdout:6/357: truncate d0/d1/f6 1800601 0 2023-12-08T20:27:54.284 INFO:tasks.workunit.client.1.smithi111.stdout:7/494: dread da/d25/d26/d32/d3e/f42 [0,4194304] 0 2023-12-08T20:27:54.293 INFO:tasks.workunit.client.1.smithi111.stdout:9/653: dwrite d2/d8/dd/d1a/d1e/d2d/d4a/d62/feb [0,4194304] 0 2023-12-08T20:27:54.294 INFO:tasks.workunit.client.1.smithi111.stdout:9/654: stat d2/d8/dd/d1a/d74/f7a 0 2023-12-08T20:27:54.296 INFO:tasks.workunit.client.1.smithi111.stdout:2/510: dwrite f0 [0,4194304] 0 2023-12-08T20:27:54.296 INFO:tasks.workunit.client.1.smithi111.stdout:6/358: unlink d0/d68/l69 0 2023-12-08T20:27:54.296 INFO:tasks.workunit.client.1.smithi111.stdout:7/495: truncate da/d25/d26/f41 1767347 0 2023-12-08T20:27:54.299 INFO:tasks.workunit.client.1.smithi111.stdout:9/655: rmdir d2/d8/dd/d1a/d66 39 2023-12-08T20:27:54.299 INFO:tasks.workunit.client.1.smithi111.stdout:9/656: chown d2/d8/dd/f6c 14784990 1 2023-12-08T20:27:54.303 INFO:tasks.workunit.client.1.smithi111.stdout:6/359: mknod d0/d1/d27/d36/c6d 0 2023-12-08T20:27:54.304 INFO:tasks.workunit.client.1.smithi111.stdout:7/496: mkdir da/d25/d3d/d58/da4 0 2023-12-08T20:27:54.305 INFO:tasks.workunit.client.1.smithi111.stdout:9/657: truncate d2/d8/dd/d1a/d1e/f26 1453397 0 2023-12-08T20:27:54.306 INFO:tasks.workunit.client.1.smithi111.stdout:2/511: dread d1/d1d/f2e [0,4194304] 0 2023-12-08T20:27:54.306 INFO:tasks.workunit.client.1.smithi111.stdout:6/360: truncate d0/d1b/f1d 2098013 0 2023-12-08T20:27:54.307 INFO:tasks.workunit.client.1.smithi111.stdout:7/497: creat da/d25/d3d/fa5 x:0 0 0 2023-12-08T20:27:54.307 INFO:tasks.workunit.client.1.smithi111.stdout:7/498: fdatasync da/d25/f2e 0 2023-12-08T20:27:54.308 INFO:tasks.workunit.client.1.smithi111.stdout:9/658: getdents d2/d8/dd/d1a/d1e 0 2023-12-08T20:27:54.309 INFO:tasks.workunit.client.1.smithi111.stdout:2/512: mkdir d1/d1d/d1f/dc1 0 2023-12-08T20:27:54.310 INFO:tasks.workunit.client.1.smithi111.stdout:6/361: mkdir d0/d1/d27/d6e 0 2023-12-08T20:27:54.311 INFO:tasks.workunit.client.1.smithi111.stdout:9/659: symlink d2/d8/dd/d56/da1/lec 0 2023-12-08T20:27:54.312 INFO:tasks.workunit.client.1.smithi111.stdout:2/513: mknod d1/d1d/d68/cc2 0 2023-12-08T20:27:54.312 INFO:tasks.workunit.client.1.smithi111.stdout:2/514: chown d1/d29 391467305 1 2023-12-08T20:27:54.312 INFO:tasks.workunit.client.1.smithi111.stdout:2/515: chown d1/d1d/c9c 368520715 1 2023-12-08T20:27:54.312 INFO:tasks.workunit.client.1.smithi111.stdout:2/516: fdatasync d1/d29/d53/f82 0 2023-12-08T20:27:54.312 INFO:tasks.workunit.client.1.smithi111.stdout:2/517: stat d1/d1d/d1f/d25/d3d/d56/cb5 0 2023-12-08T20:27:54.314 INFO:tasks.workunit.client.1.smithi111.stdout:2/518: write d1/d1d/f26 [2096445,115860] 0 2023-12-08T20:27:54.314 INFO:tasks.workunit.client.1.smithi111.stdout:2/519: stat d1/d1d/d55/f4a 0 2023-12-08T20:27:54.314 INFO:tasks.workunit.client.1.smithi111.stdout:2/520: stat d1/d1d/d22/l86 0 2023-12-08T20:27:54.314 INFO:tasks.workunit.client.1.smithi111.stdout:6/362: unlink d0/d1/cc 0 2023-12-08T20:27:54.314 INFO:tasks.workunit.client.1.smithi111.stdout:6/363: fdatasync d0/f13 0 2023-12-08T20:27:54.316 INFO:tasks.workunit.client.1.smithi111.stdout:2/521: unlink d1/d1d/d1f/d25/d67/l7e 0 2023-12-08T20:27:54.317 INFO:tasks.workunit.client.1.smithi111.stdout:6/364: creat d0/d1a/f6f x:0 0 0 2023-12-08T20:27:54.317 INFO:tasks.workunit.client.1.smithi111.stdout:6/365: write d0/d1b/f35 [4966327,110953] 0 2023-12-08T20:27:54.318 INFO:tasks.workunit.client.1.smithi111.stdout:9/660: symlink d2/d8/dd/d1a/d1e/d2d/d4a/led 0 2023-12-08T20:27:54.319 INFO:tasks.workunit.client.1.smithi111.stdout:0/772: sync 2023-12-08T20:27:54.320 INFO:tasks.workunit.client.1.smithi111.stdout:2/522: unlink d1/d1d/d22/l3b 0 2023-12-08T20:27:54.322 INFO:tasks.workunit.client.1.smithi111.stdout:6/366: truncate d0/d1/d27/f40 2299101 0 2023-12-08T20:27:54.324 INFO:tasks.workunit.client.1.smithi111.stdout:9/661: symlink d2/d8/dd/d1a/d1e/d2d/d4a/d62/lee 0 2023-12-08T20:27:54.325 INFO:tasks.workunit.client.1.smithi111.stdout:2/523: creat d1/d29/d53/d90/fc3 x:0 0 0 2023-12-08T20:27:54.325 INFO:tasks.workunit.client.1.smithi111.stdout:2/524: chown d1/d29/d53/f85 233 1 2023-12-08T20:27:54.332 INFO:tasks.workunit.client.1.smithi111.stdout:6/367: creat d0/d1/d27/d6e/f70 x:0 0 0 2023-12-08T20:27:54.334 INFO:tasks.workunit.client.1.smithi111.stdout:9/662: creat d2/d8/dd/d1a/d1e/d2d/d35/d6b/fef x:0 0 0 2023-12-08T20:27:54.336 INFO:tasks.workunit.client.1.smithi111.stdout:6/368: creat d0/d1/d27/f71 x:0 0 0 2023-12-08T20:27:54.337 INFO:tasks.workunit.client.1.smithi111.stdout:6/369: stat d0/c30 0 2023-12-08T20:27:54.337 INFO:tasks.workunit.client.1.smithi111.stdout:6/370: write d0/d1/f65 [402394,11156] 0 2023-12-08T20:27:54.338 INFO:tasks.workunit.client.1.smithi111.stdout:9/663: link d2/d8/dd/d1a/d1e/d2d/d35/f53 d2/d8/dd/d1a/d74/dbf/ff0 0 2023-12-08T20:27:54.338 INFO:tasks.workunit.client.1.smithi111.stdout:7/499: dwrite da/d25/d26/f41 [0,4194304] 0 2023-12-08T20:27:54.340 INFO:tasks.workunit.client.1.smithi111.stdout:7/500: truncate da/d25/f5d 3257472 0 2023-12-08T20:27:54.340 INFO:tasks.workunit.client.1.smithi111.stdout:7/501: chown da/d13/d9e/c5b 204450759 1 2023-12-08T20:27:54.343 INFO:tasks.workunit.client.1.smithi111.stdout:7/502: creat da/d25/d26/d32/d3e/d97/fa6 x:0 0 0 2023-12-08T20:27:54.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.342+0000 7f49cff9b700 1 -- 172.21.15.43:0/3513326626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49c80fcac0 msgr2=0x7f49c80fcf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:54.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.342+0000 7f49cff9b700 1 --2- 172.21.15.43:0/3513326626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49c80fcac0 0x7f49c80fcf10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f49b8004940 tx=0x7f49b8009e30 comp rx=0 tx=0).stop 2023-12-08T20:27:54.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.342+0000 7f49cff9b700 1 -- 172.21.15.43:0/3513326626 shutdown_connections 2023-12-08T20:27:54.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.342+0000 7f49cff9b700 1 --2- 172.21.15.43:0/3513326626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49c80fcac0 0x7f49c80fcf10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:54.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.342+0000 7f49cff9b700 1 --2- 172.21.15.43:0/3513326626 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49c80fc0e0 0x7f49c80fc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:54.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.342+0000 7f49cff9b700 1 -- 172.21.15.43:0/3513326626 >> 172.21.15.43:0/3513326626 conn(0x7f49c80f6950 msgr2=0x7f49c80f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:54.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.342+0000 7f49cff9b700 1 -- 172.21.15.43:0/3513326626 shutdown_connections 2023-12-08T20:27:54.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.342+0000 7f49cff9b700 1 -- 172.21.15.43:0/3513326626 wait complete. 2023-12-08T20:27:54.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.343+0000 7f49cff9b700 1 Processor -- start 2023-12-08T20:27:54.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.343+0000 7f49cff9b700 1 -- start start 2023-12-08T20:27:54.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.344+0000 7f49cff9b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49c80fc0e0 0x7f49c810e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:54.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.344+0000 7f49cff9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49c80fcac0 0x7f49c8110630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:54.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.344+0000 7f49cff9b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c80fbb90 con 0x7f49c80fcac0 2023-12-08T20:27:54.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.344+0000 7f49cff9b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c80fbd00 con 0x7f49c80fc0e0 2023-12-08T20:27:54.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.344+0000 7f49cd536700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49c80fcac0 0x7f49c8110630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:54.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.344+0000 7f49cd536700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49c80fcac0 0x7f49c8110630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38424/0 (socket says 172.21.15.43:38424) 2023-12-08T20:27:54.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.344+0000 7f49cd536700 1 -- 172.21.15.43:0/1511631694 learned_addr learned my addr 172.21.15.43:0/1511631694 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:27:54.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.344+0000 7f49cdd37700 1 --2- 172.21.15.43:0/1511631694 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49c80fc0e0 0x7f49c810e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:54.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.344+0000 7f49cd536700 1 -- 172.21.15.43:0/1511631694 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49c80fc0e0 msgr2=0x7f49c810e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:54.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.344+0000 7f49cd536700 1 --2- 172.21.15.43:0/1511631694 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49c80fc0e0 0x7f49c810e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:54.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.344+0000 7f49cd536700 1 -- 172.21.15.43:0/1511631694 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b8005040 con 0x7f49c80fcac0 2023-12-08T20:27:54.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.345+0000 7f49cd536700 1 --2- 172.21.15.43:0/1511631694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49c80fcac0 0x7f49c8110630 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f49b800b3b0 tx=0x7f49b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:27:54.347 INFO:tasks.workunit.client.1.smithi111.stdout:7/503: mkdir da/da7 0 2023-12-08T20:27:54.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.345+0000 7f49be7fc700 1 -- 172.21.15.43:0/1511631694 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b800e040 con 0x7f49c80fcac0 2023-12-08T20:27:54.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.345+0000 7f49cff9b700 1 -- 172.21.15.43:0/1511631694 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c8110c60 con 0x7f49c80fcac0 2023-12-08T20:27:54.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.345+0000 7f49cff9b700 1 -- 172.21.15.43:0/1511631694 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c81111a0 con 0x7f49c80fcac0 2023-12-08T20:27:54.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.345+0000 7f49be7fc700 1 -- 172.21.15.43:0/1511631694 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f49b800bc50 con 0x7f49c80fcac0 2023-12-08T20:27:54.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.345+0000 7f49be7fc700 1 -- 172.21.15.43:0/1511631694 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b8013660 con 0x7f49c80fcac0 2023-12-08T20:27:54.348 INFO:tasks.workunit.client.1.smithi111.stdout:7/504: symlink da/d25/d26/d32/la8 0 2023-12-08T20:27:54.348 INFO:tasks.workunit.client.1.smithi111.stdout:7/505: read da/f46 [1129964,70287] 0 2023-12-08T20:27:54.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.349+0000 7f49cff9b700 1 -- 172.21.15.43:0/1511631694 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ac0052e0 con 0x7f49c80fcac0 2023-12-08T20:27:54.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.349+0000 7f49be7fc700 1 -- 172.21.15.43:0/1511631694 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f49b801c430 con 0x7f49c80fcac0 2023-12-08T20:27:54.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.350+0000 7f49be7fc700 1 --2- 172.21.15.43:0/1511631694 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f49b406ae40 0x7f49b406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:54.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.350+0000 7f49be7fc700 1 -- 172.21.15.43:0/1511631694 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f49b801ce40 con 0x7f49c80fcac0 2023-12-08T20:27:54.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.351+0000 7f49cdd37700 1 --2- 172.21.15.43:0/1511631694 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f49b406ae40 0x7f49b406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:54.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.351+0000 7f49cdd37700 1 --2- 172.21.15.43:0/1511631694 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f49b406ae40 0x7f49b406d2f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f49c4006fd0 tx=0x7f49c4008040 comp rx=0 tx=0).ready entity=mgr.24407 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:27:54.353 INFO:tasks.workunit.client.1.smithi111.stdout:7/506: mkdir da/d25/da9 0 2023-12-08T20:27:54.355 INFO:tasks.workunit.client.1.smithi111.stdout:6/371: dwrite d0/d1/d1e/f2b [0,4194304] 0 2023-12-08T20:27:54.357 INFO:tasks.workunit.client.1.smithi111.stdout:7/507: creat da/d25/d26/d32/d87/faa x:0 0 0 2023-12-08T20:27:54.357 INFO:tasks.workunit.client.1.smithi111.stdout:9/664: dwrite d2/d8/d8c/f94 [0,4194304] 0 2023-12-08T20:27:54.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.357+0000 7f49be7fc700 1 -- 172.21.15.43:0/1511631694 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f49b8054b20 con 0x7f49c80fcac0 2023-12-08T20:27:54.364 INFO:tasks.workunit.client.1.smithi111.stdout:6/372: fsync d0/d1b/f1d 0 2023-12-08T20:27:54.366 INFO:tasks.workunit.client.1.smithi111.stdout:7/508: rename da/cc to da/d38/cab 0 2023-12-08T20:27:54.369 INFO:tasks.workunit.client.1.smithi111.stdout:9/665: mknod d2/d8/d8c/d96/cf1 0 2023-12-08T20:27:54.369 INFO:tasks.workunit.client.1.smithi111.stdout:9/666: readlink d2/lc8 0 2023-12-08T20:27:54.369 INFO:tasks.workunit.client.1.smithi111.stdout:9/667: write d2/d8/dd/d1a/d66/fd9 [851239,21560] 0 2023-12-08T20:27:54.369 INFO:tasks.workunit.client.1.smithi111.stdout:9/668: chown d2/d8/dd/d1a/d74 23 1 2023-12-08T20:27:54.369 INFO:tasks.workunit.client.1.smithi111.stdout:9/669: write d2/d8/dd/d1a/d1e/d2d/fe3 [155360,32844] 0 2023-12-08T20:27:54.376 INFO:tasks.workunit.client.1.smithi111.stdout:7/509: creat da/d25/d26/d32/d3e/fac x:0 0 0 2023-12-08T20:27:54.384 INFO:tasks.workunit.client.1.smithi111.stdout:6/373: rename d0/f22 to d0/d1a/f72 0 2023-12-08T20:27:54.385 INFO:tasks.workunit.client.1.smithi111.stdout:6/374: stat d0/d1/d27/d36/c6d 0 2023-12-08T20:27:54.388 INFO:tasks.workunit.client.1.smithi111.stdout:5/694: sync 2023-12-08T20:27:54.388 INFO:tasks.workunit.client.1.smithi111.stdout:1/569: sync 2023-12-08T20:27:54.388 INFO:tasks.workunit.client.1.smithi111.stdout:3/460: sync 2023-12-08T20:27:54.388 INFO:tasks.workunit.client.1.smithi111.stdout:5/695: chown d3/d4/d7/f8b 6 1 2023-12-08T20:27:54.388 INFO:tasks.workunit.client.1.smithi111.stdout:5/696: readlink d3/d4/d7/d36/l51 0 2023-12-08T20:27:54.390 INFO:tasks.workunit.client.1.smithi111.stdout:7/510: dwrite da/f5f [0,4194304] 0 2023-12-08T20:27:54.391 INFO:tasks.workunit.client.1.smithi111.stdout:3/461: mkdir d2/d3/d1e/d93 0 2023-12-08T20:27:54.391 INFO:tasks.workunit.client.1.smithi111.stdout:3/462: readlink d2/d3/d13/d36/l50 0 2023-12-08T20:27:54.393 INFO:tasks.workunit.client.1.smithi111.stdout:5/697: rmdir d3/d4/d7/d29 39 2023-12-08T20:27:54.394 INFO:tasks.workunit.client.1.smithi111.stdout:6/375: dread d0/d1/d27/f40 [0,4194304] 0 2023-12-08T20:27:54.395 INFO:tasks.workunit.client.1.smithi111.stdout:5/698: dread d3/d6d/f81 [0,4194304] 0 2023-12-08T20:27:54.397 INFO:tasks.workunit.client.1.smithi111.stdout:7/511: creat da/d13/fad x:0 0 0 2023-12-08T20:27:54.397 INFO:tasks.workunit.client.1.smithi111.stdout:7/512: write da/d25/d3d/d58/f5e [918218,55315] 0 2023-12-08T20:27:54.398 INFO:tasks.workunit.client.1.smithi111.stdout:3/463: truncate d2/d15/d17/f35 1832374 0 2023-12-08T20:27:54.399 INFO:tasks.workunit.client.1.smithi111.stdout:7/513: truncate da/f46 2022404 0 2023-12-08T20:27:54.400 INFO:tasks.workunit.client.1.smithi111.stdout:7/514: read da/d64/f71 [173782,44338] 0 2023-12-08T20:27:54.400 INFO:tasks.workunit.client.1.smithi111.stdout:7/515: dread - da/d38/f8f zero size 2023-12-08T20:27:54.402 INFO:tasks.workunit.client.1.smithi111.stdout:3/464: creat d2/d15/d17/f94 x:0 0 0 2023-12-08T20:27:54.403 INFO:tasks.workunit.client.1.smithi111.stdout:3/465: dread d2/d3/d13/d36/d69/f7a [0,4194304] 0 2023-12-08T20:27:54.403 INFO:tasks.workunit.client.1.smithi111.stdout:3/466: readlink d2/l49 0 2023-12-08T20:27:54.405 INFO:tasks.workunit.client.1.smithi111.stdout:5/699: dread d3/d12/f17 [0,4194304] 0 2023-12-08T20:27:54.405 INFO:tasks.workunit.client.1.smithi111.stdout:5/700: chown d3/d4/d4a/d21/c79 275 1 2023-12-08T20:27:54.405 INFO:tasks.workunit.client.1.smithi111.stdout:5/701: write d3/d12/f17 [4439501,78856] 0 2023-12-08T20:27:54.406 INFO:tasks.workunit.client.1.smithi111.stdout:7/516: symlink da/d25/d3d/d58/da4/lae 0 2023-12-08T20:27:54.406 INFO:tasks.workunit.client.1.smithi111.stdout:7/517: fsync da/d25/d26/d32/d87/faa 0 2023-12-08T20:27:54.406 INFO:tasks.workunit.client.1.smithi111.stdout:3/467: rmdir d2/d15/d17/d25 39 2023-12-08T20:27:54.410 INFO:tasks.workunit.client.1.smithi111.stdout:5/702: creat d3/d6d/ff1 x:0 0 0 2023-12-08T20:27:54.410 INFO:tasks.workunit.client.1.smithi111.stdout:5/703: chown d3/d4/d4a/l26 23828 1 2023-12-08T20:27:54.417 INFO:tasks.workunit.client.1.smithi111.stdout:1/570: dwrite d0/f17 [4194304,4194304] 0 2023-12-08T20:27:54.418 INFO:tasks.workunit.client.1.smithi111.stdout:1/571: getdents d0/d6/d33/d15/d51/d78 0 2023-12-08T20:27:54.420 INFO:tasks.workunit.client.1.smithi111.stdout:3/468: rmdir d2 39 2023-12-08T20:27:54.422 INFO:tasks.workunit.client.1.smithi111.stdout:1/572: rename d0/d8e/cbc to d0/d6/d33/d60/ccb 0 2023-12-08T20:27:54.422 INFO:tasks.workunit.client.1.smithi111.stdout:1/573: chown d0/d6/d47/c65 63210 1 2023-12-08T20:27:54.426 INFO:tasks.workunit.client.1.smithi111.stdout:3/469: write d2/d3/fb [3265399,112870] 0 2023-12-08T20:27:54.426 INFO:tasks.workunit.client.1.smithi111.stdout:3/470: stat d2/d3/fb 0 2023-12-08T20:27:54.426 INFO:tasks.workunit.client.1.smithi111.stdout:3/471: readlink d2/d3/d13/d36/l50 0 2023-12-08T20:27:54.426 INFO:tasks.workunit.client.1.smithi111.stdout:3/472: dread - d2/d12/d2e/f74 zero size 2023-12-08T20:27:54.427 INFO:tasks.workunit.client.1.smithi111.stdout:3/473: unlink d2/d15/d17/f3b 0 2023-12-08T20:27:54.427 INFO:tasks.workunit.client.1.smithi111.stdout:3/474: write d2/d3/d13/d36/d69/f7a [710713,100700] 0 2023-12-08T20:27:54.427 INFO:tasks.workunit.client.1.smithi111.stdout:1/574: write d0/d6/d33/d6c/f9a [1486346,99612] 0 2023-12-08T20:27:54.427 INFO:tasks.workunit.client.1.smithi111.stdout:3/475: mkdir d2/d3/d1e/d95 0 2023-12-08T20:27:54.427 INFO:tasks.workunit.client.1.smithi111.stdout:3/476: stat d2/d3/d6/d8b/c77 0 2023-12-08T20:27:54.431 INFO:tasks.workunit.client.1.smithi111.stdout:5/704: dwrite d3/d4/d7/d29/d30/dc0/fe7 [0,4194304] 0 2023-12-08T20:27:54.431 INFO:tasks.workunit.client.1.smithi111.stdout:3/477: dread d2/d3/d6/f23 [0,4194304] 0 2023-12-08T20:27:54.431 INFO:tasks.workunit.client.1.smithi111.stdout:3/478: readlink d2/d3/d13/d36/d44/d8f/l92 0 2023-12-08T20:27:54.431 INFO:tasks.workunit.client.1.smithi111.stdout:7/518: dwrite da/d25/d26/d32/f90 [0,4194304] 0 2023-12-08T20:27:54.431 INFO:tasks.workunit.client.1.smithi111.stdout:7/519: write da/d38/f8f [102629,41813] 0 2023-12-08T20:27:54.434 INFO:tasks.workunit.client.1.smithi111.stdout:5/705: mkdir d3/d4/d7/d36/df2 0 2023-12-08T20:27:54.436 INFO:tasks.workunit.client.1.smithi111.stdout:7/520: rename da/f5f to da/d25/faf 0 2023-12-08T20:27:54.436 INFO:tasks.workunit.client.1.smithi111.stdout:7/521: fsync da/d25/f4a 0 2023-12-08T20:27:54.439 INFO:tasks.workunit.client.1.smithi111.stdout:7/522: rename da/d25/d3d/c4e to da/d13/d9e/d75/cb0 0 2023-12-08T20:27:54.442 INFO:tasks.workunit.client.1.smithi111.stdout:7/523: getdents da/d13/d9e/d75/d9f 0 2023-12-08T20:27:54.444 INFO:tasks.workunit.client.1.smithi111.stdout:3/479: dwrite d2/d12/d2e/f48 [0,4194304] 0 2023-12-08T20:27:54.444 INFO:tasks.workunit.client.1.smithi111.stdout:3/480: chown d2/d3/d13/d36/d69/d81 83 1 2023-12-08T20:27:54.450 INFO:tasks.workunit.client.1.smithi111.stdout:3/481: dread d2/d3/d6/fe [0,4194304] 0 2023-12-08T20:27:54.452 INFO:tasks.workunit.client.1.smithi111.stdout:3/482: creat d2/d15/d17/d5e/f96 x:0 0 0 2023-12-08T20:27:54.453 INFO:tasks.workunit.client.1.smithi111.stdout:3/483: mknod d2/d12/d4a/d5d/c97 0 2023-12-08T20:27:54.453 INFO:tasks.workunit.client.1.smithi111.stdout:3/484: chown d2/d15/d17/d25/f58 32258 1 2023-12-08T20:27:54.455 INFO:tasks.workunit.client.1.smithi111.stdout:7/524: dwrite da/d25/d26/f98 [4194304,4194304] 0 2023-12-08T20:27:54.455 INFO:tasks.workunit.client.1.smithi111.stdout:7/525: write da/d25/f4a [1249277,71987] 0 2023-12-08T20:27:54.455 INFO:tasks.workunit.client.1.smithi111.stdout:7/526: read - da/d38/f6a zero size 2023-12-08T20:27:54.455 INFO:tasks.workunit.client.1.smithi111.stdout:7/527: readlink da/l47 0 2023-12-08T20:27:54.455 INFO:tasks.workunit.client.1.smithi111.stdout:3/485: creat d2/d3/d13/f98 x:0 0 0 2023-12-08T20:27:54.455 INFO:tasks.workunit.client.1.smithi111.stdout:3/486: stat d2/d12 0 2023-12-08T20:27:54.459 INFO:tasks.workunit.client.1.smithi111.stdout:7/528: unlink da/d5c/f52 0 2023-12-08T20:27:54.461 INFO:tasks.workunit.client.1.smithi111.stdout:3/487: rmdir d2/d3/d1e/d95 0 2023-12-08T20:27:54.463 INFO:tasks.workunit.client.1.smithi111.stdout:4/421: sync 2023-12-08T20:27:54.463 INFO:tasks.workunit.client.1.smithi111.stdout:4/422: write d8/da/db/d7f/f5a [464294,89660] 0 2023-12-08T20:27:54.463 INFO:tasks.workunit.client.1.smithi111.stdout:4/423: chown d8/da/d2c/d1f 3 1 2023-12-08T20:27:54.470 INFO:tasks.workunit.client.1.smithi111.stdout:3/488: mknod d2/d3/c99 0 2023-12-08T20:27:54.470 INFO:tasks.workunit.client.1.smithi111.stdout:3/489: rename d2/d3/d1e/d93 to d2/d3/d1e/d93/d9a 22 2023-12-08T20:27:54.472 INFO:tasks.workunit.client.1.smithi111.stdout:4/424: creat d8/da/d29/f84 x:0 0 0 2023-12-08T20:27:54.473 INFO:tasks.workunit.client.1.smithi111.stdout:4/425: getdents d8/d30 0 2023-12-08T20:27:54.473 INFO:tasks.workunit.client.1.smithi111.stdout:4/426: chown d8/da/d29/d69 107 1 2023-12-08T20:27:54.475 INFO:tasks.workunit.client.1.smithi111.stdout:3/490: write d2/d15/d17/d25/f58 [1305578,109653] 0 2023-12-08T20:27:54.475 INFO:tasks.workunit.client.1.smithi111.stdout:4/427: truncate d8/da/f75 209363 0 2023-12-08T20:27:54.476 INFO:tasks.workunit.client.1.smithi111.stdout:7/529: dwrite da/d25/f2e [0,4194304] 0 2023-12-08T20:27:54.477 INFO:tasks.workunit.client.1.smithi111.stdout:3/491: write d2/d12/d2e/f48 [2114207,69761] 0 2023-12-08T20:27:54.477 INFO:tasks.workunit.client.1.smithi111.stdout:3/492: write d2/d3/d13/d36/d69/d70/f90 [201866,14677] 0 2023-12-08T20:27:54.477 INFO:tasks.workunit.client.1.smithi111.stdout:3/493: chown d2/d3/d13/d36/f3e 21596124 1 2023-12-08T20:27:54.477 INFO:tasks.workunit.client.1.smithi111.stdout:3/494: write d2/d15/d17/f5c [873194,81478] 0 2023-12-08T20:27:54.478 INFO:tasks.workunit.client.1.smithi111.stdout:4/428: unlink f0 0 2023-12-08T20:27:54.480 INFO:tasks.workunit.client.1.smithi111.stdout:7/530: creat da/d5c/d59/d61/fb1 x:0 0 0 2023-12-08T20:27:54.481 INFO:tasks.workunit.client.1.smithi111.stdout:3/495: creat d2/d3/d13/d36/d69/d70/f9b x:0 0 0 2023-12-08T20:27:54.483 INFO:tasks.workunit.client.1.smithi111.stdout:4/429: rename d8/da/db/c2d to d8/d30/d7d/c85 0 2023-12-08T20:27:54.483 INFO:tasks.workunit.client.1.smithi111.stdout:4/430: fsync d8/f22 0 2023-12-08T20:27:54.485 INFO:tasks.workunit.client.1.smithi111.stdout:7/531: rename da/d25/d3d/l48 to da/d25/d26/d32/d3e/lb2 0 2023-12-08T20:27:54.490 INFO:tasks.workunit.client.1.smithi111.stdout:3/496: dread d2/d15/d17/d25/d4e/f73 [0,4194304] 0 2023-12-08T20:27:54.490 INFO:tasks.workunit.client.1.smithi111.stdout:3/497: write d2/d15/d17/d5e/f96 [896662,33619] 0 2023-12-08T20:27:54.491 INFO:tasks.workunit.client.1.smithi111.stdout:4/431: dread d8/d30/f79 [0,4194304] 0 2023-12-08T20:27:54.492 INFO:tasks.workunit.client.1.smithi111.stdout:4/432: creat d8/f86 x:0 0 0 2023-12-08T20:27:54.492 INFO:tasks.workunit.client.1.smithi111.stdout:3/498: dread d2/d15/d17/d25/d4e/f4f [0,4194304] 0 2023-12-08T20:27:54.494 INFO:tasks.workunit.client.1.smithi111.stdout:4/433: truncate d8/da/d2c/d1f/d40/f60 328572 0 2023-12-08T20:27:54.495 INFO:tasks.workunit.client.1.smithi111.stdout:3/499: rmdir d2 39 2023-12-08T20:27:54.495 INFO:tasks.workunit.client.1.smithi111.stdout:3/500: fdatasync d2/d12/d4a/f6f 0 2023-12-08T20:27:54.505 INFO:tasks.workunit.client.1.smithi111.stdout:4/434: dread d8/da/f25 [0,4194304] 0 2023-12-08T20:27:54.507 INFO:tasks.workunit.client.1.smithi111.stdout:4/435: rename d8/f12 to d8/da/db/d31/d77/f87 0 2023-12-08T20:27:54.513 INFO:tasks.workunit.client.1.smithi111.stdout:7/532: dwrite da/d25/d26/f4d [0,4194304] 0 2023-12-08T20:27:54.516 INFO:tasks.workunit.client.1.smithi111.stdout:7/533: symlink da/d25/da9/lb3 0 2023-12-08T20:27:54.521 INFO:tasks.workunit.client.1.smithi111.stdout:4/436: dwrite d8/da/db/d31/f3f [0,4194304] 0 2023-12-08T20:27:54.524 INFO:tasks.workunit.client.1.smithi111.stdout:4/437: symlink d8/da/db/d31/d77/l88 0 2023-12-08T20:27:54.525 INFO:tasks.workunit.client.1.smithi111.stdout:4/438: read d8/da/d2c/d1f/d2b/d4b/f53 [668186,63455] 0 2023-12-08T20:27:54.526 INFO:tasks.workunit.client.1.smithi111.stdout:4/439: rmdir d8/da/d2c/d1f/d2b/d4b 39 2023-12-08T20:27:54.527 INFO:tasks.workunit.client.1.smithi111.stdout:4/440: read d8/da/f75 [22653,92099] 0 2023-12-08T20:27:54.529 INFO:tasks.workunit.client.1.smithi111.stdout:4/441: rename d8/f86 to d8/da/d29/d5c/f89 0 2023-12-08T20:27:54.529 INFO:tasks.workunit.client.1.smithi111.stdout:4/442: mknod d8/da/db/c8a 0 2023-12-08T20:27:54.530 INFO:tasks.workunit.client.1.smithi111.stdout:4/443: mknod d8/c8b 0 2023-12-08T20:27:54.532 INFO:tasks.workunit.client.1.smithi111.stdout:4/444: rename d8/da/d2c/d1f/d2b/f3a to d8/da/d2c/d1f/d2b/d4b/f8c 0 2023-12-08T20:27:54.532 INFO:tasks.workunit.client.1.smithi111.stdout:4/445: truncate d8/f18 5148631 0 2023-12-08T20:27:54.533 INFO:tasks.workunit.client.1.smithi111.stdout:7/534: dwrite da/d25/f3b [0,4194304] 0 2023-12-08T20:27:54.533 INFO:tasks.workunit.client.1.smithi111.stdout:4/446: creat d8/da/db/f8d x:0 0 0 2023-12-08T20:27:54.534 INFO:tasks.workunit.client.1.smithi111.stdout:4/447: mkdir d8/da/db/d7f/d8e 0 2023-12-08T20:27:54.535 INFO:tasks.workunit.client.1.smithi111.stdout:4/448: creat d8/f8f x:0 0 0 2023-12-08T20:27:54.535 INFO:tasks.workunit.client.1.smithi111.stdout:4/449: chown d8/da/db/l28 129607575 1 2023-12-08T20:27:54.536 INFO:tasks.workunit.client.1.smithi111.stdout:7/535: write da/d25/d26/f2b [588346,104350] 0 2023-12-08T20:27:54.537 INFO:tasks.workunit.client.1.smithi111.stdout:7/536: mknod da/d13/d9e/cb4 0 2023-12-08T20:27:54.538 INFO:tasks.workunit.client.1.smithi111.stdout:7/537: symlink da/d13/d21/lb5 0 2023-12-08T20:27:54.540 INFO:tasks.workunit.client.1.smithi111.stdout:7/538: dread da/d25/f4a [0,4194304] 0 2023-12-08T20:27:54.541 INFO:tasks.workunit.client.1.smithi111.stdout:7/539: symlink da/d25/da9/lb6 0 2023-12-08T20:27:54.545 INFO:tasks.workunit.client.1.smithi111.stdout:4/450: dread d8/da/d2c/d1f/d40/f44 [0,4194304] 0 2023-12-08T20:27:54.545 INFO:tasks.workunit.client.1.smithi111.stdout:4/451: fsync d8/da/db/d31/d77/f87 0 2023-12-08T20:27:54.561 INFO:tasks.workunit.client.1.smithi111.stdout:0/773: sync 2023-12-08T20:27:54.561 INFO:tasks.workunit.client.1.smithi111.stdout:8/625: sync 2023-12-08T20:27:54.561 INFO:tasks.workunit.client.1.smithi111.stdout:8/626: chown dd/d35/d42/db4/lc1 11 1 2023-12-08T20:27:54.561 INFO:tasks.workunit.client.1.smithi111.stdout:0/774: chown d1/df/d16/f53 747 1 2023-12-08T20:27:54.562 INFO:tasks.workunit.client.1.smithi111.stdout:8/627: mknod dd/d32/d36/cd7 0 2023-12-08T20:27:54.562 INFO:tasks.workunit.client.1.smithi111.stdout:8/628: write dd/d32/d3d/f6a [411088,52119] 0 2023-12-08T20:27:54.562 INFO:tasks.workunit.client.1.smithi111.stdout:4/452: dwrite d8/da/f66 [4194304,4194304] 0 2023-12-08T20:27:54.562 INFO:tasks.workunit.client.1.smithi111.stdout:4/453: chown d8/d30/l54 85345095 1 2023-12-08T20:27:54.563 INFO:tasks.workunit.client.1.smithi111.stdout:4/454: truncate d8/da/db/fc 2877120 0 2023-12-08T20:27:54.564 INFO:tasks.workunit.client.1.smithi111.stdout:4/455: creat d8/da/d29/d6e/f90 x:0 0 0 2023-12-08T20:27:54.565 INFO:tasks.workunit.client.1.smithi111.stdout:4/456: mkdir d8/da/db/d31/d91 0 2023-12-08T20:27:54.567 INFO:tasks.workunit.client.1.smithi111.stdout:4/457: rename d8/da/d2c/d1f/f6a to d8/da/db/d7f/f92 0 2023-12-08T20:27:54.570 INFO:tasks.workunit.client.1.smithi111.stdout:8/629: dread dd/d35/f3b [0,4194304] 0 2023-12-08T20:27:54.570 INFO:tasks.workunit.client.1.smithi111.stdout:0/775: dread d1/df/f97 [0,4194304] 0 2023-12-08T20:27:54.570 INFO:tasks.workunit.client.1.smithi111.stdout:8/630: symlink dd/d32/d36/d4b/ld8 0 2023-12-08T20:27:54.570 INFO:tasks.workunit.client.1.smithi111.stdout:8/631: chown dd/d2d/l2e 66656 1 2023-12-08T20:27:54.574 INFO:tasks.workunit.client.1.smithi111.stdout:4/458: rename d8/da/db/d31 to d8/da/db/d7f/d93 0 2023-12-08T20:27:54.575 INFO:tasks.workunit.client.1.smithi111.stdout:4/459: creat d8/da/db/d7f/d93/d91/f94 x:0 0 0 2023-12-08T20:27:54.586 INFO:tasks.workunit.client.1.smithi111.stdout:8/632: dwrite dd/d32/d3d/f88 [0,4194304] 0 2023-12-08T20:27:54.586 INFO:tasks.workunit.client.1.smithi111.stdout:8/633: readlink dd/d35/d42/la6 0 2023-12-08T20:27:54.588 INFO:tasks.workunit.client.1.smithi111.stdout:8/634: mknod dd/d35/d7a/dc3/cd9 0 2023-12-08T20:27:54.592 INFO:tasks.workunit.client.1.smithi111.stdout:8/635: dread dd/d2d/f78 [0,4194304] 0 2023-12-08T20:27:54.592 INFO:tasks.workunit.client.1.smithi111.stdout:8/636: chown dd/d2d/d62/c9e 6762 1 2023-12-08T20:27:54.593 INFO:tasks.workunit.client.1.smithi111.stdout:8/637: mknod dd/d32/d3d/d6b/d72/cda 0 2023-12-08T20:27:54.593 INFO:tasks.workunit.client.1.smithi111.stdout:8/638: fsync dd/f15 0 2023-12-08T20:27:54.596 INFO:tasks.workunit.client.1.smithi111.stdout:8/639: write dd/f15 [6173381,15587] 0 2023-12-08T20:27:54.596 INFO:tasks.workunit.client.1.smithi111.stdout:0/776: dwrite d1/d4/d24/f60 [0,4194304] 0 2023-12-08T20:27:54.596 INFO:tasks.workunit.client.1.smithi111.stdout:4/460: dwrite d8/da/db/f4e [0,4194304] 0 2023-12-08T20:27:54.596 INFO:tasks.workunit.client.1.smithi111.stdout:4/461: dread - d8/da/db/f8d zero size 2023-12-08T20:27:54.597 INFO:tasks.workunit.client.1.smithi111.stdout:8/640: mkdir dd/dc9/ddb 0 2023-12-08T20:27:54.602 INFO:tasks.workunit.client.1.smithi111.stdout:0/777: rename d1/df/d44/d37/d5c/d70/ff6 to d1/d2d/d83/dab/f107 0 2023-12-08T20:27:54.602 INFO:tasks.workunit.client.1.smithi111.stdout:0/778: getdents d1/dd/d4a/dcb 0 2023-12-08T20:27:54.603 INFO:tasks.workunit.client.1.smithi111.stdout:0/779: chown d1/dd/d47/f91 533306 1 2023-12-08T20:27:54.603 INFO:tasks.workunit.client.1.smithi111.stdout:0/780: chown d1/d69/d8b/c103 111 1 2023-12-08T20:27:54.603 INFO:tasks.workunit.client.1.smithi111.stdout:0/781: read d1/d4/f55 [3213544,5903] 0 2023-12-08T20:27:54.603 INFO:tasks.workunit.client.1.smithi111.stdout:0/782: chown d1/df/d16/d2c/d7e/f82 24503896 1 2023-12-08T20:27:54.605 INFO:tasks.workunit.client.1.smithi111.stdout:4/462: dread f1 [0,4194304] 0 2023-12-08T20:27:54.608 INFO:tasks.workunit.client.1.smithi111.stdout:8/641: mknod dd/d35/d7a/dc3/cdc 0 2023-12-08T20:27:54.609 INFO:tasks.workunit.client.1.smithi111.stdout:4/463: link d8/l32 d8/d30/d7d/l95 0 2023-12-08T20:27:54.609 INFO:tasks.workunit.client.1.smithi111.stdout:4/464: chown d8/da/f25 4 1 2023-12-08T20:27:54.613 INFO:tasks.workunit.client.1.smithi111.stdout:4/465: link d8/da/db/d7f/d93/f4c d8/da/d29/d6e/f96 0 2023-12-08T20:27:54.616 INFO:tasks.workunit.client.1.smithi111.stdout:0/783: dwrite d1/dd/d47/f94 [0,4194304] 0 2023-12-08T20:27:54.617 INFO:tasks.workunit.client.1.smithi111.stdout:8/642: dread dd/d2d/d8b/d8d/da4/fb1 [0,4194304] 0 2023-12-08T20:27:54.618 INFO:tasks.workunit.client.1.smithi111.stdout:8/643: chown dd/d2d/d8b/d9b/cba 250460 1 2023-12-08T20:27:54.618 INFO:tasks.workunit.client.1.smithi111.stdout:8/644: chown dd/d2d/d62/c74 2267 1 2023-12-08T20:27:54.623 INFO:tasks.workunit.client.1.smithi111.stdout:0/784: dread d1/d4/d3a/f4b [0,4194304] 0 2023-12-08T20:27:54.624 INFO:tasks.workunit.client.1.smithi111.stdout:0/785: mkdir d1/d4/d24/d108 0 2023-12-08T20:27:54.631 INFO:tasks.workunit.client.1.smithi111.stdout:8/645: dwrite dd/d32/d3d/d55/fb0 [0,4194304] 0 2023-12-08T20:27:54.631 INFO:tasks.workunit.client.1.smithi111.stdout:8/646: truncate dd/d32/d36/d4b/f64 772070 0 2023-12-08T20:27:54.633 INFO:tasks.workunit.client.1.smithi111.stdout:8/647: creat dd/d35/d7a/dc3/fdd x:0 0 0 2023-12-08T20:27:54.634 INFO:tasks.workunit.client.1.smithi111.stdout:0/786: dread d1/d4/d3a/d8c/f96 [4194304,4194304] 0 2023-12-08T20:27:54.634 INFO:tasks.workunit.client.1.smithi111.stdout:8/648: link dd/d32/d36/d50/f65 dd/d2d/d8b/fde 0 2023-12-08T20:27:54.636 INFO:tasks.workunit.client.1.smithi111.stdout:0/787: mknod d1/dd/d4a/dc4/c109 0 2023-12-08T20:27:54.637 INFO:tasks.workunit.client.1.smithi111.stdout:8/649: rmdir dd/d32/d36 39 2023-12-08T20:27:54.638 INFO:tasks.workunit.client.1.smithi111.stdout:0/788: mknod d1/df/d16/d2c/d7b/dba/c10a 0 2023-12-08T20:27:54.638 INFO:tasks.workunit.client.1.smithi111.stdout:8/650: rmdir dd/d32/d3d/d6b 39 2023-12-08T20:27:54.639 INFO:tasks.workunit.client.1.smithi111.stdout:8/651: symlink dd/d32/da7/ldf 0 2023-12-08T20:27:54.640 INFO:tasks.workunit.client.1.smithi111.stdout:8/652: truncate dd/f2a 3002430 0 2023-12-08T20:27:54.642 INFO:tasks.workunit.client.1.smithi111.stdout:8/653: link dd/f90 dd/d2d/d62/fe0 0 2023-12-08T20:27:54.643 INFO:tasks.workunit.client.1.smithi111.stdout:8/654: link dd/d32/c38 dd/d2d/d62/ce1 0 2023-12-08T20:27:54.645 INFO:tasks.workunit.client.1.smithi111.stdout:8/655: mkdir dd/d32/de2 0 2023-12-08T20:27:54.646 INFO:tasks.workunit.client.1.smithi111.stdout:8/656: creat dd/d2d/d62/fe3 x:0 0 0 2023-12-08T20:27:54.654 INFO:tasks.workunit.client.1.smithi111.stdout:8/657: dread dd/d35/d7a/fac [0,4194304] 0 2023-12-08T20:27:54.654 INFO:tasks.workunit.client.1.smithi111.stdout:8/658: truncate dd/d32/d36/f7d 961323 0 2023-12-08T20:27:54.655 INFO:tasks.workunit.client.1.smithi111.stdout:8/659: rename dd/c22 to dd/dc9/ddb/ce4 0 2023-12-08T20:27:54.656 INFO:tasks.workunit.client.1.smithi111.stdout:0/789: dwrite d1/f100 [0,4194304] 0 2023-12-08T20:27:54.657 INFO:tasks.workunit.client.1.smithi111.stdout:0/790: read d1/df/d16/d2c/d7e/fe8 [108802,75872] 0 2023-12-08T20:27:54.657 INFO:tasks.workunit.client.1.smithi111.stdout:0/791: read - d1/df/d44/d37/dac/ff9 zero size 2023-12-08T20:27:54.657 INFO:tasks.workunit.client.1.smithi111.stdout:0/792: getdents d1/d4/d24/d46/db7/db9 0 2023-12-08T20:27:54.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.658+0000 7f49cff9b700 1 -- 172.21.15.43:0/1511631694 --> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49ac000bf0 con 0x7f49b406ae40 2023-12-08T20:27:54.661 INFO:tasks.workunit.client.1.smithi111.stdout:0/793: creat d1/d4/d3a/f10b x:0 0 0 2023-12-08T20:27:54.661 INFO:tasks.workunit.client.1.smithi111.stdout:0/794: dread - d1/d69/d8b/f9c zero size 2023-12-08T20:27:54.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.660+0000 7f49be7fc700 1 -- 172.21.15.43:0/1511631694 <== mgr.24407 v2:172.21.15.111:6828/940639390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f49ac000bf0 con 0x7f49b406ae40 2023-12-08T20:27:54.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.664+0000 7f49cff9b700 1 -- 172.21.15.43:0/1511631694 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f49b406ae40 msgr2=0x7f49b406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:54.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.664+0000 7f49cff9b700 1 --2- 172.21.15.43:0/1511631694 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f49b406ae40 0x7f49b406d2f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f49c4006fd0 tx=0x7f49c4008040 comp rx=0 tx=0).stop 2023-12-08T20:27:54.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.664+0000 7f49cff9b700 1 -- 172.21.15.43:0/1511631694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49c80fcac0 msgr2=0x7f49c8110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:54.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.664+0000 7f49cff9b700 1 --2- 172.21.15.43:0/1511631694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49c80fcac0 0x7f49c8110630 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f49b800b3b0 tx=0x7f49b8009e30 comp rx=0 tx=0).stop 2023-12-08T20:27:54.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.664+0000 7f49cff9b700 1 -- 172.21.15.43:0/1511631694 shutdown_connections 2023-12-08T20:27:54.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.664+0000 7f49cff9b700 1 --2- 172.21.15.43:0/1511631694 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f49b406ae40 0x7f49b406d2f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:54.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.664+0000 7f49cff9b700 1 --2- 172.21.15.43:0/1511631694 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49c80fc0e0 0x7f49c810e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:54.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.664+0000 7f49cff9b700 1 --2- 172.21.15.43:0/1511631694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49c80fcac0 0x7f49c8110630 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:54.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.664+0000 7f49cff9b700 1 -- 172.21.15.43:0/1511631694 >> 172.21.15.43:0/1511631694 conn(0x7f49c80f6950 msgr2=0x7f49c80f8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:54.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.664+0000 7f49cff9b700 1 -- 172.21.15.43:0/1511631694 shutdown_connections 2023-12-08T20:27:54.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.664+0000 7f49cff9b700 1 -- 172.21.15.43:0/1511631694 wait complete. 2023-12-08T20:27:54.673 INFO:tasks.workunit.client.1.smithi111.stdout:8/660: dwrite dd/d32/d3d/f85 [0,4194304] 0 2023-12-08T20:27:54.675 INFO:tasks.workunit.client.1.smithi111.stdout:0/795: dread d1/f100 [0,4194304] 0 2023-12-08T20:27:54.675 INFO:tasks.workunit.client.1.smithi111.stdout:0/796: write d1/dd/d47/fda [1038296,119869] 0 2023-12-08T20:27:54.675 INFO:tasks.workunit.client.1.smithi111.stdout:0/797: truncate d1/dd/d47/fe9 355779 0 2023-12-08T20:27:54.675 INFO:tasks.workunit.client.1.smithi111.stdout:8/661: getdents dd/d2d/d62/d8c 0 2023-12-08T20:27:54.679 INFO:tasks.workunit.client.1.smithi111.stdout:0/798: rename d1/df/d44/d37/d5c/l8f to d1/df/dea/l10c 0 2023-12-08T20:27:54.679 INFO:tasks.workunit.client.1.smithi111.stdout:0/799: readlink d1/d4/l2b 0 2023-12-08T20:27:54.681 INFO:tasks.workunit.client.1.smithi111.stdout:0/800: dread d1/df/f3b [4194304,4194304] 0 2023-12-08T20:27:54.681 INFO:tasks.workunit.client.1.smithi111.stdout:2/525: sync 2023-12-08T20:27:54.681 INFO:tasks.workunit.client.1.smithi111.stdout:2/526: write d1/d1d/d22/f2c [2207472,34966] 0 2023-12-08T20:27:54.681 INFO:tasks.workunit.client.1.smithi111.stdout:2/527: fsync d1/d29/d53/f85 0 2023-12-08T20:27:54.681 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:27:54.682 INFO:tasks.workunit.client.1.smithi111.stdout:8/662: rename dd/d32/d3d/f7c to dd/d2d/d62/d83/daa/fe5 0 2023-12-08T20:27:54.684 INFO:tasks.workunit.client.1.smithi111.stdout:0/801: truncate d1/df/d16/d2c/d7e/fe8 114633 0 2023-12-08T20:27:54.684 INFO:tasks.workunit.client.1.smithi111.stdout:0/802: fsync d1/df/d44/d37/d5c/f67 0 2023-12-08T20:27:54.684 INFO:tasks.workunit.client.1.smithi111.stdout:0/803: truncate d1/df/d56/f63 4553789 0 2023-12-08T20:27:54.685 INFO:tasks.workunit.client.1.smithi111.stdout:8/663: link dd/d32/d3d/lbd dd/d35/le6 0 2023-12-08T20:27:54.686 INFO:tasks.workunit.client.1.smithi111.stdout:8/664: mknod dd/d32/ce7 0 2023-12-08T20:27:54.689 INFO:tasks.workunit.client.1.smithi111.stdout:8/665: creat dd/d2d/d8b/d8d/fe8 x:0 0 0 2023-12-08T20:27:54.692 INFO:tasks.workunit.client.1.smithi111.stdout:8/666: rename dd/d35/f3b to dd/d32/d36/d4b/fe9 0 2023-12-08T20:27:54.692 INFO:tasks.workunit.client.1.smithi111.stdout:8/667: chown dd/d32/d3d/d55/f89 325723 1 2023-12-08T20:27:54.692 INFO:tasks.workunit.client.1.smithi111.stdout:8/668: chown dd/d2d/d62/d83/cab 341001456 1 2023-12-08T20:27:54.694 INFO:tasks.workunit.client.1.smithi111.stdout:8/669: rename dd/d2d/d8b/d8d/da4 to dd/d32/dea 0 2023-12-08T20:27:54.694 INFO:tasks.workunit.client.1.smithi111.stdout:8/670: chown dd/d32/d3d/lbd 52041 1 2023-12-08T20:27:54.702 INFO:tasks.workunit.client.1.smithi111.stdout:2/528: dwrite d1/d1d/d1f/d25/d3d/d41/f8b [0,4194304] 0 2023-12-08T20:27:54.703 INFO:tasks.workunit.client.1.smithi111.stdout:0/804: dwrite d1/dd/d47/f91 [0,4194304] 0 2023-12-08T20:27:54.703 INFO:tasks.workunit.client.1.smithi111.stdout:0/805: truncate d1/d69/d8b/fa3 612209 0 2023-12-08T20:27:54.704 INFO:tasks.workunit.client.1.smithi111.stdout:2/529: dread - d1/d1d/d1f/d36/d92/fb2 zero size 2023-12-08T20:27:54.705 INFO:tasks.workunit.client.1.smithi111.stdout:2/530: getdents d1/d1d/d1f/d25/d3d/da2 0 2023-12-08T20:27:54.705 INFO:tasks.workunit.client.1.smithi111.stdout:0/806: read d1/dd/d47/f91 [1933895,16387] 0 2023-12-08T20:27:54.707 INFO:tasks.workunit.client.1.smithi111.stdout:0/807: write d1/df/f3b [2364776,35828] 0 2023-12-08T20:27:54.707 INFO:tasks.workunit.client.1.smithi111.stdout:0/808: stat d1/df/f97 0 2023-12-08T20:27:54.707 INFO:tasks.workunit.client.1.smithi111.stdout:2/531: rename d1/d1d/d1f/d25/d96/lb6 to d1/d29/d53/d91/lc4 0 2023-12-08T20:27:54.707 INFO:tasks.workunit.client.1.smithi111.stdout:0/809: read d1/d4/d3a/f4b [29158,34363] 0 2023-12-08T20:27:54.707 INFO:tasks.workunit.client.1.smithi111.stdout:0/810: stat d1/d4/d24/d46/d49/d7f/fa6 0 2023-12-08T20:27:54.709 INFO:tasks.workunit.client.1.smithi111.stdout:2/532: mkdir d1/d1d/d1f/d25/d3d/d41/db9/dc5 0 2023-12-08T20:27:54.709 INFO:tasks.workunit.client.1.smithi111.stdout:2/533: readlink d1/d1d/d1f/d25/l47 0 2023-12-08T20:27:54.709 INFO:tasks.workunit.client.1.smithi111.stdout:8/671: dwrite dd/d35/f99 [0,4194304] 0 2023-12-08T20:27:54.710 INFO:tasks.workunit.client.1.smithi111.stdout:8/672: write dd/d2d/f31 [345814,112975] 0 2023-12-08T20:27:54.712 INFO:tasks.workunit.client.1.smithi111.stdout:0/811: write d1/dd/f4e [2132259,17004] 0 2023-12-08T20:27:54.712 INFO:tasks.workunit.client.1.smithi111.stdout:0/812: write d1/d69/d8b/f9c [913234,120837] 0 2023-12-08T20:27:54.712 INFO:tasks.workunit.client.1.smithi111.stdout:0/813: dread - d1/d4/d24/d46/d49/d7f/fa6 zero size 2023-12-08T20:27:54.712 INFO:tasks.workunit.client.1.smithi111.stdout:0/814: write d1/d2d/d83/ff3 [345735,95343] 0 2023-12-08T20:27:54.712 INFO:tasks.workunit.client.1.smithi111.stdout:0/815: dread - d1/dd/d47/fbd zero size 2023-12-08T20:27:54.713 INFO:tasks.workunit.client.1.smithi111.stdout:0/816: truncate d1/df/d56/fc7 792121 0 2023-12-08T20:27:54.713 INFO:tasks.workunit.client.1.smithi111.stdout:2/534: write d1/f13 [1209435,76593] 0 2023-12-08T20:27:54.714 INFO:tasks.workunit.client.1.smithi111.stdout:0/817: mknod d1/d4/d24/d46/d49/d7f/d95/db8/c10d 0 2023-12-08T20:27:54.716 INFO:tasks.workunit.client.1.smithi111.stdout:0/818: link d1/d4/d24/d46/d49/lb3 d1/df/d16/d2c/d7b/l10e 0 2023-12-08T20:27:54.716 INFO:tasks.workunit.client.1.smithi111.stdout:0/819: chown d1/dd/c17 2734 1 2023-12-08T20:27:54.716 INFO:tasks.workunit.client.1.smithi111.stdout:8/673: dread dd/fbb [0,4194304] 0 2023-12-08T20:27:54.716 INFO:tasks.workunit.client.1.smithi111.stdout:0/820: write d1/d4/d24/d46/d58/d65/f9a [4376867,80391] 0 2023-12-08T20:27:54.716 INFO:tasks.workunit.client.1.smithi111.stdout:8/674: stat dd/d2d/f33 0 2023-12-08T20:27:54.716 INFO:tasks.workunit.client.1.smithi111.stdout:8/675: write dd/f20 [4437672,74895] 0 2023-12-08T20:27:54.718 INFO:tasks.workunit.client.1.smithi111.stdout:0/821: stat d1/d4/d24/d46/d49/d7f/ddf/cfa 0 2023-12-08T20:27:54.718 INFO:tasks.workunit.client.1.smithi111.stdout:0/822: dread d1/df/d44/d37/f8a [0,4194304] 0 2023-12-08T20:27:54.720 INFO:tasks.workunit.client.1.smithi111.stdout:8/676: link dd/d35/d42/c66 dd/d35/d7a/ceb 0 2023-12-08T20:27:54.720 INFO:tasks.workunit.client.1.smithi111.stdout:8/677: dread - dd/d35/d7a/fa0 zero size 2023-12-08T20:27:54.720 INFO:tasks.workunit.client.1.smithi111.stdout:0/823: mkdir d1/d4/d24/d46/d49/d10f 0 2023-12-08T20:27:54.722 INFO:tasks.workunit.client.1.smithi111.stdout:8/678: creat dd/d32/d36/d50/fec x:0 0 0 2023-12-08T20:27:54.722 INFO:tasks.workunit.client.1.smithi111.stdout:2/535: dread d1/d1d/f2e [0,4194304] 0 2023-12-08T20:27:54.722 INFO:tasks.workunit.client.1.smithi111.stdout:2/536: fdatasync d1/f70 0 2023-12-08T20:27:54.723 INFO:tasks.workunit.client.1.smithi111.stdout:0/824: unlink d1/d4/f55 0 2023-12-08T20:27:54.724 INFO:tasks.workunit.client.1.smithi111.stdout:8/679: symlink dd/d2d/d62/d83/daa/led 0 2023-12-08T20:27:54.725 INFO:tasks.workunit.client.1.smithi111.stdout:8/680: truncate dd/d32/d36/d50/f65 1000788 0 2023-12-08T20:27:54.725 INFO:tasks.workunit.client.1.smithi111.stdout:8/681: fdatasync dd/d32/d36/f7d 0 2023-12-08T20:27:54.725 INFO:tasks.workunit.client.1.smithi111.stdout:2/537: link d1/d1d/d1f/d25/d3d/d41/cab d1/d1d/d68/d73/cc6 0 2023-12-08T20:27:54.726 INFO:tasks.workunit.client.1.smithi111.stdout:0/825: mknod d1/d4/d24/d46/d58/d65/c110 0 2023-12-08T20:27:54.728 INFO:tasks.workunit.client.1.smithi111.stdout:2/538: link d1/d29/d53/d90/f61 d1/d1d/d1f/d25/d3d/d41/db9/dc5/fc7 0 2023-12-08T20:27:54.728 INFO:tasks.workunit.client.1.smithi111.stdout:2/539: fdatasync d1/d1d/d1f/d36/d92/fb2 0 2023-12-08T20:27:54.729 INFO:tasks.workunit.client.1.smithi111.stdout:2/540: creat d1/d29/d53/d90/fc8 x:0 0 0 2023-12-08T20:27:54.730 INFO:tasks.workunit.client.1.smithi111.stdout:0/826: symlink d1/d4/l111 0 2023-12-08T20:27:54.730 INFO:tasks.workunit.client.1.smithi111.stdout:0/827: chown d1/df/dea/l10c 6116736 1 2023-12-08T20:27:54.730 INFO:tasks.workunit.client.1.smithi111.stdout:2/541: rmdir d1/d1d/d1f/d25/d3d/d41/db9/dc5 39 2023-12-08T20:27:54.732 INFO:tasks.workunit.client.1.smithi111.stdout:0/828: symlink d1/d4/d3a/l112 0 2023-12-08T20:27:54.733 INFO:tasks.workunit.client.1.smithi111.stdout:2/542: creat d1/d1d/d1f/d25/fc9 x:0 0 0 2023-12-08T20:27:54.733 INFO:tasks.workunit.client.1.smithi111.stdout:8/682: dread dd/d32/f48 [0,4194304] 0 2023-12-08T20:27:54.737 INFO:tasks.workunit.client.1.smithi111.stdout:0/829: rename d1/d4/d24/d46/d49/d7f/d95/db8/cde to d1/df/d44/d37/d5c/c113 0 2023-12-08T20:27:54.737 INFO:tasks.workunit.client.1.smithi111.stdout:0/830: readlink d1/df/d44/d37/d5c/d70/l72 0 2023-12-08T20:27:54.737 INFO:tasks.workunit.client.1.smithi111.stdout:0/831: read d1/dd/d47/f94 [2620192,36792] 0 2023-12-08T20:27:54.738 INFO:tasks.workunit.client.1.smithi111.stdout:8/683: mknod dd/d35/d7a/dc3/cee 0 2023-12-08T20:27:54.742 INFO:tasks.workunit.client.1.smithi111.stdout:8/684: symlink dd/d35/d42/lef 0 2023-12-08T20:27:54.742 INFO:tasks.workunit.client.1.smithi111.stdout:8/685: stat dd/d2d/d8b 0 2023-12-08T20:27:54.742 INFO:tasks.workunit.client.1.smithi111.stdout:8/686: fsync dd/d32/d36/d4b/f9d 0 2023-12-08T20:27:54.742 INFO:tasks.workunit.client.1.smithi111.stdout:8/687: write dd/d2d/f31 [1852301,12299] 0 2023-12-08T20:27:54.745 INFO:tasks.workunit.client.1.smithi111.stdout:8/688: mkdir dd/dc9/ddb/df0 0 2023-12-08T20:27:54.745 INFO:tasks.workunit.client.1.smithi111.stdout:8/689: getdents dd/d32/de2 0 2023-12-08T20:27:54.752 INFO:tasks.workunit.client.1.smithi111.stdout:0/832: dwrite d1/d4/d24/d46/d49/d6e/fc1 [0,4194304] 0 2023-12-08T20:27:54.756 INFO:tasks.workunit.client.1.smithi111.stdout:8/690: rename dd/d2d/d62/d83/daa to dd/d32/dea/df1 0 2023-12-08T20:27:54.760 INFO:tasks.workunit.client.1.smithi111.stdout:8/691: creat dd/dc9/ddb/ff2 x:0 0 0 2023-12-08T20:27:54.763 INFO:tasks.workunit.client.1.smithi111.stdout:8/692: creat dd/d32/d3d/d55/ff3 x:0 0 0 2023-12-08T20:27:54.763 INFO:tasks.workunit.client.1.smithi111.stdout:8/693: readlink dd/d35/d42/la6 0 2023-12-08T20:27:54.766 INFO:tasks.workunit.client.1.smithi111.stdout:8/694: unlink dd/d2d/d8b/l97 0 2023-12-08T20:27:54.780 INFO:tasks.workunit.client.1.smithi111.stdout:0/833: dwrite d1/d4/d24/f45 [0,4194304] 0 2023-12-08T20:27:54.780 INFO:tasks.workunit.client.1.smithi111.stdout:0/834: write d1/df/d16/d2c/d7e/fe8 [103378,59253] 0 2023-12-08T20:27:54.783 INFO:tasks.workunit.client.1.smithi111.stdout:8/695: dwrite fa [4194304,4194304] 0 2023-12-08T20:27:54.783 INFO:tasks.workunit.client.1.smithi111.stdout:8/696: fdatasync dd/d35/d7a/fa0 0 2023-12-08T20:27:54.784 INFO:tasks.workunit.client.1.smithi111.stdout:0/835: unlink d1/df/c48 0 2023-12-08T20:27:54.803 INFO:tasks.workunit.client.1.smithi111.stdout:8/697: dwrite dd/d32/dea/df1/fe5 [4194304,4194304] 0 2023-12-08T20:27:54.804 INFO:tasks.workunit.client.1.smithi111.stdout:8/698: chown dd/d35/d42/c66 7633009 1 2023-12-08T20:27:54.807 INFO:tasks.workunit.client.1.smithi111.stdout:8/699: creat dd/dc9/ddb/ff4 x:0 0 0 2023-12-08T20:27:54.810 INFO:tasks.workunit.client.1.smithi111.stdout:0/836: dwrite d1/d69/fc5 [0,4194304] 0 2023-12-08T20:27:54.811 INFO:tasks.workunit.client.1.smithi111.stdout:8/700: creat dd/dc9/ff5 x:0 0 0 2023-12-08T20:27:54.814 INFO:tasks.workunit.client.1.smithi111.stdout:0/837: mkdir d1/d4/d24/d108/d114 0 2023-12-08T20:27:54.815 INFO:tasks.workunit.client.1.smithi111.stdout:0/838: write d1/df/d44/d37/d5c/ffc [317942,123232] 0 2023-12-08T20:27:54.815 INFO:tasks.workunit.client.1.smithi111.stdout:0/839: dread - d1/d4/d24/d46/d49/d7f/d95/db8/fe2 zero size 2023-12-08T20:27:54.816 INFO:tasks.workunit.client.1.smithi111.stdout:8/701: link dd/d2d/f31 dd/d2d/d62/d8c/ff6 0 2023-12-08T20:27:54.817 INFO:tasks.workunit.client.1.smithi111.stdout:8/702: read dd/d32/d3d/f44 [585853,25454] 0 2023-12-08T20:27:54.818 INFO:tasks.workunit.client.1.smithi111.stdout:0/840: creat d1/df/d44/d37/dac/dce/f115 x:0 0 0 2023-12-08T20:27:54.824 INFO:tasks.workunit.client.1.smithi111.stdout:9/670: sync 2023-12-08T20:27:54.824 INFO:tasks.workunit.client.1.smithi111.stdout:1/575: sync 2023-12-08T20:27:54.824 INFO:tasks.workunit.client.1.smithi111.stdout:6/376: sync 2023-12-08T20:27:54.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.823+0000 7f9420a00700 1 -- 172.21.15.43:0/2086032601 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f941c0fcbf0 msgr2=0x7f941c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:54.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.823+0000 7f9420a00700 1 --2- 172.21.15.43:0/2086032601 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f941c0fcbf0 0x7f941c0fd000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f940c004940 tx=0x7f940c009e30 comp rx=0 tx=0).stop 2023-12-08T20:27:54.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.824+0000 7f9420a00700 1 -- 172.21.15.43:0/2086032601 shutdown_connections 2023-12-08T20:27:54.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.824+0000 7f9420a00700 1 --2- 172.21.15.43:0/2086032601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f941c0fde00 0x7f941c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:54.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.824+0000 7f9420a00700 1 --2- 172.21.15.43:0/2086032601 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f941c0fcbf0 0x7f941c0fd000 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:54.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.824+0000 7f9420a00700 1 -- 172.21.15.43:0/2086032601 >> 172.21.15.43:0/2086032601 conn(0x7f941c0f82d0 msgr2=0x7f941c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:54.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.824+0000 7f9420a00700 1 -- 172.21.15.43:0/2086032601 shutdown_connections 2023-12-08T20:27:54.826 INFO:tasks.workunit.client.1.smithi111.stdout:1/576: creat d0/d6/d33/d15/d51/d5b/fcc x:0 0 0 2023-12-08T20:27:54.826 INFO:tasks.workunit.client.1.smithi111.stdout:1/577: dread - d0/d6/d33/d60/f9e zero size 2023-12-08T20:27:54.827 INFO:tasks.workunit.client.1.smithi111.stdout:1/578: fsync d0/d6/d33/d15/d51/d2e/d61/d79/f90 0 2023-12-08T20:27:54.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.824+0000 7f9420a00700 1 -- 172.21.15.43:0/2086032601 wait complete. 2023-12-08T20:27:54.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.825+0000 7f9420a00700 1 Processor -- start 2023-12-08T20:27:54.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.825+0000 7f9420a00700 1 -- start start 2023-12-08T20:27:54.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.825+0000 7f9420a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f941c0fcbf0 0x7f941c071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:54.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.825+0000 7f9420a00700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f941c0fde00 0x7f941c06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:54.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.825+0000 7f9420a00700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c070590 con 0x7f941c0fde00 2023-12-08T20:27:54.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.825+0000 7f9420a00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c070700 con 0x7f941c0fcbf0 2023-12-08T20:27:54.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.825+0000 7f9419d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f941c0fde00 0x7f941c06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:54.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.825+0000 7f9419d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f941c0fde00 0x7f941c06ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38442/0 (socket says 172.21.15.43:38442) 2023-12-08T20:27:54.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.825+0000 7f9419d9b700 1 -- 172.21.15.43:0/2264126936 learned_addr learned my addr 172.21.15.43:0/2264126936 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:27:54.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.826+0000 7f9419d9b700 1 -- 172.21.15.43:0/2264126936 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f941c0fcbf0 msgr2=0x7f941c071b10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-08T20:27:54.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.826+0000 7f9419d9b700 1 --2- 172.21.15.43:0/2264126936 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f941c0fcbf0 0x7f941c071b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:54.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.826+0000 7f9419d9b700 1 -- 172.21.15.43:0/2264126936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c005040 con 0x7f941c0fde00 2023-12-08T20:27:54.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.826+0000 7f9419d9b700 1 --2- 172.21.15.43:0/2264126936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f941c0fde00 0x7f941c06ff90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f941000eb40 tx=0x7f941000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:27:54.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.826+0000 7f940affd700 1 -- 172.21.15.43:0/2264126936 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9410007cc0 con 0x7f941c0fde00 2023-12-08T20:27:54.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.827+0000 7f9420a00700 1 -- 172.21.15.43:0/2264126936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941c070980 con 0x7f941c0fde00 2023-12-08T20:27:54.829 INFO:tasks.workunit.client.1.smithi111.stdout:1/579: link d0/d6/d34/l3e d0/d6/d33/d15/d51/d78/lcd 0 2023-12-08T20:27:54.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.826+0000 7f940affd700 1 -- 172.21.15.43:0/2264126936 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f941000f040 con 0x7f941c0fde00 2023-12-08T20:27:54.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.827+0000 7f940affd700 1 -- 172.21.15.43:0/2264126936 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9410009570 con 0x7f941c0fde00 2023-12-08T20:27:54.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.827+0000 7f9420a00700 1 -- 172.21.15.43:0/2264126936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c115500 con 0x7f941c0fde00 2023-12-08T20:27:54.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.828+0000 7f9420a00700 1 -- 172.21.15.43:0/2264126936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941c04bb80 con 0x7f941c0fde00 2023-12-08T20:27:54.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.829+0000 7f940affd700 1 -- 172.21.15.43:0/2264126936 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f94100096d0 con 0x7f941c0fde00 2023-12-08T20:27:54.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.830+0000 7f940affd700 1 --2- 172.21.15.43:0/2264126936 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f940406ae40 0x7f940406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:54.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.830+0000 7f940affd700 1 -- 172.21.15.43:0/2264126936 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f94100893c0 con 0x7f941c0fde00 2023-12-08T20:27:54.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.831+0000 7f941a59c700 1 --2- 172.21.15.43:0/2264126936 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f940406ae40 0x7f940406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:54.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.832+0000 7f941a59c700 1 --2- 172.21.15.43:0/2264126936 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f940406ae40 0x7f940406d2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f940c00b0d0 tx=0x7f940c009e30 comp rx=0 tx=0).ready entity=mgr.24407 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:27:54.836 INFO:tasks.workunit.client.1.smithi111.stdout:6/377: dread d0/d1/f7 [4194304,4194304] 0 2023-12-08T20:27:54.839 INFO:tasks.workunit.client.1.smithi111.stdout:6/378: mknod d0/d1/d27/d56/c73 0 2023-12-08T20:27:54.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:54.838+0000 7f940affd700 1 -- 172.21.15.43:0/2264126936 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f941004ece0 con 0x7f941c0fde00 2023-12-08T20:27:54.843 INFO:tasks.workunit.client.1.smithi111.stdout:6/379: write d0/f12 [2747973,11575] 0 2023-12-08T20:27:54.843 INFO:tasks.workunit.client.1.smithi111.stdout:9/671: dwrite d2/d8/dd/d56/f73 [0,4194304] 0 2023-12-08T20:27:54.843 INFO:tasks.workunit.client.1.smithi111.stdout:9/672: dread - d2/d8/dd/d1a/d74/fdb zero size 2023-12-08T20:27:54.843 INFO:tasks.workunit.client.1.smithi111.stdout:9/673: stat d2/d8/dd/d1a/d1e/d2d/d35/f6a 0 2023-12-08T20:27:54.843 INFO:tasks.workunit.client.1.smithi111.stdout:8/703: dwrite dd/d32/d36/f7d [0,4194304] 0 2023-12-08T20:27:54.844 INFO:tasks.workunit.client.1.smithi111.stdout:6/380: write d0/d1b/f1d [1032871,8351] 0 2023-12-08T20:27:54.844 INFO:tasks.workunit.client.1.smithi111.stdout:6/381: stat d0/d1/d27/f40 0 2023-12-08T20:27:54.844 INFO:tasks.workunit.client.1.smithi111.stdout:6/382: write d0/d1b/f49 [1187369,122785] 0 2023-12-08T20:27:54.853 INFO:tasks.workunit.client.1.smithi111.stdout:1/580: dwrite d0/d6/d47/f50 [4194304,4194304] 0 2023-12-08T20:27:54.853 INFO:tasks.workunit.client.1.smithi111.stdout:1/581: truncate d0/d6/d33/d15/d51/d5b/fb3 347904 0 2023-12-08T20:27:54.861 INFO:tasks.workunit.client.1.smithi111.stdout:8/704: dread dd/f2b [0,4194304] 0 2023-12-08T20:27:54.863 INFO:tasks.workunit.client.1.smithi111.stdout:8/705: creat dd/d35/d7a/ff7 x:0 0 0 2023-12-08T20:27:54.863 INFO:tasks.workunit.client.1.smithi111.stdout:6/383: dread d0/d1b/f35 [0,4194304] 0 2023-12-08T20:27:54.867 INFO:tasks.workunit.client.1.smithi111.stdout:6/384: read d0/d1a/f31 [7692215,46346] 0 2023-12-08T20:27:54.868 INFO:tasks.workunit.client.1.smithi111.stdout:6/385: mknod d0/d1b/c74 0 2023-12-08T20:27:54.872 INFO:tasks.workunit.client.1.smithi111.stdout:6/386: write d0/f13 [787795,46118] 0 2023-12-08T20:27:54.874 INFO:tasks.workunit.client.1.smithi111.stdout:1/582: dwrite d0/d6/d33/d15/f8d [0,4194304] 0 2023-12-08T20:27:54.875 INFO:tasks.workunit.client.1.smithi111.stdout:1/583: readlink d0/d6/d33/d15/d51/d78/l7a 0 2023-12-08T20:27:54.875 INFO:tasks.workunit.client.1.smithi111.stdout:1/584: chown d0/d6/d33/d60/l83 81826877 1 2023-12-08T20:27:54.875 INFO:tasks.workunit.client.1.smithi111.stdout:9/674: dwrite d2/d8/dd/d56/fa0 [0,4194304] 0 2023-12-08T20:27:54.876 INFO:tasks.workunit.client.1.smithi111.stdout:6/387: rename d0/f55 to d0/d1/d1e/f75 0 2023-12-08T20:27:54.884 INFO:tasks.workunit.client.1.smithi111.stdout:6/388: write d0/d1/d1e/f2b [3713233,77433] 0 2023-12-08T20:27:54.884 INFO:tasks.workunit.client.1.smithi111.stdout:6/389: chown d0/d1/d1e/f61 22 1 2023-12-08T20:27:54.907 INFO:tasks.workunit.client.1.smithi111.stdout:8/706: dwrite dd/d2d/f78 [0,4194304] 0 2023-12-08T20:27:54.908 INFO:tasks.workunit.client.1.smithi111.stdout:9/675: dwrite d2/d8/dd/d1a/d1e/d2d/d35/d88/f99 [0,4194304] 0 2023-12-08T20:27:54.908 INFO:tasks.workunit.client.1.smithi111.stdout:6/390: dwrite d0/d1/f65 [0,4194304] 0 2023-12-08T20:27:54.908 INFO:tasks.workunit.client.1.smithi111.stdout:1/585: dwrite d0/d6/d33/d15/d51/d2e/f69 [0,4194304] 0 2023-12-08T20:27:54.908 INFO:tasks.workunit.client.1.smithi111.stdout:1/586: read d0/d6/d34/f52 [1078628,3628] 0 2023-12-08T20:27:54.908 INFO:tasks.workunit.client.1.smithi111.stdout:1/587: rename d0/d6/d33 to d0/d6/d33/d6c/d75/dce 22 2023-12-08T20:27:54.911 INFO:tasks.workunit.client.1.smithi111.stdout:9/676: mknod d2/d8/d8c/dbb/cf2 0 2023-12-08T20:27:54.917 INFO:tasks.workunit.client.1.smithi111.stdout:1/588: creat d0/d6/d33/d15/d51/d5b/d5e/d86/dab/fcf x:0 0 0 2023-12-08T20:27:54.918 INFO:tasks.workunit.client.1.smithi111.stdout:9/677: symlink d2/d8/dd/d1a/d1e/lf3 0 2023-12-08T20:27:54.921 INFO:tasks.workunit.client.1.smithi111.stdout:1/589: creat d0/fd0 x:0 0 0 2023-12-08T20:27:54.922 INFO:tasks.workunit.client.1.smithi111.stdout:1/590: fdatasync d0/d6/d34/f52 0 2023-12-08T20:27:54.922 INFO:tasks.workunit.client.1.smithi111.stdout:1/591: truncate d0/d6/d33/d15/d51/d5b/d5e/d86/fc5 514592 0 2023-12-08T20:27:54.922 INFO:tasks.workunit.client.1.smithi111.stdout:1/592: fdatasync d0/f2f 0 2023-12-08T20:27:54.923 INFO:tasks.workunit.client.1.smithi111.stdout:9/678: rename d2/d8/dd/d1a/d1e/d2d/d35/d6b/fef to d2/d8/dd/d1a/ff4 0 2023-12-08T20:27:54.925 INFO:tasks.workunit.client.1.smithi111.stdout:1/593: creat d0/d6/d33/d8b/db5/fd1 x:0 0 0 2023-12-08T20:27:54.926 INFO:tasks.workunit.client.1.smithi111.stdout:8/707: dwrite dd/d35/f51 [0,4194304] 0 2023-12-08T20:27:54.926 INFO:tasks.workunit.client.1.smithi111.stdout:8/708: dread - dd/d2d/d62/fcd zero size 2023-12-08T20:27:54.926 INFO:tasks.workunit.client.1.smithi111.stdout:6/391: dwrite d0/d1/d27/f2d [0,4194304] 0 2023-12-08T20:27:54.927 INFO:tasks.workunit.client.1.smithi111.stdout:1/594: creat d0/d6/d33/d6c/da1/fd2 x:0 0 0 2023-12-08T20:27:54.928 INFO:tasks.workunit.client.1.smithi111.stdout:1/595: dread d0/d6/d33/d15/d51/d2e/d61/f93 [0,4194304] 0 2023-12-08T20:27:54.928 INFO:tasks.workunit.client.1.smithi111.stdout:1/596: chown d0/d6/d33/lc4 2138490099 1 2023-12-08T20:27:54.931 INFO:tasks.workunit.client.1.smithi111.stdout:6/392: creat d0/d1/d27/d56/f76 x:0 0 0 2023-12-08T20:27:54.931 INFO:tasks.workunit.client.1.smithi111.stdout:6/393: chown d0/d1/c21 1 1 2023-12-08T20:27:54.931 INFO:tasks.workunit.client.1.smithi111.stdout:6/394: chown d0/d1/d27/d36/c6c 25127 1 2023-12-08T20:27:54.931 INFO:tasks.workunit.client.1.smithi111.stdout:6/395: chown d0/d1/d1e/f61 4010914 1 2023-12-08T20:27:54.932 INFO:tasks.workunit.client.1.smithi111.stdout:6/396: fsync d0/f32 0 2023-12-08T20:27:54.932 INFO:tasks.workunit.client.1.smithi111.stdout:6/397: stat d0/d1a/c3f 0 2023-12-08T20:27:54.933 INFO:tasks.workunit.client.1.smithi111.stdout:9/679: dread d2/d8/dd/d1a/f80 [0,4194304] 0 2023-12-08T20:27:54.934 INFO:tasks.workunit.client.1.smithi111.stdout:6/398: rename d0/d1/d27/c3d to d0/d1/d27/c77 0 2023-12-08T20:27:54.934 INFO:tasks.workunit.client.1.smithi111.stdout:9/680: write d2/d8/dd/d1a/d1e/d2d/d4a/d62/fd2 [1670152,47387] 0 2023-12-08T20:27:54.936 INFO:tasks.workunit.client.1.smithi111.stdout:6/399: symlink d0/d1/d1e/l78 0 2023-12-08T20:27:54.939 INFO:tasks.workunit.client.1.smithi111.stdout:9/681: mknod d2/d8/dd/d1a/d1e/d2d/d35/d88/cf5 0 2023-12-08T20:27:54.939 INFO:tasks.workunit.client.1.smithi111.stdout:9/682: truncate d2/d8/dd/d56/fe9 960676 0 2023-12-08T20:27:54.942 INFO:tasks.workunit.client.1.smithi111.stdout:6/400: mknod d0/d68/c79 0 2023-12-08T20:27:54.945 INFO:tasks.workunit.client.1.smithi111.stdout:5/706: sync 2023-12-08T20:27:54.945 INFO:tasks.workunit.client.1.smithi111.stdout:3/501: sync 2023-12-08T20:27:54.945 INFO:tasks.workunit.client.1.smithi111.stdout:3/502: truncate d2/d3/d13/d36/d69/d70/f66 549871 0 2023-12-08T20:27:54.950 INFO:tasks.workunit.client.1.smithi111.stdout:5/707: truncate d3/d12/fb9 1919708 0 2023-12-08T20:27:54.950 INFO:tasks.workunit.client.1.smithi111.stdout:5/708: write d3/d8d/f92 [739105,54237] 0 2023-12-08T20:27:54.952 INFO:tasks.workunit.client.1.smithi111.stdout:3/503: creat d2/f9c x:0 0 0 2023-12-08T20:27:54.952 INFO:tasks.workunit.client.1.smithi111.stdout:3/504: truncate d2/d3/d13/d36/d69/d70/f90 494716 0 2023-12-08T20:27:54.952 INFO:tasks.workunit.client.1.smithi111.stdout:3/505: dread - d2/d12/d2e/f74 zero size 2023-12-08T20:27:54.954 INFO:tasks.workunit.client.1.smithi111.stdout:5/709: dread d3/d6d/f81 [0,4194304] 0 2023-12-08T20:27:54.956 INFO:tasks.workunit.client.1.smithi111.stdout:3/506: dread d2/d15/d17/f35 [0,4194304] 0 2023-12-08T20:27:54.956 INFO:tasks.workunit.client.1.smithi111.stdout:3/507: dread - d2/d12/d4a/f6f zero size 2023-12-08T20:27:54.956 INFO:tasks.workunit.client.1.smithi111.stdout:5/710: creat d3/d12/d67/ddf/ff3 x:0 0 0 2023-12-08T20:27:54.957 INFO:tasks.workunit.client.1.smithi111.stdout:1/597: dwrite d0/d6/d33/d15/d51/d78/fba [0,4194304] 0 2023-12-08T20:27:54.957 INFO:tasks.workunit.client.1.smithi111.stdout:1/598: write d0/d4d/f8c [1560459,92291] 0 2023-12-08T20:27:54.958 INFO:tasks.workunit.client.1.smithi111.stdout:8/709: dwrite dd/d32/d3d/d6b/f98 [0,4194304] 0 2023-12-08T20:27:54.959 INFO:tasks.workunit.client.1.smithi111.stdout:3/508: mknod d2/d3/d13/d36/d69/d70/c9d 0 2023-12-08T20:27:54.959 INFO:tasks.workunit.client.1.smithi111.stdout:3/509: truncate d2/d12/d2e/f74 179308 0 2023-12-08T20:27:54.961 INFO:tasks.workunit.client.1.smithi111.stdout:5/711: creat d3/d4/d7/ff4 x:0 0 0 2023-12-08T20:27:54.966 INFO:tasks.workunit.client.1.smithi111.stdout:6/401: dwrite d0/f4a [0,4194304] 0 2023-12-08T20:27:54.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:54 smithi111 ceph-mon[121341]: pgmap v18: 65 pgs: 65 active+clean; 717 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 49 MiB/s rd, 84 MiB/s wr, 558 op/s 2023-12-08T20:27:54.971 INFO:tasks.workunit.client.1.smithi111.stdout:8/710: mkdir dd/dc9/ddb/df8 0 2023-12-08T20:27:54.973 INFO:tasks.workunit.client.1.smithi111.stdout:3/510: symlink d2/d3/d13/d36/d69/l9e 0 2023-12-08T20:27:54.973 INFO:tasks.workunit.client.1.smithi111.stdout:3/511: write d2/d3/d13/d36/f3e [4699726,68091] 0 2023-12-08T20:27:54.973 INFO:tasks.workunit.client.1.smithi111.stdout:3/512: readlink d2/d15/d17/d25/l39 0 2023-12-08T20:27:54.974 INFO:tasks.workunit.client.1.smithi111.stdout:5/712: stat d3/d4/d4a/d21/c35 0 2023-12-08T20:27:54.976 INFO:tasks.workunit.client.1.smithi111.stdout:1/599: dwrite d0/d6/d33/d15/d51/d2e/f69 [0,4194304] 0 2023-12-08T20:27:54.977 INFO:tasks.workunit.client.1.smithi111.stdout:6/402: getdents d0/d1 0 2023-12-08T20:27:54.979 INFO:tasks.workunit.client.1.smithi111.stdout:8/711: mkdir dd/dc9/ddb/df9 0 2023-12-08T20:27:54.982 INFO:tasks.workunit.client.1.smithi111.stdout:3/513: mkdir d2/d15/d17/d5e/d9f 0 2023-12-08T20:27:54.983 INFO:tasks.workunit.client.1.smithi111.stdout:5/713: symlink d3/d4/d7/d2c/d84/lf5 0 2023-12-08T20:27:54.983 INFO:tasks.workunit.client.1.smithi111.stdout:7/540: sync 2023-12-08T20:27:54.983 INFO:tasks.workunit.client.1.smithi111.stdout:4/466: sync 2023-12-08T20:27:54.983 INFO:tasks.workunit.client.1.smithi111.stdout:2/543: sync 2023-12-08T20:27:54.983 INFO:tasks.workunit.client.1.smithi111.stdout:2/544: fdatasync d1/d1d/d22/f71 0 2023-12-08T20:27:54.983 INFO:tasks.workunit.client.1.smithi111.stdout:2/545: fsync d1/d1d/f5d 0 2023-12-08T20:27:54.983 INFO:tasks.workunit.client.1.smithi111.stdout:4/467: write d8/da/db/d7f/d93/d91/f94 [543989,44692] 0 2023-12-08T20:27:54.983 INFO:tasks.workunit.client.1.smithi111.stdout:2/546: write d1/d29/d53/f85 [308240,66502] 0 2023-12-08T20:27:54.984 INFO:tasks.workunit.client.1.smithi111.stdout:7/541: write da/d25/d26/d32/f90 [69955,16765] 0 2023-12-08T20:27:54.984 INFO:tasks.workunit.client.1.smithi111.stdout:1/600: unlink d0/d6/d33/d15/d51/d5b/d5e/d86/fc5 0 2023-12-08T20:27:54.984 INFO:tasks.workunit.client.1.smithi111.stdout:1/601: stat d0/d6/d33/d15/d51/c3b 0 2023-12-08T20:27:54.985 INFO:tasks.workunit.client.1.smithi111.stdout:1/602: truncate d0/d8e/fc7 924618 0 2023-12-08T20:27:54.985 INFO:tasks.workunit.client.1.smithi111.stdout:6/403: dread d0/d1/d27/f5c [0,4194304] 0 2023-12-08T20:27:54.985 INFO:tasks.workunit.client.1.smithi111.stdout:6/404: chown d0/d1a/f1f 27 1 2023-12-08T20:27:54.986 INFO:tasks.workunit.client.1.smithi111.stdout:8/712: rename dd/dc9/ddb/ff2 to dd/d2d/d8b/d8d/ffa 0 2023-12-08T20:27:54.989 INFO:tasks.workunit.client.1.smithi111.stdout:3/514: link d2/d12/d2e/l3f d2/d15/d17/la0 0 2023-12-08T20:27:54.989 INFO:tasks.workunit.client.1.smithi111.stdout:3/515: fdatasync d2/d15/d17/d25/d4e/f61 0 2023-12-08T20:27:54.989 INFO:tasks.workunit.client.1.smithi111.stdout:3/516: stat d2/d15/d17/f94 0 2023-12-08T20:27:54.990 INFO:tasks.workunit.client.1.smithi111.stdout:5/714: unlink d3/d12/f87 0 2023-12-08T20:27:54.993 INFO:tasks.workunit.client.1.smithi111.stdout:4/468: unlink d8/d30/d7d/l95 0 2023-12-08T20:27:54.994 INFO:tasks.workunit.client.1.smithi111.stdout:4/469: write d8/d30/f49 [101812,59053] 0 2023-12-08T20:27:54.994 INFO:tasks.workunit.client.1.smithi111.stdout:4/470: dread - d8/d30/f82 zero size 2023-12-08T20:27:54.996 INFO:tasks.workunit.client.1.smithi111.stdout:7/542: symlink da/d25/d26/d32/d3e/lb7 0 2023-12-08T20:27:54.996 INFO:tasks.workunit.client.1.smithi111.stdout:2/547: dwrite d1/d1d/d22/f2c [0,4194304] 0 2023-12-08T20:27:54.997 INFO:tasks.workunit.client.1.smithi111.stdout:2/548: chown d1/d1d/d22/d30/cae 78777545 1 2023-12-08T20:27:54.997 INFO:tasks.workunit.client.1.smithi111.stdout:2/549: write d1/d1d/d68/d73/f9b [62054,1874] 0 2023-12-08T20:27:54.997 INFO:tasks.workunit.client.1.smithi111.stdout:6/405: mkdir d0/d1b/d7a 0 2023-12-08T20:27:54.997 INFO:tasks.workunit.client.1.smithi111.stdout:6/406: write d0/f32 [2131820,70553] 0 2023-12-08T20:27:54.999 INFO:tasks.workunit.client.1.smithi111.stdout:1/603: rename d0/d6/d33/d15/d51/d78/c7d to d0/d4d/cd3 0 2023-12-08T20:27:54.999 INFO:tasks.workunit.client.1.smithi111.stdout:7/543: write da/d25/d26/f98 [7307850,4529] 0 2023-12-08T20:27:55.000 INFO:tasks.workunit.client.1.smithi111.stdout:5/715: creat d3/d4/d7/d36/d82/ff6 x:0 0 0 2023-12-08T20:27:55.000 INFO:tasks.workunit.client.1.smithi111.stdout:5/716: readlink d3/d4/d7/d36/d64/d8a/la6 0 2023-12-08T20:27:55.001 INFO:tasks.workunit.client.1.smithi111.stdout:4/471: mkdir d8/d30/d97 0 2023-12-08T20:27:55.002 INFO:tasks.workunit.client.1.smithi111.stdout:4/472: fdatasync d8/da/d2c/d1f/d2b/f61 0 2023-12-08T20:27:55.002 INFO:tasks.workunit.client.1.smithi111.stdout:4/473: truncate d8/da/db/f8d 481742 0 2023-12-08T20:27:55.002 INFO:tasks.workunit.client.1.smithi111.stdout:4/474: readlink d8/da/d2c/d1f/d2b/l47 0 2023-12-08T20:27:55.002 INFO:tasks.workunit.client.1.smithi111.stdout:4/475: write d8/da/db/d7f/d93/d77/f6c [1482967,65300] 0 2023-12-08T20:27:55.002 INFO:tasks.workunit.client.1.smithi111.stdout:6/407: creat d0/d1b/f7b x:0 0 0 2023-12-08T20:27:55.002 INFO:tasks.workunit.client.1.smithi111.stdout:7/544: dread da/f46 [0,4194304] 0 2023-12-08T20:27:55.003 INFO:tasks.workunit.client.1.smithi111.stdout:1/604: mkdir d0/d8e/dd4 0 2023-12-08T20:27:55.004 INFO:tasks.workunit.client.1.smithi111.stdout:5/717: write d3/d4/d4a/f5f [1447306,1028] 0 2023-12-08T20:27:55.005 INFO:tasks.workunit.client.1.smithi111.stdout:8/713: unlink dd/d32/d3d/d6b/l8f 0 2023-12-08T20:27:55.006 INFO:tasks.workunit.client.1.smithi111.stdout:4/476: write d8/d30/f3c [3853008,5043] 0 2023-12-08T20:27:55.006 INFO:tasks.workunit.client.1.smithi111.stdout:1/605: dread d0/d4d/fb1 [0,4194304] 0 2023-12-08T20:27:55.009 INFO:tasks.workunit.client.1.smithi111.stdout:3/517: dwrite d2/d3/d13/d36/d44/d8f/f91 [0,4194304] 0 2023-12-08T20:27:55.010 INFO:tasks.workunit.client.1.smithi111.stdout:7/545: truncate da/d13/f49 733980 0 2023-12-08T20:27:55.010 INFO:tasks.workunit.client.1.smithi111.stdout:5/718: mknod d3/d4/d7/d36/d82/cf7 0 2023-12-08T20:27:55.011 INFO:tasks.workunit.client.1.smithi111.stdout:8/714: creat dd/d35/d7a/ffb x:0 0 0 2023-12-08T20:27:55.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:54 smithi043 ceph-mon[111966]: pgmap v18: 65 pgs: 65 active+clean; 717 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 49 MiB/s rd, 84 MiB/s wr, 558 op/s 2023-12-08T20:27:55.013 INFO:tasks.workunit.client.1.smithi111.stdout:4/477: rmdir d8/d30 39 2023-12-08T20:27:55.014 INFO:tasks.workunit.client.1.smithi111.stdout:6/408: dread d0/f12 [0,4194304] 0 2023-12-08T20:27:55.016 INFO:tasks.workunit.client.1.smithi111.stdout:1/606: unlink d0/d6/d33/d15/d51/f43 0 2023-12-08T20:27:55.019 INFO:tasks.workunit.client.1.smithi111.stdout:1/607: dread d0/d6/d34/f5f [0,4194304] 0 2023-12-08T20:27:55.019 INFO:tasks.workunit.client.1.smithi111.stdout:1/608: truncate d0/d6/d34/f82 1539304 0 2023-12-08T20:27:55.019 INFO:tasks.workunit.client.1.smithi111.stdout:4/478: dread d8/da/d2c/d1f/f6f [0,4194304] 0 2023-12-08T20:27:55.019 INFO:tasks.workunit.client.1.smithi111.stdout:4/479: write d8/da/db/d7f/f5a [1220833,4811] 0 2023-12-08T20:27:55.031 INFO:tasks.workunit.client.1.smithi111.stdout:7/546: dwrite da/d25/faf [0,4194304] 0 2023-12-08T20:27:55.034 INFO:tasks.workunit.client.1.smithi111.stdout:5/719: dwrite d3/d4/d7/d2c/f31 [0,4194304] 0 2023-12-08T20:27:55.035 INFO:tasks.workunit.client.1.smithi111.stdout:4/480: dread d8/da/d2c/d1f/d2b/f3d [0,4194304] 0 2023-12-08T20:27:55.037 INFO:tasks.workunit.client.1.smithi111.stdout:3/518: getdents d2/d15/d17/d25 0 2023-12-08T20:27:55.038 INFO:tasks.workunit.client.1.smithi111.stdout:3/519: dread - d2/d12/d4a/f6f zero size 2023-12-08T20:27:55.038 INFO:tasks.workunit.client.1.smithi111.stdout:3/520: chown d2/d3/d13/d36/d44 1371813 1 2023-12-08T20:27:55.038 INFO:tasks.workunit.client.1.smithi111.stdout:3/521: chown d2/d3/d6/f10 31280 1 2023-12-08T20:27:55.038 INFO:tasks.workunit.client.1.smithi111.stdout:3/522: readlink d2/d15/d17/d25/d4e/l85 0 2023-12-08T20:27:55.039 INFO:tasks.workunit.client.1.smithi111.stdout:8/715: creat dd/d2d/d8b/ffc x:0 0 0 2023-12-08T20:27:55.040 INFO:tasks.workunit.client.1.smithi111.stdout:6/409: mknod d0/d1b/d7a/c7c 0 2023-12-08T20:27:55.040 INFO:tasks.workunit.client.1.smithi111.stdout:6/410: dread - d0/d1/d27/d6e/f70 zero size 2023-12-08T20:27:55.041 INFO:tasks.workunit.client.1.smithi111.stdout:1/609: rmdir d0/d6/d33/d15/d51/d5b/d5e/d86/dab 39 2023-12-08T20:27:55.049 INFO:tasks.workunit.client.1.smithi111.stdout:2/550: truncate d1/d1d/d22/f2c 1981455 0 2023-12-08T20:27:55.050 INFO:tasks.workunit.client.1.smithi111.stdout:7/547: rename da/d13/d21 to da/d25/da9/db8 0 2023-12-08T20:27:55.050 INFO:tasks.workunit.client.1.smithi111.stdout:7/548: fdatasync da/d25/f4a 0 2023-12-08T20:27:55.050 INFO:tasks.workunit.client.1.smithi111.stdout:2/551: write d1/d29/f95 [4697453,102766] 0 2023-12-08T20:27:55.050 INFO:tasks.workunit.client.1.smithi111.stdout:2/552: read - d1/d29/d53/d91/f9e zero size 2023-12-08T20:27:55.051 INFO:tasks.workunit.client.1.smithi111.stdout:5/720: truncate d3/d4/d7/d29/d73/d90/fdc 1722649 0 2023-12-08T20:27:55.052 INFO:tasks.workunit.client.1.smithi111.stdout:4/481: creat d8/da/d2c/d1f/d2b/f98 x:0 0 0 2023-12-08T20:27:55.055 INFO:tasks.workunit.client.1.smithi111.stdout:3/523: symlink d2/d3/d13/d36/d44/la1 0 2023-12-08T20:27:55.056 INFO:tasks.workunit.client.1.smithi111.stdout:8/716: creat dd/dc9/ddb/df0/ffd x:0 0 0 2023-12-08T20:27:55.057 INFO:tasks.workunit.client.1.smithi111.stdout:8/717: readlink dd/d32/dea/df1/led 0 2023-12-08T20:27:55.057 INFO:tasks.workunit.client.1.smithi111.stdout:8/718: dread - dd/d35/d7a/dc3/fdd zero size 2023-12-08T20:27:55.057 INFO:tasks.workunit.client.1.smithi111.stdout:8/719: readlink dd/d2d/l2e 0 2023-12-08T20:27:55.057 INFO:tasks.workunit.client.1.smithi111.stdout:8/720: chown dd/c1d 43931 1 2023-12-08T20:27:55.059 INFO:tasks.workunit.client.1.smithi111.stdout:2/553: unlink d1/ca9 0 2023-12-08T20:27:55.061 INFO:tasks.workunit.client.1.smithi111.stdout:5/721: truncate d3/d4/f5b 612456 0 2023-12-08T20:27:55.066 INFO:tasks.workunit.client.1.smithi111.stdout:8/721: getdents dd/d35/d7a/dc3 0 2023-12-08T20:27:55.068 INFO:tasks.workunit.client.1.smithi111.stdout:3/524: dread d2/d3/f16 [0,4194304] 0 2023-12-08T20:27:55.068 INFO:tasks.workunit.client.1.smithi111.stdout:3/525: truncate d2/d15/d17/d5e/f96 1041291 0 2023-12-08T20:27:55.069 INFO:tasks.workunit.client.1.smithi111.stdout:2/554: creat d1/d1d/d68/d73/fca x:0 0 0 2023-12-08T20:27:55.069 INFO:tasks.workunit.client.1.smithi111.stdout:6/411: dwrite d0/d1/d27/f5f [0,4194304] 0 2023-12-08T20:27:55.069 INFO:tasks.workunit.client.1.smithi111.stdout:6/412: truncate d0/d1b/f49 1578789 0 2023-12-08T20:27:55.069 INFO:tasks.workunit.client.1.smithi111.stdout:7/549: dwrite da/d25/d26/d32/d3e/fac [0,4194304] 0 2023-12-08T20:27:55.070 INFO:tasks.workunit.client.1.smithi111.stdout:5/722: creat d3/d12/dbd/ff8 x:0 0 0 2023-12-08T20:27:55.073 INFO:tasks.workunit.client.1.smithi111.stdout:8/722: rename dd/d32/d36/f94 to dd/d2d/d62/d83/ffe 0 2023-12-08T20:27:55.075 INFO:tasks.workunit.client.1.smithi111.stdout:3/526: creat d2/d12/fa2 x:0 0 0 2023-12-08T20:27:55.075 INFO:tasks.workunit.client.1.smithi111.stdout:3/527: chown d2/d3/d1e/d93 9689960 1 2023-12-08T20:27:55.076 INFO:tasks.workunit.client.1.smithi111.stdout:2/555: mknod d1/d1d/d1f/d25/ccb 0 2023-12-08T20:27:55.077 INFO:tasks.workunit.client.1.smithi111.stdout:2/556: chown d1/d29/d4e/lad 8 1 2023-12-08T20:27:55.077 INFO:tasks.workunit.client.1.smithi111.stdout:2/557: chown d1/d29/d4e/c84 33 1 2023-12-08T20:27:55.080 INFO:tasks.workunit.client.1.smithi111.stdout:3/528: write d2/d15/d17/d25/d4e/f73 [3461843,45272] 0 2023-12-08T20:27:55.080 INFO:tasks.workunit.client.1.smithi111.stdout:3/529: chown d2/d15/d17/d25 1428794 1 2023-12-08T20:27:55.080 INFO:tasks.workunit.client.1.smithi111.stdout:7/550: mknod da/d25/d26/d32/d3e/d97/cb9 0 2023-12-08T20:27:55.081 INFO:tasks.workunit.client.1.smithi111.stdout:7/551: chown da/da7 95465673 1 2023-12-08T20:27:55.082 INFO:tasks.workunit.client.1.smithi111.stdout:0/841: sync 2023-12-08T20:27:55.082 INFO:tasks.workunit.client.1.smithi111.stdout:0/842: stat d1/df/d16/f53 0 2023-12-08T20:27:55.082 INFO:tasks.workunit.client.1.smithi111.stdout:0/843: fdatasync d1/d4/f35 0 2023-12-08T20:27:55.083 INFO:tasks.workunit.client.1.smithi111.stdout:5/723: stat d3/d12/cb0 0 2023-12-08T20:27:55.084 INFO:tasks.workunit.client.1.smithi111.stdout:6/413: dwrite d0/d1/d27/d56/f76 [0,4194304] 0 2023-12-08T20:27:55.085 INFO:tasks.workunit.client.1.smithi111.stdout:2/558: rename d1/d1d/d55/f4a to d1/fcc 0 2023-12-08T20:27:55.094 INFO:tasks.workunit.client.1.smithi111.stdout:2/559: getdents d1/d29/d53 0 2023-12-08T20:27:55.094 INFO:tasks.workunit.client.1.smithi111.stdout:4/482: rmdir d8/da/d2c/d1f 39 2023-12-08T20:27:55.094 INFO:tasks.workunit.client.1.smithi111.stdout:4/483: truncate d8/da/d29/f33 1104527 0 2023-12-08T20:27:55.098 INFO:tasks.workunit.client.1.smithi111.stdout:2/560: creat d1/d1d/d22/d30/fcd x:0 0 0 2023-12-08T20:27:55.102 INFO:tasks.workunit.client.1.smithi111.stdout:2/561: mkdir d1/d29/d53/d91/dce 0 2023-12-08T20:27:55.102 INFO:tasks.workunit.client.1.smithi111.stdout:4/484: creat d8/da/d29/d6e/f99 x:0 0 0 2023-12-08T20:27:55.102 INFO:tasks.workunit.client.1.smithi111.stdout:2/562: write d1/d29/d53/d91/fbb [103909,34774] 0 2023-12-08T20:27:55.106 INFO:tasks.workunit.client.1.smithi111.stdout:4/485: creat d8/da/d29/f9a x:0 0 0 2023-12-08T20:27:55.107 INFO:tasks.workunit.client.1.smithi111.stdout:4/486: chown d8/da/db/d7f/d93 174 1 2023-12-08T20:27:55.107 INFO:tasks.workunit.client.1.smithi111.stdout:6/414: dread d0/f12 [4194304,4194304] 0 2023-12-08T20:27:55.107 INFO:tasks.workunit.client.1.smithi111.stdout:6/415: fsync d0/d1b/f47 0 2023-12-08T20:27:55.109 INFO:tasks.workunit.client.1.smithi111.stdout:6/416: read d0/d1/d27/f5f [3296060,109077] 0 2023-12-08T20:27:55.113 INFO:tasks.workunit.client.1.smithi111.stdout:4/487: write d8/da/d2c/d1f/fe [1889131,1680] 0 2023-12-08T20:27:55.114 INFO:tasks.workunit.client.1.smithi111.stdout:3/530: dwrite d2/d12/f4b [0,4194304] 0 2023-12-08T20:27:55.114 INFO:tasks.workunit.client.1.smithi111.stdout:6/417: rename d0/d1/d1e/f4f to d0/d1a/f7d 0 2023-12-08T20:27:55.114 INFO:tasks.workunit.client.1.smithi111.stdout:7/552: dwrite da/d25/f3b [0,4194304] 0 2023-12-08T20:27:55.116 INFO:tasks.workunit.client.1.smithi111.stdout:5/724: dwrite d3/d4/d7/d36/d82/fda [0,4194304] 0 2023-12-08T20:27:55.116 INFO:tasks.workunit.client.1.smithi111.stdout:5/725: chown d3/d4/ld 55050 1 2023-12-08T20:27:55.117 INFO:tasks.workunit.client.1.smithi111.stdout:4/488: mkdir d8/d30/d7d/d9b 0 2023-12-08T20:27:55.118 INFO:tasks.workunit.client.1.smithi111.stdout:3/531: creat d2/d3/d51/d88/fa3 x:0 0 0 2023-12-08T20:27:55.119 INFO:tasks.workunit.client.1.smithi111.stdout:0/844: dwrite d1/df/f97 [0,4194304] 0 2023-12-08T20:27:55.120 INFO:tasks.workunit.client.1.smithi111.stdout:6/418: rename d0/d1/la to d0/d1a/l7e 0 2023-12-08T20:27:55.121 INFO:tasks.workunit.client.1.smithi111.stdout:7/553: truncate da/d13/f7f 7937439 0 2023-12-08T20:27:55.122 INFO:tasks.workunit.client.1.smithi111.stdout:7/554: chown da/d38 20 1 2023-12-08T20:27:55.122 INFO:tasks.workunit.client.1.smithi111.stdout:2/563: dwrite d1/d1d/d22/f76 [0,4194304] 0 2023-12-08T20:27:55.124 INFO:tasks.workunit.client.1.smithi111.stdout:5/726: creat d3/d4/d7/d29/d73/d90/ff9 x:0 0 0 2023-12-08T20:27:55.136 INFO:tasks.workunit.client.1.smithi111.stdout:4/489: symlink d8/da/d29/d69/l9c 0 2023-12-08T20:27:55.137 INFO:tasks.workunit.client.1.smithi111.stdout:4/490: write d8/da/d2c/d1f/f58 [185150,125115] 0 2023-12-08T20:27:55.137 INFO:tasks.workunit.client.1.smithi111.stdout:3/532: truncate d2/d3/d13/d36/d69/d70/f90 469055 0 2023-12-08T20:27:55.140 INFO:tasks.workunit.client.1.smithi111.stdout:0/845: creat d1/df/d16/d2c/f116 x:0 0 0 2023-12-08T20:27:55.141 INFO:tasks.workunit.client.1.smithi111.stdout:0/846: chown d1/df/d44/d37/d5c/l77 11833092 1 2023-12-08T20:27:55.142 INFO:tasks.workunit.client.1.smithi111.stdout:6/419: creat d0/d1/d27/d36/f7f x:0 0 0 2023-12-08T20:27:55.144 INFO:tasks.workunit.client.1.smithi111.stdout:7/555: creat da/d25/d3d/d58/da4/fba x:0 0 0 2023-12-08T20:27:55.145 INFO:tasks.workunit.client.1.smithi111.stdout:7/556: write da/d25/d26/d32/d3e/fac [3958769,105580] 0 2023-12-08T20:27:55.145 INFO:tasks.workunit.client.1.smithi111.stdout:7/557: chown da/d13/d9e/cb4 23347898 1 2023-12-08T20:27:55.146 INFO:tasks.workunit.client.1.smithi111.stdout:2/564: creat d1/d29/d53/d91/dbd/fcf x:0 0 0 2023-12-08T20:27:55.148 INFO:tasks.workunit.client.1.smithi111.stdout:2/565: dread d1/d29/d53/d90/f61 [0,4194304] 0 2023-12-08T20:27:55.148 INFO:tasks.workunit.client.1.smithi111.stdout:5/727: mkdir d3/d12/dbd/dfa 0 2023-12-08T20:27:55.148 INFO:tasks.workunit.client.1.smithi111.stdout:5/728: stat d3/d4/d7/d2c/d84/c9c 0 2023-12-08T20:27:55.149 INFO:tasks.workunit.client.1.smithi111.stdout:4/491: truncate d8/da/d29/f39 1731519 0 2023-12-08T20:27:55.152 INFO:tasks.workunit.client.1.smithi111.stdout:3/533: unlink d2/d15/d17/f35 0 2023-12-08T20:27:55.157 INFO:tasks.workunit.client.1.smithi111.stdout:7/558: mknod da/d25/d26/d32/d87/cbb 0 2023-12-08T20:27:55.159 INFO:tasks.workunit.client.1.smithi111.stdout:2/566: symlink d1/d1d/ld0 0 2023-12-08T20:27:55.159 INFO:tasks.workunit.client.1.smithi111.stdout:2/567: fdatasync d1/d29/d53/d90/fc8 0 2023-12-08T20:27:55.161 INFO:tasks.workunit.client.1.smithi111.stdout:5/729: rename d3/d4/d7/d36/d82/db4/fb7 to d3/d12/d67/ffb 0 2023-12-08T20:27:55.162 INFO:tasks.workunit.client.1.smithi111.stdout:3/534: creat d2/d3/d1e/d93/fa4 x:0 0 0 2023-12-08T20:27:55.162 INFO:tasks.workunit.client.1.smithi111.stdout:3/535: write d2/d3/d13/f98 [624815,3407] 0 2023-12-08T20:27:55.164 INFO:tasks.workunit.client.1.smithi111.stdout:6/420: mknod d0/c80 0 2023-12-08T20:27:55.165 INFO:tasks.workunit.client.1.smithi111.stdout:2/568: rename d1/d29/d4e/l37 to d1/d1d/d1f/d25/d3d/ld1 0 2023-12-08T20:27:55.166 INFO:tasks.workunit.client.1.smithi111.stdout:5/730: mknod d3/d4/d7/d36/d64/d96/cfc 0 2023-12-08T20:27:55.168 INFO:tasks.workunit.client.1.smithi111.stdout:7/559: dread da/d25/d26/f4d [0,4194304] 0 2023-12-08T20:27:55.168 INFO:tasks.workunit.client.1.smithi111.stdout:7/560: readlink da/d5c/l95 0 2023-12-08T20:27:55.168 INFO:tasks.workunit.client.1.smithi111.stdout:3/536: creat d2/d3/d51/d88/fa5 x:0 0 0 2023-12-08T20:27:55.169 INFO:tasks.workunit.client.1.smithi111.stdout:0/847: rmdir d1/d4/d24/d46/db7/db9 0 2023-12-08T20:27:55.170 INFO:tasks.workunit.client.1.smithi111.stdout:4/492: dread d8/da/d29/f39 [0,4194304] 0 2023-12-08T20:27:55.170 INFO:tasks.workunit.client.1.smithi111.stdout:6/421: rename d0/d1/d1e/c3a to d0/d1/c81 0 2023-12-08T20:27:55.170 INFO:tasks.workunit.client.1.smithi111.stdout:4/493: write d8/da/db/f8d [1458635,13846] 0 2023-12-08T20:27:55.171 INFO:tasks.workunit.client.1.smithi111.stdout:2/569: creat d1/d29/d53/d90/fd2 x:0 0 0 2023-12-08T20:27:55.172 INFO:tasks.workunit.client.1.smithi111.stdout:2/570: dread d1/d29/d53/f82 [0,4194304] 0 2023-12-08T20:27:55.172 INFO:tasks.workunit.client.1.smithi111.stdout:5/731: mknod d3/d4/d7/d29/d30/cfd 0 2023-12-08T20:27:55.172 INFO:tasks.workunit.client.1.smithi111.stdout:5/732: fdatasync d3/d12/fb2 0 2023-12-08T20:27:55.174 INFO:tasks.workunit.client.1.smithi111.stdout:3/537: mkdir d2/d15/d17/d5e/da6 0 2023-12-08T20:27:55.175 INFO:tasks.workunit.client.1.smithi111.stdout:7/561: dread da/d25/f5d [0,4194304] 0 2023-12-08T20:27:55.175 INFO:tasks.workunit.client.1.smithi111.stdout:5/733: read d3/d4/d7/d36/f7c [42196,47193] 0 2023-12-08T20:27:55.175 INFO:tasks.workunit.client.1.smithi111.stdout:0/848: symlink d1/d4/d3a/l117 0 2023-12-08T20:27:55.179 INFO:tasks.workunit.client.1.smithi111.stdout:6/422: mknod d0/d1/c82 0 2023-12-08T20:27:55.180 INFO:tasks.workunit.client.1.smithi111.stdout:4/494: symlink d8/da/db/d7f/d93/d77/l9d 0 2023-12-08T20:27:55.183 INFO:tasks.workunit.client.1.smithi111.stdout:5/734: symlink d3/d4/d7/d29/d30/dc0/lfe 0 2023-12-08T20:27:55.183 INFO:tasks.workunit.client.1.smithi111.stdout:5/735: fdatasync d3/d4/d7/d29/d73/d90/fa1 0 2023-12-08T20:27:55.183 INFO:tasks.workunit.client.1.smithi111.stdout:5/736: stat d3/d4/d7/d29/d30/dc0 0 2023-12-08T20:27:55.185 INFO:tasks.workunit.client.1.smithi111.stdout:0/849: link d1/d4/faf d1/df/d16/d2c/f118 0 2023-12-08T20:27:55.185 INFO:tasks.workunit.client.1.smithi111.stdout:0/850: stat d1/d4/d24/l27 0 2023-12-08T20:27:55.186 INFO:tasks.workunit.client.1.smithi111.stdout:6/423: mknod d0/d1a/c83 0 2023-12-08T20:27:55.190 INFO:tasks.workunit.client.1.smithi111.stdout:5/737: symlink d3/d12/dbd/lff 0 2023-12-08T20:27:55.190 INFO:tasks.workunit.client.1.smithi111.stdout:5/738: dread - d3/d4/d7/d29/d73/d90/ff9 zero size 2023-12-08T20:27:55.190 INFO:tasks.workunit.client.1.smithi111.stdout:5/739: dread - d3/d4/d7/d29/fba zero size 2023-12-08T20:27:55.195 INFO:tasks.workunit.client.1.smithi111.stdout:5/740: link d3/d6d/l74 d3/d4/d7/d36/d82/db4/dbe/dc6/l100 0 2023-12-08T20:27:55.196 INFO:tasks.workunit.client.1.smithi111.stdout:0/851: symlink d1/d4/l119 0 2023-12-08T20:27:55.197 INFO:tasks.workunit.client.1.smithi111.stdout:5/741: unlink d3/d4/d7/d2c/fe6 0 2023-12-08T20:27:55.200 INFO:tasks.workunit.client.1.smithi111.stdout:0/852: mkdir d1/df/d56/d102/d11a 0 2023-12-08T20:27:55.200 INFO:tasks.workunit.client.1.smithi111.stdout:0/853: write d1/d69/fd2 [743383,122874] 0 2023-12-08T20:27:55.200 INFO:tasks.workunit.client.1.smithi111.stdout:7/562: dwrite da/d25/faf [0,4194304] 0 2023-12-08T20:27:55.200 INFO:tasks.workunit.client.1.smithi111.stdout:7/563: write da/d25/da9/db8/d89/fa1 [35487,64650] 0 2023-12-08T20:27:55.201 INFO:tasks.workunit.client.1.smithi111.stdout:0/854: rename d1/df/d44/d37/dac/lad to d1/d4/d24/d46/d58/d65/l11b 0 2023-12-08T20:27:55.203 INFO:tasks.workunit.client.1.smithi111.stdout:0/855: symlink d1/df/d44/d37/d5c/l11c 0 2023-12-08T20:27:55.208 INFO:tasks.workunit.client.1.smithi111.stdout:4/495: dwrite d8/f8f [0,4194304] 0 2023-12-08T20:27:55.208 INFO:tasks.workunit.client.1.smithi111.stdout:3/538: dwrite d2/d3/d13/d36/d69/f75 [0,4194304] 0 2023-12-08T20:27:55.208 INFO:tasks.workunit.client.1.smithi111.stdout:2/571: dwrite d1/d1d/d1f/d25/f78 [0,4194304] 0 2023-12-08T20:27:55.208 INFO:tasks.workunit.client.1.smithi111.stdout:0/856: rename d1/d4/faf to d1/d4/d24/d46/d49/d7f/d95/f11d 0 2023-12-08T20:27:55.212 INFO:tasks.workunit.client.1.smithi111.stdout:4/496: unlink d8/da/f75 0 2023-12-08T20:27:55.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.212+0000 7f9420a00700 1 -- 172.21.15.43:0/2264126936 --> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f941c115690 con 0x7f940406ae40 2023-12-08T20:27:55.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.213+0000 7f940affd700 1 -- 172.21.15.43:0/2264126936 <== mgr.24407 v2:172.21.15.111:6828/940639390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f941c115690 con 0x7f940406ae40 2023-12-08T20:27:55.218 INFO:tasks.workunit.client.1.smithi111.stdout:3/539: mkdir d2/d3/d13/d36/d44/d8f/da7 0 2023-12-08T20:27:55.219 INFO:tasks.workunit.client.1.smithi111.stdout:2/572: getdents d1/d1d/d1f/d25/d96 0 2023-12-08T20:27:55.219 INFO:tasks.workunit.client.1.smithi111.stdout:2/573: fdatasync d1/d1d/d1f/d25/d3d/f63 0 2023-12-08T20:27:55.219 INFO:tasks.workunit.client.1.smithi111.stdout:5/742: dwrite d3/d4/d7/d29/d30/f3f [4194304,4194304] 0 2023-12-08T20:27:55.220 INFO:tasks.workunit.client.1.smithi111.stdout:7/564: dwrite da/d5c/d59/d61/fb1 [0,4194304] 0 2023-12-08T20:27:55.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.219+0000 7f9420a00700 1 -- 172.21.15.43:0/2264126936 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f940406ae40 msgr2=0x7f940406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:55.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.219+0000 7f9420a00700 1 --2- 172.21.15.43:0/2264126936 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f940406ae40 0x7f940406d2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f940c00b0d0 tx=0x7f940c009e30 comp rx=0 tx=0).stop 2023-12-08T20:27:55.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.219+0000 7f9420a00700 1 -- 172.21.15.43:0/2264126936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f941c0fde00 msgr2=0x7f941c06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:55.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.219+0000 7f9420a00700 1 --2- 172.21.15.43:0/2264126936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f941c0fde00 0x7f941c06ff90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f941000eb40 tx=0x7f941000b040 comp rx=0 tx=0).stop 2023-12-08T20:27:55.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.219+0000 7f9420a00700 1 -- 172.21.15.43:0/2264126936 shutdown_connections 2023-12-08T20:27:55.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.219+0000 7f9420a00700 1 --2- 172.21.15.43:0/2264126936 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f940406ae40 0x7f940406d2f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:55.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.219+0000 7f9420a00700 1 --2- 172.21.15.43:0/2264126936 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f941c0fcbf0 0x7f941c071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:55.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.219+0000 7f9420a00700 1 --2- 172.21.15.43:0/2264126936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f941c0fde00 0x7f941c06ff90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:55.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.219+0000 7f9420a00700 1 -- 172.21.15.43:0/2264126936 >> 172.21.15.43:0/2264126936 conn(0x7f941c0f82d0 msgr2=0x7f941c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:55.221 INFO:tasks.workunit.client.1.smithi111.stdout:7/565: write da/d25/d26/f2b [6476,78102] 0 2023-12-08T20:27:55.221 INFO:tasks.workunit.client.1.smithi111.stdout:7/566: write da/d25/d3d/fa5 [376857,130820] 0 2023-12-08T20:27:55.222 INFO:tasks.workunit.client.1.smithi111.stdout:0/857: unlink d1/dd/d47/f91 0 2023-12-08T20:27:55.222 INFO:tasks.workunit.client.1.smithi111.stdout:3/540: symlink d2/d15/d17/d5e/la8 0 2023-12-08T20:27:55.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.222+0000 7f9420a00700 1 -- 172.21.15.43:0/2264126936 shutdown_connections 2023-12-08T20:27:55.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.222+0000 7f9420a00700 1 -- 172.21.15.43:0/2264126936 wait complete. 2023-12-08T20:27:55.224 INFO:tasks.workunit.client.1.smithi111.stdout:2/574: rmdir d1/d29/d53/d91 39 2023-12-08T20:27:55.228 INFO:tasks.workunit.client.1.smithi111.stdout:5/743: creat d3/d4/d7/d36/d82/db4/f101 x:0 0 0 2023-12-08T20:27:55.230 INFO:tasks.workunit.client.1.smithi111.stdout:4/497: dwrite d8/da/db/d7f/f5a [0,4194304] 0 2023-12-08T20:27:55.232 INFO:tasks.workunit.client.1.smithi111.stdout:7/567: creat da/d5c/d59/fbc x:0 0 0 2023-12-08T20:27:55.233 INFO:tasks.workunit.client.1.smithi111.stdout:0/858: creat d1/d69/f11e x:0 0 0 2023-12-08T20:27:55.233 INFO:tasks.workunit.client.1.smithi111.stdout:0/859: fsync d1/f10 0 2023-12-08T20:27:55.234 INFO:tasks.workunit.client.1.smithi111.stdout:3/541: rename d2/d12/d4a/d5d/c97 to d2/d15/d17/ca9 0 2023-12-08T20:27:55.235 INFO:tasks.workunit.client.1.smithi111.stdout:3/542: dread - d2/d12/f8c zero size 2023-12-08T20:27:55.235 INFO:tasks.workunit.client.1.smithi111.stdout:3/543: fsync d2/d12/d4a/f6f 0 2023-12-08T20:27:55.236 INFO:tasks.workunit.client.1.smithi111.stdout:5/744: creat d3/d4/d7/d36/d82/db4/f102 x:0 0 0 2023-12-08T20:27:55.248 INFO:tasks.workunit.client.1.smithi111.stdout:7/568: unlink da/d25/d3d/c94 0 2023-12-08T20:27:55.248 INFO:tasks.workunit.client.1.smithi111.stdout:0/860: dwrite d1/df/d56/fff [0,4194304] 0 2023-12-08T20:27:55.248 INFO:tasks.workunit.client.1.smithi111.stdout:2/575: rename d1/d1d/d1f/d25/d3d/d41/f74 to d1/d1d/d1f/d25/d3d/da2/fd3 0 2023-12-08T20:27:55.250 INFO:tasks.workunit.client.1.smithi111.stdout:3/544: mkdir d2/d3/d13/d36/d44/daa 0 2023-12-08T20:27:55.250 INFO:tasks.workunit.client.1.smithi111.stdout:3/545: chown d2/d3/d1e/d93 119948001 1 2023-12-08T20:27:55.250 INFO:tasks.workunit.client.1.smithi111.stdout:3/546: fsync d2/d3/d13/d36/d69/d70/f66 0 2023-12-08T20:27:55.250 INFO:tasks.workunit.client.1.smithi111.stdout:3/547: fdatasync d2/d3/f16 0 2023-12-08T20:27:55.251 INFO:tasks.workunit.client.1.smithi111.stdout:5/745: symlink d3/d12/d67/l103 0 2023-12-08T20:27:55.255 INFO:tasks.workunit.client.1.smithi111.stdout:7/569: truncate da/d25/d3d/f85 362788 0 2023-12-08T20:27:55.257 INFO:tasks.workunit.client.1.smithi111.stdout:7/570: write da/d13/f9b [3376408,89192] 0 2023-12-08T20:27:55.261 INFO:tasks.workunit.client.1.smithi111.stdout:4/498: rename d8/d30/f49 to d8/da/db/d7f/f9e 0 2023-12-08T20:27:55.261 INFO:tasks.workunit.client.1.smithi111.stdout:4/499: chown d8/da/d2c/d1f/d2b/d4b/f53 2608 1 2023-12-08T20:27:55.261 INFO:tasks.workunit.client.1.smithi111.stdout:2/576: creat d1/d29/d53/d90/fd4 x:0 0 0 2023-12-08T20:27:55.261 INFO:tasks.workunit.client.1.smithi111.stdout:2/577: write d1/d1d/d1f/d25/d3d/f63 [4956634,81673] 0 2023-12-08T20:27:55.261 INFO:tasks.workunit.client.1.smithi111.stdout:2/578: fdatasync d1/d29/d53/f23 0 2023-12-08T20:27:55.261 INFO:tasks.workunit.client.1.smithi111.stdout:2/579: chown d1/d29/d53/d90 19041 1 2023-12-08T20:27:55.262 INFO:tasks.workunit.client.1.smithi111.stdout:3/548: mknod d2/d3/d13/d36/d69/d81/cab 0 2023-12-08T20:27:55.262 INFO:tasks.workunit.client.1.smithi111.stdout:3/549: stat d2/d15/d17/d5e/d9f 0 2023-12-08T20:27:55.263 INFO:tasks.workunit.client.1.smithi111.stdout:5/746: mkdir d3/d12/d104 0 2023-12-08T20:27:55.268 INFO:tasks.workunit.client.1.smithi111.stdout:2/580: rename d1/d1d/d22/f2f to d1/d29/d53/fd5 0 2023-12-08T20:27:55.269 INFO:tasks.workunit.client.1.smithi111.stdout:3/550: mkdir d2/d3/d13/d36/d44/d8f/dac 0 2023-12-08T20:27:55.270 INFO:tasks.workunit.client.1.smithi111.stdout:7/571: dwrite da/d5c/d59/d61/fb1 [0,4194304] 0 2023-12-08T20:27:55.270 INFO:tasks.workunit.client.1.smithi111.stdout:7/572: write da/d25/d3d/d58/f5e [1428501,87240] 0 2023-12-08T20:27:55.270 INFO:tasks.workunit.client.1.smithi111.stdout:7/573: write da/d13/fad [34675,127471] 0 2023-12-08T20:27:55.271 INFO:tasks.workunit.client.1.smithi111.stdout:1/610: sync 2023-12-08T20:27:55.271 INFO:tasks.workunit.client.1.smithi111.stdout:9/683: sync 2023-12-08T20:27:55.271 INFO:tasks.workunit.client.1.smithi111.stdout:8/723: sync 2023-12-08T20:27:55.272 INFO:tasks.workunit.client.1.smithi111.stdout:4/500: dread d8/da/db/f4d [0,4194304] 0 2023-12-08T20:27:55.276 INFO:tasks.workunit.client.1.smithi111.stdout:2/581: mkdir d1/d1d/d68/d73/dd6 0 2023-12-08T20:27:55.276 INFO:tasks.workunit.client.1.smithi111.stdout:3/551: mknod d2/d15/cad 0 2023-12-08T20:27:55.276 INFO:tasks.workunit.client.1.smithi111.stdout:2/582: write d1/d1d/d1f/d25/d67/faa [382389,96520] 0 2023-12-08T20:27:55.277 INFO:tasks.workunit.client.1.smithi111.stdout:7/574: rename l7 to da/d25/d3d/d58/da4/lbd 0 2023-12-08T20:27:55.279 INFO:tasks.workunit.client.1.smithi111.stdout:1/611: mknod d0/d8e/db0/cd5 0 2023-12-08T20:27:55.281 INFO:tasks.workunit.client.1.smithi111.stdout:9/684: symlink d2/d8/dd/d1a/d66/lf6 0 2023-12-08T20:27:55.282 INFO:tasks.workunit.client.1.smithi111.stdout:4/501: creat d8/da/d2c/f9f x:0 0 0 2023-12-08T20:27:55.285 INFO:tasks.workunit.client.1.smithi111.stdout:9/685: write d2/d8/dd/d1a/f7f [315190,126463] 0 2023-12-08T20:27:55.285 INFO:tasks.workunit.client.1.smithi111.stdout:9/686: chown d2/d8/dd/d1a/d1e/l5f 155356970 1 2023-12-08T20:27:55.290 INFO:tasks.workunit.client.1.smithi111.stdout:3/552: dwrite d2/fa [0,4194304] 0 2023-12-08T20:27:55.290 INFO:tasks.workunit.client.1.smithi111.stdout:3/553: readlink d2/d3/d1e/l22 0 2023-12-08T20:27:55.291 INFO:tasks.workunit.client.1.smithi111.stdout:2/583: unlink d1/d1d/d1f/d25/d3d/d41/l6b 0 2023-12-08T20:27:55.291 INFO:tasks.workunit.client.1.smithi111.stdout:2/584: chown d1/d29/d53/d90/fc8 243 1 2023-12-08T20:27:55.291 INFO:tasks.workunit.client.1.smithi111.stdout:2/585: fdatasync d1/d1d/d22/f69 0 2023-12-08T20:27:55.294 INFO:tasks.workunit.client.1.smithi111.stdout:7/575: link da/d5c/d59/d61/l73 da/d25/d3d/d58/lbe 0 2023-12-08T20:27:55.294 INFO:tasks.workunit.client.1.smithi111.stdout:5/747: rmdir d3/d4/d7/d36/d82/db4 39 2023-12-08T20:27:55.297 INFO:tasks.workunit.client.1.smithi111.stdout:1/612: creat d0/d6/d33/d15/d51/d5b/d5e/d86/dbd/fd6 x:0 0 0 2023-12-08T20:27:55.299 INFO:tasks.workunit.client.1.smithi111.stdout:4/502: dwrite d8/da/db/d7f/d93/d77/f6c [0,4194304] 0 2023-12-08T20:27:55.303 INFO:tasks.workunit.client.1.smithi111.stdout:2/586: mknod d1/d1d/d1f/cd7 0 2023-12-08T20:27:55.303 INFO:tasks.workunit.client.1.smithi111.stdout:2/587: fdatasync d1/d1d/f2e 0 2023-12-08T20:27:55.303 INFO:tasks.workunit.client.1.smithi111.stdout:2/588: truncate d1/d1d/d68/fa1 1558934 0 2023-12-08T20:27:55.304 INFO:tasks.workunit.client.1.smithi111.stdout:7/576: rmdir da/da7 0 2023-12-08T20:27:55.309 INFO:tasks.workunit.client.1.smithi111.stdout:1/613: unlink d0/l68 0 2023-12-08T20:27:55.311 INFO:tasks.workunit.client.1.smithi111.stdout:9/687: mkdir d2/d8/dd/d1a/d1e/d2d/df7 0 2023-12-08T20:27:55.311 INFO:tasks.workunit.client.1.smithi111.stdout:9/688: fdatasync d2/d8/fb6 0 2023-12-08T20:27:55.312 INFO:tasks.workunit.client.1.smithi111.stdout:5/748: dwrite d3/d4/d7/d29/d30/f3f [0,4194304] 0 2023-12-08T20:27:55.316 INFO:tasks.workunit.client.1.smithi111.stdout:2/589: link d1/d1d/d22/f7d d1/d1d/fd8 0 2023-12-08T20:27:55.317 INFO:tasks.workunit.client.1.smithi111.stdout:4/503: dwrite d8/da/f3b [0,4194304] 0 2023-12-08T20:27:55.318 INFO:tasks.workunit.client.1.smithi111.stdout:7/577: mknod da/d64/cbf 0 2023-12-08T20:27:55.320 INFO:tasks.workunit.client.1.smithi111.stdout:9/689: unlink d2/d8/dd/d1a/d66/fd9 0 2023-12-08T20:27:55.320 INFO:tasks.workunit.client.1.smithi111.stdout:9/690: fdatasync d2/d8/dd/d56/f72 0 2023-12-08T20:27:55.320 INFO:tasks.workunit.client.1.smithi111.stdout:9/691: write d2/d8/dd/d1a/d1e/d2d/d35/f60 [4590274,117462] 0 2023-12-08T20:27:55.322 INFO:tasks.workunit.client.1.smithi111.stdout:5/749: unlink d3/d4/l72 0 2023-12-08T20:27:55.326 INFO:tasks.workunit.client.1.smithi111.stdout:4/504: creat d8/da/db/fa0 x:0 0 0 2023-12-08T20:27:55.326 INFO:tasks.workunit.client.1.smithi111.stdout:3/554: rmdir d2 39 2023-12-08T20:27:55.326 INFO:tasks.workunit.client.1.smithi111.stdout:3/555: fdatasync d2/d3/d6/fe 0 2023-12-08T20:27:55.327 INFO:tasks.workunit.client.1.smithi111.stdout:3/556: read d2/d3/f1c [102552,9483] 0 2023-12-08T20:27:55.328 INFO:tasks.workunit.client.1.smithi111.stdout:3/557: stat d2/d12/f1a 0 2023-12-08T20:27:55.331 INFO:tasks.workunit.client.1.smithi111.stdout:7/578: link da/d25/da9/db8/c6d da/d13/d9e/cc0 0 2023-12-08T20:27:55.331 INFO:tasks.workunit.client.1.smithi111.stdout:9/692: unlink d2/d8/d8c/dbb/cf2 0 2023-12-08T20:27:55.331 INFO:tasks.workunit.client.1.smithi111.stdout:9/693: chown d2/d8/d8c/d96/f9e 417358 1 2023-12-08T20:27:55.332 INFO:tasks.workunit.client.1.smithi111.stdout:5/750: unlink d3/d4/d7/ff4 0 2023-12-08T20:27:55.335 INFO:tasks.workunit.client.1.smithi111.stdout:7/579: symlink da/d13/d9e/lc1 0 2023-12-08T20:27:55.336 INFO:tasks.workunit.client.1.smithi111.stdout:5/751: rmdir d3/d4/d7/d29/d30/dd3 39 2023-12-08T20:27:55.336 INFO:tasks.workunit.client.1.smithi111.stdout:5/752: fdatasync d3/d4/d7/d2c/f41 0 2023-12-08T20:27:55.340 INFO:tasks.workunit.client.1.smithi111.stdout:7/580: symlink da/d25/d3d/d58/lc2 0 2023-12-08T20:27:55.343 INFO:tasks.workunit.client.1.smithi111.stdout:5/753: rename d3/f6b to d3/d8d/f105 0 2023-12-08T20:27:55.343 INFO:tasks.workunit.client.1.smithi111.stdout:5/754: truncate d3/d6d/f81 884073 0 2023-12-08T20:27:55.344 INFO:tasks.workunit.client.1.smithi111.stdout:7/581: creat da/d25/d26/d32/d3e/d97/fc3 x:0 0 0 2023-12-08T20:27:55.345 INFO:tasks.workunit.client.1.smithi111.stdout:4/505: dwrite d8/da/d29/d6e/f99 [0,4194304] 0 2023-12-08T20:27:55.345 INFO:tasks.workunit.client.1.smithi111.stdout:7/582: dread da/d13/f69 [0,4194304] 0 2023-12-08T20:27:55.350 INFO:tasks.workunit.client.1.smithi111.stdout:3/558: dwrite d2/d3/d51/d88/fa3 [0,4194304] 0 2023-12-08T20:27:55.350 INFO:tasks.workunit.client.1.smithi111.stdout:3/559: fsync d2/d15/d17/d25/d4e/f78 0 2023-12-08T20:27:55.350 INFO:tasks.workunit.client.1.smithi111.stdout:4/506: rename d8/da/db/d7f/d93/d77/l74 to d8/d30/d7d/d9b/la1 0 2023-12-08T20:27:55.354 INFO:tasks.workunit.client.1.smithi111.stdout:3/560: mkdir d2/d15/d17/d5e/da6/dae 0 2023-12-08T20:27:55.356 INFO:tasks.workunit.client.1.smithi111.stdout:5/755: dread d3/d4/d4a/fb3 [0,4194304] 0 2023-12-08T20:27:55.356 INFO:tasks.workunit.client.1.smithi111.stdout:5/756: dread - d3/d4/d7/f89 zero size 2023-12-08T20:27:55.358 INFO:tasks.workunit.client.1.smithi111.stdout:3/561: creat d2/d3/d13/d36/d44/daa/faf x:0 0 0 2023-12-08T20:27:55.362 INFO:tasks.workunit.client.1.smithi111.stdout:5/757: link d3/d4/f8e d3/d4/d7/d29/d73/f106 0 2023-12-08T20:27:55.365 INFO:tasks.workunit.client.1.smithi111.stdout:3/562: rmdir d2/d15/d17/d5e/da6/dae 0 2023-12-08T20:27:55.368 INFO:tasks.workunit.client.1.smithi111.stdout:7/583: dwrite da/f1e [0,4194304] 0 2023-12-08T20:27:55.368 INFO:tasks.workunit.client.1.smithi111.stdout:7/584: chown da/d5c/d59 894 1 2023-12-08T20:27:55.368 INFO:tasks.workunit.client.1.smithi111.stdout:7/585: write da/d25/da9/db8/d89/fa1 [388042,72141] 0 2023-12-08T20:27:55.368 INFO:tasks.workunit.client.1.smithi111.stdout:5/758: creat d3/d6d/f107 x:0 0 0 2023-12-08T20:27:55.368 INFO:tasks.workunit.client.1.smithi111.stdout:5/759: chown d3/d8d/fcd 286849 1 2023-12-08T20:27:55.369 INFO:tasks.workunit.client.1.smithi111.stdout:4/507: dwrite d8/da/f66 [0,4194304] 0 2023-12-08T20:27:55.372 INFO:tasks.workunit.client.1.smithi111.stdout:7/586: mkdir da/d64/dc4 0 2023-12-08T20:27:55.373 INFO:tasks.workunit.client.1.smithi111.stdout:7/587: write da/d25/f2e [1784589,111767] 0 2023-12-08T20:27:55.373 INFO:tasks.workunit.client.1.smithi111.stdout:5/760: mkdir d3/d12/d67/ddf/d108 0 2023-12-08T20:27:55.375 INFO:tasks.workunit.client.1.smithi111.stdout:4/508: creat d8/da/d29/d69/fa2 x:0 0 0 2023-12-08T20:27:55.375 INFO:tasks.workunit.client.1.smithi111.stdout:4/509: read d8/da/db/f4d [775508,37061] 0 2023-12-08T20:27:55.375 INFO:tasks.workunit.client.1.smithi111.stdout:4/510: stat d8/da/c48 0 2023-12-08T20:27:55.375 INFO:tasks.workunit.client.1.smithi111.stdout:4/511: chown d8/da/d2c/d1f/d2b/f3d 5 1 2023-12-08T20:27:55.376 INFO:tasks.workunit.client.1.smithi111.stdout:4/512: getdents d8/d30/d97 0 2023-12-08T20:27:55.379 INFO:tasks.workunit.client.1.smithi111.stdout:5/761: rename d3/d4/c50 to d3/d4/d7/d29/dd6/c109 0 2023-12-08T20:27:55.379 INFO:tasks.workunit.client.1.smithi111.stdout:5/762: getdents d3/d12/dbd/dfa 0 2023-12-08T20:27:55.383 INFO:tasks.workunit.client.1.smithi111.stdout:7/588: rmdir da/d25/d26/d32/d3e 39 2023-12-08T20:27:55.386 INFO:tasks.workunit.client.1.smithi111.stdout:7/589: symlink da/d25/d3d/d58/lc5 0 2023-12-08T20:27:55.387 INFO:tasks.workunit.client.1.smithi111.stdout:7/590: chown da/d25/d3d/d58/da4/lbd 79341 1 2023-12-08T20:27:55.388 INFO:tasks.workunit.client.1.smithi111.stdout:7/591: link da/d5c/d59/c92 da/d5c/cc6 0 2023-12-08T20:27:55.402 INFO:tasks.workunit.client.1.smithi111.stdout:5/763: dwrite d3/d6d/f81 [0,4194304] 0 2023-12-08T20:27:55.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.401+0000 7f1ebe5ce700 1 -- 172.21.15.43:0/432792772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1eb80fcd00 msgr2=0x7f1eb80fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:55.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.401+0000 7f1ebe5ce700 1 --2- 172.21.15.43:0/432792772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1eb80fcd00 0x7f1eb80fd150 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1eac004940 tx=0x7f1eac009e30 comp rx=0 tx=0).stop 2023-12-08T20:27:55.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.401+0000 7f1ebe5ce700 1 -- 172.21.15.43:0/432792772 shutdown_connections 2023-12-08T20:27:55.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.401+0000 7f1ebe5ce700 1 --2- 172.21.15.43:0/432792772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1eb80fcd00 0x7f1eb80fd150 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:55.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.401+0000 7f1ebe5ce700 1 --2- 172.21.15.43:0/432792772 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1eb80fbaf0 0x7f1eb80fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:55.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.402+0000 7f1ebe5ce700 1 -- 172.21.15.43:0/432792772 >> 172.21.15.43:0/432792772 conn(0x7f1eb80f71b0 msgr2=0x7f1eb80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:55.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.402+0000 7f1ebe5ce700 1 -- 172.21.15.43:0/432792772 shutdown_connections 2023-12-08T20:27:55.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.402+0000 7f1ebe5ce700 1 -- 172.21.15.43:0/432792772 wait complete. 2023-12-08T20:27:55.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.402+0000 7f1ebe5ce700 1 Processor -- start 2023-12-08T20:27:55.404 INFO:tasks.workunit.client.1.smithi111.stdout:5/764: mknod d3/d12/d67/ddf/c10a 0 2023-12-08T20:27:55.404 INFO:tasks.workunit.client.1.smithi111.stdout:5/765: write d3/d6d/fa4 [5411679,61298] 0 2023-12-08T20:27:55.404 INFO:tasks.workunit.client.1.smithi111.stdout:5/766: write d3/d4/d7/d36/f3d [4265867,67121] 0 2023-12-08T20:27:55.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.403+0000 7f1ebe5ce700 1 -- start start 2023-12-08T20:27:55.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.403+0000 7f1ebe5ce700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1eb80fbaf0 0x7f1eb810c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:55.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.403+0000 7f1ebe5ce700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1eb80fcd00 0x7f1eb810ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:55.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.403+0000 7f1ebe5ce700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb810d0d0 con 0x7f1eb80fcd00 2023-12-08T20:27:55.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.403+0000 7f1ebe5ce700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb810d910 con 0x7f1eb80fbaf0 2023-12-08T20:27:55.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.403+0000 7f1eb77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1eb80fcd00 0x7f1eb810ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:55.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.403+0000 7f1eb77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1eb80fcd00 0x7f1eb810ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38460/0 (socket says 172.21.15.43:38460) 2023-12-08T20:27:55.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.403+0000 7f1eb77fe700 1 -- 172.21.15.43:0/804637073 learned_addr learned my addr 172.21.15.43:0/804637073 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:27:55.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.403+0000 7f1eb7fff700 1 --2- 172.21.15.43:0/804637073 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1eb80fbaf0 0x7f1eb810c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:55.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.403+0000 7f1eb77fe700 1 -- 172.21.15.43:0/804637073 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1eb80fbaf0 msgr2=0x7f1eb810c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:55.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.403+0000 7f1eb77fe700 1 --2- 172.21.15.43:0/804637073 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1eb80fbaf0 0x7f1eb810c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:55.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.403+0000 7f1eb77fe700 1 -- 172.21.15.43:0/804637073 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac005040 con 0x7f1eb80fcd00 2023-12-08T20:27:55.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.404+0000 7f1eb77fe700 1 --2- 172.21.15.43:0/804637073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1eb80fcd00 0x7f1eb810ca40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1eac008fb0 tx=0x7f1eac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:27:55.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.404+0000 7f1eb4ff9700 1 -- 172.21.15.43:0/804637073 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eac00e070 con 0x7f1eb80fcd00 2023-12-08T20:27:55.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.404+0000 7f1ebe5ce700 1 -- 172.21.15.43:0/804637073 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb810db90 con 0x7f1eb80fcd00 2023-12-08T20:27:55.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.404+0000 7f1ebe5ce700 1 -- 172.21.15.43:0/804637073 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb810e070 con 0x7f1eb80fcd00 2023-12-08T20:27:55.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.404+0000 7f1eb4ff9700 1 -- 172.21.15.43:0/804637073 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1eac013420 con 0x7f1eb80fcd00 2023-12-08T20:27:55.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.404+0000 7f1eb4ff9700 1 -- 172.21.15.43:0/804637073 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eac01c640 con 0x7f1eb80fcd00 2023-12-08T20:27:55.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.405+0000 7f1ebe5ce700 1 -- 172.21.15.43:0/804637073 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea40052e0 con 0x7f1eb80fcd00 2023-12-08T20:27:55.407 INFO:tasks.workunit.client.1.smithi111.stdout:5/767: truncate d3/d8d/f105 1205618 0 2023-12-08T20:27:55.407 INFO:tasks.workunit.client.1.smithi111.stdout:5/768: truncate d3/d8d/fcd 40151 0 2023-12-08T20:27:55.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.407+0000 7f1eb4ff9700 1 -- 172.21.15.43:0/804637073 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f1eac00bb80 con 0x7f1eb80fcd00 2023-12-08T20:27:55.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.407+0000 7f1eb4ff9700 1 --2- 172.21.15.43:0/804637073 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f1ea006d050 0x7f1ea006f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:55.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.407+0000 7f1eb4ff9700 1 -- 172.21.15.43:0/804637073 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f1eac08ae50 con 0x7f1eb80fcd00 2023-12-08T20:27:55.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.408+0000 7f1eb7fff700 1 --2- 172.21.15.43:0/804637073 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f1ea006d050 0x7f1ea006f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:55.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.409+0000 7f1eb7fff700 1 --2- 172.21.15.43:0/804637073 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f1ea006d050 0x7f1ea006f500 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80fcb60 tx=0x7f1ea80090f0 comp rx=0 tx=0).ready entity=mgr.24407 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:27:55.412 INFO:tasks.workunit.client.1.smithi111.stdout:3/563: dwrite d2/d3/d51/d88/fa3 [4194304,4194304] 0 2023-12-08T20:27:55.412 INFO:tasks.workunit.client.1.smithi111.stdout:3/564: readlink d2/d3/l20 0 2023-12-08T20:27:55.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.414+0000 7f1eb4ff9700 1 -- 172.21.15.43:0/804637073 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f1eac058c50 con 0x7f1eb80fcd00 2023-12-08T20:27:55.436 INFO:tasks.workunit.client.1.smithi111.stdout:3/565: dwrite d2/d3/d13/d36/d69/f75 [4194304,4194304] 0 2023-12-08T20:27:55.436 INFO:tasks.workunit.client.1.smithi111.stdout:3/566: chown d2/d15/d17/la0 1392 1 2023-12-08T20:27:55.436 INFO:tasks.workunit.client.1.smithi111.stdout:3/567: write d2/d3/d13/d36/d44/daa/faf [427991,65914] 0 2023-12-08T20:27:55.436 INFO:tasks.workunit.client.1.smithi111.stdout:3/568: dread - d2/d12/fa2 zero size 2023-12-08T20:27:55.436 INFO:tasks.workunit.client.1.smithi111.stdout:5/769: dwrite d3/d4/d7/d29/f9b [0,4194304] 0 2023-12-08T20:27:55.436 INFO:tasks.workunit.client.1.smithi111.stdout:5/770: write d3/d4/d7/d36/f44 [5692498,53206] 0 2023-12-08T20:27:55.436 INFO:tasks.workunit.client.1.smithi111.stdout:5/771: fdatasync d3/d12/d67/ddf/ff3 0 2023-12-08T20:27:55.443 INFO:tasks.workunit.client.1.smithi111.stdout:5/772: creat d3/d12/d104/f10b x:0 0 0 2023-12-08T20:27:55.443 INFO:tasks.workunit.client.1.smithi111.stdout:5/773: fsync d3/d8d/f92 0 2023-12-08T20:27:55.443 INFO:tasks.workunit.client.1.smithi111.stdout:5/774: stat d3/d4/d4a/f7a 0 2023-12-08T20:27:55.443 INFO:tasks.workunit.client.1.smithi111.stdout:5/775: chown d3/d4/d7/l18 30 1 2023-12-08T20:27:55.446 INFO:tasks.workunit.client.1.smithi111.stdout:5/776: rename d3/d4/f8 to d3/d4/d4a/d21/da5/f10c 0 2023-12-08T20:27:55.447 INFO:tasks.workunit.client.1.smithi111.stdout:5/777: truncate d3/d6d/fa4 2731074 0 2023-12-08T20:27:55.449 INFO:tasks.workunit.client.1.smithi111.stdout:5/778: unlink d3/d4/d7/d29/dd6/fe8 0 2023-12-08T20:27:55.453 INFO:tasks.workunit.client.1.smithi111.stdout:5/779: creat d3/d12/d67/ddf/f10d x:0 0 0 2023-12-08T20:27:55.454 INFO:tasks.workunit.client.1.smithi111.stdout:5/780: rename d3/d4 to d3/d4/d7/d29/d73/d90/d10e 22 2023-12-08T20:27:55.471 INFO:tasks.workunit.client.1.smithi111.stdout:3/569: dwrite d2/d3/d6/f23 [0,4194304] 0 2023-12-08T20:27:55.489 INFO:tasks.workunit.client.1.smithi111.stdout:5/781: dwrite d3/d4/d7/d29/fba [0,4194304] 0 2023-12-08T20:27:55.491 INFO:tasks.workunit.client.1.smithi111.stdout:3/570: dwrite d2/d12/d2e/f48 [0,4194304] 0 2023-12-08T20:27:55.493 INFO:tasks.workunit.client.1.smithi111.stdout:5/782: creat d3/d4/d7/d2c/f10f x:0 0 0 2023-12-08T20:27:55.495 INFO:tasks.workunit.client.1.smithi111.stdout:3/571: creat d2/d3/d51/fb0 x:0 0 0 2023-12-08T20:27:55.495 INFO:tasks.workunit.client.1.smithi111.stdout:3/572: readlink d2/d15/d17/d5e/la8 0 2023-12-08T20:27:55.495 INFO:tasks.workunit.client.1.smithi111.stdout:3/573: stat d2/d3/d13/d36/d44/daa/faf 0 2023-12-08T20:27:55.496 INFO:tasks.workunit.client.1.smithi111.stdout:3/574: mknod d2/d3/d6/cb1 0 2023-12-08T20:27:55.496 INFO:tasks.workunit.client.1.smithi111.stdout:3/575: chown d2/d3/d6/fd 0 1 2023-12-08T20:27:55.497 INFO:tasks.workunit.client.1.smithi111.stdout:3/576: rmdir d2/d3/d13/d36/d69/d81 39 2023-12-08T20:27:55.499 INFO:tasks.workunit.client.1.smithi111.stdout:3/577: getdents d2/d3/d13/d36/d44/d8f 0 2023-12-08T20:27:55.501 INFO:tasks.workunit.client.1.smithi111.stdout:3/578: creat d2/d3/d13/d36/d69/fb2 x:0 0 0 2023-12-08T20:27:55.502 INFO:tasks.workunit.client.1.smithi111.stdout:3/579: chown d2/d15/d17/d25/d4e/f61 7 1 2023-12-08T20:27:55.502 INFO:tasks.workunit.client.1.smithi111.stdout:3/580: write d2/d12/f1a [3348495,86304] 0 2023-12-08T20:27:55.540 INFO:tasks.workunit.client.1.smithi111.stdout:6/424: sync 2023-12-08T20:27:55.541 INFO:tasks.workunit.client.1.smithi111.stdout:6/425: truncate d0/d1/d1e/f61 368496 0 2023-12-08T20:27:55.543 INFO:tasks.workunit.client.1.smithi111.stdout:6/426: creat d0/f84 x:0 0 0 2023-12-08T20:27:55.544 INFO:tasks.workunit.client.1.smithi111.stdout:6/427: symlink d0/d1/d27/d36/l85 0 2023-12-08T20:27:55.545 INFO:tasks.workunit.client.1.smithi111.stdout:6/428: write d0/f12 [4941396,111320] 0 2023-12-08T20:27:55.560 INFO:tasks.workunit.client.1.smithi111.stdout:6/429: dwrite d0/d1/d1e/f61 [0,4194304] 0 2023-12-08T20:27:55.576 INFO:tasks.workunit.client.1.smithi111.stdout:6/430: dwrite d0/d1/d27/f2f [0,4194304] 0 2023-12-08T20:27:55.577 INFO:tasks.workunit.client.1.smithi111.stdout:6/431: link d0/d1/d27/l51 d0/d1/d27/d56/l86 0 2023-12-08T20:27:55.577 INFO:tasks.workunit.client.1.smithi111.stdout:6/432: chown d0/d1/c82 183836 1 2023-12-08T20:27:55.577 INFO:tasks.workunit.client.1.smithi111.stdout:6/433: stat d0/d1/d27/l66 0 2023-12-08T20:27:55.578 INFO:tasks.workunit.client.1.smithi111.stdout:6/434: truncate d0/d1a/f2a 7034806 0 2023-12-08T20:27:55.579 INFO:tasks.workunit.client.1.smithi111.stdout:6/435: fdatasync d0/d1/d1e/f75 0 2023-12-08T20:27:55.621 INFO:tasks.workunit.client.1.smithi111.stdout:0/861: sync 2023-12-08T20:27:55.621 INFO:tasks.workunit.client.1.smithi111.stdout:8/724: sync 2023-12-08T20:27:55.621 INFO:tasks.workunit.client.1.smithi111.stdout:6/436: dwrite d0/d1/f8 [0,4194304] 0 2023-12-08T20:27:55.621 INFO:tasks.workunit.client.1.smithi111.stdout:0/862: chown d1/d4/d24/d46/d49/d7f/d95/f11d 16 1 2023-12-08T20:27:55.621 INFO:tasks.workunit.client.1.smithi111.stdout:0/863: chown d1/df/l20 783 1 2023-12-08T20:27:55.622 INFO:tasks.workunit.client.1.smithi111.stdout:6/437: creat d0/d1/d27/f87 x:0 0 0 2023-12-08T20:27:55.622 INFO:tasks.workunit.client.1.smithi111.stdout:6/438: readlink d0/d1/l14 0 2023-12-08T20:27:55.622 INFO:tasks.workunit.client.1.smithi111.stdout:0/864: mkdir d1/df/d44/daa/db2/d11f 0 2023-12-08T20:27:55.624 INFO:tasks.workunit.client.1.smithi111.stdout:6/439: rename d0/d1/d27/d36/l85 to d0/d1/d27/d36/l88 0 2023-12-08T20:27:55.625 INFO:tasks.workunit.client.1.smithi111.stdout:0/865: creat d1/d2d/d83/f120 x:0 0 0 2023-12-08T20:27:55.625 INFO:tasks.workunit.client.1.smithi111.stdout:0/866: fsync d1/df/d16/d2c/d7b/f87 0 2023-12-08T20:27:55.625 INFO:tasks.workunit.client.1.smithi111.stdout:0/867: stat d1/d4/d24/d46/d49/d7f/ddf 0 2023-12-08T20:27:55.625 INFO:tasks.workunit.client.1.smithi111.stdout:0/868: creat d1/d4/d24/d46/d58/f121 x:0 0 0 2023-12-08T20:27:55.631 INFO:tasks.workunit.client.1.smithi111.stdout:0/869: write d1/d4/d24/f45 [765081,60386] 0 2023-12-08T20:27:55.636 INFO:tasks.workunit.client.1.smithi111.stdout:0/870: write d1/d4/d24/f60 [2507478,69571] 0 2023-12-08T20:27:55.636 INFO:tasks.workunit.client.1.smithi111.stdout:0/871: rename d1/d4/d24/d46/d49/d7f/d95/db8/c10d to d1/d4/d3a/c122 0 2023-12-08T20:27:55.642 INFO:tasks.workunit.client.1.smithi111.stdout:8/725: dwrite dd/d32/dea/fa9 [0,4194304] 0 2023-12-08T20:27:55.642 INFO:tasks.workunit.client.1.smithi111.stdout:8/726: readlink dd/d32/d36/d4b/l68 0 2023-12-08T20:27:55.642 INFO:tasks.workunit.client.1.smithi111.stdout:8/727: write dd/d32/d3d/d55/fa8 [588099,88643] 0 2023-12-08T20:27:55.642 INFO:tasks.workunit.client.1.smithi111.stdout:6/440: dwrite d0/d1/d27/d36/f3e [0,4194304] 0 2023-12-08T20:27:55.642 INFO:tasks.workunit.client.1.smithi111.stdout:6/441: fdatasync d0/d1/f65 0 2023-12-08T20:27:55.645 INFO:tasks.workunit.client.1.smithi111.stdout:8/728: dread dd/d32/d3d/f6a [0,4194304] 0 2023-12-08T20:27:55.646 INFO:tasks.workunit.client.1.smithi111.stdout:6/442: symlink d0/d1/l89 0 2023-12-08T20:27:55.646 INFO:tasks.workunit.client.1.smithi111.stdout:6/443: chown d0/d1a 3 1 2023-12-08T20:27:55.654 INFO:tasks.workunit.client.1.smithi111.stdout:8/729: symlink dd/d32/lff 0 2023-12-08T20:27:55.654 INFO:tasks.workunit.client.1.smithi111.stdout:6/444: rename d0/d68/c79 to d0/d1/d1e/c8a 0 2023-12-08T20:27:55.654 INFO:tasks.workunit.client.1.smithi111.stdout:6/445: creat d0/d68/f8b x:0 0 0 2023-12-08T20:27:55.656 INFO:tasks.workunit.client.1.smithi111.stdout:6/446: creat d0/f8c x:0 0 0 2023-12-08T20:27:55.656 INFO:tasks.workunit.client.1.smithi111.stdout:6/447: chown d0/f13 317 1 2023-12-08T20:27:55.656 INFO:tasks.workunit.client.1.smithi111.stdout:8/730: write dd/f12 [2146979,25111] 0 2023-12-08T20:27:55.656 INFO:tasks.workunit.client.1.smithi111.stdout:8/731: chown dd/d2d/d62/d83/ffe 0 1 2023-12-08T20:27:55.656 INFO:tasks.workunit.client.1.smithi111.stdout:6/448: mkdir d0/d1/d27/d36/d8d 0 2023-12-08T20:27:55.656 INFO:tasks.workunit.client.1.smithi111.stdout:6/449: write d0/d1/f65 [5122428,108718] 0 2023-12-08T20:27:55.657 INFO:tasks.workunit.client.1.smithi111.stdout:8/732: truncate dd/d35/f51 3544706 0 2023-12-08T20:27:55.658 INFO:tasks.workunit.client.1.smithi111.stdout:8/733: symlink dd/d35/d42/db4/l100 0 2023-12-08T20:27:55.658 INFO:tasks.workunit.client.1.smithi111.stdout:8/734: fdatasync dd/d2d/f33 0 2023-12-08T20:27:55.659 INFO:tasks.workunit.client.1.smithi111.stdout:0/872: dwrite d1/d69/f11e [0,4194304] 0 2023-12-08T20:27:55.659 INFO:tasks.workunit.client.1.smithi111.stdout:0/873: fdatasync d1/df/d44/d37/f8a 0 2023-12-08T20:27:55.662 INFO:tasks.workunit.client.1.smithi111.stdout:0/874: symlink d1/d4/d24/d46/d58/d65/l123 0 2023-12-08T20:27:55.667 INFO:tasks.workunit.client.1.smithi111.stdout:0/875: mknod d1/df/d16/d2c/d7e/c124 0 2023-12-08T20:27:55.670 INFO:tasks.workunit.client.1.smithi111.stdout:0/876: rename d1/df/d44/d37/c71 to d1/d4/d24/d46/d49/d7f/ddf/c125 0 2023-12-08T20:27:55.671 INFO:tasks.workunit.client.1.smithi111.stdout:0/877: stat d1/d4/d24/d46/d58/d65/l11b 0 2023-12-08T20:27:55.672 INFO:tasks.workunit.client.1.smithi111.stdout:0/878: dread d1/df/d44/d37/f8a [0,4194304] 0 2023-12-08T20:27:55.674 INFO:tasks.workunit.client.1.smithi111.stdout:6/450: dwrite d0/d1/d27/f87 [0,4194304] 0 2023-12-08T20:27:55.674 INFO:tasks.workunit.client.1.smithi111.stdout:6/451: stat d0/d1/d1e/l78 0 2023-12-08T20:27:55.674 INFO:tasks.workunit.client.1.smithi111.stdout:6/452: chown d0/d1b/c50 48 1 2023-12-08T20:27:55.680 INFO:tasks.workunit.client.1.smithi111.stdout:6/453: unlink d0/d1a/c83 0 2023-12-08T20:27:55.682 INFO:tasks.workunit.client.1.smithi111.stdout:6/454: mkdir d0/d68/d8e 0 2023-12-08T20:27:55.682 INFO:tasks.workunit.client.1.smithi111.stdout:6/455: chown d0/f32 99 1 2023-12-08T20:27:55.683 INFO:tasks.workunit.client.1.smithi111.stdout:6/456: rename d0/d1b/c54 to d0/d1/d27/d56/c8f 0 2023-12-08T20:27:55.684 INFO:tasks.workunit.client.1.smithi111.stdout:6/457: getdents d0/d1b/d7a 0 2023-12-08T20:27:55.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.684+0000 7f1ebe5ce700 1 -- 172.21.15.43:0/804637073 --> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ea4000bf0 con 0x7f1ea006d050 2023-12-08T20:27:55.685 INFO:tasks.workunit.client.1.smithi111.stdout:0/879: dwrite d1/d69/d8b/f9c [0,4194304] 0 2023-12-08T20:27:55.685 INFO:tasks.workunit.client.1.smithi111.stdout:0/880: chown d1/l28 12902 1 2023-12-08T20:27:55.688 INFO:tasks.workunit.client.1.smithi111.stdout:0/881: creat d1/d2d/d83/f126 x:0 0 0 2023-12-08T20:27:55.700 INFO:tasks.workunit.client.1.smithi111.stdout:0/882: dwrite d1/dd/d47/fbd [0,4194304] 0 2023-12-08T20:27:55.703 INFO:tasks.workunit.client.1.smithi111.stdout:0/883: creat d1/df/d56/f127 x:0 0 0 2023-12-08T20:27:55.703 INFO:tasks.workunit.client.1.smithi111.stdout:0/884: write d1/d4/d24/f45 [4239475,25404] 0 2023-12-08T20:27:55.703 INFO:tasks.workunit.client.1.smithi111.stdout:0/885: stat d1/d4/d3a/l99 0 2023-12-08T20:27:55.703 INFO:tasks.workunit.client.1.smithi111.stdout:0/886: chown d1/d4/d24/d108 362 1 2023-12-08T20:27:55.703 INFO:tasks.workunit.client.1.smithi111.stdout:0/887: truncate d1/d2d/d83/ff3 570690 0 2023-12-08T20:27:55.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.702+0000 7f1eb4ff9700 1 -- 172.21.15.43:0/804637073 <== mgr.24407 v2:172.21.15.111:6828/940639390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f1ea4000bf0 con 0x7f1ea006d050 2023-12-08T20:27:55.704 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-08T20:27:55.704 INFO:teuthology.orchestra.run.smithi043.stdout:alertmanager.smithi043 smithi043 *:9093,9094 starting - - - - 2023-12-08T20:27:55.704 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi043 smithi043 running (6m) 22s ago 6m 7432k - 17.2.7-119-ge2143d99 f761b6e42225 f84d492b732c 2023-12-08T20:27:55.704 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi111 smithi111 running (5m) 18s ago 5m 7428k - 17.2.7-119-ge2143d99 f761b6e42225 88b53685ae54 2023-12-08T20:27:55.704 INFO:teuthology.orchestra.run.smithi043.stdout:grafana.smithi043 smithi043 *:3000 running (5m) 22s ago 5m 91.2M - 9.4.7 954c08fa6188 503ad8a7ae04 2023-12-08T20:27:55.704 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.akrjef smithi043 running (2m) 22s ago 2m 16.4M - 17.2.7-119-ge2143d99 f761b6e42225 1c0cb8d34ef8 2023-12-08T20:27:55.704 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.pjmszb smithi043 running (2m) 22s ago 2m 1215M - 17.2.7-119-ge2143d99 f761b6e42225 d7eee0c78093 2023-12-08T20:27:55.704 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.svpasm smithi111 running (2m) 18s ago 2m 14.0M - 17.2.7-119-ge2143d99 f761b6e42225 657d4d1cf4b2 2023-12-08T20:27:55.705 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.veeegc smithi111 running (2m) 18s ago 2m 111M - 17.2.7-119-ge2143d99 f761b6e42225 31f794a388ab 2023-12-08T20:27:55.705 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi043.hqcdcm smithi043 *:9283 running (7m) 22s ago 7m 407M - 17.2.7-119-ge2143d99 f761b6e42225 58b656e8e333 2023-12-08T20:27:55.705 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi111.mtcffu smithi111 *:8443,9283 running (40s) 18s ago 5m 492M - 19.0.0-44-g9dcc13bb f28f2b94f153 d2b826bdf0bf 2023-12-08T20:27:55.705 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi043 smithi043 running (7m) 22s ago 7m 82.3M 2048M 17.2.7-119-ge2143d99 f761b6e42225 fe2a56effef3 2023-12-08T20:27:55.705 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi111 smithi111 running (5m) 18s ago 5m 54.5M 2048M 17.2.7-119-ge2143d99 f761b6e42225 2ae21cf3fa1e 2023-12-08T20:27:55.705 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi043 smithi043 *:9100 starting - - - - 2023-12-08T20:27:55.705 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi111 smithi111 *:9100 running (5m) 18s ago 5m 16.9M - 1.5.0 0da6a335fe13 73de1624518e 2023-12-08T20:27:55.705 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (4m) 22s ago 4m 124M 1570M 17.2.7-119-ge2143d99 f761b6e42225 462eeaf62b2c 2023-12-08T20:27:55.705 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi043 running (4m) 22s ago 4m 133M 1570M 17.2.7-119-ge2143d99 f761b6e42225 dde419c88a89 2023-12-08T20:27:55.705 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi043 running (4m) 22s ago 4m 100M 1570M 17.2.7-119-ge2143d99 f761b6e42225 f7e812026ef5 2023-12-08T20:27:55.705 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi111 running (3m) 18s ago 3m 122M 2592M 17.2.7-119-ge2143d99 f761b6e42225 2a738d30441c 2023-12-08T20:27:55.705 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi111 running (3m) 18s ago 3m 108M 2592M 17.2.7-119-ge2143d99 f761b6e42225 38cdb6a88694 2023-12-08T20:27:55.705 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi111 running (3m) 18s ago 3m 108M 2592M 17.2.7-119-ge2143d99 f761b6e42225 59a9ce8c1141 2023-12-08T20:27:55.705 INFO:teuthology.orchestra.run.smithi043.stdout:prometheus.smithi043 smithi043 *:9095 running (4m) 22s ago 5m 56.7M - 2.43.0 a07b618ecd1d 88bcbb698598 2023-12-08T20:27:55.706 INFO:tasks.workunit.client.1.smithi111.stdout:0/888: rename d1/d2d/d83/f126 to d1/f128 0 2023-12-08T20:27:55.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.705+0000 7f1ebe5ce700 1 -- 172.21.15.43:0/804637073 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f1ea006d050 msgr2=0x7f1ea006f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:55.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.705+0000 7f1ebe5ce700 1 --2- 172.21.15.43:0/804637073 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f1ea006d050 0x7f1ea006f500 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80fcb60 tx=0x7f1ea80090f0 comp rx=0 tx=0).stop 2023-12-08T20:27:55.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.705+0000 7f1ebe5ce700 1 -- 172.21.15.43:0/804637073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1eb80fcd00 msgr2=0x7f1eb810ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:55.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.705+0000 7f1ebe5ce700 1 --2- 172.21.15.43:0/804637073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1eb80fcd00 0x7f1eb810ca40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1eac008fb0 tx=0x7f1eac009e30 comp rx=0 tx=0).stop 2023-12-08T20:27:55.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.705+0000 7f1ebe5ce700 1 -- 172.21.15.43:0/804637073 shutdown_connections 2023-12-08T20:27:55.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.705+0000 7f1ebe5ce700 1 --2- 172.21.15.43:0/804637073 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f1ea006d050 0x7f1ea006f500 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:55.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.705+0000 7f1ebe5ce700 1 --2- 172.21.15.43:0/804637073 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1eb80fbaf0 0x7f1eb810c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:55.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.705+0000 7f1ebe5ce700 1 --2- 172.21.15.43:0/804637073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1eb80fcd00 0x7f1eb810ca40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:55.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.705+0000 7f1ebe5ce700 1 -- 172.21.15.43:0/804637073 >> 172.21.15.43:0/804637073 conn(0x7f1eb80f71b0 msgr2=0x7f1eb80f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:55.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.705+0000 7f1ebe5ce700 1 -- 172.21.15.43:0/804637073 shutdown_connections 2023-12-08T20:27:55.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.705+0000 7f1ebe5ce700 1 -- 172.21.15.43:0/804637073 wait complete. 2023-12-08T20:27:55.708 INFO:tasks.workunit.client.1.smithi111.stdout:0/889: rename d1/d2d/d83/f120 to d1/df/d16/d2c/d7b/dba/f129 0 2023-12-08T20:27:55.708 INFO:tasks.workunit.client.1.smithi111.stdout:0/890: write d1/d69/fc5 [411650,86275] 0 2023-12-08T20:27:55.709 INFO:tasks.workunit.client.1.smithi111.stdout:6/458: dwrite d0/d1b/f1d [0,4194304] 0 2023-12-08T20:27:55.710 INFO:tasks.workunit.client.1.smithi111.stdout:0/891: link d1/d4/d24/f60 d1/df/d44/daa/db2/f12a 0 2023-12-08T20:27:55.725 INFO:tasks.workunit.client.1.smithi111.stdout:0/892: dwrite d1/d2d/f41 [8388608,4194304] 0 2023-12-08T20:27:55.725 INFO:tasks.workunit.client.1.smithi111.stdout:0/893: chown d1/f100 7 1 2023-12-08T20:27:55.728 INFO:tasks.workunit.client.1.smithi111.stdout:0/894: link d1/d69/fc5 d1/d2d/d83/f12b 0 2023-12-08T20:27:55.744 INFO:tasks.workunit.client.1.smithi111.stdout:0/895: dwrite d1/d4/d24/d46/fa8 [0,4194304] 0 2023-12-08T20:27:55.749 INFO:tasks.workunit.client.1.smithi111.stdout:0/896: mkdir d1/d2d/d83/dab/d12c 0 2023-12-08T20:27:55.758 INFO:tasks.workunit.client.1.smithi111.stdout:0/897: mkdir d1/d4/d24/d2f/d12d 0 2023-12-08T20:27:55.758 INFO:tasks.workunit.client.1.smithi111.stdout:1/614: sync 2023-12-08T20:27:55.758 INFO:tasks.workunit.client.1.smithi111.stdout:2/590: sync 2023-12-08T20:27:55.758 INFO:tasks.workunit.client.1.smithi111.stdout:9/694: sync 2023-12-08T20:27:55.758 INFO:tasks.workunit.client.1.smithi111.stdout:9/695: fsync d2/f7 0 2023-12-08T20:27:55.758 INFO:tasks.workunit.client.1.smithi111.stdout:4/513: sync 2023-12-08T20:27:55.758 INFO:tasks.workunit.client.1.smithi111.stdout:4/514: chown d8/c17 0 1 2023-12-08T20:27:55.758 INFO:tasks.workunit.client.1.smithi111.stdout:4/515: truncate d8/da/d2c/d1f/f6f 1314204 0 2023-12-08T20:27:55.758 INFO:tasks.workunit.client.1.smithi111.stdout:4/516: chown d8/da/f25 1437435 1 2023-12-08T20:27:55.759 INFO:tasks.workunit.client.1.smithi111.stdout:4/517: write d8/da/d2c/d1f/d40/f60 [278962,16118] 0 2023-12-08T20:27:55.759 INFO:tasks.workunit.client.1.smithi111.stdout:4/518: readlink d8/da/d2c/d1f/d40/l41 0 2023-12-08T20:27:55.759 INFO:tasks.workunit.client.1.smithi111.stdout:1/615: write d0/f2f [1003135,79681] 0 2023-12-08T20:27:55.761 INFO:tasks.workunit.client.1.smithi111.stdout:0/898: rename d1/d4/d24/d46/d49/d7f/ddf/cfa to d1/d4/d24/d46/d58/d65/c12e 0 2023-12-08T20:27:55.762 INFO:tasks.workunit.client.1.smithi111.stdout:0/899: dread d1/d69/d8b/fa3 [0,4194304] 0 2023-12-08T20:27:55.762 INFO:tasks.workunit.client.1.smithi111.stdout:2/591: truncate d1/d1d/d22/f76 1214030 0 2023-12-08T20:27:55.764 INFO:tasks.workunit.client.1.smithi111.stdout:9/696: creat d2/d8/dd/d1a/d1e/d2d/d8f/ff8 x:0 0 0 2023-12-08T20:27:55.764 INFO:tasks.workunit.client.1.smithi111.stdout:9/697: chown d2/da 31361 1 2023-12-08T20:27:55.765 INFO:tasks.workunit.client.1.smithi111.stdout:4/519: creat d8/d30/fa3 x:0 0 0 2023-12-08T20:27:55.766 INFO:tasks.workunit.client.1.smithi111.stdout:1/616: dread d0/d6/d33/f4f [0,4194304] 0 2023-12-08T20:27:55.766 INFO:tasks.workunit.client.1.smithi111.stdout:1/617: truncate d0/d6/d33/d60/f9d 709848 0 2023-12-08T20:27:55.766 INFO:tasks.workunit.client.1.smithi111.stdout:4/520: write d8/da/d29/d6e/f96 [1917115,124806] 0 2023-12-08T20:27:55.768 INFO:tasks.workunit.client.1.smithi111.stdout:0/900: unlink d1/df/d44/d37/d5c/ffc 0 2023-12-08T20:27:55.768 INFO:tasks.workunit.client.1.smithi111.stdout:0/901: dread - d1/df/d44/d37/d5c/f67 zero size 2023-12-08T20:27:55.771 INFO:tasks.workunit.client.1.smithi111.stdout:2/592: symlink d1/d29/d4e/dbf/ld9 0 2023-12-08T20:27:55.771 INFO:tasks.workunit.client.1.smithi111.stdout:9/698: chown d2/l61 2975231 1 2023-12-08T20:27:55.775 INFO:tasks.workunit.client.1.smithi111.stdout:0/902: creat d1/df/d44/daa/db2/d11f/f12f x:0 0 0 2023-12-08T20:27:55.776 INFO:tasks.workunit.client.1.smithi111.stdout:0/903: write d1/df/d56/fc7 [962363,75348] 0 2023-12-08T20:27:55.776 INFO:tasks.workunit.client.1.smithi111.stdout:0/904: fdatasync d1/dd/d4a/f84 0 2023-12-08T20:27:55.777 INFO:tasks.workunit.client.1.smithi111.stdout:2/593: creat d1/d1d/d68/d73/dd6/fda x:0 0 0 2023-12-08T20:27:55.778 INFO:tasks.workunit.client.1.smithi111.stdout:9/699: mknod d2/d8/dd/d1a/d66/cf9 0 2023-12-08T20:27:55.779 INFO:tasks.workunit.client.1.smithi111.stdout:1/618: mkdir d0/d6/d33/d15/dd7 0 2023-12-08T20:27:55.782 INFO:tasks.workunit.client.1.smithi111.stdout:4/521: truncate d8/da/db/d7f/d93/f4c 780456 0 2023-12-08T20:27:55.784 INFO:tasks.workunit.client.1.smithi111.stdout:0/905: rmdir d1/d4/d24/d46/d49/d7f 39 2023-12-08T20:27:55.786 INFO:tasks.workunit.client.1.smithi111.stdout:2/594: dread f0 [0,4194304] 0 2023-12-08T20:27:55.786 INFO:tasks.workunit.client.1.smithi111.stdout:2/595: chown d1/d1d/d1f/d25/d3d/d41/f8b 58828436 1 2023-12-08T20:27:55.786 INFO:tasks.workunit.client.1.smithi111.stdout:9/700: getdents d2/d8/dd/d1a/d1e/d2d/d35 0 2023-12-08T20:27:55.790 INFO:tasks.workunit.client.1.smithi111.stdout:4/522: creat d8/da/db/d7f/d93/d91/fa4 x:0 0 0 2023-12-08T20:27:55.792 INFO:tasks.workunit.client.1.smithi111.stdout:0/906: symlink d1/df/d16/l130 0 2023-12-08T20:27:55.797 INFO:tasks.workunit.client.1.smithi111.stdout:9/701: mkdir d2/d8/dd/d1a/d1e/d2d/d35/d71/dfa 0 2023-12-08T20:27:55.799 INFO:tasks.workunit.client.1.smithi111.stdout:1/619: rename d0/d6/d33/d15/c88 to d0/d8e/dd4/cd8 0 2023-12-08T20:27:55.800 INFO:tasks.workunit.client.1.smithi111.stdout:4/523: dread d8/da/d2c/d1f/d40/f44 [0,4194304] 0 2023-12-08T20:27:55.800 INFO:tasks.workunit.client.1.smithi111.stdout:0/907: rmdir d1/d4/d24 39 2023-12-08T20:27:55.802 INFO:tasks.workunit.client.1.smithi111.stdout:2/596: link d1/d1d/d1f/d36/l98 d1/d1d/d1f/d25/d3d/d41/db9/dc5/ldb 0 2023-12-08T20:27:55.805 INFO:tasks.workunit.client.1.smithi111.stdout:9/702: mkdir d2/d8/dd/d1a/d1e/d2d/db9/dd5/dfb 0 2023-12-08T20:27:55.809 INFO:tasks.workunit.client.1.smithi111.stdout:9/703: rename d2/l61 to d2/d8/dd/d1a/d1e/d2d/d4a/lfc 0 2023-12-08T20:27:55.811 INFO:tasks.workunit.client.1.smithi111.stdout:9/704: mknod d2/d8/dd/d56/cfd 0 2023-12-08T20:27:55.812 INFO:tasks.workunit.client.1.smithi111.stdout:0/908: write d1/d4/d3a/d8c/f96 [3425039,47507] 0 2023-12-08T20:27:55.814 INFO:tasks.workunit.client.1.smithi111.stdout:9/705: mknod d2/d8/d8c/cfe 0 2023-12-08T20:27:55.816 INFO:tasks.workunit.client.1.smithi111.stdout:9/706: getdents d2/d8/dd 0 2023-12-08T20:27:55.816 INFO:tasks.workunit.client.1.smithi111.stdout:9/707: fsync d2/d8/dd/d1a/d1e/d2d/d8f/fd3 0 2023-12-08T20:27:55.818 INFO:tasks.workunit.client.1.smithi111.stdout:9/708: link d2/d8/dd/d1a/d74/fdb d2/d8/d8c/d96/fff 0 2023-12-08T20:27:55.820 INFO:tasks.workunit.client.1.smithi111.stdout:9/709: creat d2/d8/dd/d56/f100 x:0 0 0 2023-12-08T20:27:55.820 INFO:tasks.workunit.client.1.smithi111.stdout:9/710: dread - d2/d8/fda zero size 2023-12-08T20:27:55.820 INFO:tasks.workunit.client.1.smithi111.stdout:9/711: chown d2/d8/d8c 378923 1 2023-12-08T20:27:55.822 INFO:tasks.workunit.client.1.smithi111.stdout:9/712: symlink d2/d8/dd/d1a/d74/dbf/l101 0 2023-12-08T20:27:55.823 INFO:tasks.workunit.client.1.smithi111.stdout:9/713: dread - d2/d8/dd/d1a/d74/fdb zero size 2023-12-08T20:27:55.823 INFO:tasks.workunit.client.1.smithi111.stdout:9/714: chown d2/d8/dd/f69 27 1 2023-12-08T20:27:55.823 INFO:tasks.workunit.client.1.smithi111.stdout:9/715: write d2/d8/dd/d1a/d1e/d2d/d8f/fe8 [371285,115469] 0 2023-12-08T20:27:55.824 INFO:tasks.workunit.client.1.smithi111.stdout:9/716: truncate d2/d8/dd/d56/f73 536614 0 2023-12-08T20:27:55.827 INFO:tasks.workunit.client.1.smithi111.stdout:9/717: dread d2/d8/dd/d56/fad [0,4194304] 0 2023-12-08T20:27:55.828 INFO:tasks.workunit.client.1.smithi111.stdout:9/718: creat d2/d8/d8c/f102 x:0 0 0 2023-12-08T20:27:55.829 INFO:tasks.workunit.client.1.smithi111.stdout:9/719: creat d2/d8/dd/d1a/d74/dbf/f103 x:0 0 0 2023-12-08T20:27:55.829 INFO:tasks.workunit.client.1.smithi111.stdout:9/720: truncate d2/d8/dd/d1a/d1e/de7/f28 1113450 0 2023-12-08T20:27:55.831 INFO:tasks.workunit.client.1.smithi111.stdout:9/721: truncate d2/d8/dd/d1a/d1e/d2d/d4a/d62/fb7 918456 0 2023-12-08T20:27:55.831 INFO:tasks.workunit.client.1.smithi111.stdout:9/722: write d2/d8/dd/d1a/d1e/d2d/d8f/faa [803027,36608] 0 2023-12-08T20:27:55.834 INFO:tasks.workunit.client.1.smithi111.stdout:4/524: dwrite d8/da/db/d7f/d93/f4c [0,4194304] 0 2023-12-08T20:27:55.834 INFO:tasks.workunit.client.1.smithi111.stdout:1/620: dwrite d0/f71 [0,4194304] 0 2023-12-08T20:27:55.835 INFO:tasks.workunit.client.1.smithi111.stdout:2/597: dwrite d1/f70 [0,4194304] 0 2023-12-08T20:27:55.835 INFO:tasks.workunit.client.1.smithi111.stdout:0/909: dwrite d1/d4/d24/d46/d49/d7f/d95/f11d [0,4194304] 0 2023-12-08T20:27:55.836 INFO:tasks.workunit.client.1.smithi111.stdout:4/525: rmdir d8/da/d2c/d1f/d40/d73 0 2023-12-08T20:27:55.839 INFO:tasks.workunit.client.1.smithi111.stdout:9/723: dread d2/d8/dd/d56/f72 [0,4194304] 0 2023-12-08T20:27:55.841 INFO:tasks.workunit.client.1.smithi111.stdout:1/621: getdents d0 0 2023-12-08T20:27:55.842 INFO:tasks.workunit.client.1.smithi111.stdout:1/622: write d0/d4d/f57 [12068,75098] 0 2023-12-08T20:27:55.842 INFO:tasks.workunit.client.1.smithi111.stdout:1/623: chown d0/d6/d33/d15/d51/f21 1360690 1 2023-12-08T20:27:55.843 INFO:tasks.workunit.client.1.smithi111.stdout:1/624: write d0/d6/f14 [7470293,108834] 0 2023-12-08T20:27:55.844 INFO:tasks.workunit.client.1.smithi111.stdout:2/598: mkdir d1/d29/d4e/ddc 0 2023-12-08T20:27:55.844 INFO:tasks.workunit.client.1.smithi111.stdout:2/599: truncate d1/d1d/d68/d73/dd6/fda 856363 0 2023-12-08T20:27:55.858 INFO:tasks.workunit.client.1.smithi111.stdout:2/600: dwrite d1/d1d/d1f/d25/d3d/d41/f6c [0,4194304] 0 2023-12-08T20:27:55.860 INFO:tasks.workunit.client.1.smithi111.stdout:0/910: unlink d1/d4/d24/d46/d58/f121 0 2023-12-08T20:27:55.861 INFO:tasks.workunit.client.1.smithi111.stdout:4/526: creat d8/da/d2c/d1f/d2b/d4b/fa5 x:0 0 0 2023-12-08T20:27:55.861 INFO:tasks.workunit.client.1.smithi111.stdout:0/911: dread d1/dd/d47/fe9 [0,4194304] 0 2023-12-08T20:27:55.862 INFO:tasks.workunit.client.1.smithi111.stdout:9/724: mknod d2/d8/dd/d56/da1/c104 0 2023-12-08T20:27:55.863 INFO:tasks.workunit.client.1.smithi111.stdout:1/625: mkdir d0/d6/d33/d15/d51/d5b/d59/db8/dd9 0 2023-12-08T20:27:55.864 INFO:tasks.workunit.client.1.smithi111.stdout:1/626: read d0/d6/d33/d15/d51/f6e [273694,96764] 0 2023-12-08T20:27:55.867 INFO:tasks.workunit.client.1.smithi111.stdout:2/601: creat d1/d29/d4e/ddc/fdd x:0 0 0 2023-12-08T20:27:55.868 INFO:tasks.workunit.client.1.smithi111.stdout:4/527: creat d8/da/db/d7f/d93/d77/fa6 x:0 0 0 2023-12-08T20:27:55.870 INFO:tasks.workunit.client.1.smithi111.stdout:0/912: link d1/dd/le5 d1/d4/d24/d46/d49/d7f/d95/db8/l131 0 2023-12-08T20:27:55.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.870+0000 7f1a20df8700 1 -- 172.21.15.43:0/2375573050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a1c0fcd00 msgr2=0x7f1a1c0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:55.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.870+0000 7f1a20df8700 1 --2- 172.21.15.43:0/2375573050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a1c0fcd00 0x7f1a1c0fd150 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1a100049c0 tx=0x7f1a10009e30 comp rx=0 tx=0).stop 2023-12-08T20:27:55.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.871+0000 7f1a20df8700 1 -- 172.21.15.43:0/2375573050 shutdown_connections 2023-12-08T20:27:55.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.871+0000 7f1a20df8700 1 --2- 172.21.15.43:0/2375573050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a1c0fcd00 0x7f1a1c0fd150 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:55.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.871+0000 7f1a20df8700 1 --2- 172.21.15.43:0/2375573050 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a1c0fbaf0 0x7f1a1c0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:55.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.871+0000 7f1a20df8700 1 -- 172.21.15.43:0/2375573050 >> 172.21.15.43:0/2375573050 conn(0x7f1a1c0f71b0 msgr2=0x7f1a1c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:55.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.871+0000 7f1a20df8700 1 -- 172.21.15.43:0/2375573050 shutdown_connections 2023-12-08T20:27:55.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.871+0000 7f1a20df8700 1 -- 172.21.15.43:0/2375573050 wait complete. 2023-12-08T20:27:55.873 INFO:tasks.workunit.client.1.smithi111.stdout:1/627: symlink d0/d8e/lda 0 2023-12-08T20:27:55.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.872+0000 7f1a20df8700 1 Processor -- start 2023-12-08T20:27:55.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.872+0000 7f1a20df8700 1 -- start start 2023-12-08T20:27:55.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.872+0000 7f1a20df8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a1c0fbaf0 0x7f1a1c10b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:55.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.872+0000 7f1a20df8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a1c0fcd00 0x7f1a1c10b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:55.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.872+0000 7f1a20df8700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c10bdc0 con 0x7f1a1c0fbaf0 2023-12-08T20:27:55.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.873+0000 7f1a20df8700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c10c660 con 0x7f1a1c0fcd00 2023-12-08T20:27:55.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.873+0000 7f1a1a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a1c0fbaf0 0x7f1a1c10b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:55.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.873+0000 7f1a1a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a1c0fbaf0 0x7f1a1c10b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38470/0 (socket says 172.21.15.43:38470) 2023-12-08T20:27:55.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.873+0000 7f1a1a59c700 1 -- 172.21.15.43:0/2812035020 learned_addr learned my addr 172.21.15.43:0/2812035020 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:27:55.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.873+0000 7f1a19d9b700 1 --2- 172.21.15.43:0/2812035020 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a1c0fcd00 0x7f1a1c10b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:55.875 INFO:tasks.workunit.client.1.smithi111.stdout:2/602: mkdir d1/d1d/d1f/d25/dde 0 2023-12-08T20:27:55.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.873+0000 7f1a1a59c700 1 -- 172.21.15.43:0/2812035020 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a1c0fcd00 msgr2=0x7f1a1c10b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:55.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.873+0000 7f1a1a59c700 1 --2- 172.21.15.43:0/2812035020 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a1c0fcd00 0x7f1a1c10b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:55.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.873+0000 7f1a1a59c700 1 -- 172.21.15.43:0/2812035020 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a10005040 con 0x7f1a1c0fbaf0 2023-12-08T20:27:55.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.874+0000 7f1a1a59c700 1 --2- 172.21.15.43:0/2812035020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a1c0fbaf0 0x7f1a1c10b230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00eb70 tx=0x7f1a0c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:27:55.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.874+0000 7f1a0affd700 1 -- 172.21.15.43:0/2812035020 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a0c007cc0 con 0x7f1a1c0fbaf0 2023-12-08T20:27:55.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.874+0000 7f1a0affd700 1 -- 172.21.15.43:0/2812035020 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1a0c00f040 con 0x7f1a1c0fbaf0 2023-12-08T20:27:55.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.874+0000 7f1a0affd700 1 -- 172.21.15.43:0/2812035020 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a0c00c950 con 0x7f1a1c0fbaf0 2023-12-08T20:27:55.876 INFO:tasks.workunit.client.1.smithi111.stdout:9/725: dwrite d2/fe1 [0,4194304] 0 2023-12-08T20:27:55.877 INFO:tasks.workunit.client.1.smithi111.stdout:9/726: fdatasync d2/d8/d8c/dbb/fc5 0 2023-12-08T20:27:55.877 INFO:tasks.workunit.client.1.smithi111.stdout:9/727: fdatasync d2/d8/dd/d56/f58 0 2023-12-08T20:27:55.877 INFO:tasks.workunit.client.1.smithi111.stdout:9/728: write d2/d8/f4d [581810,29976] 0 2023-12-08T20:27:55.877 INFO:tasks.workunit.client.1.smithi111.stdout:0/913: link d1/df/d16/d2c/f118 d1/d4/d3a/f132 0 2023-12-08T20:27:55.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.875+0000 7f1a20df8700 1 -- 172.21.15.43:0/2812035020 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1c10c860 con 0x7f1a1c0fbaf0 2023-12-08T20:27:55.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.875+0000 7f1a20df8700 1 -- 172.21.15.43:0/2812035020 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1c10cd70 con 0x7f1a1c0fbaf0 2023-12-08T20:27:55.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.876+0000 7f1a20df8700 1 -- 172.21.15.43:0/2812035020 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1c04bb80 con 0x7f1a1c0fbaf0 2023-12-08T20:27:55.879 INFO:tasks.workunit.client.1.smithi111.stdout:7/592: sync 2023-12-08T20:27:55.879 INFO:tasks.workunit.client.1.smithi111.stdout:3/581: sync 2023-12-08T20:27:55.879 INFO:tasks.workunit.client.1.smithi111.stdout:5/783: sync 2023-12-08T20:27:55.879 INFO:tasks.workunit.client.1.smithi111.stdout:3/582: dread - d2/d15/f87 zero size 2023-12-08T20:27:55.879 INFO:tasks.workunit.client.1.smithi111.stdout:3/583: fdatasync d2/d15/d17/d25/f26 0 2023-12-08T20:27:55.879 INFO:tasks.workunit.client.1.smithi111.stdout:5/784: write d3/d6d/ff1 [845859,40938] 0 2023-12-08T20:27:55.880 INFO:tasks.workunit.client.1.smithi111.stdout:1/628: truncate d0/d6/d33/d15/d51/d5b/fc1 3798412 0 2023-12-08T20:27:55.880 INFO:tasks.workunit.client.1.smithi111.stdout:4/528: dread d8/da/d2c/d1f/fe [0,4194304] 0 2023-12-08T20:27:55.880 INFO:tasks.workunit.client.1.smithi111.stdout:1/629: read d0/d6/d34/f96 [990961,8167] 0 2023-12-08T20:27:55.880 INFO:tasks.workunit.client.1.smithi111.stdout:2/603: mkdir d1/d1d/d1f/d25/d96/ddf 0 2023-12-08T20:27:55.880 INFO:tasks.workunit.client.1.smithi111.stdout:2/604: chown d1/d1d/d1f/d25/d67/l77 30339712 1 2023-12-08T20:27:55.880 INFO:tasks.workunit.client.1.smithi111.stdout:2/605: chown d1/d29/d53/d91/fbb 1551390 1 2023-12-08T20:27:55.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.878+0000 7f1a0affd700 1 -- 172.21.15.43:0/2812035020 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f1a0c00cab0 con 0x7f1a1c0fbaf0 2023-12-08T20:27:55.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.878+0000 7f1a0affd700 1 --2- 172.21.15.43:0/2812035020 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f1a0406ae40 0x7f1a0406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:55.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.879+0000 7f1a0affd700 1 -- 172.21.15.43:0/2812035020 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f1a0c088d90 con 0x7f1a1c0fbaf0 2023-12-08T20:27:55.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.879+0000 7f1a19d9b700 1 --2- 172.21.15.43:0/2812035020 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f1a0406ae40 0x7f1a0406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:55.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.882+0000 7f1a19d9b700 1 --2- 172.21.15.43:0/2812035020 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f1a0406ae40 0x7f1a0406d2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000d5c0 tx=0x7f1a1000b040 comp rx=0 tx=0).ready entity=mgr.24407 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:27:55.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:55.885+0000 7f1a0affd700 1 -- 172.21.15.43:0/2812035020 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f1a0c0534d0 con 0x7f1a1c0fbaf0 2023-12-08T20:27:55.887 INFO:tasks.workunit.client.1.smithi111.stdout:9/729: rename d2/d8/dd/d1a/d66 to d2/d8/dd/d1a/d1e/d2d/d35/d71/d105 0 2023-12-08T20:27:55.888 INFO:tasks.workunit.client.1.smithi111.stdout:3/584: dread d2/d3/d13/d36/d44/d8f/f91 [0,4194304] 0 2023-12-08T20:27:55.888 INFO:tasks.workunit.client.1.smithi111.stdout:3/585: dread - d2/d3/d13/d36/d69/fb2 zero size 2023-12-08T20:27:55.892 INFO:tasks.workunit.client.1.smithi111.stdout:8/735: sync 2023-12-08T20:27:55.892 INFO:tasks.workunit.client.1.smithi111.stdout:6/459: sync 2023-12-08T20:27:55.892 INFO:tasks.workunit.client.1.smithi111.stdout:7/593: getdents da/d5c/d6e 0 2023-12-08T20:27:55.892 INFO:tasks.workunit.client.1.smithi111.stdout:7/594: truncate da/d25/f2e 4951259 0 2023-12-08T20:27:55.892 INFO:tasks.workunit.client.1.smithi111.stdout:0/914: getdents d1/d4/d24/d46/d58 0 2023-12-08T20:27:55.892 INFO:tasks.workunit.client.1.smithi111.stdout:0/915: fdatasync d1/d2d/d83/f12b 0 2023-12-08T20:27:55.892 INFO:tasks.workunit.client.1.smithi111.stdout:0/916: truncate d1/d4/d24/d46/d49/d7f/fa6 245518 0 2023-12-08T20:27:55.892 INFO:tasks.workunit.client.1.smithi111.stdout:0/917: fsync d1/dd/f4e 0 2023-12-08T20:27:55.892 INFO:tasks.workunit.client.1.smithi111.stdout:4/529: mkdir d8/da/db/d7f/da7 0 2023-12-08T20:27:55.892 INFO:tasks.workunit.client.1.smithi111.stdout:4/530: stat d8/da/c48 0 2023-12-08T20:27:55.893 INFO:tasks.workunit.client.1.smithi111.stdout:4/531: chown d8/da/d2c/f5e 10857362 1 2023-12-08T20:27:55.893 INFO:tasks.workunit.client.1.smithi111.stdout:5/785: dwrite d3/d4/d7/d36/d82/ff6 [0,4194304] 0 2023-12-08T20:27:55.893 INFO:tasks.workunit.client.1.smithi111.stdout:1/630: symlink d0/d22/ldb 0 2023-12-08T20:27:55.894 INFO:tasks.workunit.client.1.smithi111.stdout:2/606: creat d1/d29/d4e/ddc/fe0 x:0 0 0 2023-12-08T20:27:55.897 INFO:tasks.workunit.client.1.smithi111.stdout:4/532: dread d8/f15 [4194304,4194304] 0 2023-12-08T20:27:55.897 INFO:tasks.workunit.client.1.smithi111.stdout:6/460: rename d0/d1/d27/d36/c6d to d0/d1/d27/d36/d8d/c90 0 2023-12-08T20:27:55.900 INFO:tasks.workunit.client.1.smithi111.stdout:8/736: creat dd/d2d/d8b/d8d/f101 x:0 0 0 2023-12-08T20:27:55.900 INFO:tasks.workunit.client.1.smithi111.stdout:0/918: dread d1/df/d16/fae [0,4194304] 0 2023-12-08T20:27:55.901 INFO:tasks.workunit.client.1.smithi111.stdout:7/595: creat da/d5c/fc7 x:0 0 0 2023-12-08T20:27:55.909 INFO:tasks.workunit.client.1.smithi111.stdout:1/631: mkdir d0/d6/d33/d15/d51/d78/ddc 0 2023-12-08T20:27:55.911 INFO:tasks.workunit.client.1.smithi111.stdout:9/730: dwrite d2/d8/dd/d56/f72 [4194304,4194304] 0 2023-12-08T20:27:55.912 INFO:tasks.workunit.client.1.smithi111.stdout:4/533: creat d8/d30/d7d/d9b/fa8 x:0 0 0 2023-12-08T20:27:55.915 INFO:tasks.workunit.client.1.smithi111.stdout:4/534: write d8/da/d2c/d1f/d2b/f61 [1488027,87139] 0 2023-12-08T20:27:55.916 INFO:tasks.workunit.client.1.smithi111.stdout:3/586: dwrite d2/d15/d17/d25/f26 [0,4194304] 0 2023-12-08T20:27:55.916 INFO:tasks.workunit.client.1.smithi111.stdout:2/607: dwrite d1/d29/d53/fd5 [0,4194304] 0 2023-12-08T20:27:55.916 INFO:tasks.workunit.client.1.smithi111.stdout:5/786: dwrite d3/d4/d7/d36/d82/f85 [0,4194304] 0 2023-12-08T20:27:55.917 INFO:tasks.workunit.client.1.smithi111.stdout:0/919: rename d1/d69/f11e to d1/d4/d24/d46/d58/f133 0 2023-12-08T20:27:55.918 INFO:tasks.workunit.client.1.smithi111.stdout:7/596: truncate da/d25/da9/db8/f29 1324162 0 2023-12-08T20:27:55.919 INFO:tasks.workunit.client.1.smithi111.stdout:5/787: dread d3/d8d/f8f [0,4194304] 0 2023-12-08T20:27:55.920 INFO:tasks.workunit.client.1.smithi111.stdout:1/632: creat d0/d6/d33/d15/d51/d2e/d61/fdd x:0 0 0 2023-12-08T20:27:55.920 INFO:tasks.workunit.client.1.smithi111.stdout:1/633: write d0/d6/fb7 [412972,77595] 0 2023-12-08T20:27:55.920 INFO:tasks.workunit.client.1.smithi111.stdout:1/634: write d0/d6/fb7 [939842,77843] 0 2023-12-08T20:27:55.923 INFO:tasks.workunit.client.1.smithi111.stdout:9/731: creat d2/d8/dd/d1a/d1e/de7/f106 x:0 0 0 2023-12-08T20:27:55.925 INFO:tasks.workunit.client.1.smithi111.stdout:3/587: dread d2/f34 [0,4194304] 0 2023-12-08T20:27:55.925 INFO:tasks.workunit.client.1.smithi111.stdout:3/588: write d2/d12/f8c [388441,73339] 0 2023-12-08T20:27:55.926 INFO:tasks.workunit.client.1.smithi111.stdout:6/461: symlink d0/l91 0 2023-12-08T20:27:55.926 INFO:tasks.workunit.client.1.smithi111.stdout:6/462: read d0/d1/d27/f5c [2694635,40037] 0 2023-12-08T20:27:55.927 INFO:tasks.workunit.client.1.smithi111.stdout:9/732: dread d2/d8/dd/d1a/d74/dbf/ff0 [0,4194304] 0 2023-12-08T20:27:55.927 INFO:tasks.workunit.client.1.smithi111.stdout:4/535: stat d8/da/l5b 0 2023-12-08T20:27:55.928 INFO:tasks.workunit.client.1.smithi111.stdout:0/920: dread d1/d4/d24/d46/d49/d6e/fc1 [0,4194304] 0 2023-12-08T20:27:55.930 INFO:tasks.workunit.client.1.smithi111.stdout:2/608: mkdir d1/d1d/d1f/d25/d3d/d41/de1 0 2023-12-08T20:27:55.930 INFO:tasks.workunit.client.1.smithi111.stdout:2/609: chown d1/d29/d4e/l8e 2 1 2023-12-08T20:27:55.930 INFO:tasks.workunit.client.1.smithi111.stdout:2/610: chown d1/d1d/d68/d73/fca 2 1 2023-12-08T20:27:55.931 INFO:tasks.workunit.client.1.smithi111.stdout:5/788: dread d3/d4/d7/d29/d30/fb5 [0,4194304] 0 2023-12-08T20:27:55.931 INFO:tasks.workunit.client.1.smithi111.stdout:5/789: write d3/d4/d7/f89 [1038717,108613] 0 2023-12-08T20:27:55.931 INFO:tasks.workunit.client.1.smithi111.stdout:8/737: link dd/d35/cb7 dd/d32/d3d/d6b/c102 0 2023-12-08T20:27:55.931 INFO:tasks.workunit.client.1.smithi111.stdout:8/738: chown l9 365 1 2023-12-08T20:27:55.934 INFO:tasks.workunit.client.1.smithi111.stdout:7/597: creat da/d13/d9e/d75/d9f/fc8 x:0 0 0 2023-12-08T20:27:55.934 INFO:tasks.workunit.client.1.smithi111.stdout:7/598: write da/d38/f6a [614098,25330] 0 2023-12-08T20:27:55.936 INFO:tasks.workunit.client.1.smithi111.stdout:4/536: dread d8/da/d2c/d1f/d40/f55 [0,4194304] 0 2023-12-08T20:27:55.936 INFO:tasks.workunit.client.1.smithi111.stdout:5/790: fdatasync d3/d4/d7/f89 0 2023-12-08T20:27:55.937 INFO:tasks.workunit.client.1.smithi111.stdout:1/635: link d0/d4d/lc9 d0/d6/d33/d6c/lde 0 2023-12-08T20:27:55.937 INFO:tasks.workunit.client.1.smithi111.stdout:1/636: stat d0/d6/d33/d15/d51/d2e 0 2023-12-08T20:27:55.937 INFO:tasks.workunit.client.1.smithi111.stdout:1/637: fdatasync d0/d4d/f8c 0 2023-12-08T20:27:55.937 INFO:tasks.workunit.client.1.smithi111.stdout:1/638: chown d0/d6/d33/d15/d51/d2e/d61/d79/fc6 168 1 2023-12-08T20:27:55.937 INFO:tasks.workunit.client.1.smithi111.stdout:1/639: dread - d0/d6/d33/d15/d51/d2e/d61/fdd zero size 2023-12-08T20:27:55.938 INFO:tasks.workunit.client.1.smithi111.stdout:9/733: dread d2/da/f50 [0,4194304] 0 2023-12-08T20:27:55.938 INFO:tasks.workunit.client.1.smithi111.stdout:3/589: rmdir d2/d3/d13/d36/d69/d70 39 2023-12-08T20:27:55.941 INFO:tasks.workunit.client.1.smithi111.stdout:6/463: creat d0/d1/d1e/f92 x:0 0 0 2023-12-08T20:27:55.942 INFO:tasks.workunit.client.1.smithi111.stdout:2/611: mkdir d1/d1d/d68/de2 0 2023-12-08T20:27:55.944 INFO:tasks.workunit.client.1.smithi111.stdout:8/739: mknod dd/dc9/ddb/df0/c103 0 2023-12-08T20:27:55.946 INFO:tasks.workunit.client.1.smithi111.stdout:7/599: rename da/d25/d3d/d58/da4 to da/d25/d3d/dc9 0 2023-12-08T20:27:55.948 INFO:tasks.workunit.client.1.smithi111.stdout:4/537: creat d8/da/d29/d5c/fa9 x:0 0 0 2023-12-08T20:27:55.951 INFO:tasks.workunit.client.1.smithi111.stdout:5/791: creat d3/d4/d7/d36/d64/d96/f110 x:0 0 0 2023-12-08T20:27:55.951 INFO:tasks.workunit.client.1.smithi111.stdout:0/921: dwrite d1/df/d16/fae [0,4194304] 0 2023-12-08T20:27:55.951 INFO:tasks.workunit.client.1.smithi111.stdout:5/792: read d3/d4/d7/d29/d30/f9d [936987,40843] 0 2023-12-08T20:27:55.953 INFO:tasks.workunit.client.1.smithi111.stdout:1/640: link d0/f31 d0/d6/d33/d6c/fdf 0 2023-12-08T20:27:55.953 INFO:tasks.workunit.client.1.smithi111.stdout:1/641: chown d0/d6/d33/d60/ca2 0 1 2023-12-08T20:27:55.956 INFO:tasks.workunit.client.1.smithi111.stdout:6/464: symlink d0/d1/d27/d56/l93 0 2023-12-08T20:27:55.956 INFO:tasks.workunit.client.1.smithi111.stdout:6/465: chown d0/d1/d27/d56/f62 147 1 2023-12-08T20:27:55.957 INFO:tasks.workunit.client.1.smithi111.stdout:0/922: write d1/dd/f18 [3960068,119036] 0 2023-12-08T20:27:55.958 INFO:tasks.workunit.client.1.smithi111.stdout:9/734: dwrite d2/d8/dd/d1a/d1e/d2d/fc0 [0,4194304] 0 2023-12-08T20:27:55.959 INFO:tasks.workunit.client.1.smithi111.stdout:2/612: creat d1/d1d/d1f/d36/fe3 x:0 0 0 2023-12-08T20:27:55.962 INFO:tasks.workunit.client.1.smithi111.stdout:8/740: link dd/d35/d42/fb5 dd/d35/d42/f104 0 2023-12-08T20:27:55.965 INFO:tasks.workunit.client.1.smithi111.stdout:3/590: rename d2/d15/d17/f68 to d2/d15/d17/d25/d4e/fb3 0 2023-12-08T20:27:55.965 INFO:tasks.workunit.client.1.smithi111.stdout:3/591: read - d2/d15/f87 zero size 2023-12-08T20:27:55.965 INFO:tasks.workunit.client.1.smithi111.stdout:3/592: fdatasync d2/d3/d13/d36/f3e 0 2023-12-08T20:27:55.965 INFO:tasks.workunit.client.1.smithi111.stdout:3/593: stat d2/d12 0 2023-12-08T20:27:55.965 INFO:tasks.workunit.client.1.smithi111.stdout:7/600: rmdir da/d5c/d6e 39 2023-12-08T20:27:55.966 INFO:tasks.workunit.client.1.smithi111.stdout:1/642: rmdir d0/d6 39 2023-12-08T20:27:55.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:55 smithi111 ceph-mon[121341]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:27:55.967 INFO:tasks.workunit.client.1.smithi111.stdout:6/466: truncate d0/d1/f7 6359348 0 2023-12-08T20:27:55.967 INFO:tasks.workunit.client.1.smithi111.stdout:6/467: read d0/d1a/f1f [7445,74971] 0 2023-12-08T20:27:55.968 INFO:tasks.workunit.client.1.smithi111.stdout:0/923: rmdir d1/d2d/d83/dab 39 2023-12-08T20:27:55.969 INFO:tasks.workunit.client.1.smithi111.stdout:2/613: mkdir d1/d1d/d1f/d25/d3d/d9f/de4 0 2023-12-08T20:27:55.971 INFO:tasks.workunit.client.1.smithi111.stdout:8/741: unlink dd/d32/d3d/d55/fa8 0 2023-12-08T20:27:55.972 INFO:tasks.workunit.client.1.smithi111.stdout:8/742: write dd/fbb [110043,89645] 0 2023-12-08T20:27:55.973 INFO:tasks.workunit.client.1.smithi111.stdout:7/601: rmdir da/d5c/d59 39 2023-12-08T20:27:55.974 INFO:tasks.workunit.client.1.smithi111.stdout:7/602: write da/d38/f74 [912166,126508] 0 2023-12-08T20:27:55.974 INFO:tasks.workunit.client.1.smithi111.stdout:7/603: chown da/d25/da9/db8/f67 3529070 1 2023-12-08T20:27:55.974 INFO:tasks.workunit.client.1.smithi111.stdout:3/594: dread d2/d3/fb [0,4194304] 0 2023-12-08T20:27:55.974 INFO:tasks.workunit.client.1.smithi111.stdout:6/468: symlink d0/d1/d1e/l94 0 2023-12-08T20:27:55.975 INFO:tasks.workunit.client.1.smithi111.stdout:5/793: dwrite d3/d4/d7/d2c/f97 [0,4194304] 0 2023-12-08T20:27:55.975 INFO:tasks.workunit.client.1.smithi111.stdout:5/794: stat d3/f10 0 2023-12-08T20:27:55.977 INFO:tasks.workunit.client.1.smithi111.stdout:7/604: rmdir da/d64 39 2023-12-08T20:27:55.979 INFO:tasks.workunit.client.1.smithi111.stdout:1/643: dread d0/d6/f10 [4194304,4194304] 0 2023-12-08T20:27:55.979 INFO:tasks.workunit.client.1.smithi111.stdout:2/614: dread d1/d1d/d1f/d25/d3d/d64/f80 [0,4194304] 0 2023-12-08T20:27:55.981 INFO:tasks.workunit.client.1.smithi111.stdout:3/595: symlink d2/d3/d6/lb4 0 2023-12-08T20:27:55.984 INFO:tasks.workunit.client.1.smithi111.stdout:4/538: dwrite f6 [0,4194304] 0 2023-12-08T20:27:55.984 INFO:tasks.workunit.client.1.smithi111.stdout:8/743: dread dd/f28 [0,4194304] 0 2023-12-08T20:27:55.987 INFO:tasks.workunit.client.1.smithi111.stdout:6/469: rename d0/d1b to d0/d68/d95 0 2023-12-08T20:27:55.990 INFO:tasks.workunit.client.1.smithi111.stdout:0/924: link d1/l7 d1/df/d56/d102/l134 0 2023-12-08T20:27:55.990 INFO:tasks.workunit.client.1.smithi111.stdout:0/925: chown d1/d4/d24/d46/d58/d65/c110 3165 1 2023-12-08T20:27:55.990 INFO:tasks.workunit.client.1.smithi111.stdout:0/926: stat d1/d2d/d83/fcd 0 2023-12-08T20:27:55.992 INFO:tasks.workunit.client.1.smithi111.stdout:7/605: creat da/d25/da9/db8/fca x:0 0 0 2023-12-08T20:27:55.992 INFO:tasks.workunit.client.1.smithi111.stdout:7/606: write da/d25/d26/f9c [92079,21313] 0 2023-12-08T20:27:55.994 INFO:tasks.workunit.client.1.smithi111.stdout:9/735: dwrite d2/d8/dd/d1a/d1e/d2d/d8f/faa [0,4194304] 0 2023-12-08T20:27:55.994 INFO:tasks.workunit.client.1.smithi111.stdout:9/736: fdatasync d2/d8/dd/f4e 0 2023-12-08T20:27:55.995 INFO:tasks.workunit.client.1.smithi111.stdout:2/615: unlink d1/d1d/d22/f2c 0 2023-12-08T20:27:55.995 INFO:tasks.workunit.client.1.smithi111.stdout:7/607: dread da/d25/da9/db8/d89/fa1 [0,4194304] 0 2023-12-08T20:27:55.995 INFO:tasks.workunit.client.1.smithi111.stdout:7/608: truncate da/d25/d3d/fa5 1547110 0 2023-12-08T20:27:56.000 INFO:tasks.workunit.client.1.smithi111.stdout:3/596: mknod d2/d3/d13/d36/d44/daa/cb5 0 2023-12-08T20:27:56.000 INFO:tasks.workunit.client.1.smithi111.stdout:0/927: dread d1/df/d44/daa/db2/f12a [0,4194304] 0 2023-12-08T20:27:56.002 INFO:tasks.workunit.client.1.smithi111.stdout:6/470: dwrite d0/d1a/f60 [0,4194304] 0 2023-12-08T20:27:56.004 INFO:tasks.workunit.client.1.smithi111.stdout:8/744: creat dd/d32/d3d/d6b/f105 x:0 0 0 2023-12-08T20:27:56.005 INFO:tasks.workunit.client.1.smithi111.stdout:5/795: rename d3/d4/d7/d2c/f4c to d3/d12/d67/f111 0 2023-12-08T20:27:56.005 INFO:tasks.workunit.client.1.smithi111.stdout:5/796: stat d3/d4/d7/d29/d73/c93 0 2023-12-08T20:27:56.005 INFO:tasks.workunit.client.1.smithi111.stdout:5/797: chown d3/d4/d4a/d21/da5/f10c 193020 1 2023-12-08T20:27:56.006 INFO:tasks.workunit.client.1.smithi111.stdout:7/609: dread da/d25/d26/d32/f90 [0,4194304] 0 2023-12-08T20:27:56.006 INFO:tasks.workunit.client.1.smithi111.stdout:7/610: fsync da/d13/f69 0 2023-12-08T20:27:56.006 INFO:tasks.workunit.client.1.smithi111.stdout:7/611: write da/d25/d3d/dc9/fba [210275,24841] 0 2023-12-08T20:27:56.007 INFO:tasks.workunit.client.1.smithi111.stdout:9/737: link d2/d8/dd/d1a/d74/dbf/fca d2/d8/d8c/dbb/f107 0 2023-12-08T20:27:56.007 INFO:tasks.workunit.client.1.smithi111.stdout:7/612: dread da/d13/f49 [0,4194304] 0 2023-12-08T20:27:56.008 INFO:tasks.workunit.client.1.smithi111.stdout:2/616: symlink d1/d1d/d1f/d25/d3d/da2/le5 0 2023-12-08T20:27:56.010 INFO:tasks.workunit.client.1.smithi111.stdout:0/928: symlink d1/dd/d4a/dcb/l135 0 2023-12-08T20:27:56.012 INFO:tasks.workunit.client.1.smithi111.stdout:3/597: dread d2/d12/f1d [0,4194304] 0 2023-12-08T20:27:56.012 INFO:tasks.workunit.client.1.smithi111.stdout:3/598: write d2/d12/d4a/f6f [284821,61106] 0 2023-12-08T20:27:56.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:55 smithi043 ceph-mon[111966]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:27:56.013 INFO:tasks.workunit.client.1.smithi111.stdout:8/745: dread dd/f54 [0,4194304] 0 2023-12-08T20:27:56.014 INFO:tasks.workunit.client.1.smithi111.stdout:6/471: creat d0/d1/f96 x:0 0 0 2023-12-08T20:27:56.014 INFO:tasks.workunit.client.1.smithi111.stdout:4/539: rename d8/da/f3b to d8/da/d2c/d1f/faa 0 2023-12-08T20:27:56.014 INFO:tasks.workunit.client.1.smithi111.stdout:5/798: mknod d3/d4/d4a/d21/dea/c112 0 2023-12-08T20:27:56.014 INFO:tasks.workunit.client.1.smithi111.stdout:6/472: dread d0/d1/f11 [0,4194304] 0 2023-12-08T20:27:56.017 INFO:tasks.workunit.client.1.smithi111.stdout:9/738: getdents d2/d8/dd/d1a/d1e/d2d/d35/d6b 0 2023-12-08T20:27:56.019 INFO:tasks.workunit.client.1.smithi111.stdout:7/613: mknod da/ccb 0 2023-12-08T20:27:56.020 INFO:tasks.workunit.client.1.smithi111.stdout:7/614: truncate da/d25/d3d/f51 1525098 0 2023-12-08T20:27:56.020 INFO:tasks.workunit.client.1.smithi111.stdout:7/615: readlink da/d38/d80/l84 0 2023-12-08T20:27:56.021 INFO:tasks.workunit.client.1.smithi111.stdout:2/617: creat d1/d1d/d22/fe6 x:0 0 0 2023-12-08T20:27:56.026 INFO:tasks.workunit.client.1.smithi111.stdout:2/618: dread d1/d29/d53/f3a [0,4194304] 0 2023-12-08T20:27:56.026 INFO:tasks.workunit.client.1.smithi111.stdout:0/929: mknod d1/df/d44/daa/db2/c136 0 2023-12-08T20:27:56.027 INFO:tasks.workunit.client.1.smithi111.stdout:0/930: readlink d1/df/d16/d2c/la0 0 2023-12-08T20:27:56.027 INFO:tasks.workunit.client.1.smithi111.stdout:8/746: truncate dd/d2d/f3c 2706394 0 2023-12-08T20:27:56.027 INFO:tasks.workunit.client.1.smithi111.stdout:3/599: creat d2/d3/d13/d36/d69/fb6 x:0 0 0 2023-12-08T20:27:56.027 INFO:tasks.workunit.client.1.smithi111.stdout:3/600: write d2/d3/d51/d88/fa5 [649897,10945] 0 2023-12-08T20:27:56.027 INFO:tasks.workunit.client.1.smithi111.stdout:5/799: mknod d3/d4/d7/d36/c113 0 2023-12-08T20:27:56.028 INFO:tasks.workunit.client.1.smithi111.stdout:6/473: mkdir d0/d1/d27/d36/d97 0 2023-12-08T20:27:56.028 INFO:tasks.workunit.client.1.smithi111.stdout:4/540: dwrite d8/f22 [0,4194304] 0 2023-12-08T20:27:56.028 INFO:tasks.workunit.client.1.smithi111.stdout:4/541: chown d8/da/d29/f39 244 1 2023-12-08T20:27:56.029 INFO:tasks.workunit.client.1.smithi111.stdout:9/739: truncate d2/d8/dd/d1a/d1e/d2d/d35/f3e 1584918 0 2023-12-08T20:27:56.029 INFO:tasks.workunit.client.1.smithi111.stdout:7/616: dread da/d25/d26/d32/d3e/f42 [0,4194304] 0 2023-12-08T20:27:56.029 INFO:tasks.workunit.client.1.smithi111.stdout:9/740: chown d2/d8/dd/d1a/d1e/d2d/lbc 70467 1 2023-12-08T20:27:56.029 INFO:tasks.workunit.client.1.smithi111.stdout:9/741: chown d2/d8/dd/f6c 872389 1 2023-12-08T20:27:56.030 INFO:tasks.workunit.client.1.smithi111.stdout:0/931: unlink d1/d4/l111 0 2023-12-08T20:27:56.030 INFO:tasks.workunit.client.1.smithi111.stdout:0/932: fdatasync d1/df/d16/d2c/d7e/fe8 0 2023-12-08T20:27:56.031 INFO:tasks.workunit.client.1.smithi111.stdout:1/644: truncate d0/d6/f14 1859106 0 2023-12-08T20:27:56.031 INFO:tasks.workunit.client.1.smithi111.stdout:0/933: read d1/dd/d47/f94 [787688,29298] 0 2023-12-08T20:27:56.032 INFO:tasks.workunit.client.1.smithi111.stdout:8/747: creat dd/dc9/ddb/df8/f106 x:0 0 0 2023-12-08T20:27:56.032 INFO:tasks.workunit.client.1.smithi111.stdout:8/748: fsync dd/d32/da7/fb2 0 2023-12-08T20:27:56.033 INFO:tasks.workunit.client.1.smithi111.stdout:3/601: rename d2/d15/d17/d25/d4e/f73 to d2/d3/d13/d36/d44/d8f/fb7 0 2023-12-08T20:27:56.038 INFO:tasks.workunit.client.1.smithi111.stdout:2/619: dread f0 [0,4194304] 0 2023-12-08T20:27:56.038 INFO:tasks.workunit.client.1.smithi111.stdout:2/620: stat d1/d1d/d1f/d25/d67/c9a 0 2023-12-08T20:27:56.038 INFO:tasks.workunit.client.1.smithi111.stdout:2/621: readlink d1/d1d/d1f/d25/l47 0 2023-12-08T20:27:56.039 INFO:tasks.workunit.client.1.smithi111.stdout:6/474: unlink d0/d68/d95/f49 0 2023-12-08T20:27:56.039 INFO:tasks.workunit.client.1.smithi111.stdout:6/475: chown d0/d1/d27/c77 8345 1 2023-12-08T20:27:56.039 INFO:tasks.workunit.client.1.smithi111.stdout:5/800: getdents d3/d4/d7/d36/d82 0 2023-12-08T20:27:56.039 INFO:tasks.workunit.client.1.smithi111.stdout:4/542: symlink d8/d30/d7d/lab 0 2023-12-08T20:27:56.039 INFO:tasks.workunit.client.1.smithi111.stdout:4/543: chown d8/da/d2c 251880 1 2023-12-08T20:27:56.040 INFO:tasks.workunit.client.1.smithi111.stdout:7/617: link da/d25/d3d/f85 da/d5c/fcc 0 2023-12-08T20:27:56.043 INFO:tasks.workunit.client.1.smithi111.stdout:9/742: creat d2/d8/d8c/dbb/f108 x:0 0 0 2023-12-08T20:27:56.045 INFO:tasks.workunit.client.1.smithi111.stdout:8/749: dwrite dd/dc9/ddb/df0/ffd [0,4194304] 0 2023-12-08T20:27:56.045 INFO:tasks.workunit.client.1.smithi111.stdout:4/544: dread d8/da/db/d7f/f5a [0,4194304] 0 2023-12-08T20:27:56.045 INFO:tasks.workunit.client.1.smithi111.stdout:4/545: fsync d8/da/d29/d6e/f90 0 2023-12-08T20:27:56.045 INFO:tasks.workunit.client.1.smithi111.stdout:1/645: creat d0/d6/d33/d6c/d75/d89/fe0 x:0 0 0 2023-12-08T20:27:56.046 INFO:tasks.workunit.client.1.smithi111.stdout:0/934: mkdir d1/df/d16/d2c/d7e/d104/d137 0 2023-12-08T20:27:56.047 INFO:tasks.workunit.client.1.smithi111.stdout:8/750: dread dd/d35/d42/fb5 [0,4194304] 0 2023-12-08T20:27:56.047 INFO:tasks.workunit.client.1.smithi111.stdout:8/751: fdatasync dd/d32/d3d/d55/ff3 0 2023-12-08T20:27:56.047 INFO:tasks.workunit.client.1.smithi111.stdout:8/752: write dd/d2d/f4a [4387571,128753] 0 2023-12-08T20:27:56.049 INFO:tasks.workunit.client.1.smithi111.stdout:3/602: rename d2/d3/d6/f3a to d2/d3/d13/d36/d69/d70/fb8 0 2023-12-08T20:27:56.051 INFO:tasks.workunit.client.1.smithi111.stdout:2/622: mknod d1/d1d/d1f/dc1/ce7 0 2023-12-08T20:27:56.053 INFO:tasks.workunit.client.1.smithi111.stdout:9/743: dread d2/d8/dd/d1a/d1e/f54 [0,4194304] 0 2023-12-08T20:27:56.054 INFO:tasks.workunit.client.1.smithi111.stdout:5/801: mknod d3/d4/d7/d2c/d84/c114 0 2023-12-08T20:27:56.054 INFO:tasks.workunit.client.1.smithi111.stdout:2/623: dread d1/d1d/d1f/d25/d67/faa [0,4194304] 0 2023-12-08T20:27:56.056 INFO:tasks.workunit.client.1.smithi111.stdout:7/618: mkdir da/d25/d26/d32/dcd 0 2023-12-08T20:27:56.056 INFO:tasks.workunit.client.1.smithi111.stdout:7/619: fsync da/f1b 0 2023-12-08T20:27:56.056 INFO:tasks.workunit.client.1.smithi111.stdout:5/802: write d3/d12/d67/f111 [3781777,118733] 0 2023-12-08T20:27:56.057 INFO:tasks.workunit.client.1.smithi111.stdout:5/803: readlink d3/d4/d7/d29/d30/l70 0 2023-12-08T20:27:56.061 INFO:tasks.workunit.client.1.smithi111.stdout:4/546: getdents d8/da/d2c/d1f/d2b 0 2023-12-08T20:27:56.063 INFO:tasks.workunit.client.1.smithi111.stdout:1/646: creat d0/d6/d33/d60/fe1 x:0 0 0 2023-12-08T20:27:56.063 INFO:tasks.workunit.client.1.smithi111.stdout:1/647: write d0/d4d/f57 [1527887,103670] 0 2023-12-08T20:27:56.065 INFO:tasks.workunit.client.1.smithi111.stdout:0/935: rmdir d1/df/d16/d2c/d7b/dba 39 2023-12-08T20:27:56.067 INFO:tasks.workunit.client.1.smithi111.stdout:8/753: creat dd/d96/f107 x:0 0 0 2023-12-08T20:27:56.068 INFO:tasks.workunit.client.1.smithi111.stdout:3/603: dwrite d2/d3/d6/fd [0,4194304] 0 2023-12-08T20:27:56.072 INFO:tasks.workunit.client.1.smithi111.stdout:6/476: link d0/c4d d0/d1/d27/d56/c98 0 2023-12-08T20:27:56.072 INFO:tasks.workunit.client.1.smithi111.stdout:6/477: write d0/d1/f2c [427365,100710] 0 2023-12-08T20:27:56.073 INFO:tasks.workunit.client.1.smithi111.stdout:9/744: mknod d2/da/c109 0 2023-12-08T20:27:56.075 INFO:tasks.workunit.client.1.smithi111.stdout:2/624: symlink d1/d1d/d1f/d25/d3d/d9f/le8 0 2023-12-08T20:27:56.077 INFO:tasks.workunit.client.1.smithi111.stdout:7/620: creat da/d13/fce x:0 0 0 2023-12-08T20:27:56.078 INFO:tasks.workunit.client.1.smithi111.stdout:7/621: write da/d25/d26/d32/d3e/d97/fa6 [749608,79298] 0 2023-12-08T20:27:56.078 INFO:tasks.workunit.client.1.smithi111.stdout:0/936: dread d1/dd/f18 [0,4194304] 0 2023-12-08T20:27:56.080 INFO:tasks.workunit.client.1.smithi111.stdout:4/547: mknod d8/da/cac 0 2023-12-08T20:27:56.081 INFO:tasks.workunit.client.1.smithi111.stdout:1/648: creat d0/d6/d33/d15/d51/d2e/d61/d79/fe2 x:0 0 0 2023-12-08T20:27:56.081 INFO:tasks.workunit.client.1.smithi111.stdout:1/649: chown d0/l35 1571 1 2023-12-08T20:27:56.083 INFO:tasks.workunit.client.1.smithi111.stdout:8/754: unlink dd/d32/f39 0 2023-12-08T20:27:56.084 INFO:tasks.workunit.client.1.smithi111.stdout:3/604: rmdir d2/d3 39 2023-12-08T20:27:56.086 INFO:tasks.workunit.client.1.smithi111.stdout:5/804: dread d3/d4/d7/d29/d30/f76 [4194304,4194304] 0 2023-12-08T20:27:56.089 INFO:tasks.workunit.client.1.smithi111.stdout:1/650: write d0/d22/f45 [2849899,76467] 0 2023-12-08T20:27:56.089 INFO:tasks.workunit.client.1.smithi111.stdout:1/651: chown d0/d6/d34/f5f 0 1 2023-12-08T20:27:56.089 INFO:tasks.workunit.client.1.smithi111.stdout:9/745: link d2/d8/dd/d1a/d1e/d2d/f4b d2/d8/dd/d1a/d1e/d2d/d35/f10a 0 2023-12-08T20:27:56.089 INFO:tasks.workunit.client.1.smithi111.stdout:9/746: truncate d2/d8/dd/d1a/d1e/d2d/fe3 796838 0 2023-12-08T20:27:56.090 INFO:tasks.workunit.client.1.smithi111.stdout:7/622: rename da/d5c/d59/d61/l73 to da/d25/d3d/d58/lcf 0 2023-12-08T20:27:56.090 INFO:tasks.workunit.client.1.smithi111.stdout:7/623: write da/d38/f8f [726506,37926] 0 2023-12-08T20:27:56.090 INFO:tasks.workunit.client.1.smithi111.stdout:7/624: chown da/d25/d3d/dc9/lbd 217969 1 2023-12-08T20:27:56.095 INFO:tasks.workunit.client.1.smithi111.stdout:6/478: dwrite d0/d1/f96 [0,4194304] 0 2023-12-08T20:27:56.096 INFO:tasks.workunit.client.1.smithi111.stdout:4/548: creat d8/da/db/d7f/da7/fad x:0 0 0 2023-12-08T20:27:56.096 INFO:tasks.workunit.client.1.smithi111.stdout:3/605: mkdir d2/d3/d1e/d93/db9 0 2023-12-08T20:27:56.096 INFO:tasks.workunit.client.1.smithi111.stdout:5/805: truncate d3/d4/d4a/d21/faa 1484648 0 2023-12-08T20:27:56.097 INFO:tasks.workunit.client.1.smithi111.stdout:5/806: write d3/d8d/f8f [25373,79107] 0 2023-12-08T20:27:56.097 INFO:tasks.workunit.client.1.smithi111.stdout:9/747: symlink d2/d8/d8c/d96/l10b 0 2023-12-08T20:27:56.097 INFO:tasks.workunit.client.1.smithi111.stdout:9/748: readlink d2/d8/dd/d1a/d1e/d2d/d35/d71/d105/lf6 0 2023-12-08T20:27:56.098 INFO:tasks.workunit.client.1.smithi111.stdout:7/625: creat da/fd0 x:0 0 0 2023-12-08T20:27:56.100 INFO:tasks.workunit.client.1.smithi111.stdout:8/755: write dd/d32/d36/f7d [2229377,19163] 0 2023-12-08T20:27:56.101 INFO:tasks.workunit.client.1.smithi111.stdout:2/625: dwrite d1/fcc [0,4194304] 0 2023-12-08T20:27:56.101 INFO:tasks.workunit.client.1.smithi111.stdout:2/626: chown d1/l28 15814073 1 2023-12-08T20:27:56.102 INFO:tasks.workunit.client.1.smithi111.stdout:0/937: dwrite d1/df/d56/f127 [0,4194304] 0 2023-12-08T20:27:56.102 INFO:tasks.workunit.client.1.smithi111.stdout:1/652: dread d0/d6/fb7 [0,4194304] 0 2023-12-08T20:27:56.102 INFO:tasks.workunit.client.1.smithi111.stdout:1/653: truncate d0/d6/d33/d15/d51/d2e/fa9 809243 0 2023-12-08T20:27:56.104 INFO:tasks.workunit.client.1.smithi111.stdout:4/549: rename d8/da/d2c/d1f/d40/f60 to d8/da/db/d7f/d93/d91/fae 0 2023-12-08T20:27:56.104 INFO:tasks.workunit.client.1.smithi111.stdout:3/606: rename d2/d3/d13 to d2/d3/d13/d36/d69/d81/dba 22 2023-12-08T20:27:56.106 INFO:tasks.workunit.client.1.smithi111.stdout:3/607: dread d2/d12/d4a/f6d [0,4194304] 0 2023-12-08T20:27:56.106 INFO:tasks.workunit.client.1.smithi111.stdout:3/608: write d2/d3/d6/fd [4582645,21149] 0 2023-12-08T20:27:56.109 INFO:tasks.workunit.client.1.smithi111.stdout:9/749: mknod d2/d8/dd/d1a/d1e/d2d/d35/d71/c10c 0 2023-12-08T20:27:56.109 INFO:tasks.workunit.client.1.smithi111.stdout:9/750: truncate d2/d8/dd/d1a/d1e/d2d/d35/d6b/f90 396424 0 2023-12-08T20:27:56.109 INFO:tasks.workunit.client.1.smithi111.stdout:9/751: write d2/d8/dd/d1a/ff4 [678555,68544] 0 2023-12-08T20:27:56.110 INFO:tasks.workunit.client.1.smithi111.stdout:7/626: creat da/d25/d26/d32/d87/fd1 x:0 0 0 2023-12-08T20:27:56.111 INFO:tasks.workunit.client.1.smithi111.stdout:7/627: truncate da/f40 379033 0 2023-12-08T20:27:56.112 INFO:tasks.workunit.client.1.smithi111.stdout:8/756: getdents dd/d32/dea/df1 0 2023-12-08T20:27:56.113 INFO:tasks.workunit.client.1.smithi111.stdout:2/627: creat d1/d1d/d1f/d25/d96/ddf/fe9 x:0 0 0 2023-12-08T20:27:56.118 INFO:tasks.workunit.client.1.smithi111.stdout:6/479: dwrite d0/f20 [0,4194304] 0 2023-12-08T20:27:56.118 INFO:tasks.workunit.client.1.smithi111.stdout:0/938: symlink d1/df/d44/d37/dac/dce/l138 0 2023-12-08T20:27:56.118 INFO:tasks.workunit.client.1.smithi111.stdout:0/939: chown d1/d69/fd2 188953806 1 2023-12-08T20:27:56.119 INFO:tasks.workunit.client.1.smithi111.stdout:1/654: mknod d0/d6/d33/d15/d51/d5b/d59/da3/ce3 0 2023-12-08T20:27:56.124 INFO:tasks.workunit.client.1.smithi111.stdout:4/550: link d8/da/db/d7f/d93/d77/f6c d8/da/d2c/d1f/d2b/d4b/faf 0 2023-12-08T20:27:56.126 INFO:tasks.workunit.client.1.smithi111.stdout:9/752: creat d2/d8/dd/d1a/d1e/d2d/d4a/d62/f10d x:0 0 0 2023-12-08T20:27:56.128 INFO:tasks.workunit.client.1.smithi111.stdout:7/628: truncate da/d13/f9b 3261667 0 2023-12-08T20:27:56.128 INFO:tasks.workunit.client.1.smithi111.stdout:7/629: chown da/d25/d3d 142922754 1 2023-12-08T20:27:56.132 INFO:tasks.workunit.client.1.smithi111.stdout:3/609: dwrite d2/d3/f1c [0,4194304] 0 2023-12-08T20:27:56.132 INFO:tasks.workunit.client.1.smithi111.stdout:8/757: creat dd/d32/dea/df1/f108 x:0 0 0 2023-12-08T20:27:56.135 INFO:tasks.workunit.client.1.smithi111.stdout:2/628: truncate d1/d1d/d22/f71 1281501 0 2023-12-08T20:27:56.138 INFO:tasks.workunit.client.1.smithi111.stdout:0/940: unlink d1/d4/d24/d46/fa8 0 2023-12-08T20:27:56.138 INFO:tasks.workunit.client.1.smithi111.stdout:0/941: write d1/d2d/f39 [2456986,108263] 0 2023-12-08T20:27:56.138 INFO:tasks.workunit.client.1.smithi111.stdout:0/942: stat d1/d69/d8b/f9c 0 2023-12-08T20:27:56.140 INFO:tasks.workunit.client.1.smithi111.stdout:6/480: dwrite d0/f84 [0,4194304] 0 2023-12-08T20:27:56.140 INFO:tasks.workunit.client.1.smithi111.stdout:1/655: rename d0/d6/d33/d6c/d75/d89/cb2 to d0/d6/d33/d15/d51/d5b/d5e/d86/dbd/ce4 0 2023-12-08T20:27:56.142 INFO:tasks.workunit.client.1.smithi111.stdout:0/943: dread d1/dd/d47/fda [0,4194304] 0 2023-12-08T20:27:56.144 INFO:tasks.workunit.client.1.smithi111.stdout:5/807: dread d3/d4/d4a/d21/faa [0,4194304] 0 2023-12-08T20:27:56.145 INFO:tasks.workunit.client.1.smithi111.stdout:6/481: write d0/f84 [2103597,127195] 0 2023-12-08T20:27:56.146 INFO:tasks.workunit.client.1.smithi111.stdout:9/753: truncate d2/d8/dd/d1a/d1e/d2d/d35/f60 3690844 0 2023-12-08T20:27:56.146 INFO:tasks.workunit.client.1.smithi111.stdout:9/754: read - d2/d8/dd/d1a/d1e/d2d/d35/d71/fe2 zero size 2023-12-08T20:27:56.147 INFO:tasks.workunit.client.1.smithi111.stdout:9/755: read d2/d8/dd/f4e [1804085,113724] 0 2023-12-08T20:27:56.148 INFO:tasks.workunit.client.1.smithi111.stdout:8/758: truncate dd/f12 2859173 0 2023-12-08T20:27:56.149 INFO:tasks.workunit.client.1.smithi111.stdout:2/629: dread d1/d29/f95 [0,4194304] 0 2023-12-08T20:27:56.155 INFO:tasks.workunit.client.1.smithi111.stdout:4/551: rename d8/da/d2c/d1f/d2b/d4b/l5f to d8/d30/d97/lb0 0 2023-12-08T20:27:56.155 INFO:tasks.workunit.client.1.smithi111.stdout:4/552: write d8/da/d2c/d1f/f83 [147474,69456] 0 2023-12-08T20:27:56.155 INFO:tasks.workunit.client.1.smithi111.stdout:4/553: dread - d8/da/d29/f84 zero size 2023-12-08T20:27:56.155 INFO:tasks.workunit.client.1.smithi111.stdout:4/554: fsync d8/da/d2c/d1f/f6f 0 2023-12-08T20:27:56.155 INFO:tasks.workunit.client.1.smithi111.stdout:4/555: write d8/da/d29/f84 [161446,38179] 0 2023-12-08T20:27:56.157 INFO:tasks.workunit.client.1.smithi111.stdout:0/944: symlink d1/df/d56/l139 0 2023-12-08T20:27:56.158 INFO:tasks.workunit.client.1.smithi111.stdout:1/656: dwrite d0/d6/d47/f53 [4194304,4194304] 0 2023-12-08T20:27:56.158 INFO:tasks.workunit.client.1.smithi111.stdout:1/657: chown d0/d6/d33/d6c/d75/l9c 1105 1 2023-12-08T20:27:56.171 INFO:tasks.workunit.client.1.smithi111.stdout:5/808: rmdir d3/d4/d4a/d21 39 2023-12-08T20:27:56.171 INFO:tasks.workunit.client.1.smithi111.stdout:5/809: chown d3/f14 0 1 2023-12-08T20:27:56.174 INFO:tasks.workunit.client.1.smithi111.stdout:9/756: dwrite d2/d8/dd/d56/f72 [0,4194304] 0 2023-12-08T20:27:56.174 INFO:tasks.workunit.client.1.smithi111.stdout:9/757: chown d2/c87 1 1 2023-12-08T20:27:56.176 INFO:tasks.workunit.client.1.smithi111.stdout:6/482: chown d0/l37 44 1 2023-12-08T20:27:56.176 INFO:tasks.workunit.client.1.smithi111.stdout:6/483: dread - d0/d1/d27/f71 zero size 2023-12-08T20:27:56.182 INFO:tasks.workunit.client.1.smithi111.stdout:8/759: mkdir dd/d35/d42/db4/d109 0 2023-12-08T20:27:56.186 INFO:tasks.workunit.client.1.smithi111.stdout:9/758: dwrite d2/da/fce [0,4194304] 0 2023-12-08T20:27:56.187 INFO:tasks.workunit.client.1.smithi111.stdout:2/630: mkdir d1/d1d/d22/dea 0 2023-12-08T20:27:56.189 INFO:tasks.workunit.client.1.smithi111.stdout:7/630: rename da/d25/d26/f9c to da/d25/d26/d32/dcd/fd2 0 2023-12-08T20:27:56.189 INFO:tasks.workunit.client.1.smithi111.stdout:7/631: chown da/d25/d3d/f85 24 1 2023-12-08T20:27:56.189 INFO:tasks.workunit.client.1.smithi111.stdout:7/632: chown da/d25/d3d/f85 0 1 2023-12-08T20:27:56.190 INFO:tasks.workunit.client.1.smithi111.stdout:7/633: fsync da/d25/d3d/dc9/fba 0 2023-12-08T20:27:56.191 INFO:tasks.workunit.client.1.smithi111.stdout:7/634: dread da/d38/f6a [0,4194304] 0 2023-12-08T20:27:56.191 INFO:tasks.workunit.client.1.smithi111.stdout:4/556: creat d8/fb1 x:0 0 0 2023-12-08T20:27:56.193 INFO:tasks.workunit.client.1.smithi111.stdout:1/658: mknod d0/d6/d33/d15/d51/d5b/d5e/d86/dab/ce5 0 2023-12-08T20:27:56.194 INFO:tasks.workunit.client.1.smithi111.stdout:2/631: dread d1/d29/d4e/f4d [0,4194304] 0 2023-12-08T20:27:56.197 INFO:tasks.workunit.client.1.smithi111.stdout:5/810: truncate d3/d4/d7/d29/d30/f3f 7172478 0 2023-12-08T20:27:56.199 INFO:tasks.workunit.client.1.smithi111.stdout:6/484: creat d0/d1/d27/d56/f99 x:0 0 0 2023-12-08T20:27:56.200 INFO:tasks.workunit.client.1.smithi111.stdout:8/760: symlink dd/d2d/d8b/d9b/l10a 0 2023-12-08T20:27:56.206 INFO:tasks.workunit.client.1.smithi111.stdout:9/759: creat d2/d8/dd/d1a/d74/dbf/f10e x:0 0 0 2023-12-08T20:27:56.209 INFO:tasks.workunit.client.1.smithi111.stdout:0/945: rename d1/dd/d47/fc8 to d1/d4/d24/d46/f13a 0 2023-12-08T20:27:56.209 INFO:tasks.workunit.client.1.smithi111.stdout:0/946: fsync d1/d4/d24/d46/ff8 0 2023-12-08T20:27:56.211 INFO:tasks.workunit.client.1.smithi111.stdout:0/947: write d1/df/d56/f63 [41826,127732] 0 2023-12-08T20:27:56.213 INFO:tasks.workunit.client.1.smithi111.stdout:1/659: unlink d0/d6/d33/d15/f98 0 2023-12-08T20:27:56.213 INFO:tasks.workunit.client.1.smithi111.stdout:1/660: readlink d0/d8e/lda 0 2023-12-08T20:27:56.214 INFO:tasks.workunit.client.1.smithi111.stdout:2/632: mknod d1/d1d/d1f/d25/d3d/d56/ceb 0 2023-12-08T20:27:56.214 INFO:tasks.workunit.client.1.smithi111.stdout:6/485: symlink d0/d1/d27/d6e/l9a 0 2023-12-08T20:27:56.215 INFO:tasks.workunit.client.1.smithi111.stdout:7/635: getdents da/d25/d26 0 2023-12-08T20:27:56.217 INFO:tasks.workunit.client.1.smithi111.stdout:8/761: creat dd/d32/f10b x:0 0 0 2023-12-08T20:27:56.217 INFO:tasks.workunit.client.1.smithi111.stdout:9/760: creat d2/da/f10f x:0 0 0 2023-12-08T20:27:56.220 INFO:tasks.workunit.client.1.smithi111.stdout:4/557: rename d8/da/d2c/d1f/d2b to d8/d30/d7d/d9b/db2 0 2023-12-08T20:27:56.221 INFO:tasks.workunit.client.1.smithi111.stdout:5/811: dwrite d3/d4/d7/d29/d73/f106 [0,4194304] 0 2023-12-08T20:27:56.225 INFO:tasks.workunit.client.1.smithi111.stdout:1/661: mknod d0/d22/ce6 0 2023-12-08T20:27:56.227 INFO:tasks.workunit.client.1.smithi111.stdout:9/761: dread d2/d8/dd/d1a/d1e/d2d/d35/f6a [0,4194304] 0 2023-12-08T20:27:56.227 INFO:tasks.workunit.client.1.smithi111.stdout:9/762: chown d2/d8/dd/d1a/d1e/d2d/d4a/d62/fcf 10416128 1 2023-12-08T20:27:56.227 INFO:tasks.workunit.client.1.smithi111.stdout:2/633: truncate d1/d1d/d1f/d25/d3d/f63 881677 0 2023-12-08T20:27:56.229 INFO:tasks.workunit.client.1.smithi111.stdout:6/486: creat d0/d1/d1e/f9b x:0 0 0 2023-12-08T20:27:56.232 INFO:tasks.workunit.client.1.smithi111.stdout:2/634: dread d1/d29/d53/d90/f65 [0,4194304] 0 2023-12-08T20:27:56.233 INFO:tasks.workunit.client.1.smithi111.stdout:8/762: dwrite dd/d35/f51 [0,4194304] 0 2023-12-08T20:27:56.233 INFO:tasks.workunit.client.1.smithi111.stdout:7/636: rename da/d13/f69 to da/d25/d3d/dc9/fd3 0 2023-12-08T20:27:56.233 INFO:tasks.workunit.client.1.smithi111.stdout:7/637: dread - da/d25/d26/d32/f8e zero size 2023-12-08T20:27:56.235 INFO:tasks.workunit.client.1.smithi111.stdout:8/763: read dd/f54 [2384056,100431] 0 2023-12-08T20:27:56.235 INFO:tasks.workunit.client.1.smithi111.stdout:4/558: mknod d8/da/db/d7f/cb3 0 2023-12-08T20:27:56.238 INFO:tasks.workunit.client.1.smithi111.stdout:0/948: creat d1/d2d/d83/dab/f13b x:0 0 0 2023-12-08T20:27:56.241 INFO:tasks.workunit.client.1.smithi111.stdout:1/662: link d0/d4d/f6f d0/d6/d33/d15/d51/d5b/d5e/d86/dbd/fe7 0 2023-12-08T20:27:56.242 INFO:tasks.workunit.client.1.smithi111.stdout:1/663: chown d0/d6/d33/d6c/d75/l8a 49920345 1 2023-12-08T20:27:56.242 INFO:tasks.workunit.client.1.smithi111.stdout:5/812: dwrite d3/d6d/fa4 [0,4194304] 0 2023-12-08T20:27:56.243 INFO:tasks.workunit.client.1.smithi111.stdout:9/763: mkdir d2/d8/dd/d1a/d1e/d2d/d4a/d62/d110 0 2023-12-08T20:27:56.246 INFO:tasks.workunit.client.1.smithi111.stdout:1/664: dread d0/d6/d33/d6c/fdf [0,4194304] 0 2023-12-08T20:27:56.246 INFO:tasks.workunit.client.1.smithi111.stdout:6/487: creat d0/d1/d27/d36/d8d/f9c x:0 0 0 2023-12-08T20:27:56.248 INFO:tasks.workunit.client.1.smithi111.stdout:2/635: mkdir d1/dec 0 2023-12-08T20:27:56.254 INFO:tasks.workunit.client.1.smithi111.stdout:4/559: dwrite d8/da/d29/d5c/f89 [0,4194304] 0 2023-12-08T20:27:56.254 INFO:tasks.workunit.client.1.smithi111.stdout:8/764: creat dd/d2d/d8b/d9b/f10c x:0 0 0 2023-12-08T20:27:56.254 INFO:tasks.workunit.client.1.smithi111.stdout:7/638: mknod da/d25/da9/cd4 0 2023-12-08T20:27:56.254 INFO:tasks.workunit.client.1.smithi111.stdout:7/639: chown da/d25/d3d 7428814 1 2023-12-08T20:27:56.254 INFO:tasks.workunit.client.1.smithi111.stdout:7/640: write da/d25/d26/d32/d3e/d97/fc3 [285160,72350] 0 2023-12-08T20:27:56.257 INFO:tasks.workunit.client.1.smithi111.stdout:5/813: creat d3/d12/d67/ddf/f115 x:0 0 0 2023-12-08T20:27:56.262 INFO:tasks.workunit.client.1.smithi111.stdout:1/665: mknod d0/d6/d33/d60/ce8 0 2023-12-08T20:27:56.262 INFO:tasks.workunit.client.1.smithi111.stdout:1/666: stat d0/d6/ca8 0 2023-12-08T20:27:56.267 INFO:tasks.workunit.client.1.smithi111.stdout:7/641: dread da/d25/faf [0,4194304] 0 2023-12-08T20:27:56.267 INFO:tasks.workunit.client.1.smithi111.stdout:7/642: chown da/d13/c31 4728 1 2023-12-08T20:27:56.267 INFO:tasks.workunit.client.1.smithi111.stdout:7/643: fsync da/d25/f3a 0 2023-12-08T20:27:56.269 INFO:tasks.workunit.client.1.smithi111.stdout:4/560: creat d8/d30/d7d/fb4 x:0 0 0 2023-12-08T20:27:56.269 INFO:tasks.workunit.client.1.smithi111.stdout:8/765: creat dd/d32/d3d/dd4/f10d x:0 0 0 2023-12-08T20:27:56.270 INFO:tasks.workunit.client.1.smithi111.stdout:1/667: mkdir d0/d6/d33/d8b/de9 0 2023-12-08T20:27:56.270 INFO:tasks.workunit.client.1.smithi111.stdout:6/488: dwrite d0/d1/f65 [0,4194304] 0 2023-12-08T20:27:56.271 INFO:tasks.workunit.client.1.smithi111.stdout:2/636: dwrite d1/d1d/d55/f72 [0,4194304] 0 2023-12-08T20:27:56.271 INFO:tasks.workunit.client.1.smithi111.stdout:2/637: readlink d1/d1d/l18 0 2023-12-08T20:27:56.272 INFO:tasks.workunit.client.1.smithi111.stdout:7/644: mknod da/d25/cd5 0 2023-12-08T20:27:56.273 INFO:tasks.workunit.client.1.smithi111.stdout:4/561: mkdir d8/da/db/d7f/d93/d77/db5 0 2023-12-08T20:27:56.274 INFO:tasks.workunit.client.1.smithi111.stdout:5/814: dwrite d3/d12/d67/f111 [0,4194304] 0 2023-12-08T20:27:56.276 INFO:tasks.workunit.client.1.smithi111.stdout:1/668: truncate d0/d6/f28 439026 0 2023-12-08T20:27:56.276 INFO:tasks.workunit.client.1.smithi111.stdout:1/669: write d0/d6/d33/d6c/da1/fd2 [451211,85576] 0 2023-12-08T20:27:56.278 INFO:tasks.workunit.client.1.smithi111.stdout:7/645: mkdir da/d64/dd6 0 2023-12-08T20:27:56.278 INFO:tasks.workunit.client.1.smithi111.stdout:4/562: dread d8/da/d2c/d1f/f58 [0,4194304] 0 2023-12-08T20:27:56.278 INFO:tasks.workunit.client.1.smithi111.stdout:7/646: fsync da/d25/da9/db8/fca 0 2023-12-08T20:27:56.278 INFO:tasks.workunit.client.1.smithi111.stdout:7/647: write da/d25/d3d/f51 [1852752,12486] 0 2023-12-08T20:27:56.281 INFO:tasks.workunit.client.1.smithi111.stdout:5/815: link d3/d6d/ce0 d3/d4/d4a/c116 0 2023-12-08T20:27:56.281 INFO:tasks.workunit.client.1.smithi111.stdout:5/816: stat d3/d4/d7/d2c/f10f 0 2023-12-08T20:27:56.283 INFO:tasks.workunit.client.1.smithi111.stdout:6/489: dwrite d0/f8c [0,4194304] 0 2023-12-08T20:27:56.286 INFO:tasks.workunit.client.1.smithi111.stdout:1/670: mknod d0/d6/d33/d15/d51/d2e/cea 0 2023-12-08T20:27:56.286 INFO:tasks.workunit.client.1.smithi111.stdout:8/766: rename dd/d32/d36/d50/c9c to dd/d32/dea/c10e 0 2023-12-08T20:27:56.287 INFO:tasks.workunit.client.1.smithi111.stdout:4/563: creat d8/d30/d7d/d9b/db2/fb6 x:0 0 0 2023-12-08T20:27:56.292 INFO:tasks.workunit.client.1.smithi111.stdout:6/490: dread d0/d1/d27/d56/f76 [0,4194304] 0 2023-12-08T20:27:56.292 INFO:tasks.workunit.client.1.smithi111.stdout:7/648: link da/l6f da/d25/d3d/ld7 0 2023-12-08T20:27:56.297 INFO:tasks.workunit.client.1.smithi111.stdout:7/649: write da/f1b [2823405,130815] 0 2023-12-08T20:27:56.297 INFO:tasks.workunit.client.1.smithi111.stdout:7/650: chown da/d25/d3d/f85 1 1 2023-12-08T20:27:56.298 INFO:tasks.workunit.client.1.smithi111.stdout:4/564: rmdir d8/da/db/d7f/d93 39 2023-12-08T20:27:56.299 INFO:tasks.workunit.client.1.smithi111.stdout:4/565: chown d8/da/d29/f9a 2594451 1 2023-12-08T20:27:56.299 INFO:tasks.workunit.client.1.smithi111.stdout:8/767: symlink dd/dc9/ddb/df9/l10f 0 2023-12-08T20:27:56.304 INFO:tasks.workunit.client.1.smithi111.stdout:5/817: dwrite d3/d8d/fcd [0,4194304] 0 2023-12-08T20:27:56.304 INFO:tasks.workunit.client.1.smithi111.stdout:5/818: chown d3/d6d/ce0 10914 1 2023-12-08T20:27:56.304 INFO:tasks.workunit.client.1.smithi111.stdout:5/819: dread - d3/d4/d7/d29/d73/d90/ff9 zero size 2023-12-08T20:27:56.318 INFO:tasks.workunit.client.1.smithi111.stdout:4/566: mkdir d8/d30/d7d/d9b/db2/d4b/db7 0 2023-12-08T20:27:56.320 INFO:tasks.workunit.client.1.smithi111.stdout:5/820: creat d3/d4/d7/d29/d73/d90/f117 x:0 0 0 2023-12-08T20:27:56.320 INFO:tasks.workunit.client.1.smithi111.stdout:5/821: symlink d3/d4/d7/d29/d30/dc0/l118 0 2023-12-08T20:27:56.324 INFO:tasks.workunit.client.1.smithi111.stdout:6/491: dwrite d0/f13 [0,4194304] 0 2023-12-08T20:27:56.324 INFO:tasks.workunit.client.1.smithi111.stdout:6/492: read - d0/d1/d27/d6e/f70 zero size 2023-12-08T20:27:56.324 INFO:tasks.workunit.client.1.smithi111.stdout:6/493: write d0/d1a/f6f [160807,87999] 0 2023-12-08T20:27:56.324 INFO:tasks.workunit.client.1.smithi111.stdout:7/651: dwrite da/d25/d26/d32/d3e/d97/fa6 [0,4194304] 0 2023-12-08T20:27:56.324 INFO:tasks.workunit.client.1.smithi111.stdout:1/671: dwrite d0/fd0 [0,4194304] 0 2023-12-08T20:27:56.325 INFO:tasks.workunit.client.1.smithi111.stdout:8/768: dwrite dd/d35/d7a/f7f [0,4194304] 0 2023-12-08T20:27:56.325 INFO:tasks.workunit.client.1.smithi111.stdout:6/494: write d0/d1/d27/f87 [1575743,3649] 0 2023-12-08T20:27:56.327 INFO:tasks.workunit.client.1.smithi111.stdout:1/672: dread d0/d6/d33/d15/d51/d2e/d61/d79/f90 [0,4194304] 0 2023-12-08T20:27:56.327 INFO:tasks.workunit.client.1.smithi111.stdout:1/673: stat d0/d6/d33/d15/d51/d5b/d59/l74 0 2023-12-08T20:27:56.330 INFO:tasks.workunit.client.1.smithi111.stdout:5/822: dread d3/f10 [0,4194304] 0 2023-12-08T20:27:56.331 INFO:tasks.workunit.client.1.smithi111.stdout:7/652: creat da/d25/da9/fd8 x:0 0 0 2023-12-08T20:27:56.334 INFO:tasks.workunit.client.1.smithi111.stdout:8/769: creat dd/dc9/ddb/df9/f110 x:0 0 0 2023-12-08T20:27:56.336 INFO:tasks.workunit.client.1.smithi111.stdout:6/495: symlink d0/d68/d95/l9d 0 2023-12-08T20:27:56.336 INFO:tasks.workunit.client.1.smithi111.stdout:6/496: dread - d0/d1/d27/f5d zero size 2023-12-08T20:27:56.336 INFO:tasks.workunit.client.1.smithi111.stdout:6/497: write d0/d1a/f7d [568018,100511] 0 2023-12-08T20:27:56.337 INFO:tasks.workunit.client.1.smithi111.stdout:1/674: creat d0/d4d/feb x:0 0 0 2023-12-08T20:27:56.337 INFO:tasks.workunit.client.1.smithi111.stdout:6/498: write d0/d1a/f28 [7666191,16874] 0 2023-12-08T20:27:56.339 INFO:tasks.workunit.client.1.smithi111.stdout:5/823: creat d3/d4/d7/d36/d82/db4/dbe/f119 x:0 0 0 2023-12-08T20:27:56.340 INFO:tasks.workunit.client.1.smithi111.stdout:5/824: write d3/d4/d7/d29/d73/d90/fa1 [848334,14331] 0 2023-12-08T20:27:56.340 INFO:tasks.workunit.client.1.smithi111.stdout:7/653: unlink da/d25/d26/c72 0 2023-12-08T20:27:56.341 INFO:tasks.workunit.client.1.smithi111.stdout:8/770: creat dd/dc9/ddb/df0/f111 x:0 0 0 2023-12-08T20:27:56.344 INFO:tasks.workunit.client.1.smithi111.stdout:1/675: link d0/d6/d33/d60/ce8 d0/d6/d33/d15/d51/d5b/d5e/d86/dbd/cec 0 2023-12-08T20:27:56.344 INFO:tasks.workunit.client.1.smithi111.stdout:1/676: fdatasync d0/d6/d33/d15/d51/d2e/d61/fdd 0 2023-12-08T20:27:56.344 INFO:tasks.workunit.client.1.smithi111.stdout:1/677: readlink d0/d6/d33/d15/d51/d5b/l3f 0 2023-12-08T20:27:56.344 INFO:tasks.workunit.client.1.smithi111.stdout:1/678: chown d0/d6/d33/d15/d51/d5b/f54 6 1 2023-12-08T20:27:56.344 INFO:tasks.workunit.client.1.smithi111.stdout:5/825: symlink d3/d4/d7/d36/d64/l11a 0 2023-12-08T20:27:56.345 INFO:tasks.workunit.client.1.smithi111.stdout:1/679: dread d0/d6/d33/d15/d51/d2e/d61/f93 [0,4194304] 0 2023-12-08T20:27:56.347 INFO:tasks.workunit.client.1.smithi111.stdout:6/499: mknod d0/c9e 0 2023-12-08T20:27:56.348 INFO:tasks.workunit.client.1.smithi111.stdout:5/826: symlink d3/d4/d4a/l11b 0 2023-12-08T20:27:56.351 INFO:tasks.workunit.client.1.smithi111.stdout:5/827: rename d3/d4/d7/d36/l4e to d3/d12/d67/ddf/d108/l11c 0 2023-12-08T20:27:56.355 INFO:tasks.workunit.client.1.smithi111.stdout:6/500: dread d0/d1/f65 [0,4194304] 0 2023-12-08T20:27:56.355 INFO:tasks.workunit.client.1.smithi111.stdout:5/828: mknod d3/d4/d4a/d21/dea/c11d 0 2023-12-08T20:27:56.356 INFO:tasks.workunit.client.1.smithi111.stdout:5/829: creat d3/d12/d67/ddf/f11e x:0 0 0 2023-12-08T20:27:56.357 INFO:tasks.workunit.client.1.smithi111.stdout:1/680: dread d0/d4d/f6f [0,4194304] 0 2023-12-08T20:27:56.359 INFO:tasks.workunit.client.1.smithi111.stdout:5/830: creat d3/d4/d7/d36/d64/d8a/f11f x:0 0 0 2023-12-08T20:27:56.360 INFO:tasks.workunit.client.1.smithi111.stdout:5/831: read d3/d6d/f81 [1178454,68130] 0 2023-12-08T20:27:56.360 INFO:tasks.workunit.client.1.smithi111.stdout:7/654: truncate da/d25/f2e 4567127 0 2023-12-08T20:27:56.363 INFO:tasks.workunit.client.1.smithi111.stdout:7/655: mkdir da/d25/dd9 0 2023-12-08T20:27:56.363 INFO:tasks.workunit.client.1.smithi111.stdout:7/656: read - da/d5c/d59/fbc zero size 2023-12-08T20:27:56.363 INFO:tasks.workunit.client.1.smithi111.stdout:7/657: stat da/d25/d26/d32/d3e/d97/fa6 0 2023-12-08T20:27:56.363 INFO:tasks.workunit.client.1.smithi111.stdout:7/658: fdatasync da/fd0 0 2023-12-08T20:27:56.364 INFO:tasks.workunit.client.1.smithi111.stdout:5/832: creat d3/d4/d7/d29/d30/f120 x:0 0 0 2023-12-08T20:27:56.365 INFO:tasks.workunit.client.1.smithi111.stdout:7/659: creat da/d38/fda x:0 0 0 2023-12-08T20:27:56.366 INFO:tasks.workunit.client.1.smithi111.stdout:7/660: fdatasync da/d25/d26/d32/dcd/fd2 0 2023-12-08T20:27:56.366 INFO:tasks.workunit.client.1.smithi111.stdout:8/771: dwrite dd/d35/f43 [0,4194304] 0 2023-12-08T20:27:56.367 INFO:tasks.workunit.client.1.smithi111.stdout:5/833: truncate d3/d4/d7/d2c/f31 1702085 0 2023-12-08T20:27:56.372 INFO:tasks.workunit.client.1.smithi111.stdout:1/681: dread d0/d6/d33/f64 [0,4194304] 0 2023-12-08T20:27:56.376 INFO:tasks.workunit.client.1.smithi111.stdout:7/661: dread da/f1e [0,4194304] 0 2023-12-08T20:27:56.376 INFO:tasks.workunit.client.1.smithi111.stdout:7/662: chown da/d38 6878 1 2023-12-08T20:27:56.376 INFO:tasks.workunit.client.1.smithi111.stdout:6/501: dwrite d0/d1/d27/d36/d8d/f9c [0,4194304] 0 2023-12-08T20:27:56.376 INFO:tasks.workunit.client.1.smithi111.stdout:1/682: creat d0/d6/d33/d15/d51/d2e/d61/d79/dac/fed x:0 0 0 2023-12-08T20:27:56.378 INFO:tasks.workunit.client.1.smithi111.stdout:6/502: write d0/d1/d27/f40 [2223416,55749] 0 2023-12-08T20:27:56.379 INFO:tasks.workunit.client.1.smithi111.stdout:8/772: symlink dd/d32/d3d/d6b/l112 0 2023-12-08T20:27:56.384 INFO:tasks.workunit.client.1.smithi111.stdout:1/683: mkdir d0/d6/d47/dee 0 2023-12-08T20:27:56.387 INFO:tasks.workunit.client.1.smithi111.stdout:5/834: dwrite d3/d4/fac [0,4194304] 0 2023-12-08T20:27:56.389 INFO:tasks.workunit.client.1.smithi111.stdout:6/503: dread d0/f12 [0,4194304] 0 2023-12-08T20:27:56.392 INFO:tasks.workunit.client.1.smithi111.stdout:5/835: creat d3/d12/dbd/f121 x:0 0 0 2023-12-08T20:27:56.392 INFO:tasks.workunit.client.1.smithi111.stdout:5/836: fdatasync d3/d6d/fa4 0 2023-12-08T20:27:56.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.393+0000 7f1a20df8700 1 -- 172.21.15.43:0/2812035020 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1a1c10cfb0 con 0x7f1a1c0fbaf0 2023-12-08T20:27:56.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.394+0000 7f1a0affd700 1 -- 172.21.15.43:0/2812035020 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7f1a0c056720 con 0x7f1a1c0fbaf0 2023-12-08T20:27:56.395 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:27:56.395 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": { 2023-12-08T20:27:56.396 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2 2023-12-08T20:27:56.396 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:27:56.396 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": { 2023-12-08T20:27:56.397 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 1, 2023-12-08T20:27:56.397 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 1 2023-12-08T20:27:56.397 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:27:56.397 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": { 2023-12-08T20:27:56.397 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 6 2023-12-08T20:27:56.397 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:27:56.397 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2023-12-08T20:27:56.397 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-08T20:27:56.397 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:27:56.397 INFO:teuthology.orchestra.run.smithi043.stdout: "overall": { 2023-12-08T20:27:56.397 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 13, 2023-12-08T20:27:56.397 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 1 2023-12-08T20:27:56.397 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-12-08T20:27:56.397 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:27:56.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.397+0000 7f1a20df8700 1 -- 172.21.15.43:0/2812035020 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f1a0406ae40 msgr2=0x7f1a0406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:56.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.397+0000 7f1a20df8700 1 --2- 172.21.15.43:0/2812035020 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f1a0406ae40 0x7f1a0406d2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000d5c0 tx=0x7f1a1000b040 comp rx=0 tx=0).stop 2023-12-08T20:27:56.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.397+0000 7f1a20df8700 1 -- 172.21.15.43:0/2812035020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a1c0fbaf0 msgr2=0x7f1a1c10b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:56.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.397+0000 7f1a20df8700 1 --2- 172.21.15.43:0/2812035020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a1c0fbaf0 0x7f1a1c10b230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00eb70 tx=0x7f1a0c00b040 comp rx=0 tx=0).stop 2023-12-08T20:27:56.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.397+0000 7f1a20df8700 1 -- 172.21.15.43:0/2812035020 shutdown_connections 2023-12-08T20:27:56.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.397+0000 7f1a20df8700 1 --2- 172.21.15.43:0/2812035020 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f1a0406ae40 0x7f1a0406d2f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:56.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.397+0000 7f1a20df8700 1 --2- 172.21.15.43:0/2812035020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a1c0fbaf0 0x7f1a1c10b230 secure :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00eb70 tx=0x7f1a0c00b040 comp rx=0 tx=0).stop 2023-12-08T20:27:56.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.397+0000 7f1a20df8700 1 --2- 172.21.15.43:0/2812035020 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a1c0fcd00 0x7f1a1c10b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:56.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.397+0000 7f1a20df8700 1 -- 172.21.15.43:0/2812035020 >> 172.21.15.43:0/2812035020 conn(0x7f1a1c0f71b0 msgr2=0x7f1a1c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:56.399 INFO:tasks.workunit.client.1.smithi111.stdout:7/663: getdents da/d25 0 2023-12-08T20:27:56.399 INFO:tasks.workunit.client.1.smithi111.stdout:7/664: chown da/d64/cbf 533 1 2023-12-08T20:27:56.399 INFO:tasks.workunit.client.1.smithi111.stdout:7/665: readlink da/d25/d3d/dc9/lbd 0 2023-12-08T20:27:56.401 INFO:tasks.workunit.client.1.smithi111.stdout:5/837: mkdir d3/d4/d7/d29/dd6/d122 0 2023-12-08T20:27:56.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.400+0000 7f1a20df8700 1 -- 172.21.15.43:0/2812035020 shutdown_connections 2023-12-08T20:27:56.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.400+0000 7f1a20df8700 1 -- 172.21.15.43:0/2812035020 wait complete. 2023-12-08T20:27:56.403 INFO:tasks.workunit.client.1.smithi111.stdout:6/504: dwrite d0/d1/f65 [0,4194304] 0 2023-12-08T20:27:56.403 INFO:tasks.workunit.client.1.smithi111.stdout:6/505: fdatasync d0/d1/d27/f5f 0 2023-12-08T20:27:56.403 INFO:tasks.workunit.client.1.smithi111.stdout:5/838: dread d3/d4/d7/d29/d30/dd3/fdb [0,4194304] 0 2023-12-08T20:27:56.404 INFO:tasks.workunit.client.1.smithi111.stdout:5/839: readlink d3/le3 0 2023-12-08T20:27:56.405 INFO:tasks.workunit.client.1.smithi111.stdout:7/666: creat da/d5c/d6e/fdb x:0 0 0 2023-12-08T20:27:56.406 INFO:tasks.workunit.client.1.smithi111.stdout:6/506: creat d0/d1/f9f x:0 0 0 2023-12-08T20:27:56.406 INFO:tasks.workunit.client.1.smithi111.stdout:6/507: fdatasync d0/f13 0 2023-12-08T20:27:56.407 INFO:tasks.workunit.client.1.smithi111.stdout:5/840: creat d3/f123 x:0 0 0 2023-12-08T20:27:56.408 INFO:tasks.workunit.client.1.smithi111.stdout:5/841: write d3/d4/d7/d36/d64/d96/f110 [1033589,59506] 0 2023-12-08T20:27:56.408 INFO:tasks.workunit.client.1.smithi111.stdout:5/842: dread - d3/d12/dbd/f121 zero size 2023-12-08T20:27:56.408 INFO:tasks.workunit.client.1.smithi111.stdout:5/843: fdatasync d3/d4/d7/d29/d30/fd1 0 2023-12-08T20:27:56.408 INFO:tasks.workunit.client.1.smithi111.stdout:5/844: fsync d3/f6e 0 2023-12-08T20:27:56.408 INFO:tasks.workunit.client.1.smithi111.stdout:5/845: write d3/d4/d4a/fcf [2543424,64736] 0 2023-12-08T20:27:56.408 INFO:tasks.workunit.client.1.smithi111.stdout:7/667: creat da/d25/da9/fdc x:0 0 0 2023-12-08T20:27:56.408 INFO:tasks.workunit.client.1.smithi111.stdout:8/773: getdents dd/d32/d3d/d6b 0 2023-12-08T20:27:56.411 INFO:tasks.workunit.client.1.smithi111.stdout:5/846: creat d3/d12/dbd/f124 x:0 0 0 2023-12-08T20:27:56.413 INFO:tasks.workunit.client.1.smithi111.stdout:7/668: unlink da/d25/da9/db8/f29 0 2023-12-08T20:27:56.414 INFO:tasks.workunit.client.1.smithi111.stdout:8/774: dread dd/f2a [0,4194304] 0 2023-12-08T20:27:56.415 INFO:tasks.workunit.client.1.smithi111.stdout:8/775: write dd/d35/d42/fb5 [47390,11933] 0 2023-12-08T20:27:56.415 INFO:tasks.workunit.client.1.smithi111.stdout:6/508: mkdir d0/da0 0 2023-12-08T20:27:56.417 INFO:tasks.workunit.client.1.smithi111.stdout:8/776: dread dd/d32/d36/d50/f65 [0,4194304] 0 2023-12-08T20:27:56.417 INFO:tasks.workunit.client.1.smithi111.stdout:8/777: chown dd/d35/d7a/ffb 5959999 1 2023-12-08T20:27:56.418 INFO:tasks.workunit.client.1.smithi111.stdout:6/509: mkdir d0/d1/d27/da1 0 2023-12-08T20:27:56.418 INFO:tasks.workunit.client.1.smithi111.stdout:5/847: dread d3/d4/d4a/fcf [0,4194304] 0 2023-12-08T20:27:56.418 INFO:tasks.workunit.client.1.smithi111.stdout:5/848: fdatasync d3/d4/d4a/f6f 0 2023-12-08T20:27:56.418 INFO:tasks.workunit.client.1.smithi111.stdout:5/849: fsync d3/d4/d7/d29/d30/f3f 0 2023-12-08T20:27:56.418 INFO:tasks.workunit.client.1.smithi111.stdout:5/850: chown d3/d4/d7/d36/d64/f86 2032503 1 2023-12-08T20:27:56.420 INFO:tasks.workunit.client.1.smithi111.stdout:8/778: link dd/d35/d42/fb5 dd/d32/dea/f113 0 2023-12-08T20:27:56.420 INFO:tasks.workunit.client.1.smithi111.stdout:8/779: write dd/f54 [5323590,92935] 0 2023-12-08T20:27:56.420 INFO:tasks.workunit.client.1.smithi111.stdout:8/780: getdents dd/d32/de2 0 2023-12-08T20:27:56.424 INFO:tasks.workunit.client.1.smithi111.stdout:5/851: link d3/f10 d3/d4/d4a/d21/dea/f125 0 2023-12-08T20:27:56.427 INFO:tasks.workunit.client.1.smithi111.stdout:8/781: creat dd/d35/d42/db4/d109/f114 x:0 0 0 2023-12-08T20:27:56.428 INFO:tasks.workunit.client.1.smithi111.stdout:6/510: truncate d0/d1a/f7d 524395 0 2023-12-08T20:27:56.428 INFO:tasks.workunit.client.1.smithi111.stdout:6/511: read d0/d1/d1e/f42 [113688,100853] 0 2023-12-08T20:27:56.431 INFO:tasks.workunit.client.1.smithi111.stdout:8/782: truncate fa 4372282 0 2023-12-08T20:27:56.432 INFO:tasks.workunit.client.1.smithi111.stdout:7/669: dwrite da/d13/d9e/f4b [4194304,4194304] 0 2023-12-08T20:27:56.435 INFO:tasks.workunit.client.1.smithi111.stdout:6/512: write d0/f4a [427639,81486] 0 2023-12-08T20:27:56.435 INFO:tasks.workunit.client.1.smithi111.stdout:6/513: fdatasync d0/d1/d27/d36/f3e 0 2023-12-08T20:27:56.435 INFO:tasks.workunit.client.1.smithi111.stdout:6/514: fsync d0/d68/d95/f35 0 2023-12-08T20:27:56.435 INFO:tasks.workunit.client.1.smithi111.stdout:6/515: chown d0/d1/f5 7 1 2023-12-08T20:27:56.436 INFO:tasks.workunit.client.1.smithi111.stdout:8/783: rename dd/d35/d42/lef to dd/d35/d42/l115 0 2023-12-08T20:27:56.439 INFO:tasks.workunit.client.1.smithi111.stdout:7/670: symlink da/d5c/ldd 0 2023-12-08T20:27:56.439 INFO:tasks.workunit.client.1.smithi111.stdout:7/671: write da/d13/d9e/d75/d9f/fc8 [157049,40704] 0 2023-12-08T20:27:56.440 INFO:tasks.workunit.client.1.smithi111.stdout:7/672: readlink da/d25/d3d/d58/lc2 0 2023-12-08T20:27:56.440 INFO:tasks.workunit.client.1.smithi111.stdout:6/516: rename d0/d1/d27/c77 to d0/d68/d95/d7a/ca2 0 2023-12-08T20:27:56.440 INFO:tasks.workunit.client.1.smithi111.stdout:6/517: chown d0/d68/d95/c74 1 1 2023-12-08T20:27:56.441 INFO:tasks.workunit.client.1.smithi111.stdout:6/518: creat d0/d1/d27/d36/d8d/fa3 x:0 0 0 2023-12-08T20:27:56.443 INFO:tasks.workunit.client.1.smithi111.stdout:5/852: dwrite d3/d4/d7/d29/d30/f9d [0,4194304] 0 2023-12-08T20:27:56.443 INFO:tasks.workunit.client.1.smithi111.stdout:6/519: mknod d0/d68/ca4 0 2023-12-08T20:27:56.449 INFO:tasks.workunit.client.1.smithi111.stdout:8/784: read dd/d32/dea/df1/fe5 [7669487,2964] 0 2023-12-08T20:27:56.451 INFO:tasks.workunit.client.1.smithi111.stdout:8/785: mknod dd/d35/d42/db4/d109/c116 0 2023-12-08T20:27:56.454 INFO:tasks.workunit.client.1.smithi111.stdout:8/786: unlink dd/d32/d3d/d55/fb0 0 2023-12-08T20:27:56.455 INFO:tasks.workunit.client.1.smithi111.stdout:6/520: read d0/d1a/f72 [520111,53414] 0 2023-12-08T20:27:56.456 INFO:tasks.workunit.client.1.smithi111.stdout:8/787: symlink dd/dc9/ddb/df9/l117 0 2023-12-08T20:27:56.458 INFO:tasks.workunit.client.1.smithi111.stdout:6/521: mkdir d0/d1a/da5 0 2023-12-08T20:27:56.465 INFO:tasks.workunit.client.1.smithi111.stdout:8/788: dread dd/f2b [0,4194304] 0 2023-12-08T20:27:56.466 INFO:tasks.workunit.client.1.smithi111.stdout:8/789: write dd/d2d/d62/d83/fc5 [98234,5755] 0 2023-12-08T20:27:56.467 INFO:tasks.workunit.client.1.smithi111.stdout:7/673: dwrite da/d25/d26/d32/f90 [0,4194304] 0 2023-12-08T20:27:56.467 INFO:tasks.workunit.client.1.smithi111.stdout:7/674: chown da/d25/da9/db8/f67 23288848 1 2023-12-08T20:27:56.468 INFO:tasks.workunit.client.1.smithi111.stdout:7/675: fdatasync da/d25/da9/fd8 0 2023-12-08T20:27:56.468 INFO:tasks.workunit.client.1.smithi111.stdout:7/676: write da/d25/d26/d32/f8e [5343,50195] 0 2023-12-08T20:27:56.468 INFO:tasks.workunit.client.1.smithi111.stdout:5/853: dwrite d3/d12/d67/ddf/ff3 [0,4194304] 0 2023-12-08T20:27:56.468 INFO:tasks.workunit.client.1.smithi111.stdout:5/854: chown d3/l5e 103406 1 2023-12-08T20:27:56.468 INFO:tasks.workunit.client.1.smithi111.stdout:5/855: readlink d3/d4/d7/d29/d73/l9a 0 2023-12-08T20:27:56.468 INFO:tasks.workunit.client.1.smithi111.stdout:8/790: mkdir dd/d32/d3d/d6b/d72/d118 0 2023-12-08T20:27:56.469 INFO:tasks.workunit.client.1.smithi111.stdout:7/677: unlink da/d25/f3a 0 2023-12-08T20:27:56.469 INFO:tasks.workunit.client.1.smithi111.stdout:7/678: fsync da/d25/f5d 0 2023-12-08T20:27:56.469 INFO:tasks.workunit.client.1.smithi111.stdout:7/679: write da/d38/f8f [215588,42053] 0 2023-12-08T20:27:56.470 INFO:tasks.workunit.client.1.smithi111.stdout:7/680: readlink da/d25/d26/d32/d3e/l76 0 2023-12-08T20:27:56.474 INFO:tasks.workunit.client.1.smithi111.stdout:5/856: mknod d3/d8d/c126 0 2023-12-08T20:27:56.475 INFO:tasks.workunit.client.1.smithi111.stdout:5/857: dread d3/d6d/ff1 [0,4194304] 0 2023-12-08T20:27:56.476 INFO:tasks.workunit.client.1.smithi111.stdout:6/522: dwrite d0/d1/d1e/f61 [0,4194304] 0 2023-12-08T20:27:56.484 INFO:tasks.workunit.client.1.smithi111.stdout:7/681: stat da/d25/d3d/ld7 0 2023-12-08T20:27:56.485 INFO:tasks.workunit.client.0.smithi043.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-08T20:27:56.485 INFO:tasks.workunit.client.1.smithi111.stdout:8/791: mkdir dd/d32/d36/d119 0 2023-12-08T20:27:56.486 INFO:tasks.workunit.client.1.smithi111.stdout:5/858: creat d3/d4/f127 x:0 0 0 2023-12-08T20:27:56.491 INFO:tasks.workunit.client.1.smithi111.stdout:7/682: creat da/d5c/d59/d61/fde x:0 0 0 2023-12-08T20:27:56.491 INFO:tasks.workunit.client.1.smithi111.stdout:7/683: write da/d25/d26/d32/dcd/fd2 [185380,63554] 0 2023-12-08T20:27:56.493 INFO:tasks.workunit.client.1.smithi111.stdout:8/792: link dd/d32/d36/d50/fc8 dd/f11a 0 2023-12-08T20:27:56.495 INFO:tasks.workunit.client.1.smithi111.stdout:6/523: dwrite d0/d1/f64 [0,4194304] 0 2023-12-08T20:27:56.496 INFO:tasks.workunit.client.0.smithi043.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-08T20:27:56.496 INFO:tasks.workunit.client.0.smithi043.stderr:+ make 2023-12-08T20:27:56.496 INFO:tasks.workunit.client.1.smithi111.stdout:5/859: creat d3/d6d/f128 x:0 0 0 2023-12-08T20:27:56.498 INFO:tasks.workunit.client.1.smithi111.stdout:8/793: symlink dd/d35/d42/db4/l11b 0 2023-12-08T20:27:56.501 INFO:tasks.workunit.client.1.smithi111.stdout:3/610: sync 2023-12-08T20:27:56.501 INFO:tasks.workunit.client.1.smithi111.stdout:0/949: sync 2023-12-08T20:27:56.501 INFO:tasks.workunit.client.1.smithi111.stdout:2/638: sync 2023-12-08T20:27:56.501 INFO:tasks.workunit.client.1.smithi111.stdout:9/764: sync 2023-12-08T20:27:56.501 INFO:tasks.workunit.client.1.smithi111.stdout:3/611: dread - d2/d15/d17/d25/d4e/f78 zero size 2023-12-08T20:27:56.503 INFO:tasks.workunit.client.1.smithi111.stdout:2/639: dread d1/d29/d53/d91/fbb [0,4194304] 0 2023-12-08T20:27:56.505 INFO:tasks.workunit.client.1.smithi111.stdout:3/612: symlink d2/d3/d13/d36/d44/d8f/lbb 0 2023-12-08T20:27:56.506 INFO:tasks.workunit.client.1.smithi111.stdout:9/765: write d2/f59 [2947062,110887] 0 2023-12-08T20:27:56.506 INFO:tasks.workunit.client.1.smithi111.stdout:7/684: dwrite da/d25/da9/fd8 [0,4194304] 0 2023-12-08T20:27:56.507 INFO:tasks.workunit.client.1.smithi111.stdout:2/640: symlink d1/d1d/d68/d73/dd6/led 0 2023-12-08T20:27:56.511 INFO:tasks.workunit.client.1.smithi111.stdout:9/766: unlink d2/d8/dd/d1a/d1e/d2d/d35/f53 0 2023-12-08T20:27:56.512 INFO:tasks.workunit.client.1.smithi111.stdout:9/767: fsync d2/d8/dd/d1a/d1e/d2d/d4a/fab 0 2023-12-08T20:27:56.512 INFO:tasks.workunit.client.1.smithi111.stdout:9/768: truncate d2/d8/dd/d1a/d1e/d2d/d35/f95 179076 0 2023-12-08T20:27:56.512 INFO:tasks.workunit.client.1.smithi111.stdout:3/613: read d2/d12/f65 [188841,125414] 0 2023-12-08T20:27:56.515 INFO:tasks.workunit.client.1.smithi111.stdout:9/769: write d2/da/fce [1250645,116355] 0 2023-12-08T20:27:56.515 INFO:tasks.workunit.client.1.smithi111.stdout:7/685: mkdir da/d5c/d6e/ddf 0 2023-12-08T20:27:56.515 INFO:tasks.workunit.client.1.smithi111.stdout:0/950: dwrite d1/df/d16/d2c/d7b/dba/f129 [0,4194304] 0 2023-12-08T20:27:56.518 INFO:tasks.workunit.client.1.smithi111.stdout:2/641: rename d1/d1d/d1f/d25/d3d/d41/db9/dc5/ldb to d1/d1d/d1f/d25/d3d/d9f/lee 0 2023-12-08T20:27:56.518 INFO:tasks.workunit.client.1.smithi111.stdout:2/642: dread - d1/d1d/d1f/d25/fc9 zero size 2023-12-08T20:27:56.518 INFO:tasks.workunit.client.1.smithi111.stdout:1/684: sync 2023-12-08T20:27:56.518 INFO:tasks.workunit.client.1.smithi111.stdout:4/567: sync 2023-12-08T20:27:56.518 INFO:tasks.workunit.client.1.smithi111.stdout:4/568: dread - d8/d30/fa3 zero size 2023-12-08T20:27:56.519 INFO:tasks.workunit.client.1.smithi111.stdout:6/524: truncate d0/d1/d1e/f61 503807 0 2023-12-08T20:27:56.521 INFO:tasks.workunit.client.1.smithi111.stdout:3/614: link d2/d15/d17/d25/d4e/fb3 d2/d15/d17/d25/d4e/fbc 0 2023-12-08T20:27:56.524 INFO:tasks.workunit.client.1.smithi111.stdout:7/686: creat da/d38/d80/fe0 x:0 0 0 2023-12-08T20:27:56.531 INFO:tasks.workunit.client.1.smithi111.stdout:3/615: dread d2/d12/f1d [0,4194304] 0 2023-12-08T20:27:56.531 INFO:tasks.workunit.client.1.smithi111.stdout:3/616: chown d2/d3/d13/d36/c8d 604269 1 2023-12-08T20:27:56.532 INFO:tasks.workunit.client.1.smithi111.stdout:0/951: rename d1/d4/f38 to d1/d2d/d83/dab/f13c 0 2023-12-08T20:27:56.535 INFO:tasks.workunit.client.1.smithi111.stdout:2/643: rmdir d1/d1d/d1f/d25/d3d/d41/db9 39 2023-12-08T20:27:56.538 INFO:tasks.workunit.client.1.smithi111.stdout:1/685: mkdir d0/d8e/db6/def 0 2023-12-08T20:27:56.539 INFO:tasks.workunit.client.1.smithi111.stdout:6/525: dwrite d0/d68/f8b [0,4194304] 0 2023-12-08T20:27:56.539 INFO:tasks.workunit.client.1.smithi111.stdout:6/526: write d0/d1/d27/d6e/f70 [321839,74817] 0 2023-12-08T20:27:56.539 INFO:tasks.workunit.client.1.smithi111.stdout:6/527: stat d0/c80 0 2023-12-08T20:27:56.539 INFO:tasks.workunit.client.1.smithi111.stdout:6/528: read - d0/d68/d95/f7b zero size 2023-12-08T20:27:56.540 INFO:tasks.workunit.client.1.smithi111.stdout:6/529: chown d0/d1a/f1f 4 1 2023-12-08T20:27:56.540 INFO:tasks.workunit.client.1.smithi111.stdout:7/687: mknod da/d25/da9/db8/ce1 0 2023-12-08T20:27:56.540 INFO:tasks.workunit.client.1.smithi111.stdout:7/688: write da/fd0 [951088,101038] 0 2023-12-08T20:27:56.540 INFO:tasks.workunit.client.1.smithi111.stdout:7/689: fdatasync da/d25/da9/db8/f50 0 2023-12-08T20:27:56.540 INFO:tasks.workunit.client.1.smithi111.stdout:4/569: dwrite d8/da/d2c/f5e [0,4194304] 0 2023-12-08T20:27:56.541 INFO:tasks.workunit.client.1.smithi111.stdout:9/770: dwrite d2/d8/dd/d56/fa0 [4194304,4194304] 0 2023-12-08T20:27:56.542 INFO:tasks.workunit.client.1.smithi111.stdout:9/771: write d2/d8/dd/d56/fa0 [2066773,126673] 0 2023-12-08T20:27:56.542 INFO:tasks.workunit.client.1.smithi111.stdout:6/530: read d0/d1a/f31 [1168091,109786] 0 2023-12-08T20:27:56.544 INFO:tasks.workunit.client.1.smithi111.stdout:3/617: mkdir d2/d12/dbd 0 2023-12-08T20:27:56.544 INFO:tasks.workunit.client.1.smithi111.stdout:3/618: fdatasync d2/d15/d17/d25/d4e/f61 0 2023-12-08T20:27:56.547 INFO:tasks.workunit.client.1.smithi111.stdout:0/952: creat d1/df/d16/d2c/f13d x:0 0 0 2023-12-08T20:27:56.547 INFO:tasks.workunit.client.1.smithi111.stdout:8/794: dwrite dd/d32/d36/d50/f65 [0,4194304] 0 2023-12-08T20:27:56.548 INFO:tasks.workunit.client.1.smithi111.stdout:8/795: readlink dd/l5f 0 2023-12-08T20:27:56.548 INFO:tasks.workunit.client.1.smithi111.stdout:8/796: read dd/d35/d42/fa5 [2554169,67500] 0 2023-12-08T20:27:56.552 INFO:tasks.workunit.client.1.smithi111.stdout:2/644: mkdir d1/d1d/d1f/d25/d3d/d41/db9/def 0 2023-12-08T20:27:56.552 INFO:tasks.workunit.client.1.smithi111.stdout:2/645: truncate d1/d29/d53/f82 267098 0 2023-12-08T20:27:56.554 INFO:tasks.workunit.client.1.smithi111.stdout:1/686: creat d0/d6/d33/d15/d51/d2e/d61/ff0 x:0 0 0 2023-12-08T20:27:56.554 INFO:tasks.workunit.client.1.smithi111.stdout:1/687: write d0/d6/d33/f64 [4428873,82465] 0 2023-12-08T20:27:56.559 INFO:tasks.workunit.client.1.smithi111.stdout:7/690: rmdir da/d25/d26 39 2023-12-08T20:27:56.563 INFO:tasks.workunit.client.1.smithi111.stdout:4/570: rename d8/d30/d7d/d9b/db2/d4b/faf to d8/da/db/d7f/d93/d77/db5/fb8 0 2023-12-08T20:27:56.569 INFO:tasks.workunit.client.1.smithi111.stdout:6/531: symlink d0/d1/d27/d36/d8d/la6 0 2023-12-08T20:27:56.570 INFO:tasks.workunit.client.1.smithi111.stdout:0/953: dwrite d1/df/d16/d2c/d7b/fbf [0,4194304] 0 2023-12-08T20:27:56.570 INFO:tasks.workunit.client.1.smithi111.stdout:0/954: stat d1/dd/d47 0 2023-12-08T20:27:56.570 INFO:tasks.workunit.client.1.smithi111.stdout:6/532: read d0/d1/d27/f40 [2120558,64866] 0 2023-12-08T20:27:56.572 INFO:tasks.workunit.client.1.smithi111.stdout:3/619: mkdir d2/d15/d17/d5e/d9f/dbe 0 2023-12-08T20:27:56.572 INFO:tasks.workunit.client.1.smithi111.stdout:3/620: dread - d2/d3/d1e/d93/fa4 zero size 2023-12-08T20:27:56.573 INFO:tasks.workunit.client.1.smithi111.stdout:3/621: dread d2/d12/d2e/f74 [0,4194304] 0 2023-12-08T20:27:56.573 INFO:tasks.workunit.client.1.smithi111.stdout:3/622: dread - d2/d3/d51/fb0 zero size 2023-12-08T20:27:56.577 INFO:tasks.workunit.client.1.smithi111.stdout:8/797: mknod dd/d32/c11c 0 2023-12-08T20:27:56.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.579+0000 7fbc59630700 1 -- 172.21.15.43:0/1746634729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc540ffd70 msgr2=0x7fbc541021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:56.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.579+0000 7fbc59630700 1 --2- 172.21.15.43:0/1746634729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc540ffd70 0x7fbc541021d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbc48004940 tx=0x7fbc48009e30 comp rx=0 tx=0).stop 2023-12-08T20:27:56.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.579+0000 7fbc59630700 1 -- 172.21.15.43:0/1746634729 shutdown_connections 2023-12-08T20:27:56.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.579+0000 7fbc59630700 1 --2- 172.21.15.43:0/1746634729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc540ffd70 0x7fbc541021d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:56.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.579+0000 7fbc59630700 1 --2- 172.21.15.43:0/1746634729 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc54066920 0x7fbc540ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:56.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.580+0000 7fbc59630700 1 -- 172.21.15.43:0/1746634729 >> 172.21.15.43:0/1746634729 conn(0x7fbc540f71b0 msgr2=0x7fbc540f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:56.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.580+0000 7fbc59630700 1 -- 172.21.15.43:0/1746634729 shutdown_connections 2023-12-08T20:27:56.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.580+0000 7fbc59630700 1 -- 172.21.15.43:0/1746634729 wait complete. 2023-12-08T20:27:56.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.581+0000 7fbc59630700 1 Processor -- start 2023-12-08T20:27:56.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.581+0000 7fbc59630700 1 -- start start 2023-12-08T20:27:56.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.581+0000 7fbc59630700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc54066920 0x7fbc5410b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:56.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.581+0000 7fbc59630700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc540ffd70 0x7fbc5410b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:56.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.581+0000 7fbc59630700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5410bdd0 con 0x7fbc54066920 2023-12-08T20:27:56.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.581+0000 7fbc59630700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5410c670 con 0x7fbc540ffd70 2023-12-08T20:27:56.583 INFO:tasks.workunit.client.1.smithi111.stdout:2/646: rmdir d1/d29/d53 39 2023-12-08T20:27:56.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.581+0000 7fbc52ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc54066920 0x7fbc5410b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:56.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.581+0000 7fbc527fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc540ffd70 0x7fbc5410b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:56.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.581+0000 7fbc527fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc540ffd70 0x7fbc5410b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.43:56078/0 (socket says 172.21.15.43:56078) 2023-12-08T20:27:56.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.581+0000 7fbc527fc700 1 -- 172.21.15.43:0/3171926208 learned_addr learned my addr 172.21.15.43:0/3171926208 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:27:56.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.581+0000 7fbc52ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc54066920 0x7fbc5410b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38492/0 (socket says 172.21.15.43:38492) 2023-12-08T20:27:56.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.582+0000 7fbc527fc700 1 -- 172.21.15.43:0/3171926208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc54066920 msgr2=0x7fbc5410b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:56.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.582+0000 7fbc527fc700 1 --2- 172.21.15.43:0/3171926208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc54066920 0x7fbc5410b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:56.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.582+0000 7fbc527fc700 1 -- 172.21.15.43:0/3171926208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc44005040 con 0x7fbc540ffd70 2023-12-08T20:27:56.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.582+0000 7fbc527fc700 1 --2- 172.21.15.43:0/3171926208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc540ffd70 0x7fbc5410b780 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009fd0 tx=0x7fbc48009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:27:56.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.582+0000 7fbc3b7fe700 1 -- 172.21.15.43:0/3171926208 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc48021070 con 0x7fbc540ffd70 2023-12-08T20:27:56.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.583+0000 7fbc3b7fe700 1 -- 172.21.15.43:0/3171926208 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbc4801c400 con 0x7fbc540ffd70 2023-12-08T20:27:56.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.583+0000 7fbc3b7fe700 1 -- 172.21.15.43:0/3171926208 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc4800e070 con 0x7fbc540ffd70 2023-12-08T20:27:56.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.583+0000 7fbc59630700 1 -- 172.21.15.43:0/3171926208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc48005040 con 0x7fbc540ffd70 2023-12-08T20:27:56.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.583+0000 7fbc59630700 1 -- 172.21.15.43:0/3171926208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5410cc40 con 0x7fbc540ffd70 2023-12-08T20:27:56.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.584+0000 7fbc59630700 1 -- 172.21.15.43:0/3171926208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5404bb80 con 0x7fbc540ffd70 2023-12-08T20:27:56.585 INFO:tasks.workunit.client.1.smithi111.stdout:1/688: link d0/d8e/lda d0/d6/d47/lf1 0 2023-12-08T20:27:56.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.586+0000 7fbc3b7fe700 1 -- 172.21.15.43:0/3171926208 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7fbc4801ca00 con 0x7fbc540ffd70 2023-12-08T20:27:56.588 INFO:tasks.workunit.client.1.smithi111.stdout:7/691: mkdir da/d25/da9/db8/d89/de2 0 2023-12-08T20:27:56.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.587+0000 7fbc3b7fe700 1 --2- 172.21.15.43:0/3171926208 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7fbc3c06ae40 0x7fbc3c06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:27:56.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.587+0000 7fbc3b7fe700 1 -- 172.21.15.43:0/3171926208 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fbc4808ad00 con 0x7fbc540ffd70 2023-12-08T20:27:56.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.587+0000 7fbc52ffd700 1 --2- 172.21.15.43:0/3171926208 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7fbc3c06ae40 0x7fbc3c06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:27:56.589 INFO:tasks.workunit.client.1.smithi111.stdout:4/571: mknod d8/d30/d7d/d9b/cb9 0 2023-12-08T20:27:56.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.589+0000 7fbc52ffd700 1 --2- 172.21.15.43:0/3171926208 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7fbc3c06ae40 0x7fbc3c06d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbc44007fd0 tx=0x7fbc4400b040 comp rx=0 tx=0).ready entity=mgr.24407 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:27:56.590 INFO:tasks.workunit.client.1.smithi111.stdout:1/689: write d0/d4d/f57 [184101,69437] 0 2023-12-08T20:27:56.591 INFO:tasks.workunit.client.1.smithi111.stdout:1/690: write d0/d6/d33/d15/d51/d78/f95 [773942,95282] 0 2023-12-08T20:27:56.591 INFO:tasks.workunit.client.1.smithi111.stdout:1/691: chown d0/d22 573764 1 2023-12-08T20:27:56.591 INFO:tasks.workunit.client.1.smithi111.stdout:8/798: dread dd/d2d/f78 [0,4194304] 0 2023-12-08T20:27:56.592 INFO:tasks.workunit.client.1.smithi111.stdout:0/955: creat d1/df/d16/d2c/d7e/f13e x:0 0 0 2023-12-08T20:27:56.593 INFO:tasks.workunit.client.1.smithi111.stdout:6/533: mknod d0/d1/d27/d56/ca7 0 2023-12-08T20:27:56.593 INFO:tasks.workunit.client.1.smithi111.stdout:6/534: fsync d0/d1/f8 0 2023-12-08T20:27:56.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.593+0000 7fbc3b7fe700 1 -- 172.21.15.43:0/3171926208 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fbc48055100 con 0x7fbc540ffd70 2023-12-08T20:27:56.595 INFO:tasks.workunit.client.1.smithi111.stdout:3/623: link d2/d3/d6/f23 d2/d3/d13/d36/fbf 0 2023-12-08T20:27:56.597 INFO:tasks.workunit.client.1.smithi111.stdout:7/692: rename da/d25/d3d/dc9/lbd to da/d25/da9/le3 0 2023-12-08T20:27:56.597 INFO:tasks.workunit.client.1.smithi111.stdout:7/693: dread - da/d5c/fc7 zero size 2023-12-08T20:27:56.597 INFO:tasks.workunit.client.1.smithi111.stdout:7/694: dread - da/d5c/d59/d61/fde zero size 2023-12-08T20:27:56.598 INFO:tasks.workunit.client.1.smithi111.stdout:4/572: creat d8/da/d29/d69/fba x:0 0 0 2023-12-08T20:27:56.598 INFO:tasks.workunit.client.1.smithi111.stdout:2/647: dwrite d1/f15 [0,4194304] 0 2023-12-08T20:27:56.599 INFO:tasks.workunit.client.1.smithi111.stdout:1/692: truncate d0/f2f 1353615 0 2023-12-08T20:27:56.601 INFO:tasks.workunit.client.1.smithi111.stdout:8/799: mknod dd/d2d/d8b/d9b/c11d 0 2023-12-08T20:27:56.603 INFO:tasks.workunit.client.1.smithi111.stdout:0/956: dread d1/d69/d8b/f9c [0,4194304] 0 2023-12-08T20:27:56.603 INFO:tasks.workunit.client.1.smithi111.stdout:6/535: mkdir d0/d68/d8e/da8 0 2023-12-08T20:27:56.603 INFO:tasks.workunit.client.1.smithi111.stdout:0/957: write d1/df/d44/d37/f8a [23974,104452] 0 2023-12-08T20:27:56.603 INFO:tasks.workunit.client.1.smithi111.stdout:6/536: chown d0/d1/d27/f2f 1819 1 2023-12-08T20:27:56.603 INFO:tasks.workunit.client.1.smithi111.stdout:6/537: chown d0/d1/d27/d36/l4c 1 1 2023-12-08T20:27:56.606 INFO:tasks.workunit.client.1.smithi111.stdout:4/573: dread d8/da/d29/d6e/f99 [0,4194304] 0 2023-12-08T20:27:56.607 INFO:tasks.workunit.client.1.smithi111.stdout:3/624: rmdir d2/d3/d13/d36/d44/daa 39 2023-12-08T20:27:56.607 INFO:tasks.workunit.client.1.smithi111.stdout:7/695: symlink da/d25/le4 0 2023-12-08T20:27:56.608 INFO:tasks.workunit.client.1.smithi111.stdout:1/693: mknod d0/d6/d33/d6c/cf2 0 2023-12-08T20:27:56.608 INFO:tasks.workunit.client.1.smithi111.stdout:1/694: stat d0/d6/d33/d60 0 2023-12-08T20:27:56.611 INFO:tasks.workunit.client.1.smithi111.stdout:8/800: rename dd/c1c to dd/d32/dea/c11e 0 2023-12-08T20:27:56.613 INFO:tasks.workunit.client.1.smithi111.stdout:0/958: creat d1/d4/d24/d46/d49/d10f/f13f x:0 0 0 2023-12-08T20:27:56.614 INFO:tasks.workunit.client.1.smithi111.stdout:6/538: mkdir d0/d68/da9 0 2023-12-08T20:27:56.614 INFO:tasks.workunit.client.1.smithi111.stdout:7/696: dread da/d25/d26/d32/d3e/fac [0,4194304] 0 2023-12-08T20:27:56.615 INFO:tasks.workunit.client.1.smithi111.stdout:3/625: creat d2/d15/d17/d5e/d9f/dbe/fc0 x:0 0 0 2023-12-08T20:27:56.617 INFO:tasks.workunit.client.1.smithi111.stdout:0/959: creat d1/df/d16/f140 x:0 0 0 2023-12-08T20:27:56.617 INFO:tasks.workunit.client.1.smithi111.stdout:4/574: write d8/da/d2c/f5e [773566,74868] 0 2023-12-08T20:27:56.618 INFO:tasks.workunit.client.1.smithi111.stdout:4/575: chown d8/d30/l56 4685385 1 2023-12-08T20:27:56.620 INFO:tasks.workunit.client.1.smithi111.stdout:4/576: creat d8/fbb x:0 0 0 2023-12-08T20:27:56.621 INFO:tasks.workunit.client.1.smithi111.stdout:6/539: mkdir d0/daa 0 2023-12-08T20:27:56.625 INFO:tasks.workunit.client.1.smithi111.stdout:4/577: unlink d8/fb1 0 2023-12-08T20:27:56.625 INFO:tasks.workunit.client.1.smithi111.stdout:6/540: getdents d0/d68/d95/d7a 0 2023-12-08T20:27:56.626 INFO:tasks.workunit.client.1.smithi111.stdout:2/648: dwrite d1/fcc [0,4194304] 0 2023-12-08T20:27:56.629 INFO:tasks.workunit.client.0.smithi043.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-08T20:27:56.630 INFO:tasks.workunit.client.1.smithi111.stdout:4/578: rmdir d8/da/db 39 2023-12-08T20:27:56.630 INFO:tasks.workunit.client.1.smithi111.stdout:4/579: write d8/da/d29/d69/fa2 [806117,58753] 0 2023-12-08T20:27:56.631 INFO:tasks.workunit.client.1.smithi111.stdout:2/649: symlink d1/d1d/d1f/lf0 0 2023-12-08T20:27:56.632 INFO:tasks.workunit.client.1.smithi111.stdout:3/626: getdents d2/d3/d13/d36 0 2023-12-08T20:27:56.635 INFO:tasks.workunit.client.1.smithi111.stdout:4/580: symlink d8/d30/d97/lbc 0 2023-12-08T20:27:56.635 INFO:tasks.workunit.client.1.smithi111.stdout:4/581: truncate d8/d30/d7d/d9b/db2/d4b/fa5 465281 0 2023-12-08T20:27:56.636 INFO:tasks.workunit.client.1.smithi111.stdout:1/695: dwrite d0/d6/d33/d60/fe1 [0,4194304] 0 2023-12-08T20:27:56.637 INFO:tasks.workunit.client.1.smithi111.stdout:2/650: mknod d1/d1d/d1f/d25/d3d/d9f/de4/cf1 0 2023-12-08T20:27:56.637 INFO:tasks.workunit.client.1.smithi111.stdout:6/541: dread d0/d1/d27/f87 [0,4194304] 0 2023-12-08T20:27:56.638 INFO:tasks.workunit.client.1.smithi111.stdout:1/696: write d0/d6/d33/d15/d51/d78/f95 [84867,57139] 0 2023-12-08T20:27:56.638 INFO:tasks.workunit.client.1.smithi111.stdout:1/697: readlink d0/d6/d33/d15/d51/d5b/l3f 0 2023-12-08T20:27:56.638 INFO:tasks.workunit.client.1.smithi111.stdout:1/698: write d0/d6/d33/d15/d51/d5b/fcc [848892,42405] 0 2023-12-08T20:27:56.638 INFO:tasks.workunit.client.1.smithi111.stdout:3/627: symlink d2/d15/d17/d25/d4e/lc1 0 2023-12-08T20:27:56.639 INFO:tasks.workunit.client.1.smithi111.stdout:7/697: dwrite da/d13/f1a [0,4194304] 0 2023-12-08T20:27:56.639 INFO:tasks.workunit.client.1.smithi111.stdout:1/699: dread d0/d6/d33/d15/d51/d5b/fb3 [0,4194304] 0 2023-12-08T20:27:56.641 INFO:tasks.workunit.client.1.smithi111.stdout:4/582: mknod d8/da/db/cbd 0 2023-12-08T20:27:56.641 INFO:tasks.workunit.client.1.smithi111.stdout:4/583: fdatasync d8/da/d2c/d1f/d40/f42 0 2023-12-08T20:27:56.641 INFO:tasks.workunit.client.1.smithi111.stdout:4/584: readlink d8/da/db/d7f/d93/l5d 0 2023-12-08T20:27:56.642 INFO:tasks.workunit.client.1.smithi111.stdout:4/585: write d8/d30/d7d/d9b/db2/f98 [846164,9378] 0 2023-12-08T20:27:56.642 INFO:tasks.workunit.client.1.smithi111.stdout:4/586: stat d8/da/d29/d69/l9c 0 2023-12-08T20:27:56.642 INFO:tasks.workunit.client.1.smithi111.stdout:1/700: write d0/f2d [2404953,23088] 0 2023-12-08T20:27:56.642 INFO:tasks.workunit.client.1.smithi111.stdout:1/701: write d0/d6/d33/d60/f7f [84458,38542] 0 2023-12-08T20:27:56.642 INFO:tasks.workunit.client.1.smithi111.stdout:4/587: write d8/da/db/d7f/d93/d77/f87 [3166979,110989] 0 2023-12-08T20:27:56.642 INFO:tasks.workunit.client.1.smithi111.stdout:4/588: fdatasync d8/da/d2c/d1f/d40/f55 0 2023-12-08T20:27:56.646 INFO:tasks.workunit.client.1.smithi111.stdout:2/651: readlink d1/d1d/d1f/d36/l6f 0 2023-12-08T20:27:56.648 INFO:tasks.workunit.client.1.smithi111.stdout:3/628: mknod d2/d15/d17/d5e/d62/cc2 0 2023-12-08T20:27:56.648 INFO:tasks.workunit.client.1.smithi111.stdout:3/629: stat d2/d3/d13/d36/l50 0 2023-12-08T20:27:56.648 INFO:tasks.workunit.client.1.smithi111.stdout:2/652: dread d1/d1d/d22/f50 [0,4194304] 0 2023-12-08T20:27:56.649 INFO:tasks.workunit.client.1.smithi111.stdout:7/698: creat da/d25/dd9/fe5 x:0 0 0 2023-12-08T20:27:56.650 INFO:tasks.workunit.client.1.smithi111.stdout:1/702: symlink d0/d4d/lf3 0 2023-12-08T20:27:56.651 INFO:tasks.workunit.client.1.smithi111.stdout:6/542: dwrite d0/d1/d27/f5c [0,4194304] 0 2023-12-08T20:27:56.652 INFO:tasks.workunit.client.1.smithi111.stdout:1/703: write d0/f2 [193667,21692] 0 2023-12-08T20:27:56.655 INFO:tasks.workunit.client.1.smithi111.stdout:1/704: dread d0/d6/d33/f4f [0,4194304] 0 2023-12-08T20:27:56.656 INFO:tasks.workunit.client.1.smithi111.stdout:1/705: write d0/d6/d33/d6c/f9a [3995089,21303] 0 2023-12-08T20:27:56.657 INFO:tasks.workunit.client.1.smithi111.stdout:3/630: unlink d2/d3/d13/d36/f55 0 2023-12-08T20:27:56.657 INFO:tasks.workunit.client.1.smithi111.stdout:3/631: stat d2/d15/d17/c38 0 2023-12-08T20:27:56.657 INFO:tasks.workunit.client.1.smithi111.stdout:3/632: write d2/d3/d13/d36/d69/d70/f9b [362775,106466] 0 2023-12-08T20:27:56.659 INFO:tasks.workunit.client.1.smithi111.stdout:2/653: mknod d1/d1d/d68/de2/cf2 0 2023-12-08T20:27:56.659 INFO:tasks.workunit.client.1.smithi111.stdout:2/654: write d1/d1d/d1f/d25/d96/ddf/fe9 [377021,74109] 0 2023-12-08T20:27:56.659 INFO:tasks.workunit.client.1.smithi111.stdout:2/655: write d1/fcc [4217073,94923] 0 2023-12-08T20:27:56.659 INFO:tasks.workunit.client.1.smithi111.stdout:2/656: dread - d1/d1d/d1f/d25/d3d/d56/f8a zero size 2023-12-08T20:27:56.661 INFO:tasks.workunit.client.1.smithi111.stdout:7/699: link da/d25/da9/cd4 da/d25/d26/d32/d87/ce6 0 2023-12-08T20:27:56.663 INFO:tasks.workunit.client.1.smithi111.stdout:6/543: symlink d0/d68/d95/d7a/lab 0 2023-12-08T20:27:56.667 INFO:tasks.workunit.client.1.smithi111.stdout:1/706: symlink d0/d6/d33/d6c/da1/lf4 0 2023-12-08T20:27:56.669 INFO:tasks.workunit.client.1.smithi111.stdout:6/544: dread d0/d1/f96 [0,4194304] 0 2023-12-08T20:27:56.669 INFO:tasks.workunit.client.1.smithi111.stdout:3/633: link d2/d12/f1d d2/d3/d1e/fc3 0 2023-12-08T20:27:56.670 INFO:tasks.workunit.client.1.smithi111.stdout:3/634: dread d2/d3/d13/d36/d69/d70/fb8 [0,4194304] 0 2023-12-08T20:27:56.675 INFO:tasks.workunit.client.1.smithi111.stdout:7/700: mknod da/d25/d26/d32/d87/ce7 0 2023-12-08T20:27:56.676 INFO:tasks.workunit.client.1.smithi111.stdout:3/635: dread d2/d3/d13/d36/d69/d70/f9b [0,4194304] 0 2023-12-08T20:27:56.678 INFO:tasks.workunit.client.1.smithi111.stdout:1/707: symlink d0/d6/d33/d15/d51/d78/lf5 0 2023-12-08T20:27:56.679 INFO:tasks.workunit.client.1.smithi111.stdout:4/589: rmdir d8/da 39 2023-12-08T20:27:56.683 INFO:tasks.workunit.client.1.smithi111.stdout:6/545: rmdir d0/d68/d8e/da8 0 2023-12-08T20:27:56.685 INFO:tasks.workunit.client.1.smithi111.stdout:3/636: mknod d2/d3/d13/d36/d69/d70/cc4 0 2023-12-08T20:27:56.692 INFO:tasks.workunit.client.1.smithi111.stdout:2/657: rmdir d1/d1d/d68 39 2023-12-08T20:27:56.698 INFO:tasks.workunit.client.1.smithi111.stdout:6/546: rmdir d0/d1 39 2023-12-08T20:27:56.701 INFO:tasks.workunit.client.1.smithi111.stdout:4/590: dwrite d8/da/d2c/f9f [0,4194304] 0 2023-12-08T20:27:56.701 INFO:tasks.workunit.client.1.smithi111.stdout:4/591: write d8/d30/d7d/d9b/db2/d4b/fa5 [370813,75204] 0 2023-12-08T20:27:56.704 INFO:tasks.workunit.client.1.smithi111.stdout:3/637: rename d2/d3/d1e/d93/db9 to d2/d15/dc5 0 2023-12-08T20:27:56.704 INFO:tasks.workunit.client.1.smithi111.stdout:3/638: write d2/d15/d17/f94 [902884,43864] 0 2023-12-08T20:27:56.705 INFO:tasks.workunit.client.1.smithi111.stdout:2/658: creat d1/d29/d53/d90/ff3 x:0 0 0 2023-12-08T20:27:56.706 INFO:tasks.workunit.client.1.smithi111.stdout:6/547: unlink d0/d1/d27/d36/f7f 0 2023-12-08T20:27:56.707 INFO:tasks.workunit.client.1.smithi111.stdout:6/548: write d0/d1/d1e/f75 [437297,51344] 0 2023-12-08T20:27:56.707 INFO:tasks.workunit.client.1.smithi111.stdout:6/549: fdatasync d0/d1/d27/f40 0 2023-12-08T20:27:56.709 INFO:tasks.workunit.client.1.smithi111.stdout:4/592: rmdir d8/da/d29/d6e 39 2023-12-08T20:27:56.709 INFO:tasks.workunit.client.1.smithi111.stdout:4/593: write d8/d30/d7d/d9b/db2/d4b/f67 [293334,85266] 0 2023-12-08T20:27:56.709 INFO:tasks.workunit.client.1.smithi111.stdout:4/594: chown d8/d30/d7d/d9b/db2/f3e 225715 1 2023-12-08T20:27:56.712 INFO:tasks.workunit.client.1.smithi111.stdout:6/550: mknod d0/d1/cac 0 2023-12-08T20:27:56.712 INFO:tasks.workunit.client.1.smithi111.stdout:6/551: write d0/d1/d27/d6e/f70 [774500,124893] 0 2023-12-08T20:27:56.712 INFO:tasks.workunit.client.1.smithi111.stdout:6/552: getdents d0/d1/d27/d36/d97 0 2023-12-08T20:27:56.713 INFO:tasks.workunit.client.1.smithi111.stdout:4/595: truncate d8/da/d2c/d1f/f6f 835471 0 2023-12-08T20:27:56.714 INFO:tasks.workunit.client.1.smithi111.stdout:6/553: creat d0/d1a/fad x:0 0 0 2023-12-08T20:27:56.715 INFO:tasks.workunit.client.1.smithi111.stdout:4/596: truncate d8/da/d2c/d1f/faa 4079717 0 2023-12-08T20:27:56.716 INFO:tasks.workunit.client.1.smithi111.stdout:4/597: dread d8/da/db/d7f/f9e [0,4194304] 0 2023-12-08T20:27:56.718 INFO:tasks.workunit.client.1.smithi111.stdout:6/554: link d0/d1/l39 d0/d1a/lae 0 2023-12-08T20:27:56.718 INFO:tasks.workunit.client.1.smithi111.stdout:6/555: getdents d0/d1a/da5 0 2023-12-08T20:27:56.718 INFO:tasks.workunit.client.1.smithi111.stdout:6/556: chown d0/f12 134 1 2023-12-08T20:27:56.718 INFO:tasks.workunit.client.1.smithi111.stdout:6/557: dread - d0/d1/d27/f5d zero size 2023-12-08T20:27:56.718 INFO:tasks.workunit.client.1.smithi111.stdout:6/558: chown d0/d68/f8b 7 1 2023-12-08T20:27:56.718 INFO:tasks.workunit.client.1.smithi111.stdout:4/598: mkdir d8/da/d29/d5c/dbe 0 2023-12-08T20:27:56.720 INFO:tasks.workunit.client.1.smithi111.stdout:6/559: mknod d0/d1a/caf 0 2023-12-08T20:27:56.720 INFO:tasks.workunit.client.1.smithi111.stdout:6/560: dread - d0/d68/d95/f7b zero size 2023-12-08T20:27:56.721 INFO:tasks.workunit.client.1.smithi111.stdout:6/561: read d0/d1/f11 [42814,48241] 0 2023-12-08T20:27:56.721 INFO:tasks.workunit.client.1.smithi111.stdout:6/562: chown d0/da0 1100 1 2023-12-08T20:27:56.721 INFO:tasks.workunit.client.1.smithi111.stdout:4/599: link d8/da/d29/f9a d8/da/db/d7f/d93/d77/db5/fbf 0 2023-12-08T20:27:56.721 INFO:tasks.workunit.client.1.smithi111.stdout:4/600: write d8/d30/d7d/d9b/db2/d4b/f67 [953406,27165] 0 2023-12-08T20:27:56.722 INFO:tasks.workunit.client.1.smithi111.stdout:6/563: creat d0/d68/d95/d7a/fb0 x:0 0 0 2023-12-08T20:27:56.724 INFO:tasks.workunit.client.1.smithi111.stdout:4/601: getdents d8 0 2023-12-08T20:27:56.727 INFO:tasks.workunit.client.1.smithi111.stdout:6/564: creat d0/d68/da9/fb1 x:0 0 0 2023-12-08T20:27:56.729 INFO:tasks.workunit.client.1.smithi111.stdout:3/639: rename d2/d3/d1e to d2/d12/d2e/dc6 0 2023-12-08T20:27:56.729 INFO:tasks.workunit.client.1.smithi111.stdout:3/640: read d2/d12/d4a/d5d/f6a [177160,45367] 0 2023-12-08T20:27:56.729 INFO:tasks.workunit.client.1.smithi111.stdout:3/641: write d2/d15/d17/d25/d4e/fb3 [4613074,45895] 0 2023-12-08T20:27:56.729 INFO:tasks.workunit.client.1.smithi111.stdout:3/642: truncate d2/d3/d13/d36/d69/d70/f90 1197819 0 2023-12-08T20:27:56.731 INFO:tasks.workunit.client.1.smithi111.stdout:2/659: rename d1/d29/d53/d91/f9e to d1/d1d/d68/d73/ff4 0 2023-12-08T20:27:56.741 INFO:tasks.workunit.client.1.smithi111.stdout:4/602: dwrite d8/da/d2c/d1f/d40/f55 [4194304,4194304] 0 2023-12-08T20:27:56.742 INFO:tasks.workunit.client.1.smithi111.stdout:6/565: rename d0/d1a to d0/d1/d1e/db2 0 2023-12-08T20:27:56.744 INFO:tasks.workunit.client.1.smithi111.stdout:2/660: dread d1/d1d/d22/f39 [0,4194304] 0 2023-12-08T20:27:56.744 INFO:tasks.workunit.client.1.smithi111.stdout:2/661: dread - d1/d1d/d1f/d36/fe3 zero size 2023-12-08T20:27:56.744 INFO:tasks.workunit.client.1.smithi111.stdout:2/662: chown d1/f13 1540 1 2023-12-08T20:27:56.745 INFO:tasks.workunit.client.1.smithi111.stdout:3/643: rename d2/d3/d13/d36/d44/la1 to d2/d15/d17/d5e/da6/lc7 0 2023-12-08T20:27:56.746 INFO:tasks.workunit.client.1.smithi111.stdout:6/566: symlink d0/d1/d1e/lb3 0 2023-12-08T20:27:56.747 INFO:tasks.workunit.client.1.smithi111.stdout:2/663: mknod d1/d1d/d1f/d25/d3d/d41/db9/def/cf5 0 2023-12-08T20:27:56.747 INFO:tasks.workunit.client.1.smithi111.stdout:2/664: write d1/d1d/d22/fe6 [978405,85576] 0 2023-12-08T20:27:56.749 INFO:tasks.workunit.client.1.smithi111.stdout:3/644: mknod d2/d3/d13/d36/cc8 0 2023-12-08T20:27:56.752 INFO:tasks.workunit.client.1.smithi111.stdout:6/567: mkdir d0/d1/d27/d36/d97/db4 0 2023-12-08T20:27:56.756 INFO:tasks.workunit.client.1.smithi111.stdout:2/665: mkdir d1/d1d/d68/df6 0 2023-12-08T20:27:56.756 INFO:tasks.workunit.client.1.smithi111.stdout:3/645: creat d2/d12/d2e/dc6/d93/fc9 x:0 0 0 2023-12-08T20:27:56.757 INFO:tasks.workunit.client.1.smithi111.stdout:6/568: creat d0/d1/d27/fb5 x:0 0 0 2023-12-08T20:27:56.757 INFO:tasks.workunit.client.1.smithi111.stdout:6/569: write d0/d1/f2c [612890,1620] 0 2023-12-08T20:27:56.758 INFO:tasks.workunit.client.1.smithi111.stdout:4/603: dwrite d8/da/d29/f57 [0,4194304] 0 2023-12-08T20:27:56.758 INFO:tasks.workunit.client.1.smithi111.stdout:2/666: rename d1/d29/d53/d91/fbb to d1/d29/d53/d91/ff7 0 2023-12-08T20:27:56.758 INFO:tasks.workunit.client.1.smithi111.stdout:2/667: fdatasync d1/d1d/d22/f69 0 2023-12-08T20:27:56.759 INFO:tasks.workunit.client.1.smithi111.stdout:2/668: read d1/d29/d4e/f32 [977074,47771] 0 2023-12-08T20:27:56.761 INFO:tasks.workunit.client.1.smithi111.stdout:3/646: link d2/d15/d17/d5e/d9f/dbe/fc0 d2/d3/d13/d36/d44/d8f/da7/fca 0 2023-12-08T20:27:56.761 INFO:tasks.workunit.client.1.smithi111.stdout:3/647: fdatasync d2/d12/d2e/dc6/d93/fa4 0 2023-12-08T20:27:56.762 INFO:tasks.workunit.client.1.smithi111.stdout:6/570: write d0/f6b [695188,46193] 0 2023-12-08T20:27:56.766 INFO:tasks.workunit.client.1.smithi111.stdout:4/604: creat d8/da/d29/d6e/fc0 x:0 0 0 2023-12-08T20:27:56.766 INFO:tasks.workunit.client.1.smithi111.stdout:4/605: truncate d8/da/db/d7f/d93/d77/fa6 902647 0 2023-12-08T20:27:56.768 INFO:tasks.workunit.client.1.smithi111.stdout:2/669: rename d1/d1d/d1f/d36/d92/cb7 to d1/d29/d4e/cf8 0 2023-12-08T20:27:56.769 INFO:tasks.workunit.client.1.smithi111.stdout:3/648: creat d2/d3/d6/fcb x:0 0 0 2023-12-08T20:27:56.769 INFO:tasks.workunit.client.1.smithi111.stdout:6/571: creat d0/d68/da9/fb6 x:0 0 0 2023-12-08T20:27:56.769 INFO:tasks.workunit.client.1.smithi111.stdout:6/572: fdatasync d0/f84 0 2023-12-08T20:27:56.771 INFO:tasks.workunit.client.1.smithi111.stdout:4/606: creat d8/da/db/d7f/d93/d77/db5/fc1 x:0 0 0 2023-12-08T20:27:56.772 INFO:tasks.workunit.client.1.smithi111.stdout:2/670: mknod d1/d1d/d1f/d25/dde/cf9 0 2023-12-08T20:27:56.778 INFO:tasks.workunit.client.1.smithi111.stdout:4/607: getdents d8/d30/d7d/d9b/db2 0 2023-12-08T20:27:56.778 INFO:tasks.workunit.client.1.smithi111.stdout:2/671: write d1/d1d/d1f/d25/d3d/d56/f7a [429549,16425] 0 2023-12-08T20:27:56.778 INFO:tasks.workunit.client.1.smithi111.stdout:2/672: write d1/d1d/d68/fa1 [1303279,25603] 0 2023-12-08T20:27:56.780 INFO:tasks.workunit.client.1.smithi111.stdout:3/649: dread d2/d3/d13/d36/d44/d8f/f91 [0,4194304] 0 2023-12-08T20:27:56.780 INFO:tasks.workunit.client.1.smithi111.stdout:3/650: truncate d2/d15/f87 136236 0 2023-12-08T20:27:56.780 INFO:tasks.workunit.client.1.smithi111.stdout:3/651: readlink d2/d3/d13/d36/d44/d8f/l92 0 2023-12-08T20:27:56.783 INFO:tasks.workunit.client.1.smithi111.stdout:4/608: creat d8/da/db/d7f/d93/d91/fc2 x:0 0 0 2023-12-08T20:27:56.786 INFO:tasks.workunit.client.1.smithi111.stdout:3/652: write d2/d15/d17/d25/f26 [110905,68945] 0 2023-12-08T20:27:56.790 INFO:tasks.workunit.client.1.smithi111.stdout:4/609: unlink d8/da/d29/f57 0 2023-12-08T20:27:56.797 INFO:tasks.workunit.client.1.smithi111.stdout:3/653: symlink d2/d15/d17/lcc 0 2023-12-08T20:27:56.797 INFO:tasks.workunit.client.1.smithi111.stdout:6/573: dwrite d0/d68/d95/f35 [0,4194304] 0 2023-12-08T20:27:56.798 INFO:tasks.workunit.client.1.smithi111.stdout:4/610: mknod d8/d30/d97/cc3 0 2023-12-08T20:27:56.798 INFO:tasks.workunit.client.1.smithi111.stdout:4/611: write d8/fbb [47468,126463] 0 2023-12-08T20:27:56.798 INFO:tasks.workunit.client.1.smithi111.stdout:4/612: read d8/da/d2c/d1f/f6f [818055,51353] 0 2023-12-08T20:27:56.799 INFO:tasks.workunit.client.1.smithi111.stdout:6/574: creat d0/d1/d27/da1/fb7 x:0 0 0 2023-12-08T20:27:56.799 INFO:tasks.workunit.client.1.smithi111.stdout:6/575: chown d0/d68/d95/f1d 19521834 1 2023-12-08T20:27:56.799 INFO:tasks.workunit.client.1.smithi111.stdout:6/576: chown d0/da0 666576911 1 2023-12-08T20:27:56.800 INFO:tasks.workunit.client.1.smithi111.stdout:2/673: dwrite d1/d1d/f5d [0,4194304] 0 2023-12-08T20:27:56.800 INFO:tasks.workunit.client.1.smithi111.stdout:4/613: link d8/da/db/d7f/c70 d8/da/d29/d5c/cc4 0 2023-12-08T20:27:56.801 INFO:tasks.workunit.client.1.smithi111.stdout:4/614: dread d8/da/db/d7f/f9e [0,4194304] 0 2023-12-08T20:27:56.801 INFO:tasks.workunit.client.1.smithi111.stdout:6/577: truncate d0/d1/d27/f87 1522032 0 2023-12-08T20:27:56.805 INFO:tasks.workunit.client.1.smithi111.stdout:2/674: creat d1/d1d/d1f/d36/ffa x:0 0 0 2023-12-08T20:27:56.805 INFO:tasks.workunit.client.1.smithi111.stdout:2/675: write d1/d29/d53/f85 [283729,107640] 0 2023-12-08T20:27:56.810 INFO:tasks.workunit.client.1.smithi111.stdout:4/615: creat d8/da/d2c/fc5 x:0 0 0 2023-12-08T20:27:56.810 INFO:tasks.workunit.client.1.smithi111.stdout:4/616: readlink d8/d30/d7d/d9b/la1 0 2023-12-08T20:27:56.810 INFO:tasks.workunit.client.1.smithi111.stdout:4/617: readlink d8/da/d2c/d1f/l63 0 2023-12-08T20:27:56.811 INFO:tasks.workunit.client.1.smithi111.stdout:2/676: creat d1/d1d/d1f/d25/d3d/d56/ffb x:0 0 0 2023-12-08T20:27:56.811 INFO:tasks.workunit.client.1.smithi111.stdout:4/618: dread d8/da/db/d7f/d93/d77/fa6 [0,4194304] 0 2023-12-08T20:27:56.812 INFO:tasks.workunit.client.1.smithi111.stdout:2/677: symlink d1/d1d/d1f/d25/d3d/d9f/de4/lfc 0 2023-12-08T20:27:56.812 INFO:tasks.workunit.client.1.smithi111.stdout:2/678: write d1/d29/d53/d90/f65 [1771285,122302] 0 2023-12-08T20:27:56.813 INFO:tasks.workunit.client.1.smithi111.stdout:2/679: read d1/d29/d4e/f32 [664639,110155] 0 2023-12-08T20:27:56.814 INFO:tasks.workunit.client.1.smithi111.stdout:4/619: write d8/da/db/d7f/d93/f3f [1834597,45945] 0 2023-12-08T20:27:56.819 INFO:tasks.workunit.client.1.smithi111.stdout:3/654: dwrite d2/f9c [0,4194304] 0 2023-12-08T20:27:56.822 INFO:tasks.workunit.client.1.smithi111.stdout:6/578: dwrite d0/d1/f7 [0,4194304] 0 2023-12-08T20:27:56.824 INFO:tasks.workunit.client.1.smithi111.stdout:3/655: mknod d2/d12/d2e/ccd 0 2023-12-08T20:27:56.824 INFO:tasks.workunit.client.1.smithi111.stdout:4/620: dread d8/d30/d7d/d9b/db2/f34 [0,4194304] 0 2023-12-08T20:27:56.824 INFO:tasks.workunit.client.1.smithi111.stdout:4/621: chown d8/da/l36 5929973 1 2023-12-08T20:27:56.824 INFO:tasks.workunit.client.1.smithi111.stdout:4/622: chown d8/da/d29/d69/fba 14362093 1 2023-12-08T20:27:56.824 INFO:tasks.workunit.client.1.smithi111.stdout:3/656: read d2/d15/d17/f94 [249655,45036] 0 2023-12-08T20:27:56.824 INFO:tasks.workunit.client.1.smithi111.stdout:3/657: dread - d2/d3/d13/d36/d44/d8f/da7/fca zero size 2023-12-08T20:27:56.827 INFO:tasks.workunit.client.1.smithi111.stdout:6/579: symlink d0/d68/da9/lb8 0 2023-12-08T20:27:56.829 INFO:tasks.workunit.client.1.smithi111.stdout:6/580: read d0/d1/d27/d36/d8d/f9c [775150,129042] 0 2023-12-08T20:27:56.832 INFO:tasks.workunit.client.1.smithi111.stdout:2/680: dwrite d1/d29/d53/d90/fc8 [0,4194304] 0 2023-12-08T20:27:56.835 INFO:tasks.workunit.client.1.smithi111.stdout:3/658: dread d2/d3/d51/d88/fa3 [0,4194304] 0 2023-12-08T20:27:56.837 INFO:tasks.workunit.client.1.smithi111.stdout:2/681: link d1/d1d/d1f/d25/l87 d1/d1d/d1f/d25/d3d/d64/lfd 0 2023-12-08T20:27:56.837 INFO:tasks.workunit.client.1.smithi111.stdout:2/682: truncate d1/d29/d53/d91/ff7 1163955 0 2023-12-08T20:27:56.841 INFO:tasks.workunit.client.1.smithi111.stdout:3/659: mknod d2/d12/d4a/d5d/cce 0 2023-12-08T20:27:56.843 INFO:tasks.workunit.client.1.smithi111.stdout:2/683: rename d1/d1d/d1f/d25/d3d/d41/db9 to d1/d29/dfe 0 2023-12-08T20:27:56.847 INFO:tasks.workunit.client.1.smithi111.stdout:5/860: sync 2023-12-08T20:27:56.848 INFO:tasks.workunit.client.1.smithi111.stdout:5/861: read d3/d4/d7/d2c/f78 [3250746,98751] 0 2023-12-08T20:27:56.848 INFO:tasks.workunit.client.1.smithi111.stdout:5/862: readlink d3/d4/d7/l94 0 2023-12-08T20:27:56.850 INFO:tasks.workunit.client.1.smithi111.stdout:5/863: truncate d3/d4/f53 2266778 0 2023-12-08T20:27:56.850 INFO:tasks.workunit.client.1.smithi111.stdout:6/581: dwrite d0/d1/d27/d6e/f70 [0,4194304] 0 2023-12-08T20:27:56.851 INFO:tasks.workunit.client.1.smithi111.stdout:2/684: dread d1/d29/d53/fd5 [0,4194304] 0 2023-12-08T20:27:56.851 INFO:tasks.workunit.client.1.smithi111.stdout:2/685: dread - d1/d1d/d1f/d36/ffa zero size 2023-12-08T20:27:56.851 INFO:tasks.workunit.client.1.smithi111.stdout:2/686: chown d1/d1d/d1f/d25/d67/faa 85216 1 2023-12-08T20:27:56.851 INFO:tasks.workunit.client.1.smithi111.stdout:2/687: fsync d1/d1d/d1f/d25/d3d/d64/f80 0 2023-12-08T20:27:56.852 INFO:tasks.workunit.client.1.smithi111.stdout:3/660: dread d2/f34 [0,4194304] 0 2023-12-08T20:27:56.852 INFO:tasks.workunit.client.1.smithi111.stdout:3/661: truncate d2/d15/d17/f43 185594 0 2023-12-08T20:27:56.852 INFO:tasks.workunit.client.1.smithi111.stdout:5/864: rename d3/d12/d67/ddf/f11e to d3/d4/d7/d29/dd6/d122/f129 0 2023-12-08T20:27:56.853 INFO:tasks.workunit.client.1.smithi111.stdout:6/582: link d0/d1/f11 d0/d1/d27/d36/fb9 0 2023-12-08T20:27:56.854 INFO:tasks.workunit.client.1.smithi111.stdout:3/662: rmdir d2/d3/d13 39 2023-12-08T20:27:56.856 INFO:tasks.workunit.client.1.smithi111.stdout:5/865: getdents d3/d4/d4a 0 2023-12-08T20:27:56.857 INFO:tasks.workunit.client.1.smithi111.stdout:4/623: dwrite d8/da/d29/f33 [0,4194304] 0 2023-12-08T20:27:56.858 INFO:tasks.workunit.client.1.smithi111.stdout:2/688: rename d1/d29/d53/d90/fc8 to d1/d1d/d22/fff 0 2023-12-08T20:27:56.858 INFO:tasks.workunit.client.1.smithi111.stdout:2/689: chown d1/d1d/d22/d30/fcd 47 1 2023-12-08T20:27:56.858 INFO:tasks.workunit.client.1.smithi111.stdout:2/690: fsync d1/d1d/d68/d73/dd6/fda 0 2023-12-08T20:27:56.859 INFO:tasks.workunit.client.1.smithi111.stdout:4/624: dread d8/da/db/f8d [0,4194304] 0 2023-12-08T20:27:56.860 INFO:tasks.workunit.client.1.smithi111.stdout:5/866: truncate d3/d6d/fa4 1132389 0 2023-12-08T20:27:56.860 INFO:tasks.workunit.client.1.smithi111.stdout:4/625: write d8/da/db/fa0 [752061,93853] 0 2023-12-08T20:27:56.864 INFO:tasks.workunit.client.1.smithi111.stdout:3/663: dread d2/d15/d17/d25/f26 [0,4194304] 0 2023-12-08T20:27:56.864 INFO:tasks.workunit.client.1.smithi111.stdout:3/664: write d2/d3/d6/f10 [9305622,50505] 0 2023-12-08T20:27:56.866 INFO:tasks.workunit.client.1.smithi111.stdout:6/583: rename d0/d1/l63 to d0/d1/d27/d56/lba 0 2023-12-08T20:27:56.869 INFO:tasks.workunit.client.1.smithi111.stdout:2/691: rmdir d1/d1d/d22/dea 0 2023-12-08T20:27:56.878 INFO:tasks.workunit.client.1.smithi111.stdout:4/626: rename d8/f22 to d8/da/d29/d69/fc6 0 2023-12-08T20:27:56.881 INFO:tasks.workunit.client.1.smithi111.stdout:4/627: rename d8/d30/l56 to d8/d30/d97/lc7 0 2023-12-08T20:27:56.881 INFO:tasks.workunit.client.1.smithi111.stdout:4/628: stat d8/da/db/d7f/d93/d77/db5/fb8 0 2023-12-08T20:27:56.881 INFO:tasks.workunit.client.1.smithi111.stdout:4/629: read - d8/d30/d7d/d9b/fa8 zero size 2023-12-08T20:27:56.881 INFO:tasks.workunit.client.1.smithi111.stdout:4/630: chown d8/d30/d7d/d9b/db2/d4b/fa5 287 1 2023-12-08T20:27:56.882 INFO:tasks.workunit.client.1.smithi111.stdout:4/631: mknod d8/da/db/d7f/da7/cc8 0 2023-12-08T20:27:56.883 INFO:tasks.workunit.client.1.smithi111.stdout:4/632: write d8/d30/d7d/d9b/db2/d4b/f8c [67420,40785] 0 2023-12-08T20:27:56.884 INFO:tasks.workunit.client.1.smithi111.stdout:4/633: symlink d8/d30/d7d/lc9 0 2023-12-08T20:27:56.886 INFO:tasks.workunit.client.1.smithi111.stdout:9/772: sync 2023-12-08T20:27:56.886 INFO:tasks.workunit.client.1.smithi111.stdout:8/801: sync 2023-12-08T20:27:56.886 INFO:tasks.workunit.client.1.smithi111.stdout:9/773: truncate d2/d8/dd/d1a/d74/fdb 79266 0 2023-12-08T20:27:56.888 INFO:tasks.workunit.client.1.smithi111.stdout:5/867: dwrite d3/d8d/f8f [0,4194304] 0 2023-12-08T20:27:56.889 INFO:tasks.workunit.client.1.smithi111.stdout:5/868: fsync d3/d4/d7/d29/d30/fd1 0 2023-12-08T20:27:56.889 INFO:tasks.workunit.client.1.smithi111.stdout:9/774: unlink d2/d8/fda 0 2023-12-08T20:27:56.889 INFO:tasks.workunit.client.1.smithi111.stdout:4/634: write d8/da/f25 [1464975,41938] 0 2023-12-08T20:27:56.889 INFO:tasks.workunit.client.1.smithi111.stdout:9/775: chown d2/da/le4 18337199 1 2023-12-08T20:27:56.889 INFO:tasks.workunit.client.1.smithi111.stdout:4/635: stat d8/da/d29/d6e/f99 0 2023-12-08T20:27:56.892 INFO:tasks.workunit.client.1.smithi111.stdout:3/665: dwrite d2/d3/d13/d36/d44/d8f/da7/fca [0,4194304] 0 2023-12-08T20:27:56.893 INFO:tasks.workunit.client.1.smithi111.stdout:3/666: stat d2/d3/d13/d36/d69/fb6 0 2023-12-08T20:27:56.893 INFO:tasks.workunit.client.1.smithi111.stdout:2/692: dwrite d1/d29/d53/f7b [0,4194304] 0 2023-12-08T20:27:56.893 INFO:tasks.workunit.client.1.smithi111.stdout:4/636: write d8/da/d2c/d1f/fe [7509905,122714] 0 2023-12-08T20:27:56.893 INFO:tasks.workunit.client.1.smithi111.stdout:4/637: write d8/da/db/f6b [805508,10252] 0 2023-12-08T20:27:56.893 INFO:tasks.workunit.client.1.smithi111.stdout:3/667: write d2/d15/d17/d5e/f96 [182158,97827] 0 2023-12-08T20:27:56.894 INFO:tasks.workunit.client.1.smithi111.stdout:9/776: dread d2/da/fc [0,4194304] 0 2023-12-08T20:27:56.895 INFO:tasks.workunit.client.1.smithi111.stdout:9/777: read d2/da/f68 [135107,96428] 0 2023-12-08T20:27:56.895 INFO:tasks.workunit.client.1.smithi111.stdout:9/778: chown d2/d8/dd/d1a/d1e/d2d/d35/f10a 43445696 1 2023-12-08T20:27:56.895 INFO:tasks.workunit.client.1.smithi111.stdout:9/779: stat d2/d8/dd/d1a/d1e/d2d/d35/d88/lc7 0 2023-12-08T20:27:56.895 INFO:tasks.workunit.client.1.smithi111.stdout:9/780: chown d2/d8/dd/d1a/d1e/d2d/fe3 62544648 1 2023-12-08T20:27:56.897 INFO:tasks.workunit.client.1.smithi111.stdout:6/584: dwrite d0/d1/d1e/db2/f72 [0,4194304] 0 2023-12-08T20:27:56.903 INFO:tasks.workunit.client.1.smithi111.stdout:2/693: rmdir d1/d1d/d1f 39 2023-12-08T20:27:56.903 INFO:tasks.workunit.client.1.smithi111.stdout:4/638: mkdir d8/da/d29/d5c/dca 0 2023-12-08T20:27:56.906 INFO:tasks.workunit.client.1.smithi111.stdout:3/668: mkdir d2/d15/dcf 0 2023-12-08T20:27:56.906 INFO:tasks.workunit.client.1.smithi111.stdout:8/802: dwrite dd/d2d/d62/d83/fc5 [0,4194304] 0 2023-12-08T20:27:56.909 INFO:tasks.workunit.client.1.smithi111.stdout:9/781: mknod d2/d8/dd/d1a/d1e/d2d/db9/dd5/dfb/c111 0 2023-12-08T20:27:56.910 INFO:tasks.workunit.client.1.smithi111.stdout:9/782: chown d2/l55 280865806 1 2023-12-08T20:27:56.914 INFO:tasks.workunit.client.1.smithi111.stdout:6/585: truncate d0/f13 4009581 0 2023-12-08T20:27:56.914 INFO:tasks.workunit.client.1.smithi111.stdout:2/694: getdents d1/d1d/d1f/d25/d3d/d64 0 2023-12-08T20:27:56.914 INFO:tasks.workunit.client.1.smithi111.stdout:5/869: dwrite d3/d6d/f81 [0,4194304] 0 2023-12-08T20:27:56.914 INFO:tasks.workunit.client.1.smithi111.stdout:5/870: fdatasync d3/d4/d7/d29/d73/d90/f117 0 2023-12-08T20:27:56.914 INFO:tasks.workunit.client.1.smithi111.stdout:5/871: readlink d3/d4/ld 0 2023-12-08T20:27:56.914 INFO:tasks.workunit.client.1.smithi111.stdout:2/695: dread d1/d29/d53/f82 [0,4194304] 0 2023-12-08T20:27:56.915 INFO:tasks.workunit.client.1.smithi111.stdout:4/639: link d8/d30/f3c d8/da/db/d7f/d8e/fcb 0 2023-12-08T20:27:56.917 INFO:tasks.workunit.client.1.smithi111.stdout:3/669: creat d2/d3/d13/d36/fd0 x:0 0 0 2023-12-08T20:27:56.917 INFO:tasks.workunit.client.1.smithi111.stdout:3/670: write d2/d12/d4a/d5d/f82 [42589,24335] 0 2023-12-08T20:27:56.921 INFO:tasks.workunit.client.1.smithi111.stdout:8/803: fdatasync dd/d32/d36/d4b/fe9 0 2023-12-08T20:27:56.921 INFO:tasks.workunit.client.1.smithi111.stdout:6/586: dread d0/d1/d1e/db2/f31 [4194304,4194304] 0 2023-12-08T20:27:56.921 INFO:tasks.workunit.client.1.smithi111.stdout:9/783: rmdir d2/d8/dd/d1a/d1e 39 2023-12-08T20:27:56.921 INFO:tasks.workunit.client.1.smithi111.stdout:9/784: chown d2/l55 1721104804 1 2023-12-08T20:27:56.922 INFO:tasks.workunit.client.1.smithi111.stdout:9/785: write d2/d8/dd/d1a/d1e/d2d/d35/f95 [649340,92894] 0 2023-12-08T20:27:56.922 INFO:tasks.workunit.client.1.smithi111.stdout:8/804: write dd/d32/d3d/f88 [983298,18183] 0 2023-12-08T20:27:56.922 INFO:tasks.workunit.client.1.smithi111.stdout:5/872: mknod d3/d4/d7/d29/d73/d90/c12a 0 2023-12-08T20:27:56.923 INFO:tasks.workunit.client.1.smithi111.stdout:5/873: write d3/d4/d4a/f7a [688517,28653] 0 2023-12-08T20:27:56.923 INFO:tasks.workunit.client.1.smithi111.stdout:5/874: chown d3/d12/dbd/ff8 2 1 2023-12-08T20:27:56.923 INFO:tasks.workunit.client.1.smithi111.stdout:5/875: write d3/d4/d7/d2c/f78 [55409,14113] 0 2023-12-08T20:27:56.924 INFO:tasks.workunit.client.1.smithi111.stdout:2/696: creat d1/d1d/d1f/d25/d96/ddf/f100 x:0 0 0 2023-12-08T20:27:56.924 INFO:tasks.workunit.client.1.smithi111.stdout:2/697: readlink d1/d1d/d1f/l42 0 2023-12-08T20:27:56.924 INFO:tasks.workunit.client.1.smithi111.stdout:4/640: symlink d8/da/d29/d6e/lcc 0 2023-12-08T20:27:56.924 INFO:tasks.workunit.client.1.smithi111.stdout:4/641: chown d8/da/db/d7f/d93/d77/f6c 7715478 1 2023-12-08T20:27:56.926 INFO:tasks.workunit.client.1.smithi111.stdout:3/671: creat d2/d15/d17/d5e/da6/fd1 x:0 0 0 2023-12-08T20:27:56.926 INFO:tasks.workunit.client.1.smithi111.stdout:3/672: truncate d2/d3/d13/d36/fd0 456480 0 2023-12-08T20:27:56.926 INFO:tasks.workunit.client.1.smithi111.stdout:3/673: dread - d2/d3/d13/d36/d69/fb6 zero size 2023-12-08T20:27:56.927 INFO:tasks.workunit.client.1.smithi111.stdout:6/587: symlink d0/d68/lbb 0 2023-12-08T20:27:56.927 INFO:tasks.workunit.client.1.smithi111.stdout:0/960: sync 2023-12-08T20:27:56.927 INFO:tasks.workunit.client.1.smithi111.stdout:1/708: sync 2023-12-08T20:27:56.927 INFO:tasks.workunit.client.1.smithi111.stdout:7/701: sync 2023-12-08T20:27:56.927 INFO:tasks.workunit.client.1.smithi111.stdout:0/961: read - d1/df/d44/d37/dac/ff9 zero size 2023-12-08T20:27:56.927 INFO:tasks.workunit.client.1.smithi111.stdout:0/962: read d1/df/d16/d2c/d7b/fca [20009,25617] 0 2023-12-08T20:27:56.927 INFO:tasks.workunit.client.1.smithi111.stdout:0/963: chown d1/d4/d24/d46/d58/f6d 3453 1 2023-12-08T20:27:56.927 INFO:tasks.workunit.client.1.smithi111.stdout:9/786: creat d2/d8/dd/d1a/d1e/d2d/d35/d88/f112 x:0 0 0 2023-12-08T20:27:56.928 INFO:tasks.workunit.client.1.smithi111.stdout:9/787: chown d2/f67 534182 1 2023-12-08T20:27:56.929 INFO:tasks.workunit.client.1.smithi111.stdout:8/805: unlink l6 0 2023-12-08T20:27:56.931 INFO:tasks.workunit.client.1.smithi111.stdout:5/876: rmdir d3/d6d 39 2023-12-08T20:27:56.934 INFO:tasks.workunit.client.1.smithi111.stdout:2/698: rename d1/d1d/d1f/d25/d3d/d9f to d1/d1d/d1f/d25/d3d/d56/d101 0 2023-12-08T20:27:56.934 INFO:tasks.workunit.client.1.smithi111.stdout:2/699: read d1/d29/d53/f85 [82855,87159] 0 2023-12-08T20:27:56.934 INFO:tasks.workunit.client.1.smithi111.stdout:2/700: write d1/d29/d53/d90/ff3 [579481,99849] 0 2023-12-08T20:27:56.940 INFO:tasks.workunit.client.1.smithi111.stdout:4/642: symlink d8/d30/d7d/d9b/db2/lcd 0 2023-12-08T20:27:56.940 INFO:tasks.workunit.client.1.smithi111.stdout:6/588: creat d0/d68/da9/fbc x:0 0 0 2023-12-08T20:27:56.940 INFO:tasks.workunit.client.1.smithi111.stdout:6/589: stat d0 0 2023-12-08T20:27:56.941 INFO:tasks.workunit.client.1.smithi111.stdout:1/709: rmdir d0/d6/d33/d8b/db5 39 2023-12-08T20:27:56.941 INFO:tasks.workunit.client.1.smithi111.stdout:1/710: fsync d0/d6/d33/d15/d51/d2e/f69 0 2023-12-08T20:27:56.943 INFO:tasks.workunit.client.1.smithi111.stdout:7/702: getdents da/d25/d26/d32 0 2023-12-08T20:27:56.945 INFO:tasks.workunit.client.1.smithi111.stdout:7/703: dread da/d25/da9/db8/f50 [0,4194304] 0 2023-12-08T20:27:56.945 INFO:tasks.workunit.client.1.smithi111.stdout:7/704: dread - da/d38/fda zero size 2023-12-08T20:27:56.945 INFO:tasks.workunit.client.1.smithi111.stdout:9/788: mknod d2/d8/dd/d1a/d1e/d2d/d4a/d62/d110/c113 0 2023-12-08T20:27:56.946 INFO:tasks.workunit.client.1.smithi111.stdout:8/806: link dd/d35/d42/db4/fca dd/dc9/ddb/df8/f11f 0 2023-12-08T20:27:56.946 INFO:tasks.workunit.client.1.smithi111.stdout:8/807: chown dd/d32/f48 496 1 2023-12-08T20:27:56.946 INFO:tasks.workunit.client.1.smithi111.stdout:8/808: chown dd/d32/l6d 0 1 2023-12-08T20:27:56.949 INFO:tasks.workunit.client.1.smithi111.stdout:5/877: link d3/d4/d7/d29/d73/f106 d3/d12/d67/ddf/d108/f12b 0 2023-12-08T20:27:56.952 INFO:tasks.workunit.client.1.smithi111.stdout:3/674: rename d2/d3/d13/d36/f3e to d2/d15/d17/d25/fd2 0 2023-12-08T20:27:56.956 INFO:tasks.workunit.client.1.smithi111.stdout:0/964: dread d1/d2d/d83/f12b [0,4194304] 0 2023-12-08T20:27:56.957 INFO:tasks.workunit.client.1.smithi111.stdout:0/965: read d1/d2d/d83/f12b [2828783,35159] 0 2023-12-08T20:27:56.961 INFO:tasks.workunit.client.1.smithi111.stdout:4/643: mknod d8/d30/d7d/d9b/db2/d4b/cce 0 2023-12-08T20:27:56.962 INFO:tasks.workunit.client.1.smithi111.stdout:6/590: mknod d0/d1/d27/da1/cbd 0 2023-12-08T20:27:56.966 INFO:tasks.workunit.client.1.smithi111.stdout:1/711: truncate d0/d6/d33/d15/d51/d5b/d5e/d86/dbd/fe7 3360061 0 2023-12-08T20:27:56.966 INFO:tasks.workunit.client.1.smithi111.stdout:1/712: readlink d0/d6/d33/d15/d51/l3d 0 2023-12-08T20:27:56.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:56 smithi111 ceph-mon[121341]: pgmap v19: 65 pgs: 65 active+clean; 1.4 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 97 MiB/s rd, 191 MiB/s wr, 710 op/s 2023-12-08T20:27:56.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:56 smithi111 ceph-mon[121341]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:27:56.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:56 smithi111 ceph-mon[121341]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:27:56.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:56 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/2812035020' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:27:56.967 INFO:tasks.workunit.client.1.smithi111.stdout:9/789: mkdir d2/d8/dd/d1a/d1e/d114 0 2023-12-08T20:27:56.968 INFO:tasks.workunit.client.1.smithi111.stdout:8/809: getdents dd/d96 0 2023-12-08T20:27:56.968 INFO:tasks.workunit.client.1.smithi111.stdout:8/810: readlink lc 0 2023-12-08T20:27:56.968 INFO:tasks.workunit.client.1.smithi111.stdout:8/811: truncate dd/d32/d3d/f6a 648790 0 2023-12-08T20:27:56.970 INFO:tasks.workunit.client.1.smithi111.stdout:3/675: link d2/d3/c64 d2/cd3 0 2023-12-08T20:27:56.973 INFO:tasks.workunit.client.1.smithi111.stdout:0/966: rmdir d1/d4 39 2023-12-08T20:27:56.973 INFO:tasks.workunit.client.1.smithi111.stdout:0/967: chown d1/df/d16/d2c 612 1 2023-12-08T20:27:56.974 INFO:tasks.workunit.client.1.smithi111.stdout:7/705: dwrite da/d13/f9b [0,4194304] 0 2023-12-08T20:27:56.976 INFO:tasks.workunit.client.1.smithi111.stdout:5/878: dwrite d3/d4/d4a/fb3 [0,4194304] 0 2023-12-08T20:27:56.976 INFO:tasks.workunit.client.1.smithi111.stdout:1/713: dread d0/d6/d33/d6c/f9a [0,4194304] 0 2023-12-08T20:27:56.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.975+0000 7fbc59630700 1 -- 172.21.15.43:0/3171926208 --> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc5410d110 con 0x7fbc3c06ae40 2023-12-08T20:27:56.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.977+0000 7fbc3b7fe700 1 -- 172.21.15.43:0/3171926208 <== mgr.24407 v2:172.21.15.111:6828/940639390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fbc5410d110 con 0x7fbc3c06ae40 2023-12-08T20:27:56.978 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:27:56.978 INFO:teuthology.orchestra.run.smithi043.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-08T20:27:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: "in_progress": true, 2023-12-08T20:27:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-08T20:27:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: "services_complete": [], 2023-12-08T20:27:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: "progress": "1/2 daemons upgraded", 2023-12-08T20:27:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: "message": "", 2023-12-08T20:27:56.979 INFO:teuthology.orchestra.run.smithi043.stdout: "is_paused": false 2023-12-08T20:27:56.979 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:27:56.980 INFO:tasks.workunit.client.1.smithi111.stdout:4/644: mknod d8/da/db/d7f/d8e/ccf 0 2023-12-08T20:27:56.980 INFO:tasks.workunit.client.1.smithi111.stdout:4/645: chown d8/da/db/d7f/d93/d77 201828984 1 2023-12-08T20:27:56.980 INFO:tasks.workunit.client.1.smithi111.stdout:4/646: write d8/da/db/fc [1716794,33284] 0 2023-12-08T20:27:56.980 INFO:tasks.workunit.client.1.smithi111.stdout:8/812: dread dd/f29 [0,4194304] 0 2023-12-08T20:27:56.980 INFO:tasks.workunit.client.1.smithi111.stdout:6/591: dwrite d0/d1/d27/da1/fb7 [0,4194304] 0 2023-12-08T20:27:56.981 INFO:tasks.workunit.client.1.smithi111.stdout:6/592: chown d0/d1/d27/d36/d97/db4 80413346 1 2023-12-08T20:27:56.981 INFO:tasks.workunit.client.1.smithi111.stdout:6/593: fdatasync d0/f32 0 2023-12-08T20:27:56.981 INFO:tasks.workunit.client.1.smithi111.stdout:6/594: write d0/d1/d27/f5d [683220,79371] 0 2023-12-08T20:27:56.981 INFO:tasks.workunit.client.1.smithi111.stdout:6/595: write d0/d1/d1e/f75 [3546513,26001] 0 2023-12-08T20:27:56.981 INFO:tasks.workunit.client.1.smithi111.stdout:1/714: write d0/f2d [1369318,77150] 0 2023-12-08T20:27:56.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.982+0000 7fbc59630700 1 -- 172.21.15.43:0/3171926208 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7fbc3c06ae40 msgr2=0x7fbc3c06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:56.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.982+0000 7fbc59630700 1 --2- 172.21.15.43:0/3171926208 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7fbc3c06ae40 0x7fbc3c06d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbc44007fd0 tx=0x7fbc4400b040 comp rx=0 tx=0).stop 2023-12-08T20:27:56.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.982+0000 7fbc59630700 1 -- 172.21.15.43:0/3171926208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc540ffd70 msgr2=0x7fbc5410b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:27:56.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.982+0000 7fbc59630700 1 --2- 172.21.15.43:0/3171926208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc540ffd70 0x7fbc5410b780 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009fd0 tx=0x7fbc48009e30 comp rx=0 tx=0).stop 2023-12-08T20:27:56.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.982+0000 7fbc59630700 1 -- 172.21.15.43:0/3171926208 shutdown_connections 2023-12-08T20:27:56.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.982+0000 7fbc59630700 1 --2- 172.21.15.43:0/3171926208 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7fbc3c06ae40 0x7fbc3c06d2f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:56.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.982+0000 7fbc59630700 1 --2- 172.21.15.43:0/3171926208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc54066920 0x7fbc5410b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:56.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.982+0000 7fbc59630700 1 --2- 172.21.15.43:0/3171926208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc540ffd70 0x7fbc5410b780 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:27:56.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.982+0000 7fbc59630700 1 -- 172.21.15.43:0/3171926208 >> 172.21.15.43:0/3171926208 conn(0x7fbc540f71b0 msgr2=0x7fbc540fb580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:27:56.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.982+0000 7fbc59630700 1 -- 172.21.15.43:0/3171926208 shutdown_connections 2023-12-08T20:27:56.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:27:56.982+0000 7fbc59630700 1 -- 172.21.15.43:0/3171926208 wait complete. 2023-12-08T20:27:56.986 INFO:tasks.workunit.client.1.smithi111.stdout:3/676: mkdir d2/d15/d17/d5e/da6/dd4 0 2023-12-08T20:27:56.988 INFO:tasks.workunit.client.1.smithi111.stdout:7/706: symlink da/d5c/le8 0 2023-12-08T20:27:56.988 INFO:tasks.workunit.client.1.smithi111.stdout:7/707: chown da/d13/l39 25466948 1 2023-12-08T20:27:56.994 INFO:tasks.workunit.client.1.smithi111.stdout:9/790: dread d2/d8/dd/d1a/d74/dbf/fca [0,4194304] 0 2023-12-08T20:27:56.995 INFO:tasks.workunit.client.1.smithi111.stdout:4/647: symlink d8/da/d2c/d1f/ld0 0 2023-12-08T20:27:56.996 INFO:tasks.workunit.client.1.smithi111.stdout:8/813: mknod dd/d32/d3d/d6b/d72/d118/c120 0 2023-12-08T20:27:56.999 INFO:tasks.workunit.client.1.smithi111.stdout:0/968: dwrite d1/df/d56/f127 [4194304,4194304] 0 2023-12-08T20:27:57.002 INFO:tasks.workunit.client.1.smithi111.stdout:5/879: dwrite d3/d4/d7/d2c/f10f [0,4194304] 0 2023-12-08T20:27:57.004 INFO:tasks.workunit.client.1.smithi111.stdout:6/596: creat d0/d1/d1e/db2/da5/fbe x:0 0 0 2023-12-08T20:27:57.004 INFO:tasks.workunit.client.1.smithi111.stdout:6/597: stat d0/d68/d95/f7b 0 2023-12-08T20:27:57.005 INFO:tasks.workunit.client.1.smithi111.stdout:4/648: dread d8/da/d29/d6e/f99 [0,4194304] 0 2023-12-08T20:27:57.010 INFO:tasks.workunit.client.1.smithi111.stdout:1/715: rmdir d0/d6/d33/d15 39 2023-12-08T20:27:57.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:56 smithi043 ceph-mon[111966]: pgmap v19: 65 pgs: 65 active+clean; 1.4 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 97 MiB/s rd, 191 MiB/s wr, 710 op/s 2023-12-08T20:27:57.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:56 smithi043 ceph-mon[111966]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:27:57.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:56 smithi043 ceph-mon[111966]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:27:57.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:56 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/2812035020' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:27:57.014 INFO:tasks.workunit.client.1.smithi111.stdout:0/969: dwrite d1/df/d16/d2c/d7b/dba/f129 [4194304,4194304] 0 2023-12-08T20:27:57.014 INFO:tasks.workunit.client.1.smithi111.stdout:0/970: chown d1/dd/c29 403585 1 2023-12-08T20:27:57.016 INFO:tasks.workunit.client.1.smithi111.stdout:3/677: rename d2/d15/f60 to d2/d3/fd5 0 2023-12-08T20:27:57.016 INFO:tasks.workunit.client.1.smithi111.stdout:4/649: dread d8/da/f25 [0,4194304] 0 2023-12-08T20:27:57.016 INFO:tasks.workunit.client.1.smithi111.stdout:4/650: stat d8/da/l36 0 2023-12-08T20:27:57.019 INFO:tasks.workunit.client.1.smithi111.stdout:7/708: mkdir da/d25/da9/db8/d89/de9 0 2023-12-08T20:27:57.021 INFO:tasks.workunit.client.1.smithi111.stdout:9/791: rmdir d2/d8/d8c/d96 39 2023-12-08T20:27:57.021 INFO:tasks.workunit.client.1.smithi111.stdout:9/792: chown d2/d8/dd/d1a/d1e/de7/c6d 254242048 1 2023-12-08T20:27:57.022 INFO:tasks.workunit.client.1.smithi111.stdout:5/880: dwrite d3/d4/fac [0,4194304] 0 2023-12-08T20:27:57.023 INFO:tasks.workunit.client.1.smithi111.stdout:7/709: write da/d13/d9e/f4b [5104753,81013] 0 2023-12-08T20:27:57.025 INFO:tasks.workunit.client.1.smithi111.stdout:8/814: truncate dd/d2d/f78 591575 0 2023-12-08T20:27:57.025 INFO:tasks.workunit.client.1.smithi111.stdout:7/710: dread da/d13/d9e/d75/d9f/fc8 [0,4194304] 0 2023-12-08T20:27:57.028 INFO:tasks.workunit.client.1.smithi111.stdout:2/701: sync 2023-12-08T20:27:57.028 INFO:tasks.workunit.client.1.smithi111.stdout:2/702: chown d1/d1d/d1f/d25/d3d/d56/d101/de4/cf1 3 1 2023-12-08T20:27:57.030 INFO:tasks.workunit.client.1.smithi111.stdout:6/598: creat d0/d1/d27/d36/d8d/fbf x:0 0 0 2023-12-08T20:27:57.032 INFO:tasks.workunit.client.1.smithi111.stdout:6/599: write d0/d1/f8 [1542148,29492] 0 2023-12-08T20:27:57.032 INFO:tasks.workunit.client.1.smithi111.stdout:6/600: write d0/d1/f6 [1732402,98841] 0 2023-12-08T20:27:57.033 INFO:tasks.workunit.client.1.smithi111.stdout:8/815: dread dd/d32/d3d/f5b [0,4194304] 0 2023-12-08T20:27:57.034 INFO:tasks.workunit.client.1.smithi111.stdout:0/971: mknod d1/d2d/c141 0 2023-12-08T20:27:57.039 INFO:tasks.workunit.client.1.smithi111.stdout:3/678: rename d2/d3/d13/d36/d69/f75 to d2/d3/d51/d88/fd6 0 2023-12-08T20:27:57.042 INFO:tasks.workunit.client.1.smithi111.stdout:4/651: dwrite f1 [0,4194304] 0 2023-12-08T20:27:57.042 INFO:tasks.workunit.client.1.smithi111.stdout:4/652: readlink d8/da/db/l14 0 2023-12-08T20:27:57.045 INFO:tasks.workunit.client.1.smithi111.stdout:9/793: creat d2/d8/dd/d1a/d1e/d2d/d35/f115 x:0 0 0 2023-12-08T20:27:57.045 INFO:tasks.workunit.client.1.smithi111.stdout:9/794: chown d2/d8/dd/d1a/d1e/d2d/db9/dd5/dfb/c111 0 1 2023-12-08T20:27:57.045 INFO:tasks.workunit.client.1.smithi111.stdout:2/703: dwrite d1/d1d/d1f/d25/f78 [0,4194304] 0 2023-12-08T20:27:57.048 INFO:tasks.workunit.client.1.smithi111.stdout:5/881: unlink c2 0 2023-12-08T20:27:57.050 INFO:tasks.workunit.client.1.smithi111.stdout:6/601: mknod d0/d1/d27/d36/d97/db4/cc0 0 2023-12-08T20:27:57.050 INFO:tasks.workunit.client.1.smithi111.stdout:6/602: chown d0/d68/d95/f47 6 1 2023-12-08T20:27:57.051 INFO:tasks.workunit.client.1.smithi111.stdout:8/816: symlink dd/d32/d36/d119/l121 0 2023-12-08T20:27:57.053 INFO:tasks.workunit.client.1.smithi111.stdout:0/972: symlink d1/df/d44/daa/l142 0 2023-12-08T20:27:57.053 INFO:tasks.workunit.client.1.smithi111.stdout:0/973: write d1/d4/f73 [809566,7290] 0 2023-12-08T20:27:57.055 INFO:tasks.workunit.client.1.smithi111.stdout:7/711: rename da/d13/d9e/c5b to da/d25/d26/d32/d87/cea 0 2023-12-08T20:27:57.056 INFO:tasks.workunit.client.1.smithi111.stdout:7/712: stat da/d25/d3d/fa5 0 2023-12-08T20:27:57.058 INFO:tasks.workunit.client.1.smithi111.stdout:3/679: unlink d2/d12/l67 0 2023-12-08T20:27:57.059 INFO:tasks.workunit.client.1.smithi111.stdout:3/680: read d2/d12/d4a/f6f [265341,10506] 0 2023-12-08T20:27:57.061 INFO:tasks.workunit.client.1.smithi111.stdout:9/795: symlink d2/d8/dd/d1a/d1e/d2d/d4a/dd6/l116 0 2023-12-08T20:27:57.061 INFO:tasks.workunit.client.1.smithi111.stdout:9/796: readlink d2/d8/dd/d1a/d74/l76 0 2023-12-08T20:27:57.064 INFO:tasks.workunit.client.1.smithi111.stdout:2/704: mknod d1/d1d/d1f/dc1/c102 0 2023-12-08T20:27:57.066 INFO:tasks.workunit.client.1.smithi111.stdout:5/882: mkdir d3/d4/d7/d29/d30/dc0/d12c 0 2023-12-08T20:27:57.067 INFO:tasks.workunit.client.1.smithi111.stdout:6/603: getdents d0/d1/d27/d36/d8d 0 2023-12-08T20:27:57.071 INFO:tasks.workunit.client.1.smithi111.stdout:8/817: link dd/d32/d36/d4b/l68 dd/d2d/d62/d8c/l122 0 2023-12-08T20:27:57.072 INFO:tasks.workunit.client.1.smithi111.stdout:0/974: rmdir d1/df/d16/d2c/d7e 39 2023-12-08T20:27:57.075 INFO:tasks.workunit.client.1.smithi111.stdout:7/713: dwrite da/d13/d9e/d75/f99 [0,4194304] 0 2023-12-08T20:27:57.076 INFO:tasks.workunit.client.1.smithi111.stdout:4/653: rename d8/da/d2c to d8/d30/d7d/d9b/db2/d4b/dd1 0 2023-12-08T20:27:57.077 INFO:tasks.workunit.client.1.smithi111.stdout:9/797: mkdir d2/d8/dd/d1a/d1e/d117 0 2023-12-08T20:27:57.080 INFO:tasks.workunit.client.1.smithi111.stdout:3/681: dwrite d2/d3/d13/d36/d69/f7d [4194304,4194304] 0 2023-12-08T20:27:57.080 INFO:tasks.workunit.client.1.smithi111.stdout:3/682: chown d2/d15/d17/d25/fd2 1782312 1 2023-12-08T20:27:57.080 INFO:tasks.workunit.client.1.smithi111.stdout:2/705: unlink d1/d1d/c9c 0 2023-12-08T20:27:57.083 INFO:tasks.workunit.client.1.smithi111.stdout:6/604: mknod d0/d1/d27/d36/d8d/cc1 0 2023-12-08T20:27:57.083 INFO:tasks.workunit.client.1.smithi111.stdout:6/605: fdatasync d0/d1/d1e/db2/f7d 0 2023-12-08T20:27:57.083 INFO:tasks.workunit.client.1.smithi111.stdout:6/606: truncate d0/d1/d1e/db2/da5/fbe 418566 0 2023-12-08T20:27:57.083 INFO:tasks.workunit.client.1.smithi111.stdout:7/714: dread da/d25/d26/f2b [0,4194304] 0 2023-12-08T20:27:57.083 INFO:tasks.workunit.client.1.smithi111.stdout:3/683: dread d2/d3/d13/d36/d69/f6b [0,4194304] 0 2023-12-08T20:27:57.083 INFO:tasks.workunit.client.1.smithi111.stdout:8/818: symlink dd/d2d/d8b/d8d/l123 0 2023-12-08T20:27:57.085 INFO:tasks.workunit.client.1.smithi111.stdout:0/975: creat d1/d4/d24/d46/d49/d6e/f143 x:0 0 0 2023-12-08T20:27:57.086 INFO:tasks.workunit.client.1.smithi111.stdout:5/883: dwrite d3/d4/d7/d29/d73/d90/ff9 [0,4194304] 0 2023-12-08T20:27:57.086 INFO:tasks.workunit.client.1.smithi111.stdout:5/884: truncate d3/d12/d67/ddf/ff3 5182165 0 2023-12-08T20:27:57.092 INFO:tasks.workunit.client.1.smithi111.stdout:4/654: mkdir d8/da/db/d7f/dd2 0 2023-12-08T20:27:57.092 INFO:tasks.workunit.client.1.smithi111.stdout:9/798: mkdir d2/d8/d118 0 2023-12-08T20:27:57.092 INFO:tasks.workunit.client.1.smithi111.stdout:9/799: fsync d2/d8/f4d 0 2023-12-08T20:27:57.092 INFO:tasks.workunit.client.1.smithi111.stdout:9/800: fsync d2/d8/dd/d1a/d1e/d2d/d35/f3e 0 2023-12-08T20:27:57.093 INFO:tasks.workunit.client.1.smithi111.stdout:0/976: dread d1/df/d16/d2c/f8d [0,4194304] 0 2023-12-08T20:27:57.094 INFO:tasks.workunit.client.1.smithi111.stdout:5/885: dread d3/d4/d7/d29/d30/fb5 [0,4194304] 0 2023-12-08T20:27:57.094 INFO:tasks.workunit.client.1.smithi111.stdout:9/801: dread d2/d8/dd/d1a/d74/fdb [0,4194304] 0 2023-12-08T20:27:57.094 INFO:tasks.workunit.client.1.smithi111.stdout:9/802: fsync d2/d8/f4d 0 2023-12-08T20:27:57.094 INFO:tasks.workunit.client.1.smithi111.stdout:9/803: fdatasync d2/da/f10f 0 2023-12-08T20:27:57.095 INFO:tasks.workunit.client.1.smithi111.stdout:0/977: write d1/f57 [254721,44212] 0 2023-12-08T20:27:57.102 INFO:tasks.workunit.client.1.smithi111.stdout:2/706: mknod d1/d29/d4e/ddc/c103 0 2023-12-08T20:27:57.102 INFO:tasks.workunit.client.1.smithi111.stdout:2/707: truncate d1/d1d/fd8 701089 0 2023-12-08T20:27:57.104 INFO:tasks.workunit.client.1.smithi111.stdout:6/607: mknod d0/d1/d1e/db2/da5/cc2 0 2023-12-08T20:27:57.104 INFO:tasks.workunit.client.1.smithi111.stdout:6/608: write d0/d68/da9/fbc [957105,39160] 0 2023-12-08T20:27:57.104 INFO:tasks.workunit.client.1.smithi111.stdout:7/715: dwrite da/f1e [0,4194304] 0 2023-12-08T20:27:57.105 INFO:tasks.workunit.client.1.smithi111.stdout:3/684: creat d2/d3/d13/d36/d44/d8f/dac/fd7 x:0 0 0 2023-12-08T20:27:57.108 INFO:tasks.workunit.client.1.smithi111.stdout:0/978: dread d1/d4/d24/d46/f13a [0,4194304] 0 2023-12-08T20:27:57.109 INFO:tasks.workunit.client.1.smithi111.stdout:8/819: dwrite dd/d35/d42/db4/d109/f114 [0,4194304] 0 2023-12-08T20:27:57.112 INFO:tasks.workunit.client.1.smithi111.stdout:4/655: creat d8/d30/d97/fd3 x:0 0 0 2023-12-08T20:27:57.113 INFO:tasks.workunit.client.1.smithi111.stdout:5/886: truncate d3/d4/d4a/d21/da5/f10c 8051779 0 2023-12-08T20:27:57.117 INFO:tasks.workunit.client.1.smithi111.stdout:9/804: creat d2/d8/f119 x:0 0 0 2023-12-08T20:27:57.117 INFO:tasks.workunit.client.1.smithi111.stdout:2/708: mkdir d1/d29/d4e/ddc/d104 0 2023-12-08T20:27:57.117 INFO:tasks.workunit.client.1.smithi111.stdout:1/716: sync 2023-12-08T20:27:57.117 INFO:tasks.workunit.client.1.smithi111.stdout:6/609: creat d0/d1/d27/d36/d97/fc3 x:0 0 0 2023-12-08T20:27:57.118 INFO:tasks.workunit.client.1.smithi111.stdout:7/716: creat da/d25/d26/d32/feb x:0 0 0 2023-12-08T20:27:57.118 INFO:tasks.workunit.client.1.smithi111.stdout:7/717: write da/d25/d26/d32/dcd/fd2 [656592,26392] 0 2023-12-08T20:27:57.120 INFO:tasks.workunit.client.1.smithi111.stdout:0/979: creat d1/d2d/f144 x:0 0 0 2023-12-08T20:27:57.120 INFO:tasks.workunit.client.1.smithi111.stdout:0/980: chown d1/dd/d4a/dc4 1931 1 2023-12-08T20:27:57.120 INFO:tasks.workunit.client.1.smithi111.stdout:0/981: dread - d1/d4/d24/d46/d49/d6e/f143 zero size 2023-12-08T20:27:57.125 INFO:tasks.workunit.client.1.smithi111.stdout:8/820: mknod dd/d35/d42/c124 0 2023-12-08T20:27:57.131 INFO:tasks.workunit.client.1.smithi111.stdout:5/887: mknod d3/d4/d7/d36/d82/db4/dbe/c12d 0 2023-12-08T20:27:57.131 INFO:tasks.workunit.client.1.smithi111.stdout:5/888: chown d3/d4/f5b 131 1 2023-12-08T20:27:57.132 INFO:tasks.workunit.client.1.smithi111.stdout:9/805: rmdir d2/d8/dd/d1a/d1e/d117 0 2023-12-08T20:27:57.134 INFO:tasks.workunit.client.1.smithi111.stdout:1/717: link d0/d6/d33/d15/d51/d5b/d5e/d86/dbd/fd6 d0/d6/d33/d15/d51/ff6 0 2023-12-08T20:27:57.136 INFO:tasks.workunit.client.1.smithi111.stdout:7/718: rename da/d25/d26/d32/feb to da/d64/dd6/fec 0 2023-12-08T20:27:57.136 INFO:tasks.workunit.client.1.smithi111.stdout:7/719: fsync da/f40 0 2023-12-08T20:27:57.139 INFO:tasks.workunit.client.1.smithi111.stdout:1/718: symlink d0/d6/d33/d8b/db5/lf7 0 2023-12-08T20:27:57.139 INFO:tasks.workunit.client.1.smithi111.stdout:1/719: truncate d0/d6/d33/d15/d51/d5b/d5e/d86/dbd/fd6 655552 0 2023-12-08T20:27:57.140 INFO:tasks.workunit.client.1.smithi111.stdout:6/610: link d0/d1/d27/d36/d8d/fbf d0/d68/d95/d7a/fc4 0 2023-12-08T20:27:57.141 INFO:tasks.workunit.client.1.smithi111.stdout:1/720: symlink d0/d6/d34/lf8 0 2023-12-08T20:27:57.141 INFO:tasks.workunit.client.1.smithi111.stdout:6/611: write d0/d1/d27/f2d [4924962,36321] 0 2023-12-08T20:27:57.143 INFO:tasks.workunit.client.1.smithi111.stdout:1/721: creat d0/d8e/db0/ff9 x:0 0 0 2023-12-08T20:27:57.145 INFO:tasks.workunit.client.1.smithi111.stdout:2/709: dwrite d1/d1d/d68/d73/f9b [0,4194304] 0 2023-12-08T20:27:57.146 INFO:tasks.workunit.client.1.smithi111.stdout:2/710: write d1/d29/d53/d90/f65 [617972,87194] 0 2023-12-08T20:27:57.146 INFO:tasks.workunit.client.1.smithi111.stdout:2/711: truncate d1/d1d/d1f/d25/d3d/d56/ffb 749299 0 2023-12-08T20:27:57.146 INFO:tasks.workunit.client.1.smithi111.stdout:1/722: mkdir d0/d6/d33/d15/d51/d5b/d5e/da0/dfa 0 2023-12-08T20:27:57.147 INFO:tasks.workunit.client.1.smithi111.stdout:4/656: dwrite d8/da/d29/f39 [0,4194304] 0 2023-12-08T20:27:57.147 INFO:tasks.workunit.client.1.smithi111.stdout:7/720: dread da/d25/da9/fd8 [0,4194304] 0 2023-12-08T20:27:57.148 INFO:tasks.workunit.client.1.smithi111.stdout:0/982: dwrite d1/df/d16/d2c/d7b/fca [0,4194304] 0 2023-12-08T20:27:57.150 INFO:tasks.workunit.client.1.smithi111.stdout:9/806: dread d2/d8/dd/d1a/d1e/d2d/d8f/faa [0,4194304] 0 2023-12-08T20:27:57.150 INFO:tasks.workunit.client.1.smithi111.stdout:8/821: dread dd/d32/d36/f7d [0,4194304] 0 2023-12-08T20:27:57.150 INFO:tasks.workunit.client.1.smithi111.stdout:0/983: write d1/df/d16/fae [3309869,1878] 0 2023-12-08T20:27:57.151 INFO:tasks.workunit.client.1.smithi111.stdout:2/712: creat d1/dec/f105 x:0 0 0 2023-12-08T20:27:57.151 INFO:tasks.workunit.client.1.smithi111.stdout:2/713: fdatasync d1/d29/d53/f82 0 2023-12-08T20:27:57.151 INFO:tasks.workunit.client.1.smithi111.stdout:8/822: write dd/d2d/d62/fe3 [743536,66114] 0 2023-12-08T20:27:57.151 INFO:tasks.workunit.client.1.smithi111.stdout:8/823: dread - dd/d2d/d8b/d8d/f101 zero size 2023-12-08T20:27:57.151 INFO:tasks.workunit.client.1.smithi111.stdout:8/824: readlink dd/d35/le6 0 2023-12-08T20:27:57.151 INFO:tasks.workunit.client.1.smithi111.stdout:5/889: dwrite d3/d6d/f107 [0,4194304] 0 2023-12-08T20:27:57.151 INFO:tasks.workunit.client.1.smithi111.stdout:5/890: chown d3/d4/d7/d36/d82/fda 1350043 1 2023-12-08T20:27:57.152 INFO:tasks.workunit.client.1.smithi111.stdout:9/807: write d2/d8/f40 [3828197,46010] 0 2023-12-08T20:27:57.153 INFO:tasks.workunit.client.1.smithi111.stdout:8/825: dread dd/d32/dea/f113 [0,4194304] 0 2023-12-08T20:27:57.154 INFO:tasks.workunit.client.1.smithi111.stdout:1/723: rename d0/d6/d33/d15/d51/f73 to d0/d6/d33/d60/ffb 0 2023-12-08T20:27:57.154 INFO:tasks.workunit.client.1.smithi111.stdout:1/724: truncate d0/d6/d33/d15/d51/d5b/d5e/d86/dab/fcf 268082 0 2023-12-08T20:27:57.154 INFO:tasks.workunit.client.1.smithi111.stdout:1/725: fsync d0/d6/d33/ff 0 2023-12-08T20:27:57.156 INFO:tasks.workunit.client.1.smithi111.stdout:5/891: write d3/d4/d7/d36/d64/d96/f110 [937028,9972] 0 2023-12-08T20:27:57.159 INFO:tasks.workunit.client.1.smithi111.stdout:7/721: link da/d64/cbf da/d25/da9/ced 0 2023-12-08T20:27:57.161 INFO:tasks.workunit.client.1.smithi111.stdout:2/714: symlink d1/d1d/d1f/d25/l106 0 2023-12-08T20:27:57.166 INFO:tasks.workunit.client.1.smithi111.stdout:9/808: truncate d2/d8/dd/d1a/d1e/d2d/d35/d88/f99 2869493 0 2023-12-08T20:27:57.167 INFO:tasks.workunit.client.1.smithi111.stdout:8/826: creat dd/d32/f125 x:0 0 0 2023-12-08T20:27:57.172 INFO:tasks.workunit.client.1.smithi111.stdout:1/726: mkdir d0/d8e/dd4/dfc 0 2023-12-08T20:27:57.175 INFO:tasks.workunit.client.1.smithi111.stdout:5/892: symlink d3/d12/d67/ddf/l12e 0 2023-12-08T20:27:57.176 INFO:tasks.workunit.client.1.smithi111.stdout:0/984: dwrite d1/dd/d47/fda [0,4194304] 0 2023-12-08T20:27:57.178 INFO:tasks.workunit.client.1.smithi111.stdout:9/809: creat d2/d8/d8c/dbb/f11a x:0 0 0 2023-12-08T20:27:57.183 INFO:tasks.workunit.client.1.smithi111.stdout:7/722: dwrite da/d5c/fcc [0,4194304] 0 2023-12-08T20:27:57.184 INFO:tasks.workunit.client.1.smithi111.stdout:5/893: rename d3/c6 to d3/d6d/c12f 0 2023-12-08T20:27:57.187 INFO:tasks.workunit.client.1.smithi111.stdout:6/612: truncate d0/d68/d95/f35 2065987 0 2023-12-08T20:27:57.192 INFO:tasks.workunit.client.1.smithi111.stdout:8/827: dwrite fa [0,4194304] 0 2023-12-08T20:27:57.194 INFO:tasks.workunit.client.1.smithi111.stdout:0/985: dwrite d1/df/d16/f53 [0,4194304] 0 2023-12-08T20:27:57.194 INFO:tasks.workunit.client.1.smithi111.stdout:0/986: write d1/d4/d24/d46/d58/f6d [4411746,77666] 0 2023-12-08T20:27:57.194 INFO:tasks.workunit.client.1.smithi111.stdout:1/727: getdents d0/d6/d33/d15/d51 0 2023-12-08T20:27:57.194 INFO:tasks.workunit.client.1.smithi111.stdout:2/715: dwrite d1/d1d/d1f/d36/d92/fbe [0,4194304] 0 2023-12-08T20:27:57.194 INFO:tasks.workunit.client.1.smithi111.stdout:0/987: write d1/df/d16/d2c/d7e/f82 [358395,30535] 0 2023-12-08T20:27:57.200 INFO:tasks.workunit.client.1.smithi111.stdout:9/810: creat d2/f11b x:0 0 0 2023-12-08T20:27:57.204 INFO:tasks.workunit.client.1.smithi111.stdout:7/723: link da/d25/f4a da/d25/d26/d32/fee 0 2023-12-08T20:27:57.204 INFO:tasks.workunit.client.1.smithi111.stdout:7/724: chown da/d13/f49 91508 1 2023-12-08T20:27:57.204 INFO:tasks.workunit.client.1.smithi111.stdout:7/725: stat da/d13/d9e/d75/d9f/ca2 0 2023-12-08T20:27:57.204 INFO:tasks.workunit.client.1.smithi111.stdout:6/613: dwrite d0/d1/d1e/db2/f2a [4194304,4194304] 0 2023-12-08T20:27:57.206 INFO:tasks.workunit.client.1.smithi111.stdout:5/894: link d3/d4/d7/d2c/f41 d3/d4/d7/d36/d82/db4/dbe/dc6/f130 0 2023-12-08T20:27:57.209 INFO:tasks.workunit.client.1.smithi111.stdout:8/828: symlink dd/d32/d36/d50/l126 0 2023-12-08T20:27:57.214 INFO:tasks.workunit.client.1.smithi111.stdout:2/716: mkdir d1/d1d/d22/d30/d107 0 2023-12-08T20:27:57.216 INFO:tasks.workunit.client.1.smithi111.stdout:9/811: symlink d2/d8/dd/l11c 0 2023-12-08T20:27:57.218 INFO:tasks.workunit.client.1.smithi111.stdout:7/726: symlink da/d25/d3d/dc9/lef 0 2023-12-08T20:27:57.219 INFO:tasks.workunit.client.1.smithi111.stdout:1/728: dwrite d0/f17 [8388608,4194304] 0 2023-12-08T20:27:57.221 INFO:tasks.workunit.client.1.smithi111.stdout:6/614: getdents d0/d1/d27 0 2023-12-08T20:27:57.221 INFO:tasks.workunit.client.1.smithi111.stdout:6/615: readlink d0/d1/d27/d36/l88 0 2023-12-08T20:27:57.222 INFO:tasks.workunit.client.1.smithi111.stdout:5/895: creat d3/d4/d4a/f131 x:0 0 0 2023-12-08T20:27:57.222 INFO:tasks.workunit.client.1.smithi111.stdout:5/896: fdatasync d3/d4/d7/d2c/f5a 0 2023-12-08T20:27:57.222 INFO:tasks.workunit.client.1.smithi111.stdout:5/897: chown d3/d4/f55 178931020 1 2023-12-08T20:27:57.222 INFO:tasks.workunit.client.1.smithi111.stdout:5/898: stat d3/d4/d4a/d21/f91 0 2023-12-08T20:27:57.223 INFO:tasks.workunit.client.1.smithi111.stdout:5/899: fsync d3/d4/fac 0 2023-12-08T20:27:57.223 INFO:tasks.workunit.client.1.smithi111.stdout:9/812: mkdir d2/d8/dd/d1a/d1e/d2d/db9/dd5/dfb/d11d 0 2023-12-08T20:27:57.226 INFO:tasks.workunit.client.1.smithi111.stdout:7/727: mkdir da/d25/d3d/d58/df0 0 2023-12-08T20:27:57.227 INFO:tasks.workunit.client.1.smithi111.stdout:6/616: write d0/f20 [2357440,106717] 0 2023-12-08T20:27:57.227 INFO:tasks.workunit.client.1.smithi111.stdout:1/729: mknod d0/d6/d47/dee/cfd 0 2023-12-08T20:27:57.228 INFO:tasks.workunit.client.1.smithi111.stdout:1/730: write d0/f31 [1570016,82822] 0 2023-12-08T20:27:57.229 INFO:tasks.workunit.client.1.smithi111.stdout:0/988: dwrite d1/d4/d24/f45 [0,4194304] 0 2023-12-08T20:27:57.229 INFO:tasks.workunit.client.1.smithi111.stdout:0/989: chown d1/d4/d24/d2f 79163 1 2023-12-08T20:27:57.229 INFO:tasks.workunit.client.1.smithi111.stdout:0/990: fsync d1/df/d44/d37/d5c/f67 0 2023-12-08T20:27:57.229 INFO:tasks.workunit.client.1.smithi111.stdout:8/829: dwrite dd/d2d/d62/d83/fc5 [0,4194304] 0 2023-12-08T20:27:57.230 INFO:tasks.workunit.client.1.smithi111.stdout:5/900: rename d3/d8d/c126 to d3/d12/dbd/c132 0 2023-12-08T20:27:57.234 INFO:tasks.workunit.client.1.smithi111.stdout:9/813: mkdir d2/da/d11e 0 2023-12-08T20:27:57.234 INFO:tasks.workunit.client.1.smithi111.stdout:7/728: truncate da/d25/d26/d32/d3e/fac 433159 0 2023-12-08T20:27:57.234 INFO:tasks.workunit.client.1.smithi111.stdout:7/729: fsync da/d13/d9e/f4b 0 2023-12-08T20:27:57.235 INFO:tasks.workunit.client.1.smithi111.stdout:6/617: stat d0/d1/d27/d36/c45 0 2023-12-08T20:27:57.236 INFO:tasks.workunit.client.1.smithi111.stdout:3/685: sync 2023-12-08T20:27:57.236 INFO:tasks.workunit.client.1.smithi111.stdout:3/686: chown d2/d15/c27 45 1 2023-12-08T20:27:57.237 INFO:tasks.workunit.client.1.smithi111.stdout:1/731: creat d0/d6/d33/d8b/ffe x:0 0 0 2023-12-08T20:27:57.237 INFO:tasks.workunit.client.1.smithi111.stdout:8/830: dread dd/f20 [0,4194304] 0 2023-12-08T20:27:57.240 INFO:tasks.workunit.client.1.smithi111.stdout:3/687: write d2/d15/d17/d5e/d9f/dbe/fc0 [3072981,48340] 0 2023-12-08T20:27:57.247 INFO:tasks.workunit.client.1.smithi111.stdout:3/688: dread d2/d3/d13/d36/fbf [0,4194304] 0 2023-12-08T20:27:57.249 INFO:tasks.workunit.client.1.smithi111.stdout:0/991: mkdir d1/df/d56/d145 0 2023-12-08T20:27:57.249 INFO:tasks.workunit.client.1.smithi111.stdout:1/732: write d0/d6/d33/d15/d51/d5b/f54 [3973665,110119] 0 2023-12-08T20:27:57.249 INFO:tasks.workunit.client.1.smithi111.stdout:1/733: fsync d0/d6/d33/d15/d51/d78/f7c 0 2023-12-08T20:27:57.251 INFO:tasks.workunit.client.1.smithi111.stdout:2/717: dwrite d1/fcc [0,4194304] 0 2023-12-08T20:27:57.251 INFO:tasks.workunit.client.1.smithi111.stdout:7/730: dwrite da/d13/d9e/d75/d9f/fc8 [0,4194304] 0 2023-12-08T20:27:57.251 INFO:tasks.workunit.client.1.smithi111.stdout:7/731: stat da/d5c/d6e/f86 0 2023-12-08T20:27:57.251 INFO:tasks.workunit.client.1.smithi111.stdout:7/732: fdatasync da/d13/d9e/f4b 0 2023-12-08T20:27:57.251 INFO:tasks.workunit.client.1.smithi111.stdout:7/733: fdatasync da/d25/da9/db8/f50 0 2023-12-08T20:27:57.252 INFO:tasks.workunit.client.1.smithi111.stdout:5/901: symlink d3/d4/d7/d2c/d84/l133 0 2023-12-08T20:27:57.252 INFO:tasks.workunit.client.1.smithi111.stdout:5/902: readlink d3/d4/d4a/l45 0 2023-12-08T20:27:57.253 INFO:tasks.workunit.client.1.smithi111.stdout:9/814: truncate d2/d8/dd/d1a/d74/dbf/f10e 807204 0 2023-12-08T20:27:57.256 INFO:tasks.workunit.client.1.smithi111.stdout:6/618: creat d0/daa/fc5 x:0 0 0 2023-12-08T20:27:57.256 INFO:tasks.workunit.client.1.smithi111.stdout:6/619: readlink d0/d68/lbb 0 2023-12-08T20:27:57.259 INFO:tasks.workunit.client.1.smithi111.stdout:3/689: creat d2/d15/d17/d5e/d62/fd8 x:0 0 0 2023-12-08T20:27:57.259 INFO:tasks.workunit.client.1.smithi111.stdout:3/690: chown d2/d3/d13/d36 93191005 1 2023-12-08T20:27:57.260 INFO:tasks.workunit.client.1.smithi111.stdout:0/992: truncate d1/dd/d47/fbd 1206769 0 2023-12-08T20:27:57.262 INFO:tasks.workunit.client.1.smithi111.stdout:1/734: link d0/f2f d0/d6/d33/d8b/de9/fff 0 2023-12-08T20:27:57.263 INFO:tasks.workunit.client.1.smithi111.stdout:2/718: mkdir d1/d29/d4e/ddc/d108 0 2023-12-08T20:27:57.268 INFO:tasks.workunit.client.1.smithi111.stdout:7/734: creat da/d64/dc4/ff1 x:0 0 0 2023-12-08T20:27:57.272 INFO:tasks.workunit.client.1.smithi111.stdout:9/815: creat d2/d8/dd/d1a/f11f x:0 0 0 2023-12-08T20:27:57.276 INFO:tasks.workunit.client.1.smithi111.stdout:8/831: symlink dd/d32/dea/df1/l127 0 2023-12-08T20:27:57.277 INFO:tasks.workunit.client.1.smithi111.stdout:8/832: readlink dd/d32/d3d/lad 0 2023-12-08T20:27:57.277 INFO:tasks.workunit.client.1.smithi111.stdout:8/833: chown dd/f2b 597246516 1 2023-12-08T20:27:57.277 INFO:tasks.workunit.client.1.smithi111.stdout:3/691: mknod d2/d15/d17/d5e/cd9 0 2023-12-08T20:27:57.279 INFO:tasks.workunit.client.1.smithi111.stdout:4/657: sync 2023-12-08T20:27:57.281 INFO:tasks.workunit.client.1.smithi111.stdout:0/993: mknod d1/df/d16/d2c/d7e/d104/c146 0 2023-12-08T20:27:57.286 INFO:tasks.workunit.client.1.smithi111.stdout:9/816: rmdir d2/d8/dd 39 2023-12-08T20:27:57.286 INFO:tasks.workunit.client.1.smithi111.stdout:9/817: readlink d2/d8/dd/d56/da1/lec 0 2023-12-08T20:27:57.286 INFO:tasks.workunit.client.1.smithi111.stdout:9/818: stat d2/d8/dd/d1a/d1e/de7/c49 0 2023-12-08T20:27:57.287 INFO:tasks.workunit.client.1.smithi111.stdout:8/834: creat dd/d32/de2/f128 x:0 0 0 2023-12-08T20:27:57.287 INFO:tasks.workunit.client.1.smithi111.stdout:8/835: truncate dd/d2d/d8b/d8d/fe8 1002863 0 2023-12-08T20:27:57.287 INFO:tasks.workunit.client.1.smithi111.stdout:6/620: fsync d0/daa/fc5 0 2023-12-08T20:27:57.287 INFO:tasks.workunit.client.1.smithi111.stdout:6/621: dread d0/d1/d1e/db2/da5/fbe [0,4194304] 0 2023-12-08T20:27:57.288 INFO:tasks.workunit.client.1.smithi111.stdout:3/692: mkdir d2/d12/d2e/dc6/dda 0 2023-12-08T20:27:57.288 INFO:tasks.workunit.client.1.smithi111.stdout:4/658: creat d8/d30/fd4 x:0 0 0 2023-12-08T20:27:57.290 INFO:tasks.workunit.client.1.smithi111.stdout:8/836: truncate dd/d2d/d8b/fae 926145 0 2023-12-08T20:27:57.290 INFO:tasks.workunit.client.1.smithi111.stdout:8/837: write dd/d2d/f31 [470200,49618] 0 2023-12-08T20:27:57.291 INFO:tasks.workunit.client.1.smithi111.stdout:6/622: getdents d0/d1/d27/d56 0 2023-12-08T20:27:57.293 INFO:tasks.workunit.client.1.smithi111.stdout:4/659: creat d8/da/d29/d69/fd5 x:0 0 0 2023-12-08T20:27:57.295 INFO:tasks.workunit.client.1.smithi111.stdout:8/838: creat dd/d32/d3d/d55/f129 x:0 0 0 2023-12-08T20:27:57.295 INFO:tasks.workunit.client.1.smithi111.stdout:1/735: dwrite d0/d6/d33/d15/d51/d5b/d5e/faa [0,4194304] 0 2023-12-08T20:27:57.295 INFO:tasks.workunit.client.1.smithi111.stdout:2/719: dwrite d1/d29/d53/d90/f6e [0,4194304] 0 2023-12-08T20:27:57.297 INFO:tasks.workunit.client.1.smithi111.stdout:6/623: rmdir d0/daa 39 2023-12-08T20:27:57.297 INFO:tasks.workunit.client.1.smithi111.stdout:6/624: fdatasync d0/d68/d95/f1d 0 2023-12-08T20:27:57.299 INFO:tasks.workunit.client.1.smithi111.stdout:7/735: rename da/d64/dc4 to da/d5c/d59/df2 0 2023-12-08T20:27:57.300 INFO:tasks.workunit.client.1.smithi111.stdout:0/994: dwrite d1/df/d56/f127 [4194304,4194304] 0 2023-12-08T20:27:57.301 INFO:tasks.workunit.client.1.smithi111.stdout:4/660: symlink d8/d30/d7d/d9b/db2/ld6 0 2023-12-08T20:27:57.303 INFO:tasks.workunit.client.1.smithi111.stdout:8/839: creat dd/d32/d3d/d6b/f12a x:0 0 0 2023-12-08T20:27:57.303 INFO:tasks.workunit.client.1.smithi111.stdout:8/840: write dd/d2d/fbf [954200,118370] 0 2023-12-08T20:27:57.304 INFO:tasks.workunit.client.1.smithi111.stdout:7/736: dread da/d5c/d6e/f86 [0,4194304] 0 2023-12-08T20:27:57.304 INFO:tasks.workunit.client.1.smithi111.stdout:2/720: stat d1/d1d/d1f/d25/d3d/d56/d101/lee 0 2023-12-08T20:27:57.308 INFO:tasks.workunit.client.1.smithi111.stdout:1/736: dwrite d0/d6/d33/d60/f7f [0,4194304] 0 2023-12-08T20:27:57.311 INFO:tasks.workunit.client.1.smithi111.stdout:6/625: truncate d0/d1/d27/d36/d8d/fa3 291992 0 2023-12-08T20:27:57.311 INFO:tasks.workunit.client.1.smithi111.stdout:0/995: mkdir d1/df/d16/d2c/d7b/dba/d147 0 2023-12-08T20:27:57.311 INFO:tasks.workunit.client.1.smithi111.stdout:0/996: readlink d1/d4/d24/d46/d49/d6e/lee 0 2023-12-08T20:27:57.311 INFO:tasks.workunit.client.1.smithi111.stdout:0/997: dread - d1/f128 zero size 2023-12-08T20:27:57.312 INFO:tasks.workunit.client.1.smithi111.stdout:4/661: creat d8/d30/d7d/d9b/db2/d4b/dd1/d1f/fd7 x:0 0 0 2023-12-08T20:27:57.312 INFO:tasks.workunit.client.1.smithi111.stdout:4/662: chown d8/da/db/d7f/da7/fad 2 1 2023-12-08T20:27:57.313 INFO:tasks.workunit.client.1.smithi111.stdout:8/841: creat dd/d35/d42/db4/f12b x:0 0 0 2023-12-08T20:27:57.314 INFO:tasks.workunit.client.1.smithi111.stdout:2/721: dread d1/d1d/d22/d30/f5c [0,4194304] 0 2023-12-08T20:27:57.314 INFO:tasks.workunit.client.1.smithi111.stdout:2/722: truncate d1/d1d/d22/f76 2175093 0 2023-12-08T20:27:57.316 INFO:tasks.workunit.client.1.smithi111.stdout:7/737: rename da/d38/f74 to da/d13/ff3 0 2023-12-08T20:27:57.316 INFO:tasks.workunit.client.1.smithi111.stdout:7/738: readlink da/d5c/d59/d61/l83 0 2023-12-08T20:27:57.320 INFO:tasks.workunit.client.1.smithi111.stdout:6/626: dread d0/d1/d27/f2f [0,4194304] 0 2023-12-08T20:27:57.321 INFO:tasks.workunit.client.1.smithi111.stdout:0/998: creat d1/d4/f148 x:0 0 0 2023-12-08T20:27:57.321 INFO:tasks.workunit.client.1.smithi111.stdout:0/999: fsync d1/df/fd0 0 2023-12-08T20:27:57.322 INFO:tasks.workunit.client.1.smithi111.stdout:4/663: creat d8/da/fd8 x:0 0 0 2023-12-08T20:27:57.324 INFO:tasks.workunit.client.1.smithi111.stdout:8/842: truncate dd/d2d/d62/f93 2046765 0 2023-12-08T20:27:57.325 INFO:tasks.workunit.client.1.smithi111.stdout:2/723: creat d1/dec/f109 x:0 0 0 2023-12-08T20:27:57.336 INFO:tasks.workunit.client.1.smithi111.stdout:4/664: link d8/d30/d7d/d9b/db2/d4b/dd1/d1f/f83 d8/da/db/d7f/d93/d91/fd9 0 2023-12-08T20:27:57.336 INFO:tasks.workunit.client.1.smithi111.stdout:4/665: readlink d8/d30/d7d/lc9 0 2023-12-08T20:27:57.338 INFO:tasks.workunit.client.1.smithi111.stdout:6/627: dwrite d0/d1/d1e/db2/f7d [0,4194304] 0 2023-12-08T20:27:57.338 INFO:tasks.workunit.client.1.smithi111.stdout:8/843: mknod dd/d32/d3d/d6b/c12c 0 2023-12-08T20:27:57.338 INFO:tasks.workunit.client.1.smithi111.stdout:8/844: read - dd/d32/d3d/d55/f129 zero size 2023-12-08T20:27:57.338 INFO:tasks.workunit.client.1.smithi111.stdout:1/737: dwrite d0/d22/f45 [0,4194304] 0 2023-12-08T20:27:57.339 INFO:tasks.workunit.client.1.smithi111.stdout:2/724: mkdir d1/d1d/d1f/d25/d3d/d56/d10a 0 2023-12-08T20:27:57.340 INFO:tasks.workunit.client.1.smithi111.stdout:2/725: truncate d1/d1d/d1f/d25/d96/ddf/f100 334319 0 2023-12-08T20:27:57.342 INFO:tasks.workunit.client.1.smithi111.stdout:4/666: unlink d8/da/d29/d69/fd5 0 2023-12-08T20:27:57.342 INFO:tasks.workunit.client.1.smithi111.stdout:5/903: sync 2023-12-08T20:27:57.349 INFO:tasks.workunit.client.1.smithi111.stdout:6/628: rmdir d0 39 2023-12-08T20:27:57.349 INFO:tasks.workunit.client.1.smithi111.stdout:6/629: read d0/d1/f2c [446177,50479] 0 2023-12-08T20:27:57.352 INFO:tasks.workunit.client.1.smithi111.stdout:8/845: rename dd/d35/d7a/dc3/cee to dd/d32/d3d/d6b/d72/c12d 0 2023-12-08T20:27:57.356 INFO:tasks.workunit.client.1.smithi111.stdout:7/739: rmdir da 39 2023-12-08T20:27:57.357 INFO:tasks.workunit.client.1.smithi111.stdout:1/738: creat d0/d6/d33/d6c/d75/f100 x:0 0 0 2023-12-08T20:27:57.359 INFO:tasks.workunit.client.1.smithi111.stdout:8/846: dread dd/d32/d3d/f44 [0,4194304] 0 2023-12-08T20:27:57.359 INFO:tasks.workunit.client.1.smithi111.stdout:8/847: chown dd/d32/d3d/ccb 405902030 1 2023-12-08T20:27:57.359 INFO:tasks.workunit.client.1.smithi111.stdout:4/667: rmdir d8/da/db/d7f/d93/d77/db5 39 2023-12-08T20:27:57.362 INFO:tasks.workunit.client.1.smithi111.stdout:2/726: dwrite d1/d29/d4e/f32 [0,4194304] 0 2023-12-08T20:27:57.363 INFO:tasks.workunit.client.1.smithi111.stdout:5/904: dwrite d3/d12/dbd/f121 [0,4194304] 0 2023-12-08T20:27:57.364 INFO:tasks.workunit.client.1.smithi111.stdout:6/630: rename d0/d1/d27/d36/d97/db4/cc0 to d0/d68/d95/cc6 0 2023-12-08T20:27:57.364 INFO:tasks.workunit.client.1.smithi111.stdout:6/631: fdatasync d0/d1/f11 0 2023-12-08T20:27:57.366 INFO:tasks.workunit.client.1.smithi111.stdout:7/740: creat da/d13/ff4 x:0 0 0 2023-12-08T20:27:57.366 INFO:tasks.workunit.client.1.smithi111.stdout:4/668: getdents d8/d30/d7d/d9b/db2 0 2023-12-08T20:27:57.374 INFO:tasks.workunit.client.1.smithi111.stdout:4/669: dread d8/da/d29/f39 [0,4194304] 0 2023-12-08T20:27:57.374 INFO:tasks.workunit.client.1.smithi111.stdout:5/905: symlink d3/d4/d7/d29/d73/d90/l134 0 2023-12-08T20:27:57.374 INFO:tasks.workunit.client.1.smithi111.stdout:5/906: truncate d3/d4/d7/d2c/f3e 5030958 0 2023-12-08T20:27:57.375 INFO:tasks.workunit.client.1.smithi111.stdout:1/739: rename d0/d6/d33/d8b/db5/lf7 to d0/d6/d34/l101 0 2023-12-08T20:27:57.377 INFO:tasks.workunit.client.1.smithi111.stdout:8/848: dwrite dd/f1f [4194304,4194304] 0 2023-12-08T20:27:57.377 INFO:tasks.workunit.client.1.smithi111.stdout:8/849: readlink dd/d96/lc6 0 2023-12-08T20:27:57.377 INFO:tasks.workunit.client.1.smithi111.stdout:8/850: chown dd/d32/d36/d4b/f9d 6 1 2023-12-08T20:27:57.378 INFO:tasks.workunit.client.1.smithi111.stdout:6/632: creat d0/d1/d27/d6e/fc7 x:0 0 0 2023-12-08T20:27:57.379 INFO:tasks.workunit.client.1.smithi111.stdout:7/741: mkdir da/d5c/d59/df5 0 2023-12-08T20:27:57.382 INFO:tasks.workunit.client.1.smithi111.stdout:5/907: rmdir d3/d4/d7/d36 39 2023-12-08T20:27:57.383 INFO:tasks.workunit.client.1.smithi111.stdout:5/908: read - d3/d4/d7/d29/d30/f120 zero size 2023-12-08T20:27:57.385 INFO:tasks.workunit.client.1.smithi111.stdout:5/909: dread d3/d4/d7/d2c/fe2 [0,4194304] 0 2023-12-08T20:27:57.385 INFO:tasks.workunit.client.1.smithi111.stdout:5/910: fdatasync d3/d4/d7/d36/d82/db4/f102 0 2023-12-08T20:27:57.386 INFO:tasks.workunit.client.1.smithi111.stdout:2/727: rename d1/d29/d53/cb8 to d1/d29/d4e/ddc/d104/c10b 0 2023-12-08T20:27:57.387 INFO:tasks.workunit.client.1.smithi111.stdout:1/740: getdents d0/d6 0 2023-12-08T20:27:57.388 INFO:tasks.workunit.client.1.smithi111.stdout:1/741: write d0/d6/d33/d15/d51/d2e/d61/fbb [713199,116256] 0 2023-12-08T20:27:57.400 INFO:tasks.workunit.client.1.smithi111.stdout:8/851: unlink dd/d32/f58 0 2023-12-08T20:27:57.401 INFO:tasks.workunit.client.1.smithi111.stdout:6/633: creat d0/d1/d1e/db2/fc8 x:0 0 0 2023-12-08T20:27:57.402 INFO:tasks.workunit.client.1.smithi111.stdout:5/911: creat d3/d4/d7/d36/d64/d96/f135 x:0 0 0 2023-12-08T20:27:57.404 INFO:tasks.workunit.client.1.smithi111.stdout:5/912: read d3/d4/d7/d36/d82/ff6 [1813874,55978] 0 2023-12-08T20:27:57.405 INFO:tasks.workunit.client.1.smithi111.stdout:4/670: rename d8/da/db/d7f/d93/d91 to d8/dda 0 2023-12-08T20:27:57.405 INFO:tasks.workunit.client.1.smithi111.stdout:4/671: write d8/da/f25 [4684587,82411] 0 2023-12-08T20:27:57.406 INFO:tasks.workunit.client.1.smithi111.stdout:2/728: mknod d1/d1d/d55/c10c 0 2023-12-08T20:27:57.406 INFO:tasks.workunit.client.1.smithi111.stdout:2/729: dread - d1/dec/f105 zero size 2023-12-08T20:27:57.406 INFO:tasks.workunit.client.1.smithi111.stdout:7/742: dwrite da/d13/d9e/f4b [0,4194304] 0 2023-12-08T20:27:57.407 INFO:tasks.workunit.client.1.smithi111.stdout:1/742: dwrite d0/d6/d33/d15/d51/d2e/fa9 [0,4194304] 0 2023-12-08T20:27:57.408 INFO:tasks.workunit.client.1.smithi111.stdout:8/852: creat dd/d2d/d8b/f12e x:0 0 0 2023-12-08T20:27:57.410 INFO:tasks.workunit.client.1.smithi111.stdout:6/634: creat d0/d1/d1e/db2/da5/fc9 x:0 0 0 2023-12-08T20:27:57.410 INFO:tasks.workunit.client.1.smithi111.stdout:6/635: fsync d0/d1/f7 0 2023-12-08T20:27:57.412 INFO:tasks.workunit.client.1.smithi111.stdout:6/636: write d0/d1/d1e/db2/f7d [1304264,103401] 0 2023-12-08T20:27:57.412 INFO:tasks.workunit.client.1.smithi111.stdout:6/637: dread - d0/d1/d1e/db2/da5/fc9 zero size 2023-12-08T20:27:57.414 INFO:tasks.workunit.client.1.smithi111.stdout:5/913: symlink d3/d4/d7/d36/d82/db4/l136 0 2023-12-08T20:27:57.416 INFO:tasks.workunit.client.1.smithi111.stdout:4/672: dread d8/da/db/d7f/d93/d77/f87 [0,4194304] 0 2023-12-08T20:27:57.416 INFO:tasks.workunit.client.1.smithi111.stdout:7/743: creat da/d25/d3d/dc9/ff6 x:0 0 0 2023-12-08T20:27:57.416 INFO:tasks.workunit.client.1.smithi111.stdout:7/744: read - da/d13/ff4 zero size 2023-12-08T20:27:57.416 INFO:tasks.workunit.client.1.smithi111.stdout:7/745: read - da/d5c/d59/d61/fde zero size 2023-12-08T20:27:57.418 INFO:tasks.workunit.client.1.smithi111.stdout:4/673: dread d8/da/db/f8d [0,4194304] 0 2023-12-08T20:27:57.418 INFO:tasks.workunit.client.1.smithi111.stdout:4/674: readlink d8/d30/d97/lc7 0 2023-12-08T20:27:57.418 INFO:tasks.workunit.client.1.smithi111.stdout:4/675: chown d8/da/db/d7f/cb3 3501 1 2023-12-08T20:27:57.421 INFO:tasks.workunit.client.1.smithi111.stdout:8/853: creat dd/dc9/ddb/df9/f12f x:0 0 0 2023-12-08T20:27:57.421 INFO:tasks.workunit.client.1.smithi111.stdout:5/914: creat d3/d4/d4a/d21/f137 x:0 0 0 2023-12-08T20:27:57.422 INFO:tasks.workunit.client.1.smithi111.stdout:3/693: sync 2023-12-08T20:27:57.422 INFO:tasks.workunit.client.1.smithi111.stdout:9/819: sync 2023-12-08T20:27:57.422 INFO:tasks.workunit.client.1.smithi111.stdout:9/820: write d2/d8/dd/d56/f85 [4597620,72417] 0 2023-12-08T20:27:57.423 INFO:tasks.workunit.client.1.smithi111.stdout:1/743: dread d0/d6/d33/d15/d51/d2e/f5c [4194304,4194304] 0 2023-12-08T20:27:57.428 INFO:tasks.workunit.client.1.smithi111.stdout:5/915: mkdir d3/d8d/d138 0 2023-12-08T20:27:57.430 INFO:tasks.workunit.client.1.smithi111.stdout:8/854: mknod dd/d35/c130 0 2023-12-08T20:27:57.431 INFO:tasks.workunit.client.1.smithi111.stdout:3/694: getdents d2/d15/d17/d25/d4e 0 2023-12-08T20:27:57.432 INFO:tasks.workunit.client.1.smithi111.stdout:6/638: dwrite d0/d1/d1e/f9b [0,4194304] 0 2023-12-08T20:27:57.434 INFO:tasks.workunit.client.1.smithi111.stdout:8/855: write dd/d32/d3d/f85 [637308,102396] 0 2023-12-08T20:27:57.434 INFO:tasks.workunit.client.1.smithi111.stdout:8/856: stat dd/d32/f3e 0 2023-12-08T20:27:57.434 INFO:tasks.workunit.client.1.smithi111.stdout:8/857: write dd/d2d/f3a [1905281,120116] 0 2023-12-08T20:27:57.435 INFO:tasks.workunit.client.1.smithi111.stdout:1/744: link d0/d6/d33/d15/d51/d2e/l5a d0/d6/d47/l102 0 2023-12-08T20:27:57.435 INFO:tasks.workunit.client.1.smithi111.stdout:1/745: write d0/d6/d33/d15/d51/d5b/d5e/f9f [477193,45892] 0 2023-12-08T20:27:57.436 INFO:tasks.workunit.client.1.smithi111.stdout:1/746: truncate d0/d4d/feb 1023715 0 2023-12-08T20:27:57.437 INFO:tasks.workunit.client.1.smithi111.stdout:4/676: dread d8/da/db/fc [0,4194304] 0 2023-12-08T20:27:57.437 INFO:tasks.workunit.client.1.smithi111.stdout:4/677: write d8/d30/d7d/d9b/db2/f3d [4790838,50108] 0 2023-12-08T20:27:57.437 INFO:tasks.workunit.client.1.smithi111.stdout:4/678: readlink d8/d30/d7d/d9b/la1 0 2023-12-08T20:27:57.437 INFO:tasks.workunit.client.1.smithi111.stdout:5/916: symlink d3/d4/d7/d36/df2/l139 0 2023-12-08T20:27:57.438 INFO:tasks.workunit.client.1.smithi111.stdout:3/695: creat d2/d3/d13/d36/fdb x:0 0 0 2023-12-08T20:27:57.440 INFO:tasks.workunit.client.1.smithi111.stdout:7/746: dwrite da/d13/ff4 [0,4194304] 0 2023-12-08T20:27:57.440 INFO:tasks.workunit.client.1.smithi111.stdout:7/747: write da/d25/faf [5226463,36508] 0 2023-12-08T20:27:57.440 INFO:tasks.workunit.client.1.smithi111.stdout:7/748: chown da/d25/da9 63 1 2023-12-08T20:27:57.441 INFO:tasks.workunit.client.1.smithi111.stdout:6/639: mkdir d0/d1/d27/da1/dca 0 2023-12-08T20:27:57.441 INFO:tasks.workunit.client.1.smithi111.stdout:6/640: chown d0/d68/d95/d7a/fc4 609104 1 2023-12-08T20:27:57.441 INFO:tasks.workunit.client.1.smithi111.stdout:2/730: dwrite d1/d1d/d22/fff [0,4194304] 0 2023-12-08T20:27:57.441 INFO:tasks.workunit.client.1.smithi111.stdout:9/821: dwrite d2/d8/dd/d1a/d74/f82 [4194304,4194304] 0 2023-12-08T20:27:57.443 INFO:tasks.workunit.client.1.smithi111.stdout:9/822: read d2/da/f50 [2494956,18328] 0 2023-12-08T20:27:57.445 INFO:tasks.workunit.client.1.smithi111.stdout:8/858: truncate dd/d2d/f33 313023 0 2023-12-08T20:27:57.446 INFO:tasks.workunit.client.1.smithi111.stdout:7/749: write da/d25/f3b [437734,55307] 0 2023-12-08T20:27:57.448 INFO:tasks.workunit.client.1.smithi111.stdout:1/747: mkdir d0/d6/d33/d15/d51/d5b/d59/db8/d103 0 2023-12-08T20:27:57.448 INFO:tasks.workunit.client.1.smithi111.stdout:1/748: write d0/d4d/fb1 [160678,100858] 0 2023-12-08T20:27:57.451 INFO:tasks.workunit.client.1.smithi111.stdout:4/679: rename f6 to d8/d30/d7d/d9b/db2/fdb 0 2023-12-08T20:27:57.451 INFO:tasks.workunit.client.1.smithi111.stdout:4/680: truncate d8/da/db/f6b 1829841 0 2023-12-08T20:27:57.451 INFO:tasks.workunit.client.1.smithi111.stdout:4/681: chown d8/d30/l54 764988 1 2023-12-08T20:27:57.454 INFO:tasks.workunit.client.1.smithi111.stdout:5/917: symlink d3/d4/d4a/d21/dea/l13a 0 2023-12-08T20:27:57.458 INFO:tasks.workunit.client.1.smithi111.stdout:3/696: symlink d2/d15/d17/d5e/d62/ldc 0 2023-12-08T20:27:57.464 INFO:tasks.workunit.client.1.smithi111.stdout:9/823: chown d2/d8/dd/d1a/d74/dbf/fc2 1906192 1 2023-12-08T20:27:57.467 INFO:tasks.workunit.client.1.smithi111.stdout:8/859: dwrite dd/d35/d42/fa5 [4194304,4194304] 0 2023-12-08T20:27:57.468 INFO:tasks.workunit.client.1.smithi111.stdout:8/860: write dd/d32/d3d/f44 [3266993,89981] 0 2023-12-08T20:27:57.468 INFO:tasks.workunit.client.1.smithi111.stdout:8/861: chown dd/d35 44871251 1 2023-12-08T20:27:57.469 INFO:tasks.workunit.client.1.smithi111.stdout:6/641: dwrite d0/d1/d27/d56/f76 [4194304,4194304] 0 2023-12-08T20:27:57.469 INFO:tasks.workunit.client.1.smithi111.stdout:8/862: read dd/d35/d42/f104 [93787,7683] 0 2023-12-08T20:27:57.469 INFO:tasks.workunit.client.1.smithi111.stdout:8/863: chown dd/d32/dea/df1/f108 10 1 2023-12-08T20:27:57.469 INFO:tasks.workunit.client.1.smithi111.stdout:1/749: mknod d0/d6/d33/d15/d51/d5b/d59/c104 0 2023-12-08T20:27:57.469 INFO:tasks.workunit.client.1.smithi111.stdout:6/642: read d0/d1/d27/d56/f76 [5317647,94689] 0 2023-12-08T20:27:57.470 INFO:tasks.workunit.client.1.smithi111.stdout:6/643: readlink d0/d1/d1e/l53 0 2023-12-08T20:27:57.471 INFO:tasks.workunit.client.1.smithi111.stdout:5/918: creat d3/f13b x:0 0 0 2023-12-08T20:27:57.471 INFO:tasks.workunit.client.1.smithi111.stdout:7/750: dread da/d25/d26/f41 [0,4194304] 0 2023-12-08T20:27:57.472 INFO:tasks.workunit.client.1.smithi111.stdout:3/697: symlink d2/d15/d17/d5e/d62/ldd 0 2023-12-08T20:27:57.474 INFO:tasks.workunit.client.1.smithi111.stdout:9/824: mknod d2/d8/dd/d1a/d74/c120 0 2023-12-08T20:27:57.479 INFO:tasks.workunit.client.1.smithi111.stdout:4/682: dwrite d8/f15 [0,4194304] 0 2023-12-08T20:27:57.482 INFO:tasks.workunit.client.1.smithi111.stdout:1/750: creat d0/d6/f105 x:0 0 0 2023-12-08T20:27:57.486 INFO:tasks.workunit.client.1.smithi111.stdout:9/825: dread d2/d8/dd/d1a/d1e/d2d/d35/f95 [0,4194304] 0 2023-12-08T20:27:57.494 INFO:tasks.workunit.client.1.smithi111.stdout:6/644: dwrite d0/d1/d1e/db2/f72 [0,4194304] 0 2023-12-08T20:27:57.499 INFO:tasks.workunit.client.1.smithi111.stdout:4/683: creat d8/da/db/d7f/d93/fdc x:0 0 0 2023-12-08T20:27:57.500 INFO:tasks.workunit.client.1.smithi111.stdout:8/864: mknod dd/d32/d36/c131 0 2023-12-08T20:27:57.500 INFO:tasks.workunit.client.1.smithi111.stdout:5/919: rmdir d3 39 2023-12-08T20:27:57.501 INFO:tasks.workunit.client.1.smithi111.stdout:5/920: write d3/d4/d7/d29/d73/d90/f117 [947589,58854] 0 2023-12-08T20:27:57.501 INFO:tasks.workunit.client.1.smithi111.stdout:5/921: write d3/d4/d4a/d21/faa [1151866,10670] 0 2023-12-08T20:27:57.502 INFO:tasks.workunit.client.1.smithi111.stdout:7/751: dwrite da/d25/f3b [0,4194304] 0 2023-12-08T20:27:57.502 INFO:tasks.workunit.client.1.smithi111.stdout:7/752: write da/d5c/d59/fbc [930204,10129] 0 2023-12-08T20:27:57.502 INFO:tasks.workunit.client.1.smithi111.stdout:7/753: dread - da/d5c/d6e/fdb zero size 2023-12-08T20:27:57.502 INFO:tasks.workunit.client.1.smithi111.stdout:9/826: mkdir d2/d8/dd/d56/da1/d121 0 2023-12-08T20:27:57.503 INFO:tasks.workunit.client.1.smithi111.stdout:1/751: dwrite d0/f2 [0,4194304] 0 2023-12-08T20:27:57.503 INFO:tasks.workunit.client.1.smithi111.stdout:6/645: creat d0/d1/d27/da1/fcb x:0 0 0 2023-12-08T20:27:57.504 INFO:tasks.workunit.client.1.smithi111.stdout:4/684: symlink d8/da/d29/d5c/dca/ldd 0 2023-12-08T20:27:57.504 INFO:tasks.workunit.client.1.smithi111.stdout:4/685: chown d8/d30/d7d/d9b 0 1 2023-12-08T20:27:57.508 INFO:tasks.workunit.client.1.smithi111.stdout:5/922: link d3/d4/d4a/fcf d3/d4/d7/d36/df2/f13c 0 2023-12-08T20:27:57.508 INFO:tasks.workunit.client.1.smithi111.stdout:5/923: fdatasync d3/d4/d7/d29/dd6/d122/f129 0 2023-12-08T20:27:57.512 INFO:tasks.workunit.client.1.smithi111.stdout:7/754: rename da/d25/da9/db8/c88 to da/cf7 0 2023-12-08T20:27:57.512 INFO:tasks.workunit.client.1.smithi111.stdout:7/755: readlink da/d25/d26/d32/la8 0 2023-12-08T20:27:57.513 INFO:tasks.workunit.client.1.smithi111.stdout:1/752: mknod d0/d6/d33/d15/d51/d5b/d5e/d86/c106 0 2023-12-08T20:27:57.515 INFO:tasks.workunit.client.1.smithi111.stdout:6/646: mknod d0/d1/d27/d36/d97/ccc 0 2023-12-08T20:27:57.515 INFO:tasks.workunit.client.1.smithi111.stdout:6/647: truncate d0/d1/f6 2288104 0 2023-12-08T20:27:57.515 INFO:tasks.workunit.client.1.smithi111.stdout:6/648: write d0/d68/d95/f35 [2200810,128175] 0 2023-12-08T20:27:57.516 INFO:tasks.workunit.client.1.smithi111.stdout:8/865: dwrite dd/dc9/ddb/df9/f110 [0,4194304] 0 2023-12-08T20:27:57.517 INFO:tasks.workunit.client.1.smithi111.stdout:4/686: mkdir d8/d30/d7d/d9b/db2/d4b/dd1/dde 0 2023-12-08T20:27:57.518 INFO:tasks.workunit.client.1.smithi111.stdout:5/924: creat d3/d4/d7/f13d x:0 0 0 2023-12-08T20:27:57.520 INFO:tasks.workunit.client.1.smithi111.stdout:9/827: rename d2/d8/c83 to d2/d8/dd/d1a/d1e/d114/c122 0 2023-12-08T20:27:57.531 INFO:tasks.workunit.client.1.smithi111.stdout:6/649: symlink d0/d1/d27/d6e/lcd 0 2023-12-08T20:27:57.531 INFO:tasks.workunit.client.1.smithi111.stdout:4/687: write d8/f18 [1330970,52767] 0 2023-12-08T20:27:57.534 INFO:tasks.workunit.client.1.smithi111.stdout:1/753: dwrite d0/d6/f28 [0,4194304] 0 2023-12-08T20:27:57.535 INFO:tasks.workunit.client.1.smithi111.stdout:6/650: dread d0/d1/f6 [0,4194304] 0 2023-12-08T20:27:57.537 INFO:tasks.workunit.client.1.smithi111.stdout:7/756: rename da/d25/da9/db8/fca to da/d25/d26/d32/dcd/ff8 0 2023-12-08T20:27:57.538 INFO:tasks.workunit.client.1.smithi111.stdout:7/757: write da/d25/da9/fdc [793730,123240] 0 2023-12-08T20:27:57.538 INFO:tasks.workunit.client.1.smithi111.stdout:7/758: truncate da/d25/d26/d32/f8e 1046511 0 2023-12-08T20:27:57.540 INFO:tasks.workunit.client.1.smithi111.stdout:1/754: rename d0/f2d to d0/d8e/dd4/dfc/f107 0 2023-12-08T20:27:57.542 INFO:tasks.workunit.client.1.smithi111.stdout:7/759: creat da/d25/d3d/ff9 x:0 0 0 2023-12-08T20:27:57.545 INFO:tasks.workunit.client.1.smithi111.stdout:1/755: unlink d0/d6/d33/d15/d51/d2e/l5a 0 2023-12-08T20:27:57.545 INFO:tasks.workunit.client.1.smithi111.stdout:7/760: mknod da/d5c/cfa 0 2023-12-08T20:27:57.545 INFO:tasks.workunit.client.1.smithi111.stdout:7/761: chown da/d25/da9/fd8 6 1 2023-12-08T20:27:57.545 INFO:tasks.workunit.client.1.smithi111.stdout:7/762: truncate da/fd0 1518755 0 2023-12-08T20:27:57.546 INFO:tasks.workunit.client.1.smithi111.stdout:7/763: chown da/d25/d26/d32/d87/ce7 939 1 2023-12-08T20:27:57.548 INFO:tasks.workunit.client.1.smithi111.stdout:7/764: unlink da/d25/d3d/f85 0 2023-12-08T20:27:57.549 INFO:tasks.workunit.client.1.smithi111.stdout:7/765: truncate da/d5c/d59/d61/fb1 372156 0 2023-12-08T20:27:57.551 INFO:tasks.workunit.client.1.smithi111.stdout:1/756: write d0/d22/f23 [2234309,13354] 0 2023-12-08T20:27:57.551 INFO:tasks.workunit.client.1.smithi111.stdout:1/757: getdents d0/d6/d33/d15/d51 0 2023-12-08T20:27:57.551 INFO:tasks.workunit.client.1.smithi111.stdout:1/758: chown d0/d8e/dd4/dfc 31827 1 2023-12-08T20:27:57.551 INFO:tasks.workunit.client.1.smithi111.stdout:1/759: dread - d0/d6/d33/d60/f85 zero size 2023-12-08T20:27:57.551 INFO:tasks.workunit.client.1.smithi111.stdout:1/760: dread - d0/d6/d33/d8b/db5/fd1 zero size 2023-12-08T20:27:57.551 INFO:tasks.workunit.client.1.smithi111.stdout:1/761: dread - d0/d6/d33/d15/d51/d2e/d61/fdd zero size 2023-12-08T20:27:57.553 INFO:tasks.workunit.client.1.smithi111.stdout:1/762: unlink d0/d4d/lf3 0 2023-12-08T20:27:57.553 INFO:tasks.workunit.client.1.smithi111.stdout:1/763: getdents d0/d8e/db6/def 0 2023-12-08T20:27:57.553 INFO:tasks.workunit.client.1.smithi111.stdout:1/764: write d0/d6/d33/d60/f9e [439025,30701] 0 2023-12-08T20:27:57.553 INFO:tasks.workunit.client.1.smithi111.stdout:1/765: chown d0/c1e 140467094 1 2023-12-08T20:27:57.583 INFO:tasks.workunit.client.1.smithi111.stdout:8/866: dwrite dd/d32/dea/fb1 [0,4194304] 0 2023-12-08T20:27:57.585 INFO:tasks.workunit.client.1.smithi111.stdout:5/925: dwrite d3/d12/d104/f10b [0,4194304] 0 2023-12-08T20:27:57.586 INFO:tasks.workunit.client.1.smithi111.stdout:5/926: dread d3/f6e [0,4194304] 0 2023-12-08T20:27:57.590 INFO:tasks.workunit.client.1.smithi111.stdout:7/766: dread da/d25/f4a [0,4194304] 0 2023-12-08T20:27:57.590 INFO:tasks.workunit.client.1.smithi111.stdout:7/767: write da/d25/d26/d32/dcd/fd2 [841023,123379] 0 2023-12-08T20:27:57.591 INFO:tasks.workunit.client.1.smithi111.stdout:5/927: getdents d3/d4 0 2023-12-08T20:27:57.591 INFO:tasks.workunit.client.1.smithi111.stdout:5/928: chown d3/d4/d7/d36/d64/d96/cfc 33690752 1 2023-12-08T20:27:57.592 INFO:tasks.workunit.client.1.smithi111.stdout:6/651: dwrite d0/d1/d27/d56/f76 [0,4194304] 0 2023-12-08T20:27:57.593 INFO:tasks.workunit.client.1.smithi111.stdout:8/867: write dd/f1f [11529614,98026] 0 2023-12-08T20:27:57.593 INFO:tasks.workunit.client.1.smithi111.stdout:7/768: read da/d25/d26/f4d [1606013,115772] 0 2023-12-08T20:27:57.595 INFO:tasks.workunit.client.1.smithi111.stdout:4/688: dwrite d8/da/d29/d6e/fc0 [0,4194304] 0 2023-12-08T20:27:57.595 INFO:tasks.workunit.client.1.smithi111.stdout:9/828: dwrite d2/d8/d8c/f102 [0,4194304] 0 2023-12-08T20:27:57.595 INFO:tasks.workunit.client.1.smithi111.stdout:9/829: chown d2/l55 102212301 1 2023-12-08T20:27:57.595 INFO:tasks.workunit.client.1.smithi111.stdout:9/830: truncate d2/d8/d8c/dbb/f108 631870 0 2023-12-08T20:27:57.596 INFO:tasks.workunit.client.1.smithi111.stdout:6/652: creat d0/d68/fce x:0 0 0 2023-12-08T20:27:57.596 INFO:tasks.workunit.client.1.smithi111.stdout:9/831: write d2/d8/dd/d1a/d1e/d2d/d35/d88/f99 [1493212,107888] 0 2023-12-08T20:27:57.597 INFO:tasks.workunit.client.1.smithi111.stdout:8/868: creat dd/d96/f132 x:0 0 0 2023-12-08T20:27:57.598 INFO:tasks.workunit.client.1.smithi111.stdout:1/766: dwrite d0/d6/d33/d15/d51/d2e/d61/f93 [0,4194304] 0 2023-12-08T20:27:57.598 INFO:tasks.workunit.client.1.smithi111.stdout:1/767: chown d0/d6/d33/d15/d51/d5b/d5e/d86/dbd/cec 2 1 2023-12-08T20:27:57.599 INFO:tasks.workunit.client.1.smithi111.stdout:1/768: read d0/d6/d33/d15/d51/d2e/d61/d79/f90 [94045,93339] 0 2023-12-08T20:27:57.602 INFO:tasks.workunit.client.1.smithi111.stdout:4/689: mknod d8/d30/d7d/d9b/db2/d4b/dd1/dde/cdf 0 2023-12-08T20:27:57.609 INFO:tasks.workunit.client.1.smithi111.stdout:9/832: dread d2/d8/dd/f6c [0,4194304] 0 2023-12-08T20:27:57.611 INFO:tasks.workunit.client.1.smithi111.stdout:5/929: dwrite d3/d4/d7/d36/d64/fc1 [0,4194304] 0 2023-12-08T20:27:57.612 INFO:tasks.workunit.client.1.smithi111.stdout:5/930: chown d3/f13b 74 1 2023-12-08T20:27:57.612 INFO:tasks.workunit.client.1.smithi111.stdout:7/769: dwrite da/d25/da9/db8/f67 [4194304,4194304] 0 2023-12-08T20:27:57.616 INFO:tasks.workunit.client.1.smithi111.stdout:6/653: mknod d0/d1/d1e/db2/ccf 0 2023-12-08T20:27:57.617 INFO:tasks.workunit.client.1.smithi111.stdout:8/869: creat dd/d35/d7a/f133 x:0 0 0 2023-12-08T20:27:57.617 INFO:tasks.workunit.client.1.smithi111.stdout:8/870: stat dd/d2d/d62/lc4 0 2023-12-08T20:27:57.621 INFO:tasks.workunit.client.1.smithi111.stdout:2/731: sync 2023-12-08T20:27:57.622 INFO:tasks.workunit.client.1.smithi111.stdout:2/732: stat d1/d29/d53/c8c 0 2023-12-08T20:27:57.623 INFO:tasks.workunit.client.1.smithi111.stdout:1/769: mknod d0/d6/d33/d15/d51/d5b/d59/db8/c108 0 2023-12-08T20:27:57.627 INFO:tasks.workunit.client.1.smithi111.stdout:4/690: rename d8/d30/d97/fd3 to d8/da/d29/d5c/fe0 0 2023-12-08T20:27:57.627 INFO:tasks.workunit.client.1.smithi111.stdout:9/833: stat d2/l55 0 2023-12-08T20:27:57.630 INFO:tasks.workunit.client.1.smithi111.stdout:4/691: write d8/da/f25 [3752448,69855] 0 2023-12-08T20:27:57.635 INFO:tasks.workunit.client.1.smithi111.stdout:8/871: dwrite dd/d35/d7a/ffb [0,4194304] 0 2023-12-08T20:27:57.635 INFO:tasks.workunit.client.1.smithi111.stdout:8/872: write dd/d35/d7a/fa0 [753169,65127] 0 2023-12-08T20:27:57.635 INFO:tasks.workunit.client.1.smithi111.stdout:8/873: fdatasync dd/d2d/d62/d83/fcf 0 2023-12-08T20:27:57.638 INFO:tasks.workunit.client.1.smithi111.stdout:5/931: creat d3/d4/d7/d29/dd6/d122/f13e x:0 0 0 2023-12-08T20:27:57.638 INFO:tasks.workunit.client.1.smithi111.stdout:5/932: read d3/d4/d7/d2c/f41 [138670,42218] 0 2023-12-08T20:27:57.641 INFO:tasks.workunit.client.1.smithi111.stdout:9/834: dread d2/d8/f40 [0,4194304] 0 2023-12-08T20:27:57.641 INFO:tasks.workunit.client.1.smithi111.stdout:9/835: fsync d2/d8/dd/d56/fa0 0 2023-12-08T20:27:57.641 INFO:tasks.workunit.client.1.smithi111.stdout:9/836: chown d2/d8/d8c/f94 4968 1 2023-12-08T20:27:57.642 INFO:tasks.workunit.client.1.smithi111.stdout:7/770: symlink da/lfb 0 2023-12-08T20:27:57.642 INFO:tasks.workunit.client.1.smithi111.stdout:6/654: dwrite d0/daa/fc5 [0,4194304] 0 2023-12-08T20:27:57.645 INFO:tasks.workunit.client.1.smithi111.stdout:2/733: creat d1/d29/d53/d91/dce/f10d x:0 0 0 2023-12-08T20:27:57.645 INFO:tasks.workunit.client.1.smithi111.stdout:2/734: readlink d1/d1d/d1f/d25/d3d/d56/d101/de4/lfc 0 2023-12-08T20:27:57.645 INFO:tasks.workunit.client.1.smithi111.stdout:1/770: creat d0/d6/d33/d15/d51/d2e/d61/f109 x:0 0 0 2023-12-08T20:27:57.646 INFO:tasks.workunit.client.1.smithi111.stdout:4/692: mknod d8/d30/ce1 0 2023-12-08T20:27:57.658 INFO:tasks.workunit.client.1.smithi111.stdout:8/874: creat dd/d2d/d62/d83/f134 x:0 0 0 2023-12-08T20:27:57.662 INFO:tasks.workunit.client.1.smithi111.stdout:9/837: symlink d2/d8/dd/d1a/d1e/d2d/d35/d88/l123 0 2023-12-08T20:27:57.662 INFO:tasks.workunit.client.1.smithi111.stdout:9/838: chown d2/d8/dd/d1a/d1e/d2d/d4a/f5a 225418 1 2023-12-08T20:27:57.663 INFO:tasks.workunit.client.1.smithi111.stdout:7/771: dwrite da/d25/d26/f98 [4194304,4194304] 0 2023-12-08T20:27:57.663 INFO:tasks.workunit.client.1.smithi111.stdout:1/771: dwrite d0/d4d/f6f [0,4194304] 0 2023-12-08T20:27:57.666 INFO:tasks.workunit.client.1.smithi111.stdout:6/655: mkdir d0/d68/d95/d7a/dd0 0 2023-12-08T20:27:57.666 INFO:tasks.workunit.client.1.smithi111.stdout:3/698: sync 2023-12-08T20:27:57.667 INFO:tasks.workunit.client.1.smithi111.stdout:2/735: creat d1/d1d/d1f/d25/d67/f10e x:0 0 0 2023-12-08T20:27:57.668 INFO:tasks.workunit.client.1.smithi111.stdout:6/656: dread d0/d1/d27/f5d [0,4194304] 0 2023-12-08T20:27:57.668 INFO:tasks.workunit.client.1.smithi111.stdout:6/657: fsync d0/d68/d95/f35 0 2023-12-08T20:27:57.668 INFO:tasks.workunit.client.1.smithi111.stdout:6/658: chown d0/d1/f65 366289957 1 2023-12-08T20:27:57.668 INFO:tasks.workunit.client.1.smithi111.stdout:6/659: dread - d0/d68/d95/d7a/fc4 zero size 2023-12-08T20:27:57.668 INFO:tasks.workunit.client.1.smithi111.stdout:6/660: getdents d0/d1/d27/d56 0 2023-12-08T20:27:57.669 INFO:tasks.workunit.client.1.smithi111.stdout:4/693: mknod d8/da/db/ce2 0 2023-12-08T20:27:57.669 INFO:tasks.workunit.client.1.smithi111.stdout:4/694: write d8/dda/fa4 [987496,20061] 0 2023-12-08T20:27:57.674 INFO:tasks.workunit.client.1.smithi111.stdout:8/875: creat dd/d2d/d62/d83/f135 x:0 0 0 2023-12-08T20:27:57.675 INFO:tasks.workunit.client.1.smithi111.stdout:9/839: rmdir d2/d8/dd/d1a/d1e/d114 39 2023-12-08T20:27:57.678 INFO:tasks.workunit.client.1.smithi111.stdout:1/772: mkdir d0/d6/d33/d15/d51/d5b/d5e/da0/d10a 0 2023-12-08T20:27:57.678 INFO:tasks.workunit.client.1.smithi111.stdout:1/773: write d0/d6/d33/d15/d51/d2e/d61/f109 [514718,31286] 0 2023-12-08T20:27:57.679 INFO:tasks.workunit.client.1.smithi111.stdout:3/699: mknod d2/d3/d13/d36/d44/d8f/da7/cde 0 2023-12-08T20:27:57.681 INFO:tasks.workunit.client.1.smithi111.stdout:2/736: rename d1/dec/f109 to d1/d1d/d1f/d25/d3d/f10f 0 2023-12-08T20:27:57.682 INFO:tasks.workunit.client.1.smithi111.stdout:6/661: mknod d0/d1/d27/d36/d97/cd1 0 2023-12-08T20:27:57.683 INFO:tasks.workunit.client.1.smithi111.stdout:4/695: rmdir d8/d30/d7d/d9b/db2/d4b/dd1/dde 39 2023-12-08T20:27:57.684 INFO:tasks.workunit.client.1.smithi111.stdout:4/696: write d8/da/d29/d6e/fc0 [3621487,38629] 0 2023-12-08T20:27:57.685 INFO:tasks.workunit.client.1.smithi111.stdout:9/840: link d2/d8/dd/d1a/d1e/d2d/db9/dd5/dfb/c111 d2/d8/dd/d1a/d1e/d2d/d4a/d62/c124 0 2023-12-08T20:27:57.686 INFO:tasks.workunit.client.1.smithi111.stdout:4/697: write d8/d30/d7d/d9b/db2/f3e [1817802,5004] 0 2023-12-08T20:27:57.686 INFO:tasks.workunit.client.1.smithi111.stdout:9/841: write d2/f7 [3087589,126633] 0 2023-12-08T20:27:57.689 INFO:tasks.workunit.client.1.smithi111.stdout:7/772: link da/d25/d3d/dc9/fba da/d5c/d59/df2/ffc 0 2023-12-08T20:27:57.694 INFO:tasks.workunit.client.1.smithi111.stdout:3/700: dwrite d2/d15/d17/d25/d4e/f61 [0,4194304] 0 2023-12-08T20:27:57.694 INFO:tasks.workunit.client.1.smithi111.stdout:1/774: mknod d0/d6/c10b 0 2023-12-08T20:27:57.696 INFO:tasks.workunit.client.1.smithi111.stdout:2/737: mknod d1/d1d/d1f/d25/d3d/d56/c110 0 2023-12-08T20:27:57.696 INFO:tasks.workunit.client.1.smithi111.stdout:6/662: creat d0/d1/d27/fd2 x:0 0 0 2023-12-08T20:27:57.699 INFO:tasks.workunit.client.1.smithi111.stdout:4/698: rename d8/dda/fc2 to d8/d30/d7d/d9b/db2/d4b/dd1/d1f/d40/fe3 0 2023-12-08T20:27:57.700 INFO:tasks.workunit.client.1.smithi111.stdout:9/842: write d2/d8/dd/d56/f73 [1338843,89850] 0 2023-12-08T20:27:57.700 INFO:tasks.workunit.client.1.smithi111.stdout:9/843: write d2/d8/dd/d1a/d1e/d2d/d4a/d62/fcf [506842,61202] 0 2023-12-08T20:27:57.700 INFO:tasks.workunit.client.1.smithi111.stdout:9/844: fsync d2/d8/dd/d1a/ff4 0 2023-12-08T20:27:57.702 INFO:tasks.workunit.client.1.smithi111.stdout:7/773: dwrite da/d5c/d59/d61/fb1 [0,4194304] 0 2023-12-08T20:27:57.703 INFO:tasks.workunit.client.1.smithi111.stdout:3/701: creat d2/d3/d13/d36/d69/d70/fdf x:0 0 0 2023-12-08T20:27:57.703 INFO:tasks.workunit.client.1.smithi111.stdout:3/702: chown d2/d3/d51 2301096 1 2023-12-08T20:27:57.704 INFO:tasks.workunit.client.1.smithi111.stdout:1/775: symlink d0/d6/d33/d15/d51/d2e/d61/d79/l10c 0 2023-12-08T20:27:57.705 INFO:tasks.workunit.client.1.smithi111.stdout:2/738: truncate d1/d1d/d22/f39 1651022 0 2023-12-08T20:27:57.705 INFO:tasks.workunit.client.1.smithi111.stdout:2/739: fdatasync d1/d1d/d1f/d36/d92/fb2 0 2023-12-08T20:27:57.707 INFO:tasks.workunit.client.1.smithi111.stdout:6/663: link d0/d1/d27/f87 d0/d68/da9/fd3 0 2023-12-08T20:27:57.709 INFO:tasks.workunit.client.1.smithi111.stdout:4/699: symlink d8/d30/d7d/d9b/le4 0 2023-12-08T20:27:57.711 INFO:tasks.workunit.client.1.smithi111.stdout:9/845: rmdir d2/d8/dd/d56 39 2023-12-08T20:27:57.711 INFO:tasks.workunit.client.1.smithi111.stdout:9/846: readlink d2/d8/dd/d1a/d1e/d2d/l92 0 2023-12-08T20:27:57.712 INFO:tasks.workunit.client.1.smithi111.stdout:3/703: dread d2/fa [0,4194304] 0 2023-12-08T20:27:57.713 INFO:tasks.workunit.client.1.smithi111.stdout:4/700: dread d8/d30/d7d/d9b/db2/d4b/f53 [0,4194304] 0 2023-12-08T20:27:57.713 INFO:tasks.workunit.client.1.smithi111.stdout:4/701: dread - d8/d30/d7d/d9b/db2/d4b/dd1/fc5 zero size 2023-12-08T20:27:57.713 INFO:tasks.workunit.client.1.smithi111.stdout:7/774: symlink da/d5c/d59/lfd 0 2023-12-08T20:27:57.715 INFO:tasks.workunit.client.1.smithi111.stdout:1/776: mkdir d0/d8e/db0/d10d 0 2023-12-08T20:27:57.715 INFO:tasks.workunit.client.1.smithi111.stdout:1/777: chown d0/d8e/dd4 528 1 2023-12-08T20:27:57.715 INFO:tasks.workunit.client.1.smithi111.stdout:1/778: chown d0/d6/d33/l2b 121728 1 2023-12-08T20:27:57.718 INFO:tasks.workunit.client.1.smithi111.stdout:6/664: symlink d0/d1/d27/d6e/ld4 0 2023-12-08T20:27:57.719 INFO:tasks.workunit.client.1.smithi111.stdout:6/665: fsync d0/f13 0 2023-12-08T20:27:57.720 INFO:tasks.workunit.client.1.smithi111.stdout:9/847: dread d2/d8/dd/d1a/d1e/f54 [0,4194304] 0 2023-12-08T20:27:57.720 INFO:tasks.workunit.client.1.smithi111.stdout:9/848: stat d2/d8/dd/d1a/d74/f8e 0 2023-12-08T20:27:57.720 INFO:tasks.workunit.client.1.smithi111.stdout:3/704: rename d2/d15/d17/d25/d4e to d2/d15/d17/d25/de0 0 2023-12-08T20:27:57.720 INFO:tasks.workunit.client.1.smithi111.stdout:6/666: write d0/d68/d95/f35 [1361426,60117] 0 2023-12-08T20:27:57.721 INFO:tasks.workunit.client.1.smithi111.stdout:4/702: getdents d8 0 2023-12-08T20:27:57.722 INFO:tasks.workunit.client.1.smithi111.stdout:7/775: rmdir da 39 2023-12-08T20:27:57.724 INFO:tasks.workunit.client.1.smithi111.stdout:1/779: rmdir d0/d8e/dd4/dfc 39 2023-12-08T20:27:57.724 INFO:tasks.workunit.client.1.smithi111.stdout:1/780: fdatasync d0/d6/d33/d15/d51/d78/f80 0 2023-12-08T20:27:57.724 INFO:tasks.workunit.client.1.smithi111.stdout:1/781: write d0/d6/d33/d60/f85 [491365,27989] 0 2023-12-08T20:27:57.724 INFO:tasks.workunit.client.1.smithi111.stdout:1/782: fsync d0/d6/d33/d60/fe1 0 2023-12-08T20:27:57.726 INFO:tasks.workunit.client.1.smithi111.stdout:3/705: symlink d2/d3/d13/d36/d44/daa/le1 0 2023-12-08T20:27:57.726 INFO:tasks.workunit.client.1.smithi111.stdout:6/667: creat d0/d1/d27/d36/d97/db4/fd5 x:0 0 0 2023-12-08T20:27:57.726 INFO:tasks.workunit.client.0.smithi043.stderr:++ readlink -f fsstress 2023-12-08T20:27:57.727 INFO:tasks.workunit.client.0.smithi043.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-08T20:27:57.727 INFO:tasks.workunit.client.0.smithi043.stderr:+ popd 2023-12-08T20:27:57.728 INFO:tasks.workunit.client.1.smithi111.stdout:4/703: unlink d8/da/f25 0 2023-12-08T20:27:57.728 INFO:tasks.workunit.client.1.smithi111.stdout:4/704: chown d8/c37 11678386 1 2023-12-08T20:27:57.729 INFO:tasks.workunit.client.1.smithi111.stdout:2/740: write d1/d1d/d22/f39 [2273911,91729] 0 2023-12-08T20:27:57.730 INFO:tasks.workunit.client.1.smithi111.stdout:3/706: mknod d2/d15/d17/d5e/d9f/ce2 0 2023-12-08T20:27:57.735 INFO:tasks.workunit.client.1.smithi111.stdout:6/668: creat d0/daa/fd6 x:0 0 0 2023-12-08T20:27:57.737 INFO:tasks.workunit.client.1.smithi111.stdout:4/705: mknod d8/da/d29/d5c/dbe/ce5 0 2023-12-08T20:27:57.738 INFO:tasks.workunit.client.0.smithi043.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-08T20:27:57.738 INFO:tasks.workunit.client.0.smithi043.stdout:~/cephtest/mnt.0/client.0/tmp 2023-12-08T20:27:57.738 INFO:tasks.workunit.client.0.smithi043.stderr:+ popd 2023-12-08T20:27:57.738 INFO:tasks.workunit.client.0.smithi043.stderr:++ mktemp -d -p . 2023-12-08T20:27:57.739 INFO:tasks.workunit.client.1.smithi111.stdout:1/783: dread d0/d22/f45 [0,4194304] 0 2023-12-08T20:27:57.740 INFO:tasks.workunit.client.1.smithi111.stdout:4/706: write d8/d30/d7d/d9b/db2/d4b/dd1/d1f/d40/f44 [3349976,49802] 0 2023-12-08T20:27:57.740 INFO:tasks.workunit.client.1.smithi111.stdout:2/741: mkdir d1/d1d/d1f/dc1/d111 0 2023-12-08T20:27:57.741 INFO:tasks.workunit.client.0.smithi043.stderr:+ T=./tmp.YuwGLmRq71 2023-12-08T20:27:57.741 INFO:tasks.workunit.client.0.smithi043.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.YuwGLmRq71 -l 1 -n 1000 -p 10 -v 2023-12-08T20:27:57.743 INFO:tasks.workunit.client.0.smithi043.stdout:seed = 1702374311 2023-12-08T20:27:57.743 INFO:tasks.workunit.client.1.smithi111.stdout:1/784: creat d0/d6/d33/d15/d51/d5b/d5e/f10e x:0 0 0 2023-12-08T20:27:57.743 INFO:tasks.workunit.client.1.smithi111.stdout:1/785: write d0/f2f [1580999,59323] 0 2023-12-08T20:27:57.745 INFO:tasks.workunit.client.1.smithi111.stdout:1/786: read d0/d6/d33/d15/d51/d78/f95 [178182,121609] 0 2023-12-08T20:27:57.746 INFO:tasks.workunit.client.1.smithi111.stdout:4/707: creat d8/da/db/d7f/d8e/fe6 x:0 0 0 2023-12-08T20:27:57.746 INFO:tasks.workunit.client.1.smithi111.stdout:2/742: read d1/f13 [7254547,20780] 0 2023-12-08T20:27:57.746 INFO:tasks.workunit.client.1.smithi111.stdout:6/669: dread d0/f20 [0,4194304] 0 2023-12-08T20:27:57.746 INFO:tasks.workunit.client.1.smithi111.stdout:6/670: chown d0/d1/d27/d36/c59 278141661 1 2023-12-08T20:27:57.747 INFO:tasks.workunit.client.0.smithi043.stdout:2/0: chown . 257 1 2023-12-08T20:27:57.747 INFO:tasks.workunit.client.0.smithi043.stdout:2/1: unlink - no file 2023-12-08T20:27:57.747 INFO:tasks.workunit.client.0.smithi043.stdout:2/2: dwrite - no filename 2023-12-08T20:27:57.747 INFO:tasks.workunit.client.0.smithi043.stdout:2/3: chown . 4487 1 2023-12-08T20:27:57.747 INFO:tasks.workunit.client.0.smithi043.stdout:0/0: creat f0 x:0 0 0 2023-12-08T20:27:57.748 INFO:tasks.workunit.client.1.smithi111.stdout:1/787: mknod d0/d6/d33/d15/d51/d5b/d59/db8/d103/c10f 0 2023-12-08T20:27:57.748 INFO:tasks.workunit.client.1.smithi111.stdout:4/708: symlink d8/da/d29/d5c/dca/le7 0 2023-12-08T20:27:57.748 INFO:tasks.workunit.client.0.smithi043.stdout:5/0: dwrite - no filename 2023-12-08T20:27:57.748 INFO:tasks.workunit.client.0.smithi043.stdout:5/1: dwrite - no filename 2023-12-08T20:27:57.749 INFO:tasks.workunit.client.0.smithi043.stdout:2/4: mkdir d0 0 2023-12-08T20:27:57.749 INFO:tasks.workunit.client.0.smithi043.stdout:2/5: dwrite - no filename 2023-12-08T20:27:57.749 INFO:tasks.workunit.client.0.smithi043.stdout:2/6: dread - no filename 2023-12-08T20:27:57.749 INFO:tasks.workunit.client.0.smithi043.stdout:2/7: write - no filename 2023-12-08T20:27:57.750 INFO:tasks.workunit.client.1.smithi111.stdout:9/849: dwrite d2/d8/dd/d1a/d1e/d2d/d8f/faa [4194304,4194304] 0 2023-12-08T20:27:57.750 INFO:tasks.workunit.client.1.smithi111.stdout:1/788: write d0/d6/d33/d15/d51/d78/f95 [637706,14852] 0 2023-12-08T20:27:57.750 INFO:tasks.workunit.client.1.smithi111.stdout:1/789: chown d0/d6/d33/d15/d51/d5b 36418 1 2023-12-08T20:27:57.750 INFO:tasks.workunit.client.1.smithi111.stdout:3/707: dwrite d2/d12/f1d [0,4194304] 0 2023-12-08T20:27:57.750 INFO:tasks.workunit.client.1.smithi111.stdout:7/776: dwrite da/d5c/d59/df2/ffc [0,4194304] 0 2023-12-08T20:27:57.751 INFO:tasks.workunit.client.1.smithi111.stdout:7/777: fsync da/d13/f1a 0 2023-12-08T20:27:57.751 INFO:tasks.workunit.client.1.smithi111.stdout:2/743: rename d1/d1d/f33 to d1/d29/d4e/ddc/f112 0 2023-12-08T20:27:57.754 INFO:tasks.workunit.client.0.smithi043.stdout:0/1: unlink f0 0 2023-12-08T20:27:57.754 INFO:tasks.workunit.client.0.smithi043.stdout:0/2: link - no file 2023-12-08T20:27:57.754 INFO:tasks.workunit.client.0.smithi043.stdout:0/3: dwrite - no filename 2023-12-08T20:27:57.754 INFO:tasks.workunit.client.0.smithi043.stdout:0/4: write - no filename 2023-12-08T20:27:57.754 INFO:tasks.workunit.client.0.smithi043.stdout:4/0: read - no filename 2023-12-08T20:27:57.754 INFO:tasks.workunit.client.0.smithi043.stdout:4/1: readlink - no filename 2023-12-08T20:27:57.755 INFO:tasks.workunit.client.0.smithi043.stdout:4/2: rmdir - no directory 2023-12-08T20:27:57.755 INFO:tasks.workunit.client.1.smithi111.stdout:4/709: getdents d8/d30/d7d/d9b/db2/d4b/dd1/dde 0 2023-12-08T20:27:57.756 INFO:tasks.workunit.client.0.smithi043.stdout:2/8: creat d0/f1 x:0 0 0 2023-12-08T20:27:57.756 INFO:tasks.workunit.client.0.smithi043.stdout:2/9: dread - d0/f1 zero size 2023-12-08T20:27:57.756 INFO:tasks.workunit.client.0.smithi043.stdout:2/10: chown d0/f1 41 1 2023-12-08T20:27:57.759 INFO:tasks.workunit.client.1.smithi111.stdout:4/710: read d8/d30/d7d/d9b/db2/fdb [1791116,53064] 0 2023-12-08T20:27:57.762 INFO:tasks.workunit.client.1.smithi111.stdout:4/711: dread d8/da/d29/f39 [0,4194304] 0 2023-12-08T20:27:57.763 INFO:tasks.workunit.client.1.smithi111.stdout:9/850: creat d2/d8/dd/d1a/d1e/d2d/d4a/f125 x:0 0 0 2023-12-08T20:27:57.764 INFO:tasks.workunit.client.1.smithi111.stdout:6/671: dwrite d0/d1/d1e/db2/f7d [0,4194304] 0 2023-12-08T20:27:57.767 INFO:tasks.workunit.client.1.smithi111.stdout:1/790: creat d0/d6/d33/d15/d51/d5b/d59/db8/dd9/f110 x:0 0 0 2023-12-08T20:27:57.767 INFO:tasks.workunit.client.1.smithi111.stdout:1/791: fdatasync d0/d6/fb7 0 2023-12-08T20:27:57.775 INFO:tasks.workunit.client.1.smithi111.stdout:4/712: dread d8/da/db/d7f/f5a [0,4194304] 0 2023-12-08T20:27:57.778 INFO:tasks.workunit.client.0.smithi043.stdout:4/3: creat f0 x:0 0 0 2023-12-08T20:27:57.778 INFO:tasks.workunit.client.0.smithi043.stdout:0/5: creat f1 x:0 0 0 2023-12-08T20:27:57.778 INFO:tasks.workunit.client.0.smithi043.stdout:0/6: dread - f1 zero size 2023-12-08T20:27:57.778 INFO:tasks.workunit.client.0.smithi043.stdout:0/7: rmdir - no directory 2023-12-08T20:27:57.778 INFO:tasks.workunit.client.0.smithi043.stdout:0/8: read - f1 zero size 2023-12-08T20:27:57.781 INFO:tasks.workunit.client.0.smithi043.stdout:4/4: mkdir d1 0 2023-12-08T20:27:57.784 INFO:tasks.workunit.client.0.smithi043.stdout:7/0: dwrite - no filename 2023-12-08T20:27:57.784 INFO:tasks.workunit.client.0.smithi043.stdout:7/1: unlink - no file 2023-12-08T20:27:57.784 INFO:tasks.workunit.client.0.smithi043.stdout:7/2: rename - no filename 2023-12-08T20:27:57.784 INFO:tasks.workunit.client.0.smithi043.stdout:7/3: getdents . 0 2023-12-08T20:27:57.784 INFO:tasks.workunit.client.0.smithi043.stdout:7/4: dread - no filename 2023-12-08T20:27:57.784 INFO:tasks.workunit.client.0.smithi043.stdout:6/0: mkdir d0 0 2023-12-08T20:27:57.785 INFO:tasks.workunit.client.0.smithi043.stdout:0/9: mkdir d2 0 2023-12-08T20:27:57.786 INFO:tasks.workunit.client.0.smithi043.stdout:0/10: dread - f1 zero size 2023-12-08T20:27:57.786 INFO:tasks.workunit.client.0.smithi043.stdout:0/11: truncate f1 799298 0 2023-12-08T20:27:57.792 INFO:tasks.workunit.client.0.smithi043.stdout:4/5: creat d1/f2 x:0 0 0 2023-12-08T20:27:57.793 INFO:tasks.workunit.client.0.smithi043.stdout:7/5: mkdir d0 0 2023-12-08T20:27:57.793 INFO:tasks.workunit.client.0.smithi043.stdout:7/6: chown d0 1195 1 2023-12-08T20:27:57.793 INFO:tasks.workunit.client.0.smithi043.stdout:1/0: link - no file 2023-12-08T20:27:57.793 INFO:tasks.workunit.client.0.smithi043.stdout:1/1: write - no filename 2023-12-08T20:27:57.793 INFO:tasks.workunit.client.0.smithi043.stdout:1/2: write - no filename 2023-12-08T20:27:57.794 INFO:tasks.workunit.client.1.smithi111.stdout:2/744: mknod d1/d29/d53/d91/dce/c113 0 2023-12-08T20:27:57.796 INFO:tasks.workunit.client.1.smithi111.stdout:9/851: mknod d2/d8/dd/d1a/d74/c126 0 2023-12-08T20:27:57.796 INFO:tasks.workunit.client.1.smithi111.stdout:3/708: mknod d2/d12/d2e/dc6/ce3 0 2023-12-08T20:27:57.798 INFO:tasks.workunit.client.1.smithi111.stdout:6/672: mkdir d0/d1/d1e/db2/dd7 0 2023-12-08T20:27:57.800 INFO:tasks.workunit.client.1.smithi111.stdout:2/745: mkdir d1/d1d/d1f/d25/d3d/d56/d101/de4/d114 0 2023-12-08T20:27:57.800 INFO:tasks.workunit.client.1.smithi111.stdout:2/746: chown d1/d1d/d22/ca7 1 1 2023-12-08T20:27:57.800 INFO:tasks.workunit.client.1.smithi111.stdout:2/747: fsync d1/d1d/fd8 0 2023-12-08T20:27:57.804 INFO:tasks.workunit.client.0.smithi043.stdout:0/12: mkdir d2/d3 0 2023-12-08T20:27:57.804 INFO:tasks.workunit.client.0.smithi043.stdout:4/6: symlink d1/l3 0 2023-12-08T20:27:57.804 INFO:tasks.workunit.client.0.smithi043.stdout:0/13: stat d2 0 2023-12-08T20:27:57.804 INFO:tasks.workunit.client.0.smithi043.stdout:4/7: chown d1/f2 51 1 2023-12-08T20:27:57.804 INFO:tasks.workunit.client.0.smithi043.stdout:4/8: rename d1 to d1/d4 22 2023-12-08T20:27:57.804 INFO:tasks.workunit.client.0.smithi043.stdout:4/9: read - f0 zero size 2023-12-08T20:27:57.805 INFO:tasks.workunit.client.0.smithi043.stdout:4/10: chown d1 5945 1 2023-12-08T20:27:57.805 INFO:tasks.workunit.client.1.smithi111.stdout:1/792: rmdir d0/d6/d33/d15/d51/d5b 39 2023-12-08T20:27:57.805 INFO:tasks.workunit.client.1.smithi111.stdout:1/793: write d0/d8e/fc2 [4508510,60054] 0 2023-12-08T20:27:57.806 INFO:tasks.workunit.client.1.smithi111.stdout:1/794: fsync d0/d8e/fc7 0 2023-12-08T20:27:57.806 INFO:tasks.workunit.client.1.smithi111.stdout:9/852: rename d2/d8/dd/d56/c9c to d2/d8/dd/d1a/d1e/d2d/db9/c127 0 2023-12-08T20:27:57.806 INFO:tasks.workunit.client.0.smithi043.stdout:7/7: symlink d0/l1 0 2023-12-08T20:27:57.806 INFO:tasks.workunit.client.0.smithi043.stdout:7/8: chown d0 86 1 2023-12-08T20:27:57.806 INFO:tasks.workunit.client.0.smithi043.stdout:7/9: chown d0/l1 109565794 1 2023-12-08T20:27:57.806 INFO:tasks.workunit.client.1.smithi111.stdout:2/748: symlink d1/d1d/l115 0 2023-12-08T20:27:57.806 INFO:tasks.workunit.client.1.smithi111.stdout:2/749: readlink d1/d1d/d55/l81 0 2023-12-08T20:27:57.809 INFO:tasks.workunit.client.0.smithi043.stdout:1/3: creat f0 x:0 0 0 2023-12-08T20:27:57.810 INFO:tasks.workunit.client.1.smithi111.stdout:2/750: rename d1/d1d/d68/d73/ff4 to d1/d1d/d1f/d25/d3d/d64/f116 0 2023-12-08T20:27:57.813 INFO:tasks.workunit.client.1.smithi111.stdout:2/751: symlink d1/d1d/d55/l117 0 2023-12-08T20:27:57.815 INFO:tasks.workunit.client.0.smithi043.stdout:1/4: mkdir d1 0 2023-12-08T20:27:57.815 INFO:tasks.workunit.client.0.smithi043.stdout:7/10: rmdir d0 39 2023-12-08T20:27:57.820 INFO:tasks.workunit.client.0.smithi043.stdout:7/11: mkdir d0/d2 0 2023-12-08T20:27:57.821 INFO:tasks.workunit.client.0.smithi043.stdout:7/12: truncate - no filename 2023-12-08T20:27:57.821 INFO:tasks.workunit.client.0.smithi043.stdout:7/13: dwrite - no filename 2023-12-08T20:27:57.825 INFO:tasks.workunit.client.0.smithi043.stdout:7/14: symlink d0/l3 0 2023-12-08T20:27:57.836 INFO:tasks.workunit.client.0.smithi043.stdout:7/15: mknod d0/c4 0 2023-12-08T20:27:57.836 INFO:tasks.workunit.client.0.smithi043.stdout:7/16: dwrite - no filename 2023-12-08T20:27:57.836 INFO:tasks.workunit.client.0.smithi043.stdout:7/17: dwrite - no filename 2023-12-08T20:27:57.836 INFO:tasks.workunit.client.0.smithi043.stdout:7/18: write - no filename 2023-12-08T20:27:57.836 INFO:tasks.workunit.client.0.smithi043.stdout:7/19: getdents d0/d2 0 2023-12-08T20:27:57.842 INFO:tasks.workunit.client.0.smithi043.stdout:7/20: unlink d0/l1 0 2023-12-08T20:27:57.842 INFO:tasks.workunit.client.0.smithi043.stdout:7/21: fsync - no filename 2023-12-08T20:27:57.881 INFO:tasks.workunit.client.1.smithi111.stdout:7/778: dwrite da/d25/d3d/fa5 [0,4194304] 0 2023-12-08T20:27:57.881 INFO:tasks.workunit.client.1.smithi111.stdout:7/779: chown da/d25/da9/cd4 629 1 2023-12-08T20:27:57.887 INFO:tasks.workunit.client.1.smithi111.stdout:7/780: symlink da/d5c/d59/d61/lfe 0 2023-12-08T20:27:57.892 INFO:tasks.workunit.client.1.smithi111.stdout:7/781: fsync da/d5c/d6e/f86 0 2023-12-08T20:27:57.898 INFO:tasks.workunit.client.1.smithi111.stdout:7/782: mkdir da/d25/d3d/dff 0 2023-12-08T20:27:57.901 INFO:tasks.workunit.client.1.smithi111.stdout:7/783: mknod da/d25/d3d/c100 0 2023-12-08T20:27:57.901 INFO:tasks.workunit.client.1.smithi111.stdout:7/784: fsync da/f1e 0 2023-12-08T20:27:57.950 INFO:tasks.workunit.client.1.smithi111.stdout:3/709: dread d2/d15/d17/d25/f26 [0,4194304] 0 2023-12-08T20:27:57.951 INFO:tasks.workunit.client.1.smithi111.stdout:3/710: rmdir d2/d15/d17/d5e/d62 39 2023-12-08T20:27:57.951 INFO:tasks.workunit.client.1.smithi111.stdout:3/711: readlink d2/d3/d6/lb4 0 2023-12-08T20:27:57.958 INFO:tasks.workunit.client.1.smithi111.stdout:3/712: creat d2/d12/d2e/dc6/d93/fe4 x:0 0 0 2023-12-08T20:27:57.958 INFO:tasks.workunit.client.1.smithi111.stdout:4/713: dread d8/d30/d7d/d9b/db2/d4b/dd1/d1f/f6f [0,4194304] 0 2023-12-08T20:27:57.989 INFO:tasks.workunit.client.1.smithi111.stdout:5/933: sync 2023-12-08T20:27:57.989 INFO:tasks.workunit.client.1.smithi111.stdout:5/934: dread - d3/d4/d7/f13d zero size 2023-12-08T20:27:57.993 INFO:tasks.workunit.client.0.smithi043.stdout:2/11: dwrite d0/f1 [0,4194304] 0 2023-12-08T20:27:58.038 INFO:tasks.workunit.client.1.smithi111.stdout:9/853: dwrite d2/d8/dd/d56/fe9 [0,4194304] 0 2023-12-08T20:27:58.047 INFO:tasks.workunit.client.1.smithi111.stdout:9/854: creat d2/da/d11e/f128 x:0 0 0 2023-12-08T20:27:58.050 INFO:tasks.workunit.client.1.smithi111.stdout:9/855: link d2/d8/dd/d1a/d1e/d114/c122 d2/d8/dd/d56/da1/c129 0 2023-12-08T20:27:58.055 INFO:tasks.workunit.client.1.smithi111.stdout:9/856: creat d2/d8/dd/d1a/d1e/d2d/db9/dd5/dfb/f12a x:0 0 0 2023-12-08T20:27:58.055 INFO:tasks.workunit.client.1.smithi111.stdout:9/857: write d2/d8/dd/d1a/d1e/d2d/d8f/ff8 [347795,103641] 0 2023-12-08T20:27:58.058 INFO:tasks.workunit.client.1.smithi111.stdout:9/858: symlink d2/d8/dd/d1a/d1e/d2d/d35/d71/d105/l12b 0 2023-12-08T20:27:58.058 INFO:tasks.workunit.client.1.smithi111.stdout:9/859: chown d2/d8/dd/d1a/d74/c126 1893806 1 2023-12-08T20:27:58.066 INFO:tasks.workunit.client.1.smithi111.stdout:9/860: symlink d2/d8/dd/d1a/d1e/d2d/d35/d88/l12c 0 2023-12-08T20:27:58.081 INFO:tasks.workunit.client.1.smithi111.stdout:5/935: read d3/d4/d7/d36/d82/db4/dbe/dc6/f130 [87756,83580] 0 2023-12-08T20:27:58.082 INFO:tasks.workunit.client.1.smithi111.stdout:9/861: mknod d2/c12d 0 2023-12-08T20:27:58.088 INFO:tasks.workunit.client.1.smithi111.stdout:9/862: mkdir d2/d8/dd/d1a/d1e/d12e 0 2023-12-08T20:27:58.089 INFO:tasks.workunit.client.1.smithi111.stdout:2/752: dread d1/d29/d53/d90/f61 [0,4194304] 0 2023-12-08T20:27:58.089 INFO:tasks.workunit.client.1.smithi111.stdout:2/753: write d1/d29/d53/d90/f97 [373316,74016] 0 2023-12-08T20:27:58.092 INFO:tasks.workunit.client.1.smithi111.stdout:4/714: dread d8/da/d29/d6e/f99 [0,4194304] 0 2023-12-08T20:27:58.092 INFO:tasks.workunit.client.1.smithi111.stdout:4/715: write d8/da/d29/d69/fba [770166,111624] 0 2023-12-08T20:27:58.092 INFO:tasks.workunit.client.1.smithi111.stdout:4/716: truncate d8/da/d29/f78 684193 0 2023-12-08T20:27:58.092 INFO:tasks.workunit.client.1.smithi111.stdout:4/717: write d8/dda/fd9 [844081,18389] 0 2023-12-08T20:27:58.092 INFO:tasks.workunit.client.1.smithi111.stdout:4/718: truncate d8/d30/d7d/d9b/db2/d4b/f53 1928108 0 2023-12-08T20:27:58.100 INFO:tasks.workunit.client.1.smithi111.stdout:9/863: creat d2/d8/dd/d1a/d1e/d2d/d35/d71/d105/f12f x:0 0 0 2023-12-08T20:27:58.100 INFO:tasks.workunit.client.1.smithi111.stdout:9/864: chown d2/d8/dd/d1a/d1e/d2d/d8f/fd3 983316 1 2023-12-08T20:27:58.100 INFO:tasks.workunit.client.1.smithi111.stdout:9/865: chown d2/d8/dd/d56/fe9 696297 1 2023-12-08T20:27:58.102 INFO:tasks.workunit.client.1.smithi111.stdout:2/754: rename d1/d1d/d22/d30 to d1/d29/d53/d90/d118 0 2023-12-08T20:27:58.104 INFO:tasks.workunit.client.1.smithi111.stdout:4/719: symlink d8/da/db/d7f/d93/d77/le8 0 2023-12-08T20:27:58.104 INFO:tasks.workunit.client.1.smithi111.stdout:4/720: chown d8/d30/d7d/d9b/db2/d4b/dd1/d1f/f6f 5158 1 2023-12-08T20:27:58.114 INFO:tasks.workunit.client.1.smithi111.stdout:2/755: creat d1/d1d/d1f/d25/d3d/d56/d10a/f119 x:0 0 0 2023-12-08T20:27:58.114 INFO:tasks.workunit.client.1.smithi111.stdout:9/866: rename d2/d8/dd/d56/da1/c129 to d2/d8/dd/d1a/c130 0 2023-12-08T20:27:58.118 INFO:tasks.workunit.client.1.smithi111.stdout:2/756: mknod d1/d1d/d1f/d25/d3d/da2/c11a 0 2023-12-08T20:27:58.118 INFO:tasks.workunit.client.1.smithi111.stdout:9/867: creat d2/d8/d118/f131 x:0 0 0 2023-12-08T20:27:58.136 INFO:tasks.workunit.client.1.smithi111.stdout:6/673: write d0/d1/d1e/db2/f72 [2946900,96861] 0 2023-12-08T20:27:58.139 INFO:tasks.workunit.client.1.smithi111.stdout:9/868: mkdir d2/da/d11e/d132 0 2023-12-08T20:27:58.141 INFO:tasks.workunit.client.1.smithi111.stdout:8/876: sync 2023-12-08T20:27:58.143 INFO:tasks.workunit.client.1.smithi111.stdout:6/674: truncate d0/d1/d27/f40 1751281 0 2023-12-08T20:27:58.144 INFO:tasks.workunit.client.1.smithi111.stdout:8/877: symlink dd/d32/dea/l136 0 2023-12-08T20:27:58.144 INFO:tasks.workunit.client.1.smithi111.stdout:8/878: chown dd/d32/d36/d4b/fe9 228423009 1 2023-12-08T20:27:58.149 INFO:tasks.workunit.client.1.smithi111.stdout:8/879: mkdir dd/d2d/d62/d83/d137 0 2023-12-08T20:27:58.150 INFO:tasks.workunit.client.1.smithi111.stdout:6/675: symlink d0/d68/da9/ld8 0 2023-12-08T20:27:58.152 INFO:tasks.workunit.client.1.smithi111.stdout:8/880: rename dd/f15 to dd/d32/d36/d50/f138 0 2023-12-08T20:27:58.152 INFO:tasks.workunit.client.1.smithi111.stdout:6/676: mknod d0/d1/d1e/cd9 0 2023-12-08T20:27:58.165 INFO:tasks.workunit.client.1.smithi111.stdout:8/881: creat dd/d35/d7a/dc3/f139 x:0 0 0 2023-12-08T20:27:58.165 INFO:tasks.workunit.client.1.smithi111.stdout:6/677: creat d0/d1/d1e/db2/da5/fda x:0 0 0 2023-12-08T20:27:58.178 INFO:tasks.workunit.client.1.smithi111.stdout:8/882: unlink dd/d2d/d62/c74 0 2023-12-08T20:27:58.195 INFO:tasks.workunit.client.1.smithi111.stdout:7/785: dread da/d5c/d6e/f86 [0,4194304] 0 2023-12-08T20:27:58.195 INFO:tasks.workunit.client.1.smithi111.stdout:7/786: write da/d13/d9e/d75/f99 [5118578,73883] 0 2023-12-08T20:27:58.217 INFO:tasks.workunit.client.1.smithi111.stdout:2/757: write d1/d29/d53/f85 [75890,81513] 0 2023-12-08T20:27:58.296 INFO:tasks.workunit.client.1.smithi111.stdout:3/713: dwrite d2/d3/d13/d36/d44/d8f/da7/fca [0,4194304] 0 2023-12-08T20:27:58.298 INFO:tasks.workunit.client.1.smithi111.stdout:9/869: dwrite d2/d8/d8c/dbb/fc5 [0,4194304] 0 2023-12-08T20:27:58.304 INFO:tasks.workunit.client.1.smithi111.stdout:3/714: mkdir d2/d15/d17/d5e/da6/de5 0 2023-12-08T20:27:58.305 INFO:tasks.workunit.client.1.smithi111.stdout:3/715: write d2/d12/f1d [5186550,43277] 0 2023-12-08T20:27:58.310 INFO:tasks.workunit.client.1.smithi111.stdout:9/870: symlink d2/d8/dd/d56/da1/l133 0 2023-12-08T20:27:58.314 INFO:tasks.workunit.client.1.smithi111.stdout:3/716: creat d2/d15/d17/d5e/fe6 x:0 0 0 2023-12-08T20:27:58.315 INFO:tasks.workunit.client.1.smithi111.stdout:3/717: chown d2/d3/c64 272 1 2023-12-08T20:27:58.315 INFO:tasks.workunit.client.1.smithi111.stdout:9/871: unlink d2/d8/dd/d1a/d1e/d2d/lbc 0 2023-12-08T20:27:58.321 INFO:tasks.workunit.client.1.smithi111.stdout:6/678: read d0/d1/d27/f5c [2383535,19510] 0 2023-12-08T20:27:58.321 INFO:tasks.workunit.client.1.smithi111.stdout:9/872: write d2/d8/dd/d1a/ff4 [665705,50575] 0 2023-12-08T20:27:58.325 INFO:tasks.workunit.client.1.smithi111.stdout:3/718: rmdir d2/d3/d51 39 2023-12-08T20:27:58.329 INFO:tasks.workunit.client.1.smithi111.stdout:6/679: creat d0/d68/d8e/fdb x:0 0 0 2023-12-08T20:27:58.329 INFO:tasks.workunit.client.1.smithi111.stdout:6/680: fsync d0/f84 0 2023-12-08T20:27:58.335 INFO:tasks.workunit.client.1.smithi111.stdout:9/873: rmdir d2/d8/dd/d1a/d1e/d2d/d4a/d62 39 2023-12-08T20:27:58.336 INFO:tasks.workunit.client.1.smithi111.stdout:9/874: creat d2/d8/f134 x:0 0 0 2023-12-08T20:27:58.340 INFO:tasks.workunit.client.1.smithi111.stdout:9/875: mknod d2/d8/dd/d1a/d1e/d2d/db9/dd5/c135 0 2023-12-08T20:27:58.340 INFO:tasks.workunit.client.1.smithi111.stdout:9/876: readlink d2/d8/dd/d1a/d1e/d2d/d35/lb5 0 2023-12-08T20:27:58.358 INFO:tasks.workunit.client.1.smithi111.stdout:6/681: dread d0/d68/d95/f35 [0,4194304] 0 2023-12-08T20:27:58.359 INFO:tasks.workunit.client.1.smithi111.stdout:6/682: chown d0/d68/c5e 7692966 1 2023-12-08T20:27:58.359 INFO:tasks.workunit.client.1.smithi111.stdout:6/683: readlink d0/d68/d95/l57 0 2023-12-08T20:27:58.359 INFO:tasks.workunit.client.1.smithi111.stdout:6/684: write d0/d1/d27/d36/d8d/fa3 [915196,45566] 0 2023-12-08T20:27:58.359 INFO:tasks.workunit.client.1.smithi111.stdout:6/685: chown d0/d68/d95/f47 1314694412 1 2023-12-08T20:27:58.359 INFO:tasks.workunit.client.1.smithi111.stdout:6/686: write d0/d68/d95/f47 [176894,2295] 0 2023-12-08T20:27:58.361 INFO:tasks.workunit.client.1.smithi111.stdout:6/687: symlink d0/d1/d27/d56/ldc 0 2023-12-08T20:27:58.361 INFO:tasks.workunit.client.1.smithi111.stdout:6/688: fdatasync d0/d1/d1e/f61 0 2023-12-08T20:27:58.447 INFO:tasks.workunit.client.1.smithi111.stdout:6/689: dwrite d0/d68/d8e/fdb [0,4194304] 0 2023-12-08T20:27:58.447 INFO:tasks.workunit.client.1.smithi111.stdout:6/690: write d0/d1/d27/f2d [2634973,72042] 0 2023-12-08T20:27:58.452 INFO:tasks.workunit.client.1.smithi111.stdout:6/691: mknod d0/d1/d1e/db2/da5/cdd 0 2023-12-08T20:27:58.453 INFO:tasks.workunit.client.1.smithi111.stdout:5/936: dwrite d3/d4/d7/d29/fba [4194304,4194304] 0 2023-12-08T20:27:58.458 INFO:tasks.workunit.client.1.smithi111.stdout:6/692: mknod d0/d1/d27/d56/cde 0 2023-12-08T20:27:58.468 INFO:tasks.workunit.client.1.smithi111.stdout:6/693: rename d0/daa/fc5 to d0/d68/da9/fdf 0 2023-12-08T20:27:58.478 INFO:tasks.workunit.client.1.smithi111.stdout:7/787: dwrite da/d25/d26/d32/d3e/f42 [0,4194304] 0 2023-12-08T20:27:58.478 INFO:tasks.workunit.client.1.smithi111.stdout:6/694: rename d0/d1/d1e/db2/da5/fbe to d0/d68/d95/d7a/fe0 0 2023-12-08T20:27:58.485 INFO:tasks.workunit.client.1.smithi111.stdout:7/788: mknod da/d5c/c101 0 2023-12-08T20:27:58.485 INFO:tasks.workunit.client.1.smithi111.stdout:7/789: chown da/d25/d3d/c100 18379 1 2023-12-08T20:27:58.491 INFO:tasks.workunit.client.1.smithi111.stdout:6/695: link d0/d68/lbb d0/d1/d27/d36/d8d/le1 0 2023-12-08T20:27:58.493 INFO:tasks.workunit.client.1.smithi111.stdout:7/790: creat da/d25/d26/d32/dcd/f102 x:0 0 0 2023-12-08T20:27:58.494 INFO:tasks.workunit.client.1.smithi111.stdout:7/791: readlink da/d5c/d59/l62 0 2023-12-08T20:27:58.498 INFO:tasks.workunit.client.1.smithi111.stdout:7/792: creat da/d25/d26/d32/d3e/f103 x:0 0 0 2023-12-08T20:27:58.498 INFO:tasks.workunit.client.1.smithi111.stdout:6/696: unlink d0/d1/f65 0 2023-12-08T20:27:58.500 INFO:tasks.workunit.client.1.smithi111.stdout:7/793: creat da/d13/d9e/f104 x:0 0 0 2023-12-08T20:27:58.501 INFO:tasks.workunit.client.1.smithi111.stdout:6/697: truncate d0/d68/f8b 3363270 0 2023-12-08T20:27:58.503 INFO:tasks.workunit.client.1.smithi111.stdout:7/794: link da/d64/c9a da/d25/d3d/d58/c105 0 2023-12-08T20:27:58.507 INFO:tasks.workunit.client.1.smithi111.stdout:7/795: read da/d25/d26/d32/d3e/d97/fc3 [179019,33373] 0 2023-12-08T20:27:58.514 INFO:tasks.workunit.client.1.smithi111.stdout:6/698: symlink d0/le2 0 2023-12-08T20:27:58.515 INFO:tasks.workunit.client.1.smithi111.stdout:6/699: chown d0/d68/d95/l1c 11 1 2023-12-08T20:27:58.515 INFO:tasks.workunit.client.1.smithi111.stdout:6/700: readlink d0/d1/d27/d56/ldc 0 2023-12-08T20:27:58.515 INFO:tasks.workunit.client.1.smithi111.stdout:6/701: chown d0/d1/d1e/l94 11175 1 2023-12-08T20:27:58.515 INFO:tasks.workunit.client.1.smithi111.stdout:6/702: getdents d0/d1/d27/da1/dca 0 2023-12-08T20:27:58.515 INFO:tasks.workunit.client.0.smithi043.stdout:0/14: read f1 [616822,81802] 0 2023-12-08T20:27:58.516 INFO:tasks.workunit.client.1.smithi111.stdout:6/703: creat d0/d1/d27/d36/d97/fe3 x:0 0 0 2023-12-08T20:27:58.518 INFO:tasks.workunit.client.0.smithi043.stdout:0/15: dread f1 [0,4194304] 0 2023-12-08T20:27:58.520 INFO:tasks.workunit.client.1.smithi111.stdout:6/704: mkdir d0/d68/d95/de4 0 2023-12-08T20:27:58.523 INFO:tasks.workunit.client.1.smithi111.stdout:6/705: symlink d0/d68/d8e/le5 0 2023-12-08T20:27:58.530 INFO:tasks.workunit.client.1.smithi111.stdout:6/706: write d0/d1/d27/d36/f3e [123476,101873] 0 2023-12-08T20:27:58.530 INFO:tasks.workunit.client.1.smithi111.stdout:6/707: truncate d0/d1/d27/d36/d97/db4/fd5 470319 0 2023-12-08T20:27:58.530 INFO:tasks.workunit.client.1.smithi111.stdout:6/708: write d0/d1/d27/d36/d8d/fa3 [1418687,81463] 0 2023-12-08T20:27:58.533 INFO:tasks.workunit.client.1.smithi111.stdout:9/877: read d2/d8/dd/d1a/d1e/d2d/d4a/d62/fd2 [774595,29371] 0 2023-12-08T20:27:58.537 INFO:tasks.workunit.client.1.smithi111.stdout:1/795: dread d0/d4d/feb [0,4194304] 0 2023-12-08T20:27:58.541 INFO:tasks.workunit.client.1.smithi111.stdout:9/878: creat d2/d8/dd/d1a/d1e/d114/f136 x:0 0 0 2023-12-08T20:27:58.541 INFO:tasks.workunit.client.1.smithi111.stdout:9/879: chown d2/d8/d8c/dbb/f11a 1308 1 2023-12-08T20:27:58.541 INFO:tasks.workunit.client.1.smithi111.stdout:9/880: chown d2/d8/dd/d1a/d1e/d2d/d35/f41 21720954 1 2023-12-08T20:27:58.541 INFO:tasks.workunit.client.1.smithi111.stdout:1/796: rename d0/d6/d33/d15/d51/d5b/d5e/d86 to d0/d8e/db0/d10d/d111 0 2023-12-08T20:27:58.543 INFO:tasks.workunit.client.1.smithi111.stdout:9/881: read d2/d8/dd/d1a/d1e/d2d/d35/f95 [98525,55793] 0 2023-12-08T20:27:58.544 INFO:tasks.workunit.client.1.smithi111.stdout:1/797: truncate d0/d8e/dd4/dfc/f107 2161467 0 2023-12-08T20:27:58.568 INFO:tasks.workunit.client.0.smithi043.stdout:9/0: stat - no entries 2023-12-08T20:27:58.568 INFO:tasks.workunit.client.0.smithi043.stdout:9/1: dwrite - no filename 2023-12-08T20:27:58.568 INFO:tasks.workunit.client.0.smithi043.stdout:9/2: truncate - no filename 2023-12-08T20:27:58.568 INFO:tasks.workunit.client.0.smithi043.stdout:9/3: chown . 22 1 2023-12-08T20:27:58.568 INFO:tasks.workunit.client.0.smithi043.stdout:9/4: dread - no filename 2023-12-08T20:27:58.573 INFO:tasks.workunit.client.0.smithi043.stdout:1/5: dwrite f0 [0,4194304] 0 2023-12-08T20:27:58.574 INFO:tasks.workunit.client.1.smithi111.stdout:7/796: dwrite da/d13/ff4 [0,4194304] 0 2023-12-08T20:27:58.590 INFO:tasks.workunit.client.0.smithi043.stdout:0/16: dwrite f1 [0,4194304] 0 2023-12-08T20:27:58.597 INFO:tasks.workunit.client.1.smithi111.stdout:7/797: dwrite da/d25/f2e [4194304,4194304] 0 2023-12-08T20:27:58.599 INFO:tasks.workunit.client.1.smithi111.stdout:7/798: write da/d13/f91 [430130,26815] 0 2023-12-08T20:27:58.603 INFO:tasks.workunit.client.1.smithi111.stdout:7/799: creat da/d5c/d59/df2/f106 x:0 0 0 2023-12-08T20:27:58.603 INFO:tasks.workunit.client.1.smithi111.stdout:7/800: chown da/d5c/d59/c92 30826 1 2023-12-08T20:27:58.607 INFO:tasks.workunit.client.1.smithi111.stdout:9/882: dread d2/d8/d8c/f94 [0,4194304] 0 2023-12-08T20:27:58.629 INFO:tasks.workunit.client.1.smithi111.stdout:9/883: dwrite d2/d8/dd/f22 [4194304,4194304] 0 2023-12-08T20:27:58.630 INFO:tasks.workunit.client.1.smithi111.stdout:9/884: creat d2/d8/dd/d1a/d1e/d2d/d35/d88/f137 x:0 0 0 2023-12-08T20:27:58.632 INFO:tasks.workunit.client.1.smithi111.stdout:9/885: creat d2/d8/dd/d1a/d1e/d12e/f138 x:0 0 0 2023-12-08T20:27:58.633 INFO:tasks.workunit.client.1.smithi111.stdout:9/886: mkdir d2/d8/dd/d1a/d1e/d2d/db9/dd5/dfb/d11d/d139 0 2023-12-08T20:27:58.635 INFO:tasks.workunit.client.1.smithi111.stdout:9/887: mknod d2/d8/dd/d1a/d1e/d2d/db9/dd5/dfb/d11d/d139/c13a 0 2023-12-08T20:27:58.636 INFO:tasks.workunit.client.1.smithi111.stdout:9/888: write d2/d8/dd/f22 [7940569,106816] 0 2023-12-08T20:27:58.657 INFO:tasks.workunit.client.1.smithi111.stdout:9/889: dwrite d2/f59 [0,4194304] 0 2023-12-08T20:27:58.713 INFO:tasks.workunit.client.1.smithi111.stdout:9/890: dwrite d2/f67 [0,4194304] 0 2023-12-08T20:27:58.714 INFO:tasks.workunit.client.1.smithi111.stdout:9/891: rename d2/d8/dd/d1a/d1e/d2d/d8f/fe8 to d2/d8/dd/d1a/d1e/d2d/d35/f13b 0 2023-12-08T20:27:58.717 INFO:tasks.workunit.client.1.smithi111.stdout:9/892: stat d2/d8/dd/d1a/d1e/d2d/db9/dd5/c135 0 2023-12-08T20:27:58.717 INFO:tasks.workunit.client.1.smithi111.stdout:9/893: readlink d2/d8/dd/d1a/d74/dbf/l101 0 2023-12-08T20:27:58.717 INFO:tasks.workunit.client.1.smithi111.stdout:9/894: dread d2/d8/dd/f69 [0,4194304] 0 2023-12-08T20:27:58.718 INFO:tasks.workunit.client.1.smithi111.stdout:9/895: symlink d2/d8/dd/d1a/d1e/d2d/d35/d71/d105/l13c 0 2023-12-08T20:27:58.718 INFO:tasks.workunit.client.1.smithi111.stdout:9/896: getdents d2/da/d11e/d132 0 2023-12-08T20:27:58.718 INFO:tasks.workunit.client.1.smithi111.stdout:9/897: write d2/d8/fcc [1436841,112819] 0 2023-12-08T20:27:58.732 INFO:tasks.workunit.client.1.smithi111.stdout:9/898: dwrite d2/d8/dd/fb4 [0,4194304] 0 2023-12-08T20:27:58.733 INFO:tasks.workunit.client.1.smithi111.stdout:2/758: write f0 [2865003,69963] 0 2023-12-08T20:27:58.733 INFO:tasks.workunit.client.1.smithi111.stdout:5/937: write d3/d4/d7/d2c/f78 [3873999,7601] 0 2023-12-08T20:27:58.733 INFO:tasks.workunit.client.1.smithi111.stdout:2/759: chown d1/d1d/d22/fe6 5274 1 2023-12-08T20:27:58.734 INFO:tasks.workunit.client.1.smithi111.stdout:9/899: getdents d2/d8/d8c/d96 0 2023-12-08T20:27:58.735 INFO:tasks.workunit.client.1.smithi111.stdout:9/900: fdatasync d2/d8/d8c/f102 0 2023-12-08T20:27:58.736 INFO:tasks.workunit.client.1.smithi111.stdout:9/901: unlink d2/d8/dd/d1a/d1e/d2d/d35/lb5 0 2023-12-08T20:27:58.736 INFO:tasks.workunit.client.1.smithi111.stdout:9/902: chown d2 39318 1 2023-12-08T20:27:58.738 INFO:tasks.workunit.client.1.smithi111.stdout:9/903: write d2/d8/dd/fb4 [2498946,44239] 0 2023-12-08T20:27:58.738 INFO:tasks.workunit.client.1.smithi111.stdout:9/904: stat d2/d8/dd/d1a/d1e/d2d/d35/d6b 0 2023-12-08T20:27:58.739 INFO:tasks.workunit.client.1.smithi111.stdout:9/905: creat d2/d8/dd/d1a/d1e/d114/f13d x:0 0 0 2023-12-08T20:27:58.742 INFO:tasks.workunit.client.1.smithi111.stdout:9/906: truncate d2/d8/d8c/f102 1701978 0 2023-12-08T20:27:58.742 INFO:tasks.workunit.client.1.smithi111.stdout:9/907: dread - d2/d8/dd/d1a/d74/f7a zero size 2023-12-08T20:27:58.742 INFO:tasks.workunit.client.1.smithi111.stdout:9/908: fsync d2/d8/dd/d1a/d1e/d2d/d4a/f5a 0 2023-12-08T20:27:58.746 INFO:tasks.workunit.client.1.smithi111.stdout:9/909: mkdir d2/d8/dd/d1a/d1e/d2d/d13e 0 2023-12-08T20:27:58.746 INFO:tasks.workunit.client.1.smithi111.stdout:5/938: dread d3/d4/d7/d29/d73/f9e [0,4194304] 0 2023-12-08T20:27:58.746 INFO:tasks.workunit.client.1.smithi111.stdout:9/910: fdatasync d2/d8/d8c/dbb/fc5 0 2023-12-08T20:27:58.747 INFO:tasks.workunit.client.1.smithi111.stdout:5/939: creat d3/d4/d7/d29/dd6/f13f x:0 0 0 2023-12-08T20:27:58.748 INFO:tasks.workunit.client.1.smithi111.stdout:9/911: creat d2/d8/dd/d1a/d1e/d2d/db9/dd5/dfb/f13f x:0 0 0 2023-12-08T20:27:58.748 INFO:tasks.workunit.client.1.smithi111.stdout:9/912: stat d2/d8/dd/d1a/d1e/d2d/d4a/d62/fd7 0 2023-12-08T20:27:58.749 INFO:tasks.workunit.client.1.smithi111.stdout:5/940: dread d3/d6d/fa4 [0,4194304] 0 2023-12-08T20:27:58.755 INFO:tasks.workunit.client.1.smithi111.stdout:2/760: dwrite d1/d29/d53/f5a [0,4194304] 0 2023-12-08T20:27:58.759 INFO:tasks.workunit.client.1.smithi111.stdout:2/761: rename d1/d1d/d22/f69 to d1/d1d/d1f/d25/d3d/f11b 0 2023-12-08T20:27:58.761 INFO:tasks.workunit.client.1.smithi111.stdout:9/913: dread d2/d8/d8c/dbb/fc5 [0,4194304] 0 2023-12-08T20:27:58.763 INFO:tasks.workunit.client.1.smithi111.stdout:2/762: write d1/d29/d4e/f32 [623383,48187] 0 2023-12-08T20:27:58.763 INFO:tasks.workunit.client.1.smithi111.stdout:9/914: rmdir d2/d8/dd/d1a/d1e/d2d/d4a 39 2023-12-08T20:27:58.766 INFO:tasks.workunit.client.1.smithi111.stdout:2/763: creat d1/d29/f11c x:0 0 0 2023-12-08T20:27:58.767 INFO:tasks.workunit.client.1.smithi111.stdout:9/915: link d2/d8/dd/d1a/d1e/c89 d2/d8/d8c/d96/c140 0 2023-12-08T20:27:58.768 INFO:tasks.workunit.client.1.smithi111.stdout:5/941: dwrite d3/d4/d7/d29/d30/fb5 [0,4194304] 0 2023-12-08T20:27:58.768 INFO:tasks.workunit.client.1.smithi111.stdout:5/942: truncate d3/d4/d7/d36/d82/db4/f102 353699 0 2023-12-08T20:27:58.768 INFO:tasks.workunit.client.1.smithi111.stdout:5/943: fsync d3/d4/d7/d2c/f10f 0 2023-12-08T20:27:58.770 INFO:tasks.workunit.client.1.smithi111.stdout:5/944: dread d3/d4/d4a/d21/f47 [0,4194304] 0 2023-12-08T20:27:58.770 INFO:tasks.workunit.client.1.smithi111.stdout:5/945: chown d3/d4/d7/d29/d73/d90/l134 1382914979 1 2023-12-08T20:27:58.772 INFO:tasks.workunit.client.1.smithi111.stdout:5/946: symlink d3/d4/d7/d29/dd6/l140 0 2023-12-08T20:27:58.774 INFO:tasks.workunit.client.1.smithi111.stdout:9/916: dread d2/d8/fcc [0,4194304] 0 2023-12-08T20:27:58.776 INFO:tasks.workunit.client.1.smithi111.stdout:5/947: rename d3/d12/d104/f10b to d3/d4/d7/d2c/d84/f141 0 2023-12-08T20:27:58.776 INFO:tasks.workunit.client.1.smithi111.stdout:5/948: truncate d3/d4/d4a/f131 318590 0 2023-12-08T20:27:58.777 INFO:tasks.workunit.client.1.smithi111.stdout:9/917: creat d2/d8/dd/d1a/d1e/d2d/db9/dd5/dfb/d11d/f141 x:0 0 0 2023-12-08T20:27:58.778 INFO:tasks.workunit.client.1.smithi111.stdout:5/949: mkdir d3/d4/d7/d29/dd6/d122/d142 0 2023-12-08T20:27:58.780 INFO:tasks.workunit.client.1.smithi111.stdout:9/918: mknod d2/d8/dd/d1a/d1e/d2d/d4a/c142 0 2023-12-08T20:27:58.781 INFO:tasks.workunit.client.1.smithi111.stdout:9/919: creat d2/d8/dd/d1a/d1e/d2d/db9/dd5/dfb/d11d/d139/f143 x:0 0 0 2023-12-08T20:27:58.784 INFO:tasks.workunit.client.1.smithi111.stdout:9/920: rename d2/d8/dd/d1a/d1e/d2d/d35/f95 to d2/d8/d8c/f144 0 2023-12-08T20:27:58.784 INFO:tasks.workunit.client.1.smithi111.stdout:9/921: chown d2/d8/dd/d1a/d1e/d2d/d4a/f5a 1 1 2023-12-08T20:27:58.784 INFO:tasks.workunit.client.1.smithi111.stdout:2/764: dwrite d1/d1d/d1f/d25/d3d/d41/f52 [0,4194304] 0 2023-12-08T20:27:58.785 INFO:tasks.workunit.client.1.smithi111.stdout:2/765: read d1/d1d/f5d [1908721,59489] 0 2023-12-08T20:27:58.785 INFO:tasks.workunit.client.1.smithi111.stdout:9/922: creat d2/d8/dd/d1a/d1e/d2d/d4a/f145 x:0 0 0 2023-12-08T20:27:58.786 INFO:tasks.workunit.client.1.smithi111.stdout:9/923: fdatasync d2/d8/dd/d1a/d1e/d2d/d35/d88/f99 0 2023-12-08T20:27:58.786 INFO:tasks.workunit.client.1.smithi111.stdout:2/766: mknod d1/d1d/d1f/d25/d3d/c11d 0 2023-12-08T20:27:58.787 INFO:tasks.workunit.client.1.smithi111.stdout:9/924: symlink d2/d8/d8c/l146 0 2023-12-08T20:27:58.788 INFO:tasks.workunit.client.1.smithi111.stdout:2/767: creat d1/d1d/f11e x:0 0 0 2023-12-08T20:27:58.788 INFO:tasks.workunit.client.1.smithi111.stdout:2/768: rename d1/d29/d4e to d1/d29/d4e/d11f 22 2023-12-08T20:27:58.788 INFO:tasks.workunit.client.1.smithi111.stdout:9/925: symlink d2/d8/d8c/d96/l147 0 2023-12-08T20:27:58.789 INFO:tasks.workunit.client.1.smithi111.stdout:2/769: dread d1/d1d/d1f/d25/d3d/d56/ffb [0,4194304] 0 2023-12-08T20:27:58.792 INFO:tasks.workunit.client.1.smithi111.stdout:2/770: dread d1/d29/d53/fd5 [0,4194304] 0 2023-12-08T20:27:58.792 INFO:tasks.workunit.client.1.smithi111.stdout:2/771: dread - d1/d29/d53/d90/fd2 zero size 2023-12-08T20:27:58.792 INFO:tasks.workunit.client.1.smithi111.stdout:2/772: readlink d1/d1d/d22/lc0 0 2023-12-08T20:27:58.793 INFO:tasks.workunit.client.1.smithi111.stdout:5/950: dwrite d3/d4/d7/d29/fe5 [0,4194304] 0 2023-12-08T20:27:58.794 INFO:tasks.workunit.client.1.smithi111.stdout:9/926: dread d2/d8/dd/d56/f85 [4194304,4194304] 0 2023-12-08T20:27:58.796 INFO:tasks.workunit.client.1.smithi111.stdout:5/951: truncate d3/d4/f53 2102061 0 2023-12-08T20:27:58.800 INFO:tasks.workunit.client.1.smithi111.stdout:5/952: rmdir d3/d12/dbd/dfa 0 2023-12-08T20:27:58.800 INFO:tasks.workunit.client.1.smithi111.stdout:5/953: write d3/d4/d7/d29/d73/d90/fb1 [3217555,1467] 0 2023-12-08T20:27:58.800 INFO:tasks.workunit.client.1.smithi111.stdout:5/954: truncate d3/d4/d7/d2c/f31 1747141 0 2023-12-08T20:27:58.800 INFO:tasks.workunit.client.1.smithi111.stdout:9/927: write d2/d8/dd/d1a/d1e/d2d/d35/f60 [1550232,1784] 0 2023-12-08T20:27:58.805 INFO:tasks.workunit.client.1.smithi111.stdout:9/928: rename d2/d8/dd/d1a/d1e/d2d/l32 to d2/d8/dd/d1a/d1e/d2d/l148 0 2023-12-08T20:27:58.805 INFO:tasks.workunit.client.1.smithi111.stdout:9/929: readlink d2/d8/dd/d1a/d1e/d2d/d35/d71/d105/l13c 0 2023-12-08T20:27:58.805 INFO:tasks.workunit.client.1.smithi111.stdout:9/930: mknod d2/d8/dd/d1a/d1e/d114/c149 0 2023-12-08T20:27:58.807 INFO:tasks.workunit.client.1.smithi111.stdout:9/931: getdents d2/d8/dd 0 2023-12-08T20:27:58.810 INFO:tasks.workunit.client.1.smithi111.stdout:2/773: dwrite d1/d1d/d22/f7d [0,4194304] 0 2023-12-08T20:27:58.810 INFO:tasks.workunit.client.1.smithi111.stdout:2/774: chown d1/d1d/d1f/d25/d3d/da2/fd3 222282312 1 2023-12-08T20:27:58.810 INFO:tasks.workunit.client.1.smithi111.stdout:2/775: dread - d1/d1d/d1f/d25/d3d/d56/d10a/f119 zero size 2023-12-08T20:27:58.811 INFO:tasks.workunit.client.1.smithi111.stdout:5/955: dread d3/d12/f7e [0,4194304] 0 2023-12-08T20:27:58.814 INFO:tasks.workunit.client.1.smithi111.stdout:2/776: rename d1/d1d/d1f/d25/d3d/d56/d101 to d1/d29/d53/d91/dbd/d120 0 2023-12-08T20:27:58.814 INFO:tasks.workunit.client.1.smithi111.stdout:2/777: chown d1/d1d/d1f/dc1/c102 3111356 1 2023-12-08T20:27:58.819 INFO:tasks.workunit.client.1.smithi111.stdout:5/956: mknod d3/d4/d7/d2c/c143 0 2023-12-08T20:27:58.821 INFO:tasks.workunit.client.1.smithi111.stdout:5/957: rename d3/d4/d4a/c1e to d3/d4/d4a/d21/dea/c144 0 2023-12-08T20:27:58.821 INFO:tasks.workunit.client.1.smithi111.stdout:5/958: stat d3/d4/c57 0 2023-12-08T20:27:58.826 INFO:tasks.workunit.client.1.smithi111.stdout:5/959: mknod d3/d4/d7/d29/d30/c145 0 2023-12-08T20:27:58.830 INFO:tasks.workunit.client.1.smithi111.stdout:9/932: dwrite d2/d8/f4d [0,4194304] 0 2023-12-08T20:27:58.831 INFO:tasks.workunit.client.1.smithi111.stdout:9/933: write d2/f2c [4753040,82386] 0 2023-12-08T20:27:58.833 INFO:tasks.workunit.client.1.smithi111.stdout:9/934: rmdir d2/d8/dd/d56 39 2023-12-08T20:27:58.833 INFO:tasks.workunit.client.1.smithi111.stdout:9/935: chown d2/da/f10f 8334357 1 2023-12-08T20:27:58.834 INFO:tasks.workunit.client.1.smithi111.stdout:9/936: rename d2/d8/dd/d1a/d1e/d2d/d35/d71/d105/l13c to d2/d8/dd/d1a/d1e/d2d/db9/l14a 0 2023-12-08T20:27:58.837 INFO:tasks.workunit.client.1.smithi111.stdout:9/937: link d2/d8/dd/d1a/d74/dbf/ff0 d2/d8/dd/d1a/d1e/de7/f14b 0 2023-12-08T20:27:58.837 INFO:tasks.workunit.client.1.smithi111.stdout:9/938: truncate d2/d8/dd/d1a/d74/f9f 734542 0 2023-12-08T20:27:58.837 INFO:tasks.workunit.client.1.smithi111.stdout:9/939: stat d2/d8/dd/d1a/d1e/d2d/db9/dd5/ldf 0 2023-12-08T20:27:58.837 INFO:tasks.workunit.client.1.smithi111.stdout:9/940: write d2/d8/d8c/d96/fff [558947,10219] 0 2023-12-08T20:27:58.837 INFO:tasks.workunit.client.1.smithi111.stdout:9/941: truncate d2/d8/dd/d1a/d74/dbf/f10e 1231214 0 2023-12-08T20:27:58.838 INFO:tasks.workunit.client.1.smithi111.stdout:9/942: dread - d2/d8/dd/d1a/d1e/de7/f106 zero size 2023-12-08T20:27:58.838 INFO:tasks.workunit.client.1.smithi111.stdout:9/943: mknod d2/d8/dd/d1a/d1e/d2d/df7/c14c 0 2023-12-08T20:27:58.838 INFO:tasks.workunit.client.1.smithi111.stdout:9/944: chown d2/da/f68 1572032190 1 2023-12-08T20:27:58.838 INFO:tasks.workunit.client.1.smithi111.stdout:9/945: dread - d2/d8/dd/d1a/d1e/d2d/d35/d88/f112 zero size 2023-12-08T20:27:58.840 INFO:tasks.workunit.client.1.smithi111.stdout:5/960: dwrite d3/d4/d7/d36/d82/ff6 [0,4194304] 0 2023-12-08T20:27:58.842 INFO:tasks.workunit.client.1.smithi111.stdout:9/946: dread d2/d8/d8c/d96/fff [0,4194304] 0 2023-12-08T20:27:58.843 INFO:tasks.workunit.client.1.smithi111.stdout:9/947: read d2/d8/dd/d1a/d1e/de7/f81 [2554784,128196] 0 2023-12-08T20:27:58.843 INFO:tasks.workunit.client.1.smithi111.stdout:9/948: write d2/d8/dd/d1a/d1e/d12e/f138 [141410,15789] 0 2023-12-08T20:27:58.843 INFO:tasks.workunit.client.1.smithi111.stdout:9/949: fdatasync d2/d8/dd/d1a/d1e/d2d/d4a/fab 0 2023-12-08T20:27:58.849 INFO:tasks.workunit.client.1.smithi111.stdout:5/961: rmdir d3/d4 39 2023-12-08T20:27:58.850 INFO:tasks.workunit.client.1.smithi111.stdout:5/962: rmdir d3/d12/d67/ddf/d108 39 2023-12-08T20:27:58.850 INFO:tasks.workunit.client.1.smithi111.stdout:5/963: write d3/d4/d7/d2c/f41 [1055858,103198] 0 2023-12-08T20:27:58.850 INFO:tasks.workunit.client.1.smithi111.stdout:5/964: chown d3/d4/d4a/c60 135752 1 2023-12-08T20:27:58.850 INFO:tasks.workunit.client.1.smithi111.stdout:5/965: mknod d3/d12/c146 0 2023-12-08T20:27:58.852 INFO:tasks.workunit.client.1.smithi111.stdout:9/950: dread d2/d8/dd/d56/f85 [0,4194304] 0 2023-12-08T20:27:58.855 INFO:tasks.workunit.client.1.smithi111.stdout:9/951: unlink d2/d8/dd/d1a/d1e/d2d/d4a/d62/ccb 0 2023-12-08T20:27:58.855 INFO:tasks.workunit.client.1.smithi111.stdout:9/952: write d2/d8/dd/d1a/d74/dbf/f103 [411381,7982] 0 2023-12-08T20:27:58.858 INFO:tasks.workunit.client.1.smithi111.stdout:9/953: rename d2/d8/dd/d1a/d1e/d2d/d4a/f5a to d2/d8/dd/d1a/d1e/d2d/db9/dd5/f14d 0 2023-12-08T20:27:58.869 INFO:tasks.workunit.client.1.smithi111.stdout:5/966: dwrite d3/d4/f5 [0,4194304] 0 2023-12-08T20:27:58.869 INFO:tasks.workunit.client.1.smithi111.stdout:5/967: dread - d3/d4/d7/d29/dd6/d122/f129 zero size 2023-12-08T20:27:58.870 INFO:tasks.workunit.client.1.smithi111.stdout:5/968: rmdir d3/d12/d67 39 2023-12-08T20:27:58.870 INFO:tasks.workunit.client.1.smithi111.stdout:5/969: fsync d3/d4/d7/d2c/f5a 0 2023-12-08T20:27:58.870 INFO:tasks.workunit.client.1.smithi111.stdout:5/970: chown d3/d4/d7/d36/lbb 31332523 1 2023-12-08T20:27:58.872 INFO:tasks.workunit.client.1.smithi111.stdout:5/971: rename d3/d4/d7/d36/d82/cf7 to d3/d12/c147 0 2023-12-08T20:27:58.872 INFO:tasks.workunit.client.1.smithi111.stdout:5/972: creat d3/d4/d7/d29/dd6/f148 x:0 0 0 2023-12-08T20:27:58.873 INFO:tasks.workunit.client.1.smithi111.stdout:5/973: symlink d3/d4/d7/d29/dd6/d122/l149 0 2023-12-08T20:27:58.873 INFO:tasks.workunit.client.1.smithi111.stdout:5/974: dread - d3/d4/d7/d36/fde zero size 2023-12-08T20:27:58.874 INFO:tasks.workunit.client.1.smithi111.stdout:5/975: getdents d3/d4/d7/d29/d73 0 2023-12-08T20:27:58.874 INFO:tasks.workunit.client.1.smithi111.stdout:5/976: stat d3/d4/d7/l94 0 2023-12-08T20:27:58.874 INFO:tasks.workunit.client.1.smithi111.stdout:5/977: chown d3/d4/d4a/d21/da5/f10c 2131 1 2023-12-08T20:27:58.874 INFO:tasks.workunit.client.1.smithi111.stdout:5/978: chown d3/d4/d4a/c40 726 1 2023-12-08T20:27:58.875 INFO:tasks.workunit.client.1.smithi111.stdout:5/979: mkdir d3/d4/d7/d29/d73/d90/d14a 0 2023-12-08T20:27:58.875 INFO:tasks.workunit.client.1.smithi111.stdout:5/980: readlink d3/d12/d67/l7d 0 2023-12-08T20:27:58.875 INFO:tasks.workunit.client.1.smithi111.stdout:5/981: fdatasync d3/d4/d7/d29/d73/f106 0 2023-12-08T20:27:58.876 INFO:tasks.workunit.client.1.smithi111.stdout:9/954: dwrite d2/d8/dd/d1a/d1e/d2d/d4a/d62/fb7 [0,4194304] 0 2023-12-08T20:27:58.876 INFO:tasks.workunit.client.1.smithi111.stdout:5/982: creat d3/d12/f14b x:0 0 0 2023-12-08T20:27:58.876 INFO:tasks.workunit.client.1.smithi111.stdout:5/983: stat d3/d4/d7/d29/d30 0 2023-12-08T20:27:58.877 INFO:tasks.workunit.client.1.smithi111.stdout:9/955: dread d2/d8/dd/d1a/d74/fdb [0,4194304] 0 2023-12-08T20:27:58.878 INFO:tasks.workunit.client.1.smithi111.stdout:5/984: symlink d3/d12/d104/l14c 0 2023-12-08T20:27:58.878 INFO:tasks.workunit.client.1.smithi111.stdout:5/985: dread - d3/d4/f127 zero size 2023-12-08T20:27:58.878 INFO:tasks.workunit.client.1.smithi111.stdout:5/986: readlink d3/d4/d7/d29/d73/d90/l134 0 2023-12-08T20:27:58.878 INFO:tasks.workunit.client.1.smithi111.stdout:9/956: creat d2/d8/dd/d1a/d1e/d2d/db9/dd5/dfb/d11d/f14e x:0 0 0 2023-12-08T20:27:58.879 INFO:tasks.workunit.client.1.smithi111.stdout:9/957: link d2/d8/dd/d1a/d74/f7a d2/da/d11e/d132/f14f 0 2023-12-08T20:27:58.880 INFO:tasks.workunit.client.1.smithi111.stdout:5/987: dread d3/d4/d7/d29/d73/d90/fdc [0,4194304] 0 2023-12-08T20:27:58.882 INFO:tasks.workunit.client.1.smithi111.stdout:5/988: creat d3/d4/d7/d36/d64/d8a/f14d x:0 0 0 2023-12-08T20:27:58.884 INFO:tasks.workunit.client.1.smithi111.stdout:5/989: mkdir d3/d4/d7/d36/df2/d14e 0 2023-12-08T20:27:58.890 INFO:tasks.workunit.client.1.smithi111.stdout:4/721: sync 2023-12-08T20:27:58.890 INFO:tasks.workunit.client.1.smithi111.stdout:4/722: stat d8/d30/d7d/d9b/db2/d4b/dd1/d1f/faa 0 2023-12-08T20:27:58.892 INFO:tasks.workunit.client.1.smithi111.stdout:4/723: rename d8/d30/d7d/d9b/db2/f3d to d8/d30/d7d/d9b/db2/d4b/db7/fe9 0 2023-12-08T20:27:58.894 INFO:tasks.workunit.client.1.smithi111.stdout:4/724: mkdir d8/da/db/d7f/d8e/dea 0 2023-12-08T20:27:58.895 INFO:tasks.workunit.client.1.smithi111.stdout:4/725: symlink d8/leb 0 2023-12-08T20:27:58.897 INFO:tasks.workunit.client.1.smithi111.stdout:4/726: link d8/da/db/f6b d8/d30/d7d/d9b/db2/d4b/dd1/d1f/fec 0 2023-12-08T20:27:58.898 INFO:tasks.workunit.client.1.smithi111.stdout:4/727: creat d8/d30/d7d/d9b/db2/fed x:0 0 0 2023-12-08T20:27:58.901 INFO:tasks.workunit.client.1.smithi111.stdout:4/728: creat d8/d30/d7d/d9b/db2/d4b/dd1/d1f/fee x:0 0 0 2023-12-08T20:27:58.901 INFO:tasks.workunit.client.1.smithi111.stdout:4/729: creat d8/da/d29/fef x:0 0 0 2023-12-08T20:27:58.902 INFO:tasks.workunit.client.1.smithi111.stdout:5/990: dwrite d3/f13b [0,4194304] 0 2023-12-08T20:27:58.902 INFO:tasks.workunit.client.1.smithi111.stdout:4/730: mkdir d8/d30/d7d/d9b/db2/df0 0 2023-12-08T20:27:58.903 INFO:tasks.workunit.client.1.smithi111.stdout:5/991: mkdir d3/d4/d4a/d14f 0 2023-12-08T20:27:58.904 INFO:tasks.workunit.client.1.smithi111.stdout:4/731: rename d8/da/d29/d5c/l7e to d8/d30/d7d/d9b/db2/d4b/dd1/lf1 0 2023-12-08T20:27:58.905 INFO:tasks.workunit.client.1.smithi111.stdout:5/992: creat d3/d4/d7/d29/dd6/d122/f150 x:0 0 0 2023-12-08T20:27:58.907 INFO:tasks.workunit.client.1.smithi111.stdout:4/732: rename d8/da/cac to d8/da/db/d7f/d8e/cf2 0 2023-12-08T20:27:58.907 INFO:tasks.workunit.client.1.smithi111.stdout:4/733: fdatasync d8/d30/d7d/d9b/db2/d4b/dd1/d1f/d40/f42 0 2023-12-08T20:27:58.909 INFO:tasks.workunit.client.1.smithi111.stdout:5/993: mkdir d3/d4/d4a/d21/da5/d151 0 2023-12-08T20:27:58.909 INFO:tasks.workunit.client.1.smithi111.stdout:5/994: chown d3/d4/d7/d2c/d84/c9c 227358 1 2023-12-08T20:27:58.909 INFO:tasks.workunit.client.1.smithi111.stdout:5/995: stat d3/d4/d7/d2c/c143 0 2023-12-08T20:27:58.910 INFO:tasks.workunit.client.1.smithi111.stdout:4/734: mkdir d8/da/db/d7f/df3 0 2023-12-08T20:27:58.911 INFO:tasks.workunit.client.1.smithi111.stdout:4/735: creat d8/d30/d7d/d9b/ff4 x:0 0 0 2023-12-08T20:27:58.911 INFO:tasks.workunit.client.1.smithi111.stdout:4/736: chown d8/da/db/d7f/d93/d77/db5/fb8 156476 1 2023-12-08T20:27:58.911 INFO:tasks.workunit.client.1.smithi111.stdout:4/737: chown d8/da/d29/d6e/f99 6804636 1 2023-12-08T20:27:58.913 INFO:tasks.workunit.client.1.smithi111.stdout:4/738: dread d8/da/db/d7f/f9e [0,4194304] 0 2023-12-08T20:27:58.913 INFO:tasks.workunit.client.1.smithi111.stdout:4/739: chown d8/da/d29/l7a 489907 1 2023-12-08T20:27:58.917 INFO:tasks.workunit.client.1.smithi111.stdout:5/996: dread d3/f13b [0,4194304] 0 2023-12-08T20:27:58.918 INFO:tasks.workunit.client.1.smithi111.stdout:5/997: rename d3/fbc to d3/d4/f152 0 2023-12-08T20:27:58.922 INFO:tasks.workunit.client.1.smithi111.stdout:5/998: creat d3/d4/d7/d2c/f153 x:0 0 0 2023-12-08T20:27:58.923 INFO:tasks.workunit.client.1.smithi111.stdout:5/999: creat d3/d4/d4a/d21/da5/d151/f154 x:0 0 0 2023-12-08T20:27:58.929 INFO:tasks.workunit.client.1.smithi111.stdout:4/740: dwrite d8/da/db/d7f/f5a [0,4194304] 0 2023-12-08T20:27:58.930 INFO:tasks.workunit.client.1.smithi111.stdout:4/741: rmdir d8/da/db/d7f/d93/d77 39 2023-12-08T20:27:58.930 INFO:tasks.workunit.client.1.smithi111.stdout:4/742: chown d8/dda/fd9 179322425 1 2023-12-08T20:27:58.931 INFO:tasks.workunit.client.1.smithi111.stdout:4/743: creat d8/d30/ff5 x:0 0 0 2023-12-08T20:27:58.932 INFO:tasks.workunit.client.1.smithi111.stdout:4/744: mkdir d8/df6 0 2023-12-08T20:27:58.933 INFO:tasks.workunit.client.1.smithi111.stdout:4/745: rename d8/da/d29/d6e/f99 to d8/da/d29/ff7 0 2023-12-08T20:27:58.934 INFO:tasks.workunit.client.1.smithi111.stdout:4/746: getdents d8/d30/d7d 0 2023-12-08T20:27:58.936 INFO:tasks.workunit.client.1.smithi111.stdout:4/747: creat d8/da/db/d7f/da7/ff8 x:0 0 0 2023-12-08T20:27:58.952 INFO:tasks.workunit.client.1.smithi111.stdout:4/748: dwrite d8/da/d29/f84 [0,4194304] 0 2023-12-08T20:27:58.952 INFO:tasks.workunit.client.1.smithi111.stdout:4/749: rename d8/da/db to d8/da/db/d7f/da7/df9 22 2023-12-08T20:27:58.974 INFO:tasks.workunit.client.1.smithi111.stdout:4/750: dwrite d8/da/d29/d6e/f96 [0,4194304] 0 2023-12-08T20:27:58.974 INFO:tasks.workunit.client.1.smithi111.stdout:4/751: fdatasync d8/d30/fd4 0 2023-12-08T20:27:58.993 INFO:tasks.workunit.client.1.smithi111.stdout:4/752: dwrite d8/da/d29/d5c/f89 [0,4194304] 0 2023-12-08T20:27:58.994 INFO:tasks.workunit.client.1.smithi111.stdout:4/753: stat d8/d30/fa3 0 2023-12-08T20:27:59.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:58 smithi043 ceph-mon[111966]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:27:59.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:27:58 smithi043 ceph-mon[111966]: pgmap v20: 65 pgs: 65 active+clean; 1.4 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 89 MiB/s rd, 176 MiB/s wr, 676 op/s 2023-12-08T20:27:59.019 INFO:tasks.workunit.client.0.smithi043.stdout:2/12: truncate d0/f1 3463797 0 2023-12-08T20:27:59.032 INFO:tasks.workunit.client.1.smithi111.stdout:4/754: rmdir d8/d30/d7d 39 2023-12-08T20:27:59.032 INFO:tasks.workunit.client.1.smithi111.stdout:4/755: write d8/d30/fd4 [878187,39986] 0 2023-12-08T20:27:59.037 INFO:tasks.workunit.client.1.smithi111.stdout:4/756: creat d8/da/d29/d69/ffa x:0 0 0 2023-12-08T20:27:59.060 INFO:tasks.workunit.client.1.smithi111.stdout:4/757: dwrite d8/da/d29/f39 [0,4194304] 0 2023-12-08T20:27:59.061 INFO:tasks.workunit.client.1.smithi111.stdout:4/758: unlink d8/da/d29/d5c/dca/ldd 0 2023-12-08T20:27:59.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:58 smithi111 ceph-mon[121341]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:27:59.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:27:58 smithi111 ceph-mon[121341]: pgmap v20: 65 pgs: 65 active+clean; 1.4 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 89 MiB/s rd, 176 MiB/s wr, 676 op/s 2023-12-08T20:27:59.319 INFO:tasks.workunit.client.1.smithi111.stdout:8/883: sync 2023-12-08T20:27:59.321 INFO:tasks.workunit.client.1.smithi111.stdout:8/884: rename dd/f29 to dd/d2d/d62/d83/f13a 0 2023-12-08T20:27:59.321 INFO:tasks.workunit.client.1.smithi111.stdout:8/885: write dd/d35/d7a/f7f [4338247,26534] 0 2023-12-08T20:27:59.321 INFO:tasks.workunit.client.1.smithi111.stdout:8/886: chown dd/d32/f48 4799013 1 2023-12-08T20:27:59.337 INFO:tasks.workunit.client.1.smithi111.stdout:8/887: dwrite dd/d2d/d62/d83/f134 [0,4194304] 0 2023-12-08T20:27:59.341 INFO:tasks.workunit.client.1.smithi111.stdout:8/888: symlink dd/dc9/l13b 0 2023-12-08T20:27:59.341 INFO:tasks.workunit.client.1.smithi111.stdout:8/889: write dd/d2d/d8b/d8d/fe8 [1265136,39411] 0 2023-12-08T20:27:59.342 INFO:tasks.workunit.client.1.smithi111.stdout:8/890: getdents dd/d35/d42 0 2023-12-08T20:27:59.344 INFO:tasks.workunit.client.1.smithi111.stdout:8/891: mknod dd/dc9/ddb/df0/c13c 0 2023-12-08T20:27:59.344 INFO:tasks.workunit.client.1.smithi111.stdout:8/892: write dd/d2d/d8b/d8d/ffa [295190,11377] 0 2023-12-08T20:27:59.344 INFO:tasks.workunit.client.1.smithi111.stdout:8/893: fsync dd/d35/d42/db4/fca 0 2023-12-08T20:27:59.344 INFO:tasks.workunit.client.1.smithi111.stdout:8/894: chown dd/d32/f125 33010 1 2023-12-08T20:27:59.347 INFO:tasks.workunit.client.1.smithi111.stdout:8/895: link dd/d32/d3d/d55/f89 dd/d32/d3d/d6b/f13d 0 2023-12-08T20:27:59.347 INFO:tasks.workunit.client.1.smithi111.stdout:8/896: truncate dd/fbb 1887782 0 2023-12-08T20:27:59.347 INFO:tasks.workunit.client.1.smithi111.stdout:8/897: write dd/d32/f48 [5160437,87209] 0 2023-12-08T20:27:59.349 INFO:tasks.workunit.client.1.smithi111.stdout:8/898: mkdir dd/dc9/ddb/df8/d13e 0 2023-12-08T20:27:59.349 INFO:tasks.workunit.client.1.smithi111.stdout:8/899: write dd/d35/d42/fd1 [935436,13046] 0 2023-12-08T20:27:59.349 INFO:tasks.workunit.client.1.smithi111.stdout:8/900: write dd/d35/d7a/fac [1189830,44649] 0 2023-12-08T20:27:59.350 INFO:tasks.workunit.client.1.smithi111.stdout:8/901: creat dd/d96/f13f x:0 0 0 2023-12-08T20:27:59.352 INFO:tasks.workunit.client.1.smithi111.stdout:8/902: rename dd/d2d/f31 to dd/d32/dea/df1/f140 0 2023-12-08T20:27:59.362 INFO:tasks.workunit.client.1.smithi111.stdout:8/903: dread dd/d2d/d62/d83/fc5 [0,4194304] 0 2023-12-08T20:27:59.363 INFO:tasks.workunit.client.1.smithi111.stdout:8/904: unlink dd/d35/d7a/c81 0 2023-12-08T20:27:59.364 INFO:tasks.workunit.client.1.smithi111.stdout:8/905: getdents dd/d32/d36/d119 0 2023-12-08T20:27:59.366 INFO:tasks.workunit.client.1.smithi111.stdout:8/906: dread dd/d2d/d62/fe3 [0,4194304] 0 2023-12-08T20:27:59.450 INFO:tasks.workunit.client.1.smithi111.stdout:3/719: sync 2023-12-08T20:27:59.576 INFO:tasks.workunit.client.1.smithi111.stdout:4/759: sync 2023-12-08T20:27:59.576 INFO:tasks.workunit.client.1.smithi111.stdout:2/778: sync 2023-12-08T20:27:59.576 INFO:tasks.workunit.client.1.smithi111.stdout:6/709: sync 2023-12-08T20:27:59.576 INFO:tasks.workunit.client.1.smithi111.stdout:9/958: sync 2023-12-08T20:27:59.576 INFO:tasks.workunit.client.1.smithi111.stdout:1/798: sync 2023-12-08T20:27:59.576 INFO:tasks.workunit.client.1.smithi111.stdout:7/801: sync 2023-12-08T20:27:59.577 INFO:tasks.workunit.client.1.smithi111.stdout:9/959: dread d2/d8/d8c/dbb/f108 [0,4194304] 0 2023-12-08T20:27:59.577 INFO:tasks.workunit.client.1.smithi111.stdout:9/960: truncate d2/d8/dd/d1a/d1e/d2d/d4a/d62/fcf 1125229 0 2023-12-08T20:27:59.577 INFO:tasks.workunit.client.1.smithi111.stdout:9/961: truncate d2/d8/d8c/d96/f9e 177435 0 2023-12-08T20:27:59.577 INFO:tasks.workunit.client.1.smithi111.stdout:7/802: mknod da/d5c/d59/d61/c107 0 2023-12-08T20:27:59.579 INFO:tasks.workunit.client.1.smithi111.stdout:6/710: creat d0/d68/d95/fe6 x:0 0 0 2023-12-08T20:27:59.581 INFO:tasks.workunit.client.1.smithi111.stdout:1/799: symlink d0/d8e/db0/d10d/l112 0 2023-12-08T20:27:59.582 INFO:tasks.workunit.client.1.smithi111.stdout:1/800: write d0/d4d/f8c [159866,15164] 0 2023-12-08T20:27:59.583 INFO:tasks.workunit.client.1.smithi111.stdout:9/962: unlink d2/d8/dd/c64 0 2023-12-08T20:27:59.586 INFO:tasks.workunit.client.1.smithi111.stdout:7/803: link da/d13/c31 da/d38/d80/c108 0 2023-12-08T20:27:59.588 INFO:tasks.workunit.client.1.smithi111.stdout:1/801: symlink d0/d22/l113 0 2023-12-08T20:27:59.589 INFO:tasks.workunit.client.1.smithi111.stdout:9/963: symlink d2/d8/dd/d1a/d1e/d2d/db9/dd5/l150 0 2023-12-08T20:27:59.591 INFO:tasks.workunit.client.1.smithi111.stdout:1/802: unlink d0/d6/d33/d60/ffb 0 2023-12-08T20:27:59.601 INFO:tasks.workunit.client.1.smithi111.stdout:4/760: dwrite d8/da/d29/ff7 [0,4194304] 0 2023-12-08T20:27:59.601 INFO:tasks.workunit.client.1.smithi111.stdout:4/761: chown d8/d30/d7d/d9b/la1 235687 1 2023-12-08T20:27:59.602 INFO:tasks.workunit.client.1.smithi111.stdout:2/779: dwrite d1/d29/d4e/ddc/fe0 [0,4194304] 0 2023-12-08T20:27:59.602 INFO:tasks.workunit.client.1.smithi111.stdout:2/780: fdatasync d1/d29/d53/f82 0 2023-12-08T20:27:59.602 INFO:tasks.workunit.client.1.smithi111.stdout:4/762: write d8/dda/fa4 [815424,94779] 0 2023-12-08T20:27:59.605 INFO:tasks.workunit.client.1.smithi111.stdout:2/781: truncate d1/d1d/d22/f39 1985966 0 2023-12-08T20:27:59.607 INFO:tasks.workunit.client.1.smithi111.stdout:4/763: rename d8/d30/f82 to d8/da/d29/ffb 0 2023-12-08T20:27:59.608 INFO:tasks.workunit.client.1.smithi111.stdout:4/764: read d8/da/db/f8d [1000164,19303] 0 2023-12-08T20:27:59.608 INFO:tasks.workunit.client.1.smithi111.stdout:2/782: creat d1/d1d/d1f/d25/d3d/d56/d10a/f121 x:0 0 0 2023-12-08T20:27:59.609 INFO:tasks.workunit.client.1.smithi111.stdout:4/765: unlink d8/d30/d7d/d9b/db2/d4b/l68 0 2023-12-08T20:27:59.611 INFO:tasks.workunit.client.1.smithi111.stdout:2/783: mknod d1/d1d/d22/c122 0 2023-12-08T20:27:59.612 INFO:tasks.workunit.client.1.smithi111.stdout:4/766: symlink d8/da/d29/d5c/dbe/lfc 0 2023-12-08T20:27:59.612 INFO:tasks.workunit.client.1.smithi111.stdout:4/767: fdatasync d8/da/db/d7f/d8e/fe6 0 2023-12-08T20:27:59.613 INFO:tasks.workunit.client.1.smithi111.stdout:7/804: dwrite da/d13/d9e/d75/f99 [0,4194304] 0 2023-12-08T20:27:59.613 INFO:tasks.workunit.client.1.smithi111.stdout:1/803: dwrite d0/d6/d33/d15/d51/d2e/d61/ff0 [0,4194304] 0 2023-12-08T20:27:59.613 INFO:tasks.workunit.client.1.smithi111.stdout:9/964: dwrite d2/d8/dd/d1a/d1e/d2d/f51 [4194304,4194304] 0 2023-12-08T20:27:59.613 INFO:tasks.workunit.client.1.smithi111.stdout:4/768: truncate d8/d30/d7d/d9b/db2/d4b/dd1/d1f/f52 1259377 0 2023-12-08T20:27:59.614 INFO:tasks.workunit.client.1.smithi111.stdout:1/804: write d0/d6/d34/f52 [1561294,52899] 0 2023-12-08T20:27:59.623 INFO:tasks.workunit.client.1.smithi111.stdout:1/805: mkdir d0/d6/d33/d15/d51/d5b/d114 0 2023-12-08T20:27:59.623 INFO:tasks.workunit.client.1.smithi111.stdout:1/806: write d0/d6/d33/d15/d51/d2e/d61/d79/f90 [831970,103081] 0 2023-12-08T20:27:59.624 INFO:tasks.workunit.client.1.smithi111.stdout:7/805: dread da/d25/d26/f4d [0,4194304] 0 2023-12-08T20:27:59.625 INFO:tasks.workunit.client.1.smithi111.stdout:1/807: link d0/d6/d33/d60/ca2 d0/d6/d33/d15/d51/d5b/d114/c115 0 2023-12-08T20:27:59.627 INFO:tasks.workunit.client.1.smithi111.stdout:2/784: fsync d1/d1d/d22/f39 0 2023-12-08T20:27:59.627 INFO:tasks.workunit.client.1.smithi111.stdout:2/785: fsync d1/d1d/f16 0 2023-12-08T20:27:59.627 INFO:tasks.workunit.client.1.smithi111.stdout:2/786: fdatasync d1/d29/d4e/ddc/fe0 0 2023-12-08T20:27:59.627 INFO:tasks.workunit.client.1.smithi111.stdout:2/787: read - d1/d29/d53/d90/d118/fcd zero size 2023-12-08T20:27:59.629 INFO:tasks.workunit.client.1.smithi111.stdout:2/788: symlink d1/d1d/d1f/dc1/l123 0 2023-12-08T20:27:59.637 INFO:tasks.workunit.client.1.smithi111.stdout:2/789: dread d1/d1d/f16 [0,4194304] 0 2023-12-08T20:27:59.637 INFO:tasks.workunit.client.1.smithi111.stdout:7/806: dread da/d25/d26/d32/d3e/f42 [0,4194304] 0 2023-12-08T20:27:59.637 INFO:tasks.workunit.client.1.smithi111.stdout:7/807: write da/d25/d26/d32/dcd/ff8 [733408,34770] 0 2023-12-08T20:27:59.638 INFO:tasks.workunit.client.1.smithi111.stdout:7/808: chown da/d38/f8f 60 1 2023-12-08T20:27:59.638 INFO:tasks.workunit.client.1.smithi111.stdout:2/790: write d1/d29/d53/d90/f6e [2328504,47887] 0 2023-12-08T20:27:59.638 INFO:tasks.workunit.client.1.smithi111.stdout:7/809: mknod da/d13/d9e/d75/d9f/c109 0 2023-12-08T20:27:59.639 INFO:tasks.workunit.client.1.smithi111.stdout:2/791: truncate d1/d1d/d1f/d25/d3d/d41/f6c 542575 0 2023-12-08T20:27:59.639 INFO:tasks.workunit.client.1.smithi111.stdout:2/792: dread - d1/d29/d4e/ddc/fdd zero size 2023-12-08T20:27:59.642 INFO:tasks.workunit.client.1.smithi111.stdout:4/769: dwrite d8/da/d29/d6e/f90 [0,4194304] 0 2023-12-08T20:27:59.643 INFO:tasks.workunit.client.1.smithi111.stdout:9/965: dwrite d2/d8/dd/d1a/d74/f82 [4194304,4194304] 0 2023-12-08T20:27:59.644 INFO:tasks.workunit.client.1.smithi111.stdout:4/770: symlink d8/d30/d7d/d9b/db2/d4b/dd1/dde/lfd 0 2023-12-08T20:27:59.644 INFO:tasks.workunit.client.1.smithi111.stdout:4/771: readlink d8/d30/d7d/d9b/db2/d4b/dd1/d1f/d40/l50 0 2023-12-08T20:27:59.645 INFO:tasks.workunit.client.1.smithi111.stdout:1/808: dwrite d0/d6/f105 [0,4194304] 0 2023-12-08T20:27:59.646 INFO:tasks.workunit.client.1.smithi111.stdout:9/966: symlink d2/d8/dd/d1a/d1e/d2d/db9/dd5/dfb/l151 0 2023-12-08T20:27:59.651 INFO:tasks.workunit.client.1.smithi111.stdout:1/809: mkdir d0/d6/d33/d15/d51/d5b/d116 0 2023-12-08T20:27:59.651 INFO:tasks.workunit.client.1.smithi111.stdout:1/810: chown d0/d6/d33/d15/d51/d5b/fb3 109459581 1 2023-12-08T20:27:59.651 INFO:tasks.workunit.client.1.smithi111.stdout:1/811: chown d0/d6/d33/d15/d51/l4b 477679221 1 2023-12-08T20:27:59.654 INFO:tasks.workunit.client.1.smithi111.stdout:9/967: rmdir d2/d8/dd/d1a/d1e/d2d/d35/d71/dfa 0 2023-12-08T20:27:59.654 INFO:tasks.workunit.client.1.smithi111.stdout:9/968: dread - d2/d8/dd/d1a/d1e/d2d/db9/dd5/dfb/d11d/f141 zero size 2023-12-08T20:27:59.655 INFO:tasks.workunit.client.1.smithi111.stdout:9/969: write d2/d8/dd/d1a/d1e/d2d/d4a/d62/fcf [1947844,21211] 0 2023-12-08T20:27:59.656 INFO:tasks.workunit.client.1.smithi111.stdout:9/970: dread d2/d8/dd/d1a/d1e/d2d/fe3 [0,4194304] 0 2023-12-08T20:27:59.656 INFO:tasks.workunit.client.1.smithi111.stdout:9/971: write d2/d8/dd/d1a/d1e/d2d/f4b [8975657,12917] 0 2023-12-08T20:27:59.658 INFO:tasks.workunit.client.1.smithi111.stdout:9/972: mkdir d2/d8/dd/d1a/d1e/d2d/db9/dd5/dfb/d152 0 2023-12-08T20:27:59.663 INFO:tasks.workunit.client.1.smithi111.stdout:1/812: dread d0/d6/d33/f4f [0,4194304] 0 2023-12-08T20:27:59.663 INFO:tasks.workunit.client.1.smithi111.stdout:7/810: dwrite da/d13/fad [0,4194304] 0 2023-12-08T20:27:59.664 INFO:tasks.workunit.client.1.smithi111.stdout:4/772: dwrite d8/da/d29/ff7 [0,4194304] 0 2023-12-08T20:27:59.664 INFO:tasks.workunit.client.1.smithi111.stdout:4/773: fsync d8/d30/d7d/d9b/db2/d4b/dd1/d1f/f1a 0 2023-12-08T20:27:59.664 INFO:tasks.workunit.client.1.smithi111.stdout:9/973: unlink d2/d8/d8c/d96/fb3 0 2023-12-08T20:27:59.664 INFO:tasks.workunit.client.1.smithi111.stdout:7/811: read da/d5c/d59/fbc [825246,300] 0 2023-12-08T20:27:59.666 INFO:tasks.workunit.client.1.smithi111.stdout:1/813: rename d0/f71 to d0/d6/d33/d15/d51/d2e/d61/d79/dac/f117 0 2023-12-08T20:27:59.672 INFO:tasks.workunit.client.1.smithi111.stdout:4/774: getdents d8/d30/d7d/d9b/db2/d4b/dd1/dde 0 2023-12-08T20:27:59.673 INFO:tasks.workunit.client.1.smithi111.stdout:4/775: truncate d8/d30/d7d/d9b/db2/fb6 171012 0 2023-12-08T20:27:59.674 INFO:tasks.workunit.client.1.smithi111.stdout:9/974: symlink d2/d8/dd/d1a/l153 0 2023-12-08T20:27:59.675 INFO:tasks.workunit.client.1.smithi111.stdout:9/975: read d2/d8/dd/d1a/d1e/d2d/f51 [1927671,117873] 0 2023-12-08T20:27:59.678 INFO:tasks.workunit.client.1.smithi111.stdout:7/812: mkdir da/d13/d10a 0 2023-12-08T20:27:59.678 INFO:tasks.workunit.client.1.smithi111.stdout:7/813: write da/d25/d26/d32/d87/faa [718842,22195] 0 2023-12-08T20:27:59.679 INFO:tasks.workunit.client.1.smithi111.stdout:4/776: getdents d8/da/d29/d5c 0 2023-12-08T20:27:59.679 INFO:tasks.workunit.client.1.smithi111.stdout:4/777: stat d8/da/d29/d6e 0 2023-12-08T20:27:59.680 INFO:tasks.workunit.client.1.smithi111.stdout:9/976: mkdir d2/d8/dd/d1a/d1e/d2d/d35/d6b/d154 0 2023-12-08T20:27:59.680 INFO:tasks.workunit.client.1.smithi111.stdout:1/814: dwrite d0/d6/d33/d60/f7f [0,4194304] 0 2023-12-08T20:27:59.681 INFO:tasks.workunit.client.1.smithi111.stdout:1/815: readlink d0/d22/l113 0 2023-12-08T20:27:59.682 INFO:tasks.workunit.client.1.smithi111.stdout:7/814: mkdir da/d5c/d6e/d10b 0 2023-12-08T20:27:59.684 INFO:tasks.workunit.client.1.smithi111.stdout:9/977: mkdir d2/d8/dd/d1a/d1e/d2d/d35/d71/d105/d155 0 2023-12-08T20:27:59.684 INFO:tasks.workunit.client.1.smithi111.stdout:9/978: write d2/d8/dd/d1a/d1e/d2d/d4a/d62/fb7 [2981573,56411] 0 2023-12-08T20:27:59.685 INFO:tasks.workunit.client.1.smithi111.stdout:9/979: read d2/d8/f4d [617314,9053] 0 2023-12-08T20:27:59.685 INFO:tasks.workunit.client.1.smithi111.stdout:9/980: chown d2/da/d11e/d132/f14f 3626022 1 2023-12-08T20:27:59.685 INFO:tasks.workunit.client.1.smithi111.stdout:9/981: write d2/d8/dd/d1a/d1e/d2d/d35/d71/d105/f93 [4645369,107409] 0 2023-12-08T20:27:59.685 INFO:tasks.workunit.client.1.smithi111.stdout:9/982: dread - d2/d8/dd/d1a/d1e/d2d/d4a/f125 zero size 2023-12-08T20:27:59.686 INFO:tasks.workunit.client.1.smithi111.stdout:1/816: mknod d0/d6/d33/c118 0 2023-12-08T20:27:59.689 INFO:tasks.workunit.client.1.smithi111.stdout:7/815: truncate da/d25/d3d/fa5 3122371 0 2023-12-08T20:27:59.694 INFO:tasks.workunit.client.1.smithi111.stdout:7/816: mknod da/d5c/d6e/c10c 0 2023-12-08T20:27:59.699 INFO:tasks.workunit.client.1.smithi111.stdout:3/720: sync 2023-12-08T20:27:59.699 INFO:tasks.workunit.client.1.smithi111.stdout:8/907: sync 2023-12-08T20:27:59.699 INFO:tasks.workunit.client.1.smithi111.stdout:3/721: dread - d2/d12/d2e/dc6/d93/fe4 zero size 2023-12-08T20:27:59.700 INFO:tasks.workunit.client.1.smithi111.stdout:7/817: mkdir da/d5c/d6e/d10b/d10d 0 2023-12-08T20:27:59.700 INFO:tasks.workunit.client.1.smithi111.stdout:3/722: write d2/d3/d13/d36/d69/f7a [1001138,123345] 0 2023-12-08T20:27:59.700 INFO:tasks.workunit.client.1.smithi111.stdout:7/818: write da/d25/d26/f41 [1003176,54126] 0 2023-12-08T20:27:59.700 INFO:tasks.workunit.client.1.smithi111.stdout:3/723: write d2/d3/d13/d36/d69/f7d [6828973,58500] 0 2023-12-08T20:27:59.701 INFO:tasks.workunit.client.1.smithi111.stdout:9/983: dwrite d2/d8/dd/d1a/d1e/d2d/f31 [0,4194304] 0 2023-12-08T20:27:59.702 INFO:tasks.workunit.client.1.smithi111.stdout:7/819: mkdir da/d64/d10e 0 2023-12-08T20:27:59.702 INFO:tasks.workunit.client.1.smithi111.stdout:8/908: write dd/f12 [1405918,104208] 0 2023-12-08T20:27:59.704 INFO:tasks.workunit.client.1.smithi111.stdout:3/724: rename d2/d15/d17/d5e/d62/fd8 to d2/d3/d6/fe7 0 2023-12-08T20:27:59.705 INFO:tasks.workunit.client.1.smithi111.stdout:9/984: truncate d2/d8/d8c/d96/f9e 104770 0 2023-12-08T20:27:59.706 INFO:tasks.workunit.client.1.smithi111.stdout:8/909: getdents dd/d2d/d62/d8c 0 2023-12-08T20:27:59.708 INFO:tasks.workunit.client.1.smithi111.stdout:7/820: rename da/d25/cd5 to da/d13/c10f 0 2023-12-08T20:27:59.708 INFO:tasks.workunit.client.1.smithi111.stdout:7/821: chown da/d38/d80/l84 1780575 1 2023-12-08T20:27:59.709 INFO:tasks.workunit.client.1.smithi111.stdout:8/910: rmdir dd/d32/d3d/dd4 39 2023-12-08T20:27:59.713 INFO:tasks.workunit.client.1.smithi111.stdout:3/725: rename d2/d15/d17/f43 to d2/d12/dbd/fe8 0 2023-12-08T20:27:59.713 INFO:tasks.workunit.client.1.smithi111.stdout:3/726: readlink d2/d15/d17/d25/l45 0 2023-12-08T20:27:59.714 INFO:tasks.workunit.client.1.smithi111.stdout:7/822: symlink da/d25/da9/db8/l110 0 2023-12-08T20:27:59.715 INFO:tasks.workunit.client.1.smithi111.stdout:7/823: read da/d25/d26/d32/dcd/ff8 [504631,81898] 0 2023-12-08T20:27:59.717 INFO:tasks.workunit.client.1.smithi111.stdout:8/911: unlink dd/d32/dea/df1/l127 0 2023-12-08T20:27:59.719 INFO:tasks.workunit.client.1.smithi111.stdout:3/727: unlink d2/d12/d2e/l3f 0 2023-12-08T20:27:59.720 INFO:tasks.workunit.client.1.smithi111.stdout:8/912: symlink dd/d2d/d62/d83/d137/l141 0 2023-12-08T20:27:59.722 INFO:tasks.workunit.client.1.smithi111.stdout:3/728: dread d2/d3/fd5 [0,4194304] 0 2023-12-08T20:27:59.722 INFO:tasks.workunit.client.1.smithi111.stdout:3/729: chown d2/d12/dbd 13139 1 2023-12-08T20:27:59.725 INFO:tasks.workunit.client.1.smithi111.stdout:9/985: dwrite d2/d8/dd/d1a/d1e/d2d/d4a/d62/fcf [0,4194304] 0 2023-12-08T20:27:59.725 INFO:tasks.workunit.client.1.smithi111.stdout:3/730: dread d2/d15/d17/d25/de0/f4f [0,4194304] 0 2023-12-08T20:27:59.730 INFO:tasks.workunit.client.1.smithi111.stdout:3/731: creat d2/d12/d4a/fe9 x:0 0 0 2023-12-08T20:27:59.731 INFO:tasks.workunit.client.1.smithi111.stdout:9/986: mkdir d2/d8/dd/d1a/d1e/d2d/d35/d6b/d154/d156 0 2023-12-08T20:27:59.731 INFO:tasks.workunit.client.1.smithi111.stdout:3/732: fsync d2/d15/d17/d5e/da6/fd1 0 2023-12-08T20:27:59.731 INFO:tasks.workunit.client.1.smithi111.stdout:3/733: write d2/d15/d17/d5e/fe6 [494129,72866] 0 2023-12-08T20:27:59.731 INFO:tasks.workunit.client.1.smithi111.stdout:9/987: rename d2/d8/dd/d1a/d1e/de7/c6d to d2/d8/dd/d56/c157 0 2023-12-08T20:27:59.733 INFO:tasks.workunit.client.1.smithi111.stdout:9/988: rename d2/d8/dd/fb4 to d2/d8/dd/d1a/d1e/d2d/d35/f158 0 2023-12-08T20:27:59.735 INFO:tasks.workunit.client.1.smithi111.stdout:8/913: dwrite dd/d35/d42/f104 [0,4194304] 0 2023-12-08T20:27:59.735 INFO:tasks.workunit.client.1.smithi111.stdout:8/914: write dd/d35/d42/fd1 [1777716,25816] 0 2023-12-08T20:27:59.737 INFO:tasks.workunit.client.1.smithi111.stdout:9/989: unlink d2/d8/dd/d56/cfd 0 2023-12-08T20:27:59.737 INFO:tasks.workunit.client.1.smithi111.stdout:9/990: dread - d2/f11b zero size 2023-12-08T20:27:59.737 INFO:tasks.workunit.client.1.smithi111.stdout:9/991: stat d2/d8/dd/d1a/d1e/d114 0 2023-12-08T20:27:59.738 INFO:tasks.workunit.client.1.smithi111.stdout:8/915: mkdir dd/d35/d42/db4/d142 0 2023-12-08T20:27:59.741 INFO:tasks.workunit.client.1.smithi111.stdout:8/916: rename dd/d32/d3d to dd/d2d/d62/d143 0 2023-12-08T20:27:59.743 INFO:tasks.workunit.client.1.smithi111.stdout:8/917: link dd/d2d/d62/lc7 dd/d2d/d62/d143/d55/l144 0 2023-12-08T20:27:59.744 INFO:tasks.workunit.client.1.smithi111.stdout:8/918: getdents dd/d35 0 2023-12-08T20:27:59.744 INFO:tasks.workunit.client.1.smithi111.stdout:8/919: chown dd/d2d/d62/d143/d6b/f6f 16 1 2023-12-08T20:27:59.744 INFO:tasks.workunit.client.1.smithi111.stdout:8/920: truncate dd/d32/f48 4218538 0 2023-12-08T20:27:59.745 INFO:tasks.workunit.client.1.smithi111.stdout:8/921: symlink dd/d2d/d62/d143/d6b/l145 0 2023-12-08T20:27:59.746 INFO:tasks.workunit.client.1.smithi111.stdout:8/922: creat dd/d2d/d62/d83/d137/f146 x:0 0 0 2023-12-08T20:27:59.767 INFO:tasks.workunit.client.1.smithi111.stdout:3/734: write d2/d3/d6/fd [2956360,32213] 0 2023-12-08T20:27:59.768 INFO:tasks.workunit.client.1.smithi111.stdout:7/824: dwrite da/d5c/d59/df2/f106 [0,4194304] 0 2023-12-08T20:27:59.772 INFO:tasks.workunit.client.1.smithi111.stdout:3/735: unlink d2/d15/d17/d25/l83 0 2023-12-08T20:27:59.773 INFO:tasks.workunit.client.1.smithi111.stdout:3/736: write d2/d12/f65 [4171708,83766] 0 2023-12-08T20:27:59.773 INFO:tasks.workunit.client.1.smithi111.stdout:3/737: rename d2/d3/d51 to d2/d3/d51/dea 22 2023-12-08T20:27:59.773 INFO:tasks.workunit.client.1.smithi111.stdout:9/992: dwrite d2/d8/dd/d1a/d1e/d114/f13d [0,4194304] 0 2023-12-08T20:27:59.775 INFO:tasks.workunit.client.1.smithi111.stdout:7/825: creat da/d25/d26/d32/d3e/d97/f111 x:0 0 0 2023-12-08T20:27:59.778 INFO:tasks.workunit.client.1.smithi111.stdout:7/826: dread da/d25/d26/d32/d3e/f42 [0,4194304] 0 2023-12-08T20:27:59.778 INFO:tasks.workunit.client.1.smithi111.stdout:7/827: chown da/d25/d3d/d58/lc5 10953 1 2023-12-08T20:27:59.781 INFO:tasks.workunit.client.1.smithi111.stdout:3/738: mkdir d2/d3/d51/deb 0 2023-12-08T20:27:59.785 INFO:tasks.workunit.client.1.smithi111.stdout:9/993: link d2/d8/dd/d1a/d1e/d2d/d4a/l5c d2/d8/dd/d1a/d1e/d12e/l159 0 2023-12-08T20:27:59.785 INFO:tasks.workunit.client.1.smithi111.stdout:9/994: chown d2/d8/d8c/dbb/f108 1 1 2023-12-08T20:27:59.791 INFO:tasks.workunit.client.1.smithi111.stdout:3/739: write d2/d15/d17/d5e/fe6 [1565625,39228] 0 2023-12-08T20:27:59.795 INFO:tasks.workunit.client.1.smithi111.stdout:9/995: symlink d2/d8/dd/d1a/d1e/d2d/d4a/l15a 0 2023-12-08T20:27:59.798 INFO:tasks.workunit.client.1.smithi111.stdout:9/996: mknod d2/d8/dd/d1a/d1e/d2d/d35/d88/c15b 0 2023-12-08T20:27:59.800 INFO:tasks.workunit.client.1.smithi111.stdout:9/997: mknod d2/d8/d118/c15c 0 2023-12-08T20:27:59.805 INFO:tasks.workunit.client.1.smithi111.stdout:7/828: rename da/d25/d26/d32/d3e to da/d25/d26/d112 0 2023-12-08T20:27:59.808 INFO:tasks.workunit.client.1.smithi111.stdout:3/740: dwrite d2/d15/d17/d5e/f96 [0,4194304] 0 2023-12-08T20:27:59.808 INFO:tasks.workunit.client.1.smithi111.stdout:3/741: chown d2/d3/d13/d36/d44/d8f/l92 1 1 2023-12-08T20:27:59.808 INFO:tasks.workunit.client.1.smithi111.stdout:3/742: write d2/f34 [1548753,83887] 0 2023-12-08T20:27:59.809 INFO:tasks.workunit.client.1.smithi111.stdout:7/829: rename da/d5c/c101 to da/d5c/d59/df2/c113 0 2023-12-08T20:27:59.812 INFO:tasks.workunit.client.1.smithi111.stdout:3/743: creat d2/d3/d13/d36/d69/d81/fec x:0 0 0 2023-12-08T20:27:59.814 INFO:tasks.workunit.client.1.smithi111.stdout:3/744: symlink d2/d15/dcf/led 0 2023-12-08T20:27:59.815 INFO:tasks.workunit.client.1.smithi111.stdout:7/830: mknod da/d5c/c114 0 2023-12-08T20:27:59.817 INFO:tasks.workunit.client.1.smithi111.stdout:3/745: rmdir d2/d12/d2e/dc6 39 2023-12-08T20:27:59.819 INFO:tasks.workunit.client.1.smithi111.stdout:7/831: creat da/d25/dd9/f115 x:0 0 0 2023-12-08T20:27:59.820 INFO:tasks.workunit.client.1.smithi111.stdout:7/832: write da/d13/f45 [512320,54641] 0 2023-12-08T20:27:59.821 INFO:tasks.workunit.client.1.smithi111.stdout:7/833: dread da/d25/d26/f2b [0,4194304] 0 2023-12-08T20:27:59.834 INFO:tasks.workunit.client.1.smithi111.stdout:7/834: fsync da/d13/f45 0 2023-12-08T20:27:59.834 INFO:tasks.workunit.client.1.smithi111.stdout:3/746: dwrite d2/d12/f4b [4194304,4194304] 0 2023-12-08T20:27:59.834 INFO:tasks.workunit.client.1.smithi111.stdout:3/747: chown d2/d3/d13/d36/d44 732446 1 2023-12-08T20:27:59.835 INFO:tasks.workunit.client.1.smithi111.stdout:7/835: mknod da/d25/c116 0 2023-12-08T20:27:59.836 INFO:tasks.workunit.client.1.smithi111.stdout:3/748: getdents d2/d3/d51/d88 0 2023-12-08T20:27:59.837 INFO:tasks.workunit.client.1.smithi111.stdout:3/749: dread - d2/d3/d13/d36/d44/f7c zero size 2023-12-08T20:27:59.838 INFO:tasks.workunit.client.1.smithi111.stdout:3/750: symlink d2/d3/d13/d36/d44/lee 0 2023-12-08T20:27:59.839 INFO:tasks.workunit.client.1.smithi111.stdout:3/751: truncate d2/d3/d51/d88/fd6 2469009 0 2023-12-08T20:27:59.840 INFO:tasks.workunit.client.1.smithi111.stdout:3/752: getdents d2/d3/d13/d36/d69 0 2023-12-08T20:27:59.840 INFO:tasks.workunit.client.1.smithi111.stdout:3/753: fsync d2/d3/d13/d36/d69/f7d 0 2023-12-08T20:27:59.843 INFO:tasks.workunit.client.1.smithi111.stdout:3/754: creat d2/d15/d17/d25/fef x:0 0 0 2023-12-08T20:27:59.843 INFO:tasks.workunit.client.1.smithi111.stdout:3/755: chown d2/d12/d2e/c37 1912564 1 2023-12-08T20:27:59.845 INFO:tasks.workunit.client.1.smithi111.stdout:3/756: creat d2/d15/d17/d5e/d9f/ff0 x:0 0 0 2023-12-08T20:27:59.845 INFO:tasks.workunit.client.1.smithi111.stdout:3/757: truncate d2/d12/d4a/fe9 501615 0 2023-12-08T20:27:59.846 INFO:tasks.workunit.client.1.smithi111.stdout:3/758: creat d2/d3/d13/d36/d69/d70/ff1 x:0 0 0 2023-12-08T20:27:59.854 INFO:tasks.workunit.client.1.smithi111.stdout:7/836: dwrite da/d25/d26/d112/f42 [0,4194304] 0 2023-12-08T20:27:59.858 INFO:tasks.workunit.client.1.smithi111.stdout:7/837: mkdir da/d25/d3d/d58/d117 0 2023-12-08T20:27:59.860 INFO:tasks.workunit.client.1.smithi111.stdout:7/838: mkdir da/d5c/d59/df2/d118 0 2023-12-08T20:27:59.862 INFO:tasks.workunit.client.1.smithi111.stdout:3/759: dwrite d2/d15/d17/d25/fef [0,4194304] 0 2023-12-08T20:27:59.862 INFO:tasks.workunit.client.1.smithi111.stdout:3/760: truncate d2/d3/d51/d88/fa5 1398120 0 2023-12-08T20:27:59.862 INFO:tasks.workunit.client.1.smithi111.stdout:3/761: write d2/d3/d51/d88/fa5 [1291990,26694] 0 2023-12-08T20:27:59.874 INFO:tasks.workunit.client.1.smithi111.stdout:7/839: dwrite da/d25/d26/d112/f42 [0,4194304] 0 2023-12-08T20:27:59.874 INFO:tasks.workunit.client.1.smithi111.stdout:7/840: write da/d13/f45 [1008600,29643] 0 2023-12-08T20:27:59.876 INFO:tasks.workunit.client.1.smithi111.stdout:7/841: rename da/d13/f9b to da/d13/d10a/f119 0 2023-12-08T20:27:59.878 INFO:tasks.workunit.client.1.smithi111.stdout:7/842: unlink da/d25/d26/d32/fee 0 2023-12-08T20:27:59.878 INFO:tasks.workunit.client.1.smithi111.stdout:7/843: fsync da/d13/f7f 0 2023-12-08T20:27:59.878 INFO:tasks.workunit.client.1.smithi111.stdout:7/844: getdents da/d64/dd6 0 2023-12-08T20:27:59.879 INFO:tasks.workunit.client.1.smithi111.stdout:7/845: rmdir da/d25/d26/d32 39 2023-12-08T20:27:59.880 INFO:tasks.workunit.client.1.smithi111.stdout:7/846: creat da/d25/d3d/d58/f11a x:0 0 0 2023-12-08T20:27:59.881 INFO:tasks.workunit.client.1.smithi111.stdout:7/847: truncate da/d13/ff4 2632887 0 2023-12-08T20:27:59.883 INFO:tasks.workunit.client.1.smithi111.stdout:7/848: dread da/d64/f71 [0,4194304] 0 2023-12-08T20:27:59.883 INFO:tasks.workunit.client.1.smithi111.stdout:7/849: chown da/d13/d9e/d75/c77 907824 1 2023-12-08T20:27:59.902 INFO:tasks.workunit.client.1.smithi111.stdout:7/850: dwrite da/d25/d26/d112/d97/fc3 [0,4194304] 0 2023-12-08T20:27:59.921 INFO:tasks.workunit.client.1.smithi111.stdout:7/851: dwrite da/d5c/d59/d61/fb1 [4194304,4194304] 0 2023-12-08T20:27:59.921 INFO:tasks.workunit.client.1.smithi111.stdout:7/852: stat da/d25/d26/d112/d97/fc3 0 2023-12-08T20:27:59.921 INFO:tasks.workunit.client.1.smithi111.stdout:7/853: write da/d25/d3d/d58/f11a [830541,59970] 0 2023-12-08T20:27:59.921 INFO:tasks.workunit.client.1.smithi111.stdout:7/854: fsync da/d13/d9e/f104 0 2023-12-08T20:27:59.923 INFO:tasks.workunit.client.1.smithi111.stdout:7/855: symlink da/d25/da9/db8/l11b 0 2023-12-08T20:27:59.926 INFO:tasks.workunit.client.1.smithi111.stdout:7/856: rename da/d25/d3d/d58/lbe to da/d25/d26/d112/d97/l11c 0 2023-12-08T20:27:59.926 INFO:tasks.workunit.client.1.smithi111.stdout:7/857: readlink da/d25/d3d/d58/lc2 0 2023-12-08T20:27:59.926 INFO:tasks.workunit.client.1.smithi111.stdout:7/858: write da/d25/d26/d32/f8e [1921466,67212] 0 2023-12-08T20:27:59.930 INFO:tasks.workunit.client.1.smithi111.stdout:7/859: truncate da/f46 1301490 0 2023-12-08T20:27:59.931 INFO:tasks.workunit.client.1.smithi111.stdout:7/860: chown da/d38/fda 86966702 1 2023-12-08T20:27:59.933 INFO:tasks.workunit.client.1.smithi111.stdout:7/861: mkdir da/d5c/d6e/d10b/d11d 0 2023-12-08T20:27:59.936 INFO:tasks.workunit.client.1.smithi111.stdout:7/862: write da/d13/d9e/d75/f99 [1681653,26275] 0 2023-12-08T20:27:59.938 INFO:tasks.workunit.client.1.smithi111.stdout:7/863: getdents da/d13 0 2023-12-08T20:27:59.938 INFO:tasks.workunit.client.1.smithi111.stdout:7/864: truncate da/d13/fce 796138 0 2023-12-08T20:27:59.940 INFO:tasks.workunit.client.1.smithi111.stdout:7/865: truncate da/d13/f4c 1783140 0 2023-12-08T20:27:59.941 INFO:tasks.workunit.client.1.smithi111.stdout:7/866: creat da/d5c/d6e/d10b/f11e x:0 0 0 2023-12-08T20:27:59.943 INFO:tasks.workunit.client.1.smithi111.stdout:7/867: unlink da/l47 0 2023-12-08T20:27:59.944 INFO:tasks.workunit.client.1.smithi111.stdout:7/868: write da/d25/d26/d32/f56 [2189849,48080] 0 2023-12-08T20:27:59.945 INFO:tasks.workunit.client.1.smithi111.stdout:7/869: mkdir da/d25/d3d/d58/df0/d11f 0 2023-12-08T20:27:59.946 INFO:tasks.workunit.client.1.smithi111.stdout:7/870: symlink da/d25/d3d/dff/l120 0 2023-12-08T20:27:59.946 INFO:tasks.workunit.client.1.smithi111.stdout:7/871: write da/d5c/d59/df2/ff1 [877875,118162] 0 2023-12-08T20:27:59.955 INFO:tasks.workunit.client.1.smithi111.stdout:7/872: dread da/d13/d9e/d75/d9f/fc8 [0,4194304] 0 2023-12-08T20:27:59.955 INFO:tasks.workunit.client.1.smithi111.stdout:7/873: write da/d5c/d59/df2/ffc [918339,123839] 0 2023-12-08T20:27:59.957 INFO:tasks.workunit.client.1.smithi111.stdout:7/874: mknod da/d25/d26/c121 0 2023-12-08T20:27:59.968 INFO:tasks.workunit.client.1.smithi111.stdout:6/711: sync 2023-12-08T20:27:59.969 INFO:tasks.workunit.client.1.smithi111.stdout:2/793: sync 2023-12-08T20:27:59.969 INFO:tasks.workunit.client.1.smithi111.stdout:6/712: readlink d0/d1/d1e/l78 0 2023-12-08T20:27:59.970 INFO:tasks.workunit.client.1.smithi111.stdout:2/794: unlink d1/d29/d53/f85 0 2023-12-08T20:27:59.971 INFO:tasks.workunit.client.1.smithi111.stdout:6/713: getdents d0/d1/d1e/db2 0 2023-12-08T20:27:59.971 INFO:tasks.workunit.client.1.smithi111.stdout:6/714: write d0/d1/d27/d36/f3e [4457286,4569] 0 2023-12-08T20:27:59.989 INFO:tasks.workunit.client.1.smithi111.stdout:2/795: dread d1/d29/d53/f82 [0,4194304] 0 2023-12-08T20:27:59.989 INFO:tasks.workunit.client.1.smithi111.stdout:2/796: truncate d1/d1d/d1f/d25/d3d/f10f 433081 0 2023-12-08T20:27:59.991 INFO:tasks.workunit.client.1.smithi111.stdout:2/797: creat d1/d1d/d68/f124 x:0 0 0 2023-12-08T20:27:59.991 INFO:tasks.workunit.client.1.smithi111.stdout:2/798: truncate f0 3431101 0 2023-12-08T20:27:59.993 INFO:tasks.workunit.client.1.smithi111.stdout:2/799: truncate d1/d1d/d22/f71 69146 0 2023-12-08T20:27:59.994 INFO:tasks.workunit.client.1.smithi111.stdout:2/800: truncate d1/d1d/f5d 1845786 0 2023-12-08T20:27:59.994 INFO:tasks.workunit.client.1.smithi111.stdout:2/801: fdatasync d1/d1d/d68/fa1 0 2023-12-08T20:27:59.996 INFO:tasks.workunit.client.1.smithi111.stdout:2/802: mknod d1/d29/dfe/dc5/c125 0 2023-12-08T20:27:59.997 INFO:tasks.workunit.client.1.smithi111.stdout:2/803: mknod d1/d29/dfe/dc5/c126 0 2023-12-08T20:28:00.013 INFO:tasks.workunit.client.1.smithi111.stdout:2/804: dwrite d1/d1d/d1f/d36/ffa [0,4194304] 0 2023-12-08T20:28:00.016 INFO:tasks.workunit.client.1.smithi111.stdout:2/805: creat d1/d1d/f127 x:0 0 0 2023-12-08T20:28:00.017 INFO:tasks.workunit.client.1.smithi111.stdout:2/806: mknod d1/d1d/c128 0 2023-12-08T20:28:00.017 INFO:tasks.workunit.client.1.smithi111.stdout:2/807: stat d1/d1d/f2e 0 2023-12-08T20:28:00.018 INFO:tasks.workunit.client.1.smithi111.stdout:2/808: chown d1/d1d/d1f/d25/d67 87511 1 2023-12-08T20:28:00.018 INFO:tasks.workunit.client.1.smithi111.stdout:2/809: read d1/d1d/f20 [7207436,11482] 0 2023-12-08T20:28:00.023 INFO:tasks.workunit.client.0.smithi043.stdout:2/13: dread d0/f1 [0,4194304] 0 2023-12-08T20:28:00.032 INFO:tasks.workunit.client.1.smithi111.stdout:2/810: dwrite d1/d29/d53/fd5 [0,4194304] 0 2023-12-08T20:28:00.032 INFO:tasks.workunit.client.1.smithi111.stdout:2/811: chown d1/d1d/d1f/d36/d92 42963949 1 2023-12-08T20:28:00.033 INFO:tasks.workunit.client.1.smithi111.stdout:2/812: link d1/d1d/d1f/d25/d3d/d64/l7c d1/d1d/d1f/d25/d67/l129 0 2023-12-08T20:28:00.035 INFO:tasks.workunit.client.1.smithi111.stdout:2/813: symlink d1/d29/d4e/ddc/l12a 0 2023-12-08T20:28:00.035 INFO:tasks.workunit.client.1.smithi111.stdout:2/814: dread - d1/d1d/d1f/d25/d3d/d56/f8a zero size 2023-12-08T20:28:00.035 INFO:tasks.workunit.client.1.smithi111.stdout:2/815: mknod d1/d1d/d68/df6/c12b 0 2023-12-08T20:28:00.047 INFO:tasks.workunit.client.1.smithi111.stdout:2/816: dwrite d1/d1d/d68/d73/fca [0,4194304] 0 2023-12-08T20:28:00.048 INFO:tasks.workunit.client.1.smithi111.stdout:2/817: chown d1/d1d/d1f/d25/d67/c9a 358 1 2023-12-08T20:28:00.050 INFO:tasks.workunit.client.1.smithi111.stdout:2/818: link d1/d1d/d55/l117 d1/d29/d53/d91/l12c 0 2023-12-08T20:28:00.050 INFO:tasks.workunit.client.1.smithi111.stdout:2/819: truncate d1/d1d/d1f/d25/d96/fa6 850882 0 2023-12-08T20:28:00.055 INFO:tasks.workunit.client.1.smithi111.stdout:2/820: dread d1/d1d/d22/f39 [0,4194304] 0 2023-12-08T20:28:00.056 INFO:tasks.workunit.client.1.smithi111.stdout:2/821: creat d1/d1d/d1f/d25/d96/ddf/f12d x:0 0 0 2023-12-08T20:28:00.068 INFO:tasks.workunit.client.1.smithi111.stdout:2/822: dwrite d1/d1d/d22/f7d [4194304,4194304] 0 2023-12-08T20:28:00.068 INFO:tasks.workunit.client.1.smithi111.stdout:2/823: readlink d1/d29/d4e/lad 0 2023-12-08T20:28:00.070 INFO:tasks.workunit.client.1.smithi111.stdout:2/824: getdents d1/d1d/d68 0 2023-12-08T20:28:00.070 INFO:tasks.workunit.client.1.smithi111.stdout:2/825: dread - d1/d1d/d22/f89 zero size 2023-12-08T20:28:00.074 INFO:tasks.workunit.client.1.smithi111.stdout:2/826: creat d1/d1d/d22/f12e x:0 0 0 2023-12-08T20:28:00.074 INFO:tasks.workunit.client.1.smithi111.stdout:2/827: chown d1/d29/d53/d90 650705 1 2023-12-08T20:28:00.074 INFO:tasks.workunit.client.1.smithi111.stdout:2/828: write d1/d29/d53/d90/f6e [4519119,37359] 0 2023-12-08T20:28:00.075 INFO:tasks.workunit.client.1.smithi111.stdout:2/829: write d1/d1d/d68/d73/f9b [398517,119725] 0 2023-12-08T20:28:00.075 INFO:tasks.workunit.client.1.smithi111.stdout:2/830: write d1/d1d/d1f/d25/d3d/d64/f80 [2942272,112413] 0 2023-12-08T20:28:00.075 INFO:tasks.workunit.client.1.smithi111.stdout:2/831: write d1/d29/d53/d90/fc3 [647062,17829] 0 2023-12-08T20:28:00.075 INFO:tasks.workunit.client.1.smithi111.stdout:2/832: write d1/d29/d53/d91/dce/f10d [606205,112103] 0 2023-12-08T20:28:00.090 INFO:tasks.workunit.client.1.smithi111.stdout:2/833: dwrite d1/d1d/d22/fe6 [0,4194304] 0 2023-12-08T20:28:00.096 INFO:tasks.workunit.client.1.smithi111.stdout:2/834: link d1/c1c d1/d1d/d1f/d25/d3d/d64/c12f 0 2023-12-08T20:28:00.096 INFO:tasks.workunit.client.1.smithi111.stdout:2/835: stat d1/d1d/d1f/d36/fe3 0 2023-12-08T20:28:00.096 INFO:tasks.workunit.client.1.smithi111.stdout:2/836: chown d1/d1d/d68/de2/cf2 874013 1 2023-12-08T20:28:00.096 INFO:tasks.workunit.client.1.smithi111.stdout:2/837: write d1/d1d/d1f/d25/fc9 [593113,33665] 0 2023-12-08T20:28:00.096 INFO:tasks.workunit.client.1.smithi111.stdout:2/838: write d1/d1d/d55/f72 [492987,63275] 0 2023-12-08T20:28:00.097 INFO:tasks.workunit.client.1.smithi111.stdout:2/839: dread - d1/d1d/f11e zero size 2023-12-08T20:28:00.098 INFO:tasks.workunit.client.1.smithi111.stdout:2/840: mkdir d1/d29/d4e/ddc/d108/d130 0 2023-12-08T20:28:00.098 INFO:tasks.workunit.client.1.smithi111.stdout:2/841: truncate d1/d1d/f11e 245701 0 2023-12-08T20:28:00.098 INFO:tasks.workunit.client.1.smithi111.stdout:2/842: readlink d1/d1d/d1f/d25/d3d/d41/l45 0 2023-12-08T20:28:00.099 INFO:tasks.workunit.client.1.smithi111.stdout:2/843: creat d1/d1d/d1f/dc1/d111/f131 x:0 0 0 2023-12-08T20:28:00.099 INFO:tasks.workunit.client.1.smithi111.stdout:8/923: sync 2023-12-08T20:28:00.099 INFO:tasks.workunit.client.1.smithi111.stdout:4/778: sync 2023-12-08T20:28:00.099 INFO:tasks.workunit.client.1.smithi111.stdout:1/817: sync 2023-12-08T20:28:00.099 INFO:tasks.workunit.client.1.smithi111.stdout:1/818: truncate d0/f70 982855 0 2023-12-08T20:28:00.100 INFO:tasks.workunit.client.1.smithi111.stdout:4/779: write d8/da/db/d7f/d8e/fe6 [921392,129831] 0 2023-12-08T20:28:00.101 INFO:tasks.workunit.client.1.smithi111.stdout:1/819: mknod d0/d8e/db0/d10d/d111/dbd/c119 0 2023-12-08T20:28:00.102 INFO:tasks.workunit.client.1.smithi111.stdout:4/780: truncate d8/da/f66 7606310 0 2023-12-08T20:28:00.102 INFO:tasks.workunit.client.1.smithi111.stdout:4/781: fdatasync d8/d30/d7d/d9b/db2/fed 0 2023-12-08T20:28:00.103 INFO:tasks.workunit.client.1.smithi111.stdout:1/820: dread d0/d6/d33/d6c/fdf [0,4194304] 0 2023-12-08T20:28:00.105 INFO:tasks.workunit.client.1.smithi111.stdout:8/924: rename dd/dc9/ddb to dd/d32/dea/df1/d147 0 2023-12-08T20:28:00.105 INFO:tasks.workunit.client.1.smithi111.stdout:8/925: write dd/d2d/d62/d143/f6a [1110500,104008] 0 2023-12-08T20:28:00.106 INFO:tasks.workunit.client.1.smithi111.stdout:4/782: getdents d8/da/db 0 2023-12-08T20:28:00.107 INFO:tasks.workunit.client.1.smithi111.stdout:3/762: sync 2023-12-08T20:28:00.107 INFO:tasks.workunit.client.1.smithi111.stdout:6/715: sync 2023-12-08T20:28:00.107 INFO:tasks.workunit.client.1.smithi111.stdout:9/998: sync 2023-12-08T20:28:00.107 INFO:tasks.workunit.client.1.smithi111.stdout:7/875: sync 2023-12-08T20:28:00.107 INFO:tasks.workunit.client.1.smithi111.stdout:7/876: readlink da/d13/d9e/lc1 0 2023-12-08T20:28:00.108 INFO:tasks.workunit.client.1.smithi111.stdout:7/877: fsync da/d25/d26/d112/d97/fc3 0 2023-12-08T20:28:00.108 INFO:tasks.workunit.client.1.smithi111.stdout:6/716: write d0/d68/d95/f47 [270550,1700] 0 2023-12-08T20:28:00.108 INFO:tasks.workunit.client.1.smithi111.stdout:6/717: dread - d0/d1/d1e/db2/fc8 zero size 2023-12-08T20:28:00.108 INFO:tasks.workunit.client.1.smithi111.stdout:6/718: chown d0/c4d 7454 1 2023-12-08T20:28:00.108 INFO:tasks.workunit.client.1.smithi111.stdout:6/719: stat d0/d1/d27 0 2023-12-08T20:28:00.108 INFO:tasks.workunit.client.1.smithi111.stdout:4/783: read d8/d30/d7d/d9b/db2/fdb [362469,90959] 0 2023-12-08T20:28:00.108 INFO:tasks.workunit.client.1.smithi111.stdout:1/821: creat d0/d6/d33/d8b/f11a x:0 0 0 2023-12-08T20:28:00.108 INFO:tasks.workunit.client.1.smithi111.stdout:2/844: dread d1/d1d/d1f/d25/d3d/d56/f7a [0,4194304] 0 2023-12-08T20:28:00.113 INFO:tasks.workunit.client.1.smithi111.stdout:8/926: creat dd/d32/d36/d4b/f148 x:0 0 0 2023-12-08T20:28:00.113 INFO:tasks.workunit.client.1.smithi111.stdout:8/927: chown dd/d35/d42/c9f 22623 1 2023-12-08T20:28:00.113 INFO:tasks.workunit.client.1.smithi111.stdout:3/763: creat d2/d3/d13/d36/d44/d8f/ff2 x:0 0 0 2023-12-08T20:28:00.114 INFO:tasks.workunit.client.1.smithi111.stdout:3/764: write d2/d3/d13/d36/d44/daa/faf [754105,52802] 0 2023-12-08T20:28:00.115 INFO:tasks.workunit.client.1.smithi111.stdout:9/999: creat d2/d8/dd/d1a/d1e/d2d/d35/d71/d105/d155/f15d x:0 0 0 2023-12-08T20:28:00.117 INFO:tasks.workunit.client.1.smithi111.stdout:7/878: mkdir da/d64/dd6/d122 0 2023-12-08T20:28:00.118 INFO:tasks.workunit.client.1.smithi111.stdout:6/720: symlink d0/d68/le7 0 2023-12-08T20:28:00.120 INFO:tasks.workunit.client.1.smithi111.stdout:2/845: creat d1/d1d/d22/f132 x:0 0 0 2023-12-08T20:28:00.120 INFO:tasks.workunit.client.1.smithi111.stdout:8/928: symlink dd/d2d/d62/d8c/l149 0 2023-12-08T20:28:00.120 INFO:tasks.workunit.client.1.smithi111.stdout:8/929: write dd/d32/dea/df1/f140 [440204,5496] 0 2023-12-08T20:28:00.120 INFO:tasks.workunit.client.1.smithi111.stdout:8/930: dread - dd/d2d/d62/d83/d137/f146 zero size 2023-12-08T20:28:00.121 INFO:tasks.workunit.client.1.smithi111.stdout:1/822: dread d0/d8e/fc2 [0,4194304] 0 2023-12-08T20:28:00.121 INFO:tasks.workunit.client.1.smithi111.stdout:3/765: mkdir d2/d3/d51/df3 0 2023-12-08T20:28:00.122 INFO:tasks.workunit.client.1.smithi111.stdout:3/766: chown d2/d12/d2e/dc6/d93/fc9 1881861 1 2023-12-08T20:28:00.122 INFO:tasks.workunit.client.1.smithi111.stdout:6/721: read d0/d1/f96 [667843,59241] 0 2023-12-08T20:28:00.125 INFO:tasks.workunit.client.1.smithi111.stdout:2/846: creat d1/d1d/d68/d73/f133 x:0 0 0 2023-12-08T20:28:00.127 INFO:tasks.workunit.client.1.smithi111.stdout:1/823: symlink d0/d6/d33/d15/d51/d5b/d5e/l11b 0 2023-12-08T20:28:00.129 INFO:tasks.workunit.client.1.smithi111.stdout:3/767: mkdir d2/d3/d13/d36/d44/df4 0 2023-12-08T20:28:00.130 INFO:tasks.workunit.client.1.smithi111.stdout:2/847: dread d1/d1d/d22/f39 [0,4194304] 0 2023-12-08T20:28:00.131 INFO:tasks.workunit.client.1.smithi111.stdout:6/722: rmdir d0/d68/d95/d7a/dd0 0 2023-12-08T20:28:00.131 INFO:tasks.workunit.client.1.smithi111.stdout:6/723: fdatasync d0/d1/d1e/f42 0 2023-12-08T20:28:00.131 INFO:tasks.workunit.client.1.smithi111.stdout:6/724: chown d0/d68/d95 0 1 2023-12-08T20:28:00.134 INFO:tasks.workunit.client.1.smithi111.stdout:1/824: mknod d0/d6/d33/d15/d51/d5b/d59/c11c 0 2023-12-08T20:28:00.136 INFO:tasks.workunit.client.1.smithi111.stdout:7/879: dwrite da/d25/d26/d32/f56 [0,4194304] 0 2023-12-08T20:28:00.137 INFO:tasks.workunit.client.1.smithi111.stdout:3/768: mkdir d2/d12/d4a/d5d/df5 0 2023-12-08T20:28:00.138 INFO:tasks.workunit.client.1.smithi111.stdout:2/848: mkdir d1/d1d/d1f/d25/d96/d134 0 2023-12-08T20:28:00.138 INFO:tasks.workunit.client.1.smithi111.stdout:2/849: write d1/d1d/d1f/d36/fe3 [878252,18192] 0 2023-12-08T20:28:00.140 INFO:tasks.workunit.client.1.smithi111.stdout:2/850: dread d1/d29/d53/d90/f61 [0,4194304] 0 2023-12-08T20:28:00.140 INFO:tasks.workunit.client.1.smithi111.stdout:1/825: symlink d0/d8e/l11d 0 2023-12-08T20:28:00.140 INFO:tasks.workunit.client.1.smithi111.stdout:1/826: truncate d0/d6/d34/f5f 356968 0 2023-12-08T20:28:00.142 INFO:tasks.workunit.client.1.smithi111.stdout:7/880: creat da/d25/d3d/dc9/f123 x:0 0 0 2023-12-08T20:28:00.143 INFO:tasks.workunit.client.1.smithi111.stdout:3/769: symlink d2/d3/d51/df3/lf6 0 2023-12-08T20:28:00.143 INFO:tasks.workunit.client.1.smithi111.stdout:3/770: read d2/d12/d4a/f6f [344619,117604] 0 2023-12-08T20:28:00.144 INFO:tasks.workunit.client.1.smithi111.stdout:2/851: truncate d1/d1d/d1f/d25/d3d/d56/ffb 469700 0 2023-12-08T20:28:00.146 INFO:tasks.workunit.client.1.smithi111.stdout:7/881: creat da/d25/d3d/f124 x:0 0 0 2023-12-08T20:28:00.147 INFO:tasks.workunit.client.1.smithi111.stdout:7/882: write da/d25/f2e [5978815,52181] 0 2023-12-08T20:28:00.148 INFO:tasks.workunit.client.1.smithi111.stdout:7/883: truncate da/d25/d26/d112/d97/f111 923619 0 2023-12-08T20:28:00.148 INFO:tasks.workunit.client.1.smithi111.stdout:7/884: fdatasync da/d25/d3d/f124 0 2023-12-08T20:28:00.148 INFO:tasks.workunit.client.1.smithi111.stdout:7/885: write da/fd0 [2126743,104734] 0 2023-12-08T20:28:00.148 INFO:tasks.workunit.client.1.smithi111.stdout:7/886: dread - da/d38/d80/fe0 zero size 2023-12-08T20:28:00.148 INFO:tasks.workunit.client.1.smithi111.stdout:2/852: stat d1/d1d/d1f/d25/l87 0 2023-12-08T20:28:00.148 INFO:tasks.workunit.client.1.smithi111.stdout:2/853: stat d1/d29/dfe/dc5/c125 0 2023-12-08T20:28:00.153 INFO:tasks.workunit.client.1.smithi111.stdout:1/827: rename d0/d6/d47/f53 to d0/d6/d33/d15/d51/d5b/d59/db8/d103/f11e 0 2023-12-08T20:28:00.153 INFO:tasks.workunit.client.1.smithi111.stdout:1/828: truncate d0/d6/d33/d8b/db5/fd1 1019429 0 2023-12-08T20:28:00.155 INFO:tasks.workunit.client.1.smithi111.stdout:1/829: getdents d0/d6/d33/d15/d51/d5b/d59/da3 0 2023-12-08T20:28:00.156 INFO:tasks.workunit.client.1.smithi111.stdout:1/830: chown d0/lb4 482215539 1 2023-12-08T20:28:00.158 INFO:tasks.workunit.client.1.smithi111.stdout:1/831: dread d0/d4d/f8c [0,4194304] 0 2023-12-08T20:28:00.158 INFO:tasks.workunit.client.1.smithi111.stdout:1/832: fdatasync d0/d6/d33/d6c/fdf 0 2023-12-08T20:28:00.159 INFO:tasks.workunit.client.1.smithi111.stdout:3/771: rename d2/d12/d2e/f48 to d2/d15/d17/ff7 0 2023-12-08T20:28:00.161 INFO:tasks.workunit.client.1.smithi111.stdout:1/833: mkdir d0/d6/d33/d15/d51/d11f 0 2023-12-08T20:28:00.161 INFO:tasks.workunit.client.1.smithi111.stdout:1/834: fsync d0/d6/d33/d15/d51/d5b/d5e/f10e 0 2023-12-08T20:28:00.163 INFO:tasks.workunit.client.1.smithi111.stdout:2/854: rename d1/d29/d53/d90/d118/f5c to d1/d29/d53/d91/dbd/f135 0 2023-12-08T20:28:00.163 INFO:tasks.workunit.client.1.smithi111.stdout:2/855: write d1/d1d/d1f/d25/fc9 [1567164,35624] 0 2023-12-08T20:28:00.164 INFO:tasks.workunit.client.1.smithi111.stdout:7/887: dwrite da/d64/dd6/fec [0,4194304] 0 2023-12-08T20:28:00.165 INFO:tasks.workunit.client.1.smithi111.stdout:3/772: mkdir d2/d15/d17/d5e/df8 0 2023-12-08T20:28:00.167 INFO:tasks.workunit.client.1.smithi111.stdout:2/856: creat d1/d1d/d1f/d25/d3d/d41/de1/f136 x:0 0 0 2023-12-08T20:28:00.185 INFO:tasks.workunit.client.1.smithi111.stdout:1/835: dwrite d0/d22/f9b [0,4194304] 0 2023-12-08T20:28:00.186 INFO:tasks.workunit.client.1.smithi111.stdout:2/857: creat d1/d29/d4e/dbf/f137 x:0 0 0 2023-12-08T20:28:00.189 INFO:tasks.workunit.client.1.smithi111.stdout:1/836: link d0/d6/d33/d15/d51/d2e/l39 d0/d6/d33/d60/l120 0 2023-12-08T20:28:00.190 INFO:tasks.workunit.client.1.smithi111.stdout:2/858: mknod d1/d1d/d1f/c138 0 2023-12-08T20:28:00.190 INFO:tasks.workunit.client.1.smithi111.stdout:3/773: dwrite d2/fa [0,4194304] 0 2023-12-08T20:28:00.197 INFO:tasks.workunit.client.1.smithi111.stdout:1/837: dread d0/d6/f14 [0,4194304] 0 2023-12-08T20:28:00.198 INFO:tasks.workunit.client.1.smithi111.stdout:7/888: dwrite da/d25/d26/d32/dcd/f102 [0,4194304] 0 2023-12-08T20:28:00.203 INFO:tasks.workunit.client.1.smithi111.stdout:1/838: symlink d0/d6/d33/d15/d51/d5b/d59/db8/d103/l121 0 2023-12-08T20:28:00.205 INFO:tasks.workunit.client.1.smithi111.stdout:1/839: truncate d0/d6/f10 1576393 0 2023-12-08T20:28:00.225 INFO:tasks.workunit.client.1.smithi111.stdout:2/859: dwrite d1/d29/d53/d91/dbd/fcf [0,4194304] 0 2023-12-08T20:28:00.226 INFO:tasks.workunit.client.1.smithi111.stdout:3/774: dwrite d2/d15/d17/d5e/d9f/ff0 [0,4194304] 0 2023-12-08T20:28:00.226 INFO:tasks.workunit.client.1.smithi111.stdout:7/889: dwrite da/d5c/d59/df2/ffc [4194304,4194304] 0 2023-12-08T20:28:00.226 INFO:tasks.workunit.client.1.smithi111.stdout:1/840: dwrite d0/d6/d33/d15/d51/d2e/d61/ff0 [0,4194304] 0 2023-12-08T20:28:00.226 INFO:tasks.workunit.client.1.smithi111.stdout:7/890: chown da/d25/da9/ced 16 1 2023-12-08T20:28:00.226 INFO:tasks.workunit.client.1.smithi111.stdout:3/775: write d2/d3/d13/d36/d44/d8f/ff2 [782994,90110] 0 2023-12-08T20:28:00.226 INFO:tasks.workunit.client.1.smithi111.stdout:2/860: dread d1/d1d/d1f/d25/d3d/f10f [0,4194304] 0 2023-12-08T20:28:00.227 INFO:tasks.workunit.client.1.smithi111.stdout:2/861: write d1/d1d/d22/fff [2648859,14832] 0 2023-12-08T20:28:00.227 INFO:tasks.workunit.client.1.smithi111.stdout:3/776: write d2/d3/f1c [379404,84043] 0 2023-12-08T20:28:00.227 INFO:tasks.workunit.client.1.smithi111.stdout:2/862: readlink d1/d29/d4e/ddc/l12a 0 2023-12-08T20:28:00.231 INFO:tasks.workunit.client.1.smithi111.stdout:7/891: rmdir da/d25/d3d 39 2023-12-08T20:28:00.234 INFO:tasks.workunit.client.1.smithi111.stdout:1/841: rmdir d0/d6/d33/d15/d51/d78/ddc 0 2023-12-08T20:28:00.238 INFO:tasks.workunit.client.1.smithi111.stdout:2/863: unlink d1/d1d/d1f/d25/d3d/d64/f116 0 2023-12-08T20:28:00.238 INFO:tasks.workunit.client.1.smithi111.stdout:2/864: write d1/d29/d4e/fb3 [921914,108799] 0 2023-12-08T20:28:00.238 INFO:tasks.workunit.client.1.smithi111.stdout:2/865: chown d1/d1d/d22/c122 0 1 2023-12-08T20:28:00.238 INFO:tasks.workunit.client.1.smithi111.stdout:2/866: write d1/d1d/d22/fff [4967780,101103] 0 2023-12-08T20:28:00.240 INFO:tasks.workunit.client.1.smithi111.stdout:3/777: symlink d2/d3/d13/d36/d44/d8f/da7/lf9 0 2023-12-08T20:28:00.240 INFO:tasks.workunit.client.1.smithi111.stdout:3/778: stat d2/d15/d17/d25/de0/f61 0 2023-12-08T20:28:00.240 INFO:tasks.workunit.client.1.smithi111.stdout:2/867: read d1/d29/d53/d91/dbd/fcf [898294,76606] 0 2023-12-08T20:28:00.240 INFO:tasks.workunit.client.1.smithi111.stdout:3/779: read d2/d3/d13/d36/d44/d8f/f91 [546565,90963] 0 2023-12-08T20:28:00.240 INFO:tasks.workunit.client.1.smithi111.stdout:2/868: read d1/d29/d53/d90/ff3 [297559,114800] 0 2023-12-08T20:28:00.240 INFO:tasks.workunit.client.1.smithi111.stdout:2/869: chown d1/d1d/d68/d73/dd6/fda 106166879 1 2023-12-08T20:28:00.241 INFO:tasks.workunit.client.1.smithi111.stdout:7/892: creat da/d5c/d6e/f125 x:0 0 0 2023-12-08T20:28:00.243 INFO:tasks.workunit.client.1.smithi111.stdout:1/842: link d0/d6/d33/f64 d0/d6/d33/d15/d51/d5b/d59/db8/d103/f122 0 2023-12-08T20:28:00.245 INFO:tasks.workunit.client.1.smithi111.stdout:2/870: symlink d1/d1d/d68/d73/dd6/l139 0 2023-12-08T20:28:00.252 INFO:tasks.workunit.client.1.smithi111.stdout:7/893: mknod da/d25/d26/d32/d87/c126 0 2023-12-08T20:28:00.252 INFO:tasks.workunit.client.1.smithi111.stdout:2/871: rmdir d1/d1d/d1f/d36 39 2023-12-08T20:28:00.252 INFO:tasks.workunit.client.1.smithi111.stdout:1/843: truncate d0/d6/d34/f82 572348 0 2023-12-08T20:28:00.252 INFO:tasks.workunit.client.1.smithi111.stdout:1/844: chown d0/d8e/db0/d10d/d111/dbd/fd6 612122 1 2023-12-08T20:28:00.253 INFO:tasks.workunit.client.1.smithi111.stdout:2/872: getdents d1/d1d/d1f/d25/d3d/d64 0 2023-12-08T20:28:00.255 INFO:tasks.workunit.client.1.smithi111.stdout:3/780: dwrite d2/d3/d51/d88/fd6 [0,4194304] 0 2023-12-08T20:28:00.255 INFO:tasks.workunit.client.1.smithi111.stdout:3/781: read - d2/d3/d13/d36/d69/d70/ff1 zero size 2023-12-08T20:28:00.255 INFO:tasks.workunit.client.1.smithi111.stdout:1/845: rmdir d0/d6/d33/d6c/d75/d89 39 2023-12-08T20:28:00.256 INFO:tasks.workunit.client.1.smithi111.stdout:3/782: write d2/d12/f1a [4683424,21657] 0 2023-12-08T20:28:00.257 INFO:tasks.workunit.client.1.smithi111.stdout:2/873: rmdir d1/d1d/d68 39 2023-12-08T20:28:00.258 INFO:tasks.workunit.client.1.smithi111.stdout:3/783: write d2/d15/d17/ff7 [2401121,127695] 0 2023-12-08T20:28:00.259 INFO:tasks.workunit.client.1.smithi111.stdout:3/784: stat d2/d15/dcf/led 0 2023-12-08T20:28:00.259 INFO:tasks.workunit.client.1.smithi111.stdout:3/785: stat d2/d3/d51/d88 0 2023-12-08T20:28:00.259 INFO:tasks.workunit.client.1.smithi111.stdout:3/786: chown d2/d3/d51 235744196 1 2023-12-08T20:28:00.259 INFO:tasks.workunit.client.1.smithi111.stdout:1/846: mknod d0/d6/d33/d15/d51/d2e/d61/c123 0 2023-12-08T20:28:00.259 INFO:tasks.workunit.client.1.smithi111.stdout:2/874: dread d1/d1d/d22/f39 [0,4194304] 0 2023-12-08T20:28:00.259 INFO:tasks.workunit.client.1.smithi111.stdout:2/875: truncate d1/d29/d53/d90/fd2 432138 0 2023-12-08T20:28:00.260 INFO:tasks.workunit.client.1.smithi111.stdout:3/787: creat d2/d3/d13/d36/d69/d70/ffa x:0 0 0 2023-12-08T20:28:00.261 INFO:tasks.workunit.client.1.smithi111.stdout:1/847: rmdir d0/d8e 39 2023-12-08T20:28:00.262 INFO:tasks.workunit.client.1.smithi111.stdout:3/788: mknod d2/d15/cfb 0 2023-12-08T20:28:00.263 INFO:tasks.workunit.client.1.smithi111.stdout:3/789: read d2/d15/d17/d25/de0/fb3 [332471,119119] 0 2023-12-08T20:28:00.263 INFO:tasks.workunit.client.1.smithi111.stdout:3/790: readlink d2/d12/d2e/dc6/l22 0 2023-12-08T20:28:00.263 INFO:tasks.workunit.client.1.smithi111.stdout:1/848: creat d0/d6/d33/d15/d51/d2e/d61/d79/f124 x:0 0 0 2023-12-08T20:28:00.268 INFO:tasks.workunit.client.1.smithi111.stdout:3/791: rename d2/d15/d17/c38 to d2/d3/d13/d36/d69/d81/cfc 0 2023-12-08T20:28:00.268 INFO:tasks.workunit.client.1.smithi111.stdout:2/876: dread d1/d1d/d1f/d25/d3d/f11b [0,4194304] 0 2023-12-08T20:28:00.268 INFO:tasks.workunit.client.1.smithi111.stdout:2/877: dread - d1/d1d/d1f/dc1/d111/f131 zero size 2023-12-08T20:28:00.270 INFO:tasks.workunit.client.1.smithi111.stdout:3/792: unlink d2/d15/d17/d25/f58 0 2023-12-08T20:28:00.270 INFO:tasks.workunit.client.1.smithi111.stdout:2/878: creat d1/d29/f13a x:0 0 0 2023-12-08T20:28:00.271 INFO:tasks.workunit.client.1.smithi111.stdout:2/879: rmdir d1/d29/d53/d91/dbd/d120/de4 39 2023-12-08T20:28:00.272 INFO:tasks.workunit.client.1.smithi111.stdout:2/880: getdents d1/d1d/d1f/d25/d3d 0 2023-12-08T20:28:00.274 INFO:tasks.workunit.client.1.smithi111.stdout:1/849: dread d0/d6/d47/f4a [0,4194304] 0 2023-12-08T20:28:00.275 INFO:tasks.workunit.client.1.smithi111.stdout:2/881: symlink d1/d1d/l13b 0 2023-12-08T20:28:00.277 INFO:tasks.workunit.client.1.smithi111.stdout:2/882: dread d1/d1d/d68/fa1 [0,4194304] 0 2023-12-08T20:28:00.279 INFO:tasks.workunit.client.1.smithi111.stdout:2/883: unlink d1/d1d/d22/l86 0 2023-12-08T20:28:00.280 INFO:tasks.workunit.client.1.smithi111.stdout:2/884: fdatasync d1/d1d/d68/d73/fca 0 2023-12-08T20:28:00.280 INFO:tasks.workunit.client.1.smithi111.stdout:2/885: fdatasync d1/d1d/fd8 0 2023-12-08T20:28:00.280 INFO:tasks.workunit.client.1.smithi111.stdout:2/886: truncate d1/dec/f105 1012095 0 2023-12-08T20:28:00.281 INFO:tasks.workunit.client.1.smithi111.stdout:2/887: mknod d1/d1d/d1f/d25/d96/c13c 0 2023-12-08T20:28:00.282 INFO:tasks.workunit.client.1.smithi111.stdout:2/888: write d1/f15 [1053190,60263] 0 2023-12-08T20:28:00.282 INFO:tasks.workunit.client.1.smithi111.stdout:2/889: truncate d1/d1d/d1f/d25/d3d/d56/d10a/f119 245148 0 2023-12-08T20:28:00.283 INFO:tasks.workunit.client.1.smithi111.stdout:2/890: write d1/f15 [4307716,85523] 0 2023-12-08T20:28:00.284 INFO:tasks.workunit.client.1.smithi111.stdout:1/850: dread d0/d6/d34/f96 [0,4194304] 0 2023-12-08T20:28:00.284 INFO:tasks.workunit.client.1.smithi111.stdout:1/851: fdatasync d0/d6/d33/d8b/db5/fd1 0 2023-12-08T20:28:00.284 INFO:tasks.workunit.client.1.smithi111.stdout:2/891: dread d1/d1d/d1f/d25/d3d/d56/ffb [0,4194304] 0 2023-12-08T20:28:00.285 INFO:tasks.workunit.client.1.smithi111.stdout:1/852: unlink d0/d8e/db0/d10d/l112 0 2023-12-08T20:28:00.286 INFO:tasks.workunit.client.1.smithi111.stdout:2/892: stat d1/d29/d4e/ddc/d104/c10b 0 2023-12-08T20:28:00.286 INFO:tasks.workunit.client.1.smithi111.stdout:2/893: write d1/d1d/d1f/d25/d3d/f10f [561122,122562] 0 2023-12-08T20:28:00.286 INFO:tasks.workunit.client.1.smithi111.stdout:2/894: readlink d1/d29/d53/l27 0 2023-12-08T20:28:00.286 INFO:tasks.workunit.client.1.smithi111.stdout:1/853: mkdir d0/d6/d33/d8b/db5/d125 0 2023-12-08T20:28:00.287 INFO:tasks.workunit.client.1.smithi111.stdout:2/895: mknod d1/d29/d53/d91/dbd/d120/c13d 0 2023-12-08T20:28:00.288 INFO:tasks.workunit.client.1.smithi111.stdout:2/896: dread - d1/d1d/d1f/dc1/d111/f131 zero size 2023-12-08T20:28:00.288 INFO:tasks.workunit.client.1.smithi111.stdout:2/897: write d1/d1d/d68/f124 [21253,23108] 0 2023-12-08T20:28:00.288 INFO:tasks.workunit.client.1.smithi111.stdout:2/898: readlink d1/d1d/d1f/d25/d3d/da2/le5 0 2023-12-08T20:28:00.288 INFO:tasks.workunit.client.1.smithi111.stdout:3/793: dwrite d2/d15/d17/f94 [0,4194304] 0 2023-12-08T20:28:00.288 INFO:tasks.workunit.client.1.smithi111.stdout:1/854: symlink d0/d6/d33/d6c/l126 0 2023-12-08T20:28:00.290 INFO:tasks.workunit.client.1.smithi111.stdout:3/794: mknod d2/cfd 0 2023-12-08T20:28:00.291 INFO:tasks.workunit.client.1.smithi111.stdout:1/855: mkdir d0/d6/d33/d6c/d127 0 2023-12-08T20:28:00.294 INFO:tasks.workunit.client.1.smithi111.stdout:3/795: unlink d2/d12/c2b 0 2023-12-08T20:28:00.296 INFO:tasks.workunit.client.1.smithi111.stdout:2/899: dread d1/d1d/d22/fff [0,4194304] 0 2023-12-08T20:28:00.298 INFO:tasks.workunit.client.1.smithi111.stdout:2/900: dread d1/d1d/d1f/d25/d67/faa [0,4194304] 0 2023-12-08T20:28:00.298 INFO:tasks.workunit.client.1.smithi111.stdout:2/901: chown d1/d1d/d68/d73/fca 3967 1 2023-12-08T20:28:00.300 INFO:tasks.workunit.client.1.smithi111.stdout:2/902: mkdir d1/d29/dfe/def/d13e 0 2023-12-08T20:28:00.300 INFO:tasks.workunit.client.1.smithi111.stdout:1/856: dread d0/d6/d33/d15/d51/d2e/fa9 [0,4194304] 0 2023-12-08T20:28:00.305 INFO:tasks.workunit.client.1.smithi111.stdout:2/903: creat d1/d29/d53/d91/dbd/f13f x:0 0 0 2023-12-08T20:28:00.314 INFO:tasks.workunit.client.1.smithi111.stdout:2/904: dread d1/d1d/fd8 [4194304,4194304] 0 2023-12-08T20:28:00.315 INFO:tasks.workunit.client.1.smithi111.stdout:1/857: dwrite d0/d8e/db0/ff9 [0,4194304] 0 2023-12-08T20:28:00.315 INFO:tasks.workunit.client.1.smithi111.stdout:2/905: read f0 [1684803,16958] 0 2023-12-08T20:28:00.318 INFO:tasks.workunit.client.1.smithi111.stdout:1/858: truncate d0/d6/d33/d60/f9d 652791 0 2023-12-08T20:28:00.319 INFO:tasks.workunit.client.1.smithi111.stdout:2/906: creat d1/d29/d53/d91/dbd/d120/de4/d114/f140 x:0 0 0 2023-12-08T20:28:00.322 INFO:tasks.workunit.client.1.smithi111.stdout:1/859: link d0/d6/d33/d60/f9e d0/d6/d33/d15/d51/d2e/f128 0 2023-12-08T20:28:00.324 INFO:tasks.workunit.client.1.smithi111.stdout:1/860: creat d0/d6/d33/d6c/d127/f129 x:0 0 0 2023-12-08T20:28:00.327 INFO:tasks.workunit.client.1.smithi111.stdout:1/861: mknod d0/d6/d33/d15/d51/d2e/d61/d79/dc3/c12a 0 2023-12-08T20:28:00.329 INFO:tasks.workunit.client.1.smithi111.stdout:1/862: creat d0/d6/d33/d15/d51/d2e/d61/d79/dac/f12b x:0 0 0 2023-12-08T20:28:00.330 INFO:tasks.workunit.client.1.smithi111.stdout:1/863: truncate d0/d6/d33/d15/d51/d2e/d61/d79/fe2 848267 0 2023-12-08T20:28:00.331 INFO:tasks.workunit.client.1.smithi111.stdout:4/784: sync 2023-12-08T20:28:00.336 INFO:tasks.workunit.client.1.smithi111.stdout:2/907: dwrite d1/d29/d4e/ddc/fe0 [0,4194304] 0 2023-12-08T20:28:00.343 INFO:tasks.workunit.client.1.smithi111.stdout:4/785: dread d8/da/db/f4e [0,4194304] 0 2023-12-08T20:28:00.345 INFO:tasks.workunit.client.1.smithi111.stdout:4/786: creat d8/d30/d7d/d9b/db2/ffe x:0 0 0 2023-12-08T20:28:00.346 INFO:tasks.workunit.client.1.smithi111.stdout:1/864: dwrite d0/d6/d33/d15/d51/d2e/d61/d79/f124 [0,4194304] 0 2023-12-08T20:28:00.348 INFO:tasks.workunit.client.1.smithi111.stdout:4/787: creat d8/da/d29/d5c/dca/fff x:0 0 0 2023-12-08T20:28:00.348 INFO:tasks.workunit.client.1.smithi111.stdout:4/788: readlink d8/da/db/l28 0 2023-12-08T20:28:00.348 INFO:tasks.workunit.client.1.smithi111.stdout:4/789: fsync d8/d30/fa3 0 2023-12-08T20:28:00.348 INFO:tasks.workunit.client.1.smithi111.stdout:4/790: readlink d8/da/d29/d5c/dca/le7 0 2023-12-08T20:28:00.348 INFO:tasks.workunit.client.1.smithi111.stdout:4/791: fsync d8/da/db/f4e 0 2023-12-08T20:28:00.350 INFO:tasks.workunit.client.1.smithi111.stdout:1/865: mknod d0/d6/d33/d8b/de9/c12c 0 2023-12-08T20:28:00.351 INFO:tasks.workunit.client.1.smithi111.stdout:1/866: dread - d0/d6/d33/d15/d51/d2e/d61/d79/fc6 zero size 2023-12-08T20:28:00.354 INFO:tasks.workunit.client.1.smithi111.stdout:1/867: link d0/l81 d0/d6/d33/d6c/d75/l12d 0 2023-12-08T20:28:00.355 INFO:tasks.workunit.client.1.smithi111.stdout:1/868: read d0/d22/f9b [2611200,72787] 0 2023-12-08T20:28:00.357 INFO:tasks.workunit.client.1.smithi111.stdout:1/869: write d0/d6/d33/d15/d51/d5b/f54 [1382329,118926] 0 2023-12-08T20:28:00.357 INFO:tasks.workunit.client.1.smithi111.stdout:1/870: fsync d0/d6/d33/d15/d51/f6e 0 2023-12-08T20:28:00.359 INFO:tasks.workunit.client.1.smithi111.stdout:1/871: symlink d0/d8e/l12e 0 2023-12-08T20:28:00.360 INFO:tasks.workunit.client.1.smithi111.stdout:1/872: read d0/d8e/db0/d10d/d111/dbd/fd6 [116511,91404] 0 2023-12-08T20:28:00.361 INFO:tasks.workunit.client.1.smithi111.stdout:1/873: symlink d0/d6/d33/d15/d51/d5b/d59/db8/dd9/l12f 0 2023-12-08T20:28:00.363 INFO:tasks.workunit.client.1.smithi111.stdout:1/874: unlink d0/d6/d33/ce 0 2023-12-08T20:28:00.365 INFO:tasks.workunit.client.1.smithi111.stdout:4/792: dwrite d8/d30/d7d/d9b/db2/d4b/dd1/d1f/faa [0,4194304] 0 2023-12-08T20:28:00.366 INFO:tasks.workunit.client.1.smithi111.stdout:4/793: read - d8/da/db/d7f/d93/d77/db5/fc1 zero size 2023-12-08T20:28:00.367 INFO:tasks.workunit.client.1.smithi111.stdout:4/794: symlink d8/d30/d7d/d9b/db2/d4b/dd1/dde/l100 0 2023-12-08T20:28:00.369 INFO:tasks.workunit.client.1.smithi111.stdout:4/795: write d8/d30/d7d/d9b/db2/f98 [746866,72916] 0 2023-12-08T20:28:00.371 INFO:tasks.workunit.client.1.smithi111.stdout:4/796: dread d8/d30/fd4 [0,4194304] 0 2023-12-08T20:28:00.372 INFO:tasks.workunit.client.1.smithi111.stdout:1/875: dread d0/d6/d33/d15/d51/f21 [0,4194304] 0 2023-12-08T20:28:00.372 INFO:tasks.workunit.client.1.smithi111.stdout:4/797: creat d8/d30/d7d/f101 x:0 0 0 2023-12-08T20:28:00.373 INFO:tasks.workunit.client.1.smithi111.stdout:1/876: write d0/fd0 [1389894,15069] 0 2023-12-08T20:28:00.374 INFO:tasks.workunit.client.1.smithi111.stdout:1/877: read d0/d8e/db0/ff9 [1601336,93965] 0 2023-12-08T20:28:00.374 INFO:tasks.workunit.client.1.smithi111.stdout:4/798: rename d8/d30/d7d/d9b/db2/d4b/f67 to d8/da/d29/f102 0 2023-12-08T20:28:00.376 INFO:tasks.workunit.client.1.smithi111.stdout:1/878: rename d0/l7 to d0/d6/d33/d8b/db5/d125/l130 0 2023-12-08T20:28:00.377 INFO:tasks.workunit.client.1.smithi111.stdout:4/799: creat d8/da/d29/f103 x:0 0 0 2023-12-08T20:28:00.379 INFO:tasks.workunit.client.1.smithi111.stdout:1/879: creat d0/d6/d47/f131 x:0 0 0 2023-12-08T20:28:00.379 INFO:tasks.workunit.client.1.smithi111.stdout:1/880: write d0/d6/d33/d15/d51/f6e [777707,123680] 0 2023-12-08T20:28:00.382 INFO:tasks.workunit.client.1.smithi111.stdout:4/800: rename d8/d30/ce1 to d8/da/d29/c104 0 2023-12-08T20:28:00.384 INFO:tasks.workunit.client.1.smithi111.stdout:1/881: mkdir d0/d6/d47/d132 0 2023-12-08T20:28:00.385 INFO:tasks.workunit.client.1.smithi111.stdout:4/801: truncate d8/d30/d7d/d9b/db2/d4b/dd1/d1f/faa 2266473 0 2023-12-08T20:28:00.404 INFO:tasks.workunit.client.1.smithi111.stdout:1/882: dwrite d0/d4d/f8c [0,4194304] 0 2023-12-08T20:28:00.404 INFO:tasks.workunit.client.1.smithi111.stdout:4/802: dwrite d8/d30/fd4 [0,4194304] 0 2023-12-08T20:28:00.413 INFO:tasks.workunit.client.1.smithi111.stdout:4/803: dread d8/da/db/d7f/f92 [0,4194304] 0 2023-12-08T20:28:00.414 INFO:tasks.workunit.client.1.smithi111.stdout:4/804: write d8/da/db/fa0 [120602,95164] 0 2023-12-08T20:28:00.414 INFO:tasks.workunit.client.1.smithi111.stdout:4/805: dread - d8/d30/d7d/d9b/db2/d4b/dd1/fc5 zero size 2023-12-08T20:28:00.415 INFO:tasks.workunit.client.1.smithi111.stdout:4/806: mknod d8/da/d29/c105 0 2023-12-08T20:28:00.417 INFO:tasks.workunit.client.1.smithi111.stdout:1/883: dwrite d0/d4d/f57 [0,4194304] 0 2023-12-08T20:28:00.433 INFO:tasks.workunit.client.1.smithi111.stdout:1/884: dwrite d0/d6/d33/d60/f7f [0,4194304] 0 2023-12-08T20:28:00.434 INFO:tasks.workunit.client.1.smithi111.stdout:1/885: link d0/d6/d33/d15/d51/l3d d0/d6/d47/l133 0 2023-12-08T20:28:00.435 INFO:tasks.workunit.client.1.smithi111.stdout:1/886: symlink d0/d8e/dd4/l134 0 2023-12-08T20:28:00.436 INFO:tasks.workunit.client.1.smithi111.stdout:1/887: symlink d0/d8e/dd4/dfc/l135 0 2023-12-08T20:28:00.436 INFO:tasks.workunit.client.1.smithi111.stdout:1/888: fsync d0/d6/d33/d8b/ffe 0 2023-12-08T20:28:00.436 INFO:tasks.workunit.client.1.smithi111.stdout:1/889: truncate d0/d6/d33/d15/d51/d78/f7c 1040240 0 2023-12-08T20:28:00.438 INFO:tasks.workunit.client.1.smithi111.stdout:4/807: dwrite d8/d30/d7d/d9b/db2/fed [0,4194304] 0 2023-12-08T20:28:00.443 INFO:tasks.workunit.client.1.smithi111.stdout:4/808: mknod d8/d30/d7d/d9b/db2/d4b/db7/c106 0 2023-12-08T20:28:00.447 INFO:tasks.workunit.client.1.smithi111.stdout:4/809: unlink d8/d30/d7d/d9b/db2/d4b/dd1/d1f/d40/l41 0 2023-12-08T20:28:00.447 INFO:tasks.workunit.client.1.smithi111.stdout:4/810: read - d8/da/d29/ffb zero size 2023-12-08T20:28:00.448 INFO:tasks.workunit.client.1.smithi111.stdout:1/890: dread d0/d6/d33/d15/d51/d2e/d61/d79/dac/f117 [0,4194304] 0 2023-12-08T20:28:00.449 INFO:tasks.workunit.client.1.smithi111.stdout:4/811: fsync d8/da/db/fa0 0 2023-12-08T20:28:00.451 INFO:tasks.workunit.client.1.smithi111.stdout:4/812: write d8/da/db/d7f/d93/d77/f6c [3168388,17850] 0 2023-12-08T20:28:00.451 INFO:tasks.workunit.client.1.smithi111.stdout:4/813: rename d8/da/d29 to d8/da/d29/d107 22 2023-12-08T20:28:00.451 INFO:tasks.workunit.client.1.smithi111.stdout:4/814: chown d8/da/d29/d5c/dca 151268773 1 2023-12-08T20:28:00.453 INFO:tasks.workunit.client.1.smithi111.stdout:4/815: dread d8/dda/fd9 [0,4194304] 0 2023-12-08T20:28:00.453 INFO:tasks.workunit.client.1.smithi111.stdout:6/725: sync 2023-12-08T20:28:00.454 INFO:tasks.workunit.client.1.smithi111.stdout:8/931: sync 2023-12-08T20:28:00.455 INFO:tasks.workunit.client.1.smithi111.stdout:4/816: mkdir d8/da/db/d7f/d93/d77/d108 0 2023-12-08T20:28:00.455 INFO:tasks.workunit.client.1.smithi111.stdout:6/726: symlink d0/d68/da9/le8 0 2023-12-08T20:28:00.455 INFO:tasks.workunit.client.1.smithi111.stdout:6/727: chown d0/d68/d95/d7a 3 1 2023-12-08T20:28:00.456 INFO:tasks.workunit.client.1.smithi111.stdout:8/932: creat dd/d32/dea/df1/d147/df9/f14a x:0 0 0 2023-12-08T20:28:00.458 INFO:tasks.workunit.client.1.smithi111.stdout:4/817: creat d8/d30/d7d/d9b/db2/d4b/db7/f109 x:0 0 0 2023-12-08T20:28:00.459 INFO:tasks.workunit.client.1.smithi111.stdout:6/728: creat d0/daa/fe9 x:0 0 0 2023-12-08T20:28:00.460 INFO:tasks.workunit.client.1.smithi111.stdout:8/933: stat dd/d2d/d62/d143/d6b/d72/c12d 0 2023-12-08T20:28:00.460 INFO:tasks.workunit.client.1.smithi111.stdout:8/934: chown dd/d32/f125 563981500 1 2023-12-08T20:28:00.461 INFO:tasks.workunit.client.1.smithi111.stdout:1/891: dwrite d0/d8e/db0/ff9 [0,4194304] 0 2023-12-08T20:28:00.461 INFO:tasks.workunit.client.1.smithi111.stdout:1/892: readlink d0/d8e/dd4/dfc/l135 0 2023-12-08T20:28:00.461 INFO:tasks.workunit.client.1.smithi111.stdout:1/893: dread - d0/d6/d33/d15/d51/d2e/d61/fdd zero size 2023-12-08T20:28:00.461 INFO:tasks.workunit.client.1.smithi111.stdout:4/818: symlink d8/d30/d7d/d9b/db2/d4b/l10a 0 2023-12-08T20:28:00.462 INFO:tasks.workunit.client.1.smithi111.stdout:6/729: creat d0/daa/fea x:0 0 0 2023-12-08T20:28:00.462 INFO:tasks.workunit.client.1.smithi111.stdout:8/935: creat dd/d2d/d62/d143/dd4/f14b x:0 0 0 2023-12-08T20:28:00.467 INFO:tasks.workunit.client.1.smithi111.stdout:1/894: creat d0/d6/d33/d15/d51/d2e/d61/d79/dc3/f136 x:0 0 0 2023-12-08T20:28:00.468 INFO:tasks.workunit.client.1.smithi111.stdout:4/819: getdents d8/d30/d7d 0 2023-12-08T20:28:00.471 INFO:tasks.workunit.client.1.smithi111.stdout:6/730: rename d0/d1/d1e/db2/f72 to d0/d1/d27/d36/d97/db4/feb 0 2023-12-08T20:28:00.471 INFO:tasks.workunit.client.1.smithi111.stdout:8/936: stat dd/d35/d42/c66 0 2023-12-08T20:28:00.472 INFO:tasks.workunit.client.1.smithi111.stdout:1/895: truncate d0/d6/d33/d15/d51/d5b/d59/db8/d103/f122 4095355 0 2023-12-08T20:28:00.472 INFO:tasks.workunit.client.1.smithi111.stdout:2/908: sync 2023-12-08T20:28:00.473 INFO:tasks.workunit.client.1.smithi111.stdout:3/796: sync 2023-12-08T20:28:00.473 INFO:tasks.workunit.client.1.smithi111.stdout:3/797: truncate d2/d3/f1c 4394238 0 2023-12-08T20:28:00.473 INFO:tasks.workunit.client.1.smithi111.stdout:2/909: write d1/d29/d53/d91/dbd/d120/de4/d114/f140 [802999,35165] 0 2023-12-08T20:28:00.473 INFO:tasks.workunit.client.1.smithi111.stdout:2/910: chown d1/d1d/f20 0 1 2023-12-08T20:28:00.477 INFO:tasks.workunit.client.1.smithi111.stdout:6/731: creat d0/d68/da9/fec x:0 0 0 2023-12-08T20:28:00.477 INFO:tasks.workunit.client.1.smithi111.stdout:6/732: stat d0/d68/c5e 0 2023-12-08T20:28:00.477 INFO:tasks.workunit.client.1.smithi111.stdout:7/894: sync 2023-12-08T20:28:00.478 INFO:tasks.workunit.client.1.smithi111.stdout:7/895: fsync da/d25/da9/db8/d89/fa1 0 2023-12-08T20:28:00.481 INFO:tasks.workunit.client.1.smithi111.stdout:8/937: write dd/d2d/d62/d143/d55/f82 [286803,98714] 0 2023-12-08T20:28:00.481 INFO:tasks.workunit.client.1.smithi111.stdout:8/938: fdatasync dd/d2d/d62/d143/f88 0 2023-12-08T20:28:00.482 INFO:tasks.workunit.client.1.smithi111.stdout:3/798: creat d2/d15/d17/d25/de0/ffe x:0 0 0 2023-12-08T20:28:00.483 INFO:tasks.workunit.client.1.smithi111.stdout:1/896: dread d0/d22/f9b [0,4194304] 0 2023-12-08T20:28:00.484 INFO:tasks.workunit.client.1.smithi111.stdout:4/820: getdents d8/d30/d7d/d9b/db2/d4b/db7 0 2023-12-08T20:28:00.484 INFO:tasks.workunit.client.1.smithi111.stdout:4/821: write d8/d30/fa3 [326457,99951] 0 2023-12-08T20:28:00.485 INFO:tasks.workunit.client.1.smithi111.stdout:1/897: dread d0/d6/d33/d60/f9e [0,4194304] 0 2023-12-08T20:28:00.488 INFO:tasks.workunit.client.1.smithi111.stdout:6/733: rename d0/d1/d27/d6e/ld4 to d0/d68/d95/de4/led 0 2023-12-08T20:28:00.488 INFO:tasks.workunit.client.1.smithi111.stdout:1/898: dread d0/d6/d33/d15/d51/d2e/d61/fbb [0,4194304] 0 2023-12-08T20:28:00.488 INFO:tasks.workunit.client.1.smithi111.stdout:1/899: chown d0/d4d/cd3 28 1 2023-12-08T20:28:00.491 INFO:tasks.workunit.client.1.smithi111.stdout:8/939: rmdir dd/d32 39 2023-12-08T20:28:00.491 INFO:tasks.workunit.client.1.smithi111.stdout:8/940: stat dd/d35/d42/la6 0 2023-12-08T20:28:00.491 INFO:tasks.workunit.client.1.smithi111.stdout:8/941: dread - dd/d32/d36/d4b/f9d zero size 2023-12-08T20:28:00.491 INFO:tasks.workunit.client.1.smithi111.stdout:3/799: truncate d2/d3/d6/fe 3883949 0 2023-12-08T20:28:00.492 INFO:tasks.workunit.client.1.smithi111.stdout:4/822: mknod d8/da/d29/d69/c10b 0 2023-12-08T20:28:00.494 INFO:tasks.workunit.client.1.smithi111.stdout:6/734: creat d0/d68/d95/d7a/fee x:0 0 0 2023-12-08T20:28:00.494 INFO:tasks.workunit.client.1.smithi111.stdout:6/735: dread - d0/d1/d1e/f92 zero size 2023-12-08T20:28:00.495 INFO:tasks.workunit.client.1.smithi111.stdout:6/736: truncate d0/d68/da9/fb6 161711 0 2023-12-08T20:28:00.496 INFO:tasks.workunit.client.1.smithi111.stdout:7/896: dwrite da/d13/d9e/d75/f99 [0,4194304] 0 2023-12-08T20:28:00.496 INFO:tasks.workunit.client.1.smithi111.stdout:1/900: mkdir d0/d6/d33/d15/d51/d2e/d61/d79/dc3/d137 0 2023-12-08T20:28:00.497 INFO:tasks.workunit.client.1.smithi111.stdout:4/823: write d8/da/d29/f39 [948077,19117] 0 2023-12-08T20:28:00.497 INFO:tasks.workunit.client.1.smithi111.stdout:8/942: symlink dd/d2d/d62/d83/l14c 0 2023-12-08T20:28:00.497 INFO:tasks.workunit.client.1.smithi111.stdout:8/943: chown dd/d2d/d62/d143 0 1 2023-12-08T20:28:00.498 INFO:tasks.workunit.client.1.smithi111.stdout:3/800: creat d2/d15/d17/d5e/df8/fff x:0 0 0 2023-12-08T20:28:00.499 INFO:tasks.workunit.client.1.smithi111.stdout:6/737: getdents d0/d1/d27/d36/d8d 0 2023-12-08T20:28:00.500 INFO:tasks.workunit.client.1.smithi111.stdout:7/897: link da/cf7 da/d5c/d59/df2/d118/c127 0 2023-12-08T20:28:00.502 INFO:tasks.workunit.client.1.smithi111.stdout:1/901: rename d0/d6/d34/f5f to d0/d6/d47/d132/f138 0 2023-12-08T20:28:00.503 INFO:tasks.workunit.client.1.smithi111.stdout:4/824: mkdir d8/da/d29/d5c/dbe/d10c 0 2023-12-08T20:28:00.511 INFO:tasks.workunit.client.1.smithi111.stdout:3/801: mknod d2/d15/d17/d5e/d9f/dbe/c100 0 2023-12-08T20:28:00.512 INFO:tasks.workunit.client.1.smithi111.stdout:8/944: rename dd/d32/f10b to dd/d32/de2/f14d 0 2023-12-08T20:28:00.512 INFO:tasks.workunit.client.1.smithi111.stdout:6/738: creat d0/d1/d27/da1/dca/fef x:0 0 0 2023-12-08T20:28:00.512 INFO:tasks.workunit.client.1.smithi111.stdout:6/739: dread - d0/d1/d27/d36/d8d/fbf zero size 2023-12-08T20:28:00.513 INFO:tasks.workunit.client.1.smithi111.stdout:8/945: getdents dd/d32/d36 0 2023-12-08T20:28:00.513 INFO:tasks.workunit.client.1.smithi111.stdout:8/946: chown dd/d32/f48 10579 1 2023-12-08T20:28:00.516 INFO:tasks.workunit.client.1.smithi111.stdout:8/947: creat dd/d2d/d62/d8c/f14e x:0 0 0 2023-12-08T20:28:00.516 INFO:tasks.workunit.client.1.smithi111.stdout:8/948: dread - dd/d32/de2/f128 zero size 2023-12-08T20:28:00.516 INFO:tasks.workunit.client.1.smithi111.stdout:4/825: rename d8/d30/d7d/d9b/db2/l47 to d8/d30/d7d/d9b/db2/d4b/dd1/dde/l10d 0 2023-12-08T20:28:00.518 INFO:tasks.workunit.client.1.smithi111.stdout:4/826: mkdir d8/da/d10e 0 2023-12-08T20:28:00.519 INFO:tasks.workunit.client.1.smithi111.stdout:4/827: unlink d8/da/db/fa0 0 2023-12-08T20:28:00.520 INFO:tasks.workunit.client.1.smithi111.stdout:6/740: write d0/f8c [2432812,4146] 0 2023-12-08T20:28:00.522 INFO:tasks.workunit.client.1.smithi111.stdout:4/828: readlink d8/d30/d7d/d9b/le4 0 2023-12-08T20:28:00.525 INFO:tasks.workunit.client.1.smithi111.stdout:1/902: dwrite d0/d4d/f8c [4194304,4194304] 0 2023-12-08T20:28:00.526 INFO:tasks.workunit.client.1.smithi111.stdout:4/829: dread d8/da/db/d7f/d8e/fe6 [0,4194304] 0 2023-12-08T20:28:00.528 INFO:tasks.workunit.client.1.smithi111.stdout:7/898: dwrite da/d25/dd9/fe5 [0,4194304] 0 2023-12-08T20:28:00.532 INFO:tasks.workunit.client.1.smithi111.stdout:7/899: symlink da/d13/d10a/l128 0 2023-12-08T20:28:00.533 INFO:tasks.workunit.client.1.smithi111.stdout:7/900: creat da/d64/f129 x:0 0 0 2023-12-08T20:28:00.540 INFO:tasks.workunit.client.1.smithi111.stdout:3/802: dwrite d2/d3/f16 [0,4194304] 0 2023-12-08T20:28:00.541 INFO:tasks.workunit.client.1.smithi111.stdout:6/741: dwrite d0/daa/fe9 [0,4194304] 0 2023-12-08T20:28:00.541 INFO:tasks.workunit.client.1.smithi111.stdout:6/742: dread - d0/d1/d27/f71 zero size 2023-12-08T20:28:00.546 INFO:tasks.workunit.client.1.smithi111.stdout:3/803: creat d2/d12/d2e/dc6/d93/f101 x:0 0 0 2023-12-08T20:28:00.548 INFO:tasks.workunit.client.1.smithi111.stdout:8/949: rename dd/d32/de2/f14d to dd/d32/de2/f14f 0 2023-12-08T20:28:00.552 INFO:tasks.workunit.client.1.smithi111.stdout:1/903: dwrite d0/d6/d47/f4a [0,4194304] 0 2023-12-08T20:28:00.552 INFO:tasks.workunit.client.1.smithi111.stdout:6/743: rename d0/d1/c82 to d0/d1/d1e/cf0 0 2023-12-08T20:28:00.553 INFO:tasks.workunit.client.1.smithi111.stdout:6/744: fsync d0/d1/d1e/f9b 0 2023-12-08T20:28:00.553 INFO:tasks.workunit.client.1.smithi111.stdout:4/830: dwrite d8/da/f66 [0,4194304] 0 2023-12-08T20:28:00.553 INFO:tasks.workunit.client.1.smithi111.stdout:7/901: dwrite da/d25/d26/d32/d87/faa [0,4194304] 0 2023-12-08T20:28:00.553 INFO:tasks.workunit.client.1.smithi111.stdout:1/904: mkdir d0/d6/d33/d15/d51/d11f/d139 0 2023-12-08T20:28:00.554 INFO:tasks.workunit.client.1.smithi111.stdout:6/745: stat d0/d68/d95/l57 0 2023-12-08T20:28:00.554 INFO:tasks.workunit.client.1.smithi111.stdout:6/746: fdatasync d0/d68/da9/fec 0 2023-12-08T20:28:00.558 INFO:tasks.workunit.client.1.smithi111.stdout:4/831: getdents d8/d30/d7d/d9b/db2/d4b/dd1/d1f 0 2023-12-08T20:28:00.562 INFO:tasks.workunit.client.1.smithi111.stdout:7/902: symlink da/d25/d26/d32/l12a 0 2023-12-08T20:28:00.562 INFO:tasks.workunit.client.1.smithi111.stdout:4/832: dread d8/da/db/f6b [0,4194304] 0 2023-12-08T20:28:00.562 INFO:tasks.workunit.client.1.smithi111.stdout:4/833: dread d8/da/d29/f78 [0,4194304] 0 2023-12-08T20:28:00.563 INFO:tasks.workunit.client.1.smithi111.stdout:6/747: mkdir d0/d1/d27/d6e/df1 0 2023-12-08T20:28:00.564 INFO:tasks.workunit.client.1.smithi111.stdout:7/903: link da/d25/d26/d112/d97/cb9 da/c12b 0 2023-12-08T20:28:00.564 INFO:tasks.workunit.client.1.smithi111.stdout:7/904: readlink da/l1d 0 2023-12-08T20:28:00.564 INFO:tasks.workunit.client.1.smithi111.stdout:7/905: write da/d25/d3d/f51 [1995204,68636] 0 2023-12-08T20:28:00.565 INFO:tasks.workunit.client.1.smithi111.stdout:4/834: truncate d8/da/d29/ff7 2918959 0 2023-12-08T20:28:00.565 INFO:tasks.workunit.client.1.smithi111.stdout:4/835: readlink d8/d30/d7d/d9b/db2/lcd 0 2023-12-08T20:28:00.565 INFO:tasks.workunit.client.1.smithi111.stdout:1/905: dwrite d0/d6/d33/d15/d51/d2e/d61/d79/fc6 [0,4194304] 0 2023-12-08T20:28:00.566 INFO:tasks.workunit.client.1.smithi111.stdout:6/748: link d0/d1/d1e/f9b d0/d68/d95/de4/ff2 0 2023-12-08T20:28:00.569 INFO:tasks.workunit.client.1.smithi111.stdout:7/906: rename da/d25/d3d to da/d64/d12c 0 2023-12-08T20:28:00.569 INFO:tasks.workunit.client.1.smithi111.stdout:7/907: stat da/d64/d12c/dc9/ff6 0 2023-12-08T20:28:00.570 INFO:tasks.workunit.client.1.smithi111.stdout:4/836: truncate d8/da/db/d7f/d93/d77/f6c 2558090 0 2023-12-08T20:28:00.570 INFO:tasks.workunit.client.1.smithi111.stdout:4/837: chown d8/d30/d7d/d9b/db2/d4b/dd1/d1f/ld0 27 1 2023-12-08T20:28:00.575 INFO:tasks.workunit.client.1.smithi111.stdout:1/906: rename d0/d6/d33/d6c/d75/f100 to d0/d6/d33/d15/d51/d5b/d5e/f13a 0 2023-12-08T20:28:00.575 INFO:tasks.workunit.client.1.smithi111.stdout:1/907: write d0/d6/d33/d15/d51/d5b/d5e/f10e [315086,58745] 0 2023-12-08T20:28:00.575 INFO:tasks.workunit.client.1.smithi111.stdout:7/908: getdents da/d25/dd9 0 2023-12-08T20:28:00.579 INFO:tasks.workunit.client.1.smithi111.stdout:6/749: getdents d0/d1 0 2023-12-08T20:28:00.579 INFO:tasks.workunit.client.1.smithi111.stdout:6/750: chown d0/d1/d27/d36/d8d/la6 7097343 1 2023-12-08T20:28:00.580 INFO:tasks.workunit.client.1.smithi111.stdout:1/908: stat d0/d6/d47/dee/cfd 0 2023-12-08T20:28:00.580 INFO:tasks.workunit.client.1.smithi111.stdout:1/909: chown d0/d8e/db0/lca 0 1 2023-12-08T20:28:00.581 INFO:tasks.workunit.client.1.smithi111.stdout:7/909: creat da/d25/d26/d32/d87/f12d x:0 0 0 2023-12-08T20:28:00.582 INFO:tasks.workunit.client.1.smithi111.stdout:7/910: dread - da/d25/d26/d112/f103 zero size 2023-12-08T20:28:00.582 INFO:tasks.workunit.client.1.smithi111.stdout:7/911: chown da/d25/dd9/fe5 554579608 1 2023-12-08T20:28:00.583 INFO:tasks.workunit.client.1.smithi111.stdout:6/751: creat d0/d1/d27/d56/ff3 x:0 0 0 2023-12-08T20:28:00.583 INFO:tasks.workunit.client.1.smithi111.stdout:1/910: getdents d0/d6/d33/d6c/d75/d89 0 2023-12-08T20:28:00.586 INFO:tasks.workunit.client.1.smithi111.stdout:7/912: rename da/d64/f71 to da/d38/d80/f12e 0 2023-12-08T20:28:00.586 INFO:tasks.workunit.client.1.smithi111.stdout:7/913: fsync da/d25/f5d 0 2023-12-08T20:28:00.587 INFO:tasks.workunit.client.1.smithi111.stdout:4/838: dwrite d8/dda/f94 [0,4194304] 0 2023-12-08T20:28:00.588 INFO:tasks.workunit.client.1.smithi111.stdout:7/914: truncate da/d64/d12c/fa5 845811 0 2023-12-08T20:28:00.589 INFO:tasks.workunit.client.1.smithi111.stdout:7/915: write da/d25/d26/f37 [1599349,121554] 0 2023-12-08T20:28:00.594 INFO:tasks.workunit.client.1.smithi111.stdout:6/752: rename d0/d68/d95/d7a/fc4 to d0/ff4 0 2023-12-08T20:28:00.594 INFO:tasks.workunit.client.1.smithi111.stdout:6/753: stat d0/d1/d27/d56 0 2023-12-08T20:28:00.594 INFO:tasks.workunit.client.1.smithi111.stdout:6/754: readlink d0/d68/d95/l9d 0 2023-12-08T20:28:00.594 INFO:tasks.workunit.client.1.smithi111.stdout:6/755: chown d0/f4a 6 1 2023-12-08T20:28:00.596 INFO:tasks.workunit.client.1.smithi111.stdout:7/916: creat da/d25/d26/d32/dcd/f12f x:0 0 0 2023-12-08T20:28:00.597 INFO:tasks.workunit.client.1.smithi111.stdout:7/917: symlink da/d5c/d6e/d10b/d11d/l130 0 2023-12-08T20:28:00.601 INFO:tasks.workunit.client.1.smithi111.stdout:6/756: dread d0/d68/d95/de4/ff2 [0,4194304] 0 2023-12-08T20:28:00.602 INFO:tasks.workunit.client.1.smithi111.stdout:6/757: chown d0/f12 107707 1 2023-12-08T20:28:00.607 INFO:tasks.workunit.client.1.smithi111.stdout:7/918: dread da/d5c/d59/df2/f106 [0,4194304] 0 2023-12-08T20:28:00.608 INFO:tasks.workunit.client.1.smithi111.stdout:7/919: read da/d25/da9/fdc [368022,53815] 0 2023-12-08T20:28:00.619 INFO:tasks.workunit.client.1.smithi111.stdout:6/758: dwrite d0/daa/fea [0,4194304] 0 2023-12-08T20:28:00.620 INFO:tasks.workunit.client.1.smithi111.stdout:6/759: mknod d0/d1/d1e/db2/da5/cf5 0 2023-12-08T20:28:00.621 INFO:tasks.workunit.client.1.smithi111.stdout:6/760: mkdir d0/d1/d27/da1/dca/df6 0 2023-12-08T20:28:00.622 INFO:tasks.workunit.client.1.smithi111.stdout:6/761: symlink d0/d1/d27/d36/d8d/lf7 0 2023-12-08T20:28:00.634 INFO:tasks.workunit.client.1.smithi111.stdout:6/762: dwrite d0/d68/da9/fec [0,4194304] 0 2023-12-08T20:28:00.640 INFO:tasks.workunit.client.1.smithi111.stdout:6/763: dread d0/d68/da9/fec [0,4194304] 0 2023-12-08T20:28:00.641 INFO:tasks.workunit.client.1.smithi111.stdout:6/764: mknod d0/d68/d95/cf8 0 2023-12-08T20:28:00.645 INFO:tasks.workunit.client.1.smithi111.stdout:6/765: dread d0/d1/f5 [4194304,4194304] 0 2023-12-08T20:28:00.646 INFO:tasks.workunit.client.1.smithi111.stdout:6/766: rename d0/d68/fce to d0/d1/d27/d6e/df1/ff9 0 2023-12-08T20:28:00.647 INFO:tasks.workunit.client.1.smithi111.stdout:6/767: stat d0/daa/fd6 0 2023-12-08T20:28:00.647 INFO:tasks.workunit.client.1.smithi111.stdout:6/768: getdents d0/d1/d1e/db2 0 2023-12-08T20:28:00.648 INFO:tasks.workunit.client.1.smithi111.stdout:6/769: write d0/d1/d27/d36/d97/fc3 [896900,60278] 0 2023-12-08T20:28:00.649 INFO:tasks.workunit.client.1.smithi111.stdout:6/770: rename d0/d1/l14 to d0/d1/d27/d36/d8d/lfa 0 2023-12-08T20:28:00.649 INFO:tasks.workunit.client.1.smithi111.stdout:6/771: chown d0/d1/d27/d36/l4c 3807 1 2023-12-08T20:28:00.649 INFO:tasks.workunit.client.1.smithi111.stdout:6/772: chown d0/d1/f2c 28 1 2023-12-08T20:28:00.660 INFO:tasks.workunit.client.1.smithi111.stdout:6/773: dwrite d0/d1/f96 [4194304,4194304] 0 2023-12-08T20:28:00.660 INFO:tasks.workunit.client.1.smithi111.stdout:6/774: stat d0/d1/d27/d36/d8d/la6 0 2023-12-08T20:28:00.660 INFO:tasks.workunit.client.1.smithi111.stdout:6/775: chown d0/d68/da9/fdf 2941 1 2023-12-08T20:28:00.681 INFO:tasks.workunit.client.1.smithi111.stdout:2/911: sync 2023-12-08T20:28:00.682 INFO:tasks.workunit.client.1.smithi111.stdout:2/912: fdatasync d1/d1d/d22/f89 0 2023-12-08T20:28:00.682 INFO:tasks.workunit.client.1.smithi111.stdout:2/913: chown d1/d29/d53/d91/dbd/d120/de4/lfc 13548864 1 2023-12-08T20:28:00.682 INFO:tasks.workunit.client.1.smithi111.stdout:2/914: creat d1/d29/d53/d91/dbd/f141 x:0 0 0 2023-12-08T20:28:00.683 INFO:tasks.workunit.client.1.smithi111.stdout:2/915: mknod d1/d1d/d1f/d25/d96/ddf/c142 0 2023-12-08T20:28:00.683 INFO:tasks.workunit.client.1.smithi111.stdout:2/916: truncate d1/d29/d53/d90/fd4 309037 0 2023-12-08T20:28:00.683 INFO:tasks.workunit.client.1.smithi111.stdout:2/917: stat d1/d29/d4e 0 2023-12-08T20:28:00.687 INFO:tasks.workunit.client.1.smithi111.stdout:2/918: dread d1/d1d/f5d [0,4194304] 0 2023-12-08T20:28:00.786 INFO:tasks.workunit.client.0.smithi043.stdout:8/0: mknod c0 0 2023-12-08T20:28:00.787 INFO:tasks.workunit.client.0.smithi043.stdout:3/0: symlink l0 0 2023-12-08T20:28:00.787 INFO:tasks.workunit.client.0.smithi043.stdout:3/1: dwrite - no filename 2023-12-08T20:28:00.787 INFO:tasks.workunit.client.0.smithi043.stdout:3/2: truncate - no filename 2023-12-08T20:28:00.787 INFO:tasks.workunit.client.0.smithi043.stdout:3/3: readlink l0 0 2023-12-08T20:28:00.797 INFO:tasks.workunit.client.0.smithi043.stdout:9/5: mkdir d0 0 2023-12-08T20:28:00.797 INFO:tasks.workunit.client.0.smithi043.stdout:9/6: dread - no filename 2023-12-08T20:28:00.797 INFO:tasks.workunit.client.0.smithi043.stdout:9/7: write - no filename 2023-12-08T20:28:00.797 INFO:tasks.workunit.client.0.smithi043.stdout:9/8: dwrite - no filename 2023-12-08T20:28:00.797 INFO:tasks.workunit.client.0.smithi043.stdout:9/9: dread - no filename 2023-12-08T20:28:00.830 INFO:tasks.workunit.client.1.smithi111.stdout:3/804: sync 2023-12-08T20:28:00.832 INFO:tasks.workunit.client.1.smithi111.stdout:3/805: creat d2/d3/d13/f102 x:0 0 0 2023-12-08T20:28:00.832 INFO:tasks.workunit.client.1.smithi111.stdout:3/806: write d2/d3/d13/d36/d69/fb6 [40105,122366] 0 2023-12-08T20:28:00.833 INFO:tasks.workunit.client.1.smithi111.stdout:3/807: write d2/d15/d17/d25/fd2 [1121244,12075] 0 2023-12-08T20:28:00.910 INFO:tasks.workunit.client.0.smithi043.stdout:1/6: rename f0 to d1/f2 0 2023-12-08T20:28:00.911 INFO:tasks.workunit.client.0.smithi043.stdout:1/7: stat d1 0 2023-12-08T20:28:00.911 INFO:tasks.workunit.client.0.smithi043.stdout:1/8: fdatasync d1/f2 0 2023-12-08T20:28:00.957 INFO:tasks.workunit.client.1.smithi111.stdout:8/950: sync 2023-12-08T20:28:00.976 INFO:tasks.workunit.client.1.smithi111.stdout:8/951: dwrite dd/d2d/d62/d143/dd4/f10d [0,4194304] 0 2023-12-08T20:28:00.976 INFO:tasks.workunit.client.1.smithi111.stdout:8/952: fdatasync dd/d2d/d62/d143/f5b 0 2023-12-08T20:28:00.978 INFO:tasks.workunit.client.1.smithi111.stdout:8/953: link dd/d32/d36/d4b/ld8 dd/d32/dea/df1/d147/df0/l150 0 2023-12-08T20:28:00.978 INFO:tasks.workunit.client.1.smithi111.stdout:8/954: dread - dd/d32/dea/df1/d147/df0/f111 zero size 2023-12-08T20:28:00.980 INFO:tasks.workunit.client.0.smithi043.stdout:0/17: mkdir d2/d4 0 2023-12-08T20:28:00.981 INFO:tasks.workunit.client.1.smithi111.stdout:8/955: creat dd/d2d/f151 x:0 0 0 2023-12-08T20:28:00.981 INFO:tasks.workunit.client.1.smithi111.stdout:8/956: read dd/d2d/f45 [2379077,105045] 0 2023-12-08T20:28:00.981 INFO:tasks.workunit.client.0.smithi043.stdout:0/18: write f1 [1801336,89774] 0 2023-12-08T20:28:00.982 INFO:tasks.workunit.client.1.smithi111.stdout:8/957: getdents dd/d2d/d62/d8c 0 2023-12-08T20:28:00.983 INFO:tasks.workunit.client.1.smithi111.stdout:8/958: creat dd/d2d/d62/d143/dd4/f152 x:0 0 0 2023-12-08T20:28:00.984 INFO:tasks.workunit.client.1.smithi111.stdout:8/959: dread dd/d2d/f33 [0,4194304] 0 2023-12-08T20:28:00.986 INFO:tasks.workunit.client.1.smithi111.stdout:8/960: rename dd/d32/dea/c11e to dd/d32/c153 0 2023-12-08T20:28:00.987 INFO:tasks.workunit.client.1.smithi111.stdout:8/961: stat dd/d32/dea/df1/d147/df0/c103 0 2023-12-08T20:28:00.987 INFO:tasks.workunit.client.1.smithi111.stdout:8/962: fsync dd/d2d/d62/d83/f13a 0 2023-12-08T20:28:00.987 INFO:tasks.workunit.client.1.smithi111.stdout:8/963: chown dd/d2d/d62/fe3 177 1 2023-12-08T20:28:00.995 INFO:tasks.workunit.client.1.smithi111.stdout:8/964: dread dd/d32/d36/d50/fc8 [0,4194304] 0 2023-12-08T20:28:00.997 INFO:tasks.workunit.client.1.smithi111.stdout:8/965: creat dd/d32/dea/df1/d147/df8/d13e/f154 x:0 0 0 2023-12-08T20:28:00.997 INFO:tasks.workunit.client.1.smithi111.stdout:8/966: fsync dd/d32/dea/df1/fe5 0 2023-12-08T20:28:00.998 INFO:tasks.workunit.client.1.smithi111.stdout:8/967: mknod dd/d35/d7a/c155 0 2023-12-08T20:28:00.998 INFO:tasks.workunit.client.1.smithi111.stdout:8/968: chown dd/d35/d42/db4/f12b 1 1 2023-12-08T20:28:00.999 INFO:tasks.workunit.client.1.smithi111.stdout:8/969: mkdir dd/d32/dea/df1/d147/df9/d156 0 2023-12-08T20:28:00.999 INFO:tasks.workunit.client.1.smithi111.stdout:8/970: write dd/d2d/d62/d143/d55/f82 [366792,118910] 0 2023-12-08T20:28:00.999 INFO:tasks.workunit.client.1.smithi111.stdout:8/971: chown dd/d2d/d62/d83/f13a 1299506 1 2023-12-08T20:28:01.000 INFO:tasks.workunit.client.1.smithi111.stdout:8/972: getdents dd/d35/d42/db4 0 2023-12-08T20:28:01.003 INFO:tasks.workunit.client.1.smithi111.stdout:8/973: write dd/d2d/d62/d83/f13a [2449994,130901] 0 2023-12-08T20:28:01.004 INFO:tasks.workunit.client.1.smithi111.stdout:8/974: mknod dd/dc9/c157 0 2023-12-08T20:28:01.004 INFO:tasks.workunit.client.1.smithi111.stdout:8/975: chown fa 946 1 2023-12-08T20:28:01.004 INFO:tasks.workunit.client.1.smithi111.stdout:8/976: dread - dd/d2d/f151 zero size 2023-12-08T20:28:01.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:00 smithi043 ceph-mon[111966]: pgmap v21: 65 pgs: 65 active+clean; 1.4 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 89 MiB/s rd, 176 MiB/s wr, 676 op/s 2023-12-08T20:28:01.019 INFO:tasks.workunit.client.1.smithi111.stdout:8/977: dwrite dd/d2d/d62/d143/d6b/f105 [0,4194304] 0 2023-12-08T20:28:01.021 INFO:tasks.workunit.client.1.smithi111.stdout:8/978: write dd/d32/dea/f113 [3115516,23] 0 2023-12-08T20:28:01.023 INFO:tasks.workunit.client.1.smithi111.stdout:8/979: symlink dd/d2d/d62/d143/d6b/d72/d118/l158 0 2023-12-08T20:28:01.024 INFO:tasks.workunit.client.1.smithi111.stdout:8/980: truncate dd/f11a 60091 0 2023-12-08T20:28:01.024 INFO:tasks.workunit.client.1.smithi111.stdout:8/981: chown dd/d2d/d8b/d9b/c11d 0 1 2023-12-08T20:28:01.026 INFO:tasks.workunit.client.1.smithi111.stdout:8/982: symlink dd/d2d/d8b/l159 0 2023-12-08T20:28:01.027 INFO:tasks.workunit.client.1.smithi111.stdout:8/983: creat dd/d2d/d62/d8c/f15a x:0 0 0 2023-12-08T20:28:01.028 INFO:tasks.workunit.client.1.smithi111.stdout:8/984: rmdir dd/d32/d36/d50 39 2023-12-08T20:28:01.028 INFO:tasks.workunit.client.1.smithi111.stdout:8/985: read fa [64231,412] 0 2023-12-08T20:28:01.030 INFO:tasks.workunit.client.1.smithi111.stdout:1/911: sync 2023-12-08T20:28:01.030 INFO:tasks.workunit.client.1.smithi111.stdout:1/912: chown d0/d6/d33/d15/d51/d2e/d61/d79 4112739 1 2023-12-08T20:28:01.031 INFO:tasks.workunit.client.1.smithi111.stdout:6/776: sync 2023-12-08T20:28:01.033 INFO:tasks.workunit.client.1.smithi111.stdout:6/777: getdents d0/d1/d27/d36/d97 0 2023-12-08T20:28:01.035 INFO:tasks.workunit.client.1.smithi111.stdout:6/778: dread d0/d1/f2c [0,4194304] 0 2023-12-08T20:28:01.037 INFO:tasks.workunit.client.1.smithi111.stdout:3/808: sync 2023-12-08T20:28:01.037 INFO:tasks.workunit.client.1.smithi111.stdout:4/839: sync 2023-12-08T20:28:01.037 INFO:tasks.workunit.client.1.smithi111.stdout:2/919: sync 2023-12-08T20:28:01.037 INFO:tasks.workunit.client.1.smithi111.stdout:7/920: sync 2023-12-08T20:28:01.039 INFO:tasks.workunit.client.1.smithi111.stdout:7/921: rename da/d25/d26/d32/dcd/f12f to da/d25/d26/d32/f131 0 2023-12-08T20:28:01.039 INFO:tasks.workunit.client.1.smithi111.stdout:7/922: chown da/d25/da9/fd8 2585 1 2023-12-08T20:28:01.040 INFO:tasks.workunit.client.1.smithi111.stdout:1/913: dread d0/d6/f105 [0,4194304] 0 2023-12-08T20:28:01.040 INFO:tasks.workunit.client.1.smithi111.stdout:2/920: creat d1/d29/dfe/def/f143 x:0 0 0 2023-12-08T20:28:01.041 INFO:tasks.workunit.client.1.smithi111.stdout:4/840: mknod d8/dda/c10f 0 2023-12-08T20:28:01.041 INFO:tasks.workunit.client.1.smithi111.stdout:7/923: write da/d25/faf [4660554,23839] 0 2023-12-08T20:28:01.042 INFO:tasks.workunit.client.1.smithi111.stdout:3/809: creat d2/d12/d2e/dc6/dda/f103 x:0 0 0 2023-12-08T20:28:01.042 INFO:tasks.workunit.client.1.smithi111.stdout:8/986: dwrite fa [0,4194304] 0 2023-12-08T20:28:01.042 INFO:tasks.workunit.client.1.smithi111.stdout:8/987: fsync dd/d2d/d8b/d9b/f10c 0 2023-12-08T20:28:01.043 INFO:tasks.workunit.client.1.smithi111.stdout:2/921: link d1/d1d/d1f/lf0 d1/d29/d4e/dbf/l144 0 2023-12-08T20:28:01.043 INFO:tasks.workunit.client.1.smithi111.stdout:2/922: chown d1/d29/d53/f7b 190 1 2023-12-08T20:28:01.043 INFO:tasks.workunit.client.1.smithi111.stdout:4/841: mknod d8/da/db/d7f/d93/d77/c110 0 2023-12-08T20:28:01.044 INFO:tasks.workunit.client.1.smithi111.stdout:1/914: write d0/d6/d33/d15/d51/d2e/d61/ff0 [1348066,49987] 0 2023-12-08T20:28:01.044 INFO:tasks.workunit.client.1.smithi111.stdout:1/915: truncate d0/d6/d33/d15/d51/d2e/d61/fdd 298076 0 2023-12-08T20:28:01.045 INFO:tasks.workunit.client.1.smithi111.stdout:7/924: mkdir da/d64/d12c/dc9/d132 0 2023-12-08T20:28:01.046 INFO:tasks.workunit.client.1.smithi111.stdout:3/810: creat d2/d3/d13/d36/d44/daa/f104 x:0 0 0 2023-12-08T20:28:01.047 INFO:tasks.workunit.client.1.smithi111.stdout:8/988: creat dd/d32/d36/d4b/f15b x:0 0 0 2023-12-08T20:28:01.048 INFO:tasks.workunit.client.1.smithi111.stdout:2/923: mknod d1/d29/d53/d91/c145 0 2023-12-08T20:28:01.048 INFO:tasks.workunit.client.1.smithi111.stdout:2/924: write d1/d29/d53/d90/f65 [694291,19667] 0 2023-12-08T20:28:01.048 INFO:tasks.workunit.client.1.smithi111.stdout:2/925: chown d1/d29/d53/d91/dbd/f141 473992 1 2023-12-08T20:28:01.049 INFO:tasks.workunit.client.1.smithi111.stdout:4/842: rename d8/da/l5b to d8/da/d29/d6e/l111 0 2023-12-08T20:28:01.051 INFO:tasks.workunit.client.1.smithi111.stdout:1/916: mknod d0/d6/d33/d15/d51/d5b/d114/c13b 0 2023-12-08T20:28:01.051 INFO:tasks.workunit.client.1.smithi111.stdout:6/779: dwrite d0/d1/d1e/f61 [0,4194304] 0 2023-12-08T20:28:01.051 INFO:tasks.workunit.client.1.smithi111.stdout:6/780: read d0/f4a [1304076,18442] 0 2023-12-08T20:28:01.051 INFO:tasks.workunit.client.1.smithi111.stdout:7/925: rmdir da/d64/d12c/d58/d117 0 2023-12-08T20:28:01.053 INFO:tasks.workunit.client.1.smithi111.stdout:3/811: mknod d2/d15/d17/d5e/c105 0 2023-12-08T20:28:01.053 INFO:tasks.workunit.client.1.smithi111.stdout:3/812: fsync d2/d3/d6/f23 0 2023-12-08T20:28:01.054 INFO:tasks.workunit.client.1.smithi111.stdout:8/989: mknod dd/d2d/d8b/d9b/c15c 0 2023-12-08T20:28:01.054 INFO:tasks.workunit.client.1.smithi111.stdout:8/990: chown dd/d32/dea/df1/fe5 0 1 2023-12-08T20:28:01.054 INFO:tasks.workunit.client.1.smithi111.stdout:8/991: fsync dd/f12 0 2023-12-08T20:28:01.055 INFO:tasks.workunit.client.1.smithi111.stdout:2/926: mkdir d1/d29/d4e/ddc/d108/d146 0 2023-12-08T20:28:01.056 INFO:tasks.workunit.client.1.smithi111.stdout:4/843: mknod d8/d30/d7d/d9b/db2/d4b/dd1/d1f/c112 0 2023-12-08T20:28:01.058 INFO:tasks.workunit.client.1.smithi111.stdout:1/917: symlink d0/d6/d33/d15/d51/d5b/d5e/da0/l13c 0 2023-12-08T20:28:01.059 INFO:tasks.workunit.client.1.smithi111.stdout:6/781: link d0/daa/fe9 d0/d1/d27/ffb 0 2023-12-08T20:28:01.061 INFO:tasks.workunit.client.1.smithi111.stdout:7/926: creat da/d5c/d59/df2/d118/f133 x:0 0 0 2023-12-08T20:28:01.061 INFO:tasks.workunit.client.1.smithi111.stdout:7/927: write da/d64/d12c/dc9/f123 [361093,27240] 0 2023-12-08T20:28:01.061 INFO:tasks.workunit.client.1.smithi111.stdout:7/928: chown da/d13/l7c 236 1 2023-12-08T20:28:01.061 INFO:tasks.workunit.client.1.smithi111.stdout:7/929: write da/d38/d80/fe0 [258660,52030] 0 2023-12-08T20:28:01.061 INFO:tasks.workunit.client.1.smithi111.stdout:7/930: dread - da/d25/d26/d112/f103 zero size 2023-12-08T20:28:01.061 INFO:tasks.workunit.client.1.smithi111.stdout:3/813: mkdir d2/d3/d13/d36/d44/d8f/dac/d106 0 2023-12-08T20:28:01.062 INFO:tasks.workunit.client.1.smithi111.stdout:8/992: getdents dd/d2d/d62/d143/d55 0 2023-12-08T20:28:01.063 INFO:tasks.workunit.client.1.smithi111.stdout:2/927: truncate d1/d29/d4e/ddc/fe0 2378687 0 2023-12-08T20:28:01.064 INFO:tasks.workunit.client.1.smithi111.stdout:4/844: unlink d8/d30/d97/lb0 0 2023-12-08T20:28:01.064 INFO:tasks.workunit.client.1.smithi111.stdout:4/845: readlink d8/da/d29/d6e/lcc 0 2023-12-08T20:28:01.064 INFO:tasks.workunit.client.1.smithi111.stdout:1/918: mkdir d0/d6/d33/d15/d51/d11f/d139/d13d 0 2023-12-08T20:28:01.066 INFO:tasks.workunit.client.1.smithi111.stdout:6/782: mkdir d0/d1/d1e/db2/da5/dfc 0 2023-12-08T20:28:01.069 INFO:tasks.workunit.client.1.smithi111.stdout:7/931: unlink da/d13/l15 0 2023-12-08T20:28:01.073 INFO:tasks.workunit.client.1.smithi111.stdout:4/846: creat d8/da/db/f113 x:0 0 0 2023-12-08T20:28:01.074 INFO:tasks.workunit.client.1.smithi111.stdout:1/919: mkdir d0/d6/d33/d15/d51/d2e/d61/d79/dac/d13e 0 2023-12-08T20:28:01.074 INFO:tasks.workunit.client.1.smithi111.stdout:3/814: dread d2/d12/dbd/fe8 [0,4194304] 0 2023-12-08T20:28:01.074 INFO:tasks.workunit.client.1.smithi111.stdout:7/932: mknod da/d64/d12c/dff/c134 0 2023-12-08T20:28:01.079 INFO:tasks.workunit.client.1.smithi111.stdout:4/847: symlink d8/da/db/d7f/d93/d77/l114 0 2023-12-08T20:28:01.081 INFO:tasks.workunit.client.1.smithi111.stdout:3/815: rename d2/d15/d17/d5e/d62/cc2 to d2/d12/d2e/c107 0 2023-12-08T20:28:01.083 INFO:tasks.workunit.client.1.smithi111.stdout:7/933: creat da/d64/d12c/dc9/f135 x:0 0 0 2023-12-08T20:28:01.089 INFO:tasks.workunit.client.1.smithi111.stdout:4/848: symlink d8/d30/d7d/d9b/db2/d4b/dd1/d1f/l115 0 2023-12-08T20:28:01.090 INFO:tasks.workunit.client.1.smithi111.stdout:8/993: dwrite dd/d35/f99 [0,4194304] 0 2023-12-08T20:28:01.090 INFO:tasks.workunit.client.1.smithi111.stdout:8/994: stat dd/d32/d36/d50/f65 0 2023-12-08T20:28:01.091 INFO:tasks.workunit.client.1.smithi111.stdout:4/849: rename d8/da/db/d7f/d93/d77/db5/fb8 to d8/da/d29/d5c/dbe/d10c/f116 0 2023-12-08T20:28:01.094 INFO:tasks.workunit.client.1.smithi111.stdout:4/850: write d8/f8f [1675578,16643] 0 2023-12-08T20:28:01.101 INFO:tasks.workunit.client.1.smithi111.stdout:2/928: dwrite d1/d29/d53/f3a [0,4194304] 0 2023-12-08T20:28:01.103 INFO:tasks.workunit.client.1.smithi111.stdout:2/929: mkdir d1/d1d/d55/d147 0 2023-12-08T20:28:01.103 INFO:tasks.workunit.client.1.smithi111.stdout:2/930: truncate d1/d29/d53/d90/d118/fcd 511304 0 2023-12-08T20:28:01.103 INFO:tasks.workunit.client.1.smithi111.stdout:2/931: chown d1/l28 4979 1 2023-12-08T20:28:01.103 INFO:tasks.workunit.client.1.smithi111.stdout:2/932: fdatasync d1/fbc 0 2023-12-08T20:28:01.104 INFO:tasks.workunit.client.1.smithi111.stdout:2/933: mkdir d1/d1d/d148 0 2023-12-08T20:28:01.104 INFO:tasks.workunit.client.1.smithi111.stdout:2/934: write d1/d1d/d1f/d25/d3d/da2/fd3 [4252148,92227] 0 2023-12-08T20:28:01.109 INFO:tasks.workunit.client.1.smithi111.stdout:6/783: dwrite d0/d1/f67 [0,4194304] 0 2023-12-08T20:28:01.109 INFO:tasks.workunit.client.1.smithi111.stdout:6/784: write d0/d1/d27/fd2 [242046,72046] 0 2023-12-08T20:28:01.109 INFO:tasks.workunit.client.1.smithi111.stdout:6/785: chown d0/d1/d1e/db2/da5/dfc 83582442 1 2023-12-08T20:28:01.112 INFO:tasks.workunit.client.1.smithi111.stdout:6/786: creat d0/d1/d27/d36/ffd x:0 0 0 2023-12-08T20:28:01.113 INFO:tasks.workunit.client.1.smithi111.stdout:2/935: dread d1/d1d/d1f/d36/d92/fbe [0,4194304] 0 2023-12-08T20:28:01.114 INFO:tasks.workunit.client.1.smithi111.stdout:6/787: mkdir d0/d68/d95/de4/dfe 0 2023-12-08T20:28:01.117 INFO:tasks.workunit.client.1.smithi111.stdout:2/936: rename d1/d29/d53/d91/dbd/d120/cba to d1/d1d/d68/d73/c149 0 2023-12-08T20:28:01.117 INFO:tasks.workunit.client.1.smithi111.stdout:2/937: readlink d1/d29/d4e/dbf/l144 0 2023-12-08T20:28:01.117 INFO:tasks.workunit.client.1.smithi111.stdout:2/938: write d1/d1d/d1f/d25/d3d/d56/d10a/f121 [416031,67618] 0 2023-12-08T20:28:01.117 INFO:tasks.workunit.client.1.smithi111.stdout:6/788: read d0/d1/d27/d36/f3e [1767182,64767] 0 2023-12-08T20:28:01.117 INFO:tasks.workunit.client.1.smithi111.stdout:2/939: write d1/d29/d4e/fb3 [78146,117164] 0 2023-12-08T20:28:01.119 INFO:tasks.workunit.client.1.smithi111.stdout:2/940: creat d1/d29/d53/d90/d118/d107/f14a x:0 0 0 2023-12-08T20:28:01.119 INFO:tasks.workunit.client.1.smithi111.stdout:2/941: chown d1/d1d/f11e 6557 1 2023-12-08T20:28:01.120 INFO:tasks.workunit.client.1.smithi111.stdout:2/942: mkdir d1/d1d/d1f/d25/d96/d134/d14b 0 2023-12-08T20:28:01.120 INFO:tasks.workunit.client.1.smithi111.stdout:6/789: dread d0/d1/d1e/f9b [0,4194304] 0 2023-12-08T20:28:01.121 INFO:tasks.workunit.client.1.smithi111.stdout:3/816: dwrite d2/d3/d13/d36/d69/d70/fb8 [0,4194304] 0 2023-12-08T20:28:01.122 INFO:tasks.workunit.client.1.smithi111.stdout:1/920: dwrite d0/d8e/db0/ff9 [4194304,4194304] 0 2023-12-08T20:28:01.122 INFO:tasks.workunit.client.1.smithi111.stdout:1/921: write d0/d6/d33/d15/d51/d2e/d61/d79/fe2 [1696058,116082] 0 2023-12-08T20:28:01.122 INFO:tasks.workunit.client.1.smithi111.stdout:1/922: chown d0/d6/d33/d15/d51/d2e/d61/d79/fe2 10082 1 2023-12-08T20:28:01.123 INFO:tasks.workunit.client.1.smithi111.stdout:1/923: fdatasync d0/d6/d33/d15/d51/d5b/f54 0 2023-12-08T20:28:01.123 INFO:tasks.workunit.client.1.smithi111.stdout:8/995: dwrite fa [0,4194304] 0 2023-12-08T20:28:01.123 INFO:tasks.workunit.client.1.smithi111.stdout:7/934: dwrite da/d5c/d6e/f125 [0,4194304] 0 2023-12-08T20:28:01.123 INFO:tasks.workunit.client.1.smithi111.stdout:2/943: link d1/d1d/f2e d1/d1d/d1f/d25/f14c 0 2023-12-08T20:28:01.123 INFO:tasks.workunit.client.1.smithi111.stdout:2/944: fsync d1/dec/f105 0 2023-12-08T20:28:01.123 INFO:tasks.workunit.client.1.smithi111.stdout:2/945: chown d1/d29/d53/d91/dbd/d120/c13d 1609803 1 2023-12-08T20:28:01.123 INFO:tasks.workunit.client.1.smithi111.stdout:2/946: write d1/d1d/d22/f89 [1002830,71467] 0 2023-12-08T20:28:01.123 INFO:tasks.workunit.client.1.smithi111.stdout:2/947: chown d1/d1d/d1f/dc1/l123 73 1 2023-12-08T20:28:01.123 INFO:tasks.workunit.client.1.smithi111.stdout:7/935: read da/d13/f45 [15993,20347] 0 2023-12-08T20:28:01.123 INFO:tasks.workunit.client.1.smithi111.stdout:7/936: write da/d5c/d6e/fdb [632404,87940] 0 2023-12-08T20:28:01.123 INFO:tasks.workunit.client.1.smithi111.stdout:7/937: chown da/d5c/d59/df2/f106 262219 1 2023-12-08T20:28:01.124 INFO:tasks.workunit.client.1.smithi111.stdout:6/790: link d0/d68/da9/fec d0/d1/d27/d36/d97/db4/fff 0 2023-12-08T20:28:01.125 INFO:tasks.workunit.client.1.smithi111.stdout:1/924: dread d0/d6/d33/d15/d51/f6e [0,4194304] 0 2023-12-08T20:28:01.127 INFO:tasks.workunit.client.1.smithi111.stdout:3/817: mkdir d2/d12/d4a/d5d/df5/d108 0 2023-12-08T20:28:01.130 INFO:tasks.workunit.client.1.smithi111.stdout:8/996: mknod dd/d96/c15d 0 2023-12-08T20:28:01.130 INFO:tasks.workunit.client.1.smithi111.stdout:8/997: fsync dd/f20 0 2023-12-08T20:28:01.130 INFO:tasks.workunit.client.1.smithi111.stdout:8/998: readlink dd/d2d/d62/d143/d6b/l112 0 2023-12-08T20:28:01.133 INFO:tasks.workunit.client.1.smithi111.stdout:2/948: unlink d1/dec/f105 0 2023-12-08T20:28:01.137 INFO:tasks.workunit.client.1.smithi111.stdout:7/938: rename da/d64/d12c/f51 to da/d25/d26/f136 0 2023-12-08T20:28:01.137 INFO:tasks.workunit.client.1.smithi111.stdout:8/999: dread dd/d35/d7a/fac [0,4194304] 0 2023-12-08T20:28:01.138 INFO:tasks.workunit.client.1.smithi111.stdout:6/791: symlink d0/d1/d27/d36/d97/l100 0 2023-12-08T20:28:01.141 INFO:tasks.workunit.client.1.smithi111.stdout:2/949: symlink d1/l14d 0 2023-12-08T20:28:01.142 INFO:tasks.workunit.client.1.smithi111.stdout:2/950: write d1/d29/d53/d90/fc3 [1204290,42806] 0 2023-12-08T20:28:01.144 INFO:tasks.workunit.client.1.smithi111.stdout:7/939: link da/d25/l44 da/d5c/d6e/d10b/d11d/l137 0 2023-12-08T20:28:01.144 INFO:tasks.workunit.client.1.smithi111.stdout:7/940: chown da/d25/da9/lb3 234 1 2023-12-08T20:28:01.144 INFO:tasks.workunit.client.1.smithi111.stdout:4/851: write d8/d30/d7d/d9b/db2/d4b/dd1/d1f/f52 [194338,46362] 0 2023-12-08T20:28:01.144 INFO:tasks.workunit.client.1.smithi111.stdout:4/852: chown d8/d30/d97 49830 1 2023-12-08T20:28:01.146 INFO:tasks.workunit.client.1.smithi111.stdout:6/792: symlink d0/d1/l101 0 2023-12-08T20:28:01.147 INFO:tasks.workunit.client.1.smithi111.stdout:6/793: chown d0/f20 15017 1 2023-12-08T20:28:01.147 INFO:tasks.workunit.client.1.smithi111.stdout:1/925: dwrite d0/d6/d33/d8b/f11a [0,4194304] 0 2023-12-08T20:28:01.147 INFO:tasks.workunit.client.1.smithi111.stdout:1/926: chown d0/d6/d33/d15/d51/d5b/l72 2888892 1 2023-12-08T20:28:01.147 INFO:tasks.workunit.client.1.smithi111.stdout:2/951: link d1/d29/d53/d91/dce/c113 d1/d1d/d1f/d36/d92/c14e 0 2023-12-08T20:28:01.147 INFO:tasks.workunit.client.1.smithi111.stdout:3/818: dwrite d2/d12/d4a/d5d/f82 [0,4194304] 0 2023-12-08T20:28:01.148 INFO:tasks.workunit.client.1.smithi111.stdout:3/819: chown d2/d15/l6c 51732 1 2023-12-08T20:28:01.148 INFO:tasks.workunit.client.1.smithi111.stdout:1/927: read d0/d6/f10 [1172225,3232] 0 2023-12-08T20:28:01.148 INFO:tasks.workunit.client.1.smithi111.stdout:7/941: creat da/d5c/f138 x:0 0 0 2023-12-08T20:28:01.148 INFO:tasks.workunit.client.1.smithi111.stdout:7/942: chown da/d38/d80/f12e 1908812 1 2023-12-08T20:28:01.148 INFO:tasks.workunit.client.1.smithi111.stdout:1/928: read d0/d6/d33/d15/d51/d2e/d61/d79/f124 [2315517,54877] 0 2023-12-08T20:28:01.149 INFO:tasks.workunit.client.1.smithi111.stdout:1/929: chown d0/d6/l42 3223494 1 2023-12-08T20:28:01.151 INFO:tasks.workunit.client.1.smithi111.stdout:7/943: dread da/d25/d26/d32/dcd/fd2 [0,4194304] 0 2023-12-08T20:28:01.152 INFO:tasks.workunit.client.1.smithi111.stdout:6/794: getdents d0/d68 0 2023-12-08T20:28:01.152 INFO:tasks.workunit.client.1.smithi111.stdout:6/795: fsync d0/d1/d27/f87 0 2023-12-08T20:28:01.154 INFO:tasks.workunit.client.1.smithi111.stdout:2/952: rename d1/d1d/d22/fe6 to d1/d29/d53/d91/dbd/f14f 0 2023-12-08T20:28:01.154 INFO:tasks.workunit.client.1.smithi111.stdout:2/953: chown d1/d29/d53/d91/dce/f10d 1123765 1 2023-12-08T20:28:01.157 INFO:tasks.workunit.client.1.smithi111.stdout:7/944: dread da/d25/d26/d32/dcd/ff8 [0,4194304] 0 2023-12-08T20:28:01.158 INFO:tasks.workunit.client.1.smithi111.stdout:1/930: unlink d0/c1e 0 2023-12-08T20:28:01.158 INFO:tasks.workunit.client.1.smithi111.stdout:1/931: fsync d0/d6/d33/d15/f8d 0 2023-12-08T20:28:01.158 INFO:tasks.workunit.client.1.smithi111.stdout:6/796: dread d0/d1/f6 [0,4194304] 0 2023-12-08T20:28:01.158 INFO:tasks.workunit.client.1.smithi111.stdout:4/853: dwrite d8/d30/d7d/d9b/db2/d4b/f53 [0,4194304] 0 2023-12-08T20:28:01.159 INFO:tasks.workunit.client.1.smithi111.stdout:1/932: write d0/d6/d33/d15/d51/d2e/d61/d79/fc6 [1364390,99279] 0 2023-12-08T20:28:01.164 INFO:tasks.workunit.client.1.smithi111.stdout:3/820: rename d2/d3/d51/df3/lf6 to d2/d12/d2e/l109 0 2023-12-08T20:28:01.166 INFO:tasks.workunit.client.1.smithi111.stdout:2/954: truncate d1/d1d/d1f/d25/d3d/d64/f80 2657638 0 2023-12-08T20:28:01.170 INFO:tasks.workunit.client.1.smithi111.stdout:6/797: getdents d0/d68/d8e 0 2023-12-08T20:28:01.170 INFO:tasks.workunit.client.1.smithi111.stdout:4/854: write d8/d30/f79 [2266399,124256] 0 2023-12-08T20:28:01.170 INFO:tasks.workunit.client.1.smithi111.stdout:4/855: fdatasync d8/f18 0 2023-12-08T20:28:01.170 INFO:tasks.workunit.client.1.smithi111.stdout:4/856: write d8/da/fd8 [571812,116651] 0 2023-12-08T20:28:01.172 INFO:tasks.workunit.client.1.smithi111.stdout:7/945: dwrite da/f46 [0,4194304] 0 2023-12-08T20:28:01.177 INFO:tasks.workunit.client.1.smithi111.stdout:6/798: creat d0/d1/d27/d36/d97/db4/f102 x:0 0 0 2023-12-08T20:28:01.177 INFO:tasks.workunit.client.1.smithi111.stdout:6/799: read - d0/d1/d27/f71 zero size 2023-12-08T20:28:01.178 INFO:tasks.workunit.client.1.smithi111.stdout:6/800: read d0/d1/f67 [517742,7029] 0 2023-12-08T20:28:01.179 INFO:tasks.workunit.client.1.smithi111.stdout:4/857: mknod d8/c117 0 2023-12-08T20:28:01.181 INFO:tasks.workunit.client.1.smithi111.stdout:2/955: rmdir d1/d29/d53/d91/dce 39 2023-12-08T20:28:01.186 INFO:tasks.workunit.client.1.smithi111.stdout:7/946: dwrite da/d38/f6a [0,4194304] 0 2023-12-08T20:28:01.188 INFO:tasks.workunit.client.1.smithi111.stdout:6/801: rmdir d0/d1/d27/da1/dca 39 2023-12-08T20:28:01.189 INFO:tasks.workunit.client.1.smithi111.stdout:4/858: dread d8/d30/d7d/d9b/db2/fed [0,4194304] 0 2023-12-08T20:28:01.189 INFO:tasks.workunit.client.1.smithi111.stdout:7/947: dread da/d13/fce [0,4194304] 0 2023-12-08T20:28:01.189 INFO:tasks.workunit.client.1.smithi111.stdout:4/859: truncate d8/da/d29/d69/ffa 188422 0 2023-12-08T20:28:01.189 INFO:tasks.workunit.client.1.smithi111.stdout:2/956: mkdir d1/d1d/d1f/d25/d3d/d41/d150 0 2023-12-08T20:28:01.189 INFO:tasks.workunit.client.1.smithi111.stdout:2/957: chown d1/d1d/d1f/d25/d3d/d64/c12f 0 1 2023-12-08T20:28:01.189 INFO:tasks.workunit.client.1.smithi111.stdout:2/958: fdatasync d1/d1d/f2e 0 2023-12-08T20:28:01.190 INFO:tasks.workunit.client.1.smithi111.stdout:7/948: read da/d25/dd9/fe5 [3530714,91748] 0 2023-12-08T20:28:01.190 INFO:tasks.workunit.client.1.smithi111.stdout:4/860: write d8/da/d29/d5c/dbe/d10c/f116 [1358676,31651] 0 2023-12-08T20:28:01.194 INFO:tasks.workunit.client.1.smithi111.stdout:2/959: mkdir d1/d1d/d1f/d25/dde/d151 0 2023-12-08T20:28:01.196 INFO:tasks.workunit.client.1.smithi111.stdout:4/861: mknod d8/d30/d7d/d9b/db2/c118 0 2023-12-08T20:28:01.196 INFO:tasks.workunit.client.1.smithi111.stdout:4/862: getdents d8/da/db/d7f/d93/d77/d108 0 2023-12-08T20:28:01.197 INFO:tasks.workunit.client.1.smithi111.stdout:2/960: dread d1/d1d/d22/f89 [0,4194304] 0 2023-12-08T20:28:01.197 INFO:tasks.workunit.client.1.smithi111.stdout:2/961: write d1/d1d/d22/f132 [86354,27908] 0 2023-12-08T20:28:01.198 INFO:tasks.workunit.client.1.smithi111.stdout:2/962: mkdir d1/d29/d4e/ddc/d104/d152 0 2023-12-08T20:28:01.201 INFO:tasks.workunit.client.1.smithi111.stdout:2/963: creat d1/d1d/d1f/d25/d3d/d41/f153 x:0 0 0 2023-12-08T20:28:01.204 INFO:tasks.workunit.client.1.smithi111.stdout:2/964: rename d1/d1d/d22/fff to d1/d1d/d1f/d25/d67/f154 0 2023-12-08T20:28:01.204 INFO:tasks.workunit.client.1.smithi111.stdout:2/965: readlink d1/d29/d53/l17 0 2023-12-08T20:28:01.204 INFO:tasks.workunit.client.1.smithi111.stdout:2/966: chown d1/d29/d4e/ddc/fe0 5 1 2023-12-08T20:28:01.210 INFO:tasks.workunit.client.1.smithi111.stdout:6/802: dwrite d0/d68/f8b [0,4194304] 0 2023-12-08T20:28:01.210 INFO:tasks.workunit.client.1.smithi111.stdout:6/803: stat d0/d1/d27/d36/c3b 0 2023-12-08T20:28:01.213 INFO:tasks.workunit.client.1.smithi111.stdout:6/804: unlink d0/daa/fe9 0 2023-12-08T20:28:01.213 INFO:tasks.workunit.client.1.smithi111.stdout:6/805: stat d0/d1/f96 0 2023-12-08T20:28:01.219 INFO:tasks.workunit.client.1.smithi111.stdout:2/967: dread d1/d1d/d1f/d25/f78 [0,4194304] 0 2023-12-08T20:28:01.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:00 smithi111 ceph-mon[121341]: pgmap v21: 65 pgs: 65 active+clean; 1.4 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 89 MiB/s rd, 176 MiB/s wr, 676 op/s 2023-12-08T20:28:01.221 INFO:tasks.workunit.client.1.smithi111.stdout:2/968: mknod d1/d1d/d55/d147/c155 0 2023-12-08T20:28:01.221 INFO:tasks.workunit.client.1.smithi111.stdout:2/969: write d1/d1d/d68/f124 [1018600,9488] 0 2023-12-08T20:28:01.222 INFO:tasks.workunit.client.1.smithi111.stdout:2/970: creat d1/d29/d53/d91/dbd/d120/de4/d114/f156 x:0 0 0 2023-12-08T20:28:01.222 INFO:tasks.workunit.client.1.smithi111.stdout:2/971: mknod d1/d1d/c157 0 2023-12-08T20:28:01.223 INFO:tasks.workunit.client.1.smithi111.stdout:2/972: rmdir d1/d29/d53/d91/dce 39 2023-12-08T20:28:01.225 INFO:tasks.workunit.client.1.smithi111.stdout:2/973: getdents d1/d29/d53/d90/d118 0 2023-12-08T20:28:01.225 INFO:tasks.workunit.client.1.smithi111.stdout:7/949: dwrite da/d64/d12c/d58/f5e [0,4194304] 0 2023-12-08T20:28:01.226 INFO:tasks.workunit.client.1.smithi111.stdout:2/974: link d1/d1d/d1f/l42 d1/d29/d53/d91/dbd/d120/de4/d114/l158 0 2023-12-08T20:28:01.227 INFO:tasks.workunit.client.1.smithi111.stdout:7/950: rmdir da/d5c/d6e/d10b/d11d 39 2023-12-08T20:28:01.227 INFO:tasks.workunit.client.1.smithi111.stdout:2/975: getdents d1/d29/dfe 0 2023-12-08T20:28:01.233 INFO:tasks.workunit.client.1.smithi111.stdout:7/951: dread da/d25/d26/f2b [0,4194304] 0 2023-12-08T20:28:01.234 INFO:tasks.workunit.client.1.smithi111.stdout:4/863: dwrite d8/da/d29/f102 [0,4194304] 0 2023-12-08T20:28:01.235 INFO:tasks.workunit.client.1.smithi111.stdout:4/864: read d8/da/db/d7f/d93/d77/f87 [3603150,112996] 0 2023-12-08T20:28:01.235 INFO:tasks.workunit.client.1.smithi111.stdout:7/952: creat da/f139 x:0 0 0 2023-12-08T20:28:01.235 INFO:tasks.workunit.client.1.smithi111.stdout:7/953: write da/d25/d26/d32/d87/fd1 [29387,98382] 0 2023-12-08T20:28:01.235 INFO:tasks.workunit.client.1.smithi111.stdout:6/806: dwrite d0/d1/d1e/f2b [0,4194304] 0 2023-12-08T20:28:01.237 INFO:tasks.workunit.client.1.smithi111.stdout:4/865: write d8/da/db/d7f/d8e/fcb [2288157,72821] 0 2023-12-08T20:28:01.237 INFO:tasks.workunit.client.1.smithi111.stdout:4/866: chown d8/da/d29/d6e 2160838 1 2023-12-08T20:28:01.239 INFO:tasks.workunit.client.1.smithi111.stdout:7/954: mknod da/d25/d26/d112/d97/c13a 0 2023-12-08T20:28:01.241 INFO:tasks.workunit.client.1.smithi111.stdout:6/807: creat d0/d68/d95/de4/dfe/f103 x:0 0 0 2023-12-08T20:28:01.248 INFO:tasks.workunit.client.1.smithi111.stdout:4/867: mkdir d8/da/d29/d119 0 2023-12-08T20:28:01.248 INFO:tasks.workunit.client.1.smithi111.stdout:4/868: write d8/da/db/d7f/d8e/fe6 [1392872,122345] 0 2023-12-08T20:28:01.248 INFO:tasks.workunit.client.1.smithi111.stdout:4/869: write d8/da/db/f8d [1671945,11925] 0 2023-12-08T20:28:01.249 INFO:tasks.workunit.client.1.smithi111.stdout:7/955: getdents da/d13/d9e 0 2023-12-08T20:28:01.249 INFO:tasks.workunit.client.1.smithi111.stdout:7/956: readlink da/d13/d9e/l96 0 2023-12-08T20:28:01.249 INFO:tasks.workunit.client.1.smithi111.stdout:4/870: write d8/da/db/d7f/d93/f3f [3443511,99044] 0 2023-12-08T20:28:01.250 INFO:tasks.workunit.client.1.smithi111.stdout:6/808: mknod d0/d1/d27/da1/dca/c104 0 2023-12-08T20:28:01.253 INFO:tasks.workunit.client.1.smithi111.stdout:7/957: truncate da/d25/d26/d112/d97/fa6 3463441 0 2023-12-08T20:28:01.254 INFO:tasks.workunit.client.1.smithi111.stdout:4/871: rename d8/da/d29/d5c/dbe to d8/d30/d7d/d9b/db2/d4b/dd1/d1f/d11a 0 2023-12-08T20:28:01.254 INFO:tasks.workunit.client.1.smithi111.stdout:6/809: stat d0/d1/d27/d36/d97/db4/fff 0 2023-12-08T20:28:01.256 INFO:tasks.workunit.client.1.smithi111.stdout:4/872: truncate d8/da/d29/f39 1910719 0 2023-12-08T20:28:01.257 INFO:tasks.workunit.client.1.smithi111.stdout:4/873: creat d8/da/d29/d5c/dca/f11b x:0 0 0 2023-12-08T20:28:01.261 INFO:tasks.workunit.client.1.smithi111.stdout:4/874: truncate d8/da/db/d7f/d8e/fcb 2178298 0 2023-12-08T20:28:01.263 INFO:tasks.workunit.client.1.smithi111.stdout:4/875: creat d8/da/d29/d119/f11c x:0 0 0 2023-12-08T20:28:01.263 INFO:tasks.workunit.client.1.smithi111.stdout:4/876: stat d8/d30/d7d/f101 0 2023-12-08T20:28:01.280 INFO:tasks.workunit.client.1.smithi111.stdout:7/958: dwrite da/d5c/d59/df2/d118/f133 [0,4194304] 0 2023-12-08T20:28:01.282 INFO:tasks.workunit.client.1.smithi111.stdout:7/959: truncate da/f1b 6692933 0 2023-12-08T20:28:01.283 INFO:tasks.workunit.client.1.smithi111.stdout:7/960: fsync da/d64/d12c/fa5 0 2023-12-08T20:28:01.290 INFO:tasks.workunit.client.1.smithi111.stdout:6/810: dwrite d0/d1/d27/d36/d8d/f9c [0,4194304] 0 2023-12-08T20:28:01.297 INFO:tasks.workunit.client.1.smithi111.stdout:4/877: dwrite d8/da/db/d7f/da7/fad [0,4194304] 0 2023-12-08T20:28:01.299 INFO:tasks.workunit.client.1.smithi111.stdout:4/878: mknod d8/d30/d7d/d9b/db2/d4b/dd1/d1f/c11d 0 2023-12-08T20:28:01.301 INFO:tasks.workunit.client.1.smithi111.stdout:4/879: mknod d8/da/d29/d69/c11e 0 2023-12-08T20:28:01.301 INFO:tasks.workunit.client.1.smithi111.stdout:7/961: dwrite da/d5c/fcc [0,4194304] 0 2023-12-08T20:28:01.301 INFO:tasks.workunit.client.1.smithi111.stdout:7/962: chown da/d25/dd9 834548283 1 2023-12-08T20:28:01.302 INFO:tasks.workunit.client.1.smithi111.stdout:4/880: mknod d8/d30/d7d/d9b/db2/c11f 0 2023-12-08T20:28:01.303 INFO:tasks.workunit.client.1.smithi111.stdout:7/963: rmdir da/d25/da9/db8/d89/de2 0 2023-12-08T20:28:01.303 INFO:tasks.workunit.client.1.smithi111.stdout:7/964: truncate da/d25/d26/f136 2273947 0 2023-12-08T20:28:01.304 INFO:tasks.workunit.client.1.smithi111.stdout:7/965: symlink da/d25/da9/db8/d89/l13b 0 2023-12-08T20:28:01.307 INFO:tasks.workunit.client.1.smithi111.stdout:4/881: dread d8/da/d29/d6e/f96 [0,4194304] 0 2023-12-08T20:28:01.308 INFO:tasks.workunit.client.1.smithi111.stdout:4/882: truncate d8/d30/d7d/d9b/db2/d4b/dd1/d1f/fe 3562073 0 2023-12-08T20:28:01.309 INFO:tasks.workunit.client.1.smithi111.stdout:4/883: symlink d8/d30/d97/l120 0 2023-12-08T20:28:01.309 INFO:tasks.workunit.client.1.smithi111.stdout:4/884: read - d8/da/d29/f9a zero size 2023-12-08T20:28:01.310 INFO:tasks.workunit.client.1.smithi111.stdout:4/885: link d8/da/d29/d69/c10b d8/da/d29/d69/c121 0 2023-12-08T20:28:01.310 INFO:tasks.workunit.client.1.smithi111.stdout:4/886: read - d8/da/d29/f9a zero size 2023-12-08T20:28:01.310 INFO:tasks.workunit.client.1.smithi111.stdout:4/887: dread - d8/d30/d7d/d9b/fa8 zero size 2023-12-08T20:28:01.313 INFO:tasks.workunit.client.1.smithi111.stdout:4/888: dread d8/d30/d7d/d9b/db2/f98 [0,4194304] 0 2023-12-08T20:28:01.315 INFO:tasks.workunit.client.1.smithi111.stdout:4/889: truncate d8/d30/fd4 427531 0 2023-12-08T20:28:01.319 INFO:tasks.workunit.client.0.smithi043.stdout:2/14: creat d0/f2 x:0 0 0 2023-12-08T20:28:01.319 INFO:tasks.workunit.client.0.smithi043.stdout:8/1: mknod c1 0 2023-12-08T20:28:01.319 INFO:tasks.workunit.client.0.smithi043.stdout:8/2: write - no filename 2023-12-08T20:28:01.321 INFO:tasks.workunit.client.0.smithi043.stdout:3/4: mkdir d1 0 2023-12-08T20:28:01.323 INFO:tasks.workunit.client.0.smithi043.stdout:9/10: symlink d0/l1 0 2023-12-08T20:28:01.323 INFO:tasks.workunit.client.0.smithi043.stdout:9/11: truncate - no filename 2023-12-08T20:28:01.324 INFO:tasks.workunit.client.1.smithi111.stdout:4/890: dread d8/d30/d7d/d9b/db2/d4b/db7/fe9 [0,4194304] 0 2023-12-08T20:28:01.325 INFO:tasks.workunit.client.0.smithi043.stdout:0/19: mknod d2/d3/c5 0 2023-12-08T20:28:01.326 INFO:tasks.workunit.client.0.smithi043.stdout:2/15: rename d0/f2 to d0/f3 0 2023-12-08T20:28:01.328 INFO:tasks.workunit.client.0.smithi043.stdout:8/3: mkdir d2 0 2023-12-08T20:28:01.328 INFO:tasks.workunit.client.0.smithi043.stdout:8/4: fdatasync - no filename 2023-12-08T20:28:01.328 INFO:tasks.workunit.client.0.smithi043.stdout:8/5: chown d2 5 1 2023-12-08T20:28:01.328 INFO:tasks.workunit.client.0.smithi043.stdout:8/6: chown c0 14472 1 2023-12-08T20:28:01.329 INFO:tasks.workunit.client.0.smithi043.stdout:3/5: link l0 d1/l2 0 2023-12-08T20:28:01.329 INFO:tasks.workunit.client.0.smithi043.stdout:3/6: write - no filename 2023-12-08T20:28:01.329 INFO:tasks.workunit.client.0.smithi043.stdout:3/7: write - no filename 2023-12-08T20:28:01.330 INFO:tasks.workunit.client.0.smithi043.stdout:9/12: rmdir d0 39 2023-12-08T20:28:01.330 INFO:tasks.workunit.client.0.smithi043.stdout:9/13: rename d0 to d0/d2 22 2023-12-08T20:28:01.332 INFO:tasks.workunit.client.1.smithi111.stdout:4/891: creat d8/da/d29/f122 x:0 0 0 2023-12-08T20:28:01.333 INFO:tasks.workunit.client.0.smithi043.stdout:2/16: truncate d0/f1 2733482 0 2023-12-08T20:28:01.334 INFO:tasks.workunit.client.0.smithi043.stdout:8/7: creat d2/f3 x:0 0 0 2023-12-08T20:28:01.335 INFO:tasks.workunit.client.0.smithi043.stdout:3/8: mknod d1/c3 0 2023-12-08T20:28:01.335 INFO:tasks.workunit.client.0.smithi043.stdout:3/9: write - no filename 2023-12-08T20:28:01.335 INFO:tasks.workunit.client.0.smithi043.stdout:3/10: dwrite - no filename 2023-12-08T20:28:01.335 INFO:tasks.workunit.client.0.smithi043.stdout:3/11: chown d1/c3 158937 1 2023-12-08T20:28:01.336 INFO:tasks.workunit.client.0.smithi043.stdout:9/14: creat d0/f3 x:0 0 0 2023-12-08T20:28:01.338 INFO:tasks.workunit.client.0.smithi043.stdout:8/8: mkdir d2/d4 0 2023-12-08T20:28:01.338 INFO:tasks.workunit.client.0.smithi043.stdout:8/9: truncate d2/f3 225905 0 2023-12-08T20:28:01.339 INFO:tasks.workunit.client.0.smithi043.stdout:8/10: dread d2/f3 [0,4194304] 0 2023-12-08T20:28:01.339 INFO:tasks.workunit.client.0.smithi043.stdout:8/11: chown c1 32 1 2023-12-08T20:28:01.340 INFO:tasks.workunit.client.0.smithi043.stdout:9/15: mknod d0/c4 0 2023-12-08T20:28:01.340 INFO:tasks.workunit.client.0.smithi043.stdout:9/16: read - d0/f3 zero size 2023-12-08T20:28:01.340 INFO:tasks.workunit.client.0.smithi043.stdout:8/12: read d2/f3 [198079,27548] 0 2023-12-08T20:28:01.341 INFO:tasks.workunit.client.0.smithi043.stdout:8/13: truncate d2/f3 1133748 0 2023-12-08T20:28:01.341 INFO:tasks.workunit.client.0.smithi043.stdout:8/14: write d2/f3 [1593722,9470] 0 2023-12-08T20:28:01.345 INFO:tasks.workunit.client.1.smithi111.stdout:4/892: dwrite d8/d30/d7d/d9b/db2/d4b/dd1/d1f/f58 [0,4194304] 0 2023-12-08T20:28:01.349 INFO:tasks.workunit.client.1.smithi111.stdout:4/893: rmdir d8/d30 39 2023-12-08T20:28:01.358 INFO:tasks.workunit.client.1.smithi111.stdout:4/894: dread d8/da/f66 [4194304,4194304] 0 2023-12-08T20:28:01.363 INFO:tasks.workunit.client.1.smithi111.stdout:4/895: symlink d8/dda/l123 0 2023-12-08T20:28:01.364 INFO:tasks.workunit.client.1.smithi111.stdout:4/896: rmdir d8/da/db/d7f/df3 0 2023-12-08T20:28:01.364 INFO:tasks.workunit.client.1.smithi111.stdout:4/897: fdatasync d8/fbb 0 2023-12-08T20:28:01.365 INFO:tasks.workunit.client.1.smithi111.stdout:4/898: fsync d8/d30/d7d/fb4 0 2023-12-08T20:28:01.365 INFO:tasks.workunit.client.1.smithi111.stdout:4/899: write d8/da/db/fc [2573024,98181] 0 2023-12-08T20:28:01.367 INFO:tasks.workunit.client.0.smithi043.stdout:8/15: dwrite d2/f3 [0,4194304] 0 2023-12-08T20:28:01.376 INFO:tasks.workunit.client.1.smithi111.stdout:4/900: dread d8/d30/d7d/d9b/db2/f34 [0,4194304] 0 2023-12-08T20:28:01.376 INFO:tasks.workunit.client.1.smithi111.stdout:4/901: truncate d8/da/d29/d119/f11c 577000 0 2023-12-08T20:28:01.376 INFO:tasks.workunit.client.1.smithi111.stdout:4/902: rmdir d8/da/db/d7f/da7 39 2023-12-08T20:28:01.377 INFO:tasks.workunit.client.1.smithi111.stdout:4/903: rename d8/da/d29/f84 to d8/da/db/d7f/f124 0 2023-12-08T20:28:01.377 INFO:tasks.workunit.client.1.smithi111.stdout:4/904: stat d8/da/l36 0 2023-12-08T20:28:01.377 INFO:tasks.workunit.client.1.smithi111.stdout:4/905: creat d8/d30/f125 x:0 0 0 2023-12-08T20:28:01.377 INFO:tasks.workunit.client.1.smithi111.stdout:4/906: write d8/d30/d7d/d9b/db2/d4b/dd1/d1f/f1a [910008,17948] 0 2023-12-08T20:28:01.378 INFO:tasks.workunit.client.1.smithi111.stdout:4/907: chown d8/da/d29/d6e/f96 37484285 1 2023-12-08T20:28:01.391 INFO:tasks.workunit.client.1.smithi111.stdout:4/908: dwrite d8/d30/d7d/d9b/db2/d4b/db7/f109 [0,4194304] 0 2023-12-08T20:28:01.391 INFO:tasks.workunit.client.1.smithi111.stdout:4/909: readlink d8/da/d29/d69/l9c 0 2023-12-08T20:28:01.394 INFO:tasks.workunit.client.1.smithi111.stdout:4/910: rename d8/da/db/f8d to d8/d30/d7d/d9b/db2/d4b/dd1/d1f/d11a/d10c/f126 0 2023-12-08T20:28:01.396 INFO:tasks.workunit.client.1.smithi111.stdout:4/911: creat d8/d30/d97/f127 x:0 0 0 2023-12-08T20:28:01.397 INFO:tasks.workunit.client.1.smithi111.stdout:4/912: read d8/d30/d7d/d9b/db2/d4b/dd1/d1f/d11a/d10c/f116 [70242,88265] 0 2023-12-08T20:28:01.397 INFO:tasks.workunit.client.1.smithi111.stdout:4/913: dread - d8/da/db/f113 zero size 2023-12-08T20:28:01.409 INFO:tasks.workunit.client.1.smithi111.stdout:4/914: dwrite d8/d30/d7d/d9b/db2/d4b/dd1/d1f/d40/fe3 [0,4194304] 0 2023-12-08T20:28:01.414 INFO:tasks.workunit.client.1.smithi111.stdout:4/915: creat d8/da/db/d7f/f128 x:0 0 0 2023-12-08T20:28:01.414 INFO:tasks.workunit.client.1.smithi111.stdout:4/916: fdatasync d8/da/fd8 0 2023-12-08T20:28:01.415 INFO:tasks.workunit.client.1.smithi111.stdout:4/917: mknod d8/d30/d7d/d9b/c129 0 2023-12-08T20:28:01.415 INFO:tasks.workunit.client.1.smithi111.stdout:4/918: truncate d8/d30/fd4 1329555 0 2023-12-08T20:28:01.415 INFO:tasks.workunit.client.1.smithi111.stdout:4/919: creat d8/da/d10e/f12a x:0 0 0 2023-12-08T20:28:01.416 INFO:tasks.workunit.client.1.smithi111.stdout:4/920: creat d8/d30/d7d/d9b/db2/d4b/dd1/f12b x:0 0 0 2023-12-08T20:28:01.417 INFO:tasks.workunit.client.1.smithi111.stdout:4/921: chown d8/da/d29/d69/fc6 6385 1 2023-12-08T20:28:01.417 INFO:tasks.workunit.client.1.smithi111.stdout:4/922: write d8/da/db/d7f/d93/d77/f6c [583011,83023] 0 2023-12-08T20:28:01.419 INFO:tasks.workunit.client.1.smithi111.stdout:4/923: creat d8/d30/d7d/d9b/db2/d4b/dd1/d1f/d11a/d10c/f12c x:0 0 0 2023-12-08T20:28:01.419 INFO:tasks.workunit.client.1.smithi111.stdout:4/924: write d8/da/d29/d5c/fa9 [616426,25188] 0 2023-12-08T20:28:01.420 INFO:tasks.workunit.client.1.smithi111.stdout:4/925: dread d8/da/db/d7f/d93/f4c [0,4194304] 0 2023-12-08T20:28:01.421 INFO:tasks.workunit.client.1.smithi111.stdout:4/926: chown d8/f8f 117526334 1 2023-12-08T20:28:01.429 INFO:tasks.workunit.client.1.smithi111.stdout:4/927: dread d8/d30/d7d/d9b/db2/d4b/dd1/d1f/d40/f55 [4194304,4194304] 0 2023-12-08T20:28:01.430 INFO:tasks.workunit.client.1.smithi111.stdout:4/928: write d8/da/d29/f9a [855673,98506] 0 2023-12-08T20:28:01.446 INFO:tasks.workunit.client.1.smithi111.stdout:4/929: dwrite d8/d30/d7d/d9b/db2/d4b/db7/fe9 [0,4194304] 0 2023-12-08T20:28:01.451 INFO:tasks.workunit.client.1.smithi111.stdout:4/930: rename d8/d30/d7d/d9b/db2/d4b/dd1/d1f to d8/d12d 0 2023-12-08T20:28:01.451 INFO:tasks.workunit.client.1.smithi111.stdout:4/931: chown d8/d30/d7d/d9b/db2/d4b/l10a 41294 1 2023-12-08T20:28:01.453 INFO:tasks.workunit.client.1.smithi111.stdout:4/932: symlink d8/da/db/d7f/l12e 0 2023-12-08T20:28:01.454 INFO:tasks.workunit.client.1.smithi111.stdout:4/933: creat d8/da/db/d7f/dd2/f12f x:0 0 0 2023-12-08T20:28:01.456 INFO:tasks.workunit.client.1.smithi111.stdout:4/934: read d8/d30/d7d/d9b/db2/d4b/db7/f109 [4080457,121939] 0 2023-12-08T20:28:01.457 INFO:tasks.workunit.client.1.smithi111.stdout:4/935: chown d8/da/d29/c105 866786 1 2023-12-08T20:28:01.458 INFO:tasks.workunit.client.1.smithi111.stdout:4/936: read d8/f15 [2981296,35366] 0 2023-12-08T20:28:01.458 INFO:tasks.workunit.client.1.smithi111.stdout:4/937: read d8/d30/d7d/d9b/db2/d4b/dd1/f9f [3141741,21512] 0 2023-12-08T20:28:01.458 INFO:tasks.workunit.client.1.smithi111.stdout:4/938: chown d8/dda/f94 118459755 1 2023-12-08T20:28:01.460 INFO:tasks.workunit.client.1.smithi111.stdout:4/939: rmdir d8/da/d10e 39 2023-12-08T20:28:01.461 INFO:tasks.workunit.client.1.smithi111.stdout:4/940: write d8/da/d29/f78 [347157,12245] 0 2023-12-08T20:28:01.461 INFO:tasks.workunit.client.1.smithi111.stdout:4/941: chown d8/d12d/d11a/ce5 1110 1 2023-12-08T20:28:01.463 INFO:tasks.workunit.client.1.smithi111.stdout:4/942: symlink d8/da/d10e/l130 0 2023-12-08T20:28:01.463 INFO:tasks.workunit.client.1.smithi111.stdout:4/943: fdatasync d8/d30/d7d/d9b/fa8 0 2023-12-08T20:28:01.463 INFO:tasks.workunit.client.1.smithi111.stdout:4/944: fdatasync d8/d12d/d40/f42 0 2023-12-08T20:28:01.465 INFO:tasks.workunit.client.1.smithi111.stdout:4/945: rename d8/d12d/d11a/d10c to d8/da/d29/d131 0 2023-12-08T20:28:01.467 INFO:tasks.workunit.client.1.smithi111.stdout:4/946: mkdir d8/da/db/d7f/d93/d77/d132 0 2023-12-08T20:28:01.467 INFO:tasks.workunit.client.1.smithi111.stdout:4/947: dread - d8/da/db/d7f/f128 zero size 2023-12-08T20:28:01.468 INFO:tasks.workunit.client.1.smithi111.stdout:4/948: mknod d8/d30/c133 0 2023-12-08T20:28:01.469 INFO:tasks.workunit.client.1.smithi111.stdout:4/949: readlink d8/da/d29/d5c/dca/le7 0 2023-12-08T20:28:01.469 INFO:tasks.workunit.client.1.smithi111.stdout:4/950: chown d8/da/db/d7f/d8e/cf2 48185 1 2023-12-08T20:28:01.470 INFO:tasks.workunit.client.1.smithi111.stdout:4/951: creat d8/d12d/d40/f134 x:0 0 0 2023-12-08T20:28:01.471 INFO:tasks.workunit.client.1.smithi111.stdout:4/952: write d8/d30/d7d/d9b/db2/d4b/db7/fe9 [5120156,28694] 0 2023-12-08T20:28:01.471 INFO:tasks.workunit.client.1.smithi111.stdout:4/953: chown d8/d30/d7d/d9b/db2/d4b/cce 5 1 2023-12-08T20:28:01.471 INFO:tasks.workunit.client.1.smithi111.stdout:4/954: readlink d8/d12d/l1c 0 2023-12-08T20:28:01.471 INFO:tasks.workunit.client.1.smithi111.stdout:4/955: stat d8/da/d29/d69/fba 0 2023-12-08T20:28:01.472 INFO:tasks.workunit.client.1.smithi111.stdout:4/956: creat d8/d12d/d11a/f135 x:0 0 0 2023-12-08T20:28:01.472 INFO:tasks.workunit.client.1.smithi111.stdout:4/957: chown d8/d30/d7d/d9b/db2/d4b/dd1 33 1 2023-12-08T20:28:01.472 INFO:tasks.workunit.client.0.smithi043.stdout:1/9: write d1/f2 [4501487,32976] 0 2023-12-08T20:28:01.472 INFO:tasks.workunit.client.0.smithi043.stdout:1/10: rename d1 to d1/d3 22 2023-12-08T20:28:01.473 INFO:tasks.workunit.client.1.smithi111.stdout:4/958: write d8/d30/d7d/d9b/db2/fed [2077857,69775] 0 2023-12-08T20:28:01.473 INFO:tasks.workunit.client.1.smithi111.stdout:4/959: chown d8/da/db/d7f/d93/d77/d108 88 1 2023-12-08T20:28:01.474 INFO:tasks.workunit.client.1.smithi111.stdout:4/960: mknod d8/da/c136 0 2023-12-08T20:28:01.476 INFO:tasks.workunit.client.1.smithi111.stdout:4/961: unlink d8/da/db/d7f/d93/d77/c110 0 2023-12-08T20:28:01.478 INFO:tasks.workunit.client.1.smithi111.stdout:4/962: rmdir d8/da/d10e 39 2023-12-08T20:28:01.479 INFO:tasks.workunit.client.1.smithi111.stdout:4/963: mkdir d8/da/db/d137 0 2023-12-08T20:28:01.494 INFO:tasks.workunit.client.0.smithi043.stdout:0/20: write f1 [4711271,92763] 0 2023-12-08T20:28:01.495 INFO:tasks.workunit.client.1.smithi111.stdout:4/964: dwrite d8/da/db/d7f/dd2/f12f [0,4194304] 0 2023-12-08T20:28:01.495 INFO:tasks.workunit.client.1.smithi111.stdout:4/965: truncate d8/dda/fd9 1747332 0 2023-12-08T20:28:01.496 INFO:tasks.workunit.client.0.smithi043.stdout:0/21: mkdir d2/d3/d6 0 2023-12-08T20:28:01.496 INFO:tasks.workunit.client.0.smithi043.stdout:0/22: chown d2/d3/d6 15 1 2023-12-08T20:28:01.500 INFO:tasks.workunit.client.1.smithi111.stdout:4/966: symlink d8/da/d29/d131/l138 0 2023-12-08T20:28:01.508 INFO:tasks.workunit.client.1.smithi111.stdout:1/933: sync 2023-12-08T20:28:01.511 INFO:tasks.workunit.client.1.smithi111.stdout:1/934: rename d0/l35 to d0/d6/d33/d15/d51/d5b/d5e/da0/d10a/l13f 0 2023-12-08T20:28:01.513 INFO:tasks.workunit.client.1.smithi111.stdout:4/967: dwrite d8/da/d29/f122 [0,4194304] 0 2023-12-08T20:28:01.514 INFO:tasks.workunit.client.0.smithi043.stdout:0/23: dread f1 [0,4194304] 0 2023-12-08T20:28:01.514 INFO:tasks.workunit.client.0.smithi043.stdout:0/24: readlink - no filename 2023-12-08T20:28:01.517 INFO:tasks.workunit.client.0.smithi043.stdout:0/25: creat d2/f7 x:0 0 0 2023-12-08T20:28:01.517 INFO:tasks.workunit.client.0.smithi043.stdout:0/26: creat d2/f8 x:0 0 0 2023-12-08T20:28:01.518 INFO:tasks.workunit.client.1.smithi111.stdout:1/935: rmdir d0/d6/d33 39 2023-12-08T20:28:01.518 INFO:tasks.workunit.client.1.smithi111.stdout:1/936: chown d0/d6/d33/d60 148 1 2023-12-08T20:28:01.518 INFO:tasks.workunit.client.1.smithi111.stdout:1/937: fdatasync d0/d6/d33/d15/d51/d2e/d61/d79/f90 0 2023-12-08T20:28:01.519 INFO:tasks.workunit.client.0.smithi043.stdout:0/27: rename f1 to d2/d3/f9 0 2023-12-08T20:28:01.519 INFO:tasks.workunit.client.0.smithi043.stdout:0/28: write d2/d3/f9 [2736458,7090] 0 2023-12-08T20:28:01.520 INFO:tasks.workunit.client.1.smithi111.stdout:2/976: sync 2023-12-08T20:28:01.520 INFO:tasks.workunit.client.1.smithi111.stdout:7/966: sync 2023-12-08T20:28:01.520 INFO:tasks.workunit.client.1.smithi111.stdout:3/821: sync 2023-12-08T20:28:01.520 INFO:tasks.workunit.client.1.smithi111.stdout:6/811: sync 2023-12-08T20:28:01.520 INFO:tasks.workunit.client.1.smithi111.stdout:2/977: write d1/d29/f13a [425485,69883] 0 2023-12-08T20:28:01.520 INFO:tasks.workunit.client.1.smithi111.stdout:2/978: chown d1/d29/d4e 100799 1 2023-12-08T20:28:01.520 INFO:tasks.workunit.client.1.smithi111.stdout:2/979: fsync d1/d1d/d1f/d36/fe3 0 2023-12-08T20:28:01.521 INFO:tasks.workunit.client.1.smithi111.stdout:4/968: creat d8/d30/d7d/d9b/db2/f139 x:0 0 0 2023-12-08T20:28:01.521 INFO:tasks.workunit.client.1.smithi111.stdout:1/938: dread d0/d6/d34/f96 [0,4194304] 0 2023-12-08T20:28:01.521 INFO:tasks.workunit.client.1.smithi111.stdout:4/969: write d8/da/d29/d69/fba [759140,69959] 0 2023-12-08T20:28:01.523 INFO:tasks.workunit.client.1.smithi111.stdout:3/822: mknod d2/d15/dc5/c10a 0 2023-12-08T20:28:01.523 INFO:tasks.workunit.client.1.smithi111.stdout:7/967: symlink da/d5c/d59/d61/l13c 0 2023-12-08T20:28:01.524 INFO:tasks.workunit.client.1.smithi111.stdout:6/812: fsync d0/d1/d27/f40 0 2023-12-08T20:28:01.524 INFO:tasks.workunit.client.1.smithi111.stdout:6/813: readlink d0/l37 0 2023-12-08T20:28:01.524 INFO:tasks.workunit.client.1.smithi111.stdout:6/814: chown d0/d1/d1e/db2/f7d 5393 1 2023-12-08T20:28:01.527 INFO:tasks.workunit.client.1.smithi111.stdout:2/980: rename d1/d1d/d1f/d25/d67/f10e to d1/d1d/d1f/d25/d96/ddf/f159 0 2023-12-08T20:28:01.528 INFO:tasks.workunit.client.1.smithi111.stdout:1/939: mkdir d0/d8e/d140 0 2023-12-08T20:28:01.528 INFO:tasks.workunit.client.1.smithi111.stdout:4/970: dread d8/f8f [0,4194304] 0 2023-12-08T20:28:01.529 INFO:tasks.workunit.client.1.smithi111.stdout:4/971: chown d8/da/d29/f9a 59784366 1 2023-12-08T20:28:01.529 INFO:tasks.workunit.client.1.smithi111.stdout:6/815: mknod d0/da0/c105 0 2023-12-08T20:28:01.531 INFO:tasks.workunit.client.1.smithi111.stdout:3/823: rename d2/d15/cfb to d2/d15/d17/d5e/d9f/c10b 0 2023-12-08T20:28:01.532 INFO:tasks.workunit.client.1.smithi111.stdout:3/824: chown d2/d12/d2e/ccd 53777635 1 2023-12-08T20:28:01.533 INFO:tasks.workunit.client.1.smithi111.stdout:2/981: symlink d1/d29/d53/d91/dce/l15a 0 2023-12-08T20:28:01.533 INFO:tasks.workunit.client.1.smithi111.stdout:7/968: dread da/d13/d9e/f4b [0,4194304] 0 2023-12-08T20:28:01.533 INFO:tasks.workunit.client.1.smithi111.stdout:7/969: fsync da/d64/d12c/d58/f5e 0 2023-12-08T20:28:01.534 INFO:tasks.workunit.client.1.smithi111.stdout:1/940: mknod d0/d6/d33/d8b/db5/d125/c141 0 2023-12-08T20:28:01.537 INFO:tasks.workunit.client.1.smithi111.stdout:4/972: rmdir d8/da/d29/d5c/dca 39 2023-12-08T20:28:01.537 INFO:tasks.workunit.client.1.smithi111.stdout:4/973: readlink d8/d30/d7d/d9b/db2/d4b/dd1/dde/l10d 0 2023-12-08T20:28:01.538 INFO:tasks.workunit.client.1.smithi111.stdout:6/816: rmdir d0/d1/d27/d36/d8d 39 2023-12-08T20:28:01.539 INFO:tasks.workunit.client.1.smithi111.stdout:3/825: readlink d2/d15/d17/lcc 0 2023-12-08T20:28:01.539 INFO:tasks.workunit.client.1.smithi111.stdout:3/826: write d2/d12/d4a/fe9 [1239776,10506] 0 2023-12-08T20:28:01.541 INFO:tasks.workunit.client.1.smithi111.stdout:2/982: unlink d1/d29/d53/d90/c6d 0 2023-12-08T20:28:01.543 INFO:tasks.workunit.client.1.smithi111.stdout:7/970: symlink da/d25/d26/d112/l13d 0 2023-12-08T20:28:01.545 INFO:tasks.workunit.client.1.smithi111.stdout:1/941: creat d0/d6/d33/d15/d51/d5b/d5e/f142 x:0 0 0 2023-12-08T20:28:01.546 INFO:tasks.workunit.client.1.smithi111.stdout:6/817: creat d0/d68/d95/d7a/f106 x:0 0 0 2023-12-08T20:28:01.547 INFO:tasks.workunit.client.1.smithi111.stdout:3/827: rmdir d2/d3/d13/d36/d44 39 2023-12-08T20:28:01.550 INFO:tasks.workunit.client.1.smithi111.stdout:4/974: dwrite d8/d30/d7d/d9b/db2/d4b/fa5 [0,4194304] 0 2023-12-08T20:28:01.550 INFO:tasks.workunit.client.1.smithi111.stdout:2/983: symlink d1/d1d/d1f/d25/d3d/da2/l15b 0 2023-12-08T20:28:01.550 INFO:tasks.workunit.client.1.smithi111.stdout:2/984: dread - d1/d29/f11c zero size 2023-12-08T20:28:01.551 INFO:tasks.workunit.client.1.smithi111.stdout:7/971: unlink da/d13/d10a/f119 0 2023-12-08T20:28:01.551 INFO:tasks.workunit.client.1.smithi111.stdout:7/972: dread - da/d25/dd9/f115 zero size 2023-12-08T20:28:01.551 INFO:tasks.workunit.client.1.smithi111.stdout:7/973: chown da/d5c/d59/d61/l13c 313779855 1 2023-12-08T20:28:01.554 INFO:tasks.workunit.client.1.smithi111.stdout:3/828: mkdir d2/d12/d4a/d5d/df5/d108/d10c 0 2023-12-08T20:28:01.554 INFO:tasks.workunit.client.1.smithi111.stdout:3/829: write d2/f9c [5104053,122483] 0 2023-12-08T20:28:01.558 INFO:tasks.workunit.client.1.smithi111.stdout:2/985: rename d1/d1d/l18 to d1/d1d/d1f/d25/d3d/d56/l15c 0 2023-12-08T20:28:01.560 INFO:tasks.workunit.client.1.smithi111.stdout:7/974: creat da/d64/dd6/d122/f13e x:0 0 0 2023-12-08T20:28:01.563 INFO:tasks.workunit.client.1.smithi111.stdout:4/975: dread d8/d12d/fe [0,4194304] 0 2023-12-08T20:28:01.564 INFO:tasks.workunit.client.1.smithi111.stdout:3/830: getdents d2/d15/d17/d5e/d9f/dbe 0 2023-12-08T20:28:01.564 INFO:tasks.workunit.client.1.smithi111.stdout:3/831: chown d2/d3/d13/d36/d69/f6b 912 1 2023-12-08T20:28:01.564 INFO:tasks.workunit.client.1.smithi111.stdout:3/832: chown d2/d15/d17/d25/l45 26 1 2023-12-08T20:28:01.569 INFO:tasks.workunit.client.1.smithi111.stdout:3/833: truncate d2/d3/d51/d88/fa3 967360 0 2023-12-08T20:28:01.576 INFO:tasks.workunit.client.1.smithi111.stdout:3/834: dread d2/d3/fd5 [0,4194304] 0 2023-12-08T20:28:01.576 INFO:tasks.workunit.client.1.smithi111.stdout:3/835: write d2/d3/d13/d36/d69/d70/fdf [508483,730] 0 2023-12-08T20:28:01.577 INFO:tasks.workunit.client.1.smithi111.stdout:1/942: dwrite d0/d6/d33/d15/d51/d2e/d61/f109 [0,4194304] 0 2023-12-08T20:28:01.577 INFO:tasks.workunit.client.1.smithi111.stdout:1/943: read d0/d6/d33/d8b/de9/fff [1579897,48254] 0 2023-12-08T20:28:01.577 INFO:tasks.workunit.client.1.smithi111.stdout:1/944: fsync d0/d6/d33/d15/d51/d78/f95 0 2023-12-08T20:28:01.579 INFO:tasks.workunit.client.1.smithi111.stdout:3/836: stat d2/d15/d17/d5e/l6e 0 2023-12-08T20:28:01.579 INFO:tasks.workunit.client.1.smithi111.stdout:3/837: readlink d2/d15/d17/d5e/l6e 0 2023-12-08T20:28:01.588 INFO:tasks.workunit.client.1.smithi111.stdout:6/818: dwrite d0/d1/d27/da1/fcb [0,4194304] 0 2023-12-08T20:28:01.589 INFO:tasks.workunit.client.1.smithi111.stdout:6/819: read - d0/d1/d27/d36/d97/fe3 zero size 2023-12-08T20:28:01.589 INFO:tasks.workunit.client.1.smithi111.stdout:7/975: dwrite da/d5c/d59/fbc [0,4194304] 0 2023-12-08T20:28:01.592 INFO:tasks.workunit.client.1.smithi111.stdout:7/976: symlink da/d64/d12c/d58/l13f 0 2023-12-08T20:28:01.594 INFO:tasks.workunit.client.1.smithi111.stdout:3/838: rename d2/d3/d51/d88 to d2/d3/d13/d36/d44/d10d 0 2023-12-08T20:28:01.596 INFO:tasks.workunit.client.1.smithi111.stdout:1/945: dwrite d0/d6/d33/d15/d51/d5b/d59/db8/dd9/f110 [0,4194304] 0 2023-12-08T20:28:01.596 INFO:tasks.workunit.client.1.smithi111.stdout:1/946: chown d0/lb4 1185452 1 2023-12-08T20:28:01.597 INFO:tasks.workunit.client.1.smithi111.stdout:1/947: write d0/d6/d33/d15/d51/f21 [814817,70573] 0 2023-12-08T20:28:01.602 INFO:tasks.workunit.client.0.smithi043.stdout:3/12: getdents d1 0 2023-12-08T20:28:01.604 INFO:tasks.workunit.client.0.smithi043.stdout:3/13: mknod d1/c4 0 2023-12-08T20:28:01.604 INFO:tasks.workunit.client.0.smithi043.stdout:3/14: truncate - no filename 2023-12-08T20:28:01.605 INFO:tasks.workunit.client.1.smithi111.stdout:4/976: dwrite d8/f15 [0,4194304] 0 2023-12-08T20:28:01.605 INFO:tasks.workunit.client.0.smithi043.stdout:9/17: getdents d0 0 2023-12-08T20:28:01.606 INFO:tasks.workunit.client.0.smithi043.stdout:3/15: mknod d1/c5 0 2023-12-08T20:28:01.606 INFO:tasks.workunit.client.1.smithi111.stdout:4/977: creat d8/da/db/d7f/f13a x:0 0 0 2023-12-08T20:28:01.607 INFO:tasks.workunit.client.1.smithi111.stdout:7/977: dread da/d25/d26/d32/f56 [0,4194304] 0 2023-12-08T20:28:01.607 INFO:tasks.workunit.client.1.smithi111.stdout:1/948: dread d0/d6/d33/d60/f85 [0,4194304] 0 2023-12-08T20:28:01.607 INFO:tasks.workunit.client.1.smithi111.stdout:1/949: truncate d0/d6/d33/d15/d51/d78/f80 1356613 0 2023-12-08T20:28:01.607 INFO:tasks.workunit.client.1.smithi111.stdout:4/978: creat d8/da/db/d7f/d8e/dea/f13b x:0 0 0 2023-12-08T20:28:01.607 INFO:tasks.workunit.client.1.smithi111.stdout:4/979: fdatasync d8/da/db/d7f/f5a 0 2023-12-08T20:28:01.608 INFO:tasks.workunit.client.0.smithi043.stdout:9/18: unlink d0/l1 0 2023-12-08T20:28:01.609 INFO:tasks.workunit.client.0.smithi043.stdout:2/17: dread d0/f1 [0,4194304] 0 2023-12-08T20:28:01.609 INFO:tasks.workunit.client.0.smithi043.stdout:3/16: symlink d1/l6 0 2023-12-08T20:28:01.612 INFO:tasks.workunit.client.0.smithi043.stdout:3/17: unlink l0 0 2023-12-08T20:28:01.614 INFO:tasks.workunit.client.1.smithi111.stdout:1/950: rename d0/d6/l42 to d0/d6/d33/d15/d51/d2e/d61/d79/dac/d13e/l143 0 2023-12-08T20:28:01.614 INFO:tasks.workunit.client.1.smithi111.stdout:4/980: rename d8/d12d/f1a to d8/d12d/f13c 0 2023-12-08T20:28:01.614 INFO:tasks.workunit.client.1.smithi111.stdout:7/978: unlink da/d5c/d59/df2/ff1 0 2023-12-08T20:28:01.615 INFO:tasks.workunit.client.1.smithi111.stdout:7/979: chown da/d13 15102819 1 2023-12-08T20:28:01.615 INFO:tasks.workunit.client.1.smithi111.stdout:7/980: stat da/d25/da9/db8/d89/de9 0 2023-12-08T20:28:01.615 INFO:tasks.workunit.client.1.smithi111.stdout:6/820: dwrite d0/d1/d27/f40 [0,4194304] 0 2023-12-08T20:28:01.615 INFO:tasks.workunit.client.1.smithi111.stdout:6/821: getdents d0/d1/d1e/db2/da5/dfc 0 2023-12-08T20:28:01.615 INFO:tasks.workunit.client.1.smithi111.stdout:6/822: readlink d0/le2 0 2023-12-08T20:28:01.616 INFO:tasks.workunit.client.1.smithi111.stdout:1/951: write d0/d22/f9b [81790,78113] 0 2023-12-08T20:28:01.616 INFO:tasks.workunit.client.1.smithi111.stdout:1/952: dread - d0/d6/d33/d6c/d127/f129 zero size 2023-12-08T20:28:01.617 INFO:tasks.workunit.client.1.smithi111.stdout:4/981: rename d8/d30/d97 to d8/d30/d13d 0 2023-12-08T20:28:01.617 INFO:tasks.workunit.client.0.smithi043.stdout:3/18: unlink d1/c3 0 2023-12-08T20:28:01.617 INFO:tasks.workunit.client.0.smithi043.stdout:3/19: dread - no filename 2023-12-08T20:28:01.617 INFO:tasks.workunit.client.0.smithi043.stdout:3/20: write - no filename 2023-12-08T20:28:01.617 INFO:tasks.workunit.client.0.smithi043.stdout:3/21: fsync - no filename 2023-12-08T20:28:01.619 INFO:tasks.workunit.client.0.smithi043.stdout:8/16: truncate d2/f3 1830931 0 2023-12-08T20:28:01.619 INFO:tasks.workunit.client.1.smithi111.stdout:6/823: symlink d0/d1/d27/da1/dca/l107 0 2023-12-08T20:28:01.620 INFO:tasks.workunit.client.0.smithi043.stdout:3/22: mknod d1/c7 0 2023-12-08T20:28:01.620 INFO:tasks.workunit.client.0.smithi043.stdout:3/23: chown d1/c5 229221 1 2023-12-08T20:28:01.620 INFO:tasks.workunit.client.0.smithi043.stdout:3/24: chown d1/c4 1902379 1 2023-12-08T20:28:01.620 INFO:tasks.workunit.client.0.smithi043.stdout:3/25: fdatasync - no filename 2023-12-08T20:28:01.620 INFO:tasks.workunit.client.0.smithi043.stdout:3/26: truncate - no filename 2023-12-08T20:28:01.620 INFO:tasks.workunit.client.0.smithi043.stdout:3/27: dread - no filename 2023-12-08T20:28:01.626 INFO:tasks.workunit.client.1.smithi111.stdout:1/953: truncate d0/d6/d33/d6c/da1/fd2 28021 0 2023-12-08T20:28:01.626 INFO:tasks.workunit.client.1.smithi111.stdout:6/824: creat d0/d1/d27/da1/dca/df6/f108 x:0 0 0 2023-12-08T20:28:01.629 INFO:tasks.workunit.client.0.smithi043.stdout:3/28: mknod d1/c8 0 2023-12-08T20:28:01.631 INFO:tasks.workunit.client.0.smithi043.stdout:3/29: mkdir d1/d9 0 2023-12-08T20:28:01.633 INFO:tasks.workunit.client.0.smithi043.stdout:3/30: mkdir d1/da 0 2023-12-08T20:28:01.635 INFO:tasks.workunit.client.0.smithi043.stdout:3/31: rename d1/c8 to d1/cb 0 2023-12-08T20:28:01.635 INFO:tasks.workunit.client.0.smithi043.stdout:3/32: write - no filename 2023-12-08T20:28:01.635 INFO:tasks.workunit.client.0.smithi043.stdout:3/33: dread - no filename 2023-12-08T20:28:01.643 INFO:tasks.workunit.client.1.smithi111.stdout:7/981: dwrite da/d64/d12c/dc9/f135 [0,4194304] 0 2023-12-08T20:28:01.644 INFO:tasks.workunit.client.1.smithi111.stdout:7/982: chown da/d5c 10056447 1 2023-12-08T20:28:01.646 INFO:tasks.workunit.client.1.smithi111.stdout:7/983: creat da/d64/dd6/f140 x:0 0 0 2023-12-08T20:28:01.647 INFO:tasks.workunit.client.1.smithi111.stdout:7/984: rename da/c18 to da/d64/dd6/d122/c141 0 2023-12-08T20:28:01.648 INFO:tasks.workunit.client.1.smithi111.stdout:4/982: dwrite d8/d30/d7d/d9b/db2/d4b/dd1/f9f [4194304,4194304] 0 2023-12-08T20:28:01.648 INFO:tasks.workunit.client.1.smithi111.stdout:4/983: fdatasync d8/d12d/f83 0 2023-12-08T20:28:01.648 INFO:tasks.workunit.client.1.smithi111.stdout:7/985: truncate da/d5c/d59/df2/ffc 2021245 0 2023-12-08T20:28:01.649 INFO:tasks.workunit.client.1.smithi111.stdout:6/825: dwrite d0/d1/d27/f2d [0,4194304] 0 2023-12-08T20:28:01.649 INFO:tasks.workunit.client.1.smithi111.stdout:6/826: fsync d0/d68/da9/fd3 0 2023-12-08T20:28:01.650 INFO:tasks.workunit.client.0.smithi043.stdout:9/19: dwrite d0/f3 [0,4194304] 0 2023-12-08T20:28:01.651 INFO:tasks.workunit.client.1.smithi111.stdout:7/986: link da/d13/f49 da/d64/d12c/f142 0 2023-12-08T20:28:01.651 INFO:tasks.workunit.client.1.smithi111.stdout:7/987: read - da/d5c/d59/d61/fde zero size 2023-12-08T20:28:01.656 INFO:tasks.workunit.client.0.smithi043.stdout:1/11: truncate d1/f2 2567065 0 2023-12-08T20:28:01.656 INFO:tasks.workunit.client.0.smithi043.stdout:9/20: symlink d0/l5 0 2023-12-08T20:28:01.657 INFO:tasks.workunit.client.0.smithi043.stdout:9/21: chown d0/f3 23867 1 2023-12-08T20:28:01.658 INFO:tasks.workunit.client.0.smithi043.stdout:0/29: rename d2/d3/f9 to d2/d3/fa 0 2023-12-08T20:28:01.661 INFO:tasks.workunit.client.0.smithi043.stdout:1/12: symlink d1/l4 0 2023-12-08T20:28:01.662 INFO:tasks.workunit.client.0.smithi043.stdout:0/30: creat d2/d3/fb x:0 0 0 2023-12-08T20:28:01.665 INFO:tasks.workunit.client.0.smithi043.stdout:9/22: dread d0/f3 [0,4194304] 0 2023-12-08T20:28:01.667 INFO:tasks.workunit.client.0.smithi043.stdout:9/23: creat d0/f6 x:0 0 0 2023-12-08T20:28:01.667 INFO:tasks.workunit.client.1.smithi111.stdout:4/984: dread d8/dda/f94 [0,4194304] 0 2023-12-08T20:28:01.668 INFO:tasks.workunit.client.0.smithi043.stdout:9/24: creat d0/f7 x:0 0 0 2023-12-08T20:28:01.669 INFO:tasks.workunit.client.0.smithi043.stdout:9/25: creat d0/f8 x:0 0 0 2023-12-08T20:28:01.670 INFO:tasks.workunit.client.0.smithi043.stdout:9/26: write d0/f3 [2956577,105471] 0 2023-12-08T20:28:01.670 INFO:tasks.workunit.client.0.smithi043.stdout:9/27: dread - d0/f6 zero size 2023-12-08T20:28:01.670 INFO:tasks.workunit.client.0.smithi043.stdout:9/28: readlink d0/l5 0 2023-12-08T20:28:01.670 INFO:tasks.workunit.client.0.smithi043.stdout:9/29: dread - d0/f7 zero size 2023-12-08T20:28:01.671 INFO:tasks.workunit.client.1.smithi111.stdout:7/988: dwrite da/d13/f7f [4194304,4194304] 0 2023-12-08T20:28:01.672 INFO:tasks.workunit.client.0.smithi043.stdout:9/30: creat d0/f9 x:0 0 0 2023-12-08T20:28:01.673 INFO:tasks.workunit.client.0.smithi043.stdout:9/31: truncate d0/f9 517266 0 2023-12-08T20:28:01.673 INFO:tasks.workunit.client.0.smithi043.stdout:0/31: truncate d2/d3/fa 227780 0 2023-12-08T20:28:01.673 INFO:tasks.workunit.client.1.smithi111.stdout:7/989: symlink da/d5c/d6e/d10b/d10d/l143 0 2023-12-08T20:28:01.673 INFO:tasks.workunit.client.1.smithi111.stdout:7/990: truncate da/d25/d26/d112/f103 592735 0 2023-12-08T20:28:01.673 INFO:tasks.workunit.client.1.smithi111.stdout:7/991: dread - da/d5c/d6e/d10b/f11e zero size 2023-12-08T20:28:01.673 INFO:tasks.workunit.client.1.smithi111.stdout:7/992: dread - da/d64/dd6/d122/f13e zero size 2023-12-08T20:28:01.673 INFO:tasks.workunit.client.1.smithi111.stdout:7/993: fdatasync da/d64/d12c/dc9/f135 0 2023-12-08T20:28:01.675 INFO:tasks.workunit.client.1.smithi111.stdout:7/994: symlink da/d38/l144 0 2023-12-08T20:28:01.675 INFO:tasks.workunit.client.0.smithi043.stdout:9/32: mknod d0/ca 0 2023-12-08T20:28:01.676 INFO:tasks.workunit.client.1.smithi111.stdout:7/995: mknod da/d5c/d6e/d10b/c145 0 2023-12-08T20:28:01.677 INFO:tasks.workunit.client.0.smithi043.stdout:9/33: creat d0/fb x:0 0 0 2023-12-08T20:28:01.677 INFO:tasks.workunit.client.0.smithi043.stdout:9/34: write d0/f9 [685495,109891] 0 2023-12-08T20:28:01.677 INFO:tasks.workunit.client.1.smithi111.stdout:6/827: dwrite d0/d1/d27/f40 [0,4194304] 0 2023-12-08T20:28:01.677 INFO:tasks.workunit.client.1.smithi111.stdout:7/996: mkdir da/d25/d26/d146 0 2023-12-08T20:28:01.686 INFO:tasks.workunit.client.0.smithi043.stdout:3/34: rename d1/cb to d1/cc 0 2023-12-08T20:28:01.686 INFO:tasks.workunit.client.0.smithi043.stdout:3/35: truncate - no filename 2023-12-08T20:28:01.686 INFO:tasks.workunit.client.0.smithi043.stdout:3/36: truncate - no filename 2023-12-08T20:28:01.686 INFO:tasks.workunit.client.0.smithi043.stdout:3/37: truncate - no filename 2023-12-08T20:28:01.689 INFO:tasks.workunit.client.0.smithi043.stdout:3/38: stat d1/d9 0 2023-12-08T20:28:01.689 INFO:tasks.workunit.client.0.smithi043.stdout:3/39: write - no filename 2023-12-08T20:28:01.689 INFO:tasks.workunit.client.0.smithi043.stdout:3/40: dread - no filename 2023-12-08T20:28:01.689 INFO:tasks.workunit.client.1.smithi111.stdout:6/828: dread d0/d68/d95/f35 [0,4194304] 0 2023-12-08T20:28:01.690 INFO:tasks.workunit.client.0.smithi043.stdout:3/41: creat d1/d9/fd x:0 0 0 2023-12-08T20:28:01.690 INFO:tasks.workunit.client.0.smithi043.stdout:3/42: dread - d1/d9/fd zero size 2023-12-08T20:28:01.693 INFO:tasks.workunit.client.0.smithi043.stdout:3/43: creat d1/d9/fe x:0 0 0 2023-12-08T20:28:01.693 INFO:tasks.workunit.client.0.smithi043.stdout:3/44: write d1/d9/fe [700690,7257] 0 2023-12-08T20:28:01.694 INFO:tasks.workunit.client.1.smithi111.stdout:6/829: link d0/d1/d27/d56/f76 d0/d1/d1e/db2/dd7/f109 0 2023-12-08T20:28:01.695 INFO:tasks.workunit.client.1.smithi111.stdout:6/830: truncate d0/d68/da9/fec 2233158 0 2023-12-08T20:28:01.696 INFO:tasks.workunit.client.1.smithi111.stdout:6/831: creat d0/d68/da9/f10a x:0 0 0 2023-12-08T20:28:01.698 INFO:tasks.workunit.client.1.smithi111.stdout:6/832: mkdir d0/d1/d27/da1/dca/df6/d10b 0 2023-12-08T20:28:01.701 INFO:tasks.workunit.client.1.smithi111.stdout:6/833: creat d0/d1/d1e/db2/da5/dfc/f10c x:0 0 0 2023-12-08T20:28:01.701 INFO:tasks.workunit.client.1.smithi111.stdout:6/834: stat d0/d1/d1e/f92 0 2023-12-08T20:28:01.701 INFO:tasks.workunit.client.1.smithi111.stdout:6/835: fdatasync d0/d1/d27/da1/fb7 0 2023-12-08T20:28:01.702 INFO:tasks.workunit.client.1.smithi111.stdout:6/836: dread - d0/ff4 zero size 2023-12-08T20:28:01.710 INFO:tasks.workunit.client.0.smithi043.stdout:8/17: dwrite d2/f3 [0,4194304] 0 2023-12-08T20:28:01.710 INFO:tasks.workunit.client.0.smithi043.stdout:8/18: readlink - no filename 2023-12-08T20:28:01.711 INFO:tasks.workunit.client.1.smithi111.stdout:7/997: dwrite da/f46 [0,4194304] 0 2023-12-08T20:28:01.711 INFO:tasks.workunit.client.1.smithi111.stdout:7/998: write da/d64/d12c/dc9/f123 [226916,30221] 0 2023-12-08T20:28:01.712 INFO:tasks.workunit.client.1.smithi111.stdout:7/999: getdents da/d64/d10e 0 2023-12-08T20:28:01.712 INFO:tasks.workunit.client.0.smithi043.stdout:1/13: read d1/f2 [571406,93794] 0 2023-12-08T20:28:01.712 INFO:tasks.workunit.client.0.smithi043.stdout:9/35: dwrite d0/f7 [0,4194304] 0 2023-12-08T20:28:01.712 INFO:tasks.workunit.client.0.smithi043.stdout:9/36: write d0/f9 [1678588,52591] 0 2023-12-08T20:28:01.712 INFO:tasks.workunit.client.0.smithi043.stdout:9/37: readlink d0/l5 0 2023-12-08T20:28:01.717 INFO:tasks.workunit.client.1.smithi111.stdout:6/837: truncate d0/d68/d95/f35 347937 0 2023-12-08T20:28:01.718 INFO:tasks.workunit.client.0.smithi043.stdout:8/19: write d2/f3 [1272410,104184] 0 2023-12-08T20:28:01.720 INFO:tasks.workunit.client.0.smithi043.stdout:8/20: write d2/f3 [501201,110325] 0 2023-12-08T20:28:01.722 INFO:tasks.workunit.client.0.smithi043.stdout:9/38: mknod d0/cc 0 2023-12-08T20:28:01.722 INFO:tasks.workunit.client.1.smithi111.stdout:6/838: symlink d0/d1/d1e/db2/l10d 0 2023-12-08T20:28:01.727 INFO:tasks.workunit.client.0.smithi043.stdout:9/39: mknod d0/cd 0 2023-12-08T20:28:01.728 INFO:tasks.workunit.client.0.smithi043.stdout:9/40: chown d0/c4 122849 1 2023-12-08T20:28:01.728 INFO:tasks.workunit.client.1.smithi111.stdout:6/839: symlink d0/d1/d27/d6e/df1/l10e 0 2023-12-08T20:28:01.729 INFO:tasks.workunit.client.0.smithi043.stdout:9/41: unlink d0/f9 0 2023-12-08T20:28:01.731 INFO:tasks.workunit.client.0.smithi043.stdout:9/42: rename d0/f8 to d0/fe 0 2023-12-08T20:28:01.731 INFO:tasks.workunit.client.0.smithi043.stdout:9/43: truncate d0/fb 1043732 0 2023-12-08T20:28:01.731 INFO:tasks.workunit.client.0.smithi043.stdout:9/44: read d0/fb [37429,82514] 0 2023-12-08T20:28:01.733 INFO:tasks.workunit.client.0.smithi043.stdout:9/45: mkdir d0/df 0 2023-12-08T20:28:01.734 INFO:tasks.workunit.client.0.smithi043.stdout:9/46: chown d0/f7 5 1 2023-12-08T20:28:01.735 INFO:tasks.workunit.client.0.smithi043.stdout:0/32: dwrite d2/d3/fa [0,4194304] 0 2023-12-08T20:28:01.736 INFO:tasks.workunit.client.0.smithi043.stdout:1/14: dwrite d1/f2 [0,4194304] 0 2023-12-08T20:28:01.736 INFO:tasks.workunit.client.0.smithi043.stdout:1/15: readlink d1/l4 0 2023-12-08T20:28:01.736 INFO:tasks.workunit.client.0.smithi043.stdout:1/16: read d1/f2 [2652866,3381] 0 2023-12-08T20:28:01.736 INFO:tasks.workunit.client.0.smithi043.stdout:1/17: chown d1/l4 0 1 2023-12-08T20:28:01.737 INFO:tasks.workunit.client.0.smithi043.stdout:9/47: rmdir d0/df 0 2023-12-08T20:28:01.739 INFO:tasks.workunit.client.0.smithi043.stdout:0/33: creat d2/d4/fc x:0 0 0 2023-12-08T20:28:01.750 INFO:tasks.workunit.client.1.smithi111.stdout:6/840: dwrite d0/f13 [0,4194304] 0 2023-12-08T20:28:01.751 INFO:tasks.workunit.client.1.smithi111.stdout:6/841: write d0/d68/d95/f47 [800983,120097] 0 2023-12-08T20:28:01.751 INFO:tasks.workunit.client.1.smithi111.stdout:6/842: rename d0/d1/d1e/lb3 to d0/d1/d1e/l10f 0 2023-12-08T20:28:01.753 INFO:tasks.workunit.client.0.smithi043.stdout:8/21: dread d2/f3 [0,4194304] 0 2023-12-08T20:28:01.753 INFO:tasks.workunit.client.1.smithi111.stdout:6/843: symlink d0/d1/l110 0 2023-12-08T20:28:01.754 INFO:tasks.workunit.client.1.smithi111.stdout:6/844: unlink d0/d1/c15 0 2023-12-08T20:28:01.755 INFO:tasks.workunit.client.1.smithi111.stdout:6/845: creat d0/d1/d1e/db2/da5/dfc/f111 x:0 0 0 2023-12-08T20:28:01.755 INFO:tasks.workunit.client.1.smithi111.stdout:6/846: chown d0/d1/f96 5437 1 2023-12-08T20:28:01.756 INFO:tasks.workunit.client.1.smithi111.stdout:6/847: symlink d0/d68/d95/l112 0 2023-12-08T20:28:01.757 INFO:tasks.workunit.client.1.smithi111.stdout:6/848: mkdir d0/d68/d95/d7a/d113 0 2023-12-08T20:28:01.759 INFO:tasks.workunit.client.1.smithi111.stdout:6/849: rename d0/d1/d27/l51 to d0/d1/d1e/db2/da5/l114 0 2023-12-08T20:28:01.759 INFO:tasks.workunit.client.1.smithi111.stdout:6/850: fsync d0/d1/d1e/db2/fc8 0 2023-12-08T20:28:01.760 INFO:tasks.workunit.client.0.smithi043.stdout:9/48: dwrite d0/f6 [0,4194304] 0 2023-12-08T20:28:01.760 INFO:tasks.workunit.client.0.smithi043.stdout:9/49: readlink d0/l5 0 2023-12-08T20:28:01.760 INFO:tasks.workunit.client.0.smithi043.stdout:1/18: dwrite d1/f2 [0,4194304] 0 2023-12-08T20:28:01.769 INFO:tasks.workunit.client.0.smithi043.stdout:8/22: creat d2/f5 x:0 0 0 2023-12-08T20:28:01.771 INFO:tasks.workunit.client.0.smithi043.stdout:9/50: creat d0/f10 x:0 0 0 2023-12-08T20:28:01.771 INFO:tasks.workunit.client.0.smithi043.stdout:1/19: symlink d1/l5 0 2023-12-08T20:28:01.774 INFO:tasks.workunit.client.0.smithi043.stdout:1/20: mkdir d1/d6 0 2023-12-08T20:28:01.775 INFO:tasks.workunit.client.0.smithi043.stdout:9/51: rmdir d0 39 2023-12-08T20:28:01.775 INFO:tasks.workunit.client.0.smithi043.stdout:1/21: write d1/f2 [3182830,85595] 0 2023-12-08T20:28:01.775 INFO:tasks.workunit.client.0.smithi043.stdout:1/22: chown d1/l5 0 1 2023-12-08T20:28:01.777 INFO:tasks.workunit.client.0.smithi043.stdout:9/52: unlink d0/f3 0 2023-12-08T20:28:01.778 INFO:tasks.workunit.client.1.smithi111.stdout:6/851: truncate d0/d1/d27/d36/d97/db4/fd5 340028 0 2023-12-08T20:28:01.788 INFO:tasks.workunit.client.0.smithi043.stdout:8/23: dwrite d2/f5 [0,4194304] 0 2023-12-08T20:28:01.789 INFO:tasks.workunit.client.0.smithi043.stdout:9/53: getdents d0 0 2023-12-08T20:28:01.789 INFO:tasks.workunit.client.0.smithi043.stdout:9/54: readlink d0/l5 0 2023-12-08T20:28:01.789 INFO:tasks.workunit.client.0.smithi043.stdout:1/23: truncate d1/f2 57875 0 2023-12-08T20:28:01.791 INFO:tasks.workunit.client.0.smithi043.stdout:9/55: rename d0/l5 to d0/l11 0 2023-12-08T20:28:01.791 INFO:tasks.workunit.client.0.smithi043.stdout:9/56: chown d0/f10 90167982 1 2023-12-08T20:28:01.791 INFO:tasks.workunit.client.0.smithi043.stdout:9/57: stat d0 0 2023-12-08T20:28:01.791 INFO:tasks.workunit.client.0.smithi043.stdout:1/24: write d1/f2 [804195,8030] 0 2023-12-08T20:28:01.792 INFO:tasks.workunit.client.0.smithi043.stdout:9/58: symlink d0/l12 0 2023-12-08T20:28:01.792 INFO:tasks.workunit.client.0.smithi043.stdout:1/25: symlink d1/d6/l7 0 2023-12-08T20:28:01.793 INFO:tasks.workunit.client.0.smithi043.stdout:9/59: creat d0/f13 x:0 0 0 2023-12-08T20:28:01.793 INFO:tasks.workunit.client.0.smithi043.stdout:9/60: dread - d0/fe zero size 2023-12-08T20:28:01.795 INFO:tasks.workunit.client.0.smithi043.stdout:9/61: write d0/fb [126864,21643] 0 2023-12-08T20:28:01.796 INFO:tasks.workunit.client.0.smithi043.stdout:9/62: creat d0/f14 x:0 0 0 2023-12-08T20:28:01.801 INFO:tasks.workunit.client.0.smithi043.stdout:8/24: dwrite d2/f3 [4194304,4194304] 0 2023-12-08T20:28:01.804 INFO:tasks.workunit.client.0.smithi043.stdout:8/25: rename c0 to d2/c6 0 2023-12-08T20:28:01.806 INFO:tasks.workunit.client.0.smithi043.stdout:8/26: creat d2/f7 x:0 0 0 2023-12-08T20:28:01.806 INFO:tasks.workunit.client.0.smithi043.stdout:8/27: fdatasync d2/f3 0 2023-12-08T20:28:01.807 INFO:tasks.workunit.client.0.smithi043.stdout:8/28: symlink d2/d4/l8 0 2023-12-08T20:28:01.809 INFO:tasks.workunit.client.0.smithi043.stdout:8/29: rename d2/f5 to d2/f9 0 2023-12-08T20:28:01.811 INFO:tasks.workunit.client.1.smithi111.stdout:6/852: creat d0/d68/d95/de4/f115 x:0 0 0 2023-12-08T20:28:01.811 INFO:tasks.workunit.client.1.smithi111.stdout:6/853: fdatasync d0/d1/d27/d36/d97/fe3 0 2023-12-08T20:28:01.811 INFO:tasks.workunit.client.0.smithi043.stdout:9/63: dwrite d0/f6 [0,4194304] 0 2023-12-08T20:28:01.815 INFO:tasks.workunit.client.1.smithi111.stdout:6/854: creat d0/d1/d27/d56/f116 x:0 0 0 2023-12-08T20:28:01.827 INFO:tasks.workunit.client.1.smithi111.stdout:6/855: dread d0/daa/fea [0,4194304] 0 2023-12-08T20:28:01.829 INFO:tasks.workunit.client.0.smithi043.stdout:8/30: dwrite d2/f3 [4194304,4194304] 0 2023-12-08T20:28:01.830 INFO:tasks.workunit.client.0.smithi043.stdout:9/64: dwrite d0/f10 [0,4194304] 0 2023-12-08T20:28:01.833 INFO:tasks.workunit.client.0.smithi043.stdout:9/65: creat d0/f15 x:0 0 0 2023-12-08T20:28:01.833 INFO:tasks.workunit.client.1.smithi111.stdout:6/856: mknod d0/d1/d27/d36/c117 0 2023-12-08T20:28:01.833 INFO:tasks.workunit.client.1.smithi111.stdout:6/857: write d0/d1/d1e/db2/f2a [9084285,74200] 0 2023-12-08T20:28:01.841 INFO:tasks.workunit.client.1.smithi111.stdout:6/858: dread d0/d1/d1e/db2/dd7/f109 [0,4194304] 0 2023-12-08T20:28:01.857 INFO:tasks.workunit.client.1.smithi111.stdout:6/859: dwrite d0/d1/d1e/db2/da5/fda [0,4194304] 0 2023-12-08T20:28:01.879 INFO:tasks.workunit.client.0.smithi043.stdout:8/31: rename d2/f7 to d2/fa 0 2023-12-08T20:28:01.879 INFO:tasks.workunit.client.0.smithi043.stdout:8/32: write d2/fa [859291,36924] 0 2023-12-08T20:28:01.881 INFO:tasks.workunit.client.0.smithi043.stdout:9/66: creat d0/f16 x:0 0 0 2023-12-08T20:28:01.881 INFO:tasks.workunit.client.0.smithi043.stdout:9/67: write d0/f13 [1039287,81238] 0 2023-12-08T20:28:01.881 INFO:tasks.workunit.client.0.smithi043.stdout:9/68: truncate d0/f13 1409835 0 2023-12-08T20:28:01.893 INFO:tasks.workunit.client.1.smithi111.stdout:3/839: sync 2023-12-08T20:28:01.893 INFO:tasks.workunit.client.1.smithi111.stdout:3/840: chown d2/d15/d17/d5e/c8e 80 1 2023-12-08T20:28:01.893 INFO:tasks.workunit.client.1.smithi111.stdout:4/985: sync 2023-12-08T20:28:01.893 INFO:tasks.workunit.client.1.smithi111.stdout:2/986: sync 2023-12-08T20:28:01.893 INFO:tasks.workunit.client.1.smithi111.stdout:1/954: sync 2023-12-08T20:28:01.893 INFO:tasks.workunit.client.1.smithi111.stdout:1/955: write d0/d4d/fb1 [1748245,31177] 0 2023-12-08T20:28:01.893 INFO:tasks.workunit.client.1.smithi111.stdout:1/956: chown d0/d8e/db0/d10d/d111/c87 13 1 2023-12-08T20:28:01.894 INFO:tasks.workunit.client.1.smithi111.stdout:3/841: creat d2/d15/d17/d5e/f10e x:0 0 0 2023-12-08T20:28:01.894 INFO:tasks.workunit.client.1.smithi111.stdout:3/842: chown d2/d3/l20 222992 1 2023-12-08T20:28:01.894 INFO:tasks.workunit.client.1.smithi111.stdout:3/843: fsync d2/d3/d13/d36/d44/d10d/fa5 0 2023-12-08T20:28:01.894 INFO:tasks.workunit.client.1.smithi111.stdout:2/987: symlink d1/dec/l15d 0 2023-12-08T20:28:01.896 INFO:tasks.workunit.client.1.smithi111.stdout:3/844: symlink d2/d15/d17/d25/de0/l10f 0 2023-12-08T20:28:01.896 INFO:tasks.workunit.client.1.smithi111.stdout:3/845: fdatasync d2/d3/f16 0 2023-12-08T20:28:01.897 INFO:tasks.workunit.client.1.smithi111.stdout:2/988: symlink d1/d29/d4e/ddc/d108/l15e 0 2023-12-08T20:28:01.897 INFO:tasks.workunit.client.1.smithi111.stdout:2/989: readlink d1/d1d/d1f/d25/d67/l77 0 2023-12-08T20:28:01.897 INFO:tasks.workunit.client.1.smithi111.stdout:3/846: dread d2/d12/f8c [0,4194304] 0 2023-12-08T20:28:01.898 INFO:tasks.workunit.client.1.smithi111.stdout:4/986: rmdir d8/da/db/d7f/d93/d77/d108 0 2023-12-08T20:28:01.899 INFO:tasks.workunit.client.1.smithi111.stdout:1/957: dread d0/d8e/fc2 [0,4194304] 0 2023-12-08T20:28:01.900 INFO:tasks.workunit.client.1.smithi111.stdout:3/847: symlink d2/d12/d4a/l110 0 2023-12-08T20:28:01.900 INFO:tasks.workunit.client.1.smithi111.stdout:2/990: mkdir d1/d29/dfe/def/d15f 0 2023-12-08T20:28:01.900 INFO:tasks.workunit.client.1.smithi111.stdout:2/991: chown d1/d1d/d1f/dc1/l123 1163583343 1 2023-12-08T20:28:01.901 INFO:tasks.workunit.client.1.smithi111.stdout:1/958: getdents d0/d8e/dd4/dfc 0 2023-12-08T20:28:01.901 INFO:tasks.workunit.client.1.smithi111.stdout:2/992: dread d1/d1d/d68/d73/dd6/fda [0,4194304] 0 2023-12-08T20:28:01.907 INFO:tasks.workunit.client.1.smithi111.stdout:3/848: unlink d2/d15/dcf/led 0 2023-12-08T20:28:01.907 INFO:tasks.workunit.client.1.smithi111.stdout:1/959: rename d0/d6/d33/d15/d51/d5b/d5e/f10e to d0/d8e/db0/d10d/d111/dab/f144 0 2023-12-08T20:28:01.908 INFO:tasks.workunit.client.1.smithi111.stdout:2/993: creat d1/d29/d53/d91/f160 x:0 0 0 2023-12-08T20:28:01.910 INFO:tasks.workunit.client.1.smithi111.stdout:1/960: creat d0/d6/d33/d15/d51/d2e/d61/d79/dc3/f145 x:0 0 0 2023-12-08T20:28:01.910 INFO:tasks.workunit.client.1.smithi111.stdout:1/961: fsync d0/d6/d33/d6c/d127/f129 0 2023-12-08T20:28:01.911 INFO:tasks.workunit.client.1.smithi111.stdout:2/994: rename d1/l14d to d1/d1d/d148/l161 0 2023-12-08T20:28:01.911 INFO:tasks.workunit.client.1.smithi111.stdout:4/987: dwrite d8/dda/fae [0,4194304] 0 2023-12-08T20:28:01.911 INFO:tasks.workunit.client.1.smithi111.stdout:4/988: write d8/da/db/d7f/d8e/dea/f13b [969001,67839] 0 2023-12-08T20:28:01.911 INFO:tasks.workunit.client.1.smithi111.stdout:4/989: truncate d8/da/d29/d131/f126 2196213 0 2023-12-08T20:28:01.911 INFO:tasks.workunit.client.1.smithi111.stdout:1/962: creat d0/d6/d33/d15/d51/d5b/f146 x:0 0 0 2023-12-08T20:28:01.912 INFO:tasks.workunit.client.1.smithi111.stdout:2/995: mknod d1/d1d/d1f/dc1/c162 0 2023-12-08T20:28:01.912 INFO:tasks.workunit.client.1.smithi111.stdout:2/996: truncate d1/d1d/d68/d73/f133 31992 0 2023-12-08T20:28:01.914 INFO:tasks.workunit.client.1.smithi111.stdout:4/990: rmdir d8/da/d10e 39 2023-12-08T20:28:01.914 INFO:tasks.workunit.client.1.smithi111.stdout:4/991: write d8/d12d/f52 [2230599,112678] 0 2023-12-08T20:28:01.914 INFO:tasks.workunit.client.1.smithi111.stdout:4/992: write d8/d30/d7d/d9b/db2/d4b/dd1/f12b [109246,30574] 0 2023-12-08T20:28:01.916 INFO:tasks.workunit.client.1.smithi111.stdout:4/993: write d8/da/db/f4d [1541583,49526] 0 2023-12-08T20:28:01.916 INFO:tasks.workunit.client.1.smithi111.stdout:4/994: write d8/da/db/d7f/dd2/f12f [5034508,52548] 0 2023-12-08T20:28:01.916 INFO:tasks.workunit.client.1.smithi111.stdout:2/997: mknod d1/d29/d53/d90/c163 0 2023-12-08T20:28:01.918 INFO:tasks.workunit.client.1.smithi111.stdout:4/995: rmdir d8/da/db/d7f/dd2 39 2023-12-08T20:28:01.927 INFO:tasks.workunit.client.1.smithi111.stdout:2/998: dread d1/d1d/d22/f71 [0,4194304] 0 2023-12-08T20:28:01.930 INFO:tasks.workunit.client.1.smithi111.stdout:3/849: dwrite d2/d12/d2e/dc6/d93/fe4 [0,4194304] 0 2023-12-08T20:28:01.931 INFO:tasks.workunit.client.1.smithi111.stdout:3/850: write d2/d3/d13/d36/d69/d70/ff1 [626055,52656] 0 2023-12-08T20:28:01.933 INFO:tasks.workunit.client.1.smithi111.stdout:3/851: mkdir d2/d15/dcf/d111 0 2023-12-08T20:28:01.933 INFO:tasks.workunit.client.1.smithi111.stdout:3/852: chown d2/d12/d2e/dc6/ce3 28447 1 2023-12-08T20:28:01.935 INFO:tasks.workunit.client.1.smithi111.stdout:3/853: mkdir d2/d15/d17/d5e/da6/dd4/d112 0 2023-12-08T20:28:01.939 INFO:tasks.workunit.client.1.smithi111.stdout:3/854: unlink d2/d3/fb 0 2023-12-08T20:28:01.941 INFO:tasks.workunit.client.1.smithi111.stdout:3/855: mknod d2/d3/d13/d36/d44/d8f/da7/c113 0 2023-12-08T20:28:01.946 INFO:tasks.workunit.client.1.smithi111.stdout:3/856: write d2/d15/d17/f5c [129551,104402] 0 2023-12-08T20:28:01.947 INFO:tasks.workunit.client.1.smithi111.stdout:3/857: mkdir d2/d3/d13/d36/d44/df4/d114 0 2023-12-08T20:28:01.948 INFO:tasks.workunit.client.1.smithi111.stdout:2/999: dwrite d1/d1d/d68/f124 [0,4194304] 0 2023-12-08T20:28:01.950 INFO:tasks.workunit.client.1.smithi111.stdout:3/858: dread d2/d3/d13/f98 [0,4194304] 0 2023-12-08T20:28:01.951 INFO:tasks.workunit.client.1.smithi111.stdout:1/963: dwrite d0/d6/d33/d6c/da1/fd2 [0,4194304] 0 2023-12-08T20:28:01.951 INFO:tasks.workunit.client.1.smithi111.stdout:3/859: write d2/d3/d13/d36/d44/daa/faf [1791701,42383] 0 2023-12-08T20:28:01.951 INFO:tasks.workunit.client.1.smithi111.stdout:3/860: fsync d2/d15/d17/d25/f26 0 2023-12-08T20:28:01.959 INFO:tasks.workunit.client.1.smithi111.stdout:1/964: dread d0/d22/f23 [0,4194304] 0 2023-12-08T20:28:01.959 INFO:tasks.workunit.client.1.smithi111.stdout:1/965: chown d0/d8e/db0/cd5 106 1 2023-12-08T20:28:01.964 INFO:tasks.workunit.client.1.smithi111.stdout:3/861: dwrite d2/d3/d13/d36/d69/d70/f90 [0,4194304] 0 2023-12-08T20:28:02.007 INFO:tasks.workunit.client.1.smithi111.stdout:1/966: mknod d0/d6/d33/d8b/c147 0 2023-12-08T20:28:02.010 INFO:tasks.workunit.client.1.smithi111.stdout:3/862: truncate d2/d3/f16 489269 0 2023-12-08T20:28:02.012 INFO:tasks.workunit.client.1.smithi111.stdout:3/863: dread d2/d12/d2e/f74 [0,4194304] 0 2023-12-08T20:28:02.012 INFO:tasks.workunit.client.1.smithi111.stdout:3/864: fdatasync d2/d3/d13/d36/fdb 0 2023-12-08T20:28:02.027 INFO:tasks.workunit.client.1.smithi111.stdout:3/865: dwrite d2/d15/d17/f94 [4194304,4194304] 0 2023-12-08T20:28:02.039 INFO:tasks.workunit.client.1.smithi111.stdout:3/866: dwrite d2/d3/d13/d36/d69/fb2 [0,4194304] 0 2023-12-08T20:28:02.041 INFO:tasks.workunit.client.1.smithi111.stdout:3/867: mkdir d2/d3/d6/d8b/d115 0 2023-12-08T20:28:02.041 INFO:tasks.workunit.client.1.smithi111.stdout:3/868: write d2/d3/d13/d36/d44/d10d/fa5 [1300315,63382] 0 2023-12-08T20:28:02.042 INFO:tasks.workunit.client.1.smithi111.stdout:3/869: truncate d2/d12/d2e/dc6/d93/fe4 5228884 0 2023-12-08T20:28:02.049 INFO:tasks.workunit.client.0.smithi043.stdout:8/33: creat d2/d4/fb x:0 0 0 2023-12-08T20:28:02.050 INFO:tasks.workunit.client.0.smithi043.stdout:9/69: rmdir d0 39 2023-12-08T20:28:02.053 INFO:tasks.workunit.client.0.smithi043.stdout:8/34: getdents d2 0 2023-12-08T20:28:02.059 INFO:tasks.workunit.client.0.smithi043.stdout:9/70: dread d0/f10 [0,4194304] 0 2023-12-08T20:28:02.059 INFO:tasks.workunit.client.0.smithi043.stdout:9/71: chown d0/l11 7005689 1 2023-12-08T20:28:02.060 INFO:tasks.workunit.client.1.smithi111.stdout:3/870: dwrite d2/d3/d13/d36/d44/d8f/fb7 [0,4194304] 0 2023-12-08T20:28:02.063 INFO:tasks.workunit.client.1.smithi111.stdout:3/871: mkdir d2/d15/d116 0 2023-12-08T20:28:02.064 INFO:tasks.workunit.client.1.smithi111.stdout:3/872: creat d2/d3/d13/d36/d69/d81/f117 x:0 0 0 2023-12-08T20:28:02.065 INFO:tasks.workunit.client.1.smithi111.stdout:3/873: fsync d2/d12/d2e/dc6/fc3 0 2023-12-08T20:28:02.065 INFO:tasks.workunit.client.0.smithi043.stdout:8/35: dread d2/f9 [0,4194304] 0 2023-12-08T20:28:02.065 INFO:tasks.workunit.client.0.smithi043.stdout:8/36: write d2/d4/fb [186999,130117] 0 2023-12-08T20:28:02.067 INFO:tasks.workunit.client.1.smithi111.stdout:3/874: mknod d2/d12/d4a/c118 0 2023-12-08T20:28:02.067 INFO:tasks.workunit.client.1.smithi111.stdout:3/875: fsync d2/d3/d13/d36/d69/d70/f9b 0 2023-12-08T20:28:02.067 INFO:tasks.workunit.client.1.smithi111.stdout:3/876: creat d2/d3/d13/d36/d69/d70/f119 x:0 0 0 2023-12-08T20:28:02.069 INFO:tasks.workunit.client.1.smithi111.stdout:3/877: unlink d2/d15/d17/d5e/d62/ldd 0 2023-12-08T20:28:02.072 INFO:tasks.workunit.client.1.smithi111.stdout:3/878: mkdir d2/d3/d6/d11a 0 2023-12-08T20:28:02.076 INFO:tasks.workunit.client.1.smithi111.stdout:3/879: creat d2/d3/d13/d36/d44/d8f/f11b x:0 0 0 2023-12-08T20:28:02.077 INFO:tasks.workunit.client.1.smithi111.stdout:3/880: mkdir d2/d15/d11c 0 2023-12-08T20:28:02.077 INFO:tasks.workunit.client.1.smithi111.stdout:3/881: truncate d2/d3/d13/d36/d69/d81/f117 1030340 0 2023-12-08T20:28:02.086 INFO:tasks.workunit.client.0.smithi043.stdout:8/37: dwrite d2/f3 [0,4194304] 0 2023-12-08T20:28:02.086 INFO:tasks.workunit.client.0.smithi043.stdout:8/38: write d2/d4/fb [351420,20597] 0 2023-12-08T20:28:02.107 INFO:tasks.workunit.client.1.smithi111.stdout:6/860: sync 2023-12-08T20:28:02.107 INFO:tasks.workunit.client.1.smithi111.stdout:6/861: readlink d0/d68/d95/l112 0 2023-12-08T20:28:02.108 INFO:tasks.workunit.client.1.smithi111.stdout:6/862: chown d0/d1/d27/d36/c6c 229521 1 2023-12-08T20:28:02.108 INFO:tasks.workunit.client.1.smithi111.stdout:6/863: chown d0/d68/d95/f1d 5732124 1 2023-12-08T20:28:02.108 INFO:tasks.workunit.client.1.smithi111.stdout:3/882: dwrite d2/d15/d17/d25/f26 [4194304,4194304] 0 2023-12-08T20:28:02.108 INFO:tasks.workunit.client.1.smithi111.stdout:3/883: dread - d2/d3/d13/d36/fdb zero size 2023-12-08T20:28:02.108 INFO:tasks.workunit.client.1.smithi111.stdout:3/884: symlink d2/d15/d17/d25/de0/l11d 0 2023-12-08T20:28:02.127 INFO:tasks.workunit.client.1.smithi111.stdout:6/864: dwrite d0/d1/f67 [0,4194304] 0 2023-12-08T20:28:02.128 INFO:tasks.workunit.client.1.smithi111.stdout:3/885: dwrite d2/d3/d13/d36/d44/daa/faf [0,4194304] 0 2023-12-08T20:28:02.128 INFO:tasks.workunit.client.1.smithi111.stdout:6/865: write d0/d1/d27/f5c [4695312,26794] 0 2023-12-08T20:28:02.128 INFO:tasks.workunit.client.1.smithi111.stdout:6/866: write d0/d68/d95/d7a/f106 [122850,31841] 0 2023-12-08T20:28:02.129 INFO:tasks.workunit.client.1.smithi111.stdout:6/867: chown d0/f8c 452050249 1 2023-12-08T20:28:02.139 INFO:tasks.workunit.client.1.smithi111.stdout:6/868: dread d0/d1/f8 [0,4194304] 0 2023-12-08T20:28:02.161 INFO:tasks.workunit.client.0.smithi043.stdout:9/72: rename d0/f15 to d0/f17 0 2023-12-08T20:28:02.163 INFO:tasks.workunit.client.0.smithi043.stdout:9/73: symlink d0/l18 0 2023-12-08T20:28:02.163 INFO:tasks.workunit.client.0.smithi043.stdout:9/74: chown d0/f6 445 1 2023-12-08T20:28:02.163 INFO:tasks.workunit.client.0.smithi043.stdout:9/75: chown d0/ca 1 1 2023-12-08T20:28:02.165 INFO:tasks.workunit.client.0.smithi043.stdout:9/76: dread d0/fb [0,4194304] 0 2023-12-08T20:28:02.165 INFO:tasks.workunit.client.0.smithi043.stdout:9/77: readlink d0/l12 0 2023-12-08T20:28:02.166 INFO:tasks.workunit.client.0.smithi043.stdout:9/78: dread d0/fb [0,4194304] 0 2023-12-08T20:28:02.167 INFO:tasks.workunit.client.0.smithi043.stdout:9/79: unlink d0/fb 0 2023-12-08T20:28:02.169 INFO:tasks.workunit.client.0.smithi043.stdout:9/80: mknod d0/c19 0 2023-12-08T20:28:02.169 INFO:tasks.workunit.client.0.smithi043.stdout:9/81: write d0/f17 [122900,66633] 0 2023-12-08T20:28:02.169 INFO:tasks.workunit.client.0.smithi043.stdout:9/82: symlink d0/l1a 0 2023-12-08T20:28:02.170 INFO:tasks.workunit.client.0.smithi043.stdout:9/83: creat d0/f1b x:0 0 0 2023-12-08T20:28:02.170 INFO:tasks.workunit.client.0.smithi043.stdout:9/84: fdatasync d0/f6 0 2023-12-08T20:28:02.175 INFO:tasks.workunit.client.0.smithi043.stdout:9/85: getdents d0 0 2023-12-08T20:28:02.232 INFO:tasks.workunit.client.1.smithi111.stdout:6/869: rename d0/d68/da9/fd3 to d0/d1/d27/d36/d8d/f118 0 2023-12-08T20:28:02.309 INFO:tasks.workunit.client.1.smithi111.stdout:6/870: getdents d0/daa 0 2023-12-08T20:28:02.309 INFO:tasks.workunit.client.1.smithi111.stdout:6/871: chown d0/d1/d27/d36/d8d/lfa 48353921 1 2023-12-08T20:28:02.310 INFO:tasks.workunit.client.1.smithi111.stdout:4/996: sync 2023-12-08T20:28:02.310 INFO:tasks.workunit.client.1.smithi111.stdout:4/997: chown d8/d30/d7d/d9b/db2/d4b 758098 1 2023-12-08T20:28:02.337 INFO:tasks.workunit.client.1.smithi111.stdout:6/872: creat d0/d1/d27/da1/dca/f119 x:0 0 0 2023-12-08T20:28:02.338 INFO:tasks.workunit.client.1.smithi111.stdout:1/967: sync 2023-12-08T20:28:02.338 INFO:tasks.workunit.client.1.smithi111.stdout:3/886: sync 2023-12-08T20:28:02.339 INFO:tasks.workunit.client.1.smithi111.stdout:4/998: creat d8/d30/d7d/d9b/db2/f13e x:0 0 0 2023-12-08T20:28:02.339 INFO:tasks.workunit.client.1.smithi111.stdout:4/999: chown d8/da/db/d7f/d93/d77/fa6 7699065 1 2023-12-08T20:28:02.355 INFO:tasks.workunit.client.1.smithi111.stdout:3/887: dwrite d2/d3/d13/d36/d69/d70/ff1 [0,4194304] 0 2023-12-08T20:28:02.359 INFO:tasks.workunit.client.1.smithi111.stdout:6/873: unlink d0/d1/f11 0 2023-12-08T20:28:02.360 INFO:tasks.workunit.client.1.smithi111.stdout:1/968: truncate d0/d6/d47/f4a 1841470 0 2023-12-08T20:28:02.361 INFO:tasks.workunit.client.1.smithi111.stdout:1/969: write d0/d6/d33/d8b/de9/fff [74715,64823] 0 2023-12-08T20:28:02.362 INFO:tasks.workunit.client.1.smithi111.stdout:3/888: getdents d2/d12/d4a/d5d/df5 0 2023-12-08T20:28:02.366 INFO:tasks.workunit.client.1.smithi111.stdout:6/874: mkdir d0/d1/d27/da1/dca/d11a 0 2023-12-08T20:28:02.366 INFO:tasks.workunit.client.1.smithi111.stdout:6/875: truncate d0/d1/d1e/f9b 4805409 0 2023-12-08T20:28:02.366 INFO:tasks.workunit.client.1.smithi111.stdout:1/970: mknod d0/d6/d33/d60/c148 0 2023-12-08T20:28:02.366 INFO:tasks.workunit.client.1.smithi111.stdout:1/971: write d0/d6/d33/d8b/de9/fff [2577719,116356] 0 2023-12-08T20:28:02.370 INFO:tasks.workunit.client.1.smithi111.stdout:6/876: unlink d0/d1/d1e/db2/da5/dfc/f10c 0 2023-12-08T20:28:02.370 INFO:tasks.workunit.client.1.smithi111.stdout:6/877: readlink d0/d68/d95/l6a 0 2023-12-08T20:28:02.373 INFO:tasks.workunit.client.1.smithi111.stdout:6/878: getdents d0/d1/d27/da1/dca/df6 0 2023-12-08T20:28:02.377 INFO:tasks.workunit.client.1.smithi111.stdout:3/889: dwrite d2/d3/d13/d36/d44/daa/faf [0,4194304] 0 2023-12-08T20:28:02.381 INFO:tasks.workunit.client.1.smithi111.stdout:1/972: dread d0/d6/d47/f4a [0,4194304] 0 2023-12-08T20:28:02.381 INFO:tasks.workunit.client.1.smithi111.stdout:1/973: fsync d0/d6/d33/d15/d51/d78/f95 0 2023-12-08T20:28:02.493 INFO:tasks.workunit.client.1.smithi111.stdout:6/879: stat d0/d1/d27/d36/l88 0 2023-12-08T20:28:02.493 INFO:tasks.workunit.client.1.smithi111.stdout:6/880: write d0/d1/d1e/db2/f7d [4413185,126330] 0 2023-12-08T20:28:02.493 INFO:tasks.workunit.client.1.smithi111.stdout:6/881: fsync d0/d1/d1e/db2/f1f 0 2023-12-08T20:28:02.496 INFO:tasks.workunit.client.1.smithi111.stdout:6/882: dread d0/d1/d27/d56/f76 [0,4194304] 0 2023-12-08T20:28:02.496 INFO:tasks.workunit.client.1.smithi111.stdout:6/883: readlink d0/d68/d95/l112 0 2023-12-08T20:28:02.496 INFO:tasks.workunit.client.1.smithi111.stdout:6/884: readlink d0/d1/d1e/db2/l10d 0 2023-12-08T20:28:02.497 INFO:tasks.workunit.client.1.smithi111.stdout:6/885: write d0/d1/d27/da1/fb7 [3518548,13486] 0 2023-12-08T20:28:02.941 INFO:tasks.workunit.client.1.smithi111.stdout:3/890: dwrite d2/d3/d6/f23 [4194304,4194304] 0 2023-12-08T20:28:02.956 INFO:tasks.workunit.client.1.smithi111.stdout:3/891: dwrite d2/d3/d13/f98 [0,4194304] 0 2023-12-08T20:28:03.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:02 smithi043 ceph-mon[111966]: pgmap v22: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 136 MiB/s rd, 277 MiB/s wr, 1.15k op/s 2023-12-08T20:28:03.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:02 smithi043 ceph-mon[111966]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:28:03.056 INFO:tasks.workunit.client.1.smithi111.stdout:1/974: rename d0/d8e/dd4/dfc to d0/d6/d33/d15/d51/d5b/d59/db8/d103/d149 0 2023-12-08T20:28:03.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:02 smithi111 ceph-mon[121341]: pgmap v22: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 136 MiB/s rd, 277 MiB/s wr, 1.15k op/s 2023-12-08T20:28:03.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:02 smithi111 ceph-mon[121341]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:28:03.311 INFO:tasks.workunit.client.1.smithi111.stdout:6/886: dread d0/d1/d27/ffb [0,4194304] 0 2023-12-08T20:28:03.312 INFO:tasks.workunit.client.1.smithi111.stdout:6/887: fdatasync d0/d1/f8 0 2023-12-08T20:28:03.353 INFO:tasks.workunit.client.1.smithi111.stdout:1/975: creat d0/d6/d47/dee/f14a x:0 0 0 2023-12-08T20:28:03.357 INFO:tasks.workunit.client.1.smithi111.stdout:6/888: rmdir d0/d1/d1e 39 2023-12-08T20:28:03.359 INFO:tasks.workunit.client.1.smithi111.stdout:1/976: unlink d0/d6/d33/d8b/db5/d125/c141 0 2023-12-08T20:28:03.359 INFO:tasks.workunit.client.1.smithi111.stdout:1/977: stat d0/d6/f105 0 2023-12-08T20:28:03.359 INFO:tasks.workunit.client.1.smithi111.stdout:3/892: dread d2/d3/d6/fd [0,4194304] 0 2023-12-08T20:28:03.361 INFO:tasks.workunit.client.1.smithi111.stdout:6/889: symlink d0/d68/d95/l11b 0 2023-12-08T20:28:03.361 INFO:tasks.workunit.client.1.smithi111.stdout:6/890: stat d0/d1/d27/d56/c8f 0 2023-12-08T20:28:03.362 INFO:tasks.workunit.client.1.smithi111.stdout:1/978: unlink d0/d8e/dd4/cd8 0 2023-12-08T20:28:03.363 INFO:tasks.workunit.client.1.smithi111.stdout:3/893: symlink d2/d15/d17/d5e/d62/l11e 0 2023-12-08T20:28:03.368 INFO:tasks.workunit.client.1.smithi111.stdout:1/979: symlink d0/d8e/l14b 0 2023-12-08T20:28:03.368 INFO:tasks.workunit.client.1.smithi111.stdout:3/894: link d2/d3/d13/d36/d44/lee d2/d12/d2e/dc6/d93/l11f 0 2023-12-08T20:28:03.369 INFO:tasks.workunit.client.1.smithi111.stdout:3/895: symlink d2/d3/d13/d36/d44/daa/l120 0 2023-12-08T20:28:03.369 INFO:tasks.workunit.client.1.smithi111.stdout:3/896: dread - d2/d12/fa2 zero size 2023-12-08T20:28:03.370 INFO:tasks.workunit.client.1.smithi111.stdout:3/897: link d2/d3/d13/d36/d69/d70/f119 d2/d3/d13/d36/d69/d81/f121 0 2023-12-08T20:28:03.378 INFO:tasks.workunit.client.1.smithi111.stdout:1/980: dread d0/d6/f105 [0,4194304] 0 2023-12-08T20:28:03.378 INFO:tasks.workunit.client.1.smithi111.stdout:1/981: readlink d0/d6/d33/d6c/d75/l8a 0 2023-12-08T20:28:03.378 INFO:tasks.workunit.client.1.smithi111.stdout:6/891: dwrite d0/d1/f67 [0,4194304] 0 2023-12-08T20:28:03.378 INFO:tasks.workunit.client.1.smithi111.stdout:6/892: getdents d0/d1/d27/da1/dca/df6 0 2023-12-08T20:28:03.379 INFO:tasks.workunit.client.1.smithi111.stdout:1/982: truncate d0/d6/f14 955269 0 2023-12-08T20:28:03.387 INFO:tasks.workunit.client.1.smithi111.stdout:3/898: dwrite d2/d3/d13/d36/d44/d8f/dac/fd7 [0,4194304] 0 2023-12-08T20:28:03.391 INFO:tasks.workunit.client.1.smithi111.stdout:3/899: write d2/d15/d17/d25/fef [4069147,80536] 0 2023-12-08T20:28:03.394 INFO:tasks.workunit.client.1.smithi111.stdout:3/900: creat d2/d3/d13/d36/d44/d8f/da7/f122 x:0 0 0 2023-12-08T20:28:03.396 INFO:tasks.workunit.client.1.smithi111.stdout:6/893: dwrite d0/d1/d27/d36/d97/fe3 [0,4194304] 0 2023-12-08T20:28:03.398 INFO:tasks.workunit.client.1.smithi111.stdout:3/901: rename d2/d3/d13/d36/d44/d8f/da7/fca to d2/d3/d13/d36/d44/df4/d114/f123 0 2023-12-08T20:28:03.403 INFO:tasks.workunit.client.1.smithi111.stdout:6/894: rename d0/d68/da9 to d0/d68/d95/d7a/d113/d11c 0 2023-12-08T20:28:03.404 INFO:tasks.workunit.client.1.smithi111.stdout:6/895: creat d0/d1/d27/d36/d97/f11d x:0 0 0 2023-12-08T20:28:03.406 INFO:tasks.workunit.client.1.smithi111.stdout:6/896: creat d0/d1/d27/da1/dca/d11a/f11e x:0 0 0 2023-12-08T20:28:03.409 INFO:tasks.workunit.client.1.smithi111.stdout:1/983: dwrite d0/d6/d33/d15/d51/d5b/f54 [0,4194304] 0 2023-12-08T20:28:03.410 INFO:tasks.workunit.client.1.smithi111.stdout:6/897: rename d0/d1/d27/f87 to d0/d1/d27/d6e/df1/f11f 0 2023-12-08T20:28:03.410 INFO:tasks.workunit.client.1.smithi111.stdout:6/898: chown d0/d68/d95/d7a/d113/d11c/fdf 595 1 2023-12-08T20:28:03.421 INFO:tasks.workunit.client.1.smithi111.stdout:6/899: dread d0/d1/d27/da1/fcb [0,4194304] 0 2023-12-08T20:28:03.421 INFO:tasks.workunit.client.1.smithi111.stdout:6/900: stat d0/d1/d27/da1/dca/d11a 0 2023-12-08T20:28:03.421 INFO:tasks.workunit.client.1.smithi111.stdout:6/901: truncate d0/d1/d27/d36/d97/fe3 1908430 0 2023-12-08T20:28:03.421 INFO:tasks.workunit.client.1.smithi111.stdout:6/902: dread - d0/d1/d27/d56/f116 zero size 2023-12-08T20:28:03.422 INFO:tasks.workunit.client.1.smithi111.stdout:6/903: symlink d0/d1/d27/d6e/l120 0 2023-12-08T20:28:03.423 INFO:tasks.workunit.client.1.smithi111.stdout:6/904: mkdir d0/d68/d95/d121 0 2023-12-08T20:28:03.426 INFO:tasks.workunit.client.1.smithi111.stdout:3/902: dwrite d2/d3/d13/d36/d44/d8f/dac/fd7 [0,4194304] 0 2023-12-08T20:28:03.426 INFO:tasks.workunit.client.1.smithi111.stdout:1/984: dwrite d0/f2 [0,4194304] 0 2023-12-08T20:28:03.427 INFO:tasks.workunit.client.1.smithi111.stdout:1/985: truncate d0/d6/d33/d6c/da1/fd2 4680490 0 2023-12-08T20:28:03.428 INFO:tasks.workunit.client.1.smithi111.stdout:3/903: link d2/d12/d2e/l109 d2/d3/d13/d36/d44/df4/d114/l124 0 2023-12-08T20:28:03.428 INFO:tasks.workunit.client.1.smithi111.stdout:6/905: write d0/d1/d1e/db2/f60 [3822769,112502] 0 2023-12-08T20:28:03.428 INFO:tasks.workunit.client.1.smithi111.stdout:6/906: chown d0/d1/l101 6 1 2023-12-08T20:28:03.429 INFO:tasks.workunit.client.1.smithi111.stdout:1/986: mknod d0/d8e/db0/d10d/d111/c14c 0 2023-12-08T20:28:03.430 INFO:tasks.workunit.client.1.smithi111.stdout:6/907: rmdir d0/d1/d27/da1/dca/df6 39 2023-12-08T20:28:03.431 INFO:tasks.workunit.client.1.smithi111.stdout:1/987: creat d0/d6/d33/d8b/db5/f14d x:0 0 0 2023-12-08T20:28:03.433 INFO:tasks.workunit.client.1.smithi111.stdout:6/908: getdents d0/d1/d27/d36 0 2023-12-08T20:28:03.434 INFO:tasks.workunit.client.1.smithi111.stdout:6/909: creat d0/d68/d95/f122 x:0 0 0 2023-12-08T20:28:03.434 INFO:tasks.workunit.client.1.smithi111.stdout:3/904: dread d2/d15/d17/d25/de0/f61 [0,4194304] 0 2023-12-08T20:28:03.435 INFO:tasks.workunit.client.1.smithi111.stdout:6/910: rmdir d0/d68/d95/d121 0 2023-12-08T20:28:03.435 INFO:tasks.workunit.client.1.smithi111.stdout:3/905: write d2/fa [562343,121629] 0 2023-12-08T20:28:03.436 INFO:tasks.workunit.client.1.smithi111.stdout:3/906: rmdir d2/d15 39 2023-12-08T20:28:03.441 INFO:tasks.workunit.client.1.smithi111.stdout:1/988: dread d0/d22/f9b [0,4194304] 0 2023-12-08T20:28:03.441 INFO:tasks.workunit.client.1.smithi111.stdout:1/989: chown d0/d6/d33/d60/f9d 473 1 2023-12-08T20:28:03.442 INFO:tasks.workunit.client.1.smithi111.stdout:3/907: creat d2/d3/d51/f125 x:0 0 0 2023-12-08T20:28:03.442 INFO:tasks.workunit.client.1.smithi111.stdout:3/908: truncate d2/d12/d4a/d5d/f82 4699320 0 2023-12-08T20:28:03.443 INFO:tasks.workunit.client.1.smithi111.stdout:1/990: truncate d0/d6/d33/d15/d51/d5b/d59/db8/d103/d149/f107 1964023 0 2023-12-08T20:28:03.443 INFO:tasks.workunit.client.1.smithi111.stdout:1/991: chown d0/d6/d33/d15/d51/d5b/d5e/f13a 16889 1 2023-12-08T20:28:03.444 INFO:tasks.workunit.client.1.smithi111.stdout:3/909: creat d2/d15/d17/d5e/d9f/dbe/f126 x:0 0 0 2023-12-08T20:28:03.446 INFO:tasks.workunit.client.1.smithi111.stdout:1/992: mkdir d0/d6/d33/d15/d51/d5b/d59/db8/d103/d14e 0 2023-12-08T20:28:03.446 INFO:tasks.workunit.client.1.smithi111.stdout:1/993: write d0/d4d/feb [1603418,23034] 0 2023-12-08T20:28:03.447 INFO:tasks.workunit.client.1.smithi111.stdout:3/910: creat d2/d3/d13/d36/d69/d70/f127 x:0 0 0 2023-12-08T20:28:03.447 INFO:tasks.workunit.client.1.smithi111.stdout:3/911: chown d2/d15/d17/d25/de0/lc1 2793633 1 2023-12-08T20:28:03.448 INFO:tasks.workunit.client.1.smithi111.stdout:1/994: rename d0/lb4 to d0/d6/d33/d6c/d75/l14f 0 2023-12-08T20:28:03.448 INFO:tasks.workunit.client.1.smithi111.stdout:1/995: write d0/d6/fb7 [2044703,82234] 0 2023-12-08T20:28:03.449 INFO:tasks.workunit.client.1.smithi111.stdout:6/911: dwrite d0/d1/d1e/db2/dd7/f109 [4194304,4194304] 0 2023-12-08T20:28:03.449 INFO:tasks.workunit.client.1.smithi111.stdout:3/912: write d2/d3/d13/d36/d44/d8f/dac/fd7 [1453369,4596] 0 2023-12-08T20:28:03.449 INFO:tasks.workunit.client.1.smithi111.stdout:3/913: stat d2/d3/d13/d36/d69/d81/f117 0 2023-12-08T20:28:03.449 INFO:tasks.workunit.client.1.smithi111.stdout:1/996: mknod d0/d6/d33/d6c/c150 0 2023-12-08T20:28:03.450 INFO:tasks.workunit.client.1.smithi111.stdout:6/912: mkdir d0/daa/d123 0 2023-12-08T20:28:03.451 INFO:tasks.workunit.client.1.smithi111.stdout:3/914: mkdir d2/d15/d17/d25/de0/d128 0 2023-12-08T20:28:03.452 INFO:tasks.workunit.client.1.smithi111.stdout:1/997: mknod d0/d6/d33/d8b/de9/c151 0 2023-12-08T20:28:03.453 INFO:tasks.workunit.client.1.smithi111.stdout:6/913: creat d0/d68/f124 x:0 0 0 2023-12-08T20:28:03.465 INFO:tasks.workunit.client.1.smithi111.stdout:1/998: dread d0/d6/d33/d15/d51/d5b/d59/db8/d103/d149/f107 [0,4194304] 0 2023-12-08T20:28:03.468 INFO:tasks.workunit.client.1.smithi111.stdout:1/999: unlink d0/d6/d33/d15/d51/d2e/d61/d79/dac/fed 0 2023-12-08T20:28:03.472 INFO:tasks.workunit.client.1.smithi111.stdout:6/914: dwrite d0/d68/f124 [0,4194304] 0 2023-12-08T20:28:03.473 INFO:tasks.workunit.client.1.smithi111.stdout:3/915: dwrite d2/d3/fd5 [0,4194304] 0 2023-12-08T20:28:03.480 INFO:tasks.workunit.client.1.smithi111.stdout:6/915: dread d0/f13 [0,4194304] 0 2023-12-08T20:28:03.481 INFO:tasks.workunit.client.1.smithi111.stdout:6/916: write d0/f20 [932516,53902] 0 2023-12-08T20:28:03.482 INFO:tasks.workunit.client.1.smithi111.stdout:6/917: rmdir d0/d1/d27/d36/d8d 39 2023-12-08T20:28:03.483 INFO:tasks.workunit.client.1.smithi111.stdout:6/918: mkdir d0/d1/d27/d36/d8d/d125 0 2023-12-08T20:28:03.483 INFO:tasks.workunit.client.1.smithi111.stdout:6/919: rmdir d0/da0 39 2023-12-08T20:28:03.484 INFO:tasks.workunit.client.1.smithi111.stdout:3/916: dwrite d2/d12/d4a/d5d/f6a [0,4194304] 0 2023-12-08T20:28:03.487 INFO:tasks.workunit.client.1.smithi111.stdout:6/920: unlink d0/d1/d1e/db2/da5/cdd 0 2023-12-08T20:28:03.502 INFO:tasks.workunit.client.1.smithi111.stdout:3/917: dwrite d2/d15/d17/d5e/d9f/dbe/fc0 [0,4194304] 0 2023-12-08T20:28:03.513 INFO:tasks.workunit.client.1.smithi111.stdout:6/921: dwrite d0/d1/d27/da1/dca/f119 [0,4194304] 0 2023-12-08T20:28:03.513 INFO:tasks.workunit.client.1.smithi111.stdout:6/922: fdatasync d0/daa/fea 0 2023-12-08T20:28:03.517 INFO:tasks.workunit.client.1.smithi111.stdout:6/923: link d0/l91 d0/d1/d1e/db2/dd7/l126 0 2023-12-08T20:28:03.975 INFO:tasks.workunit.client.1.smithi111.stdout:6/924: sync 2023-12-08T20:28:03.975 INFO:tasks.workunit.client.1.smithi111.stdout:3/918: sync 2023-12-08T20:28:03.975 INFO:tasks.workunit.client.1.smithi111.stdout:3/919: write d2/d3/d13/d36/d69/d70/f66 [853075,15000] 0 2023-12-08T20:28:03.975 INFO:tasks.workunit.client.1.smithi111.stdout:6/925: read d0/daa/fea [3268693,118069] 0 2023-12-08T20:28:04.053 INFO:tasks.workunit.client.1.smithi111.stdout:3/920: rename d2/d3/d13/d36/d44/d8f/da7/c113 to d2/d3/d13/d36/d44/d10d/c129 0 2023-12-08T20:28:04.054 INFO:tasks.workunit.client.1.smithi111.stdout:3/921: write d2/d3/fd5 [1214305,124738] 0 2023-12-08T20:28:04.056 INFO:tasks.workunit.client.1.smithi111.stdout:3/922: rmdir d2/d15/d17/d25/de0 39 2023-12-08T20:28:04.057 INFO:tasks.workunit.client.1.smithi111.stdout:3/923: fsync d2/d12/f4b 0 2023-12-08T20:28:04.095 INFO:tasks.workunit.client.1.smithi111.stdout:6/926: rmdir d0/d68/d95/de4 39 2023-12-08T20:28:04.097 INFO:tasks.workunit.client.1.smithi111.stdout:6/927: mknod d0/d1/d1e/db2/da5/c127 0 2023-12-08T20:28:04.098 INFO:tasks.workunit.client.1.smithi111.stdout:6/928: symlink d0/d1/d27/da1/l128 0 2023-12-08T20:28:04.114 INFO:tasks.workunit.client.1.smithi111.stdout:6/929: dwrite d0/d68/d95/f35 [0,4194304] 0 2023-12-08T20:28:04.116 INFO:tasks.workunit.client.1.smithi111.stdout:6/930: creat d0/d1/d27/d36/d97/f129 x:0 0 0 2023-12-08T20:28:04.117 INFO:tasks.workunit.client.1.smithi111.stdout:6/931: mkdir d0/d1/d27/d6e/d12a 0 2023-12-08T20:28:04.121 INFO:tasks.workunit.client.1.smithi111.stdout:6/932: dread d0/d1/d27/d36/d97/db4/fff [0,4194304] 0 2023-12-08T20:28:04.123 INFO:tasks.workunit.client.1.smithi111.stdout:6/933: mkdir d0/d1/d27/d36/d97/db4/d12b 0 2023-12-08T20:28:04.123 INFO:tasks.workunit.client.1.smithi111.stdout:6/934: fsync d0/d1/d1e/db2/dd7/f109 0 2023-12-08T20:28:04.123 INFO:tasks.workunit.client.1.smithi111.stdout:6/935: fdatasync d0/d1/d27/d36/d97/fe3 0 2023-12-08T20:28:04.131 INFO:tasks.workunit.client.1.smithi111.stdout:3/924: unlink d2/d12/f1d 0 2023-12-08T20:28:04.137 INFO:tasks.workunit.client.1.smithi111.stdout:3/925: dread d2/d3/d13/d36/d69/d70/f90 [0,4194304] 0 2023-12-08T20:28:04.138 INFO:tasks.workunit.client.1.smithi111.stdout:3/926: getdents d2/d3 0 2023-12-08T20:28:04.138 INFO:tasks.workunit.client.1.smithi111.stdout:3/927: chown d2/d12/d2e/dc6/d93/fa4 503291 1 2023-12-08T20:28:04.140 INFO:tasks.workunit.client.1.smithi111.stdout:3/928: mkdir d2/d15/d17/d12a 0 2023-12-08T20:28:04.152 INFO:tasks.workunit.client.1.smithi111.stdout:3/929: dwrite d2/d12/d4a/f6d [0,4194304] 0 2023-12-08T20:28:04.154 INFO:tasks.workunit.client.1.smithi111.stdout:3/930: write d2/d3/d13/d36/d44/daa/faf [1473459,45834] 0 2023-12-08T20:28:04.154 INFO:tasks.workunit.client.1.smithi111.stdout:3/931: write d2/d3/d6/fe7 [511261,58228] 0 2023-12-08T20:28:04.154 INFO:tasks.workunit.client.1.smithi111.stdout:3/932: readlink d2/d12/d2e/dc6/l24 0 2023-12-08T20:28:04.155 INFO:tasks.workunit.client.1.smithi111.stdout:3/933: write d2/d3/d13/d36/d69/d70/f9b [150440,84017] 0 2023-12-08T20:28:04.171 INFO:tasks.workunit.client.1.smithi111.stdout:3/934: dwrite d2/d12/d4a/d5d/f82 [4194304,4194304] 0 2023-12-08T20:28:04.172 INFO:tasks.workunit.client.1.smithi111.stdout:3/935: rmdir d2/d3/d6/d11a 0 2023-12-08T20:28:04.173 INFO:tasks.workunit.client.1.smithi111.stdout:3/936: creat d2/d3/d13/d36/d69/d70/f12b x:0 0 0 2023-12-08T20:28:04.173 INFO:tasks.workunit.client.1.smithi111.stdout:3/937: write d2/d3/d13/d36/d69/d70/f66 [228094,46812] 0 2023-12-08T20:28:04.174 INFO:tasks.workunit.client.1.smithi111.stdout:3/938: mkdir d2/d3/d13/d36/d44/d10d/d12c 0 2023-12-08T20:28:04.175 INFO:tasks.workunit.client.1.smithi111.stdout:3/939: chown d2/d15/d17/d25/f26 4 1 2023-12-08T20:28:04.175 INFO:tasks.workunit.client.1.smithi111.stdout:3/940: dread - d2/d12/fa2 zero size 2023-12-08T20:28:04.175 INFO:tasks.workunit.client.1.smithi111.stdout:3/941: write d2/d15/d17/d5e/da6/fd1 [206431,117085] 0 2023-12-08T20:28:04.175 INFO:tasks.workunit.client.1.smithi111.stdout:3/942: fsync d2/d12/d2e/dc6/d93/fc9 0 2023-12-08T20:28:04.191 INFO:tasks.workunit.client.1.smithi111.stdout:3/943: dwrite d2/d3/d13/d36/d69/f7d [4194304,4194304] 0 2023-12-08T20:28:04.193 INFO:tasks.workunit.client.1.smithi111.stdout:3/944: link d2/d15/d17/d5e/d62/ldc d2/d12/dbd/l12d 0 2023-12-08T20:28:04.193 INFO:tasks.workunit.client.1.smithi111.stdout:3/945: chown d2/d12/d2e 8485 1 2023-12-08T20:28:04.194 INFO:tasks.workunit.client.1.smithi111.stdout:3/946: unlink d2/d3/d13/d36/d44/d8f/ff2 0 2023-12-08T20:28:04.253 INFO:tasks.workunit.client.1.smithi111.stdout:6/936: sync 2023-12-08T20:28:04.254 INFO:tasks.workunit.client.1.smithi111.stdout:6/937: dread d0/d1/d27/fd2 [0,4194304] 0 2023-12-08T20:28:04.268 INFO:tasks.workunit.client.1.smithi111.stdout:6/938: dwrite d0/d1/d1e/f2b [0,4194304] 0 2023-12-08T20:28:04.269 INFO:tasks.workunit.client.1.smithi111.stdout:6/939: creat d0/d1/d1e/f12c x:0 0 0 2023-12-08T20:28:04.270 INFO:tasks.workunit.client.1.smithi111.stdout:6/940: symlink d0/d1/d1e/db2/dd7/l12d 0 2023-12-08T20:28:04.271 INFO:tasks.workunit.client.1.smithi111.stdout:6/941: creat d0/d1/d27/d36/d8d/f12e x:0 0 0 2023-12-08T20:28:04.271 INFO:tasks.workunit.client.1.smithi111.stdout:6/942: write d0/d1/d27/d6e/df1/ff9 [145847,21968] 0 2023-12-08T20:28:04.271 INFO:tasks.workunit.client.1.smithi111.stdout:6/943: stat d0/d1/d1e/db2/da5/fda 0 2023-12-08T20:28:04.271 INFO:tasks.workunit.client.1.smithi111.stdout:6/944: readlink d0/d1/d27/d6e/l120 0 2023-12-08T20:28:04.272 INFO:tasks.workunit.client.1.smithi111.stdout:6/945: write d0/d1/d27/d36/d8d/f118 [440120,123208] 0 2023-12-08T20:28:04.273 INFO:tasks.workunit.client.1.smithi111.stdout:6/946: symlink d0/d1/d1e/db2/dd7/l12f 0 2023-12-08T20:28:04.279 INFO:tasks.workunit.client.1.smithi111.stdout:3/947: sync 2023-12-08T20:28:04.279 INFO:tasks.workunit.client.1.smithi111.stdout:3/948: chown d2/f9c 43917 1 2023-12-08T20:28:04.279 INFO:tasks.workunit.client.1.smithi111.stdout:3/949: readlink d2/d15/l6c 0 2023-12-08T20:28:04.279 INFO:tasks.workunit.client.1.smithi111.stdout:3/950: dread - d2/d15/d17/d5e/f10e zero size 2023-12-08T20:28:04.280 INFO:tasks.workunit.client.1.smithi111.stdout:3/951: getdents d2/d3/d6/d8b 0 2023-12-08T20:28:04.280 INFO:tasks.workunit.client.1.smithi111.stdout:3/952: write d2/d3/d13/d36/d44/d10d/fa3 [1686136,7861] 0 2023-12-08T20:28:04.281 INFO:tasks.workunit.client.1.smithi111.stdout:3/953: creat d2/d15/dcf/f12e x:0 0 0 2023-12-08T20:28:04.281 INFO:tasks.workunit.client.1.smithi111.stdout:3/954: chown d2/d12/d2e/ccd 3387685 1 2023-12-08T20:28:04.281 INFO:tasks.workunit.client.1.smithi111.stdout:3/955: truncate d2/d3/d13/f98 4708323 0 2023-12-08T20:28:04.282 INFO:tasks.workunit.client.1.smithi111.stdout:3/956: creat d2/d12/d4a/d5d/df5/d108/f12f x:0 0 0 2023-12-08T20:28:04.296 INFO:tasks.workunit.client.1.smithi111.stdout:3/957: dwrite d2/d12/d2e/dc6/d93/fa4 [0,4194304] 0 2023-12-08T20:28:04.296 INFO:tasks.workunit.client.1.smithi111.stdout:3/958: readlink d2/d3/l29 0 2023-12-08T20:28:04.296 INFO:tasks.workunit.client.1.smithi111.stdout:3/959: chown d2/d3/d13/d36/d44/d10d/d12c 0 1 2023-12-08T20:28:04.298 INFO:tasks.workunit.client.1.smithi111.stdout:3/960: creat d2/d15/d17/d5e/d62/f130 x:0 0 0 2023-12-08T20:28:04.299 INFO:tasks.workunit.client.1.smithi111.stdout:3/961: mknod d2/d12/d4a/d5d/df5/d108/c131 0 2023-12-08T20:28:04.299 INFO:tasks.workunit.client.1.smithi111.stdout:3/962: dread - d2/d3/d13/d36/d69/d70/f12b zero size 2023-12-08T20:28:04.300 INFO:tasks.workunit.client.1.smithi111.stdout:3/963: creat d2/d12/d4a/d5d/df5/f132 x:0 0 0 2023-12-08T20:28:04.316 INFO:tasks.workunit.client.1.smithi111.stdout:3/964: dwrite d2/d12/d2e/dc6/d93/fa4 [0,4194304] 0 2023-12-08T20:28:04.317 INFO:tasks.workunit.client.1.smithi111.stdout:3/965: write d2/d3/d13/d36/fd0 [568464,95652] 0 2023-12-08T20:28:04.317 INFO:tasks.workunit.client.1.smithi111.stdout:3/966: fsync d2/d3/d13/d36/d69/d70/f127 0 2023-12-08T20:28:04.318 INFO:tasks.workunit.client.1.smithi111.stdout:3/967: rename d2/d12/d4a/l110 to d2/d15/d17/d5e/d9f/dbe/l133 0 2023-12-08T20:28:04.320 INFO:tasks.workunit.client.1.smithi111.stdout:3/968: creat d2/d12/d4a/d5d/df5/d108/d10c/f134 x:0 0 0 2023-12-08T20:28:04.320 INFO:tasks.workunit.client.1.smithi111.stdout:3/969: write d2/d3/d13/d36/fdb [168333,15937] 0 2023-12-08T20:28:04.321 INFO:tasks.workunit.client.1.smithi111.stdout:3/970: mknod d2/d15/d17/c135 0 2023-12-08T20:28:04.323 INFO:tasks.workunit.client.1.smithi111.stdout:3/971: rmdir d2/d3/d51/deb 0 2023-12-08T20:28:04.325 INFO:tasks.workunit.client.1.smithi111.stdout:3/972: symlink d2/d3/d6/l136 0 2023-12-08T20:28:04.325 INFO:tasks.workunit.client.1.smithi111.stdout:6/947: sync 2023-12-08T20:28:04.325 INFO:tasks.workunit.client.1.smithi111.stdout:6/948: fsync d0/daa/fd6 0 2023-12-08T20:28:04.325 INFO:tasks.workunit.client.1.smithi111.stdout:3/973: read d2/d3/d13/d36/d44/d10d/fd6 [1218209,101512] 0 2023-12-08T20:28:04.325 INFO:tasks.workunit.client.1.smithi111.stdout:3/974: stat d2/d3 0 2023-12-08T20:28:04.325 INFO:tasks.workunit.client.1.smithi111.stdout:3/975: getdents d2/d3/d13/d36/d44/d8f/dac/d106 0 2023-12-08T20:28:04.326 INFO:tasks.workunit.client.1.smithi111.stdout:6/949: creat d0/f130 x:0 0 0 2023-12-08T20:28:04.327 INFO:tasks.workunit.client.1.smithi111.stdout:3/976: truncate d2/d15/d17/f94 709928 0 2023-12-08T20:28:04.327 INFO:tasks.workunit.client.1.smithi111.stdout:3/977: dread - d2/d3/d13/d36/d69/d70/f12b zero size 2023-12-08T20:28:04.328 INFO:tasks.workunit.client.1.smithi111.stdout:3/978: chown d2/d15/d17/d5e/l63 35612866 1 2023-12-08T20:28:04.331 INFO:tasks.workunit.client.1.smithi111.stdout:3/979: dread d2/d15/d17/d5e/fe6 [0,4194304] 0 2023-12-08T20:28:04.331 INFO:tasks.workunit.client.1.smithi111.stdout:3/980: stat d2/d3/d13/d36/d69/fb2 0 2023-12-08T20:28:04.333 INFO:tasks.workunit.client.1.smithi111.stdout:3/981: symlink d2/d15/d17/d5e/da6/de5/l137 0 2023-12-08T20:28:04.335 INFO:tasks.workunit.client.1.smithi111.stdout:3/982: getdents d2/d12/d4a/d5d/df5 0 2023-12-08T20:28:04.337 INFO:tasks.workunit.client.1.smithi111.stdout:3/983: unlink d2/d3/d13/d36/d69/d70/c4d 0 2023-12-08T20:28:04.337 INFO:tasks.workunit.client.1.smithi111.stdout:3/984: truncate d2/d3/d13/d36/d69/d70/fb8 4395352 0 2023-12-08T20:28:04.338 INFO:tasks.workunit.client.1.smithi111.stdout:3/985: mkdir d2/d138 0 2023-12-08T20:28:04.340 INFO:tasks.workunit.client.1.smithi111.stdout:3/986: unlink d2/d3/d13/d36/d69/f7d 0 2023-12-08T20:28:04.341 INFO:tasks.workunit.client.1.smithi111.stdout:3/987: creat d2/d3/d13/d36/d44/df4/d114/f139 x:0 0 0 2023-12-08T20:28:04.342 INFO:tasks.workunit.client.1.smithi111.stdout:3/988: read d2/d12/f65 [1378116,100764] 0 2023-12-08T20:28:04.344 INFO:tasks.workunit.client.1.smithi111.stdout:3/989: rename d2/c57 to d2/d3/d51/c13a 0 2023-12-08T20:28:04.344 INFO:tasks.workunit.client.1.smithi111.stdout:3/990: write d2/d12/f4b [7208293,110891] 0 2023-12-08T20:28:04.353 INFO:tasks.workunit.client.1.smithi111.stdout:3/991: dread d2/d3/d13/d36/d44/d8f/dac/fd7 [0,4194304] 0 2023-12-08T20:28:04.370 INFO:tasks.workunit.client.1.smithi111.stdout:3/992: dwrite d2/d12/f1a [0,4194304] 0 2023-12-08T20:28:04.371 INFO:tasks.workunit.client.1.smithi111.stdout:3/993: creat d2/d15/dcf/d111/f13b x:0 0 0 2023-12-08T20:28:04.371 INFO:tasks.workunit.client.1.smithi111.stdout:3/994: dread - d2/d3/d13/d36/d44/df4/d114/f139 zero size 2023-12-08T20:28:04.379 INFO:tasks.workunit.client.1.smithi111.stdout:3/995: dread d2/d12/d2e/dc6/d93/fe4 [0,4194304] 0 2023-12-08T20:28:04.379 INFO:tasks.workunit.client.1.smithi111.stdout:3/996: fdatasync d2/d15/dcf/d111/f13b 0 2023-12-08T20:28:04.379 INFO:tasks.workunit.client.1.smithi111.stdout:3/997: write d2/d3/d13/d36/fd0 [692749,52782] 0 2023-12-08T20:28:04.392 INFO:tasks.workunit.client.1.smithi111.stdout:3/998: dwrite d2/d3/d13/d36/d69/d81/fec [0,4194304] 0 2023-12-08T20:28:04.394 INFO:tasks.workunit.client.1.smithi111.stdout:3/999: creat d2/d15/d17/d12a/f13c x:0 0 0 2023-12-08T20:28:04.437 INFO:tasks.workunit.client.1.smithi111.stdout:6/950: sync 2023-12-08T20:28:04.437 INFO:tasks.workunit.client.1.smithi111.stdout:6/951: fdatasync d0/d68/d95/d7a/fe0 0 2023-12-08T20:28:04.437 INFO:tasks.workunit.client.1.smithi111.stdout:6/952: write d0/d68/d95/f1d [5149070,8271] 0 2023-12-08T20:28:04.439 INFO:tasks.workunit.client.1.smithi111.stdout:6/953: unlink d0/d1/d1e/db2/f60 0 2023-12-08T20:28:04.508 INFO:tasks.workunit.client.1.smithi111.stdout:6/954: sync 2023-12-08T20:28:04.509 INFO:tasks.workunit.client.1.smithi111.stdout:6/955: rename d0/d1/d27/da1/dca/l107 to d0/d68/d95/d7a/d113/d11c/l131 0 2023-12-08T20:28:04.511 INFO:tasks.workunit.client.1.smithi111.stdout:6/956: mkdir d0/d68/d132 0 2023-12-08T20:28:04.511 INFO:tasks.workunit.client.1.smithi111.stdout:6/957: getdents d0/d1/d27/d6e/df1 0 2023-12-08T20:28:04.511 INFO:tasks.workunit.client.1.smithi111.stdout:6/958: dread - d0/d1/d27/d36/d97/f11d zero size 2023-12-08T20:28:04.513 INFO:tasks.workunit.client.1.smithi111.stdout:6/959: unlink d0/d1/d27/d56/l93 0 2023-12-08T20:28:04.514 INFO:tasks.workunit.client.1.smithi111.stdout:6/960: rename d0/d68/c5e to d0/d1/c133 0 2023-12-08T20:28:04.515 INFO:tasks.workunit.client.1.smithi111.stdout:6/961: truncate d0/d1/d27/da1/fcb 2739390 0 2023-12-08T20:28:04.516 INFO:tasks.workunit.client.1.smithi111.stdout:6/962: mkdir d0/d1/d27/d36/d134 0 2023-12-08T20:28:04.517 INFO:tasks.workunit.client.1.smithi111.stdout:6/963: creat d0/d1/d1e/db2/da5/dfc/f135 x:0 0 0 2023-12-08T20:28:04.519 INFO:tasks.workunit.client.1.smithi111.stdout:6/964: mknod d0/d1/d27/d6e/d12a/c136 0 2023-12-08T20:28:04.521 INFO:tasks.workunit.client.1.smithi111.stdout:6/965: dread d0/d1/d1e/db2/f6f [0,4194304] 0 2023-12-08T20:28:04.521 INFO:tasks.workunit.client.1.smithi111.stdout:6/966: readlink d0/l91 0 2023-12-08T20:28:04.521 INFO:tasks.workunit.client.1.smithi111.stdout:6/967: chown d0/d1/d27/d56/l86 103970972 1 2023-12-08T20:28:04.522 INFO:tasks.workunit.client.1.smithi111.stdout:6/968: mkdir d0/d68/d95/d137 0 2023-12-08T20:28:04.522 INFO:tasks.workunit.client.1.smithi111.stdout:6/969: readlink d0/d68/d95/l6a 0 2023-12-08T20:28:04.522 INFO:tasks.workunit.client.1.smithi111.stdout:6/970: chown d0/l91 253164745 1 2023-12-08T20:28:04.524 INFO:tasks.workunit.client.1.smithi111.stdout:6/971: rename d0/d1/d27/d56/l86 to d0/d68/d95/d7a/d113/d11c/l138 0 2023-12-08T20:28:04.526 INFO:tasks.workunit.client.1.smithi111.stdout:6/972: creat d0/d1/d1e/f139 x:0 0 0 2023-12-08T20:28:04.527 INFO:tasks.workunit.client.1.smithi111.stdout:6/973: write d0/d1/d27/f5f [4320743,16249] 0 2023-12-08T20:28:04.528 INFO:tasks.workunit.client.1.smithi111.stdout:6/974: creat d0/d68/d95/d137/f13a x:0 0 0 2023-12-08T20:28:04.530 INFO:tasks.workunit.client.1.smithi111.stdout:6/975: creat d0/f13b x:0 0 0 2023-12-08T20:28:04.532 INFO:tasks.workunit.client.1.smithi111.stdout:6/976: creat d0/d1/d27/d36/d97/f13c x:0 0 0 2023-12-08T20:28:04.534 INFO:tasks.workunit.client.1.smithi111.stdout:6/977: creat d0/d1/d1e/db2/da5/dfc/f13d x:0 0 0 2023-12-08T20:28:04.542 INFO:tasks.workunit.client.1.smithi111.stdout:6/978: dread d0/d1/d27/d36/d8d/f9c [0,4194304] 0 2023-12-08T20:28:04.543 INFO:tasks.workunit.client.1.smithi111.stdout:6/979: chown d0/d1/d27/d56/ff3 68 1 2023-12-08T20:28:04.549 INFO:tasks.workunit.client.1.smithi111.stdout:6/980: dread d0/d68/f124 [0,4194304] 0 2023-12-08T20:28:04.549 INFO:tasks.workunit.client.1.smithi111.stdout:6/981: readlink d0/d1/d27/d36/d8d/lfa 0 2023-12-08T20:28:04.549 INFO:tasks.workunit.client.1.smithi111.stdout:6/982: fdatasync d0/d1/d27/d36/d97/db4/fff 0 2023-12-08T20:28:04.549 INFO:tasks.workunit.client.1.smithi111.stdout:6/983: chown d0/d1 438821494 1 2023-12-08T20:28:04.550 INFO:tasks.workunit.client.1.smithi111.stdout:6/984: mknod d0/daa/d123/c13e 0 2023-12-08T20:28:05.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:04 smithi043 ceph-mon[111966]: pgmap v23: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 95 MiB/s rd, 207 MiB/s wr, 626 op/s 2023-12-08T20:28:05.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:04 smithi111 ceph-mon[121341]: pgmap v23: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 95 MiB/s rd, 207 MiB/s wr, 626 op/s 2023-12-08T20:28:07.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:06 smithi043 ceph-mon[111966]: pgmap v24: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 119 MiB/s rd, 260 MiB/s wr, 732 op/s 2023-12-08T20:28:07.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:06 smithi111 ceph-mon[121341]: pgmap v24: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 119 MiB/s rd, 260 MiB/s wr, 732 op/s 2023-12-08T20:28:08.241 INFO:tasks.workunit.client.1.smithi111.stdout:6/985: sync 2023-12-08T20:28:08.247 INFO:tasks.workunit.client.1.smithi111.stdout:6/986: unlink d0/d1/d27/d56/f99 0 2023-12-08T20:28:08.264 INFO:tasks.workunit.client.1.smithi111.stdout:6/987: dwrite d0/d1/d27/d36/d8d/f12e [0,4194304] 0 2023-12-08T20:28:08.265 INFO:tasks.workunit.client.1.smithi111.stdout:6/988: write d0/d68/d95/f1d [882106,36083] 0 2023-12-08T20:28:08.280 INFO:tasks.workunit.client.1.smithi111.stdout:6/989: dwrite d0/d1/d1e/db2/f6f [0,4194304] 0 2023-12-08T20:28:08.280 INFO:tasks.workunit.client.1.smithi111.stdout:6/990: dread - d0/d68/d95/fe6 zero size 2023-12-08T20:28:08.287 INFO:tasks.workunit.client.1.smithi111.stdout:6/991: mkdir d0/d1/d27/d6e/d12a/d13f 0 2023-12-08T20:28:08.289 INFO:tasks.workunit.client.1.smithi111.stdout:6/992: creat d0/d1/d27/da1/f140 x:0 0 0 2023-12-08T20:28:08.292 INFO:tasks.workunit.client.1.smithi111.stdout:6/993: rename d0/d1/d27/da1/dca/df6/d10b to d0/daa/d141 0 2023-12-08T20:28:08.296 INFO:tasks.workunit.client.1.smithi111.stdout:6/994: creat d0/d1/d1e/db2/dd7/f142 x:0 0 0 2023-12-08T20:28:08.310 INFO:tasks.workunit.client.1.smithi111.stdout:6/995: dwrite d0/d1/d27/d36/d8d/f12e [0,4194304] 0 2023-12-08T20:28:08.312 INFO:tasks.workunit.client.1.smithi111.stdout:6/996: mknod d0/d1/c143 0 2023-12-08T20:28:08.316 INFO:tasks.workunit.client.1.smithi111.stdout:6/997: rmdir d0/d68/d95 39 2023-12-08T20:28:08.316 INFO:tasks.workunit.client.1.smithi111.stdout:6/998: mkdir d0/d1/d27/d56/d144 0 2023-12-08T20:28:08.319 INFO:tasks.workunit.client.1.smithi111.stdout:6/999: creat d0/d1/d27/f145 x:0 0 0 2023-12-08T20:28:08.326 INFO:tasks.workunit.client.1.smithi111.stderr:+ rm -rf -- ./tmp.okzX0mycpr 2023-12-08T20:28:08.914 INFO:tasks.workunit.client.0.smithi043.stdout:0/34: sync 2023-12-08T20:28:08.915 INFO:tasks.workunit.client.0.smithi043.stdout:3/45: sync 2023-12-08T20:28:08.915 INFO:tasks.workunit.client.0.smithi043.stdout:9/86: sync 2023-12-08T20:28:08.915 INFO:tasks.workunit.client.0.smithi043.stdout:0/35: chown d2 333738 1 2023-12-08T20:28:08.915 INFO:tasks.workunit.client.0.smithi043.stdout:1/26: sync 2023-12-08T20:28:08.915 INFO:tasks.workunit.client.0.smithi043.stdout:6/1: sync 2023-12-08T20:28:08.915 INFO:tasks.workunit.client.0.smithi043.stdout:2/18: sync 2023-12-08T20:28:08.915 INFO:tasks.workunit.client.0.smithi043.stdout:1/27: fdatasync d1/f2 0 2023-12-08T20:28:08.915 INFO:tasks.workunit.client.0.smithi043.stdout:1/28: stat d1/f2 0 2023-12-08T20:28:08.915 INFO:tasks.workunit.client.0.smithi043.stdout:3/46: write d1/d9/fd [31298,116716] 0 2023-12-08T20:28:08.916 INFO:tasks.workunit.client.0.smithi043.stdout:4/11: sync 2023-12-08T20:28:08.916 INFO:tasks.workunit.client.0.smithi043.stdout:8/39: sync 2023-12-08T20:28:08.916 INFO:tasks.workunit.client.0.smithi043.stdout:5/2: sync 2023-12-08T20:28:08.916 INFO:tasks.workunit.client.0.smithi043.stdout:5/3: dread - no filename 2023-12-08T20:28:08.916 INFO:tasks.workunit.client.0.smithi043.stdout:5/4: readlink - no filename 2023-12-08T20:28:08.916 INFO:tasks.workunit.client.0.smithi043.stdout:5/5: dread - no filename 2023-12-08T20:28:08.916 INFO:tasks.workunit.client.0.smithi043.stdout:5/6: write - no filename 2023-12-08T20:28:08.916 INFO:tasks.workunit.client.0.smithi043.stdout:5/7: stat - no entries 2023-12-08T20:28:08.916 INFO:tasks.workunit.client.0.smithi043.stdout:4/12: dread - f0 zero size 2023-12-08T20:28:08.916 INFO:tasks.workunit.client.0.smithi043.stdout:8/40: readlink d2/d4/l8 0 2023-12-08T20:28:08.916 INFO:tasks.workunit.client.0.smithi043.stdout:7/22: sync 2023-12-08T20:28:08.916 INFO:tasks.workunit.client.0.smithi043.stdout:4/13: write f0 [348526,44610] 0 2023-12-08T20:28:08.916 INFO:tasks.workunit.client.0.smithi043.stdout:4/14: write d1/f2 [260291,74410] 0 2023-12-08T20:28:08.916 INFO:tasks.workunit.client.0.smithi043.stdout:4/15: chown f0 131771885 1 2023-12-08T20:28:08.918 INFO:tasks.workunit.client.0.smithi043.stdout:2/19: dread d0/f1 [0,4194304] 0 2023-12-08T20:28:08.922 INFO:tasks.workunit.client.0.smithi043.stdout:4/16: dread f0 [0,4194304] 0 2023-12-08T20:28:08.927 INFO:tasks.workunit.client.0.smithi043.stdout:9/87: creat d0/f1c x:0 0 0 2023-12-08T20:28:08.927 INFO:tasks.workunit.client.0.smithi043.stdout:0/36: creat d2/d4/fd x:0 0 0 2023-12-08T20:28:08.927 INFO:tasks.workunit.client.0.smithi043.stdout:9/88: chown d0/f13 27483294 1 2023-12-08T20:28:08.927 INFO:tasks.workunit.client.0.smithi043.stdout:1/29: truncate d1/f2 95580 0 2023-12-08T20:28:08.927 INFO:tasks.workunit.client.0.smithi043.stdout:6/2: symlink d0/l1 0 2023-12-08T20:28:08.927 INFO:tasks.workunit.client.0.smithi043.stdout:8/41: rename d2/fa to d2/fc 0 2023-12-08T20:28:08.927 INFO:tasks.workunit.client.0.smithi043.stdout:5/8: creat f0 x:0 0 0 2023-12-08T20:28:08.928 INFO:tasks.workunit.client.0.smithi043.stdout:5/9: dread - f0 zero size 2023-12-08T20:28:08.928 INFO:tasks.workunit.client.0.smithi043.stdout:5/10: fdatasync f0 0 2023-12-08T20:28:08.928 INFO:tasks.workunit.client.0.smithi043.stdout:7/23: creat d0/d2/f5 x:0 0 0 2023-12-08T20:28:08.928 INFO:tasks.workunit.client.0.smithi043.stdout:1/30: write d1/f2 [627392,29718] 0 2023-12-08T20:28:08.928 INFO:tasks.workunit.client.0.smithi043.stdout:5/11: write f0 [922013,127512] 0 2023-12-08T20:28:08.928 INFO:tasks.workunit.client.0.smithi043.stdout:2/20: truncate d0/f1 55555 0 2023-12-08T20:28:08.928 INFO:tasks.workunit.client.0.smithi043.stdout:2/21: chown d0/f1 503736 1 2023-12-08T20:28:08.929 INFO:tasks.workunit.client.0.smithi043.stdout:0/37: creat d2/d4/fe x:0 0 0 2023-12-08T20:28:08.929 INFO:tasks.workunit.client.0.smithi043.stdout:9/89: creat d0/f1d x:0 0 0 2023-12-08T20:28:08.931 INFO:tasks.workunit.client.0.smithi043.stdout:6/3: mkdir d0/d2 0 2023-12-08T20:28:08.931 INFO:tasks.workunit.client.0.smithi043.stdout:6/4: getdents d0/d2 0 2023-12-08T20:28:08.931 INFO:tasks.workunit.client.0.smithi043.stdout:6/5: fsync - no filename 2023-12-08T20:28:08.931 INFO:tasks.workunit.client.0.smithi043.stdout:5/12: rename f0 to f1 0 2023-12-08T20:28:08.933 INFO:tasks.workunit.client.0.smithi043.stdout:2/22: unlink d0/f3 0 2023-12-08T20:28:08.933 INFO:tasks.workunit.client.0.smithi043.stdout:4/17: fsync d1/f2 0 2023-12-08T20:28:08.933 INFO:tasks.workunit.client.0.smithi043.stdout:4/18: fsync d1/f2 0 2023-12-08T20:28:08.934 INFO:tasks.workunit.client.0.smithi043.stdout:9/90: rename d0/fe to d0/f1e 0 2023-12-08T20:28:08.935 INFO:tasks.workunit.client.0.smithi043.stdout:0/38: creat d2/ff x:0 0 0 2023-12-08T20:28:08.938 INFO:tasks.workunit.client.0.smithi043.stdout:8/42: symlink d2/ld 0 2023-12-08T20:28:08.938 INFO:tasks.workunit.client.0.smithi043.stdout:5/13: creat f2 x:0 0 0 2023-12-08T20:28:08.938 INFO:tasks.workunit.client.0.smithi043.stdout:5/14: rmdir - no directory 2023-12-08T20:28:08.939 INFO:tasks.workunit.client.0.smithi043.stdout:6/6: mkdir d0/d2/d3 0 2023-12-08T20:28:08.939 INFO:tasks.workunit.client.0.smithi043.stdout:6/7: read - no filename 2023-12-08T20:28:08.939 INFO:tasks.workunit.client.0.smithi043.stdout:2/23: creat d0/f4 x:0 0 0 2023-12-08T20:28:08.940 INFO:tasks.workunit.client.0.smithi043.stdout:3/47: dwrite d1/d9/fe [0,4194304] 0 2023-12-08T20:28:08.940 INFO:tasks.workunit.client.0.smithi043.stdout:3/48: write d1/d9/fd [913802,111486] 0 2023-12-08T20:28:08.942 INFO:tasks.workunit.client.0.smithi043.stdout:8/43: read d2/fc [422430,25538] 0 2023-12-08T20:28:08.942 INFO:tasks.workunit.client.0.smithi043.stdout:8/44: chown d2/c6 780476 1 2023-12-08T20:28:08.948 INFO:tasks.workunit.client.0.smithi043.stdout:4/19: creat d1/f5 x:0 0 0 2023-12-08T20:28:08.948 INFO:tasks.workunit.client.0.smithi043.stdout:9/91: mknod d0/c1f 0 2023-12-08T20:28:08.949 INFO:tasks.workunit.client.0.smithi043.stdout:6/8: symlink d0/d2/d3/l4 0 2023-12-08T20:28:08.950 INFO:tasks.workunit.client.0.smithi043.stdout:2/24: creat d0/f5 x:0 0 0 2023-12-08T20:28:08.950 INFO:tasks.workunit.client.0.smithi043.stdout:2/25: fdatasync d0/f5 0 2023-12-08T20:28:08.950 INFO:tasks.workunit.client.0.smithi043.stdout:1/31: dread d1/f2 [0,4194304] 0 2023-12-08T20:28:08.950 INFO:tasks.workunit.client.0.smithi043.stdout:1/32: truncate d1/f2 1228116 0 2023-12-08T20:28:08.951 INFO:tasks.workunit.client.0.smithi043.stdout:7/24: dwrite d0/d2/f5 [0,4194304] 0 2023-12-08T20:28:08.952 INFO:tasks.workunit.client.0.smithi043.stdout:0/39: dwrite d2/d4/fd [0,4194304] 0 2023-12-08T20:28:08.952 INFO:tasks.workunit.client.0.smithi043.stdout:7/25: fsync d0/d2/f5 0 2023-12-08T20:28:08.955 INFO:tasks.workunit.client.0.smithi043.stdout:3/49: mkdir d1/d9/df 0 2023-12-08T20:28:08.961 INFO:tasks.workunit.client.0.smithi043.stdout:8/45: mkdir d2/de 0 2023-12-08T20:28:08.961 INFO:tasks.workunit.client.0.smithi043.stdout:8/46: write d2/d4/fb [480831,47052] 0 2023-12-08T20:28:08.961 INFO:tasks.workunit.client.0.smithi043.stdout:4/20: creat d1/f6 x:0 0 0 2023-12-08T20:28:08.962 INFO:tasks.workunit.client.0.smithi043.stdout:9/92: mknod d0/c20 0 2023-12-08T20:28:08.962 INFO:tasks.workunit.client.0.smithi043.stdout:9/93: write d0/f1c [847506,4274] 0 2023-12-08T20:28:08.963 INFO:tasks.workunit.client.0.smithi043.stdout:9/94: truncate d0/f10 5194811 0 2023-12-08T20:28:08.963 INFO:tasks.workunit.client.0.smithi043.stdout:9/95: read d0/f13 [1031208,41350] 0 2023-12-08T20:28:08.963 INFO:tasks.workunit.client.0.smithi043.stdout:6/9: mkdir d0/d2/d5 0 2023-12-08T20:28:08.966 INFO:tasks.workunit.client.0.smithi043.stdout:9/96: dread d0/f10 [4194304,4194304] 0 2023-12-08T20:28:08.966 INFO:tasks.workunit.client.0.smithi043.stdout:1/33: rmdir d1/d6 39 2023-12-08T20:28:08.968 INFO:tasks.workunit.client.0.smithi043.stdout:2/26: dwrite d0/f1 [0,4194304] 0 2023-12-08T20:28:08.970 INFO:tasks.workunit.client.0.smithi043.stdout:8/47: dread d2/f9 [0,4194304] 0 2023-12-08T20:28:08.975 INFO:tasks.workunit.client.0.smithi043.stdout:0/40: creat d2/d3/d6/f10 x:0 0 0 2023-12-08T20:28:08.976 INFO:tasks.workunit.client.0.smithi043.stdout:7/26: mkdir d0/d6 0 2023-12-08T20:28:08.977 INFO:tasks.workunit.client.0.smithi043.stdout:7/27: read d0/d2/f5 [736571,125122] 0 2023-12-08T20:28:08.977 INFO:tasks.workunit.client.0.smithi043.stdout:7/28: chown d0/d2 53 1 2023-12-08T20:28:08.977 INFO:tasks.workunit.client.0.smithi043.stdout:4/21: unlink f0 0 2023-12-08T20:28:08.978 INFO:tasks.workunit.client.0.smithi043.stdout:6/10: creat d0/d2/d3/f6 x:0 0 0 2023-12-08T20:28:08.978 INFO:tasks.workunit.client.0.smithi043.stdout:6/11: write d0/d2/d3/f6 [185110,25196] 0 2023-12-08T20:28:08.978 INFO:tasks.workunit.client.0.smithi043.stdout:6/12: stat d0/d2/d3/f6 0 2023-12-08T20:28:08.989 INFO:tasks.workunit.client.0.smithi043.stdout:4/22: dread d1/f2 [0,4194304] 0 2023-12-08T20:28:08.990 INFO:tasks.workunit.client.0.smithi043.stdout:6/13: mknod d0/d2/c7 0 2023-12-08T20:28:08.990 INFO:tasks.workunit.client.0.smithi043.stdout:1/34: creat d1/f8 x:0 0 0 2023-12-08T20:28:08.990 INFO:tasks.workunit.client.0.smithi043.stdout:2/27: symlink d0/l6 0 2023-12-08T20:28:08.992 INFO:tasks.workunit.client.0.smithi043.stdout:8/48: creat d2/de/ff x:0 0 0 2023-12-08T20:28:08.999 INFO:tasks.workunit.client.0.smithi043.stdout:0/41: dwrite d2/d3/fb [0,4194304] 0 2023-12-08T20:28:09.000 INFO:tasks.workunit.client.0.smithi043.stdout:4/23: mknod d1/c7 0 2023-12-08T20:28:09.001 INFO:tasks.workunit.client.0.smithi043.stdout:3/50: rename d1/c7 to d1/c10 0 2023-12-08T20:28:09.001 INFO:tasks.workunit.client.0.smithi043.stdout:6/14: mkdir d0/d2/d3/d8 0 2023-12-08T20:28:09.003 INFO:tasks.workunit.client.0.smithi043.stdout:1/35: creat d1/d6/f9 x:0 0 0 2023-12-08T20:28:09.003 INFO:tasks.workunit.client.0.smithi043.stdout:1/36: chown d1/f2 27598787 1 2023-12-08T20:28:09.003 INFO:tasks.workunit.client.0.smithi043.stdout:1/37: chown d1/d6 99094812 1 2023-12-08T20:28:09.003 INFO:tasks.workunit.client.0.smithi043.stdout:1/38: chown d1/d6/l7 24 1 2023-12-08T20:28:09.003 INFO:tasks.workunit.client.0.smithi043.stdout:3/51: read d1/d9/fe [4006549,102106] 0 2023-12-08T20:28:09.008 INFO:tasks.workunit.client.0.smithi043.stdout:2/28: mknod d0/c7 0 2023-12-08T20:28:09.009 INFO:tasks.workunit.client.0.smithi043.stdout:9/97: dwrite d0/f1e [0,4194304] 0 2023-12-08T20:28:09.009 INFO:tasks.workunit.client.0.smithi043.stdout:7/29: dwrite d0/d2/f5 [0,4194304] 0 2023-12-08T20:28:09.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:08 smithi043 ceph-mon[111966]: pgmap v25: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 71 MiB/s rd, 153 MiB/s wr, 580 op/s 2023-12-08T20:28:09.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:08 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:28:09.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:08 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:09.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:08 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:09.015 INFO:tasks.workunit.client.0.smithi043.stdout:6/15: creat d0/f9 x:0 0 0 2023-12-08T20:28:09.023 INFO:tasks.workunit.client.0.smithi043.stdout:7/30: symlink d0/d2/l7 0 2023-12-08T20:28:09.034 INFO:tasks.workunit.client.0.smithi043.stdout:4/24: rmdir d1 39 2023-12-08T20:28:09.034 INFO:tasks.workunit.client.0.smithi043.stdout:6/16: mkdir d0/d2/d3/d8/da 0 2023-12-08T20:28:09.036 INFO:tasks.workunit.client.0.smithi043.stdout:4/25: creat d1/f8 x:0 0 0 2023-12-08T20:28:09.036 INFO:tasks.workunit.client.0.smithi043.stdout:6/17: symlink d0/d2/lb 0 2023-12-08T20:28:09.037 INFO:tasks.workunit.client.0.smithi043.stdout:6/18: write d0/f9 [715684,29498] 0 2023-12-08T20:28:09.037 INFO:tasks.workunit.client.0.smithi043.stdout:4/26: mkdir d1/d9 0 2023-12-08T20:28:09.039 INFO:tasks.workunit.client.0.smithi043.stdout:6/19: rename d0/d2/d3/l4 to d0/d2/d3/lc 0 2023-12-08T20:28:09.046 INFO:tasks.workunit.client.0.smithi043.stdout:6/20: creat d0/d2/d5/fd x:0 0 0 2023-12-08T20:28:09.052 INFO:tasks.workunit.client.0.smithi043.stdout:6/21: mkdir d0/d2/de 0 2023-12-08T20:28:09.052 INFO:tasks.workunit.client.0.smithi043.stdout:6/22: read - d0/d2/d5/fd zero size 2023-12-08T20:28:09.053 INFO:tasks.workunit.client.0.smithi043.stdout:6/23: rename d0/d2/d3/f6 to d0/d2/d5/ff 0 2023-12-08T20:28:09.054 INFO:tasks.workunit.client.0.smithi043.stdout:0/42: dwrite d2/d3/d6/f10 [0,4194304] 0 2023-12-08T20:28:09.055 INFO:tasks.workunit.client.0.smithi043.stdout:6/24: link d0/l1 d0/d2/d3/d8/da/l10 0 2023-12-08T20:28:09.055 INFO:tasks.workunit.client.0.smithi043.stdout:6/25: chown d0/d2/d3/d8/da/l10 259386858 1 2023-12-08T20:28:09.056 INFO:tasks.workunit.client.0.smithi043.stdout:6/26: stat d0/d2/d3/d8/da/l10 0 2023-12-08T20:28:09.056 INFO:tasks.workunit.client.0.smithi043.stdout:6/27: truncate d0/d2/d5/ff 418068 0 2023-12-08T20:28:09.057 INFO:tasks.workunit.client.0.smithi043.stdout:6/28: mknod d0/d2/d3/c11 0 2023-12-08T20:28:09.062 INFO:tasks.workunit.client.0.smithi043.stdout:0/43: read d2/d3/fa [1009672,12581] 0 2023-12-08T20:28:09.066 INFO:tasks.workunit.client.0.smithi043.stdout:1/39: dwrite d1/f8 [0,4194304] 0 2023-12-08T20:28:09.067 INFO:tasks.workunit.client.0.smithi043.stdout:2/29: dwrite d0/f5 [0,4194304] 0 2023-12-08T20:28:09.067 INFO:tasks.workunit.client.0.smithi043.stdout:3/52: dwrite d1/d9/fe [0,4194304] 0 2023-12-08T20:28:09.067 INFO:tasks.workunit.client.0.smithi043.stdout:4/27: dwrite d1/f5 [0,4194304] 0 2023-12-08T20:28:09.069 INFO:tasks.workunit.client.0.smithi043.stdout:3/53: read d1/d9/fe [832141,62064] 0 2023-12-08T20:28:09.070 INFO:tasks.workunit.client.0.smithi043.stdout:4/28: dread d1/f2 [0,4194304] 0 2023-12-08T20:28:09.071 INFO:tasks.workunit.client.0.smithi043.stdout:3/54: dread d1/d9/fd [0,4194304] 0 2023-12-08T20:28:09.072 INFO:tasks.workunit.client.0.smithi043.stdout:8/49: truncate d2/d4/fb 318171 0 2023-12-08T20:28:09.081 INFO:tasks.workunit.client.0.smithi043.stdout:1/40: creat d1/d6/fa x:0 0 0 2023-12-08T20:28:09.082 INFO:tasks.workunit.client.0.smithi043.stdout:1/41: write d1/f2 [944193,18987] 0 2023-12-08T20:28:09.096 INFO:tasks.workunit.client.0.smithi043.stdout:4/29: dwrite d1/f5 [0,4194304] 0 2023-12-08T20:28:09.124 INFO:tasks.workunit.client.0.smithi043.stdout:2/30: rmdir d0 39 2023-12-08T20:28:09.124 INFO:tasks.workunit.client.0.smithi043.stdout:6/29: truncate d0/f9 125451 0 2023-12-08T20:28:09.124 INFO:tasks.workunit.client.0.smithi043.stdout:6/30: truncate d0/d2/d5/ff 598250 0 2023-12-08T20:28:09.124 INFO:tasks.workunit.client.0.smithi043.stdout:3/55: mknod d1/d9/df/c11 0 2023-12-08T20:28:09.124 INFO:tasks.workunit.client.0.smithi043.stdout:3/56: fdatasync d1/d9/fe 0 2023-12-08T20:28:09.124 INFO:tasks.workunit.client.0.smithi043.stdout:8/50: rename c1 to d2/c10 0 2023-12-08T20:28:09.125 INFO:tasks.workunit.client.0.smithi043.stdout:1/42: creat d1/fb x:0 0 0 2023-12-08T20:28:09.125 INFO:tasks.workunit.client.0.smithi043.stdout:8/51: write d2/fc [532151,77684] 0 2023-12-08T20:28:09.128 INFO:tasks.workunit.client.0.smithi043.stdout:2/31: unlink d0/c7 0 2023-12-08T20:28:09.128 INFO:tasks.workunit.client.0.smithi043.stdout:2/32: chown d0/l6 3460654 1 2023-12-08T20:28:09.133 INFO:tasks.workunit.client.0.smithi043.stdout:6/31: rmdir d0 39 2023-12-08T20:28:09.135 INFO:tasks.workunit.client.0.smithi043.stdout:6/32: rename d0/f9 to d0/d2/f12 0 2023-12-08T20:28:09.135 INFO:tasks.workunit.client.0.smithi043.stdout:6/33: chown d0/d2/d3/d8/da 15 1 2023-12-08T20:28:09.137 INFO:tasks.workunit.client.0.smithi043.stdout:3/57: write d1/d9/fe [2806981,28314] 0 2023-12-08T20:28:09.141 INFO:tasks.workunit.client.0.smithi043.stdout:3/58: getdents d1/d9 0 2023-12-08T20:28:09.145 INFO:tasks.workunit.client.0.smithi043.stdout:1/43: getdents d1 0 2023-12-08T20:28:09.147 INFO:tasks.workunit.client.0.smithi043.stdout:1/44: mkdir d1/dc 0 2023-12-08T20:28:09.148 INFO:tasks.workunit.client.0.smithi043.stdout:0/44: dwrite d2/d3/fa [0,4194304] 0 2023-12-08T20:28:09.149 INFO:tasks.workunit.client.0.smithi043.stdout:8/52: write d2/f3 [9323085,84280] 0 2023-12-08T20:28:09.150 INFO:tasks.workunit.client.0.smithi043.stdout:0/45: rmdir d2/d3 39 2023-12-08T20:28:09.150 INFO:tasks.workunit.client.0.smithi043.stdout:0/46: stat d2/d4/fd 0 2023-12-08T20:28:09.151 INFO:tasks.workunit.client.0.smithi043.stdout:0/47: truncate d2/d4/fe 796190 0 2023-12-08T20:28:09.152 INFO:tasks.workunit.client.0.smithi043.stdout:8/53: link d2/ld d2/d4/l11 0 2023-12-08T20:28:09.152 INFO:tasks.workunit.client.0.smithi043.stdout:0/48: symlink d2/d3/d6/l11 0 2023-12-08T20:28:09.153 INFO:tasks.workunit.client.0.smithi043.stdout:1/45: write d1/f8 [1081570,95094] 0 2023-12-08T20:28:09.153 INFO:tasks.workunit.client.0.smithi043.stdout:1/46: write d1/f8 [5208642,6776] 0 2023-12-08T20:28:09.153 INFO:tasks.workunit.client.0.smithi043.stdout:8/54: symlink d2/d4/l12 0 2023-12-08T20:28:09.154 INFO:tasks.workunit.client.0.smithi043.stdout:0/49: symlink d2/d4/l12 0 2023-12-08T20:28:09.155 INFO:tasks.workunit.client.0.smithi043.stdout:6/34: dwrite d0/d2/d5/fd [0,4194304] 0 2023-12-08T20:28:09.158 INFO:tasks.workunit.client.0.smithi043.stdout:6/35: write d0/d2/d5/fd [2786143,111206] 0 2023-12-08T20:28:09.158 INFO:tasks.workunit.client.0.smithi043.stdout:6/36: stat d0/d2/lb 0 2023-12-08T20:28:09.160 INFO:tasks.workunit.client.0.smithi043.stdout:6/37: fdatasync d0/d2/d5/fd 0 2023-12-08T20:28:09.165 INFO:tasks.workunit.client.0.smithi043.stdout:1/47: chown d1/d6/f9 2397 1 2023-12-08T20:28:09.166 INFO:tasks.workunit.client.0.smithi043.stdout:8/55: unlink d2/d4/l11 0 2023-12-08T20:28:09.166 INFO:tasks.workunit.client.0.smithi043.stdout:0/50: symlink d2/l13 0 2023-12-08T20:28:09.168 INFO:tasks.workunit.client.0.smithi043.stdout:3/59: dread d1/d9/fe [0,4194304] 0 2023-12-08T20:28:09.168 INFO:tasks.workunit.client.0.smithi043.stdout:6/38: mknod d0/c13 0 2023-12-08T20:28:09.168 INFO:tasks.workunit.client.0.smithi043.stdout:1/48: getdents d1/d6 0 2023-12-08T20:28:09.169 INFO:tasks.workunit.client.0.smithi043.stdout:1/49: chown d1/d6 20684 1 2023-12-08T20:28:09.172 INFO:tasks.workunit.client.0.smithi043.stdout:3/60: rmdir d1/d9 39 2023-12-08T20:28:09.172 INFO:tasks.workunit.client.0.smithi043.stdout:6/39: rename d0/d2/d3 to d0/d2/d14 0 2023-12-08T20:28:09.173 INFO:tasks.workunit.client.0.smithi043.stdout:1/50: write d1/f2 [1390138,100323] 0 2023-12-08T20:28:09.173 INFO:tasks.workunit.client.0.smithi043.stdout:3/61: rename d1/da to d1/da/d12 22 2023-12-08T20:28:09.177 INFO:tasks.workunit.client.0.smithi043.stdout:0/51: dread d2/d4/fd [0,4194304] 0 2023-12-08T20:28:09.177 INFO:tasks.workunit.client.0.smithi043.stdout:0/52: mknod d2/c14 0 2023-12-08T20:28:09.178 INFO:tasks.workunit.client.0.smithi043.stdout:0/53: truncate d2/d3/d6/f10 1407046 0 2023-12-08T20:28:09.182 INFO:tasks.workunit.client.0.smithi043.stdout:0/54: mkdir d2/d3/d15 0 2023-12-08T20:28:09.182 INFO:tasks.workunit.client.0.smithi043.stdout:0/55: write d2/d4/fe [66534,21824] 0 2023-12-08T20:28:09.182 INFO:tasks.workunit.client.0.smithi043.stdout:0/56: rename d2/d4 to d2/d4/d16 22 2023-12-08T20:28:09.182 INFO:tasks.workunit.client.0.smithi043.stdout:0/57: write d2/d4/fc [324615,42546] 0 2023-12-08T20:28:09.183 INFO:tasks.workunit.client.0.smithi043.stdout:0/58: rmdir d2/d4 39 2023-12-08T20:28:09.187 INFO:tasks.workunit.client.0.smithi043.stdout:0/59: mknod d2/c17 0 2023-12-08T20:28:09.187 INFO:tasks.workunit.client.0.smithi043.stdout:0/60: dread - d2/f8 zero size 2023-12-08T20:28:09.199 INFO:tasks.workunit.client.0.smithi043.stdout:3/62: dwrite d1/d9/fe [0,4194304] 0 2023-12-08T20:28:09.203 INFO:tasks.workunit.client.0.smithi043.stdout:3/63: mknod d1/d9/c13 0 2023-12-08T20:28:09.209 INFO:tasks.workunit.client.0.smithi043.stdout:1/51: dwrite d1/d6/f9 [0,4194304] 0 2023-12-08T20:28:09.209 INFO:tasks.workunit.client.0.smithi043.stdout:1/52: getdents d1/d6 0 2023-12-08T20:28:09.209 INFO:tasks.workunit.client.0.smithi043.stdout:0/61: dwrite d2/f7 [0,4194304] 0 2023-12-08T20:28:09.209 INFO:tasks.workunit.client.0.smithi043.stdout:0/62: fsync d2/f8 0 2023-12-08T20:28:09.212 INFO:tasks.workunit.client.0.smithi043.stdout:1/53: write d1/d6/f9 [381239,17617] 0 2023-12-08T20:28:09.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:08 smithi111 ceph-mon[121341]: pgmap v25: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 71 MiB/s rd, 153 MiB/s wr, 580 op/s 2023-12-08T20:28:09.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:08 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:28:09.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:08 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:09.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:08 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:09.217 INFO:tasks.workunit.client.0.smithi043.stdout:1/54: mknod d1/dc/cd 0 2023-12-08T20:28:09.217 INFO:tasks.workunit.client.0.smithi043.stdout:1/55: fdatasync d1/f2 0 2023-12-08T20:28:09.220 INFO:tasks.workunit.client.0.smithi043.stdout:1/56: chown d1/l5 25 1 2023-12-08T20:28:09.220 INFO:tasks.workunit.client.0.smithi043.stdout:1/57: fdatasync d1/fb 0 2023-12-08T20:28:09.222 INFO:tasks.workunit.client.0.smithi043.stdout:3/64: dwrite d1/d9/fd [0,4194304] 0 2023-12-08T20:28:09.231 INFO:tasks.workunit.client.0.smithi043.stdout:3/65: mknod d1/d9/df/c14 0 2023-12-08T20:28:09.232 INFO:tasks.workunit.client.0.smithi043.stdout:3/66: readlink d1/l6 0 2023-12-08T20:28:09.237 INFO:tasks.workunit.client.0.smithi043.stdout:0/63: dwrite d2/d3/d6/f10 [0,4194304] 0 2023-12-08T20:28:09.240 INFO:tasks.workunit.client.0.smithi043.stdout:0/64: mkdir d2/d3/d18 0 2023-12-08T20:28:09.247 INFO:tasks.workunit.client.0.smithi043.stdout:0/65: write d2/d3/fa [2924744,99480] 0 2023-12-08T20:28:09.248 INFO:tasks.workunit.client.0.smithi043.stdout:0/66: symlink d2/d3/d15/l19 0 2023-12-08T20:28:09.248 INFO:tasks.workunit.client.0.smithi043.stdout:0/67: chown d2/d3/fa 0 1 2023-12-08T20:28:09.248 INFO:tasks.workunit.client.0.smithi043.stdout:0/68: readlink d2/d3/d15/l19 0 2023-12-08T20:28:09.249 INFO:tasks.workunit.client.0.smithi043.stdout:0/69: truncate d2/d4/fc 211007 0 2023-12-08T20:28:09.251 INFO:tasks.workunit.client.0.smithi043.stdout:0/70: creat d2/d3/f1a x:0 0 0 2023-12-08T20:28:09.251 INFO:tasks.workunit.client.0.smithi043.stdout:0/71: chown d2/d3/c5 10463 1 2023-12-08T20:28:09.254 INFO:tasks.workunit.client.0.smithi043.stdout:3/67: dwrite d1/d9/fd [4194304,4194304] 0 2023-12-08T20:28:09.254 INFO:tasks.workunit.client.0.smithi043.stdout:3/68: chown d1/d9/fd 57 1 2023-12-08T20:28:09.254 INFO:tasks.workunit.client.0.smithi043.stdout:3/69: fsync d1/d9/fe 0 2023-12-08T20:28:09.264 INFO:tasks.workunit.client.0.smithi043.stdout:3/70: dread d1/d9/fe [0,4194304] 0 2023-12-08T20:28:09.266 INFO:tasks.workunit.client.0.smithi043.stdout:3/71: unlink d1/d9/df/c14 0 2023-12-08T20:28:09.268 INFO:tasks.workunit.client.0.smithi043.stdout:0/72: dwrite d2/f7 [0,4194304] 0 2023-12-08T20:28:09.268 INFO:tasks.workunit.client.0.smithi043.stdout:0/73: chown d2/d3 3 1 2023-12-08T20:28:09.268 INFO:tasks.workunit.client.0.smithi043.stdout:0/74: stat d2/d3/d6/l11 0 2023-12-08T20:28:09.268 INFO:tasks.workunit.client.0.smithi043.stdout:0/75: rename d2/d3 to d2/d3/d15/d1b 22 2023-12-08T20:28:09.268 INFO:tasks.workunit.client.0.smithi043.stdout:0/76: write d2/d4/fc [840290,6116] 0 2023-12-08T20:28:09.270 INFO:tasks.workunit.client.0.smithi043.stdout:0/77: mknod d2/d3/d18/c1c 0 2023-12-08T20:28:09.270 INFO:tasks.workunit.client.0.smithi043.stdout:0/78: fsync d2/d3/fb 0 2023-12-08T20:28:09.272 INFO:tasks.workunit.client.0.smithi043.stdout:3/72: dread d1/d9/fe [0,4194304] 0 2023-12-08T20:28:09.278 INFO:tasks.workunit.client.0.smithi043.stdout:3/73: truncate d1/d9/fd 5131436 0 2023-12-08T20:28:09.294 INFO:tasks.workunit.client.0.smithi043.stdout:3/74: dread d1/d9/fe [0,4194304] 0 2023-12-08T20:28:09.298 INFO:tasks.workunit.client.0.smithi043.stdout:3/75: creat d1/d9/df/f15 x:0 0 0 2023-12-08T20:28:09.298 INFO:tasks.workunit.client.0.smithi043.stdout:3/76: chown d1/d9/c13 23819 1 2023-12-08T20:28:09.721 INFO:tasks.workunit.client.0.smithi043.stdout:5/15: sync 2023-12-08T20:28:09.738 INFO:tasks.workunit.client.0.smithi043.stdout:5/16: dwrite f2 [0,4194304] 0 2023-12-08T20:28:09.738 INFO:tasks.workunit.client.0.smithi043.stdout:5/17: readlink - no filename 2023-12-08T20:28:09.738 INFO:tasks.workunit.client.0.smithi043.stdout:5/18: truncate f1 1604754 0 2023-12-08T20:28:09.739 INFO:tasks.workunit.client.0.smithi043.stdout:5/19: mkdir d3 0 2023-12-08T20:28:09.739 INFO:tasks.workunit.client.0.smithi043.stdout:5/20: chown d3 2493 1 2023-12-08T20:28:09.740 INFO:tasks.workunit.client.0.smithi043.stdout:5/21: mknod d3/c4 0 2023-12-08T20:28:09.756 INFO:tasks.workunit.client.0.smithi043.stdout:5/22: dwrite f1 [0,4194304] 0 2023-12-08T20:28:09.758 INFO:tasks.workunit.client.0.smithi043.stdout:5/23: symlink d3/l5 0 2023-12-08T20:28:09.780 INFO:tasks.workunit.client.0.smithi043.stdout:5/24: dread f2 [0,4194304] 0 2023-12-08T20:28:09.780 INFO:tasks.workunit.client.0.smithi043.stdout:5/25: readlink d3/l5 0 2023-12-08T20:28:09.780 INFO:tasks.workunit.client.0.smithi043.stdout:5/26: stat d3/l5 0 2023-12-08T20:28:09.780 INFO:tasks.workunit.client.0.smithi043.stdout:5/27: fdatasync f2 0 2023-12-08T20:28:09.798 INFO:tasks.workunit.client.0.smithi043.stdout:5/28: dwrite f2 [0,4194304] 0 2023-12-08T20:28:09.798 INFO:tasks.workunit.client.0.smithi043.stdout:5/29: rename d3/l5 to d3/l6 0 2023-12-08T20:28:09.799 INFO:tasks.workunit.client.0.smithi043.stdout:5/30: mkdir d3/d7 0 2023-12-08T20:28:09.800 INFO:tasks.workunit.client.0.smithi043.stdout:5/31: write f1 [972172,67156] 0 2023-12-08T20:28:09.812 INFO:tasks.workunit.client.0.smithi043.stdout:5/32: dread f1 [0,4194304] 0 2023-12-08T20:28:09.812 INFO:tasks.workunit.client.0.smithi043.stdout:5/33: chown d3/c4 7 1 2023-12-08T20:28:09.812 INFO:tasks.workunit.client.0.smithi043.stdout:5/34: fsync f2 0 2023-12-08T20:28:09.814 INFO:tasks.workunit.client.0.smithi043.stdout:5/35: write f1 [2740365,9980] 0 2023-12-08T20:28:09.815 INFO:tasks.workunit.client.0.smithi043.stdout:5/36: creat d3/f8 x:0 0 0 2023-12-08T20:28:09.817 INFO:tasks.workunit.client.0.smithi043.stdout:5/37: getdents d3 0 2023-12-08T20:28:09.818 INFO:tasks.workunit.client.0.smithi043.stdout:5/38: mknod d3/c9 0 2023-12-08T20:28:09.818 INFO:tasks.workunit.client.0.smithi043.stdout:5/39: chown d3 499634 1 2023-12-08T20:28:09.819 INFO:tasks.workunit.client.0.smithi043.stdout:5/40: mknod d3/ca 0 2023-12-08T20:28:09.820 INFO:tasks.workunit.client.0.smithi043.stdout:5/41: mknod d3/cb 0 2023-12-08T20:28:09.820 INFO:tasks.workunit.client.0.smithi043.stdout:5/42: rmdir d3 39 2023-12-08T20:28:09.822 INFO:tasks.workunit.client.0.smithi043.stdout:5/43: unlink d3/c9 0 2023-12-08T20:28:09.822 INFO:tasks.workunit.client.0.smithi043.stdout:5/44: dread - d3/f8 zero size 2023-12-08T20:28:09.822 INFO:tasks.workunit.client.0.smithi043.stdout:5/45: write d3/f8 [472931,24465] 0 2023-12-08T20:28:09.830 INFO:tasks.workunit.client.0.smithi043.stdout:5/46: creat d3/fc x:0 0 0 2023-12-08T20:28:09.832 INFO:tasks.workunit.client.0.smithi043.stdout:5/47: creat d3/d7/fd x:0 0 0 2023-12-08T20:28:09.832 INFO:tasks.workunit.client.0.smithi043.stdout:5/48: chown d3/c4 243 1 2023-12-08T20:28:09.833 INFO:tasks.workunit.client.0.smithi043.stdout:5/49: mkdir d3/d7/de 0 2023-12-08T20:28:09.834 INFO:tasks.workunit.client.0.smithi043.stdout:5/50: unlink d3/cb 0 2023-12-08T20:28:09.834 INFO:tasks.workunit.client.0.smithi043.stdout:5/51: fsync f2 0 2023-12-08T20:28:09.839 INFO:tasks.workunit.client.0.smithi043.stdout:5/52: rmdir d3 39 2023-12-08T20:28:09.840 INFO:tasks.workunit.client.0.smithi043.stdout:5/53: creat d3/d7/ff x:0 0 0 2023-12-08T20:28:09.841 INFO:tasks.workunit.client.0.smithi043.stdout:5/54: creat d3/d7/de/f10 x:0 0 0 2023-12-08T20:28:09.842 INFO:tasks.workunit.client.0.smithi043.stdout:5/55: symlink d3/d7/l11 0 2023-12-08T20:28:09.845 INFO:tasks.workunit.client.0.smithi043.stdout:5/56: rmdir d3/d7 39 2023-12-08T20:28:09.846 INFO:tasks.workunit.client.0.smithi043.stdout:5/57: mknod d3/d7/c12 0 2023-12-08T20:28:09.865 INFO:tasks.workunit.client.0.smithi043.stdout:5/58: dwrite d3/fc [0,4194304] 0 2023-12-08T20:28:09.867 INFO:tasks.workunit.client.0.smithi043.stdout:5/59: creat d3/d7/f13 x:0 0 0 2023-12-08T20:28:09.868 INFO:tasks.workunit.client.0.smithi043.stdout:5/60: write d3/f8 [1330079,123453] 0 2023-12-08T20:28:09.868 INFO:tasks.workunit.client.0.smithi043.stdout:5/61: stat d3/d7/l11 0 2023-12-08T20:28:09.868 INFO:tasks.workunit.client.0.smithi043.stdout:5/62: creat d3/d7/de/f14 x:0 0 0 2023-12-08T20:28:09.868 INFO:tasks.workunit.client.0.smithi043.stdout:5/63: fdatasync d3/fc 0 2023-12-08T20:28:09.869 INFO:tasks.workunit.client.0.smithi043.stdout:5/64: symlink d3/l15 0 2023-12-08T20:28:09.869 INFO:tasks.workunit.client.0.smithi043.stdout:5/65: truncate d3/d7/ff 452312 0 2023-12-08T20:28:09.870 INFO:tasks.workunit.client.0.smithi043.stdout:5/66: chown d3/d7/ff 2130980903 1 2023-12-08T20:28:09.890 INFO:tasks.workunit.client.0.smithi043.stdout:5/67: dwrite d3/d7/ff [0,4194304] 0 2023-12-08T20:28:09.896 INFO:tasks.workunit.client.0.smithi043.stdout:5/68: dread d3/f8 [0,4194304] 0 2023-12-08T20:28:09.896 INFO:tasks.workunit.client.0.smithi043.stdout:5/69: write d3/d7/f13 [489694,102542] 0 2023-12-08T20:28:09.896 INFO:tasks.workunit.client.0.smithi043.stdout:5/70: link d3/d7/l11 d3/d7/de/l16 0 2023-12-08T20:28:09.898 INFO:tasks.workunit.client.0.smithi043.stdout:5/71: unlink d3/l15 0 2023-12-08T20:28:09.902 INFO:tasks.workunit.client.0.smithi043.stdout:5/72: truncate d3/f8 407154 0 2023-12-08T20:28:09.903 INFO:tasks.workunit.client.0.smithi043.stdout:5/73: chown d3/d7/de 19634 1 2023-12-08T20:28:09.922 INFO:tasks.workunit.client.0.smithi043.stdout:5/74: dwrite f1 [0,4194304] 0 2023-12-08T20:28:09.935 INFO:tasks.workunit.client.0.smithi043.stdout:5/75: dread f2 [0,4194304] 0 2023-12-08T20:28:09.936 INFO:tasks.workunit.client.0.smithi043.stdout:5/76: fdatasync f2 0 2023-12-08T20:28:09.936 INFO:tasks.workunit.client.0.smithi043.stdout:5/77: chown d3/d7/ff 245 1 2023-12-08T20:28:09.936 INFO:tasks.workunit.client.0.smithi043.stdout:5/78: write d3/d7/fd [282504,51284] 0 2023-12-08T20:28:09.986 INFO:tasks.workunit.client.0.smithi043.stdout:5/79: dwrite d3/f8 [0,4194304] 0 2023-12-08T20:28:09.987 INFO:tasks.workunit.client.0.smithi043.stdout:9/98: sync 2023-12-08T20:28:09.987 INFO:tasks.workunit.client.0.smithi043.stdout:9/99: write d0/f14 [735883,68727] 0 2023-12-08T20:28:09.987 INFO:tasks.workunit.client.0.smithi043.stdout:9/100: dread - d0/f1b zero size 2023-12-08T20:28:09.989 INFO:tasks.workunit.client.0.smithi043.stdout:5/80: mkdir d3/d7/de/d17 0 2023-12-08T20:28:09.990 INFO:tasks.workunit.client.0.smithi043.stdout:9/101: mkdir d0/d21 0 2023-12-08T20:28:09.994 INFO:tasks.workunit.client.0.smithi043.stdout:9/102: rename d0/l1a to d0/d21/l22 0 2023-12-08T20:28:09.994 INFO:tasks.workunit.client.0.smithi043.stdout:9/103: chown d0/cc 130079 1 2023-12-08T20:28:10.002 INFO:tasks.workunit.client.0.smithi043.stdout:9/104: fdatasync d0/f14 0 2023-12-08T20:28:10.004 INFO:tasks.workunit.client.0.smithi043.stdout:9/105: creat d0/d21/f23 x:0 0 0 2023-12-08T20:28:10.004 INFO:tasks.workunit.client.0.smithi043.stdout:9/106: symlink d0/d21/l24 0 2023-12-08T20:28:10.006 INFO:tasks.workunit.client.0.smithi043.stdout:9/107: rename d0/f7 to d0/f25 0 2023-12-08T20:28:10.006 INFO:tasks.workunit.client.0.smithi043.stdout:9/108: truncate d0/d21/f23 62880 0 2023-12-08T20:28:10.006 INFO:tasks.workunit.client.0.smithi043.stdout:9/109: dread - d0/f1d zero size 2023-12-08T20:28:10.006 INFO:tasks.workunit.client.0.smithi043.stdout:9/110: creat d0/d21/f26 x:0 0 0 2023-12-08T20:28:10.009 INFO:tasks.workunit.client.0.smithi043.stdout:9/111: fdatasync d0/f1e 0 2023-12-08T20:28:10.010 INFO:tasks.workunit.client.0.smithi043.stdout:9/112: fsync d0/f16 0 2023-12-08T20:28:10.010 INFO:tasks.workunit.client.0.smithi043.stdout:9/113: truncate d0/f1c 287612 0 2023-12-08T20:28:10.010 INFO:tasks.workunit.client.0.smithi043.stdout:5/81: dwrite d3/d7/ff [0,4194304] 0 2023-12-08T20:28:10.010 INFO:tasks.workunit.client.0.smithi043.stdout:9/114: creat d0/f27 x:0 0 0 2023-12-08T20:28:10.012 INFO:tasks.workunit.client.0.smithi043.stdout:5/82: unlink d3/d7/de/f14 0 2023-12-08T20:28:10.012 INFO:tasks.workunit.client.0.smithi043.stdout:9/115: truncate d0/f10 2659241 0 2023-12-08T20:28:10.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:09 smithi043 ceph-mon[111966]: Reconfiguring prometheus.smithi043 (dependencies changed)... 2023-12-08T20:28:10.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:09 smithi043 ceph-mon[111966]: Reconfiguring daemon prometheus.smithi043 on smithi043 2023-12-08T20:28:10.015 INFO:tasks.workunit.client.0.smithi043.stdout:5/83: link f2 d3/d7/de/f18 0 2023-12-08T20:28:10.030 INFO:tasks.workunit.client.0.smithi043.stdout:9/116: dread d0/f10 [0,4194304] 0 2023-12-08T20:28:10.031 INFO:tasks.workunit.client.0.smithi043.stdout:9/117: read - d0/d21/f26 zero size 2023-12-08T20:28:10.054 INFO:tasks.workunit.client.0.smithi043.stdout:9/118: dwrite d0/f6 [0,4194304] 0 2023-12-08T20:28:10.055 INFO:tasks.workunit.client.0.smithi043.stdout:9/119: write d0/f1b [357026,9982] 0 2023-12-08T20:28:10.055 INFO:tasks.workunit.client.0.smithi043.stdout:9/120: chown d0/c19 1227 1 2023-12-08T20:28:10.056 INFO:tasks.workunit.client.0.smithi043.stdout:9/121: dread d0/f17 [0,4194304] 0 2023-12-08T20:28:10.056 INFO:tasks.workunit.client.0.smithi043.stdout:9/122: chown d0/f1d 31644256 1 2023-12-08T20:28:10.056 INFO:tasks.workunit.client.0.smithi043.stdout:9/123: write d0/f6 [5009984,50109] 0 2023-12-08T20:28:10.056 INFO:tasks.workunit.client.0.smithi043.stdout:9/124: write d0/f17 [227779,62231] 0 2023-12-08T20:28:10.057 INFO:tasks.workunit.client.0.smithi043.stdout:9/125: truncate d0/f1d 777824 0 2023-12-08T20:28:10.059 INFO:tasks.workunit.client.0.smithi043.stdout:9/126: unlink d0/ca 0 2023-12-08T20:28:10.066 INFO:tasks.workunit.client.0.smithi043.stdout:9/127: truncate d0/f1d 240156 0 2023-12-08T20:28:10.066 INFO:tasks.workunit.client.0.smithi043.stdout:9/128: write d0/f27 [848926,40965] 0 2023-12-08T20:28:10.069 INFO:tasks.workunit.client.0.smithi043.stdout:9/129: read d0/f10 [402218,95805] 0 2023-12-08T20:28:10.089 INFO:tasks.workunit.client.0.smithi043.stdout:9/130: dwrite d0/f6 [0,4194304] 0 2023-12-08T20:28:10.089 INFO:tasks.workunit.client.0.smithi043.stdout:9/131: chown d0/l18 1559 1 2023-12-08T20:28:10.090 INFO:tasks.workunit.client.0.smithi043.stdout:9/132: creat d0/d21/f28 x:0 0 0 2023-12-08T20:28:10.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:09 smithi111 ceph-mon[121341]: Reconfiguring prometheus.smithi043 (dependencies changed)... 2023-12-08T20:28:10.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:09 smithi111 ceph-mon[121341]: Reconfiguring daemon prometheus.smithi043 on smithi043 2023-12-08T20:28:10.342 INFO:tasks.workunit.client.0.smithi043.stdout:7/31: sync 2023-12-08T20:28:10.342 INFO:tasks.workunit.client.0.smithi043.stdout:7/32: chown d0/c4 5536068 1 2023-12-08T20:28:10.342 INFO:tasks.workunit.client.0.smithi043.stdout:7/33: truncate d0/d2/f5 4506847 0 2023-12-08T20:28:10.349 INFO:tasks.workunit.client.0.smithi043.stdout:7/34: dread d0/d2/f5 [0,4194304] 0 2023-12-08T20:28:10.817 INFO:tasks.workunit.client.0.smithi043.stdout:4/30: sync 2023-12-08T20:28:10.817 INFO:tasks.workunit.client.0.smithi043.stdout:4/31: readlink d1/l3 0 2023-12-08T20:28:10.817 INFO:tasks.workunit.client.0.smithi043.stdout:4/32: dread - d1/f6 zero size 2023-12-08T20:28:10.818 INFO:tasks.workunit.client.0.smithi043.stdout:4/33: chown d1/f5 23030 1 2023-12-08T20:28:10.818 INFO:tasks.workunit.client.0.smithi043.stdout:4/34: link d1/f6 d1/d9/fa 0 2023-12-08T20:28:10.819 INFO:tasks.workunit.client.0.smithi043.stdout:4/35: read - d1/f6 zero size 2023-12-08T20:28:10.821 INFO:tasks.workunit.client.0.smithi043.stdout:4/36: unlink d1/f8 0 2023-12-08T20:28:10.823 INFO:tasks.workunit.client.0.smithi043.stdout:4/37: unlink d1/l3 0 2023-12-08T20:28:10.823 INFO:tasks.workunit.client.0.smithi043.stdout:4/38: dread - d1/f6 zero size 2023-12-08T20:28:10.825 INFO:tasks.workunit.client.0.smithi043.stdout:4/39: creat d1/d9/fb x:0 0 0 2023-12-08T20:28:10.826 INFO:tasks.workunit.client.0.smithi043.stdout:4/40: mknod d1/d9/cc 0 2023-12-08T20:28:10.843 INFO:tasks.workunit.client.0.smithi043.stdout:4/41: dwrite d1/d9/fa [0,4194304] 0 2023-12-08T20:28:10.843 INFO:tasks.workunit.client.0.smithi043.stdout:4/42: write d1/f2 [1214475,48479] 0 2023-12-08T20:28:10.855 INFO:tasks.workunit.client.0.smithi043.stdout:4/43: dread d1/f5 [0,4194304] 0 2023-12-08T20:28:10.855 INFO:tasks.workunit.client.0.smithi043.stdout:4/44: dread - d1/d9/fb zero size 2023-12-08T20:28:10.856 INFO:tasks.workunit.client.0.smithi043.stdout:4/45: symlink d1/ld 0 2023-12-08T20:28:10.856 INFO:tasks.workunit.client.0.smithi043.stdout:4/46: chown d1/f2 248344 1 2023-12-08T20:28:10.857 INFO:tasks.workunit.client.0.smithi043.stdout:4/47: symlink d1/le 0 2023-12-08T20:28:10.858 INFO:tasks.workunit.client.0.smithi043.stdout:4/48: unlink d1/le 0 2023-12-08T20:28:10.858 INFO:tasks.workunit.client.0.smithi043.stdout:4/49: mknod d1/cf 0 2023-12-08T20:28:10.858 INFO:tasks.workunit.client.0.smithi043.stdout:4/50: truncate d1/d9/fb 591304 0 2023-12-08T20:28:10.859 INFO:tasks.workunit.client.0.smithi043.stdout:4/51: creat d1/f10 x:0 0 0 2023-12-08T20:28:10.860 INFO:tasks.workunit.client.0.smithi043.stdout:4/52: creat d1/f11 x:0 0 0 2023-12-08T20:28:10.860 INFO:tasks.workunit.client.0.smithi043.stdout:4/53: dread - d1/f10 zero size 2023-12-08T20:28:10.860 INFO:tasks.workunit.client.0.smithi043.stdout:4/54: creat d1/d9/f12 x:0 0 0 2023-12-08T20:28:10.860 INFO:tasks.workunit.client.0.smithi043.stdout:4/55: write d1/f2 [1537429,128674] 0 2023-12-08T20:28:10.862 INFO:tasks.workunit.client.0.smithi043.stdout:4/56: creat d1/d9/f13 x:0 0 0 2023-12-08T20:28:10.862 INFO:tasks.workunit.client.0.smithi043.stdout:4/57: fdatasync d1/f11 0 2023-12-08T20:28:10.862 INFO:tasks.workunit.client.0.smithi043.stdout:4/58: mkdir d1/d14 0 2023-12-08T20:28:10.863 INFO:tasks.workunit.client.0.smithi043.stdout:4/59: rename d1/d9/f13 to d1/d9/f15 0 2023-12-08T20:28:10.864 INFO:tasks.workunit.client.0.smithi043.stdout:4/60: rename d1/d9/f12 to d1/d9/f16 0 2023-12-08T20:28:10.871 INFO:tasks.workunit.client.0.smithi043.stdout:4/61: dread d1/d9/fa [0,4194304] 0 2023-12-08T20:28:10.883 INFO:tasks.workunit.client.0.smithi043.stdout:4/62: dwrite d1/f6 [0,4194304] 0 2023-12-08T20:28:10.884 INFO:tasks.workunit.client.0.smithi043.stdout:4/63: symlink d1/l17 0 2023-12-08T20:28:10.885 INFO:tasks.workunit.client.0.smithi043.stdout:4/64: creat d1/d14/f18 x:0 0 0 2023-12-08T20:28:10.885 INFO:tasks.workunit.client.0.smithi043.stdout:4/65: chown d1/d14/f18 276377431 1 2023-12-08T20:28:10.885 INFO:tasks.workunit.client.0.smithi043.stdout:4/66: dread - d1/f11 zero size 2023-12-08T20:28:10.893 INFO:tasks.workunit.client.0.smithi043.stdout:4/67: getdents d1/d9 0 2023-12-08T20:28:10.893 INFO:tasks.workunit.client.0.smithi043.stdout:4/68: stat d1/d14/f18 0 2023-12-08T20:28:10.894 INFO:tasks.workunit.client.0.smithi043.stdout:4/69: getdents d1 0 2023-12-08T20:28:10.894 INFO:tasks.workunit.client.0.smithi043.stdout:4/70: dread - d1/f10 zero size 2023-12-08T20:28:10.914 INFO:tasks.workunit.client.0.smithi043.stdout:4/71: dwrite d1/f2 [0,4194304] 0 2023-12-08T20:28:10.914 INFO:tasks.workunit.client.0.smithi043.stdout:4/72: fsync d1/d14/f18 0 2023-12-08T20:28:10.924 INFO:tasks.workunit.client.0.smithi043.stdout:4/73: dread d1/f2 [0,4194304] 0 2023-12-08T20:28:10.924 INFO:tasks.workunit.client.0.smithi043.stdout:4/74: creat d1/d14/f19 x:0 0 0 2023-12-08T20:28:10.924 INFO:tasks.workunit.client.0.smithi043.stdout:4/75: fdatasync d1/f11 0 2023-12-08T20:28:10.925 INFO:tasks.workunit.client.0.smithi043.stdout:4/76: creat d1/d14/f1a x:0 0 0 2023-12-08T20:28:10.929 INFO:tasks.workunit.client.0.smithi043.stdout:4/77: truncate d1/d9/fa 2445222 0 2023-12-08T20:28:10.930 INFO:tasks.workunit.client.0.smithi043.stdout:4/78: rmdir d1/d14 39 2023-12-08T20:28:10.930 INFO:tasks.workunit.client.0.smithi043.stdout:4/79: truncate d1/f10 904787 0 2023-12-08T20:28:10.930 INFO:tasks.workunit.client.0.smithi043.stdout:4/80: truncate d1/d14/f18 766804 0 2023-12-08T20:28:10.930 INFO:tasks.workunit.client.0.smithi043.stdout:4/81: creat d1/d9/f1b x:0 0 0 2023-12-08T20:28:10.946 INFO:tasks.workunit.client.0.smithi043.stdout:4/82: dwrite d1/d14/f19 [0,4194304] 0 2023-12-08T20:28:10.947 INFO:tasks.workunit.client.0.smithi043.stdout:4/83: dread d1/d14/f18 [0,4194304] 0 2023-12-08T20:28:10.948 INFO:tasks.workunit.client.0.smithi043.stdout:4/84: creat d1/f1c x:0 0 0 2023-12-08T20:28:10.948 INFO:tasks.workunit.client.0.smithi043.stdout:4/85: chown d1/c7 202278 1 2023-12-08T20:28:10.948 INFO:tasks.workunit.client.0.smithi043.stdout:4/86: fsync d1/d14/f1a 0 2023-12-08T20:28:10.952 INFO:tasks.workunit.client.0.smithi043.stdout:4/87: rename d1/d9 to d1/d14/d1d 0 2023-12-08T20:28:10.965 INFO:tasks.workunit.client.0.smithi043.stdout:4/88: dread d1/f5 [0,4194304] 0 2023-12-08T20:28:10.970 INFO:tasks.workunit.client.0.smithi043.stdout:4/89: rename d1/f2 to d1/d14/d1d/f1e 0 2023-12-08T20:28:10.974 INFO:tasks.workunit.client.0.smithi043.stdout:4/90: symlink d1/d14/l1f 0 2023-12-08T20:28:10.976 INFO:tasks.workunit.client.0.smithi043.stdout:4/91: symlink d1/d14/l20 0 2023-12-08T20:28:10.977 INFO:tasks.workunit.client.0.smithi043.stdout:4/92: write d1/d14/f18 [441343,112257] 0 2023-12-08T20:28:10.977 INFO:tasks.workunit.client.0.smithi043.stdout:4/93: dread - d1/f11 zero size 2023-12-08T20:28:10.977 INFO:tasks.workunit.client.0.smithi043.stdout:4/94: chown d1 21 1 2023-12-08T20:28:10.980 INFO:tasks.workunit.client.0.smithi043.stdout:4/95: mknod d1/d14/d1d/c21 0 2023-12-08T20:28:10.982 INFO:tasks.workunit.client.0.smithi043.stdout:4/96: creat d1/f22 x:0 0 0 2023-12-08T20:28:10.982 INFO:tasks.workunit.client.0.smithi043.stdout:1/58: sync 2023-12-08T20:28:10.986 INFO:tasks.workunit.client.0.smithi043.stdout:4/97: rename d1/d14/d1d/f15 to d1/f23 0 2023-12-08T20:28:10.986 INFO:tasks.workunit.client.0.smithi043.stdout:1/59: mknod d1/d6/ce 0 2023-12-08T20:28:10.989 INFO:tasks.workunit.client.0.smithi043.stdout:4/98: rename d1/d14/d1d/f1b to d1/d14/f24 0 2023-12-08T20:28:10.990 INFO:tasks.workunit.client.0.smithi043.stdout:1/60: chown d1/l4 68927502 1 2023-12-08T20:28:10.990 INFO:tasks.workunit.client.0.smithi043.stdout:4/99: mkdir d1/d14/d25 0 2023-12-08T20:28:10.991 INFO:tasks.workunit.client.0.smithi043.stdout:4/100: readlink d1/l17 0 2023-12-08T20:28:10.994 INFO:tasks.workunit.client.0.smithi043.stdout:4/101: write d1/d14/f19 [1004286,5139] 0 2023-12-08T20:28:10.995 INFO:tasks.workunit.client.0.smithi043.stdout:4/102: write d1/f11 [894087,316] 0 2023-12-08T20:28:10.995 INFO:tasks.workunit.client.0.smithi043.stdout:1/61: rename d1/l4 to d1/d6/lf 0 2023-12-08T20:28:10.995 INFO:tasks.workunit.client.0.smithi043.stdout:2/33: sync 2023-12-08T20:28:10.995 INFO:tasks.workunit.client.0.smithi043.stdout:2/34: dread - d0/f4 zero size 2023-12-08T20:28:10.995 INFO:tasks.workunit.client.0.smithi043.stdout:2/35: truncate d0/f1 5174765 0 2023-12-08T20:28:10.997 INFO:tasks.workunit.client.0.smithi043.stdout:8/56: sync 2023-12-08T20:28:10.997 INFO:tasks.workunit.client.0.smithi043.stdout:6/40: sync 2023-12-08T20:28:10.999 INFO:tasks.workunit.client.0.smithi043.stdout:1/62: mknod d1/d6/c10 0 2023-12-08T20:28:10.999 INFO:tasks.workunit.client.0.smithi043.stdout:4/103: creat d1/d14/f26 x:0 0 0 2023-12-08T20:28:10.999 INFO:tasks.workunit.client.0.smithi043.stdout:4/104: dread - d1/f23 zero size 2023-12-08T20:28:11.001 INFO:tasks.workunit.client.0.smithi043.stdout:0/79: sync 2023-12-08T20:28:11.001 INFO:tasks.workunit.client.0.smithi043.stdout:0/80: chown d2/d4/fd 2059574970 1 2023-12-08T20:28:11.001 INFO:tasks.workunit.client.0.smithi043.stdout:3/77: sync 2023-12-08T20:28:11.001 INFO:tasks.workunit.client.0.smithi043.stdout:0/81: write d2/ff [516757,6466] 0 2023-12-08T20:28:11.001 INFO:tasks.workunit.client.0.smithi043.stdout:0/82: readlink d2/d4/l12 0 2023-12-08T20:28:11.001 INFO:tasks.workunit.client.0.smithi043.stdout:0/83: fdatasync d2/d3/f1a 0 2023-12-08T20:28:11.001 INFO:tasks.workunit.client.0.smithi043.stdout:0/84: read - d2/d3/f1a zero size 2023-12-08T20:28:11.001 INFO:tasks.workunit.client.0.smithi043.stdout:9/133: sync 2023-12-08T20:28:11.002 INFO:tasks.workunit.client.0.smithi043.stdout:5/84: sync 2023-12-08T20:28:11.002 INFO:tasks.workunit.client.0.smithi043.stdout:7/35: sync 2023-12-08T20:28:11.002 INFO:tasks.workunit.client.0.smithi043.stdout:7/36: fsync d0/d2/f5 0 2023-12-08T20:28:11.002 INFO:tasks.workunit.client.0.smithi043.stdout:8/57: creat d2/de/f13 x:0 0 0 2023-12-08T20:28:11.002 INFO:tasks.workunit.client.0.smithi043.stdout:8/58: chown d2/f3 24313 1 2023-12-08T20:28:11.002 INFO:tasks.workunit.client.0.smithi043.stdout:6/41: mknod d0/c15 0 2023-12-08T20:28:11.003 INFO:tasks.workunit.client.0.smithi043.stdout:4/105: symlink d1/l27 0 2023-12-08T20:28:11.003 INFO:tasks.workunit.client.0.smithi043.stdout:3/78: truncate d1/d9/fe 76164 0 2023-12-08T20:28:11.003 INFO:tasks.workunit.client.0.smithi043.stdout:4/106: chown d1/d14/f1a 2550 1 2023-12-08T20:28:11.004 INFO:tasks.workunit.client.0.smithi043.stdout:5/85: mkdir d3/d7/d19 0 2023-12-08T20:28:11.004 INFO:tasks.workunit.client.0.smithi043.stdout:5/86: write d3/d7/de/f10 [186883,8280] 0 2023-12-08T20:28:11.004 INFO:tasks.workunit.client.0.smithi043.stdout:7/37: mkdir d0/d6/d8 0 2023-12-08T20:28:11.005 INFO:tasks.workunit.client.0.smithi043.stdout:8/59: creat d2/de/f14 x:0 0 0 2023-12-08T20:28:11.005 INFO:tasks.workunit.client.0.smithi043.stdout:8/60: chown d2/d4/fb 18 1 2023-12-08T20:28:11.005 INFO:tasks.workunit.client.0.smithi043.stdout:8/61: dread - d2/de/ff zero size 2023-12-08T20:28:11.007 INFO:tasks.workunit.client.0.smithi043.stdout:8/62: write d2/f9 [2660010,84249] 0 2023-12-08T20:28:11.008 INFO:tasks.workunit.client.0.smithi043.stdout:6/42: unlink d0/d2/d5/fd 0 2023-12-08T20:28:11.008 INFO:tasks.workunit.client.0.smithi043.stdout:5/87: write d3/fc [941728,54233] 0 2023-12-08T20:28:11.008 INFO:tasks.workunit.client.0.smithi043.stdout:3/79: rmdir d1/d9/df 39 2023-12-08T20:28:11.008 INFO:tasks.workunit.client.0.smithi043.stdout:1/63: symlink d1/l11 0 2023-12-08T20:28:11.010 INFO:tasks.workunit.client.0.smithi043.stdout:4/107: mkdir d1/d14/d25/d28 0 2023-12-08T20:28:11.011 INFO:tasks.workunit.client.0.smithi043.stdout:6/43: dread d0/d2/d5/ff [0,4194304] 0 2023-12-08T20:28:11.011 INFO:tasks.workunit.client.0.smithi043.stdout:7/38: creat d0/d6/d8/f9 x:0 0 0 2023-12-08T20:28:11.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:10 smithi043 ceph-mon[111966]: pgmap v26: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 71 MiB/s rd, 153 MiB/s wr, 580 op/s 2023-12-08T20:28:11.013 INFO:tasks.workunit.client.0.smithi043.stdout:3/80: chown d1/l2 0 1 2023-12-08T20:28:11.015 INFO:tasks.workunit.client.0.smithi043.stdout:5/88: creat d3/d7/f1a x:0 0 0 2023-12-08T20:28:11.016 INFO:tasks.workunit.client.0.smithi043.stdout:4/108: creat d1/d14/d25/f29 x:0 0 0 2023-12-08T20:28:11.016 INFO:tasks.workunit.client.0.smithi043.stdout:1/64: getdents d1/dc 0 2023-12-08T20:28:11.016 INFO:tasks.workunit.client.0.smithi043.stdout:0/85: dread d2/d3/d6/f10 [0,4194304] 0 2023-12-08T20:28:11.016 INFO:tasks.workunit.client.0.smithi043.stdout:0/86: fsync d2/d4/fd 0 2023-12-08T20:28:11.016 INFO:tasks.workunit.client.0.smithi043.stdout:0/87: dread - d2/d3/f1a zero size 2023-12-08T20:28:11.017 INFO:tasks.workunit.client.0.smithi043.stdout:6/44: link d0/c15 d0/d2/d14/d8/c16 0 2023-12-08T20:28:11.018 INFO:tasks.workunit.client.0.smithi043.stdout:9/134: write d0/f27 [632495,75600] 0 2023-12-08T20:28:11.018 INFO:tasks.workunit.client.0.smithi043.stdout:9/135: stat d0/f1b 0 2023-12-08T20:28:11.018 INFO:tasks.workunit.client.0.smithi043.stdout:9/136: fsync d0/f14 0 2023-12-08T20:28:11.018 INFO:tasks.workunit.client.0.smithi043.stdout:9/137: write d0/f17 [256888,104226] 0 2023-12-08T20:28:11.018 INFO:tasks.workunit.client.0.smithi043.stdout:2/36: dwrite d0/f1 [0,4194304] 0 2023-12-08T20:28:11.018 INFO:tasks.workunit.client.0.smithi043.stdout:2/37: write d0/f5 [4814370,126993] 0 2023-12-08T20:28:11.020 INFO:tasks.workunit.client.0.smithi043.stdout:7/39: rmdir d0/d6 39 2023-12-08T20:28:11.022 INFO:tasks.workunit.client.0.smithi043.stdout:9/138: dread d0/f10 [0,4194304] 0 2023-12-08T20:28:11.022 INFO:tasks.workunit.client.0.smithi043.stdout:3/81: rename d1/d9/c13 to d1/da/c16 0 2023-12-08T20:28:11.022 INFO:tasks.workunit.client.0.smithi043.stdout:3/82: chown d1/l2 1551182 1 2023-12-08T20:28:11.022 INFO:tasks.workunit.client.0.smithi043.stdout:4/109: mknod d1/d14/d25/d28/c2a 0 2023-12-08T20:28:11.024 INFO:tasks.workunit.client.0.smithi043.stdout:1/65: symlink d1/dc/l12 0 2023-12-08T20:28:11.026 INFO:tasks.workunit.client.0.smithi043.stdout:6/45: link d0/c13 d0/d2/de/c17 0 2023-12-08T20:28:11.028 INFO:tasks.workunit.client.0.smithi043.stdout:7/40: getdents d0/d2 0 2023-12-08T20:28:11.028 INFO:tasks.workunit.client.0.smithi043.stdout:7/41: chown d0/d2/f5 148 1 2023-12-08T20:28:11.028 INFO:tasks.workunit.client.0.smithi043.stdout:2/38: mknod d0/c8 0 2023-12-08T20:28:11.031 INFO:tasks.workunit.client.0.smithi043.stdout:9/139: creat d0/f29 x:0 0 0 2023-12-08T20:28:11.031 INFO:tasks.workunit.client.0.smithi043.stdout:9/140: truncate d0/f16 142544 0 2023-12-08T20:28:11.033 INFO:tasks.workunit.client.0.smithi043.stdout:3/83: creat d1/d9/df/f17 x:0 0 0 2023-12-08T20:28:11.033 INFO:tasks.workunit.client.0.smithi043.stdout:3/84: write d1/d9/df/f17 [415752,106467] 0 2023-12-08T20:28:11.034 INFO:tasks.workunit.client.0.smithi043.stdout:6/46: creat d0/d2/d14/f18 x:0 0 0 2023-12-08T20:28:11.034 INFO:tasks.workunit.client.0.smithi043.stdout:6/47: chown d0/d2/d14 342749751 1 2023-12-08T20:28:11.039 INFO:tasks.workunit.client.0.smithi043.stdout:3/85: creat d1/f18 x:0 0 0 2023-12-08T20:28:11.039 INFO:tasks.workunit.client.0.smithi043.stdout:6/48: creat d0/d2/d14/d8/da/f19 x:0 0 0 2023-12-08T20:28:11.039 INFO:tasks.workunit.client.0.smithi043.stdout:6/49: chown d0/c13 1552958363 1 2023-12-08T20:28:11.041 INFO:tasks.workunit.client.0.smithi043.stdout:2/39: read d0/f1 [1388272,106757] 0 2023-12-08T20:28:11.041 INFO:tasks.workunit.client.0.smithi043.stdout:6/50: link d0/c15 d0/d2/d14/d8/c1a 0 2023-12-08T20:28:11.042 INFO:tasks.workunit.client.0.smithi043.stdout:4/110: dwrite d1/d14/f1a [0,4194304] 0 2023-12-08T20:28:11.042 INFO:tasks.workunit.client.0.smithi043.stdout:4/111: dread - d1/d14/f26 zero size 2023-12-08T20:28:11.046 INFO:tasks.workunit.client.0.smithi043.stdout:3/86: dread d1/d9/fe [0,4194304] 0 2023-12-08T20:28:11.050 INFO:tasks.workunit.client.0.smithi043.stdout:5/89: dwrite d3/f8 [0,4194304] 0 2023-12-08T20:28:11.050 INFO:tasks.workunit.client.0.smithi043.stdout:5/90: stat d3/fc 0 2023-12-08T20:28:11.050 INFO:tasks.workunit.client.0.smithi043.stdout:3/87: link d1/d9/fd d1/d9/f19 0 2023-12-08T20:28:11.051 INFO:tasks.workunit.client.0.smithi043.stdout:3/88: creat d1/d9/f1a x:0 0 0 2023-12-08T20:28:11.056 INFO:tasks.workunit.client.0.smithi043.stdout:8/63: dwrite d2/de/f14 [0,4194304] 0 2023-12-08T20:28:11.056 INFO:tasks.workunit.client.0.smithi043.stdout:0/88: dread d2/ff [0,4194304] 0 2023-12-08T20:28:11.057 INFO:tasks.workunit.client.0.smithi043.stdout:8/64: symlink d2/d4/l15 0 2023-12-08T20:28:11.057 INFO:tasks.workunit.client.0.smithi043.stdout:7/42: rmdir d0/d6/d8 39 2023-12-08T20:28:11.057 INFO:tasks.workunit.client.0.smithi043.stdout:7/43: chown d0/d2/f5 43 1 2023-12-08T20:28:11.057 INFO:tasks.workunit.client.0.smithi043.stdout:2/40: dread d0/f1 [0,4194304] 0 2023-12-08T20:28:11.058 INFO:tasks.workunit.client.0.smithi043.stdout:8/65: rename d2/d4/l8 to d2/de/l16 0 2023-12-08T20:28:11.063 INFO:tasks.workunit.client.0.smithi043.stdout:8/66: mknod d2/de/c17 0 2023-12-08T20:28:11.063 INFO:tasks.workunit.client.0.smithi043.stdout:8/67: stat d2/d4 0 2023-12-08T20:28:11.063 INFO:tasks.workunit.client.0.smithi043.stdout:8/68: chown d2/fc 0 1 2023-12-08T20:28:11.063 INFO:tasks.workunit.client.0.smithi043.stdout:7/44: mknod d0/d2/ca 0 2023-12-08T20:28:11.063 INFO:tasks.workunit.client.0.smithi043.stdout:4/112: rmdir d1/d14 39 2023-12-08T20:28:11.063 INFO:tasks.workunit.client.0.smithi043.stdout:3/89: dread d1/d9/f19 [0,4194304] 0 2023-12-08T20:28:11.063 INFO:tasks.workunit.client.0.smithi043.stdout:4/113: truncate d1/d14/d1d/f16 949660 0 2023-12-08T20:28:11.063 INFO:tasks.workunit.client.0.smithi043.stdout:4/114: dread - d1/d14/d25/f29 zero size 2023-12-08T20:28:11.064 INFO:tasks.workunit.client.0.smithi043.stdout:8/69: mkdir d2/d18 0 2023-12-08T20:28:11.065 INFO:tasks.workunit.client.0.smithi043.stdout:1/66: dwrite d1/fb [0,4194304] 0 2023-12-08T20:28:11.065 INFO:tasks.workunit.client.0.smithi043.stdout:7/45: write d0/d2/f5 [4277818,30835] 0 2023-12-08T20:28:11.065 INFO:tasks.workunit.client.0.smithi043.stdout:4/115: creat d1/d14/d25/d28/f2b x:0 0 0 2023-12-08T20:28:11.066 INFO:tasks.workunit.client.0.smithi043.stdout:6/51: dwrite d0/d2/d5/ff [0,4194304] 0 2023-12-08T20:28:11.069 INFO:tasks.workunit.client.0.smithi043.stdout:7/46: creat d0/fb x:0 0 0 2023-12-08T20:28:11.069 INFO:tasks.workunit.client.0.smithi043.stdout:7/47: write d0/d2/f5 [4902487,89403] 0 2023-12-08T20:28:11.071 INFO:tasks.workunit.client.0.smithi043.stdout:3/90: write d1/d9/fd [1844101,32515] 0 2023-12-08T20:28:11.072 INFO:tasks.workunit.client.0.smithi043.stdout:2/41: dread d0/f5 [4194304,4194304] 0 2023-12-08T20:28:11.072 INFO:tasks.workunit.client.0.smithi043.stdout:2/42: chown d0/f4 74689 1 2023-12-08T20:28:11.072 INFO:tasks.workunit.client.0.smithi043.stdout:2/43: stat d0/c8 0 2023-12-08T20:28:11.072 INFO:tasks.workunit.client.0.smithi043.stdout:7/48: creat d0/d2/fc x:0 0 0 2023-12-08T20:28:11.074 INFO:tasks.workunit.client.0.smithi043.stdout:3/91: creat d1/da/f1b x:0 0 0 2023-12-08T20:28:11.074 INFO:tasks.workunit.client.0.smithi043.stdout:3/92: dread - d1/d9/df/f15 zero size 2023-12-08T20:28:11.077 INFO:tasks.workunit.client.0.smithi043.stdout:5/91: dread d3/fc [0,4194304] 0 2023-12-08T20:28:11.077 INFO:tasks.workunit.client.0.smithi043.stdout:5/92: write d3/d7/ff [4627228,77476] 0 2023-12-08T20:28:11.078 INFO:tasks.workunit.client.0.smithi043.stdout:0/89: dwrite d2/d4/fd [0,4194304] 0 2023-12-08T20:28:11.080 INFO:tasks.workunit.client.0.smithi043.stdout:2/44: getdents d0 0 2023-12-08T20:28:11.080 INFO:tasks.workunit.client.0.smithi043.stdout:2/45: chown d0/f4 18191709 1 2023-12-08T20:28:11.080 INFO:tasks.workunit.client.0.smithi043.stdout:9/141: dwrite d0/d21/f26 [0,4194304] 0 2023-12-08T20:28:11.080 INFO:tasks.workunit.client.0.smithi043.stdout:9/142: readlink d0/l18 0 2023-12-08T20:28:11.081 INFO:tasks.workunit.client.0.smithi043.stdout:2/46: read d0/f1 [335858,63605] 0 2023-12-08T20:28:11.081 INFO:tasks.workunit.client.0.smithi043.stdout:0/90: getdents d2/d3/d6 0 2023-12-08T20:28:11.081 INFO:tasks.workunit.client.0.smithi043.stdout:9/143: read d0/d21/f23 [44692,39836] 0 2023-12-08T20:28:11.082 INFO:tasks.workunit.client.0.smithi043.stdout:9/144: chown d0/f1d 57286 1 2023-12-08T20:28:11.085 INFO:tasks.workunit.client.0.smithi043.stdout:2/47: rename d0/f1 to d0/f9 0 2023-12-08T20:28:11.086 INFO:tasks.workunit.client.0.smithi043.stdout:9/145: dread d0/f10 [0,4194304] 0 2023-12-08T20:28:11.089 INFO:tasks.workunit.client.0.smithi043.stdout:9/146: rmdir d0 39 2023-12-08T20:28:11.089 INFO:tasks.workunit.client.0.smithi043.stdout:9/147: chown d0/f1b 209 1 2023-12-08T20:28:11.089 INFO:tasks.workunit.client.0.smithi043.stdout:9/148: rename d0/d21 to d0/d21/d2a 22 2023-12-08T20:28:11.089 INFO:tasks.workunit.client.0.smithi043.stdout:9/149: fdatasync d0/f14 0 2023-12-08T20:28:11.089 INFO:tasks.workunit.client.0.smithi043.stdout:9/150: chown d0/f6 16338 1 2023-12-08T20:28:11.093 INFO:tasks.workunit.client.0.smithi043.stdout:9/151: mknod d0/c2b 0 2023-12-08T20:28:11.096 INFO:tasks.workunit.client.0.smithi043.stdout:7/49: fsync d0/fb 0 2023-12-08T20:28:11.104 INFO:tasks.workunit.client.0.smithi043.stdout:7/50: symlink d0/d2/ld 0 2023-12-08T20:28:11.104 INFO:tasks.workunit.client.0.smithi043.stdout:7/51: symlink d0/d6/d8/le 0 2023-12-08T20:28:11.104 INFO:tasks.workunit.client.0.smithi043.stdout:7/52: symlink d0/lf 0 2023-12-08T20:28:11.111 INFO:tasks.workunit.client.0.smithi043.stdout:4/116: dwrite d1/f5 [0,4194304] 0 2023-12-08T20:28:11.113 INFO:tasks.workunit.client.0.smithi043.stdout:2/48: truncate d0/f9 696564 0 2023-12-08T20:28:11.113 INFO:tasks.workunit.client.0.smithi043.stdout:6/52: dwrite d0/d2/d14/f18 [0,4194304] 0 2023-12-08T20:28:11.119 INFO:tasks.workunit.client.0.smithi043.stdout:6/53: getdents d0/d2/d14/d8/da 0 2023-12-08T20:28:11.120 INFO:tasks.workunit.client.0.smithi043.stdout:8/70: dwrite d2/fc [0,4194304] 0 2023-12-08T20:28:11.120 INFO:tasks.workunit.client.0.smithi043.stdout:0/91: dwrite d2/f7 [0,4194304] 0 2023-12-08T20:28:11.120 INFO:tasks.workunit.client.0.smithi043.stdout:5/93: dwrite f2 [0,4194304] 0 2023-12-08T20:28:11.121 INFO:tasks.workunit.client.0.smithi043.stdout:6/54: rmdir d0/d2 39 2023-12-08T20:28:11.121 INFO:tasks.workunit.client.0.smithi043.stdout:6/55: stat d0 0 2023-12-08T20:28:11.123 INFO:tasks.workunit.client.0.smithi043.stdout:8/71: unlink d2/d4/l12 0 2023-12-08T20:28:11.123 INFO:tasks.workunit.client.0.smithi043.stdout:8/72: chown d2/de/l16 1752052 1 2023-12-08T20:28:11.123 INFO:tasks.workunit.client.0.smithi043.stdout:8/73: readlink d2/ld 0 2023-12-08T20:28:11.125 INFO:tasks.workunit.client.0.smithi043.stdout:6/56: symlink d0/d2/d14/l1b 0 2023-12-08T20:28:11.125 INFO:tasks.workunit.client.0.smithi043.stdout:6/57: fsync d0/d2/d14/f18 0 2023-12-08T20:28:11.126 INFO:tasks.workunit.client.0.smithi043.stdout:5/94: link d3/ca d3/c1b 0 2023-12-08T20:28:11.127 INFO:tasks.workunit.client.0.smithi043.stdout:9/152: dwrite d0/f13 [0,4194304] 0 2023-12-08T20:28:11.127 INFO:tasks.workunit.client.0.smithi043.stdout:9/153: stat d0/l18 0 2023-12-08T20:28:11.129 INFO:tasks.workunit.client.0.smithi043.stdout:5/95: symlink d3/d7/de/l1c 0 2023-12-08T20:28:11.132 INFO:tasks.workunit.client.0.smithi043.stdout:8/74: write d2/fc [834711,97808] 0 2023-12-08T20:28:11.134 INFO:tasks.workunit.client.0.smithi043.stdout:1/67: dwrite d1/fb [4194304,4194304] 0 2023-12-08T20:28:11.135 INFO:tasks.workunit.client.0.smithi043.stdout:9/154: rmdir d0/d21 39 2023-12-08T20:28:11.136 INFO:tasks.workunit.client.0.smithi043.stdout:9/155: read d0/f16 [50688,16781] 0 2023-12-08T20:28:11.139 INFO:tasks.workunit.client.0.smithi043.stdout:6/58: dread d0/d2/d14/f18 [0,4194304] 0 2023-12-08T20:28:11.139 INFO:tasks.workunit.client.0.smithi043.stdout:6/59: chown d0/d2/d5/ff 0 1 2023-12-08T20:28:11.139 INFO:tasks.workunit.client.0.smithi043.stdout:6/60: readlink d0/d2/lb 0 2023-12-08T20:28:11.140 INFO:tasks.workunit.client.0.smithi043.stdout:1/68: write d1/fb [1605806,9656] 0 2023-12-08T20:28:11.140 INFO:tasks.workunit.client.0.smithi043.stdout:1/69: truncate d1/d6/fa 890751 0 2023-12-08T20:28:11.140 INFO:tasks.workunit.client.0.smithi043.stdout:1/70: readlink d1/dc/l12 0 2023-12-08T20:28:11.140 INFO:tasks.workunit.client.0.smithi043.stdout:1/71: chown d1/l5 25024 1 2023-12-08T20:28:11.140 INFO:tasks.workunit.client.0.smithi043.stdout:4/117: dwrite d1/f6 [0,4194304] 0 2023-12-08T20:28:11.140 INFO:tasks.workunit.client.0.smithi043.stdout:5/96: rename d3/d7/fd to d3/d7/de/f1d 0 2023-12-08T20:28:11.142 INFO:tasks.workunit.client.0.smithi043.stdout:6/61: dread d0/d2/f12 [0,4194304] 0 2023-12-08T20:28:11.142 INFO:tasks.workunit.client.0.smithi043.stdout:9/156: dread d0/f14 [0,4194304] 0 2023-12-08T20:28:11.142 INFO:tasks.workunit.client.0.smithi043.stdout:9/157: chown d0/l12 1575216 1 2023-12-08T20:28:11.143 INFO:tasks.workunit.client.0.smithi043.stdout:1/72: dread d1/d6/fa [0,4194304] 0 2023-12-08T20:28:11.143 INFO:tasks.workunit.client.0.smithi043.stdout:2/49: link d0/f9 d0/fa 0 2023-12-08T20:28:11.143 INFO:tasks.workunit.client.0.smithi043.stdout:2/50: truncate d0/fa 743666 0 2023-12-08T20:28:11.145 INFO:tasks.workunit.client.0.smithi043.stdout:0/92: dwrite d2/d3/f1a [0,4194304] 0 2023-12-08T20:28:11.151 INFO:tasks.workunit.client.0.smithi043.stdout:4/118: creat d1/d14/d25/f2c x:0 0 0 2023-12-08T20:28:11.151 INFO:tasks.workunit.client.0.smithi043.stdout:0/93: dread d2/d3/d6/f10 [0,4194304] 0 2023-12-08T20:28:11.152 INFO:tasks.workunit.client.0.smithi043.stdout:5/97: rename d3/d7/ff to d3/d7/de/f1e 0 2023-12-08T20:28:11.155 INFO:tasks.workunit.client.0.smithi043.stdout:2/51: mkdir d0/db 0 2023-12-08T20:28:11.157 INFO:tasks.workunit.client.0.smithi043.stdout:5/98: dread d3/d7/de/f1e [4194304,4194304] 0 2023-12-08T20:28:11.157 INFO:tasks.workunit.client.0.smithi043.stdout:5/99: stat d3 0 2023-12-08T20:28:11.159 INFO:tasks.workunit.client.0.smithi043.stdout:4/119: dread d1/d14/d1d/fa [0,4194304] 0 2023-12-08T20:28:11.159 INFO:tasks.workunit.client.0.smithi043.stdout:0/94: symlink d2/d3/d18/l1d 0 2023-12-08T20:28:11.160 INFO:tasks.workunit.client.0.smithi043.stdout:2/52: unlink d0/l6 0 2023-12-08T20:28:11.162 INFO:tasks.workunit.client.0.smithi043.stdout:4/120: symlink d1/d14/d25/d28/l2d 0 2023-12-08T20:28:11.162 INFO:tasks.workunit.client.0.smithi043.stdout:4/121: stat d1/d14/d1d/c21 0 2023-12-08T20:28:11.164 INFO:tasks.workunit.client.0.smithi043.stdout:1/73: dread d1/f8 [0,4194304] 0 2023-12-08T20:28:11.165 INFO:tasks.workunit.client.0.smithi043.stdout:1/74: mknod d1/d6/c13 0 2023-12-08T20:28:11.167 INFO:tasks.workunit.client.0.smithi043.stdout:1/75: mknod d1/d6/c14 0 2023-12-08T20:28:11.173 INFO:tasks.workunit.client.0.smithi043.stdout:8/75: dwrite d2/f3 [0,4194304] 0 2023-12-08T20:28:11.173 INFO:tasks.workunit.client.0.smithi043.stdout:8/76: rename d2/d4 to d2/d4/d19 22 2023-12-08T20:28:11.173 INFO:tasks.workunit.client.0.smithi043.stdout:8/77: write d2/d4/fb [989162,44308] 0 2023-12-08T20:28:11.175 INFO:tasks.workunit.client.0.smithi043.stdout:5/100: dread d3/d7/de/f1e [0,4194304] 0 2023-12-08T20:28:11.176 INFO:tasks.workunit.client.0.smithi043.stdout:8/78: write d2/d4/fb [868456,43325] 0 2023-12-08T20:28:11.176 INFO:tasks.workunit.client.0.smithi043.stdout:8/79: stat d2/de 0 2023-12-08T20:28:11.176 INFO:tasks.workunit.client.0.smithi043.stdout:8/80: chown d2/d4/l15 1687 1 2023-12-08T20:28:11.176 INFO:tasks.workunit.client.0.smithi043.stdout:6/62: dwrite d0/d2/d14/f18 [0,4194304] 0 2023-12-08T20:28:11.177 INFO:tasks.workunit.client.0.smithi043.stdout:8/81: mknod d2/d4/c1a 0 2023-12-08T20:28:11.177 INFO:tasks.workunit.client.0.smithi043.stdout:8/82: chown d2/d4/l15 37 1 2023-12-08T20:28:11.179 INFO:tasks.workunit.client.0.smithi043.stdout:6/63: rmdir d0/d2/d14/d8 39 2023-12-08T20:28:11.179 INFO:tasks.workunit.client.0.smithi043.stdout:3/93: dwrite d1/d9/fd [0,4194304] 0 2023-12-08T20:28:11.179 INFO:tasks.workunit.client.0.smithi043.stdout:0/95: write d2/f7 [894097,53277] 0 2023-12-08T20:28:11.181 INFO:tasks.workunit.client.0.smithi043.stdout:0/96: write d2/d4/fc [1418444,64306] 0 2023-12-08T20:28:11.182 INFO:tasks.workunit.client.0.smithi043.stdout:8/83: symlink d2/d18/l1b 0 2023-12-08T20:28:11.182 INFO:tasks.workunit.client.0.smithi043.stdout:3/94: dread d1/d9/fe [0,4194304] 0 2023-12-08T20:28:11.182 INFO:tasks.workunit.client.0.smithi043.stdout:3/95: fsync d1/d9/df/f17 0 2023-12-08T20:28:11.183 INFO:tasks.workunit.client.0.smithi043.stdout:0/97: mkdir d2/d3/d18/d1e 0 2023-12-08T20:28:11.183 INFO:tasks.workunit.client.0.smithi043.stdout:0/98: chown d2/c14 3278 1 2023-12-08T20:28:11.184 INFO:tasks.workunit.client.0.smithi043.stdout:8/84: rmdir d2/de 39 2023-12-08T20:28:11.186 INFO:tasks.workunit.client.0.smithi043.stdout:2/53: dwrite d0/f4 [0,4194304] 0 2023-12-08T20:28:11.187 INFO:tasks.workunit.client.0.smithi043.stdout:2/54: chown d0/f5 47367495 1 2023-12-08T20:28:11.190 INFO:tasks.workunit.client.0.smithi043.stdout:8/85: rename d2/de/c17 to d2/de/c1c 0 2023-12-08T20:28:11.190 INFO:tasks.workunit.client.0.smithi043.stdout:3/96: mkdir d1/d1c 0 2023-12-08T20:28:11.190 INFO:tasks.workunit.client.0.smithi043.stdout:3/97: dread - d1/da/f1b zero size 2023-12-08T20:28:11.191 INFO:tasks.workunit.client.0.smithi043.stdout:1/76: truncate d1/fb 1346907 0 2023-12-08T20:28:11.193 INFO:tasks.workunit.client.0.smithi043.stdout:1/77: write d1/d6/fa [151860,86787] 0 2023-12-08T20:28:11.198 INFO:tasks.workunit.client.0.smithi043.stdout:8/86: link d2/d4/l15 d2/de/l1d 0 2023-12-08T20:28:11.199 INFO:tasks.workunit.client.0.smithi043.stdout:2/55: mknod d0/cc 0 2023-12-08T20:28:11.205 INFO:tasks.workunit.client.0.smithi043.stdout:4/122: dwrite d1/f23 [0,4194304] 0 2023-12-08T20:28:11.205 INFO:tasks.workunit.client.0.smithi043.stdout:2/56: write d0/f4 [519070,10051] 0 2023-12-08T20:28:11.207 INFO:tasks.workunit.client.0.smithi043.stdout:6/64: dwrite d0/d2/d14/d8/da/f19 [0,4194304] 0 2023-12-08T20:28:11.207 INFO:tasks.workunit.client.0.smithi043.stdout:6/65: chown d0/d2/de 0 1 2023-12-08T20:28:11.209 INFO:tasks.workunit.client.0.smithi043.stdout:4/123: creat d1/d14/d25/d28/f2e x:0 0 0 2023-12-08T20:28:11.209 INFO:tasks.workunit.client.0.smithi043.stdout:4/124: chown d1/d14/d25/f2c 2 1 2023-12-08T20:28:11.209 INFO:tasks.workunit.client.0.smithi043.stdout:4/125: fdatasync d1/f6 0 2023-12-08T20:28:11.210 INFO:tasks.workunit.client.0.smithi043.stdout:5/101: dwrite d3/d7/de/f10 [0,4194304] 0 2023-12-08T20:28:11.216 INFO:tasks.workunit.client.0.smithi043.stdout:1/78: dwrite d1/d6/f9 [0,4194304] 0 2023-12-08T20:28:11.216 INFO:tasks.workunit.client.0.smithi043.stdout:1/79: truncate d1/f8 5291323 0 2023-12-08T20:28:11.216 INFO:tasks.workunit.client.0.smithi043.stdout:1/80: chown d1/d6/l7 4278205 1 2023-12-08T20:28:11.216 INFO:tasks.workunit.client.0.smithi043.stdout:1/81: readlink d1/l11 0 2023-12-08T20:28:11.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:10 smithi111 ceph-mon[121341]: pgmap v26: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 71 MiB/s rd, 153 MiB/s wr, 580 op/s 2023-12-08T20:28:11.218 INFO:tasks.workunit.client.0.smithi043.stdout:6/66: rename d0/d2/d14/d8/da to d0/d2/d14/d1c 0 2023-12-08T20:28:11.218 INFO:tasks.workunit.client.0.smithi043.stdout:2/57: write d0/f5 [2820658,47480] 0 2023-12-08T20:28:11.221 INFO:tasks.workunit.client.0.smithi043.stdout:5/102: rename d3/d7/l11 to d3/d7/d19/l1f 0 2023-12-08T20:28:11.222 INFO:tasks.workunit.client.0.smithi043.stdout:1/82: link d1/l11 d1/l15 0 2023-12-08T20:28:11.223 INFO:tasks.workunit.client.0.smithi043.stdout:1/83: chown d1/l5 23258715 1 2023-12-08T20:28:11.223 INFO:tasks.workunit.client.0.smithi043.stdout:1/84: write d1/fb [1449282,90103] 0 2023-12-08T20:28:11.223 INFO:tasks.workunit.client.0.smithi043.stdout:2/58: fsync d0/f4 0 2023-12-08T20:28:11.229 INFO:tasks.workunit.client.0.smithi043.stdout:0/99: dwrite d2/d4/fd [4194304,4194304] 0 2023-12-08T20:28:11.231 INFO:tasks.workunit.client.0.smithi043.stdout:0/100: symlink d2/d4/l1f 0 2023-12-08T20:28:11.235 INFO:tasks.workunit.client.0.smithi043.stdout:0/101: creat d2/d3/d15/f20 x:0 0 0 2023-12-08T20:28:11.235 INFO:tasks.workunit.client.0.smithi043.stdout:4/126: dwrite d1/d14/d1d/f1e [4194304,4194304] 0 2023-12-08T20:28:11.235 INFO:tasks.workunit.client.0.smithi043.stdout:4/127: truncate d1/d14/d25/d28/f2b 90512 0 2023-12-08T20:28:11.235 INFO:tasks.workunit.client.0.smithi043.stdout:0/102: creat d2/d4/f21 x:0 0 0 2023-12-08T20:28:11.237 INFO:tasks.workunit.client.0.smithi043.stdout:0/103: creat d2/d3/d18/f22 x:0 0 0 2023-12-08T20:28:11.239 INFO:tasks.workunit.client.0.smithi043.stdout:0/104: symlink d2/d3/d18/l23 0 2023-12-08T20:28:11.239 INFO:tasks.workunit.client.0.smithi043.stdout:0/105: fdatasync d2/d3/d18/f22 0 2023-12-08T20:28:11.242 INFO:tasks.workunit.client.0.smithi043.stdout:5/103: link d3/d7/d19/l1f d3/d7/d19/l20 0 2023-12-08T20:28:11.242 INFO:tasks.workunit.client.0.smithi043.stdout:5/104: fsync d3/d7/de/f10 0 2023-12-08T20:28:11.246 INFO:tasks.workunit.client.0.smithi043.stdout:4/128: dread d1/d14/d1d/f1e [4194304,4194304] 0 2023-12-08T20:28:11.249 INFO:tasks.workunit.client.0.smithi043.stdout:2/59: dwrite d0/f9 [0,4194304] 0 2023-12-08T20:28:11.249 INFO:tasks.workunit.client.0.smithi043.stdout:2/60: chown d0/cc 174 1 2023-12-08T20:28:11.249 INFO:tasks.workunit.client.0.smithi043.stdout:2/61: chown d0/fa 124418 1 2023-12-08T20:28:11.253 INFO:tasks.workunit.client.0.smithi043.stdout:0/106: dread d2/d3/fb [0,4194304] 0 2023-12-08T20:28:11.253 INFO:tasks.workunit.client.0.smithi043.stdout:8/87: dwrite d2/d4/fb [0,4194304] 0 2023-12-08T20:28:11.255 INFO:tasks.workunit.client.0.smithi043.stdout:0/107: rename d2/d3/d6/f10 to d2/f24 0 2023-12-08T20:28:11.255 INFO:tasks.workunit.client.0.smithi043.stdout:6/67: dwrite d0/d2/d14/d1c/f19 [0,4194304] 0 2023-12-08T20:28:11.256 INFO:tasks.workunit.client.0.smithi043.stdout:8/88: getdents d2 0 2023-12-08T20:28:11.257 INFO:tasks.workunit.client.0.smithi043.stdout:8/89: fdatasync d2/f9 0 2023-12-08T20:28:11.260 INFO:tasks.workunit.client.0.smithi043.stdout:0/108: rename d2/d4/fd to d2/d3/d18/d1e/f25 0 2023-12-08T20:28:11.261 INFO:tasks.workunit.client.0.smithi043.stdout:8/90: creat d2/f1e x:0 0 0 2023-12-08T20:28:11.263 INFO:tasks.workunit.client.0.smithi043.stdout:8/91: creat d2/d18/f1f x:0 0 0 2023-12-08T20:28:11.265 INFO:tasks.workunit.client.0.smithi043.stdout:8/92: mkdir d2/d20 0 2023-12-08T20:28:11.265 INFO:tasks.workunit.client.0.smithi043.stdout:2/62: dread d0/f4 [0,4194304] 0 2023-12-08T20:28:11.267 INFO:tasks.workunit.client.0.smithi043.stdout:8/93: creat d2/f21 x:0 0 0 2023-12-08T20:28:11.267 INFO:tasks.workunit.client.0.smithi043.stdout:8/94: write d2/d18/f1f [1042478,114582] 0 2023-12-08T20:28:11.269 INFO:tasks.workunit.client.0.smithi043.stdout:5/105: dwrite d3/d7/f1a [0,4194304] 0 2023-12-08T20:28:11.269 INFO:tasks.workunit.client.0.smithi043.stdout:5/106: readlink d3/d7/de/l1c 0 2023-12-08T20:28:11.269 INFO:tasks.workunit.client.0.smithi043.stdout:2/63: link d0/f5 d0/db/fd 0 2023-12-08T20:28:11.270 INFO:tasks.workunit.client.0.smithi043.stdout:8/95: rename d2/de/c1c to d2/c22 0 2023-12-08T20:28:11.270 INFO:tasks.workunit.client.0.smithi043.stdout:4/129: dwrite d1/d14/f26 [0,4194304] 0 2023-12-08T20:28:11.273 INFO:tasks.workunit.client.0.smithi043.stdout:5/107: stat d3/ca 0 2023-12-08T20:28:11.273 INFO:tasks.workunit.client.0.smithi043.stdout:5/108: chown d3/d7/de 8442408 1 2023-12-08T20:28:11.273 INFO:tasks.workunit.client.0.smithi043.stdout:2/64: mknod d0/db/ce 0 2023-12-08T20:28:11.274 INFO:tasks.workunit.client.0.smithi043.stdout:4/130: creat d1/d14/d25/f2f x:0 0 0 2023-12-08T20:28:11.274 INFO:tasks.workunit.client.0.smithi043.stdout:4/131: dread - d1/f1c zero size 2023-12-08T20:28:11.275 INFO:tasks.workunit.client.0.smithi043.stdout:6/68: dwrite d0/d2/d14/d1c/f19 [0,4194304] 0 2023-12-08T20:28:11.275 INFO:tasks.workunit.client.0.smithi043.stdout:2/65: read d0/f4 [3647407,23601] 0 2023-12-08T20:28:11.278 INFO:tasks.workunit.client.0.smithi043.stdout:2/66: creat d0/ff x:0 0 0 2023-12-08T20:28:11.284 INFO:tasks.workunit.client.0.smithi043.stdout:2/67: link d0/cc d0/db/c10 0 2023-12-08T20:28:11.285 INFO:tasks.workunit.client.0.smithi043.stdout:2/68: mknod d0/db/c11 0 2023-12-08T20:28:11.290 INFO:tasks.workunit.client.0.smithi043.stdout:2/69: read d0/f4 [2640984,62364] 0 2023-12-08T20:28:11.290 INFO:tasks.workunit.client.0.smithi043.stdout:6/69: dread d0/d2/d5/ff [0,4194304] 0 2023-12-08T20:28:11.290 INFO:tasks.workunit.client.0.smithi043.stdout:6/70: stat d0/d2/d14 0 2023-12-08T20:28:11.293 INFO:tasks.workunit.client.0.smithi043.stdout:0/109: dwrite d2/d3/d18/d1e/f25 [4194304,4194304] 0 2023-12-08T20:28:11.293 INFO:tasks.workunit.client.0.smithi043.stdout:2/70: symlink d0/db/l12 0 2023-12-08T20:28:11.293 INFO:tasks.workunit.client.0.smithi043.stdout:2/71: chown d0/f5 1750711 1 2023-12-08T20:28:11.293 INFO:tasks.workunit.client.0.smithi043.stdout:2/72: stat d0/fa 0 2023-12-08T20:28:11.293 INFO:tasks.workunit.client.0.smithi043.stdout:2/73: rename d0 to d0/db/d13 22 2023-12-08T20:28:11.293 INFO:tasks.workunit.client.0.smithi043.stdout:6/71: dread d0/d2/f12 [0,4194304] 0 2023-12-08T20:28:11.296 INFO:tasks.workunit.client.0.smithi043.stdout:2/74: write d0/f4 [2771598,44139] 0 2023-12-08T20:28:11.296 INFO:tasks.workunit.client.0.smithi043.stdout:2/75: chown d0/cc 14 1 2023-12-08T20:28:11.296 INFO:tasks.workunit.client.0.smithi043.stdout:6/72: creat d0/f1d x:0 0 0 2023-12-08T20:28:11.296 INFO:tasks.workunit.client.0.smithi043.stdout:8/96: dwrite d2/de/f14 [0,4194304] 0 2023-12-08T20:28:11.297 INFO:tasks.workunit.client.0.smithi043.stdout:8/97: truncate d2/f3 9542050 0 2023-12-08T20:28:11.299 INFO:tasks.workunit.client.0.smithi043.stdout:4/132: dwrite d1/d14/f1a [0,4194304] 0 2023-12-08T20:28:11.299 INFO:tasks.workunit.client.0.smithi043.stdout:2/76: unlink d0/c8 0 2023-12-08T20:28:11.303 INFO:tasks.workunit.client.0.smithi043.stdout:4/133: symlink d1/d14/l30 0 2023-12-08T20:28:11.304 INFO:tasks.workunit.client.0.smithi043.stdout:4/134: creat d1/d14/f31 x:0 0 0 2023-12-08T20:28:11.305 INFO:tasks.workunit.client.0.smithi043.stdout:2/77: creat d0/db/f14 x:0 0 0 2023-12-08T20:28:11.306 INFO:tasks.workunit.client.0.smithi043.stdout:4/135: read d1/f23 [721073,97338] 0 2023-12-08T20:28:11.307 INFO:tasks.workunit.client.0.smithi043.stdout:2/78: mknod d0/db/c15 0 2023-12-08T20:28:11.310 INFO:tasks.workunit.client.0.smithi043.stdout:2/79: symlink d0/db/l16 0 2023-12-08T20:28:11.310 INFO:tasks.workunit.client.0.smithi043.stdout:2/80: creat d0/f17 x:0 0 0 2023-12-08T20:28:11.311 INFO:tasks.workunit.client.0.smithi043.stdout:2/81: truncate d0/fa 1387175 0 2023-12-08T20:28:11.311 INFO:tasks.workunit.client.0.smithi043.stdout:2/82: fdatasync d0/f5 0 2023-12-08T20:28:11.313 INFO:tasks.workunit.client.0.smithi043.stdout:4/136: write d1/d14/f19 [2866376,56091] 0 2023-12-08T20:28:11.314 INFO:tasks.workunit.client.0.smithi043.stdout:5/109: dwrite d3/fc [4194304,4194304] 0 2023-12-08T20:28:11.318 INFO:tasks.workunit.client.0.smithi043.stdout:8/98: truncate d2/f3 7020452 0 2023-12-08T20:28:11.318 INFO:tasks.workunit.client.0.smithi043.stdout:8/99: readlink d2/de/l1d 0 2023-12-08T20:28:11.320 INFO:tasks.workunit.client.0.smithi043.stdout:0/110: dwrite d2/d3/d15/f20 [0,4194304] 0 2023-12-08T20:28:11.321 INFO:tasks.workunit.client.0.smithi043.stdout:0/111: write d2/d3/d15/f20 [2461465,96497] 0 2023-12-08T20:28:11.321 INFO:tasks.workunit.client.0.smithi043.stdout:0/112: truncate d2/d4/f21 412451 0 2023-12-08T20:28:11.327 INFO:tasks.workunit.client.0.smithi043.stdout:2/83: rmdir d0 39 2023-12-08T20:28:11.327 INFO:tasks.workunit.client.0.smithi043.stdout:2/84: read d0/f4 [2391727,10528] 0 2023-12-08T20:28:11.328 INFO:tasks.workunit.client.0.smithi043.stdout:5/110: mkdir d3/d7/d21 0 2023-12-08T20:28:11.329 INFO:tasks.workunit.client.0.smithi043.stdout:8/100: rename d2/d4/fb to d2/d20/f23 0 2023-12-08T20:28:11.329 INFO:tasks.workunit.client.0.smithi043.stdout:8/101: fsync d2/de/ff 0 2023-12-08T20:28:11.329 INFO:tasks.workunit.client.0.smithi043.stdout:8/102: chown d2/c10 142397 1 2023-12-08T20:28:11.331 INFO:tasks.workunit.client.0.smithi043.stdout:2/85: stat d0/cc 0 2023-12-08T20:28:11.332 INFO:tasks.workunit.client.0.smithi043.stdout:2/86: mkdir d0/db/d18 0 2023-12-08T20:28:11.334 INFO:tasks.workunit.client.0.smithi043.stdout:5/111: rename d3/d7/de/l16 to d3/l22 0 2023-12-08T20:28:11.334 INFO:tasks.workunit.client.0.smithi043.stdout:5/112: chown d3/c1b 7 1 2023-12-08T20:28:11.335 INFO:tasks.workunit.client.0.smithi043.stdout:2/87: creat d0/db/f19 x:0 0 0 2023-12-08T20:28:11.335 INFO:tasks.workunit.client.0.smithi043.stdout:2/88: creat d0/db/d18/f1a x:0 0 0 2023-12-08T20:28:11.391 INFO:tasks.workunit.client.0.smithi043.stdout:6/73: dwrite d0/f1d [0,4194304] 0 2023-12-08T20:28:11.398 INFO:tasks.workunit.client.0.smithi043.stdout:6/74: creat d0/d2/d14/d8/f1e x:0 0 0 2023-12-08T20:28:11.398 INFO:tasks.workunit.client.0.smithi043.stdout:6/75: write d0/d2/f12 [214944,52548] 0 2023-12-08T20:28:11.398 INFO:tasks.workunit.client.0.smithi043.stdout:6/76: write d0/d2/d14/d8/f1e [447393,109221] 0 2023-12-08T20:28:11.399 INFO:tasks.workunit.client.0.smithi043.stdout:2/89: write d0/fa [726748,67719] 0 2023-12-08T20:28:11.401 INFO:tasks.workunit.client.0.smithi043.stdout:6/77: creat d0/d2/f1f x:0 0 0 2023-12-08T20:28:11.401 INFO:tasks.workunit.client.0.smithi043.stdout:6/78: chown d0/d2/d14/f18 883 1 2023-12-08T20:28:11.403 INFO:tasks.workunit.client.0.smithi043.stdout:2/90: rename d0/db/l16 to d0/db/l1b 0 2023-12-08T20:28:11.405 INFO:tasks.workunit.client.0.smithi043.stdout:5/113: dwrite d3/fc [4194304,4194304] 0 2023-12-08T20:28:11.405 INFO:tasks.workunit.client.0.smithi043.stdout:6/79: rename d0/d2/d5 to d0/d2/d14/d20 0 2023-12-08T20:28:11.406 INFO:tasks.workunit.client.0.smithi043.stdout:2/91: mkdir d0/d1c 0 2023-12-08T20:28:11.407 INFO:tasks.workunit.client.0.smithi043.stdout:5/114: write d3/f8 [1716956,116435] 0 2023-12-08T20:28:11.407 INFO:tasks.workunit.client.0.smithi043.stdout:5/115: write d3/d7/de/f18 [5020187,56219] 0 2023-12-08T20:28:11.407 INFO:tasks.workunit.client.0.smithi043.stdout:5/116: rename d3 to d3/d7/de/d23 22 2023-12-08T20:28:11.409 INFO:tasks.workunit.client.0.smithi043.stdout:5/117: dread d3/d7/f13 [0,4194304] 0 2023-12-08T20:28:11.409 INFO:tasks.workunit.client.0.smithi043.stdout:5/118: readlink d3/l6 0 2023-12-08T20:28:11.411 INFO:tasks.workunit.client.0.smithi043.stdout:5/119: write d3/d7/de/f10 [797996,114362] 0 2023-12-08T20:28:11.414 INFO:tasks.workunit.client.0.smithi043.stdout:5/120: creat d3/d7/de/f24 x:0 0 0 2023-12-08T20:28:11.414 INFO:tasks.workunit.client.0.smithi043.stdout:5/121: truncate d3/d7/de/f1d 522595 0 2023-12-08T20:28:11.415 INFO:tasks.workunit.client.0.smithi043.stdout:5/122: readlink d3/l6 0 2023-12-08T20:28:11.415 INFO:tasks.workunit.client.0.smithi043.stdout:5/123: truncate d3/d7/f13 1549876 0 2023-12-08T20:28:11.415 INFO:tasks.workunit.client.0.smithi043.stdout:0/113: dwrite d2/d4/fc [0,4194304] 0 2023-12-08T20:28:11.416 INFO:tasks.workunit.client.0.smithi043.stdout:2/92: dread d0/f4 [0,4194304] 0 2023-12-08T20:28:11.416 INFO:tasks.workunit.client.0.smithi043.stdout:2/93: chown d0/db/c11 720901 1 2023-12-08T20:28:11.416 INFO:tasks.workunit.client.0.smithi043.stdout:2/94: chown d0/db/c11 123556 1 2023-12-08T20:28:11.419 INFO:tasks.workunit.client.0.smithi043.stdout:0/114: rename d2/d4/f21 to d2/d4/f26 0 2023-12-08T20:28:11.420 INFO:tasks.workunit.client.0.smithi043.stdout:2/95: creat d0/db/d18/f1d x:0 0 0 2023-12-08T20:28:11.420 INFO:tasks.workunit.client.0.smithi043.stdout:2/96: dread - d0/f17 zero size 2023-12-08T20:28:11.421 INFO:tasks.workunit.client.0.smithi043.stdout:0/115: symlink d2/d3/d18/d1e/l27 0 2023-12-08T20:28:11.421 INFO:tasks.workunit.client.0.smithi043.stdout:0/116: write d2/f8 [288884,26596] 0 2023-12-08T20:28:11.421 INFO:tasks.workunit.client.0.smithi043.stdout:0/117: chown d2/d4/l12 7435 1 2023-12-08T20:28:11.423 INFO:tasks.workunit.client.0.smithi043.stdout:2/97: link d0/db/f19 d0/db/f1e 0 2023-12-08T20:28:11.423 INFO:tasks.workunit.client.0.smithi043.stdout:2/98: dread - d0/db/f1e zero size 2023-12-08T20:28:11.423 INFO:tasks.workunit.client.0.smithi043.stdout:2/99: chown d0/db/l1b 0 1 2023-12-08T20:28:11.425 INFO:tasks.workunit.client.0.smithi043.stdout:0/118: getdents d2/d3/d15 0 2023-12-08T20:28:11.425 INFO:tasks.workunit.client.0.smithi043.stdout:0/119: read d2/d3/fb [2845378,44337] 0 2023-12-08T20:28:11.426 INFO:tasks.workunit.client.0.smithi043.stdout:2/100: mknod d0/d1c/c1f 0 2023-12-08T20:28:11.427 INFO:tasks.workunit.client.0.smithi043.stdout:2/101: write d0/db/d18/f1d [758847,25306] 0 2023-12-08T20:28:11.427 INFO:tasks.workunit.client.0.smithi043.stdout:0/120: getdents d2/d3/d18 0 2023-12-08T20:28:11.430 INFO:tasks.workunit.client.0.smithi043.stdout:6/80: rmdir d0/d2/d14 39 2023-12-08T20:28:11.430 INFO:tasks.workunit.client.0.smithi043.stdout:2/102: truncate d0/f5 1702491 0 2023-12-08T20:28:11.433 INFO:tasks.workunit.client.0.smithi043.stdout:2/103: mkdir d0/d20 0 2023-12-08T20:28:11.435 INFO:tasks.workunit.client.0.smithi043.stdout:0/121: rmdir d2/d4 39 2023-12-08T20:28:11.438 INFO:tasks.workunit.client.0.smithi043.stdout:0/122: truncate d2/f24 1169623 0 2023-12-08T20:28:11.438 INFO:tasks.workunit.client.0.smithi043.stdout:0/123: fdatasync d2/f24 0 2023-12-08T20:28:11.442 INFO:tasks.workunit.client.0.smithi043.stdout:5/124: dwrite d3/d7/de/f1e [4194304,4194304] 0 2023-12-08T20:28:11.461 INFO:tasks.workunit.client.0.smithi043.stdout:2/104: dwrite d0/db/d18/f1a [0,4194304] 0 2023-12-08T20:28:11.461 INFO:tasks.workunit.client.0.smithi043.stdout:2/105: write d0/ff [337044,24804] 0 2023-12-08T20:28:11.461 INFO:tasks.workunit.client.0.smithi043.stdout:2/106: chown d0/ff 1720679618 1 2023-12-08T20:28:11.463 INFO:tasks.workunit.client.0.smithi043.stdout:2/107: creat d0/f21 x:0 0 0 2023-12-08T20:28:11.463 INFO:tasks.workunit.client.0.smithi043.stdout:2/108: rename d0/ff to d0/db/d18/f22 0 2023-12-08T20:28:11.464 INFO:tasks.workunit.client.0.smithi043.stdout:2/109: symlink d0/l23 0 2023-12-08T20:28:11.465 INFO:tasks.workunit.client.0.smithi043.stdout:2/110: dread - d0/f21 zero size 2023-12-08T20:28:11.465 INFO:tasks.workunit.client.0.smithi043.stdout:2/111: creat d0/f24 x:0 0 0 2023-12-08T20:28:11.472 INFO:tasks.workunit.client.0.smithi043.stdout:6/81: dwrite d0/f1d [0,4194304] 0 2023-12-08T20:28:11.473 INFO:tasks.workunit.client.0.smithi043.stdout:0/124: dwrite d2/d4/f26 [0,4194304] 0 2023-12-08T20:28:11.474 INFO:tasks.workunit.client.0.smithi043.stdout:5/125: dwrite f1 [0,4194304] 0 2023-12-08T20:28:11.474 INFO:tasks.workunit.client.0.smithi043.stdout:6/82: rename d0/d2/de/c17 to d0/d2/c21 0 2023-12-08T20:28:11.477 INFO:tasks.workunit.client.0.smithi043.stdout:5/126: write d3/d7/f1a [18419,60145] 0 2023-12-08T20:28:11.477 INFO:tasks.workunit.client.0.smithi043.stdout:5/127: fsync d3/d7/de/f18 0 2023-12-08T20:28:11.477 INFO:tasks.workunit.client.0.smithi043.stdout:2/112: dwrite d0/fa [0,4194304] 0 2023-12-08T20:28:11.479 INFO:tasks.workunit.client.0.smithi043.stdout:0/125: dread d2/d3/fb [0,4194304] 0 2023-12-08T20:28:11.482 INFO:tasks.workunit.client.0.smithi043.stdout:2/113: rmdir d0 39 2023-12-08T20:28:11.482 INFO:tasks.workunit.client.0.smithi043.stdout:2/114: dread - d0/db/f19 zero size 2023-12-08T20:28:11.482 INFO:tasks.workunit.client.0.smithi043.stdout:2/115: fdatasync d0/db/f19 0 2023-12-08T20:28:11.483 INFO:tasks.workunit.client.0.smithi043.stdout:2/116: creat d0/f25 x:0 0 0 2023-12-08T20:28:11.487 INFO:tasks.workunit.client.0.smithi043.stdout:0/126: dread d2/d4/f26 [0,4194304] 0 2023-12-08T20:28:11.488 INFO:tasks.workunit.client.0.smithi043.stdout:2/117: rename d0/d1c to d0/d26 0 2023-12-08T20:28:11.489 INFO:tasks.workunit.client.0.smithi043.stdout:0/127: rename d2/d3/d18/l1d to d2/d3/l28 0 2023-12-08T20:28:11.489 INFO:tasks.workunit.client.0.smithi043.stdout:0/128: chown d2/d3/l28 2 1 2023-12-08T20:28:11.493 INFO:tasks.workunit.client.0.smithi043.stdout:5/128: dwrite d3/d7/de/f18 [4194304,4194304] 0 2023-12-08T20:28:11.494 INFO:tasks.workunit.client.0.smithi043.stdout:5/129: mknod d3/d7/de/d17/c25 0 2023-12-08T20:28:11.495 INFO:tasks.workunit.client.0.smithi043.stdout:2/118: rmdir d0 39 2023-12-08T20:28:11.495 INFO:tasks.workunit.client.0.smithi043.stdout:2/119: dread - d0/f24 zero size 2023-12-08T20:28:11.496 INFO:tasks.workunit.client.0.smithi043.stdout:5/130: write d3/d7/de/f18 [7657006,80084] 0 2023-12-08T20:28:11.496 INFO:tasks.workunit.client.0.smithi043.stdout:5/131: fsync d3/f8 0 2023-12-08T20:28:11.497 INFO:tasks.workunit.client.0.smithi043.stdout:2/120: creat d0/d26/f27 x:0 0 0 2023-12-08T20:28:11.498 INFO:tasks.workunit.client.0.smithi043.stdout:5/132: getdents d3/d7/de 0 2023-12-08T20:28:11.498 INFO:tasks.workunit.client.0.smithi043.stdout:5/133: read d3/fc [3638340,67593] 0 2023-12-08T20:28:11.498 INFO:tasks.workunit.client.0.smithi043.stdout:5/134: write d3/d7/de/f24 [66154,22654] 0 2023-12-08T20:28:11.499 INFO:tasks.workunit.client.0.smithi043.stdout:2/121: creat d0/f28 x:0 0 0 2023-12-08T20:28:11.500 INFO:tasks.workunit.client.0.smithi043.stdout:5/135: mknod d3/d7/de/d17/c26 0 2023-12-08T20:28:11.501 INFO:tasks.workunit.client.0.smithi043.stdout:2/122: creat d0/db/f29 x:0 0 0 2023-12-08T20:28:11.501 INFO:tasks.workunit.client.0.smithi043.stdout:2/123: chown d0/d26/c1f 8170056 1 2023-12-08T20:28:11.502 INFO:tasks.workunit.client.0.smithi043.stdout:2/124: creat d0/d20/f2a x:0 0 0 2023-12-08T20:28:11.505 INFO:tasks.workunit.client.0.smithi043.stdout:5/136: dread d3/d7/de/f24 [0,4194304] 0 2023-12-08T20:28:11.514 INFO:tasks.workunit.client.0.smithi043.stdout:5/137: dread d3/d7/de/f10 [0,4194304] 0 2023-12-08T20:28:11.516 INFO:tasks.workunit.client.0.smithi043.stdout:5/138: rename d3/f8 to d3/d7/de/d17/f27 0 2023-12-08T20:28:11.517 INFO:tasks.workunit.client.0.smithi043.stdout:5/139: creat d3/d7/d21/f28 x:0 0 0 2023-12-08T20:28:11.532 INFO:tasks.workunit.client.0.smithi043.stdout:5/140: dwrite d3/d7/de/f18 [0,4194304] 0 2023-12-08T20:28:11.536 INFO:tasks.workunit.client.0.smithi043.stdout:5/141: dread d3/d7/de/f1d [0,4194304] 0 2023-12-08T20:28:11.536 INFO:tasks.workunit.client.0.smithi043.stdout:5/142: chown d3/d7/de/f10 2 1 2023-12-08T20:28:11.537 INFO:tasks.workunit.client.0.smithi043.stdout:5/143: unlink d3/d7/d19/l20 0 2023-12-08T20:28:11.538 INFO:tasks.workunit.client.0.smithi043.stdout:5/144: mkdir d3/d7/d29 0 2023-12-08T20:28:11.701 INFO:tasks.workunit.client.0.smithi043.stdout:8/103: sync 2023-12-08T20:28:11.702 INFO:tasks.workunit.client.0.smithi043.stdout:9/158: sync 2023-12-08T20:28:11.702 INFO:tasks.workunit.client.0.smithi043.stdout:4/137: sync 2023-12-08T20:28:11.702 INFO:tasks.workunit.client.0.smithi043.stdout:1/85: sync 2023-12-08T20:28:11.702 INFO:tasks.workunit.client.0.smithi043.stdout:7/53: sync 2023-12-08T20:28:11.702 INFO:tasks.workunit.client.0.smithi043.stdout:4/138: read - d1/d14/d25/f29 zero size 2023-12-08T20:28:11.702 INFO:tasks.workunit.client.0.smithi043.stdout:3/98: sync 2023-12-08T20:28:11.702 INFO:tasks.workunit.client.0.smithi043.stdout:9/159: read d0/f25 [3060315,33023] 0 2023-12-08T20:28:11.703 INFO:tasks.workunit.client.0.smithi043.stdout:4/139: rename d1/d14/d25/d28/c2a to d1/d14/c32 0 2023-12-08T20:28:11.705 INFO:tasks.workunit.client.0.smithi043.stdout:9/160: creat d0/f2c x:0 0 0 2023-12-08T20:28:11.705 INFO:tasks.workunit.client.0.smithi043.stdout:3/99: dread d1/d9/fe [0,4194304] 0 2023-12-08T20:28:11.706 INFO:tasks.workunit.client.0.smithi043.stdout:4/140: symlink d1/d14/d25/d28/l33 0 2023-12-08T20:28:11.706 INFO:tasks.workunit.client.0.smithi043.stdout:9/161: mknod d0/d21/c2d 0 2023-12-08T20:28:11.712 INFO:tasks.workunit.client.0.smithi043.stdout:9/162: mkdir d0/d2e 0 2023-12-08T20:28:11.714 INFO:tasks.workunit.client.0.smithi043.stdout:9/163: symlink d0/d2e/l2f 0 2023-12-08T20:28:11.722 INFO:tasks.workunit.client.0.smithi043.stdout:9/164: write d0/f6 [3066380,112312] 0 2023-12-08T20:28:11.723 INFO:tasks.workunit.client.0.smithi043.stdout:9/165: fsync d0/d21/f28 0 2023-12-08T20:28:11.726 INFO:tasks.workunit.client.0.smithi043.stdout:1/86: dwrite d1/f2 [0,4194304] 0 2023-12-08T20:28:11.726 INFO:tasks.workunit.client.0.smithi043.stdout:1/87: fdatasync d1/d6/f9 0 2023-12-08T20:28:11.729 INFO:tasks.workunit.client.0.smithi043.stdout:1/88: rmdir d1/d6 39 2023-12-08T20:28:11.729 INFO:tasks.workunit.client.0.smithi043.stdout:1/89: readlink d1/l15 0 2023-12-08T20:28:11.729 INFO:tasks.workunit.client.0.smithi043.stdout:1/90: truncate d1/d6/f9 4521935 0 2023-12-08T20:28:11.730 INFO:tasks.workunit.client.0.smithi043.stdout:1/91: rename d1/dc to d1/d16 0 2023-12-08T20:28:11.737 INFO:tasks.workunit.client.0.smithi043.stdout:7/54: dwrite d0/fb [0,4194304] 0 2023-12-08T20:28:11.737 INFO:tasks.workunit.client.0.smithi043.stdout:8/104: dwrite d2/de/ff [0,4194304] 0 2023-12-08T20:28:11.737 INFO:tasks.workunit.client.0.smithi043.stdout:8/105: chown d2/d20/f23 2211109 1 2023-12-08T20:28:11.737 INFO:tasks.workunit.client.0.smithi043.stdout:3/100: dwrite d1/d9/f19 [0,4194304] 0 2023-12-08T20:28:11.738 INFO:tasks.workunit.client.0.smithi043.stdout:3/101: chown d1/d9 5101 1 2023-12-08T20:28:11.738 INFO:tasks.workunit.client.0.smithi043.stdout:3/102: chown d1/d9/f1a 290 1 2023-12-08T20:28:11.739 INFO:tasks.workunit.client.0.smithi043.stdout:7/55: creat d0/d6/d8/f10 x:0 0 0 2023-12-08T20:28:11.742 INFO:tasks.workunit.client.0.smithi043.stdout:7/56: creat d0/d2/f11 x:0 0 0 2023-12-08T20:28:11.743 INFO:tasks.workunit.client.0.smithi043.stdout:3/103: mknod d1/da/c1d 0 2023-12-08T20:28:11.743 INFO:tasks.workunit.client.0.smithi043.stdout:8/106: write d2/f9 [1782740,62023] 0 2023-12-08T20:28:11.743 INFO:tasks.workunit.client.0.smithi043.stdout:8/107: write d2/f21 [155161,73206] 0 2023-12-08T20:28:11.743 INFO:tasks.workunit.client.0.smithi043.stdout:3/104: creat d1/f1e x:0 0 0 2023-12-08T20:28:11.744 INFO:tasks.workunit.client.0.smithi043.stdout:3/105: chown d1/d9 26553 1 2023-12-08T20:28:11.744 INFO:tasks.workunit.client.0.smithi043.stdout:3/106: chown d1/c4 631 1 2023-12-08T20:28:11.746 INFO:tasks.workunit.client.0.smithi043.stdout:3/107: creat d1/d9/f1f x:0 0 0 2023-12-08T20:28:11.746 INFO:tasks.workunit.client.0.smithi043.stdout:3/108: fdatasync d1/d9/df/f15 0 2023-12-08T20:28:11.747 INFO:tasks.workunit.client.0.smithi043.stdout:1/92: dwrite d1/f8 [4194304,4194304] 0 2023-12-08T20:28:11.747 INFO:tasks.workunit.client.0.smithi043.stdout:1/93: truncate d1/d6/fa 1730209 0 2023-12-08T20:28:11.748 INFO:tasks.workunit.client.0.smithi043.stdout:3/109: link d1/c4 d1/d9/df/c20 0 2023-12-08T20:28:11.749 INFO:tasks.workunit.client.0.smithi043.stdout:1/94: link d1/d6/ce d1/d16/c17 0 2023-12-08T20:28:11.751 INFO:tasks.workunit.client.0.smithi043.stdout:1/95: creat d1/d16/f18 x:0 0 0 2023-12-08T20:28:11.751 INFO:tasks.workunit.client.0.smithi043.stdout:1/96: fdatasync d1/d6/f9 0 2023-12-08T20:28:11.753 INFO:tasks.workunit.client.0.smithi043.stdout:1/97: rename d1/l5 to d1/d16/l19 0 2023-12-08T20:28:11.760 INFO:tasks.workunit.client.0.smithi043.stdout:3/110: getdents d1/da 0 2023-12-08T20:28:11.763 INFO:tasks.workunit.client.0.smithi043.stdout:3/111: rmdir d1/da 39 2023-12-08T20:28:11.763 INFO:tasks.workunit.client.0.smithi043.stdout:3/112: dread - d1/f18 zero size 2023-12-08T20:28:11.766 INFO:tasks.workunit.client.0.smithi043.stdout:3/113: rename d1/c5 to d1/c21 0 2023-12-08T20:28:11.767 INFO:tasks.workunit.client.0.smithi043.stdout:3/114: write d1/d9/f1a [970694,121176] 0 2023-12-08T20:28:11.768 INFO:tasks.workunit.client.0.smithi043.stdout:3/115: link d1/d9/f1f d1/d1c/f22 0 2023-12-08T20:28:11.768 INFO:tasks.workunit.client.0.smithi043.stdout:3/116: getdents d1/da 0 2023-12-08T20:28:11.769 INFO:tasks.workunit.client.0.smithi043.stdout:1/98: truncate d1/d6/f9 1769547 0 2023-12-08T20:28:11.769 INFO:tasks.workunit.client.0.smithi043.stdout:1/99: write d1/fb [1853003,75066] 0 2023-12-08T20:28:11.769 INFO:tasks.workunit.client.0.smithi043.stdout:3/117: symlink d1/d9/l23 0 2023-12-08T20:28:11.770 INFO:tasks.workunit.client.0.smithi043.stdout:1/100: mknod d1/d16/c1a 0 2023-12-08T20:28:11.772 INFO:tasks.workunit.client.0.smithi043.stdout:7/57: dwrite d0/d6/d8/f10 [0,4194304] 0 2023-12-08T20:28:11.772 INFO:tasks.workunit.client.0.smithi043.stdout:7/58: readlink d0/l3 0 2023-12-08T20:28:11.772 INFO:tasks.workunit.client.0.smithi043.stdout:8/108: dwrite d2/d20/f23 [4194304,4194304] 0 2023-12-08T20:28:11.772 INFO:tasks.workunit.client.0.smithi043.stdout:8/109: truncate d2/f3 7454043 0 2023-12-08T20:28:11.776 INFO:tasks.workunit.client.0.smithi043.stdout:8/110: mknod d2/d18/c24 0 2023-12-08T20:28:11.777 INFO:tasks.workunit.client.0.smithi043.stdout:8/111: readlink d2/d4/l15 0 2023-12-08T20:28:11.777 INFO:tasks.workunit.client.0.smithi043.stdout:8/112: fdatasync d2/f1e 0 2023-12-08T20:28:11.779 INFO:tasks.workunit.client.0.smithi043.stdout:1/101: write d1/d6/f9 [245821,44806] 0 2023-12-08T20:28:11.779 INFO:tasks.workunit.client.0.smithi043.stdout:1/102: read d1/fb [1765072,21415] 0 2023-12-08T20:28:11.780 INFO:tasks.workunit.client.0.smithi043.stdout:8/113: creat d2/f25 x:0 0 0 2023-12-08T20:28:11.780 INFO:tasks.workunit.client.0.smithi043.stdout:8/114: readlink d2/d4/l15 0 2023-12-08T20:28:11.780 INFO:tasks.workunit.client.0.smithi043.stdout:7/59: dread d0/fb [0,4194304] 0 2023-12-08T20:28:11.782 INFO:tasks.workunit.client.0.smithi043.stdout:1/103: rename d1/f8 to d1/d6/f1b 0 2023-12-08T20:28:11.782 INFO:tasks.workunit.client.0.smithi043.stdout:1/104: truncate d1/d6/f9 1949923 0 2023-12-08T20:28:11.782 INFO:tasks.workunit.client.0.smithi043.stdout:1/105: chown d1/d6/l7 22 1 2023-12-08T20:28:11.783 INFO:tasks.workunit.client.0.smithi043.stdout:7/60: mkdir d0/d2/d12 0 2023-12-08T20:28:11.784 INFO:tasks.workunit.client.0.smithi043.stdout:7/61: symlink d0/d6/d8/l13 0 2023-12-08T20:28:11.785 INFO:tasks.workunit.client.0.smithi043.stdout:7/62: mknod d0/d2/c14 0 2023-12-08T20:28:11.787 INFO:tasks.workunit.client.0.smithi043.stdout:7/63: creat d0/d6/d8/f15 x:0 0 0 2023-12-08T20:28:11.787 INFO:tasks.workunit.client.0.smithi043.stdout:7/64: write d0/d2/f11 [61718,67700] 0 2023-12-08T20:28:11.787 INFO:tasks.workunit.client.0.smithi043.stdout:7/65: truncate d0/d2/fc 203093 0 2023-12-08T20:28:11.789 INFO:tasks.workunit.client.0.smithi043.stdout:7/66: mkdir d0/d2/d16 0 2023-12-08T20:28:11.793 INFO:tasks.workunit.client.0.smithi043.stdout:1/106: truncate d1/fb 630413 0 2023-12-08T20:28:11.793 INFO:tasks.workunit.client.0.smithi043.stdout:3/118: dwrite d1/f18 [0,4194304] 0 2023-12-08T20:28:11.793 INFO:tasks.workunit.client.0.smithi043.stdout:3/119: write d1/d9/fe [652496,97018] 0 2023-12-08T20:28:11.796 INFO:tasks.workunit.client.0.smithi043.stdout:1/107: mkdir d1/d16/d1c 0 2023-12-08T20:28:11.796 INFO:tasks.workunit.client.0.smithi043.stdout:3/120: stat d1/c4 0 2023-12-08T20:28:11.797 INFO:tasks.workunit.client.0.smithi043.stdout:1/108: creat d1/f1d x:0 0 0 2023-12-08T20:28:11.798 INFO:tasks.workunit.client.0.smithi043.stdout:3/121: rename d1/da/f1b to d1/da/f24 0 2023-12-08T20:28:11.798 INFO:tasks.workunit.client.0.smithi043.stdout:3/122: chown d1/d9/df/f15 2024865 1 2023-12-08T20:28:11.798 INFO:tasks.workunit.client.0.smithi043.stdout:3/123: dread - d1/da/f24 zero size 2023-12-08T20:28:11.799 INFO:tasks.workunit.client.0.smithi043.stdout:1/109: symlink d1/d16/l1e 0 2023-12-08T20:28:11.799 INFO:tasks.workunit.client.0.smithi043.stdout:1/110: fdatasync d1/d6/fa 0 2023-12-08T20:28:11.800 INFO:tasks.workunit.client.0.smithi043.stdout:1/111: unlink d1/d6/c13 0 2023-12-08T20:28:11.800 INFO:tasks.workunit.client.0.smithi043.stdout:1/112: chown d1/d16/cd 2004442488 1 2023-12-08T20:28:11.801 INFO:tasks.workunit.client.0.smithi043.stdout:3/124: dread d1/d9/f19 [4194304,4194304] 0 2023-12-08T20:28:11.804 INFO:tasks.workunit.client.0.smithi043.stdout:7/67: dwrite d0/d6/d8/f15 [0,4194304] 0 2023-12-08T20:28:11.804 INFO:tasks.workunit.client.0.smithi043.stdout:8/115: dwrite d2/f3 [0,4194304] 0 2023-12-08T20:28:11.808 INFO:tasks.workunit.client.0.smithi043.stdout:7/68: mkdir d0/d6/d17 0 2023-12-08T20:28:11.808 INFO:tasks.workunit.client.0.smithi043.stdout:7/69: write d0/d2/fc [1068322,117283] 0 2023-12-08T20:28:11.816 INFO:tasks.workunit.client.0.smithi043.stdout:1/113: dwrite d1/d6/f1b [4194304,4194304] 0 2023-12-08T20:28:11.817 INFO:tasks.workunit.client.0.smithi043.stdout:3/125: rename d1/da to d1/d25 0 2023-12-08T20:28:11.817 INFO:tasks.workunit.client.0.smithi043.stdout:3/126: truncate d1/d9/df/f15 77941 0 2023-12-08T20:28:11.818 INFO:tasks.workunit.client.0.smithi043.stdout:3/127: chown d1/l6 5387359 1 2023-12-08T20:28:11.819 INFO:tasks.workunit.client.0.smithi043.stdout:8/116: creat d2/de/f26 x:0 0 0 2023-12-08T20:28:11.821 INFO:tasks.workunit.client.0.smithi043.stdout:7/70: creat d0/d6/f18 x:0 0 0 2023-12-08T20:28:11.823 INFO:tasks.workunit.client.0.smithi043.stdout:1/114: symlink d1/d16/l1f 0 2023-12-08T20:28:11.824 INFO:tasks.workunit.client.0.smithi043.stdout:3/128: mkdir d1/d9/df/d26 0 2023-12-08T20:28:11.824 INFO:tasks.workunit.client.0.smithi043.stdout:3/129: write d1/d9/f1a [1880678,120790] 0 2023-12-08T20:28:11.824 INFO:tasks.workunit.client.0.smithi043.stdout:3/130: write d1/d9/df/f15 [700923,116545] 0 2023-12-08T20:28:11.825 INFO:tasks.workunit.client.0.smithi043.stdout:8/117: unlink d2/de/l1d 0 2023-12-08T20:28:11.827 INFO:tasks.workunit.client.0.smithi043.stdout:1/115: symlink d1/d16/d1c/l20 0 2023-12-08T20:28:11.831 INFO:tasks.workunit.client.0.smithi043.stdout:6/83: sync 2023-12-08T20:28:11.831 INFO:tasks.workunit.client.0.smithi043.stdout:6/84: dread - d0/d2/f1f zero size 2023-12-08T20:28:11.833 INFO:tasks.workunit.client.0.smithi043.stdout:6/85: mkdir d0/d2/d14/d1c/d22 0 2023-12-08T20:28:11.835 INFO:tasks.workunit.client.0.smithi043.stdout:6/86: creat d0/d2/d14/d8/f23 x:0 0 0 2023-12-08T20:28:11.835 INFO:tasks.workunit.client.0.smithi043.stdout:6/87: dread - d0/d2/f1f zero size 2023-12-08T20:28:11.836 INFO:tasks.workunit.client.0.smithi043.stdout:7/71: getdents d0/d6 0 2023-12-08T20:28:11.836 INFO:tasks.workunit.client.0.smithi043.stdout:7/72: chown d0/d2/fc 0 1 2023-12-08T20:28:11.836 INFO:tasks.workunit.client.0.smithi043.stdout:7/73: chown d0/d6/d8/f15 3 1 2023-12-08T20:28:11.839 INFO:tasks.workunit.client.0.smithi043.stdout:8/118: dread d2/f3 [0,4194304] 0 2023-12-08T20:28:11.840 INFO:tasks.workunit.client.0.smithi043.stdout:8/119: readlink d2/d18/l1b 0 2023-12-08T20:28:11.840 INFO:tasks.workunit.client.0.smithi043.stdout:8/120: chown d2/f9 673336771 1 2023-12-08T20:28:11.841 INFO:tasks.workunit.client.0.smithi043.stdout:8/121: mkdir d2/d27 0 2023-12-08T20:28:11.841 INFO:tasks.workunit.client.0.smithi043.stdout:8/122: truncate d2/d18/f1f 2065169 0 2023-12-08T20:28:11.842 INFO:tasks.workunit.client.0.smithi043.stdout:8/123: getdents d2/d20 0 2023-12-08T20:28:11.845 INFO:tasks.workunit.client.0.smithi043.stdout:8/124: stat d2/de/f14 0 2023-12-08T20:28:11.846 INFO:tasks.workunit.client.0.smithi043.stdout:6/88: dread d0/d2/d14/d20/ff [0,4194304] 0 2023-12-08T20:28:11.848 INFO:tasks.workunit.client.0.smithi043.stdout:6/89: symlink d0/d2/d14/d1c/d22/l24 0 2023-12-08T20:28:11.848 INFO:tasks.workunit.client.0.smithi043.stdout:6/90: fdatasync d0/f1d 0 2023-12-08T20:28:11.850 INFO:tasks.workunit.client.0.smithi043.stdout:1/116: dwrite d1/f1d [0,4194304] 0 2023-12-08T20:28:11.852 INFO:tasks.workunit.client.0.smithi043.stdout:6/91: mknod d0/d2/c25 0 2023-12-08T20:28:11.852 INFO:tasks.workunit.client.0.smithi043.stdout:6/92: chown d0/d2/d14/d1c/l10 185 1 2023-12-08T20:28:11.854 INFO:tasks.workunit.client.0.smithi043.stdout:1/117: mkdir d1/d16/d21 0 2023-12-08T20:28:11.854 INFO:tasks.workunit.client.0.smithi043.stdout:8/125: dwrite d2/de/f26 [0,4194304] 0 2023-12-08T20:28:11.855 INFO:tasks.workunit.client.0.smithi043.stdout:6/93: rename d0/d2/d14/d1c/d22/l24 to d0/d2/d14/l26 0 2023-12-08T20:28:11.856 INFO:tasks.workunit.client.0.smithi043.stdout:6/94: write d0/d2/d14/d1c/f19 [2593855,116001] 0 2023-12-08T20:28:11.858 INFO:tasks.workunit.client.0.smithi043.stdout:8/126: mknod d2/d27/c28 0 2023-12-08T20:28:11.859 INFO:tasks.workunit.client.0.smithi043.stdout:1/118: rename d1/d6/f9 to d1/d16/d21/f22 0 2023-12-08T20:28:11.859 INFO:tasks.workunit.client.0.smithi043.stdout:1/119: chown d1/d6/ce 161113 1 2023-12-08T20:28:11.860 INFO:tasks.workunit.client.0.smithi043.stdout:6/95: creat d0/d2/d14/d8/f27 x:0 0 0 2023-12-08T20:28:11.860 INFO:tasks.workunit.client.0.smithi043.stdout:6/96: write d0/d2/d14/d8/f27 [230315,54302] 0 2023-12-08T20:28:11.861 INFO:tasks.workunit.client.0.smithi043.stdout:8/127: mkdir d2/de/d29 0 2023-12-08T20:28:11.862 INFO:tasks.workunit.client.0.smithi043.stdout:1/120: creat d1/f23 x:0 0 0 2023-12-08T20:28:11.863 INFO:tasks.workunit.client.0.smithi043.stdout:1/121: mkdir d1/d16/d21/d24 0 2023-12-08T20:28:11.864 INFO:tasks.workunit.client.0.smithi043.stdout:1/122: read - d1/f23 zero size 2023-12-08T20:28:11.864 INFO:tasks.workunit.client.0.smithi043.stdout:1/123: chown d1/d16/d21 29 1 2023-12-08T20:28:11.864 INFO:tasks.workunit.client.0.smithi043.stdout:1/124: stat d1/d16/c17 0 2023-12-08T20:28:11.866 INFO:tasks.workunit.client.0.smithi043.stdout:1/125: write d1/f1d [3997324,58153] 0 2023-12-08T20:28:11.866 INFO:tasks.workunit.client.0.smithi043.stdout:1/126: dread - d1/d16/f18 zero size 2023-12-08T20:28:11.869 INFO:tasks.workunit.client.0.smithi043.stdout:6/97: dread d0/d2/d14/f18 [0,4194304] 0 2023-12-08T20:28:11.869 INFO:tasks.workunit.client.0.smithi043.stdout:6/98: truncate d0/d2/f1f 53251 0 2023-12-08T20:28:11.890 INFO:tasks.workunit.client.0.smithi043.stdout:8/128: dwrite d2/d20/f23 [4194304,4194304] 0 2023-12-08T20:28:11.890 INFO:tasks.workunit.client.0.smithi043.stdout:1/127: dwrite d1/f2 [0,4194304] 0 2023-12-08T20:28:11.890 INFO:tasks.workunit.client.0.smithi043.stdout:1/128: write d1/fb [1126169,44265] 0 2023-12-08T20:28:11.890 INFO:tasks.workunit.client.0.smithi043.stdout:1/129: truncate d1/d6/f1b 9040251 0 2023-12-08T20:28:11.891 INFO:tasks.workunit.client.0.smithi043.stdout:6/99: dwrite d0/f1d [0,4194304] 0 2023-12-08T20:28:11.893 INFO:tasks.workunit.client.0.smithi043.stdout:6/100: creat d0/d2/f28 x:0 0 0 2023-12-08T20:28:11.894 INFO:tasks.workunit.client.0.smithi043.stdout:6/101: mkdir d0/d2/d29 0 2023-12-08T20:28:11.895 INFO:tasks.workunit.client.0.smithi043.stdout:6/102: mkdir d0/d2/d14/d1c/d22/d2a 0 2023-12-08T20:28:11.895 INFO:tasks.workunit.client.0.smithi043.stdout:6/103: chown d0/d2/d14/d1c/f19 489519249 1 2023-12-08T20:28:11.895 INFO:tasks.workunit.client.0.smithi043.stdout:6/104: read d0/d2/d14/d8/f27 [269463,80807] 0 2023-12-08T20:28:11.895 INFO:tasks.workunit.client.0.smithi043.stdout:6/105: readlink d0/l1 0 2023-12-08T20:28:11.896 INFO:tasks.workunit.client.0.smithi043.stdout:6/106: creat d0/f2b x:0 0 0 2023-12-08T20:28:11.896 INFO:tasks.workunit.client.0.smithi043.stdout:6/107: read d0/d2/d14/d8/f1e [530772,49280] 0 2023-12-08T20:28:11.900 INFO:tasks.workunit.client.0.smithi043.stdout:1/130: fsync d1/d16/d21/f22 0 2023-12-08T20:28:11.904 INFO:tasks.workunit.client.0.smithi043.stdout:6/108: rename d0/d2/d14/d1c to d0/d2/d14/d2c 0 2023-12-08T20:28:11.904 INFO:tasks.workunit.client.0.smithi043.stdout:6/109: write d0/d2/d14/d8/f23 [34249,23050] 0 2023-12-08T20:28:11.905 INFO:tasks.workunit.client.0.smithi043.stdout:8/129: dread d2/de/ff [0,4194304] 0 2023-12-08T20:28:11.907 INFO:tasks.workunit.client.0.smithi043.stdout:8/130: creat d2/de/f2a x:0 0 0 2023-12-08T20:28:11.907 INFO:tasks.workunit.client.0.smithi043.stdout:8/131: chown d2/c22 159036127 1 2023-12-08T20:28:11.908 INFO:tasks.workunit.client.0.smithi043.stdout:8/132: creat d2/d20/f2b x:0 0 0 2023-12-08T20:28:11.908 INFO:tasks.workunit.client.0.smithi043.stdout:8/133: chown d2/de/l16 664 1 2023-12-08T20:28:11.909 INFO:tasks.workunit.client.0.smithi043.stdout:8/134: write d2/f9 [2214966,70155] 0 2023-12-08T20:28:11.910 INFO:tasks.workunit.client.0.smithi043.stdout:8/135: creat d2/d20/f2c x:0 0 0 2023-12-08T20:28:11.921 INFO:tasks.workunit.client.0.smithi043.stdout:8/136: dread d2/de/ff [0,4194304] 0 2023-12-08T20:28:11.921 INFO:tasks.workunit.client.0.smithi043.stdout:8/137: write d2/d20/f2b [378299,9643] 0 2023-12-08T20:28:11.923 INFO:tasks.workunit.client.0.smithi043.stdout:6/110: dwrite d0/d2/f12 [0,4194304] 0 2023-12-08T20:28:11.925 INFO:tasks.workunit.client.0.smithi043.stdout:8/138: rmdir d2/de 39 2023-12-08T20:28:11.925 INFO:tasks.workunit.client.0.smithi043.stdout:8/139: stat d2/d4/c1a 0 2023-12-08T20:28:11.925 INFO:tasks.workunit.client.0.smithi043.stdout:8/140: truncate d2/d20/f2c 149213 0 2023-12-08T20:28:11.925 INFO:tasks.workunit.client.0.smithi043.stdout:8/141: chown d2/f9 11486 1 2023-12-08T20:28:11.927 INFO:tasks.workunit.client.0.smithi043.stdout:6/111: symlink d0/d2/de/l2d 0 2023-12-08T20:28:11.927 INFO:tasks.workunit.client.0.smithi043.stdout:6/112: fdatasync d0/d2/f12 0 2023-12-08T20:28:11.928 INFO:tasks.workunit.client.0.smithi043.stdout:8/142: truncate d2/de/f26 1140615 0 2023-12-08T20:28:11.928 INFO:tasks.workunit.client.0.smithi043.stdout:6/113: write d0/f1d [2199743,118209] 0 2023-12-08T20:28:11.928 INFO:tasks.workunit.client.0.smithi043.stdout:6/114: write d0/d2/d14/d20/ff [2892284,459] 0 2023-12-08T20:28:11.931 INFO:tasks.workunit.client.0.smithi043.stdout:8/143: dread d2/d18/f1f [0,4194304] 0 2023-12-08T20:28:11.932 INFO:tasks.workunit.client.0.smithi043.stdout:6/115: fdatasync d0/f1d 0 2023-12-08T20:28:11.933 INFO:tasks.workunit.client.0.smithi043.stdout:6/116: mknod d0/d2/d14/d8/c2e 0 2023-12-08T20:28:11.933 INFO:tasks.workunit.client.0.smithi043.stdout:6/117: truncate d0/d2/d14/f18 4768182 0 2023-12-08T20:28:11.936 INFO:tasks.workunit.client.0.smithi043.stdout:6/118: dread d0/d2/d14/f18 [4194304,4194304] 0 2023-12-08T20:28:11.937 INFO:tasks.workunit.client.0.smithi043.stdout:6/119: rename d0/d2/d14/d2c/l10 to d0/d2/d14/d2c/d22/d2a/l2f 0 2023-12-08T20:28:11.939 INFO:tasks.workunit.client.0.smithi043.stdout:6/120: creat d0/d2/d14/f30 x:0 0 0 2023-12-08T20:28:11.940 INFO:tasks.workunit.client.0.smithi043.stdout:6/121: mknod d0/d2/c31 0 2023-12-08T20:28:11.942 INFO:tasks.workunit.client.0.smithi043.stdout:6/122: unlink d0/d2/d14/d8/c1a 0 2023-12-08T20:28:11.942 INFO:tasks.workunit.client.0.smithi043.stdout:6/123: dread - d0/d2/f28 zero size 2023-12-08T20:28:11.944 INFO:tasks.workunit.client.0.smithi043.stdout:6/124: rename d0/d2/d14/d8/f27 to d0/d2/d14/d2c/d22/f32 0 2023-12-08T20:28:11.945 INFO:tasks.workunit.client.0.smithi043.stdout:6/125: creat d0/d2/d14/d8/f33 x:0 0 0 2023-12-08T20:28:11.946 INFO:tasks.workunit.client.0.smithi043.stdout:6/126: creat d0/f34 x:0 0 0 2023-12-08T20:28:11.949 INFO:tasks.workunit.client.0.smithi043.stdout:6/127: rename d0/d2/d14/d2c/f19 to d0/f35 0 2023-12-08T20:28:11.949 INFO:tasks.workunit.client.0.smithi043.stdout:6/128: getdents d0/d2/d29 0 2023-12-08T20:28:11.951 INFO:tasks.workunit.client.0.smithi043.stdout:8/144: dwrite d2/f3 [0,4194304] 0 2023-12-08T20:28:11.954 INFO:tasks.workunit.client.0.smithi043.stdout:8/145: mkdir d2/d27/d2d 0 2023-12-08T20:28:11.959 INFO:tasks.workunit.client.0.smithi043.stdout:6/129: truncate d0/d2/d14/f18 2430907 0 2023-12-08T20:28:11.959 INFO:tasks.workunit.client.0.smithi043.stdout:6/130: chown d0/d2/d14/d2c/d22/f32 76376086 1 2023-12-08T20:28:11.961 INFO:tasks.workunit.client.0.smithi043.stdout:8/146: rmdir d2 39 2023-12-08T20:28:11.961 INFO:tasks.workunit.client.0.smithi043.stdout:6/131: write d0/d2/d14/f18 [3117466,57578] 0 2023-12-08T20:28:11.961 INFO:tasks.workunit.client.0.smithi043.stdout:8/147: write d2/f9 [2935113,93129] 0 2023-12-08T20:28:11.962 INFO:tasks.workunit.client.0.smithi043.stdout:6/132: creat d0/d2/f36 x:0 0 0 2023-12-08T20:28:11.963 INFO:tasks.workunit.client.0.smithi043.stdout:8/148: creat d2/d4/f2e x:0 0 0 2023-12-08T20:28:11.964 INFO:tasks.workunit.client.0.smithi043.stdout:6/133: symlink d0/l37 0 2023-12-08T20:28:11.964 INFO:tasks.workunit.client.0.smithi043.stdout:8/149: symlink d2/d27/d2d/l2f 0 2023-12-08T20:28:11.966 INFO:tasks.workunit.client.0.smithi043.stdout:6/134: symlink d0/d2/l38 0 2023-12-08T20:28:11.966 INFO:tasks.workunit.client.0.smithi043.stdout:6/135: fsync d0/d2/f12 0 2023-12-08T20:28:11.966 INFO:tasks.workunit.client.0.smithi043.stdout:6/136: chown d0/d2/d14/d2c/d22 0 1 2023-12-08T20:28:11.967 INFO:tasks.workunit.client.0.smithi043.stdout:8/150: mkdir d2/de/d29/d30 0 2023-12-08T20:28:11.968 INFO:tasks.workunit.client.0.smithi043.stdout:6/137: truncate d0/d2/f12 3284268 0 2023-12-08T20:28:11.968 INFO:tasks.workunit.client.0.smithi043.stdout:6/138: read - d0/d2/d14/d8/f33 zero size 2023-12-08T20:28:11.969 INFO:tasks.workunit.client.0.smithi043.stdout:8/151: mkdir d2/d27/d2d/d31 0 2023-12-08T20:28:11.970 INFO:tasks.workunit.client.0.smithi043.stdout:6/139: mknod d0/d2/d29/c39 0 2023-12-08T20:28:11.970 INFO:tasks.workunit.client.0.smithi043.stdout:8/152: mkdir d2/d18/d32 0 2023-12-08T20:28:11.971 INFO:tasks.workunit.client.0.smithi043.stdout:8/153: stat d2/de/d29 0 2023-12-08T20:28:11.972 INFO:tasks.workunit.client.0.smithi043.stdout:6/140: symlink d0/d2/de/l3a 0 2023-12-08T20:28:11.975 INFO:tasks.workunit.client.0.smithi043.stdout:8/154: rename d2/d18/c24 to d2/d20/c33 0 2023-12-08T20:28:11.975 INFO:tasks.workunit.client.0.smithi043.stdout:8/155: write d2/d20/f2c [165344,2887] 0 2023-12-08T20:28:11.977 INFO:tasks.workunit.client.0.smithi043.stdout:8/156: rename d2/d4/l15 to d2/de/d29/d30/l34 0 2023-12-08T20:28:11.979 INFO:tasks.workunit.client.0.smithi043.stdout:8/157: creat d2/d27/f35 x:0 0 0 2023-12-08T20:28:11.979 INFO:tasks.workunit.client.0.smithi043.stdout:8/158: truncate d2/d18/f1f 3052757 0 2023-12-08T20:28:11.987 INFO:tasks.workunit.client.0.smithi043.stdout:8/159: dread d2/f3 [4194304,4194304] 0 2023-12-08T20:28:11.996 INFO:tasks.workunit.client.0.smithi043.stdout:8/160: dread d2/de/ff [0,4194304] 0 2023-12-08T20:28:11.999 INFO:tasks.workunit.client.0.smithi043.stdout:8/161: creat d2/d27/d2d/d31/f36 x:0 0 0 2023-12-08T20:28:12.017 INFO:tasks.workunit.client.0.smithi043.stdout:8/162: dwrite d2/de/f2a [0,4194304] 0 2023-12-08T20:28:12.018 INFO:tasks.workunit.client.0.smithi043.stdout:8/163: write d2/d18/f1f [654412,36569] 0 2023-12-08T20:28:12.018 INFO:tasks.workunit.client.0.smithi043.stdout:8/164: dread - d2/d27/f35 zero size 2023-12-08T20:28:12.021 INFO:tasks.workunit.client.0.smithi043.stdout:8/165: rename d2/d18 to d2/de/d37 0 2023-12-08T20:28:12.021 INFO:tasks.workunit.client.0.smithi043.stdout:8/166: dread - d2/d4/f2e zero size 2023-12-08T20:28:12.022 INFO:tasks.workunit.client.0.smithi043.stdout:8/167: dread - d2/f1e zero size 2023-12-08T20:28:12.025 INFO:tasks.workunit.client.0.smithi043.stdout:8/168: dread d2/de/f26 [0,4194304] 0 2023-12-08T20:28:12.026 INFO:tasks.workunit.client.0.smithi043.stdout:8/169: mknod d2/d27/c38 0 2023-12-08T20:28:12.055 INFO:tasks.workunit.client.0.smithi043.stdout:0/129: sync 2023-12-08T20:28:12.056 INFO:tasks.workunit.client.0.smithi043.stdout:0/130: mknod d2/d3/d6/c29 0 2023-12-08T20:28:12.056 INFO:tasks.workunit.client.0.smithi043.stdout:0/131: readlink d2/l13 0 2023-12-08T20:28:12.056 INFO:tasks.workunit.client.0.smithi043.stdout:0/132: stat d2/d4/l1f 0 2023-12-08T20:28:12.057 INFO:tasks.workunit.client.0.smithi043.stdout:0/133: dread d2/f24 [0,4194304] 0 2023-12-08T20:28:12.080 INFO:tasks.workunit.client.0.smithi043.stdout:0/134: dwrite d2/d4/fc [0,4194304] 0 2023-12-08T20:28:12.082 INFO:tasks.workunit.client.0.smithi043.stdout:0/135: rename d2/d3/fa to d2/d3/d18/f2a 0 2023-12-08T20:28:12.084 INFO:tasks.workunit.client.0.smithi043.stdout:0/136: mkdir d2/d3/d18/d2b 0 2023-12-08T20:28:12.085 INFO:tasks.workunit.client.0.smithi043.stdout:0/137: read d2/d3/d15/f20 [1154994,22250] 0 2023-12-08T20:28:12.095 INFO:tasks.workunit.client.0.smithi043.stdout:0/138: dread d2/d4/f26 [0,4194304] 0 2023-12-08T20:28:12.096 INFO:tasks.workunit.client.0.smithi043.stdout:0/139: rmdir d2/d3/d18 39 2023-12-08T20:28:12.098 INFO:tasks.workunit.client.0.smithi043.stdout:0/140: mknod d2/c2c 0 2023-12-08T20:28:12.992 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:12 smithi043 ceph-mon[111966]: pgmap v27: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 74 MiB/s rd, 162 MiB/s wr, 612 op/s 2023-12-08T20:28:13.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:12 smithi111 ceph-mon[121341]: pgmap v27: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 74 MiB/s rd, 162 MiB/s wr, 612 op/s 2023-12-08T20:28:13.988 INFO:tasks.workunit.client.0.smithi043.stdout:5/145: sync 2023-12-08T20:28:13.988 INFO:tasks.workunit.client.0.smithi043.stdout:8/170: sync 2023-12-08T20:28:13.989 INFO:tasks.workunit.client.0.smithi043.stdout:2/125: sync 2023-12-08T20:28:13.989 INFO:tasks.workunit.client.0.smithi043.stdout:9/166: sync 2023-12-08T20:28:13.989 INFO:tasks.workunit.client.0.smithi043.stdout:3/131: sync 2023-12-08T20:28:13.989 INFO:tasks.workunit.client.0.smithi043.stdout:4/141: sync 2023-12-08T20:28:13.989 INFO:tasks.workunit.client.0.smithi043.stdout:4/142: fdatasync d1/d14/f19 0 2023-12-08T20:28:13.989 INFO:tasks.workunit.client.0.smithi043.stdout:4/143: dread - d1/d14/d25/f2f zero size 2023-12-08T20:28:13.989 INFO:tasks.workunit.client.0.smithi043.stdout:0/141: sync 2023-12-08T20:28:13.989 INFO:tasks.workunit.client.0.smithi043.stdout:6/141: sync 2023-12-08T20:28:13.989 INFO:tasks.workunit.client.0.smithi043.stdout:1/131: sync 2023-12-08T20:28:13.989 INFO:tasks.workunit.client.0.smithi043.stdout:0/142: fdatasync d2/f8 0 2023-12-08T20:28:13.989 INFO:tasks.workunit.client.0.smithi043.stdout:7/74: sync 2023-12-08T20:28:13.989 INFO:tasks.workunit.client.0.smithi043.stdout:1/132: write d1/f1d [4338409,48342] 0 2023-12-08T20:28:13.989 INFO:tasks.workunit.client.0.smithi043.stdout:3/132: write d1/d9/f1a [487506,42745] 0 2023-12-08T20:28:13.989 INFO:tasks.workunit.client.0.smithi043.stdout:3/133: write d1/d25/f24 [707870,75280] 0 2023-12-08T20:28:13.990 INFO:tasks.workunit.client.0.smithi043.stdout:8/171: dread d2/d20/f2b [0,4194304] 0 2023-12-08T20:28:13.990 INFO:tasks.workunit.client.0.smithi043.stdout:8/172: fdatasync d2/de/f14 0 2023-12-08T20:28:13.990 INFO:tasks.workunit.client.0.smithi043.stdout:8/173: write d2/f25 [16656,127312] 0 2023-12-08T20:28:13.991 INFO:tasks.workunit.client.0.smithi043.stdout:8/174: write d2/f1e [935611,12923] 0 2023-12-08T20:28:13.991 INFO:tasks.workunit.client.0.smithi043.stdout:2/126: mkdir d0/d2b 0 2023-12-08T20:28:13.991 INFO:tasks.workunit.client.0.smithi043.stdout:4/144: creat d1/d14/d25/d28/f34 x:0 0 0 2023-12-08T20:28:13.991 INFO:tasks.workunit.client.0.smithi043.stdout:4/145: write d1/d14/d1d/fb [655055,90886] 0 2023-12-08T20:28:13.991 INFO:tasks.workunit.client.0.smithi043.stdout:9/167: symlink d0/d2e/l30 0 2023-12-08T20:28:13.991 INFO:tasks.workunit.client.0.smithi043.stdout:6/142: rmdir d0/d2/d29 39 2023-12-08T20:28:13.994 INFO:tasks.workunit.client.0.smithi043.stdout:7/75: rmdir d0/d2/d16 0 2023-12-08T20:28:13.994 INFO:tasks.workunit.client.0.smithi043.stdout:7/76: truncate d0/d2/fc 1243091 0 2023-12-08T20:28:13.994 INFO:tasks.workunit.client.0.smithi043.stdout:7/77: chown d0/d6/d8/l13 128275 1 2023-12-08T20:28:13.994 INFO:tasks.workunit.client.0.smithi043.stdout:7/78: chown d0/c4 68393 1 2023-12-08T20:28:13.994 INFO:tasks.workunit.client.0.smithi043.stdout:7/79: dread - d0/d6/d8/f9 zero size 2023-12-08T20:28:13.994 INFO:tasks.workunit.client.0.smithi043.stdout:7/80: read - d0/d6/f18 zero size 2023-12-08T20:28:13.995 INFO:tasks.workunit.client.0.smithi043.stdout:7/81: write d0/d6/d8/f10 [1111855,20391] 0 2023-12-08T20:28:13.995 INFO:tasks.workunit.client.0.smithi043.stdout:0/143: symlink d2/d3/d18/l2d 0 2023-12-08T20:28:14.000 INFO:tasks.workunit.client.0.smithi043.stdout:3/134: symlink d1/d9/df/d26/l27 0 2023-12-08T20:28:14.001 INFO:tasks.workunit.client.0.smithi043.stdout:4/146: creat d1/d14/d25/d28/f35 x:0 0 0 2023-12-08T20:28:14.002 INFO:tasks.workunit.client.0.smithi043.stdout:9/168: creat d0/d21/f31 x:0 0 0 2023-12-08T20:28:14.002 INFO:tasks.workunit.client.0.smithi043.stdout:1/133: dread d1/d6/f1b [0,4194304] 0 2023-12-08T20:28:14.006 INFO:tasks.workunit.client.0.smithi043.stdout:5/146: dread d3/fc [4194304,4194304] 0 2023-12-08T20:28:14.007 INFO:tasks.workunit.client.0.smithi043.stdout:6/143: rmdir d0 39 2023-12-08T20:28:14.007 INFO:tasks.workunit.client.0.smithi043.stdout:7/82: mkdir d0/d2/d12/d19 0 2023-12-08T20:28:14.009 INFO:tasks.workunit.client.0.smithi043.stdout:0/144: creat d2/d3/d6/f2e x:0 0 0 2023-12-08T20:28:14.009 INFO:tasks.workunit.client.0.smithi043.stdout:4/147: mkdir d1/d36 0 2023-12-08T20:28:14.009 INFO:tasks.workunit.client.0.smithi043.stdout:4/148: readlink d1/d14/l20 0 2023-12-08T20:28:14.009 INFO:tasks.workunit.client.0.smithi043.stdout:7/83: write d0/d6/d8/f15 [1936788,10047] 0 2023-12-08T20:28:14.011 INFO:tasks.workunit.client.0.smithi043.stdout:9/169: mknod d0/d2e/c32 0 2023-12-08T20:28:14.011 INFO:tasks.workunit.client.0.smithi043.stdout:1/134: rmdir d1/d16/d21/d24 0 2023-12-08T20:28:14.015 INFO:tasks.workunit.client.0.smithi043.stdout:5/147: write d3/d7/de/f10 [490470,111312] 0 2023-12-08T20:28:14.017 INFO:tasks.workunit.client.0.smithi043.stdout:3/135: mkdir d1/d28 0 2023-12-08T20:28:14.017 INFO:tasks.workunit.client.0.smithi043.stdout:3/136: truncate d1/f1e 988144 0 2023-12-08T20:28:14.017 INFO:tasks.workunit.client.0.smithi043.stdout:7/84: creat d0/d6/f1a x:0 0 0 2023-12-08T20:28:14.017 INFO:tasks.workunit.client.0.smithi043.stdout:8/175: dwrite d2/de/ff [0,4194304] 0 2023-12-08T20:28:14.017 INFO:tasks.workunit.client.0.smithi043.stdout:8/176: chown d2/de/l16 16313682 1 2023-12-08T20:28:14.018 INFO:tasks.workunit.client.0.smithi043.stdout:1/135: getdents d1 0 2023-12-08T20:28:14.022 INFO:tasks.workunit.client.0.smithi043.stdout:5/148: rename d3/d7/de/f10 to d3/d7/de/f2a 0 2023-12-08T20:28:14.025 INFO:tasks.workunit.client.0.smithi043.stdout:7/85: creat d0/f1b x:0 0 0 2023-12-08T20:28:14.025 INFO:tasks.workunit.client.0.smithi043.stdout:1/136: mkdir d1/d16/d21/d25 0 2023-12-08T20:28:14.025 INFO:tasks.workunit.client.0.smithi043.stdout:3/137: mkdir d1/d1c/d29 0 2023-12-08T20:28:14.025 INFO:tasks.workunit.client.0.smithi043.stdout:3/138: readlink d1/d9/l23 0 2023-12-08T20:28:14.025 INFO:tasks.workunit.client.0.smithi043.stdout:0/145: write d2/d3/f1a [434670,120525] 0 2023-12-08T20:28:14.028 INFO:tasks.workunit.client.0.smithi043.stdout:2/127: dwrite d0/db/f19 [0,4194304] 0 2023-12-08T20:28:14.030 INFO:tasks.workunit.client.0.smithi043.stdout:1/137: mknod d1/d6/c26 0 2023-12-08T20:28:14.034 INFO:tasks.workunit.client.0.smithi043.stdout:2/128: creat d0/d20/f2c x:0 0 0 2023-12-08T20:28:14.035 INFO:tasks.workunit.client.0.smithi043.stdout:6/144: dread d0/f1d [0,4194304] 0 2023-12-08T20:28:14.035 INFO:tasks.workunit.client.0.smithi043.stdout:8/177: dread d2/d20/f23 [0,4194304] 0 2023-12-08T20:28:14.036 INFO:tasks.workunit.client.0.smithi043.stdout:6/145: truncate d0/f1d 993588 0 2023-12-08T20:28:14.037 INFO:tasks.workunit.client.0.smithi043.stdout:6/146: getdents d0/d2/d14/d2c/d22/d2a 0 2023-12-08T20:28:14.037 INFO:tasks.workunit.client.0.smithi043.stdout:6/147: dread - d0/d2/d14/f30 zero size 2023-12-08T20:28:14.037 INFO:tasks.workunit.client.0.smithi043.stdout:6/148: fsync d0/d2/f28 0 2023-12-08T20:28:14.037 INFO:tasks.workunit.client.0.smithi043.stdout:9/170: dread d0/f1e [0,4194304] 0 2023-12-08T20:28:14.044 INFO:tasks.workunit.client.0.smithi043.stdout:6/149: creat d0/d2/d14/d2c/f3b x:0 0 0 2023-12-08T20:28:14.045 INFO:tasks.workunit.client.0.smithi043.stdout:6/150: chown d0/d2/de/l2d 1869716626 1 2023-12-08T20:28:14.045 INFO:tasks.workunit.client.0.smithi043.stdout:6/151: chown d0/d2/d14/c11 6580631 1 2023-12-08T20:28:14.045 INFO:tasks.workunit.client.0.smithi043.stdout:9/171: creat d0/d2e/f33 x:0 0 0 2023-12-08T20:28:14.045 INFO:tasks.workunit.client.0.smithi043.stdout:6/152: dread d0/d2/d14/d8/f23 [0,4194304] 0 2023-12-08T20:28:14.045 INFO:tasks.workunit.client.0.smithi043.stdout:6/153: read - d0/d2/d14/f30 zero size 2023-12-08T20:28:14.045 INFO:tasks.workunit.client.0.smithi043.stdout:3/139: dread d1/f18 [0,4194304] 0 2023-12-08T20:28:14.045 INFO:tasks.workunit.client.0.smithi043.stdout:9/172: rename d0/f2c to d0/f34 0 2023-12-08T20:28:14.046 INFO:tasks.workunit.client.0.smithi043.stdout:0/146: fsync d2/d3/f1a 0 2023-12-08T20:28:14.046 INFO:tasks.workunit.client.0.smithi043.stdout:6/154: unlink d0/d2/c21 0 2023-12-08T20:28:14.047 INFO:tasks.workunit.client.0.smithi043.stdout:9/173: creat d0/d21/f35 x:0 0 0 2023-12-08T20:28:14.048 INFO:tasks.workunit.client.0.smithi043.stdout:0/147: mknod d2/d4/c2f 0 2023-12-08T20:28:14.049 INFO:tasks.workunit.client.0.smithi043.stdout:0/148: chown d2/d3/d6 140 1 2023-12-08T20:28:14.050 INFO:tasks.workunit.client.0.smithi043.stdout:0/149: rmdir d2/d3 39 2023-12-08T20:28:14.051 INFO:tasks.workunit.client.0.smithi043.stdout:4/149: dwrite d1/d14/f31 [0,4194304] 0 2023-12-08T20:28:14.053 INFO:tasks.workunit.client.0.smithi043.stdout:0/150: creat d2/d4/f30 x:0 0 0 2023-12-08T20:28:14.057 INFO:tasks.workunit.client.0.smithi043.stdout:4/150: symlink d1/d14/d25/d28/l37 0 2023-12-08T20:28:14.068 INFO:tasks.workunit.client.0.smithi043.stdout:5/149: dwrite d3/d7/f1a [0,4194304] 0 2023-12-08T20:28:14.068 INFO:tasks.workunit.client.0.smithi043.stdout:1/138: dwrite d1/d16/f18 [0,4194304] 0 2023-12-08T20:28:14.068 INFO:tasks.workunit.client.0.smithi043.stdout:8/178: write d2/d20/f23 [6538138,35387] 0 2023-12-08T20:28:14.070 INFO:tasks.workunit.client.0.smithi043.stdout:3/140: write d1/d25/f24 [31531,101392] 0 2023-12-08T20:28:14.073 INFO:tasks.workunit.client.0.smithi043.stdout:5/150: symlink d3/d7/d21/l2b 0 2023-12-08T20:28:14.074 INFO:tasks.workunit.client.0.smithi043.stdout:8/179: link d2/d4/f2e d2/d4/f39 0 2023-12-08T20:28:14.076 INFO:tasks.workunit.client.0.smithi043.stdout:3/141: mkdir d1/d25/d2a 0 2023-12-08T20:28:14.076 INFO:tasks.workunit.client.0.smithi043.stdout:3/142: chown d1/d9/f1a 68739 1 2023-12-08T20:28:14.077 INFO:tasks.workunit.client.0.smithi043.stdout:5/151: truncate d3/d7/de/f1e 1836022 0 2023-12-08T20:28:14.077 INFO:tasks.workunit.client.0.smithi043.stdout:3/143: symlink d1/d1c/l2b 0 2023-12-08T20:28:14.078 INFO:tasks.workunit.client.0.smithi043.stdout:3/144: chown d1/d9/df 0 1 2023-12-08T20:28:14.078 INFO:tasks.workunit.client.0.smithi043.stdout:3/145: dread - d1/d1c/f22 zero size 2023-12-08T20:28:14.080 INFO:tasks.workunit.client.0.smithi043.stdout:2/129: dwrite d0/db/f29 [0,4194304] 0 2023-12-08T20:28:14.081 INFO:tasks.workunit.client.0.smithi043.stdout:9/174: dwrite d0/f14 [0,4194304] 0 2023-12-08T20:28:14.083 INFO:tasks.workunit.client.0.smithi043.stdout:7/86: dwrite d0/d6/d8/f15 [0,4194304] 0 2023-12-08T20:28:14.084 INFO:tasks.workunit.client.0.smithi043.stdout:2/130: creat d0/db/d18/f2d x:0 0 0 2023-12-08T20:28:14.084 INFO:tasks.workunit.client.0.smithi043.stdout:4/151: rmdir d1/d14/d25/d28 39 2023-12-08T20:28:14.084 INFO:tasks.workunit.client.0.smithi043.stdout:1/139: dwrite d1/d6/fa [0,4194304] 0 2023-12-08T20:28:14.085 INFO:tasks.workunit.client.0.smithi043.stdout:7/87: write d0/d2/fc [1080746,110411] 0 2023-12-08T20:28:14.086 INFO:tasks.workunit.client.0.smithi043.stdout:9/175: symlink d0/d2e/l36 0 2023-12-08T20:28:14.088 INFO:tasks.workunit.client.0.smithi043.stdout:1/140: write d1/d16/f18 [1869733,31252] 0 2023-12-08T20:28:14.088 INFO:tasks.workunit.client.0.smithi043.stdout:1/141: readlink d1/d6/l7 0 2023-12-08T20:28:14.088 INFO:tasks.workunit.client.0.smithi043.stdout:2/131: symlink d0/d20/l2e 0 2023-12-08T20:28:14.094 INFO:tasks.workunit.client.0.smithi043.stdout:0/151: dwrite d2/f7 [4194304,4194304] 0 2023-12-08T20:28:14.094 INFO:tasks.workunit.client.0.smithi043.stdout:0/152: readlink d2/d3/d15/l19 0 2023-12-08T20:28:14.094 INFO:tasks.workunit.client.0.smithi043.stdout:0/153: chown d2/c2c 446742 1 2023-12-08T20:28:14.094 INFO:tasks.workunit.client.0.smithi043.stdout:4/152: mknod d1/d14/d25/c38 0 2023-12-08T20:28:14.094 INFO:tasks.workunit.client.0.smithi043.stdout:7/88: rename d0/l3 to d0/d6/d17/l1c 0 2023-12-08T20:28:14.095 INFO:tasks.workunit.client.0.smithi043.stdout:9/176: dread d0/d21/f26 [0,4194304] 0 2023-12-08T20:28:14.095 INFO:tasks.workunit.client.0.smithi043.stdout:9/177: readlink d0/l11 0 2023-12-08T20:28:14.096 INFO:tasks.workunit.client.0.smithi043.stdout:1/142: symlink d1/d16/d1c/l27 0 2023-12-08T20:28:14.099 INFO:tasks.workunit.client.0.smithi043.stdout:2/132: mknod d0/d26/c2f 0 2023-12-08T20:28:14.101 INFO:tasks.workunit.client.0.smithi043.stdout:9/178: mkdir d0/d2e/d37 0 2023-12-08T20:28:14.101 INFO:tasks.workunit.client.0.smithi043.stdout:1/143: creat d1/d16/f28 x:0 0 0 2023-12-08T20:28:14.101 INFO:tasks.workunit.client.0.smithi043.stdout:0/154: dread d2/f24 [0,4194304] 0 2023-12-08T20:28:14.102 INFO:tasks.workunit.client.0.smithi043.stdout:0/155: dread - d2/d3/d6/f2e zero size 2023-12-08T20:28:14.105 INFO:tasks.workunit.client.0.smithi043.stdout:1/144: creat d1/d6/f29 x:0 0 0 2023-12-08T20:28:14.108 INFO:tasks.workunit.client.0.smithi043.stdout:1/145: creat d1/f2a x:0 0 0 2023-12-08T20:28:14.108 INFO:tasks.workunit.client.0.smithi043.stdout:7/89: dread d0/d6/d8/f10 [0,4194304] 0 2023-12-08T20:28:14.113 INFO:tasks.workunit.client.0.smithi043.stdout:5/152: dwrite d3/d7/f1a [0,4194304] 0 2023-12-08T20:28:14.113 INFO:tasks.workunit.client.0.smithi043.stdout:5/153: chown d3/d7/de 402345 1 2023-12-08T20:28:14.113 INFO:tasks.workunit.client.0.smithi043.stdout:5/154: chown d3/d7/d21/f28 15217 1 2023-12-08T20:28:14.113 INFO:tasks.workunit.client.0.smithi043.stdout:5/155: chown d3/d7/de/f2a 251072 1 2023-12-08T20:28:14.113 INFO:tasks.workunit.client.0.smithi043.stdout:5/156: chown d3/d7/d29 1 1 2023-12-08T20:28:14.118 INFO:tasks.workunit.client.0.smithi043.stdout:5/157: write f1 [4010839,21120] 0 2023-12-08T20:28:14.123 INFO:tasks.workunit.client.0.smithi043.stdout:7/90: dread d0/d6/d8/f15 [0,4194304] 0 2023-12-08T20:28:14.123 INFO:tasks.workunit.client.0.smithi043.stdout:7/91: fsync d0/fb 0 2023-12-08T20:28:14.127 INFO:tasks.workunit.client.0.smithi043.stdout:7/92: mknod d0/d6/d8/c1d 0 2023-12-08T20:28:14.129 INFO:tasks.workunit.client.0.smithi043.stdout:7/93: link d0/fb d0/d6/d8/f1e 0 2023-12-08T20:28:14.129 INFO:tasks.workunit.client.0.smithi043.stdout:7/94: fdatasync d0/d2/f5 0 2023-12-08T20:28:14.135 INFO:tasks.workunit.client.0.smithi043.stdout:2/133: dwrite d0/f28 [0,4194304] 0 2023-12-08T20:28:14.135 INFO:tasks.workunit.client.0.smithi043.stdout:2/134: chown d0/db/c11 215 1 2023-12-08T20:28:14.135 INFO:tasks.workunit.client.0.smithi043.stdout:4/153: dwrite d1/d14/d1d/fa [0,4194304] 0 2023-12-08T20:28:14.136 INFO:tasks.workunit.client.0.smithi043.stdout:5/158: dread d3/fc [0,4194304] 0 2023-12-08T20:28:14.136 INFO:tasks.workunit.client.0.smithi043.stdout:5/159: chown d3/d7/d21 8 1 2023-12-08T20:28:14.139 INFO:tasks.workunit.client.0.smithi043.stdout:4/154: mkdir d1/d14/d25/d39 0 2023-12-08T20:28:14.140 INFO:tasks.workunit.client.0.smithi043.stdout:9/179: dwrite d0/d2e/f33 [0,4194304] 0 2023-12-08T20:28:14.140 INFO:tasks.workunit.client.0.smithi043.stdout:9/180: rename d0 to d0/d2e/d38 22 2023-12-08T20:28:14.142 INFO:tasks.workunit.client.0.smithi043.stdout:5/160: mknod d3/d7/d29/c2c 0 2023-12-08T20:28:14.143 INFO:tasks.workunit.client.0.smithi043.stdout:9/181: getdents d0 0 2023-12-08T20:28:14.143 INFO:tasks.workunit.client.0.smithi043.stdout:1/146: dwrite d1/f1d [0,4194304] 0 2023-12-08T20:28:14.144 INFO:tasks.workunit.client.0.smithi043.stdout:1/147: chown d1/d16/d21/f22 704 1 2023-12-08T20:28:14.144 INFO:tasks.workunit.client.0.smithi043.stdout:1/148: chown d1/d16/cd 4 1 2023-12-08T20:28:14.145 INFO:tasks.workunit.client.0.smithi043.stdout:2/135: dread d0/f4 [0,4194304] 0 2023-12-08T20:28:14.145 INFO:tasks.workunit.client.0.smithi043.stdout:2/136: stat d0/d20/f2c 0 2023-12-08T20:28:14.145 INFO:tasks.workunit.client.0.smithi043.stdout:5/161: creat d3/d7/d21/f2d x:0 0 0 2023-12-08T20:28:14.145 INFO:tasks.workunit.client.0.smithi043.stdout:1/149: mknod d1/d16/d21/d25/c2b 0 2023-12-08T20:28:14.146 INFO:tasks.workunit.client.0.smithi043.stdout:1/150: chown d1/f23 6318 1 2023-12-08T20:28:14.149 INFO:tasks.workunit.client.0.smithi043.stdout:2/137: rename d0/db/l12 to d0/d26/l30 0 2023-12-08T20:28:14.149 INFO:tasks.workunit.client.0.smithi043.stdout:2/138: write d0/db/f1e [4991538,74309] 0 2023-12-08T20:28:14.149 INFO:tasks.workunit.client.0.smithi043.stdout:5/162: rename d3/d7/d29/c2c to d3/d7/d29/c2e 0 2023-12-08T20:28:14.151 INFO:tasks.workunit.client.0.smithi043.stdout:1/151: creat d1/f2c x:0 0 0 2023-12-08T20:28:14.154 INFO:tasks.workunit.client.0.smithi043.stdout:5/163: truncate f2 443812 0 2023-12-08T20:28:14.155 INFO:tasks.workunit.client.0.smithi043.stdout:1/152: mknod d1/d16/d21/d25/c2d 0 2023-12-08T20:28:14.159 INFO:tasks.workunit.client.0.smithi043.stdout:5/164: write d3/d7/f1a [471144,83522] 0 2023-12-08T20:28:14.169 INFO:tasks.workunit.client.0.smithi043.stdout:9/182: dwrite d0/f13 [0,4194304] 0 2023-12-08T20:28:14.169 INFO:tasks.workunit.client.0.smithi043.stdout:5/165: dread d3/fc [0,4194304] 0 2023-12-08T20:28:14.169 INFO:tasks.workunit.client.0.smithi043.stdout:5/166: readlink d3/l22 0 2023-12-08T20:28:14.169 INFO:tasks.workunit.client.0.smithi043.stdout:9/183: dread - d0/f29 zero size 2023-12-08T20:28:14.169 INFO:tasks.workunit.client.0.smithi043.stdout:9/184: readlink d0/d21/l24 0 2023-12-08T20:28:14.170 INFO:tasks.workunit.client.0.smithi043.stdout:4/155: dwrite d1/f1c [0,4194304] 0 2023-12-08T20:28:14.174 INFO:tasks.workunit.client.0.smithi043.stdout:2/139: dwrite d0/f21 [0,4194304] 0 2023-12-08T20:28:14.174 INFO:tasks.workunit.client.0.smithi043.stdout:4/156: creat d1/d36/f3a x:0 0 0 2023-12-08T20:28:14.174 INFO:tasks.workunit.client.0.smithi043.stdout:4/157: dread - d1/d14/d25/f2c zero size 2023-12-08T20:28:14.175 INFO:tasks.workunit.client.0.smithi043.stdout:5/167: rename d3/ca to d3/c2f 0 2023-12-08T20:28:14.179 INFO:tasks.workunit.client.0.smithi043.stdout:2/140: creat d0/db/f31 x:0 0 0 2023-12-08T20:28:14.179 INFO:tasks.workunit.client.0.smithi043.stdout:4/158: mknod d1/d14/d25/d39/c3b 0 2023-12-08T20:28:14.179 INFO:tasks.workunit.client.0.smithi043.stdout:4/159: truncate d1/d14/d25/d28/f34 642019 0 2023-12-08T20:28:14.182 INFO:tasks.workunit.client.0.smithi043.stdout:9/185: dread d0/d2e/f33 [0,4194304] 0 2023-12-08T20:28:14.188 INFO:tasks.workunit.client.0.smithi043.stdout:9/186: write d0/f1b [316191,89493] 0 2023-12-08T20:28:14.190 INFO:tasks.workunit.client.0.smithi043.stdout:9/187: symlink d0/d21/l39 0 2023-12-08T20:28:14.191 INFO:tasks.workunit.client.0.smithi043.stdout:9/188: readlink d0/d2e/l30 0 2023-12-08T20:28:14.195 INFO:tasks.workunit.client.0.smithi043.stdout:9/189: creat d0/d2e/d37/f3a x:0 0 0 2023-12-08T20:28:14.195 INFO:tasks.workunit.client.0.smithi043.stdout:9/190: chown d0/d21/l39 1593993 1 2023-12-08T20:28:14.199 INFO:tasks.workunit.client.0.smithi043.stdout:5/168: dwrite f2 [0,4194304] 0 2023-12-08T20:28:14.201 INFO:tasks.workunit.client.0.smithi043.stdout:5/169: creat d3/d7/d19/f30 x:0 0 0 2023-12-08T20:28:14.215 INFO:tasks.workunit.client.0.smithi043.stdout:2/141: dwrite d0/f25 [0,4194304] 0 2023-12-08T20:28:14.215 INFO:tasks.workunit.client.0.smithi043.stdout:4/160: dwrite d1/d14/d25/d28/f35 [0,4194304] 0 2023-12-08T20:28:14.215 INFO:tasks.workunit.client.0.smithi043.stdout:4/161: fdatasync d1/f23 0 2023-12-08T20:28:14.215 INFO:tasks.workunit.client.0.smithi043.stdout:9/191: dwrite d0/d2e/d37/f3a [0,4194304] 0 2023-12-08T20:28:14.215 INFO:tasks.workunit.client.0.smithi043.stdout:9/192: truncate d0/f29 226178 0 2023-12-08T20:28:14.216 INFO:tasks.workunit.client.0.smithi043.stdout:9/193: chown d0/f1d 63829306 1 2023-12-08T20:28:14.219 INFO:tasks.workunit.client.0.smithi043.stdout:2/142: link d0/db/f1e d0/d20/f32 0 2023-12-08T20:28:14.232 INFO:tasks.workunit.client.0.smithi043.stdout:9/194: dread d0/f14 [0,4194304] 0 2023-12-08T20:28:14.237 INFO:tasks.workunit.client.0.smithi043.stdout:9/195: symlink d0/d2e/l3b 0 2023-12-08T20:28:14.238 INFO:tasks.workunit.client.0.smithi043.stdout:5/170: dread d3/d7/f1a [0,4194304] 0 2023-12-08T20:28:14.238 INFO:tasks.workunit.client.0.smithi043.stdout:5/171: write d3/d7/d21/f28 [541233,44849] 0 2023-12-08T20:28:14.239 INFO:tasks.workunit.client.0.smithi043.stdout:9/196: link d0/d2e/d37/f3a d0/d2e/f3c 0 2023-12-08T20:28:14.240 INFO:tasks.workunit.client.0.smithi043.stdout:5/172: link d3/d7/de/f1e d3/d7/f31 0 2023-12-08T20:28:14.241 INFO:tasks.workunit.client.0.smithi043.stdout:9/197: unlink d0/l12 0 2023-12-08T20:28:14.241 INFO:tasks.workunit.client.0.smithi043.stdout:9/198: readlink d0/l11 0 2023-12-08T20:28:14.241 INFO:tasks.workunit.client.0.smithi043.stdout:9/199: write d0/f17 [971964,42167] 0 2023-12-08T20:28:14.241 INFO:tasks.workunit.client.0.smithi043.stdout:5/173: rmdir d3/d7/de/d17 39 2023-12-08T20:28:14.242 INFO:tasks.workunit.client.0.smithi043.stdout:2/143: dwrite d0/db/fd [0,4194304] 0 2023-12-08T20:28:14.244 INFO:tasks.workunit.client.0.smithi043.stdout:4/162: dwrite d1/f22 [0,4194304] 0 2023-12-08T20:28:14.244 INFO:tasks.workunit.client.0.smithi043.stdout:4/163: dread - d1/d14/d25/d28/f2e zero size 2023-12-08T20:28:14.244 INFO:tasks.workunit.client.0.smithi043.stdout:2/144: rename d0/f21 to d0/d2b/f33 0 2023-12-08T20:28:14.244 INFO:tasks.workunit.client.0.smithi043.stdout:2/145: chown d0/d26 14271 1 2023-12-08T20:28:14.247 INFO:tasks.workunit.client.0.smithi043.stdout:4/164: getdents d1/d36 0 2023-12-08T20:28:14.247 INFO:tasks.workunit.client.0.smithi043.stdout:4/165: readlink d1/l27 0 2023-12-08T20:28:14.249 INFO:tasks.workunit.client.0.smithi043.stdout:4/166: write d1/d14/f1a [3899529,45426] 0 2023-12-08T20:28:14.250 INFO:tasks.workunit.client.0.smithi043.stdout:2/146: creat d0/d26/f34 x:0 0 0 2023-12-08T20:28:14.252 INFO:tasks.workunit.client.0.smithi043.stdout:2/147: creat d0/d2b/f35 x:0 0 0 2023-12-08T20:28:14.258 INFO:tasks.workunit.client.0.smithi043.stdout:2/148: unlink d0/db/d18/f2d 0 2023-12-08T20:28:14.261 INFO:tasks.workunit.client.0.smithi043.stdout:2/149: unlink d0/db/f29 0 2023-12-08T20:28:14.262 INFO:tasks.workunit.client.0.smithi043.stdout:2/150: creat d0/db/d18/f36 x:0 0 0 2023-12-08T20:28:14.262 INFO:tasks.workunit.client.0.smithi043.stdout:2/151: fsync d0/db/f31 0 2023-12-08T20:28:14.262 INFO:tasks.workunit.client.0.smithi043.stdout:2/152: read d0/db/d18/f22 [328520,85124] 0 2023-12-08T20:28:14.271 INFO:tasks.workunit.client.0.smithi043.stdout:2/153: dread d0/fa [0,4194304] 0 2023-12-08T20:28:14.271 INFO:tasks.workunit.client.0.smithi043.stdout:2/154: chown d0/db/c15 28190 1 2023-12-08T20:28:14.271 INFO:tasks.workunit.client.0.smithi043.stdout:2/155: readlink d0/db/l1b 0 2023-12-08T20:28:14.272 INFO:tasks.workunit.client.0.smithi043.stdout:2/156: mkdir d0/d26/d37 0 2023-12-08T20:28:14.273 INFO:tasks.workunit.client.0.smithi043.stdout:5/174: dwrite d3/d7/de/d17/f27 [0,4194304] 0 2023-12-08T20:28:14.273 INFO:tasks.workunit.client.0.smithi043.stdout:5/175: write d3/d7/de/f24 [491781,83711] 0 2023-12-08T20:28:14.274 INFO:tasks.workunit.client.0.smithi043.stdout:2/157: write d0/f4 [3379458,6205] 0 2023-12-08T20:28:14.274 INFO:tasks.workunit.client.0.smithi043.stdout:5/176: mkdir d3/d32 0 2023-12-08T20:28:14.275 INFO:tasks.workunit.client.0.smithi043.stdout:2/158: mkdir d0/d26/d37/d38 0 2023-12-08T20:28:14.277 INFO:tasks.workunit.client.0.smithi043.stdout:2/159: mkdir d0/db/d18/d39 0 2023-12-08T20:28:14.277 INFO:tasks.workunit.client.0.smithi043.stdout:2/160: chown d0/d26/f27 18 1 2023-12-08T20:28:14.277 INFO:tasks.workunit.client.0.smithi043.stdout:2/161: read - d0/db/f14 zero size 2023-12-08T20:28:14.277 INFO:tasks.workunit.client.0.smithi043.stdout:2/162: chown d0/db/fd 49 1 2023-12-08T20:28:14.278 INFO:tasks.workunit.client.0.smithi043.stdout:9/200: dwrite d0/d21/f31 [0,4194304] 0 2023-12-08T20:28:14.280 INFO:tasks.workunit.client.0.smithi043.stdout:2/163: rmdir d0/db/d18/d39 0 2023-12-08T20:28:14.284 INFO:tasks.workunit.client.0.smithi043.stdout:2/164: symlink d0/d26/d37/l3a 0 2023-12-08T20:28:14.284 INFO:tasks.workunit.client.0.smithi043.stdout:4/167: dwrite d1/d14/f26 [4194304,4194304] 0 2023-12-08T20:28:14.284 INFO:tasks.workunit.client.0.smithi043.stdout:4/168: chown d1/d14/f18 8277 1 2023-12-08T20:28:14.285 INFO:tasks.workunit.client.0.smithi043.stdout:9/201: rmdir d0/d21 39 2023-12-08T20:28:14.285 INFO:tasks.workunit.client.0.smithi043.stdout:9/202: getdents d0/d21 0 2023-12-08T20:28:14.286 INFO:tasks.workunit.client.0.smithi043.stdout:9/203: mkdir d0/d3d 0 2023-12-08T20:28:14.289 INFO:tasks.workunit.client.0.smithi043.stdout:4/169: write d1/d14/d1d/fa [949109,100194] 0 2023-12-08T20:28:14.289 INFO:tasks.workunit.client.0.smithi043.stdout:9/204: creat d0/d21/f3e x:0 0 0 2023-12-08T20:28:14.300 INFO:tasks.workunit.client.0.smithi043.stdout:5/177: dwrite d3/d7/de/f2a [4194304,4194304] 0 2023-12-08T20:28:14.303 INFO:tasks.workunit.client.0.smithi043.stdout:5/178: truncate d3/d7/de/f1e 579549 0 2023-12-08T20:28:14.303 INFO:tasks.workunit.client.0.smithi043.stdout:5/179: fdatasync d3/d7/d19/f30 0 2023-12-08T20:28:14.306 INFO:tasks.workunit.client.0.smithi043.stdout:9/205: dread d0/d2e/d37/f3a [0,4194304] 0 2023-12-08T20:28:14.308 INFO:tasks.workunit.client.0.smithi043.stdout:4/170: dwrite d1/d14/d25/d28/f2e [0,4194304] 0 2023-12-08T20:28:14.309 INFO:tasks.workunit.client.0.smithi043.stdout:2/165: dwrite d0/db/d18/f22 [0,4194304] 0 2023-12-08T20:28:14.313 INFO:tasks.workunit.client.0.smithi043.stdout:4/171: mkdir d1/d36/d3c 0 2023-12-08T20:28:14.314 INFO:tasks.workunit.client.0.smithi043.stdout:2/166: creat d0/d26/f3b x:0 0 0 2023-12-08T20:28:14.314 INFO:tasks.workunit.client.0.smithi043.stdout:2/167: chown d0/db/c11 108346 1 2023-12-08T20:28:14.318 INFO:tasks.workunit.client.0.smithi043.stdout:4/172: unlink d1/d14/d1d/fa 0 2023-12-08T20:28:14.319 INFO:tasks.workunit.client.0.smithi043.stdout:2/168: link d0/cc d0/db/d18/c3c 0 2023-12-08T20:28:14.319 INFO:tasks.workunit.client.0.smithi043.stdout:2/169: stat d0/f4 0 2023-12-08T20:28:14.323 INFO:tasks.workunit.client.0.smithi043.stdout:2/170: mkdir d0/db/d18/d3d 0 2023-12-08T20:28:14.323 INFO:tasks.workunit.client.0.smithi043.stdout:5/180: dwrite d3/d7/de/f1d [0,4194304] 0 2023-12-08T20:28:14.325 INFO:tasks.workunit.client.0.smithi043.stdout:2/171: creat d0/db/d18/f3e x:0 0 0 2023-12-08T20:28:14.325 INFO:tasks.workunit.client.0.smithi043.stdout:4/173: getdents d1/d36 0 2023-12-08T20:28:14.328 INFO:tasks.workunit.client.0.smithi043.stdout:5/181: rmdir d3/d7/de/d17 39 2023-12-08T20:28:14.329 INFO:tasks.workunit.client.0.smithi043.stdout:5/182: truncate d3/fc 8275004 0 2023-12-08T20:28:14.329 INFO:tasks.workunit.client.0.smithi043.stdout:5/183: chown d3/l6 47118025 1 2023-12-08T20:28:14.329 INFO:tasks.workunit.client.0.smithi043.stdout:5/184: stat d3/d7/d21/l2b 0 2023-12-08T20:28:14.330 INFO:tasks.workunit.client.0.smithi043.stdout:5/185: mknod d3/d7/d21/c33 0 2023-12-08T20:28:14.332 INFO:tasks.workunit.client.0.smithi043.stdout:5/186: symlink d3/d7/d21/l34 0 2023-12-08T20:28:14.332 INFO:tasks.workunit.client.0.smithi043.stdout:5/187: chown d3/d7/de 481 1 2023-12-08T20:28:14.342 INFO:tasks.workunit.client.0.smithi043.stdout:2/172: dwrite d0/db/f14 [0,4194304] 0 2023-12-08T20:28:14.346 INFO:tasks.workunit.client.0.smithi043.stdout:2/173: mknod d0/c3f 0 2023-12-08T20:28:14.355 INFO:tasks.workunit.client.0.smithi043.stdout:5/188: dwrite d3/d7/de/f18 [4194304,4194304] 0 2023-12-08T20:28:14.355 INFO:tasks.workunit.client.0.smithi043.stdout:4/174: dwrite d1/f22 [0,4194304] 0 2023-12-08T20:28:14.357 INFO:tasks.workunit.client.0.smithi043.stdout:5/189: symlink d3/d32/l35 0 2023-12-08T20:28:14.358 INFO:tasks.workunit.client.0.smithi043.stdout:4/175: mkdir d1/d14/d25/d39/d3d 0 2023-12-08T20:28:14.358 INFO:tasks.workunit.client.0.smithi043.stdout:4/176: dread - d1/d14/d25/f2f zero size 2023-12-08T20:28:14.363 INFO:tasks.workunit.client.0.smithi043.stdout:5/190: dread d3/d7/f1a [0,4194304] 0 2023-12-08T20:28:14.364 INFO:tasks.workunit.client.0.smithi043.stdout:5/191: write d3/d7/de/f1e [1087753,124792] 0 2023-12-08T20:28:14.364 INFO:tasks.workunit.client.0.smithi043.stdout:2/174: dwrite d0/f4 [0,4194304] 0 2023-12-08T20:28:14.364 INFO:tasks.workunit.client.0.smithi043.stdout:4/177: dread d1/f11 [0,4194304] 0 2023-12-08T20:28:14.366 INFO:tasks.workunit.client.0.smithi043.stdout:2/175: link d0/f28 d0/db/d18/d3d/f40 0 2023-12-08T20:28:14.367 INFO:tasks.workunit.client.0.smithi043.stdout:5/192: symlink d3/l36 0 2023-12-08T20:28:14.368 INFO:tasks.workunit.client.0.smithi043.stdout:2/176: unlink d0/db/d18/c3c 0 2023-12-08T20:28:14.370 INFO:tasks.workunit.client.0.smithi043.stdout:5/193: creat d3/f37 x:0 0 0 2023-12-08T20:28:14.371 INFO:tasks.workunit.client.0.smithi043.stdout:2/177: link d0/d20/f2c d0/d26/d37/d38/f41 0 2023-12-08T20:28:14.372 INFO:tasks.workunit.client.0.smithi043.stdout:5/194: symlink d3/d7/d19/l38 0 2023-12-08T20:28:14.374 INFO:tasks.workunit.client.0.smithi043.stdout:2/178: mkdir d0/d20/d42 0 2023-12-08T20:28:14.374 INFO:tasks.workunit.client.0.smithi043.stdout:2/179: fdatasync d0/db/f14 0 2023-12-08T20:28:14.374 INFO:tasks.workunit.client.0.smithi043.stdout:2/180: dread - d0/db/d18/f3e zero size 2023-12-08T20:28:14.374 INFO:tasks.workunit.client.0.smithi043.stdout:2/181: fdatasync d0/db/fd 0 2023-12-08T20:28:14.375 INFO:tasks.workunit.client.0.smithi043.stdout:2/182: truncate d0/f25 3389218 0 2023-12-08T20:28:14.376 INFO:tasks.workunit.client.0.smithi043.stdout:2/183: chown d0/db/d18 0 1 2023-12-08T20:28:14.379 INFO:tasks.workunit.client.0.smithi043.stdout:2/184: write d0/db/d18/f22 [2299185,120360] 0 2023-12-08T20:28:14.379 INFO:tasks.workunit.client.0.smithi043.stdout:2/185: fdatasync d0/db/d18/f1a 0 2023-12-08T20:28:14.379 INFO:tasks.workunit.client.0.smithi043.stdout:2/186: write d0/d26/f3b [383596,25532] 0 2023-12-08T20:28:14.379 INFO:tasks.workunit.client.0.smithi043.stdout:2/187: fdatasync d0/d20/f2c 0 2023-12-08T20:28:14.381 INFO:tasks.workunit.client.0.smithi043.stdout:2/188: getdents d0/db/d18/d3d 0 2023-12-08T20:28:14.384 INFO:tasks.workunit.client.0.smithi043.stdout:2/189: write d0/f5 [1136311,81122] 0 2023-12-08T20:28:14.385 INFO:tasks.workunit.client.0.smithi043.stdout:4/178: dwrite d1/d14/f24 [0,4194304] 0 2023-12-08T20:28:14.386 INFO:tasks.workunit.client.0.smithi043.stdout:4/179: stat d1/d14/d25/d28 0 2023-12-08T20:28:14.386 INFO:tasks.workunit.client.0.smithi043.stdout:4/180: stat d1/d14/d25/c38 0 2023-12-08T20:28:14.387 INFO:tasks.workunit.client.0.smithi043.stdout:2/190: symlink d0/db/l43 0 2023-12-08T20:28:14.388 INFO:tasks.workunit.client.0.smithi043.stdout:4/181: rmdir d1/d14/d25/d39 39 2023-12-08T20:28:14.389 INFO:tasks.workunit.client.0.smithi043.stdout:2/191: write d0/db/fd [2259854,87037] 0 2023-12-08T20:28:14.389 INFO:tasks.workunit.client.0.smithi043.stdout:2/192: stat d0/db/d18/f22 0 2023-12-08T20:28:14.389 INFO:tasks.workunit.client.0.smithi043.stdout:4/182: mknod d1/d14/d1d/c3e 0 2023-12-08T20:28:14.390 INFO:tasks.workunit.client.0.smithi043.stdout:2/193: creat d0/d20/f44 x:0 0 0 2023-12-08T20:28:14.391 INFO:tasks.workunit.client.0.smithi043.stdout:4/183: unlink d1/f22 0 2023-12-08T20:28:14.392 INFO:tasks.workunit.client.0.smithi043.stdout:2/194: creat d0/d26/f45 x:0 0 0 2023-12-08T20:28:14.394 INFO:tasks.workunit.client.0.smithi043.stdout:4/184: rename d1/d36 to d1/d14/d25/d39/d3f 0 2023-12-08T20:28:14.395 INFO:tasks.workunit.client.0.smithi043.stdout:2/195: creat d0/d2b/f46 x:0 0 0 2023-12-08T20:28:14.395 INFO:tasks.workunit.client.0.smithi043.stdout:2/196: dread - d0/d26/f45 zero size 2023-12-08T20:28:14.395 INFO:tasks.workunit.client.0.smithi043.stdout:5/195: dwrite d3/d7/de/f24 [0,4194304] 0 2023-12-08T20:28:14.396 INFO:tasks.workunit.client.0.smithi043.stdout:4/185: mkdir d1/d14/d25/d39/d3d/d40 0 2023-12-08T20:28:14.397 INFO:tasks.workunit.client.0.smithi043.stdout:2/197: creat d0/d26/d37/d38/f47 x:0 0 0 2023-12-08T20:28:14.397 INFO:tasks.workunit.client.0.smithi043.stdout:2/198: readlink d0/d26/d37/l3a 0 2023-12-08T20:28:14.400 INFO:tasks.workunit.client.0.smithi043.stdout:5/196: getdents d3/d7/d29 0 2023-12-08T20:28:14.400 INFO:tasks.workunit.client.0.smithi043.stdout:5/197: chown d3/d7/de/l1c 0 1 2023-12-08T20:28:14.400 INFO:tasks.workunit.client.0.smithi043.stdout:4/186: mkdir d1/d14/d25/d39/d3f/d3c/d41 0 2023-12-08T20:28:14.414 INFO:tasks.workunit.client.0.smithi043.stdout:2/199: dwrite d0/f9 [0,4194304] 0 2023-12-08T20:28:14.414 INFO:tasks.workunit.client.0.smithi043.stdout:2/200: write d0/d26/d37/d38/f41 [645702,53188] 0 2023-12-08T20:28:14.414 INFO:tasks.workunit.client.0.smithi043.stdout:2/201: chown d0/f5 1141 1 2023-12-08T20:28:14.414 INFO:tasks.workunit.client.0.smithi043.stdout:2/202: write d0/fa [4342222,56563] 0 2023-12-08T20:28:14.414 INFO:tasks.workunit.client.0.smithi043.stdout:2/203: write d0/d26/f27 [954427,116984] 0 2023-12-08T20:28:14.415 INFO:tasks.workunit.client.0.smithi043.stdout:4/187: dread d1/f5 [0,4194304] 0 2023-12-08T20:28:14.427 INFO:tasks.workunit.client.0.smithi043.stdout:2/204: dread d0/db/d18/d3d/f40 [0,4194304] 0 2023-12-08T20:28:14.427 INFO:tasks.workunit.client.0.smithi043.stdout:2/205: readlink d0/db/l1b 0 2023-12-08T20:28:14.427 INFO:tasks.workunit.client.0.smithi043.stdout:2/206: chown d0/d2b 1901 1 2023-12-08T20:28:14.427 INFO:tasks.workunit.client.0.smithi043.stdout:2/207: readlink d0/l23 0 2023-12-08T20:28:14.428 INFO:tasks.workunit.client.0.smithi043.stdout:2/208: link d0/fa d0/f48 0 2023-12-08T20:28:14.429 INFO:tasks.workunit.client.0.smithi043.stdout:2/209: mkdir d0/d20/d42/d49 0 2023-12-08T20:28:14.429 INFO:tasks.workunit.client.0.smithi043.stdout:2/210: truncate d0/db/d18/f1a 1223171 0 2023-12-08T20:28:14.430 INFO:tasks.workunit.client.0.smithi043.stdout:2/211: creat d0/db/f4a x:0 0 0 2023-12-08T20:28:14.432 INFO:tasks.workunit.client.0.smithi043.stdout:4/188: dwrite d1/d14/d1d/fb [0,4194304] 0 2023-12-08T20:28:14.434 INFO:tasks.workunit.client.0.smithi043.stdout:4/189: symlink d1/d14/d25/l42 0 2023-12-08T20:28:14.440 INFO:tasks.workunit.client.0.smithi043.stdout:2/212: dread d0/f9 [0,4194304] 0 2023-12-08T20:28:14.440 INFO:tasks.workunit.client.0.smithi043.stdout:2/213: chown d0/d26/d37/d38/f47 0 1 2023-12-08T20:28:14.441 INFO:tasks.workunit.client.0.smithi043.stdout:2/214: creat d0/db/d18/f4b x:0 0 0 2023-12-08T20:28:14.455 INFO:tasks.workunit.client.0.smithi043.stdout:2/215: dwrite d0/d20/f2a [0,4194304] 0 2023-12-08T20:28:14.455 INFO:tasks.workunit.client.0.smithi043.stdout:2/216: chown d0/db/d18/f1a 646576 1 2023-12-08T20:28:14.455 INFO:tasks.workunit.client.0.smithi043.stdout:2/217: fdatasync d0/db/f4a 0 2023-12-08T20:28:14.455 INFO:tasks.workunit.client.0.smithi043.stdout:2/218: chown d0/d2b/f46 1307911364 1 2023-12-08T20:28:14.456 INFO:tasks.workunit.client.0.smithi043.stdout:2/219: symlink d0/l4c 0 2023-12-08T20:28:14.457 INFO:tasks.workunit.client.0.smithi043.stdout:2/220: read d0/d20/f2a [2681539,36140] 0 2023-12-08T20:28:14.468 INFO:tasks.workunit.client.0.smithi043.stdout:2/221: dwrite d0/f5 [4194304,4194304] 0 2023-12-08T20:28:14.475 INFO:tasks.workunit.client.0.smithi043.stdout:2/222: dread d0/d2b/f33 [0,4194304] 0 2023-12-08T20:28:14.477 INFO:tasks.workunit.client.0.smithi043.stdout:2/223: creat d0/d20/f4d x:0 0 0 2023-12-08T20:28:14.478 INFO:tasks.workunit.client.0.smithi043.stdout:2/224: mkdir d0/d2b/d4e 0 2023-12-08T20:28:14.479 INFO:tasks.workunit.client.0.smithi043.stdout:2/225: creat d0/d26/d37/d38/f4f x:0 0 0 2023-12-08T20:28:14.480 INFO:tasks.workunit.client.0.smithi043.stdout:2/226: creat d0/db/d18/d3d/f50 x:0 0 0 2023-12-08T20:28:14.480 INFO:tasks.workunit.client.0.smithi043.stdout:2/227: dread - d0/d26/d37/d38/f4f zero size 2023-12-08T20:28:14.480 INFO:tasks.workunit.client.0.smithi043.stdout:2/228: truncate d0/db/d18/f3e 785945 0 2023-12-08T20:28:14.488 INFO:tasks.workunit.client.0.smithi043.stdout:2/229: dread d0/db/f14 [0,4194304] 0 2023-12-08T20:28:14.489 INFO:tasks.workunit.client.0.smithi043.stdout:2/230: mknod d0/d26/c51 0 2023-12-08T20:28:14.489 INFO:tasks.workunit.client.0.smithi043.stdout:2/231: fdatasync d0/db/d18/f1a 0 2023-12-08T20:28:14.489 INFO:tasks.workunit.client.0.smithi043.stdout:2/232: creat d0/d2b/d4e/f52 x:0 0 0 2023-12-08T20:28:14.490 INFO:tasks.workunit.client.0.smithi043.stdout:2/233: truncate d0/f9 1165578 0 2023-12-08T20:28:14.490 INFO:tasks.workunit.client.0.smithi043.stdout:2/234: dread - d0/d2b/f46 zero size 2023-12-08T20:28:14.493 INFO:tasks.workunit.client.0.smithi043.stdout:2/235: dread d0/d20/f2c [0,4194304] 0 2023-12-08T20:28:14.494 INFO:tasks.workunit.client.0.smithi043.stdout:2/236: mkdir d0/d26/d53 0 2023-12-08T20:28:14.495 INFO:tasks.workunit.client.0.smithi043.stdout:2/237: unlink d0/l23 0 2023-12-08T20:28:14.496 INFO:tasks.workunit.client.0.smithi043.stdout:2/238: creat d0/db/f54 x:0 0 0 2023-12-08T20:28:14.502 INFO:tasks.workunit.client.0.smithi043.stdout:2/239: dread d0/f48 [0,4194304] 0 2023-12-08T20:28:14.503 INFO:tasks.workunit.client.0.smithi043.stdout:2/240: dread d0/d20/f32 [4194304,4194304] 0 2023-12-08T20:28:14.503 INFO:tasks.workunit.client.0.smithi043.stdout:2/241: truncate d0/f28 2051529 0 2023-12-08T20:28:14.519 INFO:tasks.workunit.client.0.smithi043.stdout:2/242: dwrite d0/d26/f34 [0,4194304] 0 2023-12-08T20:28:14.520 INFO:tasks.workunit.client.0.smithi043.stdout:2/243: creat d0/f55 x:0 0 0 2023-12-08T20:28:14.520 INFO:tasks.workunit.client.0.smithi043.stdout:2/244: chown d0/db/d18 3159 1 2023-12-08T20:28:14.521 INFO:tasks.workunit.client.0.smithi043.stdout:2/245: rename d0/d2b/f33 to d0/db/d18/d3d/f56 0 2023-12-08T20:28:14.522 INFO:tasks.workunit.client.0.smithi043.stdout:2/246: creat d0/f57 x:0 0 0 2023-12-08T20:28:14.523 INFO:tasks.workunit.client.0.smithi043.stdout:2/247: write d0/f9 [810594,58009] 0 2023-12-08T20:28:14.523 INFO:tasks.workunit.client.0.smithi043.stdout:2/248: chown d0/d26/f34 1 1 2023-12-08T20:28:14.523 INFO:tasks.workunit.client.0.smithi043.stdout:2/249: fdatasync d0/d26/d37/d38/f4f 0 2023-12-08T20:28:14.523 INFO:tasks.workunit.client.0.smithi043.stdout:2/250: mknod d0/d26/d53/c58 0 2023-12-08T20:28:14.524 INFO:tasks.workunit.client.0.smithi043.stdout:2/251: unlink d0/db/fd 0 2023-12-08T20:28:14.524 INFO:tasks.workunit.client.0.smithi043.stdout:2/252: chown d0/f28 28786 1 2023-12-08T20:28:14.525 INFO:tasks.workunit.client.0.smithi043.stdout:2/253: rename d0/d20/f44 to d0/d20/d42/f59 0 2023-12-08T20:28:14.527 INFO:tasks.workunit.client.0.smithi043.stdout:2/254: rename d0/db/f1e to d0/d2b/d4e/f5a 0 2023-12-08T20:28:14.528 INFO:tasks.workunit.client.0.smithi043.stdout:2/255: write d0/db/d18/d3d/f40 [355376,67734] 0 2023-12-08T20:28:14.528 INFO:tasks.workunit.client.0.smithi043.stdout:2/256: write d0/d26/d37/d38/f47 [312282,102697] 0 2023-12-08T20:28:14.529 INFO:tasks.workunit.client.0.smithi043.stdout:2/257: read d0/d26/f27 [434007,118263] 0 2023-12-08T20:28:15.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:14 smithi043 ceph-mon[111966]: pgmap v28: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 27 MiB/s rd, 61 MiB/s wr, 138 op/s 2023-12-08T20:28:15.131 INFO:tasks.workunit.client.0.smithi043.stdout:6/155: sync 2023-12-08T20:28:15.135 INFO:tasks.workunit.client.0.smithi043.stdout:6/156: mkdir d0/d2/d14/d20/d3c 0 2023-12-08T20:28:15.136 INFO:tasks.workunit.client.0.smithi043.stdout:6/157: unlink d0/f2b 0 2023-12-08T20:28:15.138 INFO:tasks.workunit.client.0.smithi043.stdout:6/158: symlink d0/l3d 0 2023-12-08T20:28:15.140 INFO:tasks.workunit.client.0.smithi043.stdout:6/159: creat d0/d2/f3e x:0 0 0 2023-12-08T20:28:15.141 INFO:tasks.workunit.client.0.smithi043.stdout:6/160: dread d0/d2/d14/d2c/d22/f32 [0,4194304] 0 2023-12-08T20:28:15.142 INFO:tasks.workunit.client.0.smithi043.stdout:6/161: write d0/d2/f3e [898661,20007] 0 2023-12-08T20:28:15.143 INFO:tasks.workunit.client.0.smithi043.stdout:6/162: mkdir d0/d2/d14/d2c/d22/d3f 0 2023-12-08T20:28:15.144 INFO:tasks.workunit.client.0.smithi043.stdout:6/163: creat d0/d2/de/f40 x:0 0 0 2023-12-08T20:28:15.146 INFO:tasks.workunit.client.0.smithi043.stdout:6/164: rename d0/d2/c7 to d0/d2/d14/d2c/d22/d3f/c41 0 2023-12-08T20:28:15.148 INFO:tasks.workunit.client.0.smithi043.stdout:6/165: creat d0/d2/d14/d2c/d22/d2a/f42 x:0 0 0 2023-12-08T20:28:15.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:14 smithi111 ceph-mon[121341]: pgmap v28: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 27 MiB/s rd, 61 MiB/s wr, 138 op/s 2023-12-08T20:28:15.786 INFO:tasks.workunit.client.0.smithi043.stdout:3/146: sync 2023-12-08T20:28:15.787 INFO:tasks.workunit.client.0.smithi043.stdout:8/180: sync 2023-12-08T20:28:15.787 INFO:tasks.workunit.client.0.smithi043.stdout:3/147: rmdir d1/d9/df 39 2023-12-08T20:28:15.788 INFO:tasks.workunit.client.0.smithi043.stdout:3/148: write d1/d9/fe [279996,51354] 0 2023-12-08T20:28:15.790 INFO:tasks.workunit.client.0.smithi043.stdout:8/181: unlink d2/f3 0 2023-12-08T20:28:15.791 INFO:tasks.workunit.client.0.smithi043.stdout:8/182: write d2/de/f26 [313277,77538] 0 2023-12-08T20:28:15.794 INFO:tasks.workunit.client.0.smithi043.stdout:8/183: rename d2/d4 to d2/de/d3a 0 2023-12-08T20:28:15.794 INFO:tasks.workunit.client.0.smithi043.stdout:8/184: write d2/de/f13 [835669,73828] 0 2023-12-08T20:28:15.796 INFO:tasks.workunit.client.0.smithi043.stdout:8/185: truncate d2/de/f14 618952 0 2023-12-08T20:28:15.796 INFO:tasks.workunit.client.0.smithi043.stdout:8/186: chown d2/c22 31086 1 2023-12-08T20:28:15.797 INFO:tasks.workunit.client.0.smithi043.stdout:8/187: mkdir d2/d3b 0 2023-12-08T20:28:15.797 INFO:tasks.workunit.client.0.smithi043.stdout:8/188: fsync d2/de/ff 0 2023-12-08T20:28:15.802 INFO:tasks.workunit.client.0.smithi043.stdout:3/149: truncate d1/d9/fe 302039 0 2023-12-08T20:28:15.809 INFO:tasks.workunit.client.0.smithi043.stdout:3/150: truncate d1/d9/fd 2412568 0 2023-12-08T20:28:15.811 INFO:tasks.workunit.client.0.smithi043.stdout:3/151: mkdir d1/d1c/d2c 0 2023-12-08T20:28:15.812 INFO:tasks.workunit.client.0.smithi043.stdout:3/152: mkdir d1/d9/d2d 0 2023-12-08T20:28:15.814 INFO:tasks.workunit.client.0.smithi043.stdout:8/189: truncate d2/de/f14 448738 0 2023-12-08T20:28:15.816 INFO:tasks.workunit.client.0.smithi043.stdout:8/190: rename d2/f25 to d2/d27/d2d/f3c 0 2023-12-08T20:28:15.817 INFO:tasks.workunit.client.0.smithi043.stdout:8/191: getdents d2/d20 0 2023-12-08T20:28:15.819 INFO:tasks.workunit.client.0.smithi043.stdout:8/192: symlink d2/de/d29/d30/l3d 0 2023-12-08T20:28:15.820 INFO:tasks.workunit.client.0.smithi043.stdout:8/193: write d2/de/f14 [527729,101426] 0 2023-12-08T20:28:15.820 INFO:tasks.workunit.client.0.smithi043.stdout:3/153: dread d1/f18 [0,4194304] 0 2023-12-08T20:28:15.821 INFO:tasks.workunit.client.0.smithi043.stdout:8/194: creat d2/f3e x:0 0 0 2023-12-08T20:28:15.822 INFO:tasks.workunit.client.0.smithi043.stdout:3/154: unlink d1/c10 0 2023-12-08T20:28:15.824 INFO:tasks.workunit.client.0.smithi043.stdout:3/155: mkdir d1/d25/d2a/d2e 0 2023-12-08T20:28:15.825 INFO:tasks.workunit.client.0.smithi043.stdout:3/156: creat d1/d9/df/d26/f2f x:0 0 0 2023-12-08T20:28:15.826 INFO:tasks.workunit.client.0.smithi043.stdout:3/157: mkdir d1/d28/d30 0 2023-12-08T20:28:15.826 INFO:tasks.workunit.client.0.smithi043.stdout:3/158: rmdir d1/d28 39 2023-12-08T20:28:15.826 INFO:tasks.workunit.client.0.smithi043.stdout:3/159: stat d1/d9/l23 0 2023-12-08T20:28:15.826 INFO:tasks.workunit.client.0.smithi043.stdout:3/160: truncate d1/d1c/f22 284295 0 2023-12-08T20:28:15.828 INFO:tasks.workunit.client.0.smithi043.stdout:3/161: dread d1/d1c/f22 [0,4194304] 0 2023-12-08T20:28:15.830 INFO:tasks.workunit.client.0.smithi043.stdout:3/162: creat d1/d25/f31 x:0 0 0 2023-12-08T20:28:15.832 INFO:tasks.workunit.client.0.smithi043.stdout:3/163: rename d1/d9/df/f15 to d1/d9/f32 0 2023-12-08T20:28:15.833 INFO:tasks.workunit.client.0.smithi043.stdout:3/164: write d1/d9/f32 [224648,100476] 0 2023-12-08T20:28:15.834 INFO:tasks.workunit.client.0.smithi043.stdout:3/165: mkdir d1/d28/d33 0 2023-12-08T20:28:15.837 INFO:tasks.workunit.client.0.smithi043.stdout:9/206: sync 2023-12-08T20:28:15.837 INFO:tasks.workunit.client.0.smithi043.stdout:9/207: stat d0/c20 0 2023-12-08T20:28:15.837 INFO:tasks.workunit.client.0.smithi043.stdout:1/153: sync 2023-12-08T20:28:15.837 INFO:tasks.workunit.client.0.smithi043.stdout:0/156: sync 2023-12-08T20:28:15.837 INFO:tasks.workunit.client.0.smithi043.stdout:6/166: sync 2023-12-08T20:28:15.837 INFO:tasks.workunit.client.0.smithi043.stdout:6/167: fsync d0/f34 0 2023-12-08T20:28:15.839 INFO:tasks.workunit.client.0.smithi043.stdout:2/258: sync 2023-12-08T20:28:15.839 INFO:tasks.workunit.client.0.smithi043.stdout:4/190: sync 2023-12-08T20:28:15.839 INFO:tasks.workunit.client.0.smithi043.stdout:7/95: sync 2023-12-08T20:28:15.839 INFO:tasks.workunit.client.0.smithi043.stdout:7/96: dread - d0/f1b zero size 2023-12-08T20:28:15.839 INFO:tasks.workunit.client.0.smithi043.stdout:7/97: write d0/d6/d8/f9 [375380,19583] 0 2023-12-08T20:28:15.839 INFO:tasks.workunit.client.0.smithi043.stdout:7/98: fdatasync d0/d2/fc 0 2023-12-08T20:28:15.839 INFO:tasks.workunit.client.0.smithi043.stdout:5/198: sync 2023-12-08T20:28:15.839 INFO:tasks.workunit.client.0.smithi043.stdout:9/208: symlink d0/l3f 0 2023-12-08T20:28:15.841 INFO:tasks.workunit.client.0.smithi043.stdout:1/154: symlink d1/d16/d1c/l2e 0 2023-12-08T20:28:15.841 INFO:tasks.workunit.client.0.smithi043.stdout:1/155: chown d1/d6/f29 16893 1 2023-12-08T20:28:15.842 INFO:tasks.workunit.client.0.smithi043.stdout:8/195: dwrite d2/de/f26 [0,4194304] 0 2023-12-08T20:28:15.842 INFO:tasks.workunit.client.0.smithi043.stdout:4/191: creat d1/d14/d25/d39/d3f/d3c/d41/f43 x:0 0 0 2023-12-08T20:28:15.843 INFO:tasks.workunit.client.0.smithi043.stdout:7/99: mknod d0/d6/d8/c1f 0 2023-12-08T20:28:15.845 INFO:tasks.workunit.client.0.smithi043.stdout:9/209: rename d0/d21/f31 to d0/d2e/f40 0 2023-12-08T20:28:15.846 INFO:tasks.workunit.client.0.smithi043.stdout:8/196: mknod d2/d20/c3f 0 2023-12-08T20:28:15.847 INFO:tasks.workunit.client.0.smithi043.stdout:4/192: symlink d1/d14/d25/d28/l44 0 2023-12-08T20:28:15.848 INFO:tasks.workunit.client.0.smithi043.stdout:7/100: mknod d0/d6/c20 0 2023-12-08T20:28:15.849 INFO:tasks.workunit.client.0.smithi043.stdout:5/199: symlink d3/l39 0 2023-12-08T20:28:15.851 INFO:tasks.workunit.client.0.smithi043.stdout:9/210: mknod d0/d2e/c41 0 2023-12-08T20:28:15.851 INFO:tasks.workunit.client.0.smithi043.stdout:9/211: chown d0/d21/l22 1039 1 2023-12-08T20:28:15.864 INFO:tasks.workunit.client.0.smithi043.stdout:1/156: dread d1/d16/f18 [0,4194304] 0 2023-12-08T20:28:15.864 INFO:tasks.workunit.client.0.smithi043.stdout:5/200: read d3/d7/f1a [3412719,61205] 0 2023-12-08T20:28:15.866 INFO:tasks.workunit.client.0.smithi043.stdout:5/201: mknod d3/d7/d29/c3a 0 2023-12-08T20:28:15.867 INFO:tasks.workunit.client.0.smithi043.stdout:1/157: symlink d1/d16/d1c/l2f 0 2023-12-08T20:28:15.867 INFO:tasks.workunit.client.0.smithi043.stdout:1/158: truncate d1/d16/f28 719794 0 2023-12-08T20:28:15.868 INFO:tasks.workunit.client.0.smithi043.stdout:1/159: rmdir d1/d16/d1c 39 2023-12-08T20:28:15.868 INFO:tasks.workunit.client.0.smithi043.stdout:1/160: fdatasync d1/d16/f28 0 2023-12-08T20:28:15.874 INFO:tasks.workunit.client.0.smithi043.stdout:0/157: dwrite d2/d3/d6/f2e [0,4194304] 0 2023-12-08T20:28:15.877 INFO:tasks.workunit.client.0.smithi043.stdout:0/158: symlink d2/d3/d18/l31 0 2023-12-08T20:28:15.878 INFO:tasks.workunit.client.0.smithi043.stdout:7/101: fdatasync d0/d6/d8/f9 0 2023-12-08T20:28:15.878 INFO:tasks.workunit.client.0.smithi043.stdout:6/168: dwrite d0/d2/d14/d2c/d22/d2a/f42 [0,4194304] 0 2023-12-08T20:28:15.878 INFO:tasks.workunit.client.0.smithi043.stdout:6/169: readlink d0/l3d 0 2023-12-08T20:28:15.881 INFO:tasks.workunit.client.0.smithi043.stdout:2/259: dwrite d0/f28 [0,4194304] 0 2023-12-08T20:28:15.881 INFO:tasks.workunit.client.0.smithi043.stdout:6/170: rename d0/d2/d14/d2c/d22/d2a/f42 to d0/d2/d14/d8/f43 0 2023-12-08T20:28:15.883 INFO:tasks.workunit.client.0.smithi043.stdout:8/197: dwrite d2/de/d37/f1f [0,4194304] 0 2023-12-08T20:28:15.883 INFO:tasks.workunit.client.0.smithi043.stdout:8/198: readlink d2/de/l16 0 2023-12-08T20:28:15.883 INFO:tasks.workunit.client.0.smithi043.stdout:8/199: dread - d2/d27/d2d/d31/f36 zero size 2023-12-08T20:28:15.883 INFO:tasks.workunit.client.0.smithi043.stdout:8/200: write d2/d27/f35 [1028695,65826] 0 2023-12-08T20:28:15.883 INFO:tasks.workunit.client.0.smithi043.stdout:2/260: truncate d0/db/d18/f22 2462113 0 2023-12-08T20:28:15.885 INFO:tasks.workunit.client.0.smithi043.stdout:6/171: rename d0/d2/d14/d8/f23 to d0/d2/d14/d20/f44 0 2023-12-08T20:28:15.889 INFO:tasks.workunit.client.0.smithi043.stdout:8/201: symlink d2/d27/d2d/l40 0 2023-12-08T20:28:15.889 INFO:tasks.workunit.client.0.smithi043.stdout:2/261: rmdir d0/d2b/d4e 39 2023-12-08T20:28:15.889 INFO:tasks.workunit.client.0.smithi043.stdout:9/212: dwrite d0/f14 [0,4194304] 0 2023-12-08T20:28:15.889 INFO:tasks.workunit.client.0.smithi043.stdout:4/193: dwrite d1/d14/f1a [0,4194304] 0 2023-12-08T20:28:15.889 INFO:tasks.workunit.client.0.smithi043.stdout:1/161: dwrite d1/d6/fa [0,4194304] 0 2023-12-08T20:28:15.889 INFO:tasks.workunit.client.0.smithi043.stdout:1/162: chown d1/d16 0 1 2023-12-08T20:28:15.890 INFO:tasks.workunit.client.0.smithi043.stdout:0/159: dread d2/d3/d18/d1e/f25 [4194304,4194304] 0 2023-12-08T20:28:15.890 INFO:tasks.workunit.client.0.smithi043.stdout:8/202: link d2/d20/f2c d2/de/d29/d30/f41 0 2023-12-08T20:28:15.892 INFO:tasks.workunit.client.0.smithi043.stdout:2/262: creat d0/d2b/f5b x:0 0 0 2023-12-08T20:28:15.892 INFO:tasks.workunit.client.0.smithi043.stdout:2/263: readlink d0/db/l43 0 2023-12-08T20:28:15.892 INFO:tasks.workunit.client.0.smithi043.stdout:2/264: read - d0/db/d18/d3d/f50 zero size 2023-12-08T20:28:15.894 INFO:tasks.workunit.client.0.smithi043.stdout:4/194: rename d1/d14/f19 to d1/d14/f45 0 2023-12-08T20:28:15.895 INFO:tasks.workunit.client.0.smithi043.stdout:4/195: fsync d1/f11 0 2023-12-08T20:28:15.895 INFO:tasks.workunit.client.0.smithi043.stdout:4/196: write d1/d14/d1d/f16 [1795256,59670] 0 2023-12-08T20:28:15.897 INFO:tasks.workunit.client.0.smithi043.stdout:1/163: mkdir d1/d16/d30 0 2023-12-08T20:28:15.898 INFO:tasks.workunit.client.0.smithi043.stdout:0/160: symlink d2/d4/l32 0 2023-12-08T20:28:15.898 INFO:tasks.workunit.client.0.smithi043.stdout:0/161: fdatasync d2/d3/d15/f20 0 2023-12-08T20:28:15.898 INFO:tasks.workunit.client.0.smithi043.stdout:0/162: dread - d2/d3/d18/f22 zero size 2023-12-08T20:28:15.901 INFO:tasks.workunit.client.0.smithi043.stdout:8/203: rmdir d2/de/d37/d32 0 2023-12-08T20:28:15.901 INFO:tasks.workunit.client.0.smithi043.stdout:8/204: truncate d2/de/d37/f1f 4868392 0 2023-12-08T20:28:15.903 INFO:tasks.workunit.client.0.smithi043.stdout:2/265: symlink d0/d26/d37/l5c 0 2023-12-08T20:28:15.904 INFO:tasks.workunit.client.0.smithi043.stdout:0/163: dread d2/f24 [0,4194304] 0 2023-12-08T20:28:15.905 INFO:tasks.workunit.client.0.smithi043.stdout:7/102: dwrite d0/fb [0,4194304] 0 2023-12-08T20:28:15.906 INFO:tasks.workunit.client.0.smithi043.stdout:1/164: mknod d1/d16/c31 0 2023-12-08T20:28:15.906 INFO:tasks.workunit.client.0.smithi043.stdout:7/103: write d0/d6/d8/f10 [517560,60479] 0 2023-12-08T20:28:15.906 INFO:tasks.workunit.client.0.smithi043.stdout:8/205: truncate d2/f21 17675 0 2023-12-08T20:28:15.909 INFO:tasks.workunit.client.0.smithi043.stdout:2/266: unlink d0/d2b/d4e/f52 0 2023-12-08T20:28:15.909 INFO:tasks.workunit.client.0.smithi043.stdout:2/267: dread - d0/d2b/f35 zero size 2023-12-08T20:28:15.914 INFO:tasks.workunit.client.0.smithi043.stdout:7/104: unlink d0/lf 0 2023-12-08T20:28:15.914 INFO:tasks.workunit.client.0.smithi043.stdout:1/165: creat d1/d6/f32 x:0 0 0 2023-12-08T20:28:15.914 INFO:tasks.workunit.client.0.smithi043.stdout:0/164: link d2/d3/d18/d1e/l27 d2/d3/d18/l33 0 2023-12-08T20:28:15.914 INFO:tasks.workunit.client.0.smithi043.stdout:1/166: chown d1/d16/l19 126 1 2023-12-08T20:28:15.915 INFO:tasks.workunit.client.0.smithi043.stdout:4/197: dwrite d1/f10 [0,4194304] 0 2023-12-08T20:28:15.915 INFO:tasks.workunit.client.0.smithi043.stdout:4/198: chown d1/d14/d25/d28 6 1 2023-12-08T20:28:15.915 INFO:tasks.workunit.client.0.smithi043.stdout:4/199: fdatasync d1/f23 0 2023-12-08T20:28:15.915 INFO:tasks.workunit.client.0.smithi043.stdout:4/200: truncate d1/d14/d25/d39/d3f/f3a 560060 0 2023-12-08T20:28:15.915 INFO:tasks.workunit.client.0.smithi043.stdout:4/201: write d1/d14/d25/d28/f2b [689435,82335] 0 2023-12-08T20:28:15.915 INFO:tasks.workunit.client.0.smithi043.stdout:4/202: write d1/d14/d25/d39/d3f/d3c/d41/f43 [815214,26387] 0 2023-12-08T20:28:15.916 INFO:tasks.workunit.client.0.smithi043.stdout:0/165: write d2/d3/d18/d1e/f25 [7661497,20514] 0 2023-12-08T20:28:15.916 INFO:tasks.workunit.client.0.smithi043.stdout:0/166: getdents d2/d3/d18/d2b 0 2023-12-08T20:28:15.916 INFO:tasks.workunit.client.0.smithi043.stdout:0/167: fsync d2/d3/fb 0 2023-12-08T20:28:15.916 INFO:tasks.workunit.client.0.smithi043.stdout:6/172: dwrite d0/d2/f12 [0,4194304] 0 2023-12-08T20:28:15.916 INFO:tasks.workunit.client.0.smithi043.stdout:4/203: read d1/d14/f45 [1785198,72109] 0 2023-12-08T20:28:15.916 INFO:tasks.workunit.client.0.smithi043.stdout:2/268: getdents d0/d26/d37/d38 0 2023-12-08T20:28:15.917 INFO:tasks.workunit.client.0.smithi043.stdout:7/105: creat d0/d2/f21 x:0 0 0 2023-12-08T20:28:15.922 INFO:tasks.workunit.client.0.smithi043.stdout:8/206: dwrite d2/de/d37/f1f [0,4194304] 0 2023-12-08T20:28:15.922 INFO:tasks.workunit.client.0.smithi043.stdout:8/207: write d2/de/d3a/f39 [656142,45944] 0 2023-12-08T20:28:15.923 INFO:tasks.workunit.client.0.smithi043.stdout:1/167: rename d1/d16/l1e to d1/d16/d1c/l33 0 2023-12-08T20:28:15.923 INFO:tasks.workunit.client.0.smithi043.stdout:6/173: getdents d0/d2/d14/d2c 0 2023-12-08T20:28:15.923 INFO:tasks.workunit.client.0.smithi043.stdout:6/174: readlink d0/d2/lb 0 2023-12-08T20:28:15.926 INFO:tasks.workunit.client.0.smithi043.stdout:2/269: creat d0/d26/d37/d38/f5d x:0 0 0 2023-12-08T20:28:15.928 INFO:tasks.workunit.client.0.smithi043.stdout:4/204: mknod d1/c46 0 2023-12-08T20:28:15.928 INFO:tasks.workunit.client.0.smithi043.stdout:4/205: fsync d1/d14/f31 0 2023-12-08T20:28:15.933 INFO:tasks.workunit.client.0.smithi043.stdout:6/175: dread d0/d2/d14/f18 [0,4194304] 0 2023-12-08T20:28:15.933 INFO:tasks.workunit.client.0.smithi043.stdout:8/208: link d2/c6 d2/d27/d2d/d31/c42 0 2023-12-08T20:28:15.933 INFO:tasks.workunit.client.0.smithi043.stdout:2/270: mknod d0/d20/d42/d49/c5e 0 2023-12-08T20:28:15.934 INFO:tasks.workunit.client.0.smithi043.stdout:2/271: write d0/d2b/f5b [896608,45887] 0 2023-12-08T20:28:15.935 INFO:tasks.workunit.client.0.smithi043.stdout:2/272: write d0/d26/f34 [2212033,46475] 0 2023-12-08T20:28:15.936 INFO:tasks.workunit.client.0.smithi043.stdout:8/209: mknod d2/de/c43 0 2023-12-08T20:28:15.936 INFO:tasks.workunit.client.0.smithi043.stdout:8/210: write d2/de/f13 [1298921,36092] 0 2023-12-08T20:28:15.940 INFO:tasks.workunit.client.0.smithi043.stdout:2/273: creat d0/d20/d42/d49/f5f x:0 0 0 2023-12-08T20:28:15.940 INFO:tasks.workunit.client.0.smithi043.stdout:8/211: symlink d2/d20/l44 0 2023-12-08T20:28:15.941 INFO:tasks.workunit.client.0.smithi043.stdout:2/274: truncate d0/f25 1116619 0 2023-12-08T20:28:15.943 INFO:tasks.workunit.client.0.smithi043.stdout:2/275: unlink d0/db/c11 0 2023-12-08T20:28:15.944 INFO:tasks.workunit.client.0.smithi043.stdout:2/276: creat d0/d20/f60 x:0 0 0 2023-12-08T20:28:15.944 INFO:tasks.workunit.client.0.smithi043.stdout:2/277: fdatasync d0/db/d18/d3d/f56 0 2023-12-08T20:28:15.947 INFO:tasks.workunit.client.0.smithi043.stdout:4/206: dread d1/d14/d25/d28/f2e [0,4194304] 0 2023-12-08T20:28:15.949 INFO:tasks.workunit.client.0.smithi043.stdout:0/168: dwrite d2/d3/d6/f2e [0,4194304] 0 2023-12-08T20:28:15.951 INFO:tasks.workunit.client.0.smithi043.stdout:4/207: creat d1/d14/d1d/f47 x:0 0 0 2023-12-08T20:28:15.953 INFO:tasks.workunit.client.0.smithi043.stdout:7/106: dwrite d0/d2/f21 [0,4194304] 0 2023-12-08T20:28:15.954 INFO:tasks.workunit.client.0.smithi043.stdout:0/169: creat d2/f34 x:0 0 0 2023-12-08T20:28:15.955 INFO:tasks.workunit.client.0.smithi043.stdout:1/168: dwrite d1/d16/f28 [0,4194304] 0 2023-12-08T20:28:15.955 INFO:tasks.workunit.client.0.smithi043.stdout:1/169: write d1/f2a [99187,100306] 0 2023-12-08T20:28:15.957 INFO:tasks.workunit.client.0.smithi043.stdout:4/208: creat d1/d14/f48 x:0 0 0 2023-12-08T20:28:15.958 INFO:tasks.workunit.client.0.smithi043.stdout:7/107: mknod d0/d2/c22 0 2023-12-08T20:28:15.958 INFO:tasks.workunit.client.0.smithi043.stdout:7/108: write d0/d2/fc [1991838,50238] 0 2023-12-08T20:28:15.958 INFO:tasks.workunit.client.0.smithi043.stdout:7/109: getdents d0/d2/d12/d19 0 2023-12-08T20:28:15.959 INFO:tasks.workunit.client.0.smithi043.stdout:0/170: creat d2/d4/f35 x:0 0 0 2023-12-08T20:28:15.960 INFO:tasks.workunit.client.0.smithi043.stdout:2/278: dread d0/db/d18/d3d/f56 [0,4194304] 0 2023-12-08T20:28:15.960 INFO:tasks.workunit.client.0.smithi043.stdout:2/279: write d0/f24 [30465,55888] 0 2023-12-08T20:28:15.961 INFO:tasks.workunit.client.0.smithi043.stdout:6/176: dwrite d0/d2/f1f [0,4194304] 0 2023-12-08T20:28:15.961 INFO:tasks.workunit.client.0.smithi043.stdout:6/177: dread - d0/d2/f28 zero size 2023-12-08T20:28:15.961 INFO:tasks.workunit.client.0.smithi043.stdout:6/178: chown d0/f34 46754 1 2023-12-08T20:28:15.962 INFO:tasks.workunit.client.0.smithi043.stdout:8/212: dwrite d2/de/d29/d30/f41 [0,4194304] 0 2023-12-08T20:28:15.963 INFO:tasks.workunit.client.0.smithi043.stdout:1/170: getdents d1/d16/d21/d25 0 2023-12-08T20:28:15.964 INFO:tasks.workunit.client.0.smithi043.stdout:4/209: truncate d1/d14/f31 873649 0 2023-12-08T20:28:15.969 INFO:tasks.workunit.client.0.smithi043.stdout:7/110: mknod d0/d6/c23 0 2023-12-08T20:28:15.969 INFO:tasks.workunit.client.0.smithi043.stdout:7/111: write d0/d6/f18 [513568,55463] 0 2023-12-08T20:28:15.970 INFO:tasks.workunit.client.0.smithi043.stdout:7/112: truncate d0/f1b 968355 0 2023-12-08T20:28:15.970 INFO:tasks.workunit.client.0.smithi043.stdout:0/171: rename d2/ff to d2/d3/d18/d2b/f36 0 2023-12-08T20:28:15.971 INFO:tasks.workunit.client.0.smithi043.stdout:0/172: write d2/d4/fe [661427,73830] 0 2023-12-08T20:28:15.972 INFO:tasks.workunit.client.0.smithi043.stdout:0/173: truncate d2/f8 1288244 0 2023-12-08T20:28:15.978 INFO:tasks.workunit.client.0.smithi043.stdout:6/179: mkdir d0/d2/d14/d2c/d22/d3f/d45 0 2023-12-08T20:28:15.979 INFO:tasks.workunit.client.0.smithi043.stdout:1/171: truncate d1/d16/d21/f22 1891274 0 2023-12-08T20:28:15.982 INFO:tasks.workunit.client.0.smithi043.stdout:2/280: dwrite d0/db/d18/f1d [0,4194304] 0 2023-12-08T20:28:15.982 INFO:tasks.workunit.client.0.smithi043.stdout:2/281: truncate d0/f25 1678644 0 2023-12-08T20:28:15.982 INFO:tasks.workunit.client.0.smithi043.stdout:2/282: stat d0/f4 0 2023-12-08T20:28:15.985 INFO:tasks.workunit.client.0.smithi043.stdout:6/180: mknod d0/d2/d14/d2c/c46 0 2023-12-08T20:28:15.985 INFO:tasks.workunit.client.0.smithi043.stdout:6/181: chown d0/d2/d14/d2c 229753811 1 2023-12-08T20:28:15.986 INFO:tasks.workunit.client.0.smithi043.stdout:1/172: getdents d1/d6 0 2023-12-08T20:28:15.986 INFO:tasks.workunit.client.0.smithi043.stdout:7/113: dread d0/d6/d8/f1e [0,4194304] 0 2023-12-08T20:28:15.993 INFO:tasks.workunit.client.0.smithi043.stdout:2/283: creat d0/f61 x:0 0 0 2023-12-08T20:28:15.994 INFO:tasks.workunit.client.0.smithi043.stdout:6/182: mkdir d0/d2/d14/d8/d47 0 2023-12-08T20:28:15.998 INFO:tasks.workunit.client.0.smithi043.stdout:8/213: dwrite d2/de/f13 [0,4194304] 0 2023-12-08T20:28:15.998 INFO:tasks.workunit.client.0.smithi043.stdout:4/210: dwrite d1/d14/f48 [0,4194304] 0 2023-12-08T20:28:15.998 INFO:tasks.workunit.client.0.smithi043.stdout:1/173: creat d1/d6/f34 x:0 0 0 2023-12-08T20:28:15.998 INFO:tasks.workunit.client.0.smithi043.stdout:1/174: readlink d1/d16/l19 0 2023-12-08T20:28:16.004 INFO:tasks.workunit.client.0.smithi043.stdout:6/183: rename d0/f1d to d0/f48 0 2023-12-08T20:28:16.005 INFO:tasks.workunit.client.0.smithi043.stdout:7/114: dwrite d0/d6/d8/f15 [0,4194304] 0 2023-12-08T20:28:16.006 INFO:tasks.workunit.client.0.smithi043.stdout:8/214: creat d2/f45 x:0 0 0 2023-12-08T20:28:16.006 INFO:tasks.workunit.client.0.smithi043.stdout:8/215: chown d2/c10 514 1 2023-12-08T20:28:16.011 INFO:tasks.workunit.client.0.smithi043.stdout:4/211: rename d1/d14/d25/d28/l37 to d1/d14/d25/d39/d3d/d40/l49 0 2023-12-08T20:28:16.013 INFO:tasks.workunit.client.0.smithi043.stdout:1/175: mkdir d1/d16/d21/d25/d35 0 2023-12-08T20:28:16.013 INFO:tasks.workunit.client.0.smithi043.stdout:1/176: write d1/d6/f34 [537711,45436] 0 2023-12-08T20:28:16.014 INFO:tasks.workunit.client.0.smithi043.stdout:7/115: dread d0/d2/f5 [0,4194304] 0 2023-12-08T20:28:16.015 INFO:tasks.workunit.client.0.smithi043.stdout:1/177: mknod d1/c36 0 2023-12-08T20:28:16.016 INFO:tasks.workunit.client.0.smithi043.stdout:1/178: chown d1/d16/l19 15709 1 2023-12-08T20:28:16.016 INFO:tasks.workunit.client.0.smithi043.stdout:1/179: chown d1/f1d 105541849 1 2023-12-08T20:28:16.018 INFO:tasks.workunit.client.0.smithi043.stdout:1/180: unlink d1/f1d 0 2023-12-08T20:28:16.018 INFO:tasks.workunit.client.0.smithi043.stdout:1/181: fsync d1/d16/d21/f22 0 2023-12-08T20:28:16.018 INFO:tasks.workunit.client.0.smithi043.stdout:1/182: fsync d1/f2c 0 2023-12-08T20:28:16.018 INFO:tasks.workunit.client.0.smithi043.stdout:1/183: stat d1/f2c 0 2023-12-08T20:28:16.018 INFO:tasks.workunit.client.0.smithi043.stdout:1/184: chown d1/f23 5 1 2023-12-08T20:28:16.019 INFO:tasks.workunit.client.0.smithi043.stdout:7/116: dread d0/d2/f11 [0,4194304] 0 2023-12-08T20:28:16.019 INFO:tasks.workunit.client.0.smithi043.stdout:1/185: creat d1/d16/d30/f37 x:0 0 0 2023-12-08T20:28:16.023 INFO:tasks.workunit.client.0.smithi043.stdout:7/117: creat d0/d6/f24 x:0 0 0 2023-12-08T20:28:16.024 INFO:tasks.workunit.client.0.smithi043.stdout:1/186: rename d1/d16/d1c/l2e to d1/d16/d30/l38 0 2023-12-08T20:28:16.025 INFO:tasks.workunit.client.0.smithi043.stdout:4/212: dread d1/d14/d1d/fb [0,4194304] 0 2023-12-08T20:28:16.025 INFO:tasks.workunit.client.0.smithi043.stdout:1/187: write d1/fb [1022791,40886] 0 2023-12-08T20:28:16.025 INFO:tasks.workunit.client.0.smithi043.stdout:1/188: truncate d1/d6/f34 683463 0 2023-12-08T20:28:16.026 INFO:tasks.workunit.client.0.smithi043.stdout:6/184: dwrite d0/f35 [0,4194304] 0 2023-12-08T20:28:16.026 INFO:tasks.workunit.client.0.smithi043.stdout:6/185: write d0/d2/f36 [890068,123122] 0 2023-12-08T20:28:16.027 INFO:tasks.workunit.client.0.smithi043.stdout:7/118: dread d0/d6/f18 [0,4194304] 0 2023-12-08T20:28:16.027 INFO:tasks.workunit.client.0.smithi043.stdout:7/119: fdatasync d0/f1b 0 2023-12-08T20:28:16.028 INFO:tasks.workunit.client.0.smithi043.stdout:4/213: symlink d1/d14/d25/d39/d3f/d3c/d41/l4a 0 2023-12-08T20:28:16.028 INFO:tasks.workunit.client.0.smithi043.stdout:4/214: write d1/d14/d25/f29 [882307,35331] 0 2023-12-08T20:28:16.029 INFO:tasks.workunit.client.0.smithi043.stdout:1/189: rename d1/f23 to d1/d16/f39 0 2023-12-08T20:28:16.032 INFO:tasks.workunit.client.0.smithi043.stdout:1/190: write d1/d6/f34 [460621,63310] 0 2023-12-08T20:28:16.032 INFO:tasks.workunit.client.0.smithi043.stdout:7/120: link d0/d6/d8/le d0/l25 0 2023-12-08T20:28:16.033 INFO:tasks.workunit.client.0.smithi043.stdout:4/215: creat d1/d14/d1d/f4b x:0 0 0 2023-12-08T20:28:16.033 INFO:tasks.workunit.client.0.smithi043.stdout:4/216: chown d1/d14/d25/d28/f35 11 1 2023-12-08T20:28:16.033 INFO:tasks.workunit.client.0.smithi043.stdout:6/186: truncate d0/d2/f3e 366759 0 2023-12-08T20:28:16.033 INFO:tasks.workunit.client.0.smithi043.stdout:6/187: chown d0/d2/de/l3a 1609445 1 2023-12-08T20:28:16.048 INFO:tasks.workunit.client.0.smithi043.stdout:1/191: mknod d1/c3a 0 2023-12-08T20:28:16.048 INFO:tasks.workunit.client.0.smithi043.stdout:4/217: unlink d1/ld 0 2023-12-08T20:28:16.049 INFO:tasks.workunit.client.0.smithi043.stdout:7/121: dwrite d0/d6/d8/f9 [0,4194304] 0 2023-12-08T20:28:16.049 INFO:tasks.workunit.client.0.smithi043.stdout:6/188: mkdir d0/d2/d14/d20/d49 0 2023-12-08T20:28:16.051 INFO:tasks.workunit.client.0.smithi043.stdout:1/192: symlink d1/d16/d21/d25/l3b 0 2023-12-08T20:28:16.053 INFO:tasks.workunit.client.0.smithi043.stdout:4/218: mknod d1/d14/d1d/c4c 0 2023-12-08T20:28:16.055 INFO:tasks.workunit.client.0.smithi043.stdout:7/122: link d0/d2/c14 d0/d2/c26 0 2023-12-08T20:28:16.058 INFO:tasks.workunit.client.0.smithi043.stdout:4/219: truncate d1/f23 587515 0 2023-12-08T20:28:16.059 INFO:tasks.workunit.client.0.smithi043.stdout:1/193: truncate d1/fb 483365 0 2023-12-08T20:28:16.059 INFO:tasks.workunit.client.0.smithi043.stdout:1/194: write d1/d6/f32 [351054,115621] 0 2023-12-08T20:28:16.059 INFO:tasks.workunit.client.0.smithi043.stdout:1/195: readlink d1/d16/d1c/l27 0 2023-12-08T20:28:16.059 INFO:tasks.workunit.client.0.smithi043.stdout:1/196: chown d1/d16/d1c/l33 50 1 2023-12-08T20:28:16.061 INFO:tasks.workunit.client.0.smithi043.stdout:4/220: mknod d1/d14/d25/d28/c4d 0 2023-12-08T20:28:16.061 INFO:tasks.workunit.client.0.smithi043.stdout:4/221: rename d1 to d1/d14/d25/d39/d3d/d40/d4e 22 2023-12-08T20:28:16.064 INFO:tasks.workunit.client.0.smithi043.stdout:4/222: creat d1/d14/d25/d28/f4f x:0 0 0 2023-12-08T20:28:16.071 INFO:tasks.workunit.client.0.smithi043.stdout:4/223: dread d1/d14/d1d/f1e [4194304,4194304] 0 2023-12-08T20:28:16.073 INFO:tasks.workunit.client.0.smithi043.stdout:4/224: dread d1/d14/d25/d39/d3f/d3c/d41/f43 [0,4194304] 0 2023-12-08T20:28:16.075 INFO:tasks.workunit.client.0.smithi043.stdout:4/225: mkdir d1/d14/d50 0 2023-12-08T20:28:16.075 INFO:tasks.workunit.client.0.smithi043.stdout:4/226: write d1/f23 [1528469,95061] 0 2023-12-08T20:28:16.080 INFO:tasks.workunit.client.0.smithi043.stdout:6/189: dwrite d0/d2/d14/d20/f44 [0,4194304] 0 2023-12-08T20:28:16.081 INFO:tasks.workunit.client.0.smithi043.stdout:4/227: rename d1/f23 to d1/d14/d25/d39/f51 0 2023-12-08T20:28:16.081 INFO:tasks.workunit.client.0.smithi043.stdout:4/228: dread - d1/d14/d25/f2c zero size 2023-12-08T20:28:16.085 INFO:tasks.workunit.client.0.smithi043.stdout:7/123: dwrite d0/d2/fc [0,4194304] 0 2023-12-08T20:28:16.085 INFO:tasks.workunit.client.0.smithi043.stdout:4/229: rename d1/d14/d25/d39/d3d/d40/l49 to d1/d14/d25/d28/l52 0 2023-12-08T20:28:16.088 INFO:tasks.workunit.client.0.smithi043.stdout:4/230: creat d1/d14/d50/f53 x:0 0 0 2023-12-08T20:28:16.088 INFO:tasks.workunit.client.0.smithi043.stdout:1/197: dwrite d1/f2a [0,4194304] 0 2023-12-08T20:28:16.090 INFO:tasks.workunit.client.0.smithi043.stdout:1/198: symlink d1/d16/d21/d25/d35/l3c 0 2023-12-08T20:28:16.091 INFO:tasks.workunit.client.0.smithi043.stdout:1/199: creat d1/d6/f3d x:0 0 0 2023-12-08T20:28:16.093 INFO:tasks.workunit.client.0.smithi043.stdout:1/200: mkdir d1/d16/d21/d25/d3e 0 2023-12-08T20:28:16.093 INFO:tasks.workunit.client.0.smithi043.stdout:1/201: truncate d1/d16/f28 4954253 0 2023-12-08T20:28:16.094 INFO:tasks.workunit.client.0.smithi043.stdout:1/202: truncate d1/d6/fa 1093677 0 2023-12-08T20:28:16.095 INFO:tasks.workunit.client.0.smithi043.stdout:6/190: dwrite d0/d2/d14/d2c/f3b [0,4194304] 0 2023-12-08T20:28:16.097 INFO:tasks.workunit.client.0.smithi043.stdout:1/203: creat d1/d6/f3f x:0 0 0 2023-12-08T20:28:16.097 INFO:tasks.workunit.client.0.smithi043.stdout:1/204: dread - d1/f2c zero size 2023-12-08T20:28:16.097 INFO:tasks.workunit.client.0.smithi043.stdout:6/191: dread d0/d2/d14/d8/f1e [0,4194304] 0 2023-12-08T20:28:16.097 INFO:tasks.workunit.client.0.smithi043.stdout:6/192: chown d0/l1 182142 1 2023-12-08T20:28:16.098 INFO:tasks.workunit.client.0.smithi043.stdout:1/205: write d1/fb [208365,17242] 0 2023-12-08T20:28:16.101 INFO:tasks.workunit.client.0.smithi043.stdout:6/193: mkdir d0/d2/de/d4a 0 2023-12-08T20:28:16.103 INFO:tasks.workunit.client.0.smithi043.stdout:1/206: creat d1/d16/f40 x:0 0 0 2023-12-08T20:28:16.104 INFO:tasks.workunit.client.0.smithi043.stdout:1/207: unlink d1/d6/l7 0 2023-12-08T20:28:16.106 INFO:tasks.workunit.client.0.smithi043.stdout:1/208: write d1/d16/f18 [879016,20485] 0 2023-12-08T20:28:16.106 INFO:tasks.workunit.client.0.smithi043.stdout:1/209: readlink d1/d16/d21/d25/l3b 0 2023-12-08T20:28:16.106 INFO:tasks.workunit.client.0.smithi043.stdout:1/210: dread - d1/d6/f3f zero size 2023-12-08T20:28:16.109 INFO:tasks.workunit.client.0.smithi043.stdout:1/211: symlink d1/d16/d1c/l41 0 2023-12-08T20:28:16.111 INFO:tasks.workunit.client.0.smithi043.stdout:1/212: mkdir d1/d16/d21/d42 0 2023-12-08T20:28:16.113 INFO:tasks.workunit.client.0.smithi043.stdout:1/213: rename d1/d6/f1b to d1/d16/d21/d25/d35/f43 0 2023-12-08T20:28:16.116 INFO:tasks.workunit.client.0.smithi043.stdout:1/214: creat d1/d16/d1c/f44 x:0 0 0 2023-12-08T20:28:16.120 INFO:tasks.workunit.client.0.smithi043.stdout:1/215: write d1/d16/d21/f22 [1679376,25505] 0 2023-12-08T20:28:16.122 INFO:tasks.workunit.client.0.smithi043.stdout:6/194: dwrite d0/d2/f12 [0,4194304] 0 2023-12-08T20:28:16.123 INFO:tasks.workunit.client.0.smithi043.stdout:6/195: truncate d0/f48 308983 0 2023-12-08T20:28:16.123 INFO:tasks.workunit.client.0.smithi043.stdout:6/196: chown d0/d2/d14/d8/d47 45 1 2023-12-08T20:28:16.125 INFO:tasks.workunit.client.0.smithi043.stdout:6/197: rename d0/d2/lb to d0/d2/d14/d2c/d22/l4b 0 2023-12-08T20:28:16.126 INFO:tasks.workunit.client.0.smithi043.stdout:6/198: getdents d0/d2/d14/d20/d3c 0 2023-12-08T20:28:16.127 INFO:tasks.workunit.client.0.smithi043.stdout:6/199: write d0/d2/d14/f18 [705503,63462] 0 2023-12-08T20:28:16.129 INFO:tasks.workunit.client.0.smithi043.stdout:6/200: mknod d0/d2/d14/d2c/d22/d2a/c4c 0 2023-12-08T20:28:16.129 INFO:tasks.workunit.client.0.smithi043.stdout:6/201: stat d0/d2/f1f 0 2023-12-08T20:28:16.130 INFO:tasks.workunit.client.0.smithi043.stdout:6/202: chown d0/d2/f3e 0 1 2023-12-08T20:28:16.130 INFO:tasks.workunit.client.0.smithi043.stdout:1/216: dread d1/f2 [0,4194304] 0 2023-12-08T20:28:16.130 INFO:tasks.workunit.client.0.smithi043.stdout:1/217: chown d1/fb 0 1 2023-12-08T20:28:16.131 INFO:tasks.workunit.client.0.smithi043.stdout:1/218: link d1/d16/d1c/l27 d1/d16/d21/d25/l45 0 2023-12-08T20:28:16.133 INFO:tasks.workunit.client.0.smithi043.stdout:1/219: creat d1/d16/f46 x:0 0 0 2023-12-08T20:28:16.135 INFO:tasks.workunit.client.0.smithi043.stdout:1/220: rename d1/d16/d21/f22 to d1/d16/f47 0 2023-12-08T20:28:16.138 INFO:tasks.workunit.client.0.smithi043.stdout:1/221: mkdir d1/d16/d48 0 2023-12-08T20:28:16.139 INFO:tasks.workunit.client.0.smithi043.stdout:1/222: rename d1/d6/f34 to d1/d16/f49 0 2023-12-08T20:28:16.142 INFO:tasks.workunit.client.0.smithi043.stdout:1/223: creat d1/d16/d48/f4a x:0 0 0 2023-12-08T20:28:16.142 INFO:tasks.workunit.client.0.smithi043.stdout:1/224: dread - d1/d6/f3d zero size 2023-12-08T20:28:16.142 INFO:tasks.workunit.client.0.smithi043.stdout:1/225: read - d1/d6/f29 zero size 2023-12-08T20:28:16.142 INFO:tasks.workunit.client.0.smithi043.stdout:1/226: dread - d1/d16/d48/f4a zero size 2023-12-08T20:28:16.146 INFO:tasks.workunit.client.0.smithi043.stdout:1/227: rename d1/d16/c1a to d1/d16/d21/c4b 0 2023-12-08T20:28:16.149 INFO:tasks.workunit.client.0.smithi043.stdout:6/203: dwrite d0/d2/f1f [0,4194304] 0 2023-12-08T20:28:16.150 INFO:tasks.workunit.client.0.smithi043.stdout:6/204: write d0/d2/d14/d2c/d22/f32 [186159,39160] 0 2023-12-08T20:28:16.156 INFO:tasks.workunit.client.0.smithi043.stdout:6/205: creat d0/d2/f4d x:0 0 0 2023-12-08T20:28:16.158 INFO:tasks.workunit.client.0.smithi043.stdout:6/206: creat d0/d2/d14/d8/f4e x:0 0 0 2023-12-08T20:28:16.180 INFO:tasks.workunit.client.0.smithi043.stdout:3/166: sync 2023-12-08T20:28:16.180 INFO:tasks.workunit.client.0.smithi043.stdout:3/167: chown d1/d9/df 10322883 1 2023-12-08T20:28:16.181 INFO:tasks.workunit.client.0.smithi043.stdout:3/168: mkdir d1/d25/d2a/d2e/d34 0 2023-12-08T20:28:16.181 INFO:tasks.workunit.client.0.smithi043.stdout:3/169: chown d1/d9/df/c20 9784719 1 2023-12-08T20:28:16.182 INFO:tasks.workunit.client.0.smithi043.stdout:3/170: write d1/f1e [1454023,54044] 0 2023-12-08T20:28:16.182 INFO:tasks.workunit.client.0.smithi043.stdout:3/171: chown d1/d9/f32 4387 1 2023-12-08T20:28:16.182 INFO:tasks.workunit.client.0.smithi043.stdout:3/172: write d1/d25/f24 [1312098,126235] 0 2023-12-08T20:28:16.182 INFO:tasks.workunit.client.0.smithi043.stdout:3/173: link d1/d9/df/d26/l27 d1/d9/df/l35 0 2023-12-08T20:28:16.182 INFO:tasks.workunit.client.0.smithi043.stdout:3/174: write d1/d9/fe [1176261,65356] 0 2023-12-08T20:28:16.183 INFO:tasks.workunit.client.0.smithi043.stdout:3/175: truncate d1/d9/f1f 996368 0 2023-12-08T20:28:16.183 INFO:tasks.workunit.client.0.smithi043.stdout:3/176: chown d1/d1c/f22 7885178 1 2023-12-08T20:28:16.203 INFO:tasks.workunit.client.0.smithi043.stdout:3/177: dwrite d1/d9/f1f [0,4194304] 0 2023-12-08T20:28:16.203 INFO:tasks.workunit.client.0.smithi043.stdout:3/178: dread - d1/d9/df/d26/f2f zero size 2023-12-08T20:28:16.203 INFO:tasks.workunit.client.0.smithi043.stdout:3/179: fdatasync d1/f18 0 2023-12-08T20:28:16.209 INFO:tasks.workunit.client.0.smithi043.stdout:3/180: dread d1/d9/fe [0,4194304] 0 2023-12-08T20:28:16.209 INFO:tasks.workunit.client.0.smithi043.stdout:3/181: fdatasync d1/d9/f1f 0 2023-12-08T20:28:16.210 INFO:tasks.workunit.client.0.smithi043.stdout:3/182: creat d1/d25/f36 x:0 0 0 2023-12-08T20:28:16.212 INFO:tasks.workunit.client.0.smithi043.stdout:3/183: write d1/f18 [13110,87050] 0 2023-12-08T20:28:16.214 INFO:tasks.workunit.client.0.smithi043.stdout:3/184: mknod d1/d25/d2a/d2e/d34/c37 0 2023-12-08T20:28:16.216 INFO:tasks.workunit.client.0.smithi043.stdout:3/185: rename d1/d28 to d1/d9/d38 0 2023-12-08T20:28:16.216 INFO:tasks.workunit.client.0.smithi043.stdout:3/186: chown d1 30029 1 2023-12-08T20:28:16.216 INFO:tasks.workunit.client.0.smithi043.stdout:3/187: stat d1/d9/f32 0 2023-12-08T20:28:16.216 INFO:tasks.workunit.client.0.smithi043.stdout:3/188: read d1/d9/f32 [48612,128291] 0 2023-12-08T20:28:16.229 INFO:tasks.workunit.client.0.smithi043.stdout:3/189: dwrite d1/d9/df/f17 [0,4194304] 0 2023-12-08T20:28:16.230 INFO:tasks.workunit.client.0.smithi043.stdout:3/190: read d1/f18 [946019,83371] 0 2023-12-08T20:28:16.231 INFO:tasks.workunit.client.0.smithi043.stdout:3/191: creat d1/d25/d2a/f39 x:0 0 0 2023-12-08T20:28:16.231 INFO:tasks.workunit.client.0.smithi043.stdout:3/192: fsync d1/d25/f24 0 2023-12-08T20:28:16.232 INFO:tasks.workunit.client.0.smithi043.stdout:3/193: creat d1/d9/df/f3a x:0 0 0 2023-12-08T20:28:16.252 INFO:tasks.workunit.client.0.smithi043.stdout:3/194: dwrite d1/d25/f24 [0,4194304] 0 2023-12-08T20:28:16.252 INFO:tasks.workunit.client.0.smithi043.stdout:3/195: getdents d1/d9/d2d 0 2023-12-08T20:28:16.266 INFO:tasks.workunit.client.0.smithi043.stdout:3/196: dwrite d1/d9/fd [0,4194304] 0 2023-12-08T20:28:16.275 INFO:tasks.workunit.client.0.smithi043.stdout:3/197: dread d1/f18 [0,4194304] 0 2023-12-08T20:28:16.288 INFO:tasks.workunit.client.0.smithi043.stdout:3/198: dwrite d1/d9/df/d26/f2f [0,4194304] 0 2023-12-08T20:28:16.290 INFO:tasks.workunit.client.0.smithi043.stdout:3/199: mknod d1/d25/d2a/d2e/c3b 0 2023-12-08T20:28:16.290 INFO:tasks.workunit.client.0.smithi043.stdout:3/200: stat d1/d9/df/f17 0 2023-12-08T20:28:16.290 INFO:tasks.workunit.client.0.smithi043.stdout:3/201: truncate d1/d25/f36 962342 0 2023-12-08T20:28:16.290 INFO:tasks.workunit.client.0.smithi043.stdout:3/202: mknod d1/d9/c3c 0 2023-12-08T20:28:16.291 INFO:tasks.workunit.client.0.smithi043.stdout:3/203: creat d1/d9/d38/f3d x:0 0 0 2023-12-08T20:28:16.292 INFO:tasks.workunit.client.0.smithi043.stdout:3/204: dread - d1/d9/d38/f3d zero size 2023-12-08T20:28:16.292 INFO:tasks.workunit.client.0.smithi043.stdout:3/205: chown d1/d9/df/f3a 22187 1 2023-12-08T20:28:16.300 INFO:tasks.workunit.client.0.smithi043.stdout:3/206: dread d1/d9/df/d26/f2f [0,4194304] 0 2023-12-08T20:28:16.300 INFO:tasks.workunit.client.0.smithi043.stdout:3/207: stat d1/d25/d2a/f39 0 2023-12-08T20:28:16.300 INFO:tasks.workunit.client.0.smithi043.stdout:3/208: creat d1/d1c/d2c/f3e x:0 0 0 2023-12-08T20:28:16.326 INFO:tasks.workunit.client.0.smithi043.stdout:5/202: sync 2023-12-08T20:28:16.326 INFO:tasks.workunit.client.0.smithi043.stdout:9/213: sync 2023-12-08T20:28:16.326 INFO:tasks.workunit.client.0.smithi043.stdout:8/216: sync 2023-12-08T20:28:16.326 INFO:tasks.workunit.client.0.smithi043.stdout:8/217: chown d2/de/d37 6891675 1 2023-12-08T20:28:16.327 INFO:tasks.workunit.client.0.smithi043.stdout:9/214: rename d0/f29 to d0/d3d/f42 0 2023-12-08T20:28:16.329 INFO:tasks.workunit.client.0.smithi043.stdout:5/203: link d3/l6 d3/d7/d29/l3b 0 2023-12-08T20:28:16.330 INFO:tasks.workunit.client.0.smithi043.stdout:5/204: write d3/d7/de/d17/f27 [1712806,31773] 0 2023-12-08T20:28:16.332 INFO:tasks.workunit.client.0.smithi043.stdout:9/215: read d0/f14 [989087,6020] 0 2023-12-08T20:28:16.333 INFO:tasks.workunit.client.0.smithi043.stdout:5/205: write f1 [1973321,59816] 0 2023-12-08T20:28:16.334 INFO:tasks.workunit.client.0.smithi043.stdout:9/216: dread d0/d21/f23 [0,4194304] 0 2023-12-08T20:28:16.334 INFO:tasks.workunit.client.0.smithi043.stdout:9/217: fdatasync d0/f14 0 2023-12-08T20:28:16.334 INFO:tasks.workunit.client.0.smithi043.stdout:5/206: rmdir d3 39 2023-12-08T20:28:16.335 INFO:tasks.workunit.client.0.smithi043.stdout:5/207: read d3/fc [7151834,90615] 0 2023-12-08T20:28:16.336 INFO:tasks.workunit.client.0.smithi043.stdout:5/208: creat d3/d7/d29/f3c x:0 0 0 2023-12-08T20:28:16.350 INFO:tasks.workunit.client.0.smithi043.stdout:8/218: dwrite d2/f3e [0,4194304] 0 2023-12-08T20:28:16.350 INFO:tasks.workunit.client.0.smithi043.stdout:5/209: dread f2 [0,4194304] 0 2023-12-08T20:28:16.350 INFO:tasks.workunit.client.0.smithi043.stdout:5/210: chown d3/d7/de/l1c 628 1 2023-12-08T20:28:16.350 INFO:tasks.workunit.client.0.smithi043.stdout:5/211: write d3/f37 [231500,73614] 0 2023-12-08T20:28:16.350 INFO:tasks.workunit.client.0.smithi043.stdout:5/212: write f2 [9328207,47380] 0 2023-12-08T20:28:16.351 INFO:tasks.workunit.client.0.smithi043.stdout:8/219: getdents d2/de/d3a 0 2023-12-08T20:28:16.352 INFO:tasks.workunit.client.0.smithi043.stdout:5/213: creat d3/f3d x:0 0 0 2023-12-08T20:28:16.353 INFO:tasks.workunit.client.0.smithi043.stdout:5/214: symlink d3/d7/d19/l3e 0 2023-12-08T20:28:16.355 INFO:tasks.workunit.client.0.smithi043.stdout:9/218: dwrite d0/f27 [0,4194304] 0 2023-12-08T20:28:16.360 INFO:tasks.workunit.client.0.smithi043.stdout:9/219: write d0/d2e/f33 [87809,7137] 0 2023-12-08T20:28:16.367 INFO:tasks.workunit.client.0.smithi043.stdout:9/220: truncate d0/f13 1402437 0 2023-12-08T20:28:16.367 INFO:tasks.workunit.client.0.smithi043.stdout:9/221: chown d0/d2e/f40 7 1 2023-12-08T20:28:16.389 INFO:tasks.workunit.client.0.smithi043.stdout:8/220: dwrite d2/f1e [0,4194304] 0 2023-12-08T20:28:16.389 INFO:tasks.workunit.client.0.smithi043.stdout:5/215: dwrite d3/d7/de/f1e [0,4194304] 0 2023-12-08T20:28:16.389 INFO:tasks.workunit.client.0.smithi043.stdout:9/222: dwrite d0/d2e/d37/f3a [0,4194304] 0 2023-12-08T20:28:16.389 INFO:tasks.workunit.client.0.smithi043.stdout:9/223: fdatasync d0/f17 0 2023-12-08T20:28:16.390 INFO:tasks.workunit.client.0.smithi043.stdout:9/224: read d0/d2e/d37/f3a [702145,61997] 0 2023-12-08T20:28:16.391 INFO:tasks.workunit.client.0.smithi043.stdout:8/221: rename d2/f45 to d2/de/f46 0 2023-12-08T20:28:16.393 INFO:tasks.workunit.client.0.smithi043.stdout:5/216: unlink d3/d7/d21/l34 0 2023-12-08T20:28:16.393 INFO:tasks.workunit.client.0.smithi043.stdout:9/225: mknod d0/c43 0 2023-12-08T20:28:16.393 INFO:tasks.workunit.client.0.smithi043.stdout:9/226: rename d0/d2e to d0/d2e/d44 22 2023-12-08T20:28:16.393 INFO:tasks.workunit.client.0.smithi043.stdout:9/227: truncate d0/f34 101558 0 2023-12-08T20:28:16.393 INFO:tasks.workunit.client.0.smithi043.stdout:9/228: chown d0 7281022 1 2023-12-08T20:28:16.395 INFO:tasks.workunit.client.0.smithi043.stdout:5/217: fsync d3/f37 0 2023-12-08T20:28:16.397 INFO:tasks.workunit.client.0.smithi043.stdout:9/229: creat d0/d3d/f45 x:0 0 0 2023-12-08T20:28:16.397 INFO:tasks.workunit.client.0.smithi043.stdout:9/230: rename d0/d2e to d0/d2e/d46 22 2023-12-08T20:28:16.397 INFO:tasks.workunit.client.0.smithi043.stdout:9/231: chown d0/cc 663188 1 2023-12-08T20:28:16.398 INFO:tasks.workunit.client.0.smithi043.stdout:9/232: chown d0/l11 33 1 2023-12-08T20:28:16.398 INFO:tasks.workunit.client.0.smithi043.stdout:9/233: readlink d0/d21/l22 0 2023-12-08T20:28:16.398 INFO:tasks.workunit.client.0.smithi043.stdout:9/234: fsync d0/f10 0 2023-12-08T20:28:16.398 INFO:tasks.workunit.client.0.smithi043.stdout:8/222: rmdir d2 39 2023-12-08T20:28:16.399 INFO:tasks.workunit.client.0.smithi043.stdout:9/235: creat d0/d2e/f47 x:0 0 0 2023-12-08T20:28:16.401 INFO:tasks.workunit.client.0.smithi043.stdout:9/236: creat d0/d3d/f48 x:0 0 0 2023-12-08T20:28:16.402 INFO:tasks.workunit.client.0.smithi043.stdout:9/237: mkdir d0/d49 0 2023-12-08T20:28:16.402 INFO:tasks.workunit.client.0.smithi043.stdout:9/238: fdatasync d0/f27 0 2023-12-08T20:28:16.412 INFO:tasks.workunit.client.0.smithi043.stdout:9/239: getdents d0 0 2023-12-08T20:28:16.424 INFO:tasks.workunit.client.0.smithi043.stdout:5/218: dwrite d3/d7/d21/f28 [0,4194304] 0 2023-12-08T20:28:16.425 INFO:tasks.workunit.client.0.smithi043.stdout:8/223: dwrite d2/f21 [0,4194304] 0 2023-12-08T20:28:16.425 INFO:tasks.workunit.client.0.smithi043.stdout:8/224: chown d2/de 0 1 2023-12-08T20:28:16.428 INFO:tasks.workunit.client.0.smithi043.stdout:8/225: mknod d2/de/d29/d30/c47 0 2023-12-08T20:28:16.430 INFO:tasks.workunit.client.0.smithi043.stdout:8/226: write d2/f3e [3490276,118773] 0 2023-12-08T20:28:16.440 INFO:tasks.workunit.client.0.smithi043.stdout:5/219: dread d3/d7/f31 [0,4194304] 0 2023-12-08T20:28:16.441 INFO:tasks.workunit.client.0.smithi043.stdout:5/220: mkdir d3/d7/d19/d3f 0 2023-12-08T20:28:16.442 INFO:tasks.workunit.client.0.smithi043.stdout:5/221: symlink d3/d7/de/d17/l40 0 2023-12-08T20:28:16.452 INFO:tasks.workunit.client.0.smithi043.stdout:8/227: dwrite d2/d20/f23 [4194304,4194304] 0 2023-12-08T20:28:16.462 INFO:tasks.workunit.client.0.smithi043.stdout:5/222: dwrite d3/d7/f31 [0,4194304] 0 2023-12-08T20:28:16.463 INFO:tasks.workunit.client.0.smithi043.stdout:5/223: rename d3/d7/d19/l38 to d3/d7/de/d17/l41 0 2023-12-08T20:28:16.463 INFO:tasks.workunit.client.0.smithi043.stdout:5/224: fsync f1 0 2023-12-08T20:28:16.466 INFO:tasks.workunit.client.0.smithi043.stdout:8/228: dwrite d2/de/d3a/f2e [0,4194304] 0 2023-12-08T20:28:16.466 INFO:tasks.workunit.client.0.smithi043.stdout:8/229: write d2/f1e [5122985,101363] 0 2023-12-08T20:28:16.471 INFO:tasks.workunit.client.0.smithi043.stdout:8/230: mknod d2/c48 0 2023-12-08T20:28:16.471 INFO:tasks.workunit.client.0.smithi043.stdout:8/231: chown d2/de/d37 10 1 2023-12-08T20:28:16.477 INFO:tasks.workunit.client.0.smithi043.stdout:0/174: sync 2023-12-08T20:28:16.478 INFO:tasks.workunit.client.0.smithi043.stdout:2/284: sync 2023-12-08T20:28:16.479 INFO:tasks.workunit.client.0.smithi043.stdout:2/285: unlink d0/db/l43 0 2023-12-08T20:28:16.480 INFO:tasks.workunit.client.0.smithi043.stdout:0/175: creat d2/d3/d18/d2b/f37 x:0 0 0 2023-12-08T20:28:16.480 INFO:tasks.workunit.client.0.smithi043.stdout:5/225: dwrite f2 [0,4194304] 0 2023-12-08T20:28:16.482 INFO:tasks.workunit.client.0.smithi043.stdout:2/286: link d0/d20/f2a d0/d20/f62 0 2023-12-08T20:28:16.482 INFO:tasks.workunit.client.0.smithi043.stdout:2/287: dread - d0/db/f4a zero size 2023-12-08T20:28:16.483 INFO:tasks.workunit.client.0.smithi043.stdout:0/176: symlink d2/d3/d6/l38 0 2023-12-08T20:28:16.483 INFO:tasks.workunit.client.0.smithi043.stdout:0/177: write d2/d3/d18/f22 [967354,21726] 0 2023-12-08T20:28:16.496 INFO:tasks.workunit.client.0.smithi043.stdout:0/178: getdents d2/d3/d18/d2b 0 2023-12-08T20:28:16.496 INFO:tasks.workunit.client.0.smithi043.stdout:0/179: truncate d2/f34 158619 0 2023-12-08T20:28:16.498 INFO:tasks.workunit.client.0.smithi043.stdout:0/180: write d2/d4/fc [1895104,71999] 0 2023-12-08T20:28:16.498 INFO:tasks.workunit.client.0.smithi043.stdout:5/226: dread d3/d7/de/f1d [0,4194304] 0 2023-12-08T20:28:16.498 INFO:tasks.workunit.client.0.smithi043.stdout:5/227: readlink d3/l22 0 2023-12-08T20:28:16.498 INFO:tasks.workunit.client.0.smithi043.stdout:5/228: dread - d3/d7/d19/f30 zero size 2023-12-08T20:28:16.498 INFO:tasks.workunit.client.0.smithi043.stdout:5/229: rename d3/d7 to d3/d7/d21/d42 22 2023-12-08T20:28:16.498 INFO:tasks.workunit.client.0.smithi043.stdout:5/230: stat d3/d7/d19 0 2023-12-08T20:28:16.499 INFO:tasks.workunit.client.0.smithi043.stdout:0/181: mkdir d2/d3/d6/d39 0 2023-12-08T20:28:16.499 INFO:tasks.workunit.client.0.smithi043.stdout:8/232: dwrite d2/f3e [0,4194304] 0 2023-12-08T20:28:16.499 INFO:tasks.workunit.client.0.smithi043.stdout:8/233: stat d2/d27/c28 0 2023-12-08T20:28:16.499 INFO:tasks.workunit.client.0.smithi043.stdout:8/234: readlink d2/d27/d2d/l2f 0 2023-12-08T20:28:16.499 INFO:tasks.workunit.client.0.smithi043.stdout:2/288: dwrite d0/f57 [0,4194304] 0 2023-12-08T20:28:16.500 INFO:tasks.workunit.client.0.smithi043.stdout:0/182: link d2/d3/d15/f20 d2/d3/f3a 0 2023-12-08T20:28:16.505 INFO:tasks.workunit.client.0.smithi043.stdout:8/235: read d2/de/f2a [41808,13248] 0 2023-12-08T20:28:16.506 INFO:tasks.workunit.client.0.smithi043.stdout:0/183: write d2/d3/d18/f2a [515405,50157] 0 2023-12-08T20:28:16.506 INFO:tasks.workunit.client.0.smithi043.stdout:0/184: chown d2/d3/d18/f2a 19240650 1 2023-12-08T20:28:16.506 INFO:tasks.workunit.client.0.smithi043.stdout:0/185: read d2/f24 [837517,64531] 0 2023-12-08T20:28:16.506 INFO:tasks.workunit.client.0.smithi043.stdout:0/186: dread - d2/d3/d18/d2b/f37 zero size 2023-12-08T20:28:16.508 INFO:tasks.workunit.client.0.smithi043.stdout:0/187: write d2/d3/d6/f2e [3175865,4880] 0 2023-12-08T20:28:16.511 INFO:tasks.workunit.client.0.smithi043.stdout:0/188: write d2/d3/f3a [1269126,45132] 0 2023-12-08T20:28:16.511 INFO:tasks.workunit.client.0.smithi043.stdout:0/189: readlink d2/l13 0 2023-12-08T20:28:16.511 INFO:tasks.workunit.client.0.smithi043.stdout:0/190: chown d2/d3/f1a 276898 1 2023-12-08T20:28:16.512 INFO:tasks.workunit.client.0.smithi043.stdout:0/191: creat d2/d3/d15/f3b x:0 0 0 2023-12-08T20:28:16.514 INFO:tasks.workunit.client.0.smithi043.stdout:0/192: creat d2/d3/d18/d1e/f3c x:0 0 0 2023-12-08T20:28:16.515 INFO:tasks.workunit.client.0.smithi043.stdout:8/236: dread d2/f21 [0,4194304] 0 2023-12-08T20:28:16.515 INFO:tasks.workunit.client.0.smithi043.stdout:8/237: read d2/f21 [3186259,111190] 0 2023-12-08T20:28:16.516 INFO:tasks.workunit.client.0.smithi043.stdout:8/238: truncate d2/de/ff 1208057 0 2023-12-08T20:28:16.518 INFO:tasks.workunit.client.0.smithi043.stdout:8/239: rmdir d2/d3b 0 2023-12-08T20:28:16.519 INFO:tasks.workunit.client.0.smithi043.stdout:2/289: dwrite d0/d20/d42/f59 [0,4194304] 0 2023-12-08T20:28:16.519 INFO:tasks.workunit.client.0.smithi043.stdout:5/231: dwrite d3/d7/f1a [0,4194304] 0 2023-12-08T20:28:16.522 INFO:tasks.workunit.client.0.smithi043.stdout:2/290: getdents d0/db 0 2023-12-08T20:28:16.524 INFO:tasks.workunit.client.0.smithi043.stdout:2/291: creat d0/db/f63 x:0 0 0 2023-12-08T20:28:16.524 INFO:tasks.workunit.client.0.smithi043.stdout:2/292: write d0/d20/f2c [1091362,14117] 0 2023-12-08T20:28:16.525 INFO:tasks.workunit.client.0.smithi043.stdout:0/193: getdents d2/d3/d18/d1e 0 2023-12-08T20:28:16.525 INFO:tasks.workunit.client.0.smithi043.stdout:0/194: chown d2/d3/d15 121 1 2023-12-08T20:28:16.540 INFO:tasks.workunit.client.0.smithi043.stdout:0/195: rename d2/d3/f3a to d2/d4/f3d 0 2023-12-08T20:28:16.540 INFO:tasks.workunit.client.0.smithi043.stdout:0/196: write d2/f34 [1102254,122594] 0 2023-12-08T20:28:16.543 INFO:tasks.workunit.client.0.smithi043.stdout:8/240: dwrite d2/f3e [0,4194304] 0 2023-12-08T20:28:16.544 INFO:tasks.workunit.client.0.smithi043.stdout:8/241: write d2/f21 [2249595,122181] 0 2023-12-08T20:28:16.551 INFO:tasks.workunit.client.0.smithi043.stdout:0/197: dread d2/d3/d15/f20 [0,4194304] 0 2023-12-08T20:28:16.552 INFO:tasks.workunit.client.0.smithi043.stdout:5/232: dwrite d3/d7/de/f1e [0,4194304] 0 2023-12-08T20:28:16.554 INFO:tasks.workunit.client.0.smithi043.stdout:2/293: dwrite d0/f25 [0,4194304] 0 2023-12-08T20:28:16.554 INFO:tasks.workunit.client.0.smithi043.stdout:0/198: dread d2/d4/f26 [0,4194304] 0 2023-12-08T20:28:16.554 INFO:tasks.workunit.client.0.smithi043.stdout:0/199: fdatasync d2/d3/d6/f2e 0 2023-12-08T20:28:16.555 INFO:tasks.workunit.client.0.smithi043.stdout:5/233: mkdir d3/d7/de/d43 0 2023-12-08T20:28:16.558 INFO:tasks.workunit.client.0.smithi043.stdout:0/200: link d2/d3/d18/c1c d2/c3e 0 2023-12-08T20:28:16.561 INFO:tasks.workunit.client.0.smithi043.stdout:5/234: link d3/c4 d3/d7/d19/c44 0 2023-12-08T20:28:16.562 INFO:tasks.workunit.client.0.smithi043.stdout:5/235: creat d3/f45 x:0 0 0 2023-12-08T20:28:16.563 INFO:tasks.workunit.client.0.smithi043.stdout:8/242: dwrite d2/d27/d2d/d31/f36 [0,4194304] 0 2023-12-08T20:28:16.563 INFO:tasks.workunit.client.0.smithi043.stdout:5/236: read f1 [1374419,79432] 0 2023-12-08T20:28:16.566 INFO:tasks.workunit.client.0.smithi043.stdout:5/237: symlink d3/d7/d21/l46 0 2023-12-08T20:28:16.566 INFO:tasks.workunit.client.0.smithi043.stdout:5/238: chown d3/d7/d21/f2d 3 1 2023-12-08T20:28:16.566 INFO:tasks.workunit.client.0.smithi043.stdout:5/239: chown d3/f3d 3 1 2023-12-08T20:28:16.566 INFO:tasks.workunit.client.0.smithi043.stdout:5/240: readlink d3/d7/d29/l3b 0 2023-12-08T20:28:16.566 INFO:tasks.workunit.client.0.smithi043.stdout:5/241: fdatasync d3/d7/d21/f28 0 2023-12-08T20:28:16.567 INFO:tasks.workunit.client.0.smithi043.stdout:0/201: dread d2/d4/fc [0,4194304] 0 2023-12-08T20:28:16.567 INFO:tasks.workunit.client.0.smithi043.stdout:0/202: truncate d2/d4/f35 635647 0 2023-12-08T20:28:16.570 INFO:tasks.workunit.client.0.smithi043.stdout:0/203: mkdir d2/d3/d15/d3f 0 2023-12-08T20:28:16.574 INFO:tasks.workunit.client.0.smithi043.stdout:5/242: dread d3/fc [0,4194304] 0 2023-12-08T20:28:16.576 INFO:tasks.workunit.client.0.smithi043.stdout:5/243: link d3/d7/d21/f2d d3/d32/f47 0 2023-12-08T20:28:16.577 INFO:tasks.workunit.client.0.smithi043.stdout:5/244: mknod d3/d7/c48 0 2023-12-08T20:28:16.577 INFO:tasks.workunit.client.0.smithi043.stdout:5/245: write d3/f3d [813557,45449] 0 2023-12-08T20:28:16.578 INFO:tasks.workunit.client.0.smithi043.stdout:0/204: dread d2/d3/d15/f20 [0,4194304] 0 2023-12-08T20:28:16.582 INFO:tasks.workunit.client.0.smithi043.stdout:8/243: dwrite d2/d27/f35 [0,4194304] 0 2023-12-08T20:28:16.585 INFO:tasks.workunit.client.0.smithi043.stdout:8/244: creat d2/de/d29/d30/f49 x:0 0 0 2023-12-08T20:28:16.588 INFO:tasks.workunit.client.0.smithi043.stdout:8/245: write d2/de/d37/f1f [3365974,49347] 0 2023-12-08T20:28:16.588 INFO:tasks.workunit.client.0.smithi043.stdout:8/246: chown d2/d27/d2d/f3c 3986 1 2023-12-08T20:28:16.589 INFO:tasks.workunit.client.0.smithi043.stdout:8/247: stat d2/c48 0 2023-12-08T20:28:16.589 INFO:tasks.workunit.client.0.smithi043.stdout:8/248: fsync d2/de/f13 0 2023-12-08T20:28:16.599 INFO:tasks.workunit.client.0.smithi043.stdout:0/205: dwrite d2/d3/d18/d2b/f36 [0,4194304] 0 2023-12-08T20:28:16.599 INFO:tasks.workunit.client.0.smithi043.stdout:5/246: dwrite d3/d7/de/f24 [0,4194304] 0 2023-12-08T20:28:16.602 INFO:tasks.workunit.client.0.smithi043.stdout:5/247: getdents d3/d7/d19 0 2023-12-08T20:28:16.603 INFO:tasks.workunit.client.0.smithi043.stdout:8/249: dread d2/d27/d2d/d31/f36 [0,4194304] 0 2023-12-08T20:28:16.603 INFO:tasks.workunit.client.0.smithi043.stdout:5/248: symlink d3/d7/d29/l49 0 2023-12-08T20:28:16.603 INFO:tasks.workunit.client.0.smithi043.stdout:5/249: fdatasync d3/d7/d29/f3c 0 2023-12-08T20:28:16.604 INFO:tasks.workunit.client.0.smithi043.stdout:8/250: mknod d2/de/d29/d30/c4a 0 2023-12-08T20:28:16.605 INFO:tasks.workunit.client.0.smithi043.stdout:5/250: dread d3/d7/f13 [0,4194304] 0 2023-12-08T20:28:16.607 INFO:tasks.workunit.client.0.smithi043.stdout:5/251: rename d3/d7/f31 to d3/d7/de/d43/f4a 0 2023-12-08T20:28:16.618 INFO:tasks.workunit.client.0.smithi043.stdout:8/251: dread d2/de/f26 [0,4194304] 0 2023-12-08T20:28:16.619 INFO:tasks.workunit.client.0.smithi043.stdout:8/252: write d2/de/f46 [672725,98016] 0 2023-12-08T20:28:16.619 INFO:tasks.workunit.client.0.smithi043.stdout:8/253: chown d2/f1e 0 1 2023-12-08T20:28:16.619 INFO:tasks.workunit.client.0.smithi043.stdout:8/254: fsync d2/d27/d2d/f3c 0 2023-12-08T20:28:16.619 INFO:tasks.workunit.client.0.smithi043.stdout:8/255: symlink d2/de/d29/l4b 0 2023-12-08T20:28:16.619 INFO:tasks.workunit.client.0.smithi043.stdout:8/256: read d2/d27/f35 [1138608,28517] 0 2023-12-08T20:28:16.621 INFO:tasks.workunit.client.0.smithi043.stdout:0/206: dwrite d2/f7 [4194304,4194304] 0 2023-12-08T20:28:16.621 INFO:tasks.workunit.client.0.smithi043.stdout:0/207: getdents d2/d3/d18/d1e 0 2023-12-08T20:28:16.622 INFO:tasks.workunit.client.0.smithi043.stdout:8/257: write d2/d20/f23 [4298226,111985] 0 2023-12-08T20:28:16.622 INFO:tasks.workunit.client.0.smithi043.stdout:0/208: dread d2/d4/f35 [0,4194304] 0 2023-12-08T20:28:16.623 INFO:tasks.workunit.client.0.smithi043.stdout:8/258: truncate d2/f9 2171552 0 2023-12-08T20:28:16.624 INFO:tasks.workunit.client.0.smithi043.stdout:5/252: dwrite d3/d7/de/f2a [4194304,4194304] 0 2023-12-08T20:28:16.624 INFO:tasks.workunit.client.0.smithi043.stdout:8/259: mknod d2/c4c 0 2023-12-08T20:28:16.625 INFO:tasks.workunit.client.0.smithi043.stdout:0/209: dread d2/f34 [0,4194304] 0 2023-12-08T20:28:16.625 INFO:tasks.workunit.client.0.smithi043.stdout:0/210: fsync d2/d3/d15/f20 0 2023-12-08T20:28:16.625 INFO:tasks.workunit.client.0.smithi043.stdout:8/260: truncate d2/f3e 3913267 0 2023-12-08T20:28:16.627 INFO:tasks.workunit.client.0.smithi043.stdout:5/253: truncate d3/d7/f1a 2552197 0 2023-12-08T20:28:16.628 INFO:tasks.workunit.client.0.smithi043.stdout:0/211: mknod d2/d3/d18/c40 0 2023-12-08T20:28:16.630 INFO:tasks.workunit.client.0.smithi043.stdout:5/254: mknod d3/d7/d21/c4b 0 2023-12-08T20:28:16.631 INFO:tasks.workunit.client.0.smithi043.stdout:0/212: dread d2/f24 [0,4194304] 0 2023-12-08T20:28:16.631 INFO:tasks.workunit.client.0.smithi043.stdout:5/255: creat d3/d7/d19/d3f/f4c x:0 0 0 2023-12-08T20:28:16.635 INFO:tasks.workunit.client.0.smithi043.stdout:8/261: dread d2/d20/f2c [0,4194304] 0 2023-12-08T20:28:16.635 INFO:tasks.workunit.client.0.smithi043.stdout:0/213: creat d2/d3/d18/d2b/f41 x:0 0 0 2023-12-08T20:28:16.635 INFO:tasks.workunit.client.0.smithi043.stdout:0/214: fsync d2/f7 0 2023-12-08T20:28:16.636 INFO:tasks.workunit.client.0.smithi043.stdout:8/262: unlink d2/d20/f23 0 2023-12-08T20:28:16.638 INFO:tasks.workunit.client.0.smithi043.stdout:0/215: symlink d2/d3/d6/l42 0 2023-12-08T20:28:16.640 INFO:tasks.workunit.client.0.smithi043.stdout:8/263: creat d2/de/f4d x:0 0 0 2023-12-08T20:28:16.641 INFO:tasks.workunit.client.0.smithi043.stdout:5/256: dread f1 [0,4194304] 0 2023-12-08T20:28:16.642 INFO:tasks.workunit.client.0.smithi043.stdout:0/216: creat d2/d3/d18/f43 x:0 0 0 2023-12-08T20:28:16.642 INFO:tasks.workunit.client.0.smithi043.stdout:0/217: readlink d2/d3/d15/l19 0 2023-12-08T20:28:16.642 INFO:tasks.workunit.client.0.smithi043.stdout:0/218: chown d2/d3/d15/d3f 441 1 2023-12-08T20:28:16.649 INFO:tasks.workunit.client.0.smithi043.stdout:5/257: creat d3/d7/d21/f4d x:0 0 0 2023-12-08T20:28:16.651 INFO:tasks.workunit.client.0.smithi043.stdout:0/219: creat d2/d3/d6/f44 x:0 0 0 2023-12-08T20:28:16.652 INFO:tasks.workunit.client.0.smithi043.stdout:8/264: getdents d2/de 0 2023-12-08T20:28:16.652 INFO:tasks.workunit.client.0.smithi043.stdout:8/265: write d2/de/f46 [963504,102191] 0 2023-12-08T20:28:16.653 INFO:tasks.workunit.client.0.smithi043.stdout:5/258: rename d3/d7/de/f2a to d3/d7/de/d17/f4e 0 2023-12-08T20:28:16.653 INFO:tasks.workunit.client.0.smithi043.stdout:5/259: write d3/d7/de/f1e [4422170,21903] 0 2023-12-08T20:28:16.656 INFO:tasks.workunit.client.0.smithi043.stdout:8/266: link d2/d27/d2d/d31/c42 d2/d20/c4e 0 2023-12-08T20:28:16.656 INFO:tasks.workunit.client.0.smithi043.stdout:0/220: dread d2/d3/d15/f20 [0,4194304] 0 2023-12-08T20:28:16.658 INFO:tasks.workunit.client.0.smithi043.stdout:8/267: write d2/de/f46 [483949,112277] 0 2023-12-08T20:28:16.667 INFO:tasks.workunit.client.0.smithi043.stdout:5/260: dwrite d3/d7/f13 [0,4194304] 0 2023-12-08T20:28:16.670 INFO:tasks.workunit.client.0.smithi043.stdout:5/261: truncate d3/fc 7394871 0 2023-12-08T20:28:16.671 INFO:tasks.workunit.client.0.smithi043.stdout:5/262: symlink d3/d7/d21/l4f 0 2023-12-08T20:28:16.675 INFO:tasks.workunit.client.0.smithi043.stdout:7/124: sync 2023-12-08T20:28:16.676 INFO:tasks.workunit.client.0.smithi043.stdout:4/231: sync 2023-12-08T20:28:16.676 INFO:tasks.workunit.client.0.smithi043.stdout:7/125: fsync d0/fb 0 2023-12-08T20:28:16.676 INFO:tasks.workunit.client.0.smithi043.stdout:4/232: chown d1/d14/d25/d39/f51 38109 1 2023-12-08T20:28:16.676 INFO:tasks.workunit.client.0.smithi043.stdout:7/126: creat d0/d2/f27 x:0 0 0 2023-12-08T20:28:16.677 INFO:tasks.workunit.client.0.smithi043.stdout:4/233: write d1/d14/f45 [2513546,118322] 0 2023-12-08T20:28:16.677 INFO:tasks.workunit.client.0.smithi043.stdout:7/127: mknod d0/d6/c28 0 2023-12-08T20:28:16.678 INFO:tasks.workunit.client.0.smithi043.stdout:7/128: truncate d0/f1b 1202299 0 2023-12-08T20:28:16.679 INFO:tasks.workunit.client.0.smithi043.stdout:7/129: creat d0/d6/f29 x:0 0 0 2023-12-08T20:28:16.680 INFO:tasks.workunit.client.0.smithi043.stdout:4/234: dread d1/d14/d25/d28/f2b [0,4194304] 0 2023-12-08T20:28:16.680 INFO:tasks.workunit.client.0.smithi043.stdout:4/235: truncate d1/f11 1626199 0 2023-12-08T20:28:16.680 INFO:tasks.workunit.client.0.smithi043.stdout:7/130: truncate d0/d6/d8/f1e 3133769 0 2023-12-08T20:28:16.680 INFO:tasks.workunit.client.0.smithi043.stdout:7/131: readlink d0/d6/d8/le 0 2023-12-08T20:28:16.680 INFO:tasks.workunit.client.0.smithi043.stdout:7/132: rename d0/d6/d17 to d0/d6/d17/d2a 22 2023-12-08T20:28:16.681 INFO:tasks.workunit.client.0.smithi043.stdout:4/236: creat d1/d14/d25/d39/d3d/d40/f54 x:0 0 0 2023-12-08T20:28:16.681 INFO:tasks.workunit.client.0.smithi043.stdout:4/237: chown d1/d14/d25/f2f 2006190 1 2023-12-08T20:28:16.681 INFO:tasks.workunit.client.0.smithi043.stdout:4/238: dread - d1/d14/d25/d28/f4f zero size 2023-12-08T20:28:16.682 INFO:tasks.workunit.client.0.smithi043.stdout:7/133: creat d0/d2/d12/d19/f2b x:0 0 0 2023-12-08T20:28:16.682 INFO:tasks.workunit.client.0.smithi043.stdout:7/134: truncate d0/d6/f24 47584 0 2023-12-08T20:28:16.684 INFO:tasks.workunit.client.0.smithi043.stdout:4/239: rename d1/d14/d25/d28/l33 to d1/d14/d25/d39/d3d/d40/l55 0 2023-12-08T20:28:16.684 INFO:tasks.workunit.client.0.smithi043.stdout:4/240: dread - d1/d14/d25/d39/d3d/d40/f54 zero size 2023-12-08T20:28:16.685 INFO:tasks.workunit.client.0.smithi043.stdout:4/241: rename d1/d14/d25/d28/l2d to d1/l56 0 2023-12-08T20:28:16.685 INFO:tasks.workunit.client.0.smithi043.stdout:4/242: write d1/d14/d50/f53 [873867,48988] 0 2023-12-08T20:28:16.687 INFO:tasks.workunit.client.0.smithi043.stdout:8/268: dwrite d2/de/f2a [0,4194304] 0 2023-12-08T20:28:16.689 INFO:tasks.workunit.client.0.smithi043.stdout:8/269: mkdir d2/d27/d2d/d31/d4f 0 2023-12-08T20:28:16.692 INFO:tasks.workunit.client.0.smithi043.stdout:8/270: symlink d2/de/d29/l50 0 2023-12-08T20:28:16.693 INFO:tasks.workunit.client.0.smithi043.stdout:0/221: dwrite d2/d4/fc [0,4194304] 0 2023-12-08T20:28:16.693 INFO:tasks.workunit.client.0.smithi043.stdout:0/222: chown d2/d3/d18 1307 1 2023-12-08T20:28:16.694 INFO:tasks.workunit.client.0.smithi043.stdout:0/223: mknod d2/d3/d15/c45 0 2023-12-08T20:28:16.697 INFO:tasks.workunit.client.0.smithi043.stdout:0/224: link d2/d3/d18/l31 d2/d4/l46 0 2023-12-08T20:28:16.698 INFO:tasks.workunit.client.0.smithi043.stdout:0/225: rename d2/d3/d18/l2d to d2/l47 0 2023-12-08T20:28:16.699 INFO:tasks.workunit.client.0.smithi043.stdout:5/263: dwrite d3/d7/d21/f4d [0,4194304] 0 2023-12-08T20:28:16.700 INFO:tasks.workunit.client.0.smithi043.stdout:5/264: read - d3/d7/d19/f30 zero size 2023-12-08T20:28:16.704 INFO:tasks.workunit.client.0.smithi043.stdout:0/226: dread d2/d3/d18/f22 [0,4194304] 0 2023-12-08T20:28:16.705 INFO:tasks.workunit.client.0.smithi043.stdout:5/265: write d3/d7/de/f24 [3243593,20625] 0 2023-12-08T20:28:16.705 INFO:tasks.workunit.client.0.smithi043.stdout:5/266: read - d3/d7/d21/f2d zero size 2023-12-08T20:28:16.706 INFO:tasks.workunit.client.0.smithi043.stdout:0/227: link d2/d3/d18/c40 d2/c48 0 2023-12-08T20:28:16.707 INFO:tasks.workunit.client.0.smithi043.stdout:7/135: dwrite d0/d6/f1a [0,4194304] 0 2023-12-08T20:28:16.707 INFO:tasks.workunit.client.0.smithi043.stdout:7/136: fsync d0/d6/f18 0 2023-12-08T20:28:16.708 INFO:tasks.workunit.client.0.smithi043.stdout:8/271: dwrite d2/de/f26 [0,4194304] 0 2023-12-08T20:28:16.708 INFO:tasks.workunit.client.0.smithi043.stdout:8/272: dread - d2/de/d29/d30/f49 zero size 2023-12-08T20:28:16.708 INFO:tasks.workunit.client.0.smithi043.stdout:8/273: chown d2/de/f4d 637400 1 2023-12-08T20:28:16.708 INFO:tasks.workunit.client.0.smithi043.stdout:5/267: rmdir d3 39 2023-12-08T20:28:16.708 INFO:tasks.workunit.client.0.smithi043.stdout:8/274: read d2/f21 [746988,16309] 0 2023-12-08T20:28:16.709 INFO:tasks.workunit.client.0.smithi043.stdout:8/275: chown d2/de/d29/d30 357186 1 2023-12-08T20:28:16.713 INFO:tasks.workunit.client.0.smithi043.stdout:5/268: creat d3/d7/d21/f50 x:0 0 0 2023-12-08T20:28:16.716 INFO:tasks.workunit.client.0.smithi043.stdout:8/276: write d2/d27/f35 [299424,6355] 0 2023-12-08T20:28:16.716 INFO:tasks.workunit.client.0.smithi043.stdout:4/243: dwrite d1/d14/f18 [0,4194304] 0 2023-12-08T20:28:16.718 INFO:tasks.workunit.client.0.smithi043.stdout:8/277: symlink d2/de/d3a/l51 0 2023-12-08T20:28:16.718 INFO:tasks.workunit.client.0.smithi043.stdout:7/137: write d0/d6/d8/f15 [2099243,87018] 0 2023-12-08T20:28:16.718 INFO:tasks.workunit.client.0.smithi043.stdout:5/269: dread d3/d7/de/f1d [0,4194304] 0 2023-12-08T20:28:16.721 INFO:tasks.workunit.client.0.smithi043.stdout:8/278: mknod d2/d27/d2d/c52 0 2023-12-08T20:28:16.721 INFO:tasks.workunit.client.0.smithi043.stdout:8/279: write d2/de/f4d [791531,104861] 0 2023-12-08T20:28:16.722 INFO:tasks.workunit.client.0.smithi043.stdout:5/270: mkdir d3/d7/d21/d51 0 2023-12-08T20:28:16.724 INFO:tasks.workunit.client.0.smithi043.stdout:5/271: mkdir d3/d7/d19/d3f/d52 0 2023-12-08T20:28:16.726 INFO:tasks.workunit.client.0.smithi043.stdout:5/272: getdents d3/d7/de 0 2023-12-08T20:28:16.726 INFO:tasks.workunit.client.0.smithi043.stdout:5/273: fdatasync d3/d7/de/d17/f27 0 2023-12-08T20:28:16.726 INFO:tasks.workunit.client.0.smithi043.stdout:5/274: chown d3/d7/d19/d3f/f4c 3562512 1 2023-12-08T20:28:16.726 INFO:tasks.workunit.client.0.smithi043.stdout:0/228: dwrite d2/d3/d18/d1e/f25 [4194304,4194304] 0 2023-12-08T20:28:16.726 INFO:tasks.workunit.client.0.smithi043.stdout:0/229: chown d2/d3/d6/l11 24 1 2023-12-08T20:28:16.726 INFO:tasks.workunit.client.0.smithi043.stdout:0/230: fsync d2/d3/d18/f2a 0 2023-12-08T20:28:16.726 INFO:tasks.workunit.client.0.smithi043.stdout:0/231: fdatasync d2/f7 0 2023-12-08T20:28:16.727 INFO:tasks.workunit.client.0.smithi043.stdout:5/275: mknod d3/d7/de/c53 0 2023-12-08T20:28:16.731 INFO:tasks.workunit.client.0.smithi043.stdout:0/232: unlink d2/d3/d15/f20 0 2023-12-08T20:28:16.734 INFO:tasks.workunit.client.0.smithi043.stdout:0/233: creat d2/d3/d15/f49 x:0 0 0 2023-12-08T20:28:16.734 INFO:tasks.workunit.client.0.smithi043.stdout:0/234: readlink d2/d3/d18/l31 0 2023-12-08T20:28:16.734 INFO:tasks.workunit.client.0.smithi043.stdout:0/235: write d2/f24 [1459595,42051] 0 2023-12-08T20:28:16.737 INFO:tasks.workunit.client.0.smithi043.stdout:0/236: link d2/d3/d6/c29 d2/c4a 0 2023-12-08T20:28:16.738 INFO:tasks.workunit.client.0.smithi043.stdout:0/237: creat d2/d4/f4b x:0 0 0 2023-12-08T20:28:16.739 INFO:tasks.workunit.client.0.smithi043.stdout:0/238: mknod d2/d3/c4c 0 2023-12-08T20:28:16.764 INFO:tasks.workunit.client.0.smithi043.stdout:8/280: dwrite d2/de/d37/f1f [4194304,4194304] 0 2023-12-08T20:28:16.764 INFO:tasks.workunit.client.0.smithi043.stdout:7/138: dwrite d0/d6/f29 [0,4194304] 0 2023-12-08T20:28:16.764 INFO:tasks.workunit.client.0.smithi043.stdout:8/281: chown d2/d27/d2d/d31/d4f 33 1 2023-12-08T20:28:16.764 INFO:tasks.workunit.client.0.smithi043.stdout:8/282: fsync d2/d27/d2d/d31/f36 0 2023-12-08T20:28:16.765 INFO:tasks.workunit.client.0.smithi043.stdout:7/139: write d0/f1b [1466334,52098] 0 2023-12-08T20:28:16.765 INFO:tasks.workunit.client.0.smithi043.stdout:7/140: chown d0/d2/c22 32 1 2023-12-08T20:28:16.765 INFO:tasks.workunit.client.0.smithi043.stdout:7/141: fsync d0/d2/f11 0 2023-12-08T20:28:16.765 INFO:tasks.workunit.client.0.smithi043.stdout:7/142: write d0/f1b [1473129,28787] 0 2023-12-08T20:28:16.766 INFO:tasks.workunit.client.0.smithi043.stdout:5/276: dwrite d3/f3d [0,4194304] 0 2023-12-08T20:28:16.769 INFO:tasks.workunit.client.0.smithi043.stdout:8/283: mkdir d2/d27/d2d/d31/d4f/d53 0 2023-12-08T20:28:16.769 INFO:tasks.workunit.client.0.smithi043.stdout:8/284: fdatasync d2/de/d29/d30/f41 0 2023-12-08T20:28:16.769 INFO:tasks.workunit.client.0.smithi043.stdout:8/285: chown d2/de/d29/l50 3715823 1 2023-12-08T20:28:16.769 INFO:tasks.workunit.client.0.smithi043.stdout:8/286: fdatasync d2/d27/d2d/f3c 0 2023-12-08T20:28:16.770 INFO:tasks.workunit.client.0.smithi043.stdout:5/277: write d3/d7/d21/f4d [3056602,54033] 0 2023-12-08T20:28:16.770 INFO:tasks.workunit.client.0.smithi043.stdout:7/143: truncate d0/fb 314070 0 2023-12-08T20:28:16.770 INFO:tasks.workunit.client.0.smithi043.stdout:7/144: write d0/d2/f11 [1131394,51442] 0 2023-12-08T20:28:16.775 INFO:tasks.workunit.client.0.smithi043.stdout:0/239: getdents d2/d3/d15 0 2023-12-08T20:28:16.781 INFO:tasks.workunit.client.0.smithi043.stdout:5/278: dread f2 [0,4194304] 0 2023-12-08T20:28:16.782 INFO:tasks.workunit.client.0.smithi043.stdout:8/287: rmdir d2/d27/d2d/d31/d4f/d53 0 2023-12-08T20:28:16.784 INFO:tasks.workunit.client.0.smithi043.stdout:7/145: creat d0/d2/d12/f2c x:0 0 0 2023-12-08T20:28:16.788 INFO:tasks.workunit.client.0.smithi043.stdout:5/279: creat d3/d7/d21/d51/f54 x:0 0 0 2023-12-08T20:28:16.789 INFO:tasks.workunit.client.0.smithi043.stdout:8/288: symlink d2/de/d29/d30/l54 0 2023-12-08T20:28:16.789 INFO:tasks.workunit.client.0.smithi043.stdout:8/289: fsync d2/d27/f35 0 2023-12-08T20:28:16.791 INFO:tasks.workunit.client.0.smithi043.stdout:7/146: rmdir d0/d6/d8 39 2023-12-08T20:28:16.794 INFO:tasks.workunit.client.0.smithi043.stdout:5/280: creat d3/d7/de/f55 x:0 0 0 2023-12-08T20:28:16.794 INFO:tasks.workunit.client.0.smithi043.stdout:8/290: creat d2/d27/d2d/f55 x:0 0 0 2023-12-08T20:28:16.794 INFO:tasks.workunit.client.0.smithi043.stdout:8/291: fsync d2/de/f14 0 2023-12-08T20:28:16.795 INFO:tasks.workunit.client.0.smithi043.stdout:8/292: write d2/d27/d2d/f3c [346347,115666] 0 2023-12-08T20:28:16.795 INFO:tasks.workunit.client.0.smithi043.stdout:0/240: dwrite d2/d3/d18/d2b/f36 [0,4194304] 0 2023-12-08T20:28:16.795 INFO:tasks.workunit.client.0.smithi043.stdout:0/241: dread - d2/d3/d18/f43 zero size 2023-12-08T20:28:16.795 INFO:tasks.workunit.client.0.smithi043.stdout:5/281: write f2 [2739752,30471] 0 2023-12-08T20:28:16.796 INFO:tasks.workunit.client.0.smithi043.stdout:0/242: write d2/d4/f4b [665565,28970] 0 2023-12-08T20:28:16.796 INFO:tasks.workunit.client.0.smithi043.stdout:0/243: write d2/d4/f4b [1238932,10743] 0 2023-12-08T20:28:16.796 INFO:tasks.workunit.client.0.smithi043.stdout:0/244: truncate d2/d3/d18/d2b/f37 491052 0 2023-12-08T20:28:16.796 INFO:tasks.workunit.client.0.smithi043.stdout:0/245: mknod d2/d3/d18/d1e/c4d 0 2023-12-08T20:28:16.796 INFO:tasks.workunit.client.0.smithi043.stdout:0/246: chown d2/d3/d15/d3f 74020767 1 2023-12-08T20:28:16.798 INFO:tasks.workunit.client.0.smithi043.stdout:0/247: creat d2/d3/f4e x:0 0 0 2023-12-08T20:28:16.798 INFO:tasks.workunit.client.0.smithi043.stdout:0/248: read - d2/d3/d18/f43 zero size 2023-12-08T20:28:16.799 INFO:tasks.workunit.client.0.smithi043.stdout:8/293: read d2/de/d3a/f39 [2814685,107355] 0 2023-12-08T20:28:16.799 INFO:tasks.workunit.client.0.smithi043.stdout:8/294: chown d2/d20/l44 1431567 1 2023-12-08T20:28:16.799 INFO:tasks.workunit.client.0.smithi043.stdout:0/249: stat d2/d3/d18/d1e/l27 0 2023-12-08T20:28:16.800 INFO:tasks.workunit.client.0.smithi043.stdout:8/295: rename d2/d27/c38 to d2/de/d3a/c56 0 2023-12-08T20:28:16.802 INFO:tasks.workunit.client.0.smithi043.stdout:0/250: rename d2/d3/d15 to d2/d3/d18/d2b/d4f 0 2023-12-08T20:28:16.802 INFO:tasks.workunit.client.0.smithi043.stdout:0/251: truncate d2/d3/d18/f22 1787633 0 2023-12-08T20:28:16.803 INFO:tasks.workunit.client.0.smithi043.stdout:0/252: fdatasync d2/d3/d18/f2a 0 2023-12-08T20:28:16.804 INFO:tasks.workunit.client.0.smithi043.stdout:7/147: dread d0/d6/f1a [0,4194304] 0 2023-12-08T20:28:16.804 INFO:tasks.workunit.client.0.smithi043.stdout:7/148: chown d0/d2/f21 2312 1 2023-12-08T20:28:16.805 INFO:tasks.workunit.client.0.smithi043.stdout:8/296: mknod d2/d27/d2d/d31/c57 0 2023-12-08T20:28:16.807 INFO:tasks.workunit.client.0.smithi043.stdout:8/297: write d2/f21 [1426159,72179] 0 2023-12-08T20:28:16.808 INFO:tasks.workunit.client.0.smithi043.stdout:8/298: write d2/de/f46 [1427625,111546] 0 2023-12-08T20:28:16.808 INFO:tasks.workunit.client.0.smithi043.stdout:8/299: fdatasync d2/de/ff 0 2023-12-08T20:28:16.812 INFO:tasks.workunit.client.0.smithi043.stdout:7/149: symlink d0/d6/l2d 0 2023-12-08T20:28:16.812 INFO:tasks.workunit.client.0.smithi043.stdout:0/253: rename d2/d4/l1f to d2/d3/d18/d2b/l50 0 2023-12-08T20:28:16.812 INFO:tasks.workunit.client.0.smithi043.stdout:7/150: chown d0/d2/c26 394 1 2023-12-08T20:28:16.812 INFO:tasks.workunit.client.0.smithi043.stdout:8/300: creat d2/d27/d2d/d31/f58 x:0 0 0 2023-12-08T20:28:16.815 INFO:tasks.workunit.client.0.smithi043.stdout:7/151: getdents d0/d2/d12/d19 0 2023-12-08T20:28:16.816 INFO:tasks.workunit.client.0.smithi043.stdout:8/301: write d2/d27/f35 [3473078,111070] 0 2023-12-08T20:28:16.816 INFO:tasks.workunit.client.0.smithi043.stdout:5/282: dwrite d3/d32/f47 [0,4194304] 0 2023-12-08T20:28:16.816 INFO:tasks.workunit.client.0.smithi043.stdout:0/254: mknod d2/c51 0 2023-12-08T20:28:16.816 INFO:tasks.workunit.client.0.smithi043.stdout:0/255: chown d2/l13 57132 1 2023-12-08T20:28:16.817 INFO:tasks.workunit.client.0.smithi043.stdout:7/152: dread d0/d6/f18 [0,4194304] 0 2023-12-08T20:28:16.817 INFO:tasks.workunit.client.0.smithi043.stdout:7/153: truncate d0/d6/d8/f1e 1124948 0 2023-12-08T20:28:16.817 INFO:tasks.workunit.client.0.smithi043.stdout:8/302: truncate d2/de/f2a 1559215 0 2023-12-08T20:28:16.817 INFO:tasks.workunit.client.0.smithi043.stdout:8/303: readlink d2/d27/d2d/l40 0 2023-12-08T20:28:16.819 INFO:tasks.workunit.client.0.smithi043.stdout:7/154: rmdir d0/d6/d17 39 2023-12-08T20:28:16.819 INFO:tasks.workunit.client.0.smithi043.stdout:8/304: mkdir d2/de/d29/d59 0 2023-12-08T20:28:16.820 INFO:tasks.workunit.client.0.smithi043.stdout:7/155: dread d0/d6/f18 [0,4194304] 0 2023-12-08T20:28:16.820 INFO:tasks.workunit.client.0.smithi043.stdout:8/305: mkdir d2/de/d37/d5a 0 2023-12-08T20:28:16.822 INFO:tasks.workunit.client.0.smithi043.stdout:8/306: mknod d2/de/d29/c5b 0 2023-12-08T20:28:16.826 INFO:tasks.workunit.client.0.smithi043.stdout:7/156: dread d0/d6/f18 [0,4194304] 0 2023-12-08T20:28:16.826 INFO:tasks.workunit.client.0.smithi043.stdout:7/157: readlink d0/d2/ld 0 2023-12-08T20:28:16.834 INFO:tasks.workunit.client.0.smithi043.stdout:5/283: write d3/d32/f47 [5087612,15866] 0 2023-12-08T20:28:16.836 INFO:tasks.workunit.client.0.smithi043.stdout:0/256: dwrite d2/d3/f1a [0,4194304] 0 2023-12-08T20:28:16.837 INFO:tasks.workunit.client.0.smithi043.stdout:0/257: rmdir d2/d4 39 2023-12-08T20:28:16.838 INFO:tasks.workunit.client.0.smithi043.stdout:8/307: dwrite d2/de/f4d [0,4194304] 0 2023-12-08T20:28:16.853 INFO:tasks.workunit.client.0.smithi043.stdout:5/284: dwrite d3/d32/f47 [4194304,4194304] 0 2023-12-08T20:28:16.856 INFO:tasks.workunit.client.0.smithi043.stdout:5/285: link d3/d7/de/d17/c26 d3/d7/c56 0 2023-12-08T20:28:16.856 INFO:tasks.workunit.client.0.smithi043.stdout:5/286: rmdir d3/d32 39 2023-12-08T20:28:16.858 INFO:tasks.workunit.client.0.smithi043.stdout:5/287: truncate d3/d7/de/d43/f4a 4259543 0 2023-12-08T20:28:16.859 INFO:tasks.workunit.client.0.smithi043.stdout:1/228: sync 2023-12-08T20:28:16.859 INFO:tasks.workunit.client.0.smithi043.stdout:6/207: sync 2023-12-08T20:28:16.860 INFO:tasks.workunit.client.0.smithi043.stdout:3/209: sync 2023-12-08T20:28:16.860 INFO:tasks.workunit.client.0.smithi043.stdout:6/208: write d0/d2/f3e [478810,66496] 0 2023-12-08T20:28:16.860 INFO:tasks.workunit.client.0.smithi043.stdout:6/209: write d0/f48 [421034,76227] 0 2023-12-08T20:28:16.860 INFO:tasks.workunit.client.0.smithi043.stdout:6/210: fsync d0/d2/d14/d8/f4e 0 2023-12-08T20:28:16.860 INFO:tasks.workunit.client.0.smithi043.stdout:6/211: fdatasync d0/d2/d14/d20/ff 0 2023-12-08T20:28:16.860 INFO:tasks.workunit.client.0.smithi043.stdout:6/212: truncate d0/d2/d14/d8/f1e 1394892 0 2023-12-08T20:28:16.861 INFO:tasks.workunit.client.0.smithi043.stdout:3/210: read d1/f18 [1179135,59460] 0 2023-12-08T20:28:16.861 INFO:tasks.workunit.client.0.smithi043.stdout:3/211: truncate d1/d1c/d2c/f3e 506935 0 2023-12-08T20:28:16.861 INFO:tasks.workunit.client.0.smithi043.stdout:1/229: mknod d1/d16/d1c/c4c 0 2023-12-08T20:28:16.861 INFO:tasks.workunit.client.0.smithi043.stdout:1/230: fdatasync d1/d16/f28 0 2023-12-08T20:28:16.861 INFO:tasks.workunit.client.0.smithi043.stdout:6/213: write d0/d2/d14/d2c/f3b [3217601,12420] 0 2023-12-08T20:28:16.861 INFO:tasks.workunit.client.0.smithi043.stdout:3/212: creat d1/d9/d2d/f3f x:0 0 0 2023-12-08T20:28:16.862 INFO:tasks.workunit.client.0.smithi043.stdout:3/213: write d1/d9/df/d26/f2f [381524,111295] 0 2023-12-08T20:28:16.864 INFO:tasks.workunit.client.0.smithi043.stdout:1/231: unlink d1/d16/l19 0 2023-12-08T20:28:16.864 INFO:tasks.workunit.client.0.smithi043.stdout:6/214: getdents d0/d2/d29 0 2023-12-08T20:28:16.864 INFO:tasks.workunit.client.0.smithi043.stdout:6/215: fdatasync d0/d2/d14/d8/f1e 0 2023-12-08T20:28:16.865 INFO:tasks.workunit.client.0.smithi043.stdout:3/214: creat d1/d9/d38/d30/f40 x:0 0 0 2023-12-08T20:28:16.866 INFO:tasks.workunit.client.0.smithi043.stdout:1/232: rename d1/d16/f40 to d1/d16/f4d 0 2023-12-08T20:28:16.866 INFO:tasks.workunit.client.0.smithi043.stdout:1/233: fdatasync d1/d16/d1c/f44 0 2023-12-08T20:28:16.866 INFO:tasks.workunit.client.0.smithi043.stdout:1/234: read d1/f2 [441303,55022] 0 2023-12-08T20:28:16.867 INFO:tasks.workunit.client.0.smithi043.stdout:6/216: creat d0/d2/d14/d20/d49/f4f x:0 0 0 2023-12-08T20:28:16.868 INFO:tasks.workunit.client.0.smithi043.stdout:3/215: rename d1/d25/d2a/d2e to d1/d9/df/d41 0 2023-12-08T20:28:16.868 INFO:tasks.workunit.client.0.smithi043.stdout:3/216: chown d1/d9/fd 217822 1 2023-12-08T20:28:16.870 INFO:tasks.workunit.client.0.smithi043.stdout:1/235: mkdir d1/d16/d1c/d4e 0 2023-12-08T20:28:16.871 INFO:tasks.workunit.client.0.smithi043.stdout:5/288: dwrite d3/d7/de/d17/f27 [4194304,4194304] 0 2023-12-08T20:28:16.871 INFO:tasks.workunit.client.0.smithi043.stdout:5/289: read - d3/d7/d29/f3c zero size 2023-12-08T20:28:16.871 INFO:tasks.workunit.client.0.smithi043.stdout:6/217: mkdir d0/d2/d14/d20/d3c/d50 0 2023-12-08T20:28:16.872 INFO:tasks.workunit.client.0.smithi043.stdout:3/217: mkdir d1/d9/d2d/d42 0 2023-12-08T20:28:16.873 INFO:tasks.workunit.client.0.smithi043.stdout:1/236: truncate d1/d16/f18 92867 0 2023-12-08T20:28:16.875 INFO:tasks.workunit.client.0.smithi043.stdout:5/290: rmdir d3/d7 39 2023-12-08T20:28:16.877 INFO:tasks.workunit.client.0.smithi043.stdout:6/218: unlink d0/d2/d29/c39 0 2023-12-08T20:28:16.877 INFO:tasks.workunit.client.0.smithi043.stdout:1/237: mkdir d1/d16/d30/d4f 0 2023-12-08T20:28:16.879 INFO:tasks.workunit.client.0.smithi043.stdout:5/291: mkdir d3/d7/d21/d57 0 2023-12-08T20:28:16.879 INFO:tasks.workunit.client.0.smithi043.stdout:1/238: creat d1/d16/d1c/f50 x:0 0 0 2023-12-08T20:28:16.879 INFO:tasks.workunit.client.0.smithi043.stdout:1/239: dread - d1/d16/d1c/f44 zero size 2023-12-08T20:28:16.881 INFO:tasks.workunit.client.0.smithi043.stdout:1/240: rename d1/d16/f39 to d1/d16/d21/f51 0 2023-12-08T20:28:16.881 INFO:tasks.workunit.client.0.smithi043.stdout:1/241: write d1/d16/f46 [755935,120236] 0 2023-12-08T20:28:16.881 INFO:tasks.workunit.client.0.smithi043.stdout:3/218: dread d1/d9/fd [0,4194304] 0 2023-12-08T20:28:16.883 INFO:tasks.workunit.client.0.smithi043.stdout:1/242: symlink d1/d16/d21/d25/d3e/l52 0 2023-12-08T20:28:16.888 INFO:tasks.workunit.client.0.smithi043.stdout:1/243: getdents d1 0 2023-12-08T20:28:16.892 INFO:tasks.workunit.client.0.smithi043.stdout:1/244: read d1/d16/d21/d25/d35/f43 [2233670,44967] 0 2023-12-08T20:28:16.892 INFO:tasks.workunit.client.0.smithi043.stdout:3/219: dread d1/d1c/f22 [0,4194304] 0 2023-12-08T20:28:16.892 INFO:tasks.workunit.client.0.smithi043.stdout:3/220: truncate d1/d9/df/f3a 964253 0 2023-12-08T20:28:16.892 INFO:tasks.workunit.client.0.smithi043.stdout:3/221: stat d1/d25/d2a/f39 0 2023-12-08T20:28:16.895 INFO:tasks.workunit.client.0.smithi043.stdout:3/222: mknod d1/d9/df/c43 0 2023-12-08T20:28:16.895 INFO:tasks.workunit.client.0.smithi043.stdout:6/219: dwrite d0/f48 [0,4194304] 0 2023-12-08T20:28:16.896 INFO:tasks.workunit.client.0.smithi043.stdout:6/220: creat d0/d2/d14/d2c/d22/d3f/d45/f51 x:0 0 0 2023-12-08T20:28:16.896 INFO:tasks.workunit.client.0.smithi043.stdout:6/221: readlink d0/l1 0 2023-12-08T20:28:16.897 INFO:tasks.workunit.client.0.smithi043.stdout:6/222: fsync d0/f34 0 2023-12-08T20:28:16.897 INFO:tasks.workunit.client.0.smithi043.stdout:6/223: chown d0/d2/d14/d2c/c46 392 1 2023-12-08T20:28:16.898 INFO:tasks.workunit.client.0.smithi043.stdout:6/224: rename d0/d2/d14/d2c/d22/f32 to d0/d2/d29/f52 0 2023-12-08T20:28:16.898 INFO:tasks.workunit.client.0.smithi043.stdout:6/225: chown d0/d2/d14/d20/d3c 229 1 2023-12-08T20:28:16.905 INFO:tasks.workunit.client.0.smithi043.stdout:3/223: dread d1/d9/fd [0,4194304] 0 2023-12-08T20:28:16.908 INFO:tasks.workunit.client.0.smithi043.stdout:3/224: write d1/d9/f1f [1993228,108580] 0 2023-12-08T20:28:16.908 INFO:tasks.workunit.client.0.smithi043.stdout:1/245: dwrite d1/f2a [0,4194304] 0 2023-12-08T20:28:16.908 INFO:tasks.workunit.client.0.smithi043.stdout:3/225: dread d1/d1c/d2c/f3e [0,4194304] 0 2023-12-08T20:28:16.909 INFO:tasks.workunit.client.0.smithi043.stdout:3/226: chown d1/f18 22 1 2023-12-08T20:28:16.909 INFO:tasks.workunit.client.0.smithi043.stdout:3/227: write d1/d9/d38/d30/f40 [190507,14996] 0 2023-12-08T20:28:16.910 INFO:tasks.workunit.client.0.smithi043.stdout:3/228: symlink d1/d1c/l44 0 2023-12-08T20:28:16.911 INFO:tasks.workunit.client.0.smithi043.stdout:3/229: mkdir d1/d25/d2a/d45 0 2023-12-08T20:28:16.911 INFO:tasks.workunit.client.0.smithi043.stdout:1/246: write d1/d16/f47 [293927,93179] 0 2023-12-08T20:28:16.911 INFO:tasks.workunit.client.0.smithi043.stdout:1/247: chown d1/d16/f28 591322 1 2023-12-08T20:28:16.911 INFO:tasks.workunit.client.0.smithi043.stdout:3/230: symlink d1/d25/d2a/d45/l46 0 2023-12-08T20:28:16.912 INFO:tasks.workunit.client.0.smithi043.stdout:3/231: dread d1/d1c/d2c/f3e [0,4194304] 0 2023-12-08T20:28:16.915 INFO:tasks.workunit.client.0.smithi043.stdout:3/232: rename d1/d9/d2d/f3f to d1/d9/df/f47 0 2023-12-08T20:28:16.916 INFO:tasks.workunit.client.0.smithi043.stdout:3/233: creat d1/d9/f48 x:0 0 0 2023-12-08T20:28:16.923 INFO:tasks.workunit.client.0.smithi043.stdout:1/248: dwrite d1/d6/fa [0,4194304] 0 2023-12-08T20:28:16.923 INFO:tasks.workunit.client.0.smithi043.stdout:6/226: dwrite d0/d2/f28 [0,4194304] 0 2023-12-08T20:28:16.923 INFO:tasks.workunit.client.0.smithi043.stdout:3/234: dread d1/f18 [0,4194304] 0 2023-12-08T20:28:16.923 INFO:tasks.workunit.client.0.smithi043.stdout:3/235: dread - d1/d25/d2a/f39 zero size 2023-12-08T20:28:16.923 INFO:tasks.workunit.client.0.smithi043.stdout:3/236: dread - d1/d25/d2a/f39 zero size 2023-12-08T20:28:16.927 INFO:tasks.workunit.client.0.smithi043.stdout:6/227: rmdir d0/d2/d14/d2c/d22/d2a 39 2023-12-08T20:28:16.927 INFO:tasks.workunit.client.0.smithi043.stdout:3/237: rename d1/d1c/l2b to d1/d25/l49 0 2023-12-08T20:28:16.927 INFO:tasks.workunit.client.0.smithi043.stdout:3/238: write d1/d9/f48 [884660,29976] 0 2023-12-08T20:28:16.928 INFO:tasks.workunit.client.0.smithi043.stdout:3/239: fdatasync d1/d1c/d2c/f3e 0 2023-12-08T20:28:16.939 INFO:tasks.workunit.client.0.smithi043.stdout:1/249: dwrite d1/d16/f4d [0,4194304] 0 2023-12-08T20:28:16.940 INFO:tasks.workunit.client.0.smithi043.stdout:3/240: rmdir d1/d9/df 39 2023-12-08T20:28:16.940 INFO:tasks.workunit.client.0.smithi043.stdout:3/241: write d1/d25/d2a/f39 [451167,98422] 0 2023-12-08T20:28:16.941 INFO:tasks.workunit.client.0.smithi043.stdout:6/228: dwrite d0/d2/f3e [0,4194304] 0 2023-12-08T20:28:16.943 INFO:tasks.workunit.client.0.smithi043.stdout:3/242: dread d1/d9/f32 [0,4194304] 0 2023-12-08T20:28:16.945 INFO:tasks.workunit.client.0.smithi043.stdout:1/250: creat d1/d16/d48/f53 x:0 0 0 2023-12-08T20:28:16.945 INFO:tasks.workunit.client.0.smithi043.stdout:1/251: fdatasync d1/f2 0 2023-12-08T20:28:16.946 INFO:tasks.workunit.client.0.smithi043.stdout:1/252: write d1/d16/f4d [2872494,84596] 0 2023-12-08T20:28:16.949 INFO:tasks.workunit.client.0.smithi043.stdout:3/243: mkdir d1/d9/d38/d4a 0 2023-12-08T20:28:16.949 INFO:tasks.workunit.client.0.smithi043.stdout:3/244: truncate d1/d25/f36 1334540 0 2023-12-08T20:28:16.950 INFO:tasks.workunit.client.0.smithi043.stdout:1/253: mkdir d1/d16/d30/d4f/d54 0 2023-12-08T20:28:16.953 INFO:tasks.workunit.client.0.smithi043.stdout:2/294: sync 2023-12-08T20:28:16.953 INFO:tasks.workunit.client.0.smithi043.stdout:9/240: sync 2023-12-08T20:28:16.957 INFO:tasks.workunit.client.0.smithi043.stdout:2/295: unlink d0/f5 0 2023-12-08T20:28:16.957 INFO:tasks.workunit.client.0.smithi043.stdout:3/245: dread d1/d9/f19 [0,4194304] 0 2023-12-08T20:28:16.957 INFO:tasks.workunit.client.0.smithi043.stdout:3/246: read d1/d9/f48 [775849,124253] 0 2023-12-08T20:28:16.959 INFO:tasks.workunit.client.0.smithi043.stdout:2/296: write d0/db/d18/f1d [624758,114596] 0 2023-12-08T20:28:16.959 INFO:tasks.workunit.client.0.smithi043.stdout:2/297: dread - d0/f55 zero size 2023-12-08T20:28:16.959 INFO:tasks.workunit.client.0.smithi043.stdout:2/298: chown d0/d26/d37/l5c 228164 1 2023-12-08T20:28:16.959 INFO:tasks.workunit.client.0.smithi043.stdout:6/229: dwrite d0/d2/d14/d2c/d22/d3f/d45/f51 [0,4194304] 0 2023-12-08T20:28:16.962 INFO:tasks.workunit.client.0.smithi043.stdout:1/254: dread d1/f2a [0,4194304] 0 2023-12-08T20:28:16.962 INFO:tasks.workunit.client.0.smithi043.stdout:2/299: read d0/f9 [997461,79495] 0 2023-12-08T20:28:16.962 INFO:tasks.workunit.client.0.smithi043.stdout:2/300: dread - d0/d26/d37/d38/f5d zero size 2023-12-08T20:28:16.965 INFO:tasks.workunit.client.0.smithi043.stdout:6/230: mkdir d0/d2/d14/d20/d53 0 2023-12-08T20:28:16.976 INFO:tasks.workunit.client.0.smithi043.stdout:2/301: rmdir d0 39 2023-12-08T20:28:16.976 INFO:tasks.workunit.client.0.smithi043.stdout:2/302: truncate d0/db/f54 428812 0 2023-12-08T20:28:16.978 INFO:tasks.workunit.client.0.smithi043.stdout:2/303: symlink d0/d26/l64 0 2023-12-08T20:28:16.980 INFO:tasks.workunit.client.0.smithi043.stdout:2/304: mknod d0/d20/d42/d49/c65 0 2023-12-08T20:28:16.983 INFO:tasks.workunit.client.0.smithi043.stdout:9/241: dwrite d0/d2e/f33 [0,4194304] 0 2023-12-08T20:28:16.984 INFO:tasks.workunit.client.0.smithi043.stdout:1/255: dwrite d1/d6/fa [0,4194304] 0 2023-12-08T20:28:16.984 INFO:tasks.workunit.client.0.smithi043.stdout:1/256: stat d1/f2 0 2023-12-08T20:28:16.985 INFO:tasks.workunit.client.0.smithi043.stdout:1/257: write d1/d6/fa [3206949,15240] 0 2023-12-08T20:28:16.986 INFO:tasks.workunit.client.0.smithi043.stdout:1/258: creat d1/d16/d1c/f55 x:0 0 0 2023-12-08T20:28:16.989 INFO:tasks.workunit.client.0.smithi043.stdout:6/231: dwrite d0/f48 [0,4194304] 0 2023-12-08T20:28:16.991 INFO:tasks.workunit.client.0.smithi043.stdout:6/232: write d0/d2/d14/f18 [1758586,28419] 0 2023-12-08T20:28:16.993 INFO:tasks.workunit.client.0.smithi043.stdout:9/242: dread d0/d21/f26 [0,4194304] 0 2023-12-08T20:28:16.993 INFO:tasks.workunit.client.0.smithi043.stdout:9/243: write d0/f1c [575396,46685] 0 2023-12-08T20:28:16.997 INFO:tasks.workunit.client.0.smithi043.stdout:6/233: link d0/d2/d14/d2c/f3b d0/f54 0 2023-12-08T20:28:16.997 INFO:tasks.workunit.client.0.smithi043.stdout:6/234: chown d0/d2/d14/d8/f43 12819669 1 2023-12-08T20:28:16.998 INFO:tasks.workunit.client.0.smithi043.stdout:6/235: creat d0/d2/d14/d20/d3c/f55 x:0 0 0 2023-12-08T20:28:16.999 INFO:tasks.workunit.client.0.smithi043.stdout:6/236: mkdir d0/d2/de/d4a/d56 0 2023-12-08T20:28:17.001 INFO:tasks.workunit.client.0.smithi043.stdout:1/259: dread d1/d16/d21/d25/d35/f43 [0,4194304] 0 2023-12-08T20:28:17.001 INFO:tasks.workunit.client.0.smithi043.stdout:1/260: chown d1/d16/d48/f53 151964985 1 2023-12-08T20:28:17.001 INFO:tasks.workunit.client.0.smithi043.stdout:1/261: chown d1/d16/d1c/f55 965 1 2023-12-08T20:28:17.001 INFO:tasks.workunit.client.0.smithi043.stdout:1/262: fsync d1/d16/d48/f53 0 2023-12-08T20:28:17.002 INFO:tasks.workunit.client.0.smithi043.stdout:1/263: rename d1/d16/d21/d25/d35/f43 to d1/d16/d48/f56 0 2023-12-08T20:28:17.023 INFO:tasks.workunit.client.0.smithi043.stdout:2/305: dwrite d0/db/d18/d3d/f40 [0,4194304] 0 2023-12-08T20:28:17.025 INFO:tasks.workunit.client.0.smithi043.stdout:2/306: mkdir d0/db/d18/d66 0 2023-12-08T20:28:17.028 INFO:tasks.workunit.client.0.smithi043.stdout:1/264: dwrite d1/d6/f3d [0,4194304] 0 2023-12-08T20:28:17.040 INFO:tasks.workunit.client.0.smithi043.stdout:4/244: sync 2023-12-08T20:28:17.041 INFO:tasks.workunit.client.0.smithi043.stdout:1/265: dread d1/d6/f3d [0,4194304] 0 2023-12-08T20:28:17.041 INFO:tasks.workunit.client.0.smithi043.stdout:4/245: write d1/d14/f24 [5227655,114246] 0 2023-12-08T20:28:17.041 INFO:tasks.workunit.client.0.smithi043.stdout:4/246: chown d1/d14/d25/d39/f51 23283 1 2023-12-08T20:28:17.043 INFO:tasks.workunit.client.0.smithi043.stdout:1/266: unlink d1/d16/d30/f37 0 2023-12-08T20:28:17.043 INFO:tasks.workunit.client.0.smithi043.stdout:1/267: write d1/d6/f29 [17448,63386] 0 2023-12-08T20:28:17.043 INFO:tasks.workunit.client.0.smithi043.stdout:1/268: write d1/f2c [523473,3444] 0 2023-12-08T20:28:17.043 INFO:tasks.workunit.client.0.smithi043.stdout:1/269: write d1/fb [919340,25499] 0 2023-12-08T20:28:17.043 INFO:tasks.workunit.client.0.smithi043.stdout:1/270: getdents d1 0 2023-12-08T20:28:17.044 INFO:tasks.workunit.client.0.smithi043.stdout:2/307: dwrite d0/d20/f2c [0,4194304] 0 2023-12-08T20:28:17.045 INFO:tasks.workunit.client.0.smithi043.stdout:4/247: write d1/d14/d1d/f1e [5147389,78220] 0 2023-12-08T20:28:17.045 INFO:tasks.workunit.client.0.smithi043.stdout:4/248: chown d1/d14/d25/d39/d3d/d40 571 1 2023-12-08T20:28:17.045 INFO:tasks.workunit.client.0.smithi043.stdout:1/271: mknod d1/d16/d30/c57 0 2023-12-08T20:28:17.046 INFO:tasks.workunit.client.0.smithi043.stdout:2/308: dread - d0/db/f31 zero size 2023-12-08T20:28:17.049 INFO:tasks.workunit.client.0.smithi043.stdout:1/272: mkdir d1/d16/d21/d42/d58 0 2023-12-08T20:28:17.049 INFO:tasks.workunit.client.0.smithi043.stdout:2/309: getdents d0/db/d18/d3d 0 2023-12-08T20:28:17.049 INFO:tasks.workunit.client.0.smithi043.stdout:2/310: write d0/f55 [112534,63004] 0 2023-12-08T20:28:17.051 INFO:tasks.workunit.client.0.smithi043.stdout:1/273: creat d1/d16/d1c/f59 x:0 0 0 2023-12-08T20:28:17.055 INFO:tasks.workunit.client.0.smithi043.stdout:1/274: creat d1/d16/d30/f5a x:0 0 0 2023-12-08T20:28:17.055 INFO:tasks.workunit.client.0.smithi043.stdout:1/275: write d1/fb [1509312,93167] 0 2023-12-08T20:28:17.057 INFO:tasks.workunit.client.0.smithi043.stdout:1/276: rmdir d1/d16/d21/d42/d58 0 2023-12-08T20:28:17.059 INFO:tasks.workunit.client.0.smithi043.stdout:2/311: dread d0/f28 [0,4194304] 0 2023-12-08T20:28:17.059 INFO:tasks.workunit.client.0.smithi043.stdout:2/312: write d0/d26/d37/d38/f5d [68812,107840] 0 2023-12-08T20:28:17.061 INFO:tasks.workunit.client.0.smithi043.stdout:2/313: creat d0/d26/d37/f67 x:0 0 0 2023-12-08T20:28:17.063 INFO:tasks.workunit.client.0.smithi043.stdout:1/277: write d1/f2c [376102,94173] 0 2023-12-08T20:28:17.063 INFO:tasks.workunit.client.0.smithi043.stdout:2/314: creat d0/d2b/f68 x:0 0 0 2023-12-08T20:28:17.065 INFO:tasks.workunit.client.0.smithi043.stdout:1/278: creat d1/d16/f5b x:0 0 0 2023-12-08T20:28:17.066 INFO:tasks.workunit.client.0.smithi043.stdout:2/315: link d0/db/f31 d0/d20/d42/d49/f69 0 2023-12-08T20:28:17.067 INFO:tasks.workunit.client.0.smithi043.stdout:2/316: truncate d0/d20/d42/d49/f69 966845 0 2023-12-08T20:28:17.069 INFO:tasks.workunit.client.0.smithi043.stdout:2/317: mkdir d0/d26/d53/d6a 0 2023-12-08T20:28:17.070 INFO:tasks.workunit.client.0.smithi043.stdout:1/279: creat d1/d16/d21/d42/f5c x:0 0 0 2023-12-08T20:28:17.072 INFO:tasks.workunit.client.0.smithi043.stdout:1/280: dread d1/d16/f18 [0,4194304] 0 2023-12-08T20:28:17.072 INFO:tasks.workunit.client.0.smithi043.stdout:2/318: link d0/c3f d0/d26/d53/c6b 0 2023-12-08T20:28:17.075 INFO:tasks.workunit.client.0.smithi043.stdout:2/319: creat d0/f6c x:0 0 0 2023-12-08T20:28:17.075 INFO:tasks.workunit.client.0.smithi043.stdout:2/320: write d0/d2b/f68 [758341,129180] 0 2023-12-08T20:28:17.078 INFO:tasks.workunit.client.0.smithi043.stdout:2/321: creat d0/d2b/d4e/f6d x:0 0 0 2023-12-08T20:28:17.097 INFO:tasks.workunit.client.0.smithi043.stdout:2/322: dwrite d0/d20/f4d [0,4194304] 0 2023-12-08T20:28:17.097 INFO:tasks.workunit.client.0.smithi043.stdout:1/281: dwrite d1/d16/d1c/f55 [0,4194304] 0 2023-12-08T20:28:17.102 INFO:tasks.workunit.client.0.smithi043.stdout:1/282: symlink d1/d16/d48/l5d 0 2023-12-08T20:28:17.104 INFO:tasks.workunit.client.0.smithi043.stdout:1/283: unlink d1/d16/l1f 0 2023-12-08T20:28:17.106 INFO:tasks.workunit.client.0.smithi043.stdout:1/284: rename d1/d16/d30/l38 to d1/d16/d48/l5e 0 2023-12-08T20:28:17.109 INFO:tasks.workunit.client.0.smithi043.stdout:2/323: dread d0/d20/f32 [0,4194304] 0 2023-12-08T20:28:17.109 INFO:tasks.workunit.client.0.smithi043.stdout:2/324: fsync d0/d26/d37/d38/f4f 0 2023-12-08T20:28:17.111 INFO:tasks.workunit.client.0.smithi043.stdout:1/285: rmdir d1 39 2023-12-08T20:28:17.114 INFO:tasks.workunit.client.0.smithi043.stdout:2/325: creat d0/d26/d37/d38/f6e x:0 0 0 2023-12-08T20:28:17.114 INFO:tasks.workunit.client.0.smithi043.stdout:1/286: creat d1/d16/d30/f5f x:0 0 0 2023-12-08T20:28:17.119 INFO:tasks.workunit.client.0.smithi043.stdout:1/287: unlink d1/d16/f5b 0 2023-12-08T20:28:17.122 INFO:tasks.workunit.client.0.smithi043.stdout:1/288: mkdir d1/d16/d21/d60 0 2023-12-08T20:28:17.124 INFO:tasks.workunit.client.0.smithi043.stdout:1/289: link d1/d16/d1c/l41 d1/d16/d21/d25/d3e/l61 0 2023-12-08T20:28:17.124 INFO:tasks.workunit.client.0.smithi043.stdout:1/290: dread - d1/d16/d30/f5a zero size 2023-12-08T20:28:17.126 INFO:tasks.workunit.client.0.smithi043.stdout:1/291: creat d1/d16/d21/d25/d35/f62 x:0 0 0 2023-12-08T20:28:17.129 INFO:tasks.workunit.client.0.smithi043.stdout:1/292: mkdir d1/d6/d63 0 2023-12-08T20:28:17.138 INFO:tasks.workunit.client.0.smithi043.stdout:2/326: dwrite d0/d2b/d4e/f5a [0,4194304] 0 2023-12-08T20:28:17.143 INFO:tasks.workunit.client.0.smithi043.stdout:2/327: rename d0/d26/d37/l5c to d0/d26/d37/d38/l6f 0 2023-12-08T20:28:17.145 INFO:tasks.workunit.client.0.smithi043.stdout:2/328: symlink d0/d26/d53/l70 0 2023-12-08T20:28:17.148 INFO:tasks.workunit.client.0.smithi043.stdout:1/293: getdents d1/d16 0 2023-12-08T20:28:17.195 INFO:tasks.workunit.client.0.smithi043.stdout:1/294: dread d1/d16/f4d [0,4194304] 0 2023-12-08T20:28:17.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:16 smithi111 ceph-mon[121341]: pgmap v29: 65 pgs: 65 active+clean; 1.9 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 45 MiB/s rd, 97 MiB/s wr, 237 op/s 2023-12-08T20:28:17.217 INFO:tasks.workunit.client.0.smithi043.stdout:1/295: dwrite d1/d16/f47 [0,4194304] 0 2023-12-08T20:28:17.222 INFO:tasks.workunit.client.0.smithi043.stdout:1/296: rename d1/d6/f3f to d1/d16/d21/d25/d35/f64 0 2023-12-08T20:28:17.222 INFO:tasks.workunit.client.0.smithi043.stdout:1/297: truncate d1/d16/d48/f4a 383261 0 2023-12-08T20:28:17.222 INFO:tasks.workunit.client.0.smithi043.stdout:1/298: chown d1/d16/d1c/l27 1255 1 2023-12-08T20:28:17.239 INFO:tasks.workunit.client.0.smithi043.stdout:1/299: dwrite d1/d16/f47 [0,4194304] 0 2023-12-08T20:28:17.240 INFO:tasks.workunit.client.0.smithi043.stdout:1/300: creat d1/d16/d48/f65 x:0 0 0 2023-12-08T20:28:17.240 INFO:tasks.workunit.client.0.smithi043.stdout:1/301: fsync d1/d16/d30/f5f 0 2023-12-08T20:28:17.241 INFO:tasks.workunit.client.0.smithi043.stdout:1/302: symlink d1/d16/d48/l66 0 2023-12-08T20:28:17.242 INFO:tasks.workunit.client.0.smithi043.stdout:1/303: rename d1/d16/d21/d25/l3b to d1/d16/d21/l67 0 2023-12-08T20:28:17.242 INFO:tasks.workunit.client.0.smithi043.stdout:1/304: chown d1/d16/d1c/l27 15808930 1 2023-12-08T20:28:17.243 INFO:tasks.workunit.client.0.smithi043.stdout:1/305: creat d1/d6/f68 x:0 0 0 2023-12-08T20:28:17.244 INFO:tasks.workunit.client.0.smithi043.stdout:1/306: link d1/d16/d1c/c4c d1/d6/d63/c69 0 2023-12-08T20:28:17.244 INFO:tasks.workunit.client.0.smithi043.stdout:1/307: symlink d1/l6a 0 2023-12-08T20:28:17.246 INFO:tasks.workunit.client.0.smithi043.stdout:1/308: symlink d1/d16/d21/d25/d35/l6b 0 2023-12-08T20:28:17.246 INFO:tasks.workunit.client.0.smithi043.stdout:1/309: write d1/d16/d21/f51 [180722,89351] 0 2023-12-08T20:28:17.247 INFO:tasks.workunit.client.0.smithi043.stdout:1/310: read d1/d6/fa [2317503,52605] 0 2023-12-08T20:28:17.247 INFO:tasks.workunit.client.0.smithi043.stdout:1/311: truncate d1/d16/d48/f4a 459646 0 2023-12-08T20:28:17.247 INFO:tasks.workunit.client.0.smithi043.stdout:1/312: dread - d1/d16/d1c/f59 zero size 2023-12-08T20:28:17.247 INFO:tasks.workunit.client.0.smithi043.stdout:1/313: write d1/d16/d30/f5f [601397,109707] 0 2023-12-08T20:28:17.247 INFO:tasks.workunit.client.0.smithi043.stdout:1/314: stat d1/d16/d1c/l27 0 2023-12-08T20:28:17.247 INFO:tasks.workunit.client.0.smithi043.stdout:1/315: stat d1/d6/c26 0 2023-12-08T20:28:17.254 INFO:tasks.workunit.client.0.smithi043.stdout:1/316: dread d1/f2a [0,4194304] 0 2023-12-08T20:28:17.254 INFO:tasks.workunit.client.0.smithi043.stdout:1/317: truncate d1/d16/d1c/f44 481597 0 2023-12-08T20:28:17.254 INFO:tasks.workunit.client.0.smithi043.stdout:1/318: chown d1/l6a 2178709 1 2023-12-08T20:28:17.255 INFO:tasks.workunit.client.0.smithi043.stdout:1/319: creat d1/d16/d21/f6c x:0 0 0 2023-12-08T20:28:17.256 INFO:tasks.workunit.client.0.smithi043.stdout:1/320: rename d1/d16/d1c/l33 to d1/d16/d21/d60/l6d 0 2023-12-08T20:28:17.257 INFO:tasks.workunit.client.0.smithi043.stdout:1/321: mkdir d1/d16/d30/d6e 0 2023-12-08T20:28:17.262 INFO:tasks.workunit.client.0.smithi043.stdout:1/322: dread d1/f2 [0,4194304] 0 2023-12-08T20:28:17.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:16 smithi043 ceph-mon[111966]: pgmap v29: 65 pgs: 65 active+clean; 1.9 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 45 MiB/s rd, 97 MiB/s wr, 237 op/s 2023-12-08T20:28:17.264 INFO:tasks.workunit.client.0.smithi043.stdout:1/323: mkdir d1/d16/d21/d6f 0 2023-12-08T20:28:17.264 INFO:tasks.workunit.client.0.smithi043.stdout:1/324: readlink d1/d6/lf 0 2023-12-08T20:28:17.264 INFO:tasks.workunit.client.0.smithi043.stdout:1/325: chown d1/d6/f3d 50630442 1 2023-12-08T20:28:17.264 INFO:tasks.workunit.client.0.smithi043.stdout:1/326: symlink d1/d16/d30/d6e/l70 0 2023-12-08T20:28:17.271 INFO:tasks.workunit.client.0.smithi043.stdout:7/158: sync 2023-12-08T20:28:17.271 INFO:tasks.workunit.client.0.smithi043.stdout:7/159: fsync d0/d6/f29 0 2023-12-08T20:28:17.278 INFO:tasks.workunit.client.0.smithi043.stdout:1/327: dwrite d1/d6/f3d [4194304,4194304] 0 2023-12-08T20:28:17.279 INFO:tasks.workunit.client.0.smithi043.stdout:1/328: write d1/d16/d48/f56 [8495124,100020] 0 2023-12-08T20:28:17.280 INFO:tasks.workunit.client.0.smithi043.stdout:7/160: dread d0/d6/f1a [0,4194304] 0 2023-12-08T20:28:17.280 INFO:tasks.workunit.client.0.smithi043.stdout:1/329: mkdir d1/d16/d1c/d71 0 2023-12-08T20:28:17.298 INFO:tasks.workunit.client.0.smithi043.stdout:7/161: dwrite d0/d2/f5 [0,4194304] 0 2023-12-08T20:28:17.299 INFO:tasks.workunit.client.0.smithi043.stdout:7/162: rmdir d0/d6/d17 39 2023-12-08T20:28:17.299 INFO:tasks.workunit.client.0.smithi043.stdout:7/163: rmdir d0/d2/d12 39 2023-12-08T20:28:17.301 INFO:tasks.workunit.client.0.smithi043.stdout:7/164: creat d0/d2/d12/f2e x:0 0 0 2023-12-08T20:28:17.301 INFO:tasks.workunit.client.0.smithi043.stdout:7/165: read - d0/d2/d12/d19/f2b zero size 2023-12-08T20:28:17.301 INFO:tasks.workunit.client.0.smithi043.stdout:7/166: readlink d0/d2/ld 0 2023-12-08T20:28:17.302 INFO:tasks.workunit.client.0.smithi043.stdout:7/167: rename d0/d6/d17/l1c to d0/d6/d17/l2f 0 2023-12-08T20:28:17.302 INFO:tasks.workunit.client.0.smithi043.stdout:7/168: mknod d0/c30 0 2023-12-08T20:28:17.303 INFO:tasks.workunit.client.0.smithi043.stdout:7/169: fdatasync d0/d6/f24 0 2023-12-08T20:28:17.303 INFO:tasks.workunit.client.0.smithi043.stdout:7/170: chown d0/d6/c20 79 1 2023-12-08T20:28:17.303 INFO:tasks.workunit.client.0.smithi043.stdout:7/171: symlink d0/l31 0 2023-12-08T20:28:17.303 INFO:tasks.workunit.client.0.smithi043.stdout:7/172: stat d0/d6 0 2023-12-08T20:28:17.304 INFO:tasks.workunit.client.0.smithi043.stdout:7/173: creat d0/d2/d12/f32 x:0 0 0 2023-12-08T20:28:17.304 INFO:tasks.workunit.client.0.smithi043.stdout:7/174: readlink d0/d6/d17/l2f 0 2023-12-08T20:28:17.311 INFO:tasks.workunit.client.0.smithi043.stdout:7/175: dread d0/d6/d8/f15 [0,4194304] 0 2023-12-08T20:28:17.312 INFO:tasks.workunit.client.0.smithi043.stdout:7/176: symlink d0/d2/d12/l33 0 2023-12-08T20:28:17.312 INFO:tasks.workunit.client.0.smithi043.stdout:7/177: mknod d0/d6/c34 0 2023-12-08T20:28:17.313 INFO:tasks.workunit.client.0.smithi043.stdout:7/178: mknod d0/d6/d17/c35 0 2023-12-08T20:28:17.313 INFO:tasks.workunit.client.0.smithi043.stdout:7/179: dread - d0/d2/d12/d19/f2b zero size 2023-12-08T20:28:17.314 INFO:tasks.workunit.client.0.smithi043.stdout:7/180: mkdir d0/d2/d36 0 2023-12-08T20:28:17.315 INFO:tasks.workunit.client.0.smithi043.stdout:7/181: creat d0/d6/d17/f37 x:0 0 0 2023-12-08T20:28:17.317 INFO:tasks.workunit.client.0.smithi043.stdout:7/182: mkdir d0/d2/d12/d19/d38 0 2023-12-08T20:28:17.318 INFO:tasks.workunit.client.0.smithi043.stdout:7/183: mknod d0/d2/c39 0 2023-12-08T20:28:17.318 INFO:tasks.workunit.client.0.smithi043.stdout:7/184: fdatasync d0/d6/f1a 0 2023-12-08T20:28:17.318 INFO:tasks.workunit.client.0.smithi043.stdout:7/185: chown d0/d2/d12 227 1 2023-12-08T20:28:17.318 INFO:tasks.workunit.client.0.smithi043.stdout:7/186: creat d0/d2/f3a x:0 0 0 2023-12-08T20:28:17.340 INFO:tasks.workunit.client.0.smithi043.stdout:7/187: dwrite d0/d2/fc [0,4194304] 0 2023-12-08T20:28:17.347 INFO:tasks.workunit.client.0.smithi043.stdout:7/188: rmdir d0/d6 39 2023-12-08T20:28:17.348 INFO:tasks.workunit.client.0.smithi043.stdout:7/189: stat d0/d6/c20 0 2023-12-08T20:28:17.348 INFO:tasks.workunit.client.0.smithi043.stdout:7/190: write d0/d2/f3a [1010648,103586] 0 2023-12-08T20:28:17.349 INFO:tasks.workunit.client.0.smithi043.stdout:7/191: rmdir d0/d2/d36 0 2023-12-08T20:28:17.350 INFO:tasks.workunit.client.0.smithi043.stdout:7/192: symlink d0/d6/d17/l3b 0 2023-12-08T20:28:17.350 INFO:tasks.workunit.client.0.smithi043.stdout:7/193: chown d0/d2/f3a 52 1 2023-12-08T20:28:17.351 INFO:tasks.workunit.client.0.smithi043.stdout:7/194: read d0/d2/f21 [3447470,98164] 0 2023-12-08T20:28:17.353 INFO:tasks.workunit.client.0.smithi043.stdout:7/195: symlink d0/d6/l3c 0 2023-12-08T20:28:17.354 INFO:tasks.workunit.client.0.smithi043.stdout:7/196: creat d0/f3d x:0 0 0 2023-12-08T20:28:17.356 INFO:tasks.workunit.client.0.smithi043.stdout:7/197: mknod d0/d2/c3e 0 2023-12-08T20:28:17.371 INFO:tasks.workunit.client.0.smithi043.stdout:8/308: sync 2023-12-08T20:28:17.371 INFO:tasks.workunit.client.0.smithi043.stdout:0/258: sync 2023-12-08T20:28:17.372 INFO:tasks.workunit.client.0.smithi043.stdout:0/259: truncate d2/d3/fb 2126437 0 2023-12-08T20:28:17.374 INFO:tasks.workunit.client.0.smithi043.stdout:0/260: link d2/c17 d2/d3/c52 0 2023-12-08T20:28:17.374 INFO:tasks.workunit.client.0.smithi043.stdout:0/261: chown d2/d4/f4b 2179596 1 2023-12-08T20:28:17.383 INFO:tasks.workunit.client.0.smithi043.stdout:8/309: dread d2/de/f13 [0,4194304] 0 2023-12-08T20:28:17.385 INFO:tasks.workunit.client.0.smithi043.stdout:8/310: link d2/c4c d2/de/c5c 0 2023-12-08T20:28:17.385 INFO:tasks.workunit.client.0.smithi043.stdout:8/311: write d2/de/d3a/f2e [4489321,92337] 0 2023-12-08T20:28:17.385 INFO:tasks.workunit.client.0.smithi043.stdout:8/312: chown d2/de/ff 4959 1 2023-12-08T20:28:17.387 INFO:tasks.workunit.client.0.smithi043.stdout:8/313: rename d2/fc to d2/de/d37/d5a/f5d 0 2023-12-08T20:28:17.387 INFO:tasks.workunit.client.0.smithi043.stdout:8/314: write d2/de/f14 [1199842,103550] 0 2023-12-08T20:28:17.388 INFO:tasks.workunit.client.0.smithi043.stdout:8/315: link d2/c22 d2/de/d29/c5e 0 2023-12-08T20:28:17.391 INFO:tasks.workunit.client.0.smithi043.stdout:0/262: dwrite d2/d3/d18/f43 [0,4194304] 0 2023-12-08T20:28:17.391 INFO:tasks.workunit.client.0.smithi043.stdout:8/316: fsync d2/de/d3a/f2e 0 2023-12-08T20:28:17.391 INFO:tasks.workunit.client.0.smithi043.stdout:8/317: stat d2/de/d37/d5a 0 2023-12-08T20:28:17.394 INFO:tasks.workunit.client.0.smithi043.stdout:0/263: dread d2/d4/f35 [0,4194304] 0 2023-12-08T20:28:17.395 INFO:tasks.workunit.client.0.smithi043.stdout:8/318: getdents d2/d20 0 2023-12-08T20:28:17.396 INFO:tasks.workunit.client.0.smithi043.stdout:8/319: write d2/de/d3a/f39 [2199634,7610] 0 2023-12-08T20:28:17.396 INFO:tasks.workunit.client.0.smithi043.stdout:0/264: mkdir d2/d3/d18/d1e/d53 0 2023-12-08T20:28:17.399 INFO:tasks.workunit.client.0.smithi043.stdout:0/265: getdents d2/d3/d18/d1e 0 2023-12-08T20:28:17.400 INFO:tasks.workunit.client.0.smithi043.stdout:0/266: getdents d2/d3/d18/d2b/d4f/d3f 0 2023-12-08T20:28:17.401 INFO:tasks.workunit.client.0.smithi043.stdout:0/267: getdents d2 0 2023-12-08T20:28:17.401 INFO:tasks.workunit.client.0.smithi043.stdout:0/268: fdatasync d2/d3/d18/f43 0 2023-12-08T20:28:17.403 INFO:tasks.workunit.client.0.smithi043.stdout:8/320: dread d2/de/f4d [0,4194304] 0 2023-12-08T20:28:17.403 INFO:tasks.workunit.client.0.smithi043.stdout:8/321: fdatasync d2/de/f26 0 2023-12-08T20:28:17.403 INFO:tasks.workunit.client.0.smithi043.stdout:8/322: fdatasync d2/de/d29/d30/f49 0 2023-12-08T20:28:17.403 INFO:tasks.workunit.client.0.smithi043.stdout:8/323: chown d2/f1e 3347154 1 2023-12-08T20:28:17.403 INFO:tasks.workunit.client.0.smithi043.stdout:8/324: readlink d2/de/d3a/l51 0 2023-12-08T20:28:17.403 INFO:tasks.workunit.client.0.smithi043.stdout:8/325: fsync d2/de/ff 0 2023-12-08T20:28:17.404 INFO:tasks.workunit.client.0.smithi043.stdout:0/269: dread d2/f24 [0,4194304] 0 2023-12-08T20:28:17.405 INFO:tasks.workunit.client.0.smithi043.stdout:0/270: symlink d2/d3/d18/d2b/d4f/l54 0 2023-12-08T20:28:17.406 INFO:tasks.workunit.client.0.smithi043.stdout:0/271: write d2/d3/d18/d2b/f41 [335906,89924] 0 2023-12-08T20:28:17.407 INFO:tasks.workunit.client.0.smithi043.stdout:0/272: truncate d2/f24 1449895 0 2023-12-08T20:28:17.423 INFO:tasks.workunit.client.0.smithi043.stdout:0/273: dwrite d2/d3/fb [0,4194304] 0 2023-12-08T20:28:17.423 INFO:tasks.workunit.client.0.smithi043.stdout:0/274: fsync d2/d3/d6/f2e 0 2023-12-08T20:28:17.438 INFO:tasks.workunit.client.0.smithi043.stdout:0/275: dwrite d2/d3/d18/f43 [4194304,4194304] 0 2023-12-08T20:28:17.438 INFO:tasks.workunit.client.0.smithi043.stdout:0/276: chown d2/d3/d18/d2b/l50 94 1 2023-12-08T20:28:17.439 INFO:tasks.workunit.client.0.smithi043.stdout:0/277: mkdir d2/d3/d55 0 2023-12-08T20:28:17.441 INFO:tasks.workunit.client.0.smithi043.stdout:0/278: unlink d2/d3/d18/d2b/l50 0 2023-12-08T20:28:17.457 INFO:tasks.workunit.client.0.smithi043.stdout:0/279: dwrite d2/d3/d18/f22 [0,4194304] 0 2023-12-08T20:28:17.460 INFO:tasks.workunit.client.0.smithi043.stdout:0/280: rename d2/d4/c2f to d2/d3/d18/d1e/c56 0 2023-12-08T20:28:17.461 INFO:tasks.workunit.client.0.smithi043.stdout:0/281: symlink d2/l57 0 2023-12-08T20:28:17.542 INFO:tasks.workunit.client.0.smithi043.stdout:9/244: sync 2023-12-08T20:28:17.542 INFO:tasks.workunit.client.0.smithi043.stdout:3/247: sync 2023-12-08T20:28:17.543 INFO:tasks.workunit.client.0.smithi043.stdout:5/292: sync 2023-12-08T20:28:17.544 INFO:tasks.workunit.client.0.smithi043.stdout:9/245: symlink d0/d49/l4a 0 2023-12-08T20:28:17.544 INFO:tasks.workunit.client.0.smithi043.stdout:3/248: dread d1/d25/d2a/f39 [0,4194304] 0 2023-12-08T20:28:17.544 INFO:tasks.workunit.client.0.smithi043.stdout:9/246: mkdir d0/d3d/d4b 0 2023-12-08T20:28:17.544 INFO:tasks.workunit.client.0.smithi043.stdout:9/247: fdatasync d0/d21/f23 0 2023-12-08T20:28:17.545 INFO:tasks.workunit.client.0.smithi043.stdout:9/248: creat d0/d3d/f4c x:0 0 0 2023-12-08T20:28:17.549 INFO:tasks.workunit.client.0.smithi043.stdout:9/249: getdents d0/d49 0 2023-12-08T20:28:17.549 INFO:tasks.workunit.client.0.smithi043.stdout:5/293: dread d3/d7/de/f1d [0,4194304] 0 2023-12-08T20:28:17.551 INFO:tasks.workunit.client.0.smithi043.stdout:9/250: truncate d0/d21/f26 3902072 0 2023-12-08T20:28:17.562 INFO:tasks.workunit.client.0.smithi043.stdout:3/249: dwrite d1/d9/d38/f3d [0,4194304] 0 2023-12-08T20:28:17.565 INFO:tasks.workunit.client.0.smithi043.stdout:3/250: creat d1/f4b x:0 0 0 2023-12-08T20:28:17.565 INFO:tasks.workunit.client.0.smithi043.stdout:3/251: fdatasync d1/d9/d38/f3d 0 2023-12-08T20:28:17.567 INFO:tasks.workunit.client.0.smithi043.stdout:3/252: symlink d1/d1c/d2c/l4c 0 2023-12-08T20:28:17.577 INFO:tasks.workunit.client.0.smithi043.stdout:5/294: dwrite d3/d7/d21/f4d [0,4194304] 0 2023-12-08T20:28:17.577 INFO:tasks.workunit.client.0.smithi043.stdout:9/251: dwrite d0/d2e/f47 [0,4194304] 0 2023-12-08T20:28:17.577 INFO:tasks.workunit.client.0.smithi043.stdout:9/252: truncate d0/f1b 813099 0 2023-12-08T20:28:17.577 INFO:tasks.workunit.client.0.smithi043.stdout:9/253: fsync d0/f10 0 2023-12-08T20:28:17.580 INFO:tasks.workunit.client.0.smithi043.stdout:9/254: unlink d0/d21/l39 0 2023-12-08T20:28:17.584 INFO:tasks.workunit.client.0.smithi043.stdout:9/255: write d0/d2e/f3c [24273,78688] 0 2023-12-08T20:28:17.584 INFO:tasks.workunit.client.0.smithi043.stdout:9/256: chown d0/c19 1547 1 2023-12-08T20:28:17.587 INFO:tasks.workunit.client.0.smithi043.stdout:9/257: rename d0/d49/l4a to d0/d49/l4d 0 2023-12-08T20:28:17.587 INFO:tasks.workunit.client.0.smithi043.stdout:3/253: dwrite d1/d9/fe [0,4194304] 0 2023-12-08T20:28:17.587 INFO:tasks.workunit.client.0.smithi043.stdout:9/258: creat d0/d21/f4e x:0 0 0 2023-12-08T20:28:17.588 INFO:tasks.workunit.client.0.smithi043.stdout:3/254: symlink d1/d1c/d29/l4d 0 2023-12-08T20:28:17.591 INFO:tasks.workunit.client.0.smithi043.stdout:9/259: link d0/d2e/f40 d0/d21/f4f 0 2023-12-08T20:28:17.591 INFO:tasks.workunit.client.0.smithi043.stdout:3/255: creat d1/d9/f4e x:0 0 0 2023-12-08T20:28:17.591 INFO:tasks.workunit.client.0.smithi043.stdout:3/256: chown d1/d25/c16 10333195 1 2023-12-08T20:28:17.592 INFO:tasks.workunit.client.0.smithi043.stdout:5/295: dread d3/f3d [0,4194304] 0 2023-12-08T20:28:17.592 INFO:tasks.workunit.client.0.smithi043.stdout:3/257: mkdir d1/d9/d38/d4f 0 2023-12-08T20:28:17.593 INFO:tasks.workunit.client.0.smithi043.stdout:3/258: read - d1/d9/df/f47 zero size 2023-12-08T20:28:17.594 INFO:tasks.workunit.client.0.smithi043.stdout:3/259: write d1/f18 [1909065,44859] 0 2023-12-08T20:28:17.594 INFO:tasks.workunit.client.0.smithi043.stdout:3/260: fdatasync d1/f1e 0 2023-12-08T20:28:17.594 INFO:tasks.workunit.client.0.smithi043.stdout:3/261: fdatasync d1/d9/fd 0 2023-12-08T20:28:17.595 INFO:tasks.workunit.client.0.smithi043.stdout:3/262: write d1/d9/f1a [2209933,43589] 0 2023-12-08T20:28:17.603 INFO:tasks.workunit.client.0.smithi043.stdout:3/263: dread d1/d9/f1a [0,4194304] 0 2023-12-08T20:28:17.603 INFO:tasks.workunit.client.0.smithi043.stdout:3/264: fdatasync d1/d9/d38/d30/f40 0 2023-12-08T20:28:17.608 INFO:tasks.workunit.client.0.smithi043.stdout:9/260: dwrite d0/f14 [0,4194304] 0 2023-12-08T20:28:17.609 INFO:tasks.workunit.client.0.smithi043.stdout:9/261: read d0/d21/f4f [684771,114850] 0 2023-12-08T20:28:17.611 INFO:tasks.workunit.client.0.smithi043.stdout:9/262: symlink d0/d49/l50 0 2023-12-08T20:28:17.611 INFO:tasks.workunit.client.0.smithi043.stdout:9/263: chown d0/f1e 72 1 2023-12-08T20:28:17.611 INFO:tasks.workunit.client.0.smithi043.stdout:9/264: creat d0/f51 x:0 0 0 2023-12-08T20:28:17.629 INFO:tasks.workunit.client.0.smithi043.stdout:3/265: dwrite d1/d9/fd [4194304,4194304] 0 2023-12-08T20:28:17.629 INFO:tasks.workunit.client.0.smithi043.stdout:9/265: dwrite d0/d3d/f4c [0,4194304] 0 2023-12-08T20:28:17.629 INFO:tasks.workunit.client.0.smithi043.stdout:9/266: stat d0/d21/f28 0 2023-12-08T20:28:17.633 INFO:tasks.workunit.client.0.smithi043.stdout:3/266: rmdir d1/d1c/d2c 39 2023-12-08T20:28:17.635 INFO:tasks.workunit.client.0.smithi043.stdout:9/267: link d0/f1b d0/d2e/f52 0 2023-12-08T20:28:17.638 INFO:tasks.workunit.client.0.smithi043.stdout:9/268: mkdir d0/d49/d53 0 2023-12-08T20:28:17.640 INFO:tasks.workunit.client.0.smithi043.stdout:9/269: rename d0/d2e/f52 to d0/d2e/d37/f54 0 2023-12-08T20:28:17.641 INFO:tasks.workunit.client.0.smithi043.stdout:9/270: read d0/d2e/f47 [2464570,16073] 0 2023-12-08T20:28:17.642 INFO:tasks.workunit.client.0.smithi043.stdout:9/271: write d0/d3d/f4c [3507443,130] 0 2023-12-08T20:28:17.643 INFO:tasks.workunit.client.0.smithi043.stdout:9/272: fsync d0/d2e/d37/f3a 0 2023-12-08T20:28:17.644 INFO:tasks.workunit.client.0.smithi043.stdout:9/273: creat d0/d21/f55 x:0 0 0 2023-12-08T20:28:17.644 INFO:tasks.workunit.client.0.smithi043.stdout:9/274: truncate d0/d21/f3e 269944 0 2023-12-08T20:28:17.644 INFO:tasks.workunit.client.0.smithi043.stdout:2/329: sync 2023-12-08T20:28:17.644 INFO:tasks.workunit.client.0.smithi043.stdout:4/249: sync 2023-12-08T20:28:17.644 INFO:tasks.workunit.client.0.smithi043.stdout:6/237: sync 2023-12-08T20:28:17.646 INFO:tasks.workunit.client.0.smithi043.stdout:6/238: creat d0/d2/d14/f57 x:0 0 0 2023-12-08T20:28:17.647 INFO:tasks.workunit.client.0.smithi043.stdout:4/250: symlink d1/d14/d25/d39/d3d/d40/l57 0 2023-12-08T20:28:17.649 INFO:tasks.workunit.client.0.smithi043.stdout:6/239: rename d0/d2/d14/d8/f33 to d0/d2/de/d4a/f58 0 2023-12-08T20:28:17.649 INFO:tasks.workunit.client.0.smithi043.stdout:6/240: write d0/d2/d14/d8/f4e [462742,26634] 0 2023-12-08T20:28:17.650 INFO:tasks.workunit.client.0.smithi043.stdout:4/251: mkdir d1/d14/d1d/d58 0 2023-12-08T20:28:17.650 INFO:tasks.workunit.client.0.smithi043.stdout:4/252: readlink d1/l27 0 2023-12-08T20:28:17.650 INFO:tasks.workunit.client.0.smithi043.stdout:6/241: read d0/d2/d14/d8/f4e [40525,76667] 0 2023-12-08T20:28:17.650 INFO:tasks.workunit.client.0.smithi043.stdout:6/242: chown d0/d2/d14/d2c/d22/d2a/c4c 105084 1 2023-12-08T20:28:17.650 INFO:tasks.workunit.client.0.smithi043.stdout:6/243: fsync d0/d2/d14/d20/f44 0 2023-12-08T20:28:17.653 INFO:tasks.workunit.client.0.smithi043.stdout:9/275: dread d0/d2e/f47 [0,4194304] 0 2023-12-08T20:28:17.654 INFO:tasks.workunit.client.0.smithi043.stdout:9/276: creat d0/d21/f56 x:0 0 0 2023-12-08T20:28:17.654 INFO:tasks.workunit.client.0.smithi043.stdout:9/277: write d0/f16 [193140,9750] 0 2023-12-08T20:28:17.654 INFO:tasks.workunit.client.0.smithi043.stdout:3/267: dwrite d1/d9/f4e [0,4194304] 0 2023-12-08T20:28:17.655 INFO:tasks.workunit.client.0.smithi043.stdout:4/253: write d1/f1c [2122989,86182] 0 2023-12-08T20:28:17.659 INFO:tasks.workunit.client.0.smithi043.stdout:9/278: rename d0/f1d to d0/d2e/f57 0 2023-12-08T20:28:17.659 INFO:tasks.workunit.client.0.smithi043.stdout:9/279: write d0/d3d/f45 [555764,124428] 0 2023-12-08T20:28:17.660 INFO:tasks.workunit.client.0.smithi043.stdout:4/254: mkdir d1/d14/d25/d39/d3f/d59 0 2023-12-08T20:28:17.660 INFO:tasks.workunit.client.0.smithi043.stdout:2/330: dwrite d0/d26/f3b [0,4194304] 0 2023-12-08T20:28:17.661 INFO:tasks.workunit.client.0.smithi043.stdout:4/255: getdents d1/d14/d25/d39 0 2023-12-08T20:28:17.662 INFO:tasks.workunit.client.0.smithi043.stdout:2/331: write d0/d26/f3b [1124801,48887] 0 2023-12-08T20:28:17.663 INFO:tasks.workunit.client.0.smithi043.stdout:6/244: dread d0/f35 [0,4194304] 0 2023-12-08T20:28:17.664 INFO:tasks.workunit.client.0.smithi043.stdout:6/245: truncate d0/d2/de/d4a/f58 993257 0 2023-12-08T20:28:17.664 INFO:tasks.workunit.client.0.smithi043.stdout:6/246: write d0/f48 [4876637,62425] 0 2023-12-08T20:28:17.664 INFO:tasks.workunit.client.0.smithi043.stdout:4/256: write d1/d14/f48 [2690338,29600] 0 2023-12-08T20:28:17.664 INFO:tasks.workunit.client.0.smithi043.stdout:4/257: fsync d1/d14/d50/f53 0 2023-12-08T20:28:17.664 INFO:tasks.workunit.client.0.smithi043.stdout:9/280: dread d0/f1c [0,4194304] 0 2023-12-08T20:28:17.665 INFO:tasks.workunit.client.0.smithi043.stdout:2/332: dread d0/d2b/f68 [0,4194304] 0 2023-12-08T20:28:17.665 INFO:tasks.workunit.client.0.smithi043.stdout:2/333: chown d0/cc 0 1 2023-12-08T20:28:17.668 INFO:tasks.workunit.client.0.smithi043.stdout:6/247: mkdir d0/d2/de/d4a/d56/d59 0 2023-12-08T20:28:17.668 INFO:tasks.workunit.client.0.smithi043.stdout:3/268: dwrite d1/d9/df/f47 [0,4194304] 0 2023-12-08T20:28:17.668 INFO:tasks.workunit.client.0.smithi043.stdout:3/269: read d1/d9/f48 [730223,16456] 0 2023-12-08T20:28:17.670 INFO:tasks.workunit.client.0.smithi043.stdout:6/248: read d0/d2/f1f [569567,80793] 0 2023-12-08T20:28:17.672 INFO:tasks.workunit.client.0.smithi043.stdout:9/281: rename d0/f17 to d0/d21/f58 0 2023-12-08T20:28:17.673 INFO:tasks.workunit.client.0.smithi043.stdout:2/334: mkdir d0/db/d18/d66/d71 0 2023-12-08T20:28:17.677 INFO:tasks.workunit.client.0.smithi043.stdout:6/249: rmdir d0/d2/d14/d20/d3c 39 2023-12-08T20:28:17.677 INFO:tasks.workunit.client.0.smithi043.stdout:6/250: fsync d0/d2/d14/d2c/f3b 0 2023-12-08T20:28:17.677 INFO:tasks.workunit.client.0.smithi043.stdout:6/251: write d0/d2/d14/d20/d49/f4f [790344,47995] 0 2023-12-08T20:28:17.680 INFO:tasks.workunit.client.0.smithi043.stdout:4/258: dwrite d1/d14/d25/d39/d3f/d3c/d41/f43 [0,4194304] 0 2023-12-08T20:28:17.681 INFO:tasks.workunit.client.0.smithi043.stdout:4/259: dread d1/d14/d25/d39/d3f/f3a [0,4194304] 0 2023-12-08T20:28:17.683 INFO:tasks.workunit.client.0.smithi043.stdout:2/335: readlink d0/db/l1b 0 2023-12-08T20:28:17.685 INFO:tasks.workunit.client.0.smithi043.stdout:6/252: dread d0/d2/f12 [0,4194304] 0 2023-12-08T20:28:17.687 INFO:tasks.workunit.client.0.smithi043.stdout:4/260: symlink d1/d14/d25/d39/d3f/d59/l5a 0 2023-12-08T20:28:17.688 INFO:tasks.workunit.client.0.smithi043.stdout:9/282: rmdir d0 39 2023-12-08T20:28:17.688 INFO:tasks.workunit.client.0.smithi043.stdout:9/283: write d0/d21/f4e [148739,88753] 0 2023-12-08T20:28:17.690 INFO:tasks.workunit.client.0.smithi043.stdout:2/336: creat d0/d20/d42/f72 x:0 0 0 2023-12-08T20:28:17.690 INFO:tasks.workunit.client.0.smithi043.stdout:2/337: fdatasync d0/d26/f3b 0 2023-12-08T20:28:17.690 INFO:tasks.workunit.client.0.smithi043.stdout:2/338: readlink d0/d26/d37/d38/l6f 0 2023-12-08T20:28:17.690 INFO:tasks.workunit.client.0.smithi043.stdout:2/339: fsync d0/f61 0 2023-12-08T20:28:17.690 INFO:tasks.workunit.client.0.smithi043.stdout:2/340: read d0/f55 [42928,29277] 0 2023-12-08T20:28:17.691 INFO:tasks.workunit.client.0.smithi043.stdout:2/341: write d0/db/f63 [91026,66859] 0 2023-12-08T20:28:17.695 INFO:tasks.workunit.client.0.smithi043.stdout:6/253: truncate d0/d2/f12 2375888 0 2023-12-08T20:28:17.696 INFO:tasks.workunit.client.0.smithi043.stdout:4/261: creat d1/d14/d25/d39/d3d/d40/f5b x:0 0 0 2023-12-08T20:28:17.698 INFO:tasks.workunit.client.0.smithi043.stdout:9/284: rename d0/d21/f23 to d0/d2e/f59 0 2023-12-08T20:28:17.698 INFO:tasks.workunit.client.0.smithi043.stdout:9/285: readlink d0/d49/l4d 0 2023-12-08T20:28:17.702 INFO:tasks.workunit.client.0.smithi043.stdout:2/342: truncate d0/db/f14 4027790 0 2023-12-08T20:28:17.703 INFO:tasks.workunit.client.0.smithi043.stdout:6/254: truncate d0/d2/d14/d20/d49/f4f 564223 0 2023-12-08T20:28:17.705 INFO:tasks.workunit.client.0.smithi043.stdout:2/343: symlink d0/db/l73 0 2023-12-08T20:28:17.709 INFO:tasks.workunit.client.0.smithi043.stdout:2/344: symlink d0/d20/l74 0 2023-12-08T20:28:17.710 INFO:tasks.workunit.client.0.smithi043.stdout:4/262: dread d1/f1c [0,4194304] 0 2023-12-08T20:28:17.715 INFO:tasks.workunit.client.0.smithi043.stdout:6/255: dread d0/d2/d14/d20/d49/f4f [0,4194304] 0 2023-12-08T20:28:17.716 INFO:tasks.workunit.client.0.smithi043.stdout:2/345: dread d0/db/d18/d3d/f40 [0,4194304] 0 2023-12-08T20:28:17.717 INFO:tasks.workunit.client.0.smithi043.stdout:6/256: creat d0/d2/d14/d2c/d22/d2a/f5a x:0 0 0 2023-12-08T20:28:17.717 INFO:tasks.workunit.client.0.smithi043.stdout:6/257: chown d0/d2/d14/d2c/d22/d3f 71214907 1 2023-12-08T20:28:17.717 INFO:tasks.workunit.client.0.smithi043.stdout:6/258: fsync d0/d2/d14/f57 0 2023-12-08T20:28:17.719 INFO:tasks.workunit.client.0.smithi043.stdout:9/286: dwrite d0/d21/f55 [0,4194304] 0 2023-12-08T20:28:17.720 INFO:tasks.workunit.client.0.smithi043.stdout:2/346: creat d0/d26/d53/f75 x:0 0 0 2023-12-08T20:28:17.721 INFO:tasks.workunit.client.0.smithi043.stdout:6/259: rename d0/d2/d14/d2c/c46 to d0/d2/d14/d20/d3c/d50/c5b 0 2023-12-08T20:28:17.722 INFO:tasks.workunit.client.0.smithi043.stdout:9/287: dread d0/f10 [0,4194304] 0 2023-12-08T20:28:17.723 INFO:tasks.workunit.client.0.smithi043.stdout:6/260: creat d0/d2/de/d4a/d56/f5c x:0 0 0 2023-12-08T20:28:17.723 INFO:tasks.workunit.client.0.smithi043.stdout:2/347: dread d0/f9 [0,4194304] 0 2023-12-08T20:28:17.723 INFO:tasks.workunit.client.0.smithi043.stdout:6/261: read - d0/d2/d14/d2c/d22/d2a/f5a zero size 2023-12-08T20:28:17.723 INFO:tasks.workunit.client.0.smithi043.stdout:9/288: symlink d0/d49/l5a 0 2023-12-08T20:28:17.725 INFO:tasks.workunit.client.0.smithi043.stdout:6/262: mknod d0/d2/d14/d20/d3c/d50/c5d 0 2023-12-08T20:28:17.725 INFO:tasks.workunit.client.0.smithi043.stdout:6/263: stat d0/d2/l38 0 2023-12-08T20:28:17.726 INFO:tasks.workunit.client.0.smithi043.stdout:6/264: creat d0/d2/d14/d20/d53/f5e x:0 0 0 2023-12-08T20:28:17.728 INFO:tasks.workunit.client.0.smithi043.stdout:6/265: mknod d0/d2/d14/c5f 0 2023-12-08T20:28:17.729 INFO:tasks.workunit.client.0.smithi043.stdout:2/348: dread d0/db/d18/d3d/f40 [0,4194304] 0 2023-12-08T20:28:17.731 INFO:tasks.workunit.client.0.smithi043.stdout:6/266: mkdir d0/d2/d14/d8/d47/d60 0 2023-12-08T20:28:17.731 INFO:tasks.workunit.client.0.smithi043.stdout:2/349: write d0/db/f14 [2657990,2181] 0 2023-12-08T20:28:17.733 INFO:tasks.workunit.client.0.smithi043.stdout:2/350: rename d0/d20/d42/f59 to d0/d20/f76 0 2023-12-08T20:28:17.734 INFO:tasks.workunit.client.0.smithi043.stdout:2/351: creat d0/db/d18/d66/f77 x:0 0 0 2023-12-08T20:28:17.735 INFO:tasks.workunit.client.0.smithi043.stdout:2/352: chown d0/db/d18/d3d 2592 1 2023-12-08T20:28:17.735 INFO:tasks.workunit.client.0.smithi043.stdout:4/263: dwrite d1/f5 [0,4194304] 0 2023-12-08T20:28:17.736 INFO:tasks.workunit.client.0.smithi043.stdout:2/353: unlink d0/d20/f62 0 2023-12-08T20:28:17.738 INFO:tasks.workunit.client.0.smithi043.stdout:2/354: creat d0/d20/d42/f78 x:0 0 0 2023-12-08T20:28:17.738 INFO:tasks.workunit.client.0.smithi043.stdout:2/355: chown d0/d20/d42/d49/c5e 35924725 1 2023-12-08T20:28:17.739 INFO:tasks.workunit.client.0.smithi043.stdout:2/356: getdents d0/d26/d37/d38 0 2023-12-08T20:28:17.741 INFO:tasks.workunit.client.0.smithi043.stdout:9/289: dwrite d0/d2e/f40 [0,4194304] 0 2023-12-08T20:28:17.746 INFO:tasks.workunit.client.0.smithi043.stdout:7/198: sync 2023-12-08T20:28:17.747 INFO:tasks.workunit.client.0.smithi043.stdout:0/282: sync 2023-12-08T20:28:17.747 INFO:tasks.workunit.client.0.smithi043.stdout:8/326: sync 2023-12-08T20:28:17.747 INFO:tasks.workunit.client.0.smithi043.stdout:1/330: sync 2023-12-08T20:28:17.748 INFO:tasks.workunit.client.0.smithi043.stdout:1/331: chown d1/d6/c26 425570 1 2023-12-08T20:28:17.748 INFO:tasks.workunit.client.0.smithi043.stdout:1/332: stat d1/d16/d48/f53 0 2023-12-08T20:28:17.748 INFO:tasks.workunit.client.0.smithi043.stdout:8/327: write d2/d27/d2d/d31/f58 [828195,113490] 0 2023-12-08T20:28:17.749 INFO:tasks.workunit.client.0.smithi043.stdout:8/328: write d2/de/f26 [2034451,108545] 0 2023-12-08T20:28:17.749 INFO:tasks.workunit.client.0.smithi043.stdout:8/329: stat d2/f21 0 2023-12-08T20:28:17.749 INFO:tasks.workunit.client.0.smithi043.stdout:8/330: chown d2/c22 8899636 1 2023-12-08T20:28:17.749 INFO:tasks.workunit.client.0.smithi043.stdout:1/333: mkdir d1/d16/d21/d25/d3e/d72 0 2023-12-08T20:28:17.751 INFO:tasks.workunit.client.0.smithi043.stdout:8/331: symlink d2/d27/l5f 0 2023-12-08T20:28:17.751 INFO:tasks.workunit.client.0.smithi043.stdout:1/334: creat d1/d16/d21/d25/d35/f73 x:0 0 0 2023-12-08T20:28:17.754 INFO:tasks.workunit.client.0.smithi043.stdout:8/332: unlink d2/f1e 0 2023-12-08T20:28:17.755 INFO:tasks.workunit.client.0.smithi043.stdout:1/335: creat d1/d16/d21/d25/d3e/d72/f74 x:0 0 0 2023-12-08T20:28:17.755 INFO:tasks.workunit.client.0.smithi043.stdout:1/336: chown d1/d16/c31 868 1 2023-12-08T20:28:17.756 INFO:tasks.workunit.client.0.smithi043.stdout:4/264: dwrite d1/d14/d25/d39/d3f/d3c/d41/f43 [0,4194304] 0 2023-12-08T20:28:17.756 INFO:tasks.workunit.client.0.smithi043.stdout:4/265: chown d1/d14/d25/d39 28127465 1 2023-12-08T20:28:17.756 INFO:tasks.workunit.client.0.smithi043.stdout:8/333: write d2/de/d37/d5a/f5d [3290721,34333] 0 2023-12-08T20:28:17.756 INFO:tasks.workunit.client.0.smithi043.stdout:8/334: chown d2/f21 9832 1 2023-12-08T20:28:17.756 INFO:tasks.workunit.client.0.smithi043.stdout:9/290: dread d0/f14 [0,4194304] 0 2023-12-08T20:28:17.757 INFO:tasks.workunit.client.0.smithi043.stdout:9/291: dread - d0/d21/f35 zero size 2023-12-08T20:28:17.758 INFO:tasks.workunit.client.0.smithi043.stdout:4/266: symlink d1/d14/d25/d39/d3f/d59/l5c 0 2023-12-08T20:28:17.758 INFO:tasks.workunit.client.0.smithi043.stdout:8/335: rmdir d2/de/d3a 39 2023-12-08T20:28:17.760 INFO:tasks.workunit.client.0.smithi043.stdout:9/292: mknod d0/c5b 0 2023-12-08T20:28:17.760 INFO:tasks.workunit.client.0.smithi043.stdout:9/293: chown d0/d3d/d4b 5 1 2023-12-08T20:28:17.760 INFO:tasks.workunit.client.0.smithi043.stdout:4/267: rename d1/d14/d25/d39/d3f/d59/l5a to d1/d14/d25/d39/d3d/d40/l5d 0 2023-12-08T20:28:17.761 INFO:tasks.workunit.client.0.smithi043.stdout:0/283: dread d2/f7 [4194304,4194304] 0 2023-12-08T20:28:17.762 INFO:tasks.workunit.client.0.smithi043.stdout:8/336: mkdir d2/de/d29/d30/d60 0 2023-12-08T20:28:17.763 INFO:tasks.workunit.client.0.smithi043.stdout:9/294: mkdir d0/d3d/d4b/d5c 0 2023-12-08T20:28:17.764 INFO:tasks.workunit.client.0.smithi043.stdout:4/268: dread d1/f11 [0,4194304] 0 2023-12-08T20:28:17.764 INFO:tasks.workunit.client.0.smithi043.stdout:0/284: rename d2/d3/d18/c40 to d2/c58 0 2023-12-08T20:28:17.767 INFO:tasks.workunit.client.0.smithi043.stdout:1/337: dread d1/d16/d1c/f55 [0,4194304] 0 2023-12-08T20:28:17.767 INFO:tasks.workunit.client.0.smithi043.stdout:9/295: dread d0/d21/f3e [0,4194304] 0 2023-12-08T20:28:17.767 INFO:tasks.workunit.client.0.smithi043.stdout:1/338: dread - d1/d16/d48/f65 zero size 2023-12-08T20:28:17.767 INFO:tasks.workunit.client.0.smithi043.stdout:4/269: mknod d1/d14/d25/d39/d3d/c5e 0 2023-12-08T20:28:17.767 INFO:tasks.workunit.client.0.smithi043.stdout:4/270: fdatasync d1/d14/d25/f29 0 2023-12-08T20:28:17.768 INFO:tasks.workunit.client.0.smithi043.stdout:1/339: creat d1/d16/d30/f75 x:0 0 0 2023-12-08T20:28:17.768 INFO:tasks.workunit.client.0.smithi043.stdout:1/340: readlink d1/d16/d48/l66 0 2023-12-08T20:28:17.768 INFO:tasks.workunit.client.0.smithi043.stdout:9/296: read d0/d21/f4f [2615250,84878] 0 2023-12-08T20:28:17.768 INFO:tasks.workunit.client.0.smithi043.stdout:9/297: fdatasync d0/d21/f3e 0 2023-12-08T20:28:17.768 INFO:tasks.workunit.client.0.smithi043.stdout:9/298: creat d0/d3d/f5d x:0 0 0 2023-12-08T20:28:17.769 INFO:tasks.workunit.client.0.smithi043.stdout:9/299: write d0/f13 [1751174,50685] 0 2023-12-08T20:28:17.770 INFO:tasks.workunit.client.0.smithi043.stdout:9/300: rename d0/d2e to d0/d5e 0 2023-12-08T20:28:17.770 INFO:tasks.workunit.client.0.smithi043.stdout:9/301: truncate d0/d21/f4e 540898 0 2023-12-08T20:28:17.771 INFO:tasks.workunit.client.0.smithi043.stdout:9/302: symlink d0/d49/d53/l5f 0 2023-12-08T20:28:17.771 INFO:tasks.workunit.client.0.smithi043.stdout:9/303: write d0/d21/f35 [76690,97167] 0 2023-12-08T20:28:17.779 INFO:tasks.workunit.client.0.smithi043.stdout:1/341: dread d1/d16/d1c/f55 [0,4194304] 0 2023-12-08T20:28:17.779 INFO:tasks.workunit.client.0.smithi043.stdout:1/342: mknod d1/d16/d1c/c76 0 2023-12-08T20:28:17.779 INFO:tasks.workunit.client.0.smithi043.stdout:1/343: read - d1/d16/d48/f53 zero size 2023-12-08T20:28:17.779 INFO:tasks.workunit.client.0.smithi043.stdout:7/199: dwrite d0/d6/d8/f10 [0,4194304] 0 2023-12-08T20:28:17.779 INFO:tasks.workunit.client.0.smithi043.stdout:7/200: truncate d0/d6/f24 489362 0 2023-12-08T20:28:17.779 INFO:tasks.workunit.client.0.smithi043.stdout:7/201: read - d0/d2/d12/f2c zero size 2023-12-08T20:28:17.781 INFO:tasks.workunit.client.0.smithi043.stdout:1/344: mkdir d1/d16/d21/d25/d3e/d77 0 2023-12-08T20:28:17.781 INFO:tasks.workunit.client.0.smithi043.stdout:7/202: symlink d0/d2/l3f 0 2023-12-08T20:28:17.781 INFO:tasks.workunit.client.0.smithi043.stdout:7/203: write d0/f3d [476981,68950] 0 2023-12-08T20:28:17.782 INFO:tasks.workunit.client.0.smithi043.stdout:0/285: dread d2/d3/d18/f43 [0,4194304] 0 2023-12-08T20:28:17.782 INFO:tasks.workunit.client.0.smithi043.stdout:0/286: write d2/d3/d18/d2b/f37 [1194428,96201] 0 2023-12-08T20:28:17.782 INFO:tasks.workunit.client.0.smithi043.stdout:1/345: creat d1/d16/d30/d4f/d54/f78 x:0 0 0 2023-12-08T20:28:17.782 INFO:tasks.workunit.client.0.smithi043.stdout:1/346: dread - d1/d16/d30/f75 zero size 2023-12-08T20:28:17.782 INFO:tasks.workunit.client.0.smithi043.stdout:7/204: write d0/d2/fc [3870405,126999] 0 2023-12-08T20:28:17.785 INFO:tasks.workunit.client.0.smithi043.stdout:4/271: dwrite d1/d14/f26 [0,4194304] 0 2023-12-08T20:28:17.786 INFO:tasks.workunit.client.0.smithi043.stdout:7/205: creat d0/d2/d12/d19/f40 x:0 0 0 2023-12-08T20:28:17.787 INFO:tasks.workunit.client.0.smithi043.stdout:8/337: getdents d2/de/d29/d30 0 2023-12-08T20:28:17.788 INFO:tasks.workunit.client.0.smithi043.stdout:9/304: getdents d0/d3d/d4b 0 2023-12-08T20:28:17.788 INFO:tasks.workunit.client.0.smithi043.stdout:7/206: creat d0/d2/d12/d19/f41 x:0 0 0 2023-12-08T20:28:17.789 INFO:tasks.workunit.client.0.smithi043.stdout:7/207: dread - d0/d6/d17/f37 zero size 2023-12-08T20:28:17.789 INFO:tasks.workunit.client.0.smithi043.stdout:7/208: readlink d0/d2/l7 0 2023-12-08T20:28:17.791 INFO:tasks.workunit.client.0.smithi043.stdout:0/287: dread d2/d4/f26 [0,4194304] 0 2023-12-08T20:28:17.792 INFO:tasks.workunit.client.0.smithi043.stdout:0/288: chown d2/d3/d18/d2b/f37 1546400010 1 2023-12-08T20:28:17.792 INFO:tasks.workunit.client.0.smithi043.stdout:0/289: write d2/d3/d18/d2b/f37 [2302877,24646] 0 2023-12-08T20:28:17.792 INFO:tasks.workunit.client.0.smithi043.stdout:0/290: stat d2/d4/f35 0 2023-12-08T20:28:17.792 INFO:tasks.workunit.client.0.smithi043.stdout:8/338: creat d2/de/f61 x:0 0 0 2023-12-08T20:28:17.792 INFO:tasks.workunit.client.0.smithi043.stdout:8/339: chown d2/d27/d2d/d31/c42 10856 1 2023-12-08T20:28:17.794 INFO:tasks.workunit.client.0.smithi043.stdout:9/305: truncate d0/d5e/d37/f54 616611 0 2023-12-08T20:28:17.794 INFO:tasks.workunit.client.0.smithi043.stdout:9/306: fdatasync d0/f13 0 2023-12-08T20:28:17.796 INFO:tasks.workunit.client.0.smithi043.stdout:7/209: creat d0/f42 x:0 0 0 2023-12-08T20:28:17.796 INFO:tasks.workunit.client.0.smithi043.stdout:0/291: fdatasync d2/d4/fe 0 2023-12-08T20:28:17.797 INFO:tasks.workunit.client.0.smithi043.stdout:8/340: getdents d2/de/d3a 0 2023-12-08T20:28:17.799 INFO:tasks.workunit.client.0.smithi043.stdout:9/307: rename d0/d5e/l30 to d0/d3d/d4b/d5c/l60 0 2023-12-08T20:28:17.800 INFO:tasks.workunit.client.0.smithi043.stdout:7/210: mknod d0/d2/d12/c43 0 2023-12-08T20:28:17.801 INFO:tasks.workunit.client.0.smithi043.stdout:0/292: mknod d2/d3/d18/d1e/c59 0 2023-12-08T20:28:17.802 INFO:tasks.workunit.client.0.smithi043.stdout:8/341: creat d2/de/d37/d5a/f62 x:0 0 0 2023-12-08T20:28:17.803 INFO:tasks.workunit.client.0.smithi043.stdout:7/211: mknod d0/d6/d17/c44 0 2023-12-08T20:28:17.804 INFO:tasks.workunit.client.0.smithi043.stdout:0/293: mknod d2/d3/d18/d1e/d53/c5a 0 2023-12-08T20:28:17.805 INFO:tasks.workunit.client.0.smithi043.stdout:0/294: mknod d2/d3/d18/d2b/c5b 0 2023-12-08T20:28:17.805 INFO:tasks.workunit.client.0.smithi043.stdout:0/295: stat d2/d3/d18/d1e/f25 0 2023-12-08T20:28:17.810 INFO:tasks.workunit.client.0.smithi043.stdout:4/272: dwrite d1/d14/d25/d39/f51 [0,4194304] 0 2023-12-08T20:28:17.814 INFO:tasks.workunit.client.0.smithi043.stdout:4/273: creat d1/f5f x:0 0 0 2023-12-08T20:28:17.816 INFO:tasks.workunit.client.0.smithi043.stdout:8/342: write d2/d27/d2d/d31/f36 [1341723,60990] 0 2023-12-08T20:28:17.818 INFO:tasks.workunit.client.0.smithi043.stdout:8/343: rename d2/de/d3a/f2e to d2/de/d37/d5a/f63 0 2023-12-08T20:28:17.818 INFO:tasks.workunit.client.0.smithi043.stdout:8/344: fdatasync d2/d27/d2d/f55 0 2023-12-08T20:28:17.819 INFO:tasks.workunit.client.0.smithi043.stdout:8/345: mknod d2/de/d29/d30/d60/c64 0 2023-12-08T20:28:17.820 INFO:tasks.workunit.client.0.smithi043.stdout:8/346: creat d2/de/d29/d59/f65 x:0 0 0 2023-12-08T20:28:17.820 INFO:tasks.workunit.client.0.smithi043.stdout:8/347: chown d2/ld 48576 1 2023-12-08T20:28:17.820 INFO:tasks.workunit.client.0.smithi043.stdout:0/296: dread d2/d4/f3d [0,4194304] 0 2023-12-08T20:28:17.822 INFO:tasks.workunit.client.0.smithi043.stdout:8/348: getdents d2/d27/d2d/d31 0 2023-12-08T20:28:17.823 INFO:tasks.workunit.client.0.smithi043.stdout:8/349: creat d2/de/d29/f66 x:0 0 0 2023-12-08T20:28:17.823 INFO:tasks.workunit.client.0.smithi043.stdout:0/297: dread d2/f24 [0,4194304] 0 2023-12-08T20:28:17.825 INFO:tasks.workunit.client.0.smithi043.stdout:0/298: creat d2/d3/d18/d2b/d4f/f5c x:0 0 0 2023-12-08T20:28:17.826 INFO:tasks.workunit.client.0.smithi043.stdout:4/274: dread d1/d14/d1d/f1e [0,4194304] 0 2023-12-08T20:28:17.826 INFO:tasks.workunit.client.0.smithi043.stdout:4/275: chown d1/d14/d25/d39/d3d/d40/l57 853970235 1 2023-12-08T20:28:17.827 INFO:tasks.workunit.client.0.smithi043.stdout:0/299: creat d2/d3/d18/d1e/d53/f5d x:0 0 0 2023-12-08T20:28:17.827 INFO:tasks.workunit.client.0.smithi043.stdout:0/300: fsync d2/f24 0 2023-12-08T20:28:17.827 INFO:tasks.workunit.client.0.smithi043.stdout:0/301: stat d2/d3/d18/d1e/l27 0 2023-12-08T20:28:17.827 INFO:tasks.workunit.client.0.smithi043.stdout:7/212: dwrite d0/d2/d12/d19/f2b [0,4194304] 0 2023-12-08T20:28:17.827 INFO:tasks.workunit.client.0.smithi043.stdout:9/308: dwrite d0/d5e/f3c [0,4194304] 0 2023-12-08T20:28:17.839 INFO:tasks.workunit.client.0.smithi043.stdout:7/213: rename d0/d6/d8/c1f to d0/d6/d8/c45 0 2023-12-08T20:28:17.842 INFO:tasks.workunit.client.0.smithi043.stdout:9/309: getdents d0 0 2023-12-08T20:28:17.843 INFO:tasks.workunit.client.0.smithi043.stdout:7/214: rmdir d0/d6 39 2023-12-08T20:28:17.846 INFO:tasks.workunit.client.0.smithi043.stdout:9/310: unlink d0/d21/f35 0 2023-12-08T20:28:17.846 INFO:tasks.workunit.client.0.smithi043.stdout:9/311: chown d0 50 1 2023-12-08T20:28:17.848 INFO:tasks.workunit.client.0.smithi043.stdout:9/312: mkdir d0/d3d/d4b/d61 0 2023-12-08T20:28:17.850 INFO:tasks.workunit.client.0.smithi043.stdout:9/313: link d0/d5e/f59 d0/d3d/d4b/d61/f62 0 2023-12-08T20:28:17.853 INFO:tasks.workunit.client.0.smithi043.stdout:9/314: creat d0/d5e/f63 x:0 0 0 2023-12-08T20:28:17.855 INFO:tasks.workunit.client.0.smithi043.stdout:9/315: unlink d0/d5e/l2f 0 2023-12-08T20:28:17.855 INFO:tasks.workunit.client.0.smithi043.stdout:4/276: dwrite d1/f5 [0,4194304] 0 2023-12-08T20:28:17.856 INFO:tasks.workunit.client.0.smithi043.stdout:9/316: mknod d0/d3d/d4b/c64 0 2023-12-08T20:28:17.859 INFO:tasks.workunit.client.0.smithi043.stdout:8/350: dwrite d2/d27/f35 [0,4194304] 0 2023-12-08T20:28:17.860 INFO:tasks.workunit.client.0.smithi043.stdout:9/317: mkdir d0/d3d/d4b/d65 0 2023-12-08T20:28:17.860 INFO:tasks.workunit.client.0.smithi043.stdout:8/351: truncate d2/de/f46 1324467 0 2023-12-08T20:28:17.862 INFO:tasks.workunit.client.0.smithi043.stdout:9/318: mknod d0/d3d/d4b/d61/c66 0 2023-12-08T20:28:17.863 INFO:tasks.workunit.client.0.smithi043.stdout:8/352: mknod d2/d27/d2d/d31/d4f/c67 0 2023-12-08T20:28:17.865 INFO:tasks.workunit.client.0.smithi043.stdout:9/319: mkdir d0/d67 0 2023-12-08T20:28:17.865 INFO:tasks.workunit.client.0.smithi043.stdout:9/320: getdents d0/d67 0 2023-12-08T20:28:17.866 INFO:tasks.workunit.client.0.smithi043.stdout:8/353: mkdir d2/de/d29/d68 0 2023-12-08T20:28:17.866 INFO:tasks.workunit.client.0.smithi043.stdout:8/354: truncate d2/de/d29/d59/f65 636256 0 2023-12-08T20:28:17.867 INFO:tasks.workunit.client.0.smithi043.stdout:0/302: dwrite d2/f7 [0,4194304] 0 2023-12-08T20:28:17.867 INFO:tasks.workunit.client.0.smithi043.stdout:0/303: truncate d2/d3/d18/d1e/f3c 1030191 0 2023-12-08T20:28:17.870 INFO:tasks.workunit.client.0.smithi043.stdout:9/321: unlink d0/l11 0 2023-12-08T20:28:17.870 INFO:tasks.workunit.client.0.smithi043.stdout:8/355: mknod d2/d27/d2d/d31/d4f/c69 0 2023-12-08T20:28:17.870 INFO:tasks.workunit.client.0.smithi043.stdout:7/215: dwrite d0/f1b [0,4194304] 0 2023-12-08T20:28:17.870 INFO:tasks.workunit.client.0.smithi043.stdout:4/277: dread d1/d14/d1d/fb [0,4194304] 0 2023-12-08T20:28:17.873 INFO:tasks.workunit.client.0.smithi043.stdout:5/296: sync 2023-12-08T20:28:17.874 INFO:tasks.workunit.client.0.smithi043.stdout:8/356: rmdir d2/d27 39 2023-12-08T20:28:17.878 INFO:tasks.workunit.client.0.smithi043.stdout:7/216: creat d0/d2/f46 x:0 0 0 2023-12-08T20:28:17.880 INFO:tasks.workunit.client.0.smithi043.stdout:4/278: link d1/d14/d1d/c4c d1/d14/d50/c60 0 2023-12-08T20:28:17.880 INFO:tasks.workunit.client.0.smithi043.stdout:4/279: write d1/f5f [1009889,35936] 0 2023-12-08T20:28:17.880 INFO:tasks.workunit.client.0.smithi043.stdout:4/280: chown d1/d14/d25/d39/d3d/d40/l57 40 1 2023-12-08T20:28:17.883 INFO:tasks.workunit.client.0.smithi043.stdout:5/297: creat d3/d7/d19/d3f/f58 x:0 0 0 2023-12-08T20:28:17.885 INFO:tasks.workunit.client.0.smithi043.stdout:8/357: symlink d2/de/d37/d5a/l6a 0 2023-12-08T20:28:17.885 INFO:tasks.workunit.client.0.smithi043.stdout:8/358: chown d2/c4c 746885 1 2023-12-08T20:28:17.886 INFO:tasks.workunit.client.0.smithi043.stdout:7/217: mkdir d0/d6/d8/d47 0 2023-12-08T20:28:17.887 INFO:tasks.workunit.client.0.smithi043.stdout:4/281: creat d1/d14/d25/d39/d3d/f61 x:0 0 0 2023-12-08T20:28:17.888 INFO:tasks.workunit.client.0.smithi043.stdout:7/218: dread d0/d6/f18 [0,4194304] 0 2023-12-08T20:28:17.889 INFO:tasks.workunit.client.0.smithi043.stdout:8/359: stat d2/de/c5c 0 2023-12-08T20:28:17.890 INFO:tasks.workunit.client.0.smithi043.stdout:4/282: creat d1/d14/d1d/d58/f62 x:0 0 0 2023-12-08T20:28:17.891 INFO:tasks.workunit.client.0.smithi043.stdout:0/304: dwrite d2/d3/d18/d2b/f36 [0,4194304] 0 2023-12-08T20:28:17.891 INFO:tasks.workunit.client.0.smithi043.stdout:7/219: mknod d0/d2/d12/d19/d38/c48 0 2023-12-08T20:28:17.892 INFO:tasks.workunit.client.0.smithi043.stdout:9/322: dwrite d0/d5e/f33 [4194304,4194304] 0 2023-12-08T20:28:17.893 INFO:tasks.workunit.client.0.smithi043.stdout:8/360: symlink d2/de/d29/d30/d60/l6b 0 2023-12-08T20:28:17.895 INFO:tasks.workunit.client.0.smithi043.stdout:4/283: dread d1/d14/d50/f53 [0,4194304] 0 2023-12-08T20:28:17.896 INFO:tasks.workunit.client.0.smithi043.stdout:0/305: mkdir d2/d3/d6/d39/d5e 0 2023-12-08T20:28:17.899 INFO:tasks.workunit.client.0.smithi043.stdout:7/220: rename d0/d6/c34 to d0/d6/d8/d47/c49 0 2023-12-08T20:28:17.899 INFO:tasks.workunit.client.0.smithi043.stdout:7/221: write d0/d2/f5 [2537282,60655] 0 2023-12-08T20:28:17.903 INFO:tasks.workunit.client.0.smithi043.stdout:8/361: creat d2/de/d29/f6c x:0 0 0 2023-12-08T20:28:17.904 INFO:tasks.workunit.client.0.smithi043.stdout:4/284: truncate d1/d14/f45 2244798 0 2023-12-08T20:28:17.905 INFO:tasks.workunit.client.0.smithi043.stdout:7/222: symlink d0/d6/d8/l4a 0 2023-12-08T20:28:17.907 INFO:tasks.workunit.client.0.smithi043.stdout:8/362: unlink d2/d27/d2d/l40 0 2023-12-08T20:28:17.908 INFO:tasks.workunit.client.0.smithi043.stdout:4/285: getdents d1 0 2023-12-08T20:28:17.909 INFO:tasks.workunit.client.0.smithi043.stdout:9/323: dwrite d0/f1c [0,4194304] 0 2023-12-08T20:28:17.909 INFO:tasks.workunit.client.0.smithi043.stdout:4/286: read d1/d14/f31 [326191,67168] 0 2023-12-08T20:28:17.909 INFO:tasks.workunit.client.0.smithi043.stdout:9/324: stat d0/d3d/f48 0 2023-12-08T20:28:17.909 INFO:tasks.workunit.client.0.smithi043.stdout:7/223: mknod d0/d6/d8/c4b 0 2023-12-08T20:28:17.910 INFO:tasks.workunit.client.0.smithi043.stdout:8/363: creat d2/d27/f6d x:0 0 0 2023-12-08T20:28:17.910 INFO:tasks.workunit.client.0.smithi043.stdout:8/364: chown d2/d20 8 1 2023-12-08T20:28:17.913 INFO:tasks.workunit.client.0.smithi043.stdout:9/325: creat d0/d49/f68 x:0 0 0 2023-12-08T20:28:17.914 INFO:tasks.workunit.client.0.smithi043.stdout:4/287: symlink d1/d14/d25/l63 0 2023-12-08T20:28:17.916 INFO:tasks.workunit.client.0.smithi043.stdout:7/224: truncate d0/d2/d12/d19/f2b 955626 0 2023-12-08T20:28:17.917 INFO:tasks.workunit.client.0.smithi043.stdout:8/365: symlink d2/de/d29/d30/l6e 0 2023-12-08T20:28:17.919 INFO:tasks.workunit.client.0.smithi043.stdout:4/288: symlink d1/d14/d25/d39/d3d/l64 0 2023-12-08T20:28:17.920 INFO:tasks.workunit.client.0.smithi043.stdout:7/225: symlink d0/d2/d12/l4c 0 2023-12-08T20:28:17.922 INFO:tasks.workunit.client.0.smithi043.stdout:8/366: rename d2/de/d3a to d2/d6f 0 2023-12-08T20:28:17.922 INFO:tasks.workunit.client.0.smithi043.stdout:8/367: readlink d2/de/l16 0 2023-12-08T20:28:17.924 INFO:tasks.workunit.client.0.smithi043.stdout:4/289: mkdir d1/d14/d25/d39/d3f/d3c/d41/d65 0 2023-12-08T20:28:17.925 INFO:tasks.workunit.client.0.smithi043.stdout:0/306: getdents d2/d3/d6/d39 0 2023-12-08T20:28:17.927 INFO:tasks.workunit.client.0.smithi043.stdout:7/226: rename d0/d2/d12/c43 to d0/d6/d8/c4d 0 2023-12-08T20:28:17.927 INFO:tasks.workunit.client.0.smithi043.stdout:7/227: chown d0/d2/fc 44652882 1 2023-12-08T20:28:17.927 INFO:tasks.workunit.client.0.smithi043.stdout:7/228: fdatasync d0/d2/f27 0 2023-12-08T20:28:17.929 INFO:tasks.workunit.client.0.smithi043.stdout:7/229: dread d0/fb [0,4194304] 0 2023-12-08T20:28:17.930 INFO:tasks.workunit.client.0.smithi043.stdout:0/307: mkdir d2/d3/d18/d2b/d4f/d5f 0 2023-12-08T20:28:17.931 INFO:tasks.workunit.client.0.smithi043.stdout:9/326: dwrite d0/d5e/d37/f3a [0,4194304] 0 2023-12-08T20:28:17.932 INFO:tasks.workunit.client.0.smithi043.stdout:7/230: rename d0/d6/l3c to d0/d2/l4e 0 2023-12-08T20:28:17.933 INFO:tasks.workunit.client.0.smithi043.stdout:3/270: sync 2023-12-08T20:28:17.936 INFO:tasks.workunit.client.0.smithi043.stdout:9/327: link d0/c1f d0/c69 0 2023-12-08T20:28:17.936 INFO:tasks.workunit.client.0.smithi043.stdout:3/271: dread d1/d9/f48 [0,4194304] 0 2023-12-08T20:28:17.936 INFO:tasks.workunit.client.0.smithi043.stdout:7/231: creat d0/d2/d12/d19/f4f x:0 0 0 2023-12-08T20:28:17.938 INFO:tasks.workunit.client.0.smithi043.stdout:7/232: mknod d0/d6/d8/d47/c50 0 2023-12-08T20:28:17.939 INFO:tasks.workunit.client.0.smithi043.stdout:3/272: rename d1/d25/d2a/f39 to d1/f50 0 2023-12-08T20:28:17.946 INFO:tasks.workunit.client.0.smithi043.stdout:4/290: rmdir d1/d14/d25/d39/d3d 39 2023-12-08T20:28:17.948 INFO:tasks.workunit.client.0.smithi043.stdout:4/291: getdents d1/d14/d25/d39/d3f/d59 0 2023-12-08T20:28:17.960 INFO:tasks.workunit.client.0.smithi043.stdout:7/233: rmdir d0/d2/d12 39 2023-12-08T20:28:17.962 INFO:tasks.workunit.client.0.smithi043.stdout:7/234: creat d0/d2/d12/f51 x:0 0 0 2023-12-08T20:28:17.962 INFO:tasks.workunit.client.0.smithi043.stdout:7/235: dread - d0/d2/d12/f32 zero size 2023-12-08T20:28:17.963 INFO:tasks.workunit.client.0.smithi043.stdout:7/236: mkdir d0/d6/d17/d52 0 2023-12-08T20:28:17.964 INFO:tasks.workunit.client.0.smithi043.stdout:7/237: symlink d0/d6/d17/l53 0 2023-12-08T20:28:17.966 INFO:tasks.workunit.client.0.smithi043.stdout:7/238: truncate d0/d2/f11 1039325 0 2023-12-08T20:28:17.967 INFO:tasks.workunit.client.0.smithi043.stdout:7/239: truncate d0/d2/f21 94207 0 2023-12-08T20:28:17.969 INFO:tasks.workunit.client.0.smithi043.stdout:7/240: write d0/d2/d12/f2e [941555,68323] 0 2023-12-08T20:28:17.983 INFO:tasks.workunit.client.0.smithi043.stdout:3/273: dwrite d1/f4b [0,4194304] 0 2023-12-08T20:28:17.984 INFO:tasks.workunit.client.0.smithi043.stdout:3/274: fdatasync d1/d25/f36 0 2023-12-08T20:28:17.984 INFO:tasks.workunit.client.0.smithi043.stdout:0/308: dwrite d2/d4/fc [0,4194304] 0 2023-12-08T20:28:17.984 INFO:tasks.workunit.client.0.smithi043.stdout:9/328: dwrite d0/d5e/d37/f54 [0,4194304] 0 2023-12-08T20:28:17.984 INFO:tasks.workunit.client.0.smithi043.stdout:4/292: dwrite d1/d14/d25/d39/d3f/f3a [0,4194304] 0 2023-12-08T20:28:17.986 INFO:tasks.workunit.client.0.smithi043.stdout:7/241: dwrite d0/d2/d12/f2c [0,4194304] 0 2023-12-08T20:28:17.986 INFO:tasks.workunit.client.0.smithi043.stdout:7/242: chown d0/d6/d17/f37 8 1 2023-12-08T20:28:17.986 INFO:tasks.workunit.client.0.smithi043.stdout:7/243: truncate d0/d2/d12/d19/f40 373591 0 2023-12-08T20:28:17.986 INFO:tasks.workunit.client.0.smithi043.stdout:7/244: chown d0/d6/d8/c4d 112015888 1 2023-12-08T20:28:17.986 INFO:tasks.workunit.client.0.smithi043.stdout:0/309: getdents d2/d4 0 2023-12-08T20:28:17.993 INFO:tasks.workunit.client.0.smithi043.stdout:4/293: rename d1/d14/d25/d39/d3d/d40/l55 to d1/d14/d25/d39/d3f/d3c/d41/l66 0 2023-12-08T20:28:17.995 INFO:tasks.workunit.client.0.smithi043.stdout:7/245: mkdir d0/d6/d17/d54 0 2023-12-08T20:28:17.995 INFO:tasks.workunit.client.0.smithi043.stdout:7/246: dread - d0/d2/d12/d19/f41 zero size 2023-12-08T20:28:17.997 INFO:tasks.workunit.client.0.smithi043.stdout:0/310: truncate d2/f7 168370 0 2023-12-08T20:28:17.997 INFO:tasks.workunit.client.0.smithi043.stdout:9/329: dread d0/d5e/f40 [0,4194304] 0 2023-12-08T20:28:17.998 INFO:tasks.workunit.client.0.smithi043.stdout:0/311: symlink d2/d3/d18/d2b/l60 0 2023-12-08T20:28:17.999 INFO:tasks.workunit.client.0.smithi043.stdout:9/330: mknod d0/d3d/c6a 0 2023-12-08T20:28:17.999 INFO:tasks.workunit.client.0.smithi043.stdout:3/275: dwrite d1/d9/f19 [0,4194304] 0 2023-12-08T20:28:17.999 INFO:tasks.workunit.client.0.smithi043.stdout:0/312: mkdir d2/d61 0 2023-12-08T20:28:18.000 INFO:tasks.workunit.client.0.smithi043.stdout:9/331: mkdir d0/d5e/d37/d6b 0 2023-12-08T20:28:18.002 INFO:tasks.workunit.client.0.smithi043.stdout:0/313: write d2/d3/f1a [2962516,99692] 0 2023-12-08T20:28:18.002 INFO:tasks.workunit.client.0.smithi043.stdout:3/276: getdents d1/d1c/d29 0 2023-12-08T20:28:18.002 INFO:tasks.workunit.client.0.smithi043.stdout:3/277: readlink d1/d9/l23 0 2023-12-08T20:28:18.003 INFO:tasks.workunit.client.0.smithi043.stdout:4/294: dread d1/d14/f48 [0,4194304] 0 2023-12-08T20:28:18.006 INFO:tasks.workunit.client.0.smithi043.stdout:9/332: mkdir d0/d5e/d37/d6b/d6c 0 2023-12-08T20:28:18.006 INFO:tasks.workunit.client.0.smithi043.stdout:9/333: fsync d0/f34 0 2023-12-08T20:28:18.007 INFO:tasks.workunit.client.0.smithi043.stdout:4/295: mkdir d1/d14/d25/d39/d3d/d40/d67 0 2023-12-08T20:28:18.009 INFO:tasks.workunit.client.0.smithi043.stdout:9/334: rename d0/f25 to d0/d49/d53/f6d 0 2023-12-08T20:28:18.011 INFO:tasks.workunit.client.0.smithi043.stdout:4/296: rename d1/d14/d25/d28/f35 to d1/d14/d25/d39/d3d/d40/d67/f68 0 2023-12-08T20:28:18.013 INFO:tasks.workunit.client.0.smithi043.stdout:9/335: symlink d0/d5e/d37/l6e 0 2023-12-08T20:28:18.015 INFO:tasks.workunit.client.0.smithi043.stdout:4/297: getdents d1/d14 0 2023-12-08T20:28:18.015 INFO:tasks.workunit.client.0.smithi043.stdout:4/298: stat d1/d14/d25/d39/d3f/d3c/d41/f43 0 2023-12-08T20:28:18.015 INFO:tasks.workunit.client.0.smithi043.stdout:4/299: stat d1/d14/l30 0 2023-12-08T20:28:18.015 INFO:tasks.workunit.client.0.smithi043.stdout:9/336: rmdir d0/d5e/d37 39 2023-12-08T20:28:18.015 INFO:tasks.workunit.client.0.smithi043.stdout:9/337: write d0/d21/f28 [285641,47719] 0 2023-12-08T20:28:18.017 INFO:tasks.workunit.client.0.smithi043.stdout:4/300: creat d1/d14/d25/d39/d3d/d40/f69 x:0 0 0 2023-12-08T20:28:18.019 INFO:tasks.workunit.client.0.smithi043.stdout:9/338: mknod d0/d5e/c6f 0 2023-12-08T20:28:18.019 INFO:tasks.workunit.client.0.smithi043.stdout:9/339: chown d0/d5e/d37 1817710 1 2023-12-08T20:28:18.019 INFO:tasks.workunit.client.0.smithi043.stdout:4/301: truncate d1/d14/d25/d39/d3d/d40/d67/f68 3241102 0 2023-12-08T20:28:18.019 INFO:tasks.workunit.client.0.smithi043.stdout:4/302: chown d1/d14/c32 7969331 1 2023-12-08T20:28:18.019 INFO:tasks.workunit.client.0.smithi043.stdout:9/340: read d0/d5e/f59 [16308,66913] 0 2023-12-08T20:28:18.021 INFO:tasks.workunit.client.0.smithi043.stdout:4/303: unlink d1/d14/d1d/f16 0 2023-12-08T20:28:18.022 INFO:tasks.workunit.client.0.smithi043.stdout:9/341: symlink d0/d3d/d4b/d5c/l70 0 2023-12-08T20:28:18.024 INFO:tasks.workunit.client.0.smithi043.stdout:9/342: write d0/f10 [1078256,93731] 0 2023-12-08T20:28:18.024 INFO:tasks.workunit.client.0.smithi043.stdout:2/357: sync 2023-12-08T20:28:18.024 INFO:tasks.workunit.client.0.smithi043.stdout:4/304: mknod d1/d14/d25/d39/d3d/d40/d67/c6a 0 2023-12-08T20:28:18.024 INFO:tasks.workunit.client.0.smithi043.stdout:4/305: truncate d1/f5f 1738683 0 2023-12-08T20:28:18.024 INFO:tasks.workunit.client.0.smithi043.stdout:2/358: getdents d0/db/d18/d66/d71 0 2023-12-08T20:28:18.024 INFO:tasks.workunit.client.0.smithi043.stdout:6/267: sync 2023-12-08T20:28:18.024 INFO:tasks.workunit.client.0.smithi043.stdout:1/347: sync 2023-12-08T20:28:18.025 INFO:tasks.workunit.client.0.smithi043.stdout:6/268: fdatasync d0/d2/de/d4a/f58 0 2023-12-08T20:28:18.025 INFO:tasks.workunit.client.0.smithi043.stdout:6/269: chown d0/d2/d14/d8/c16 1242796 1 2023-12-08T20:28:18.025 INFO:tasks.workunit.client.0.smithi043.stdout:9/343: truncate d0/d21/f55 1504852 0 2023-12-08T20:28:18.025 INFO:tasks.workunit.client.0.smithi043.stdout:6/270: write d0/d2/f3e [601504,94321] 0 2023-12-08T20:28:18.029 INFO:tasks.workunit.client.0.smithi043.stdout:4/306: symlink d1/d14/d25/d39/d3f/l6b 0 2023-12-08T20:28:18.029 INFO:tasks.workunit.client.0.smithi043.stdout:6/271: write d0/d2/d14/d20/f44 [3437131,64265] 0 2023-12-08T20:28:18.029 INFO:tasks.workunit.client.0.smithi043.stdout:2/359: mkdir d0/d2b/d4e/d79 0 2023-12-08T20:28:18.029 INFO:tasks.workunit.client.0.smithi043.stdout:1/348: creat d1/d16/d30/d4f/d54/f79 x:0 0 0 2023-12-08T20:28:18.029 INFO:tasks.workunit.client.0.smithi043.stdout:9/344: creat d0/d3d/d4b/f71 x:0 0 0 2023-12-08T20:28:18.030 INFO:tasks.workunit.client.0.smithi043.stdout:6/272: link d0/d2/f28 d0/d2/d29/f61 0 2023-12-08T20:28:18.030 INFO:tasks.workunit.client.0.smithi043.stdout:6/273: stat d0/d2/d14/d20/d3c/d50/c5d 0 2023-12-08T20:28:18.030 INFO:tasks.workunit.client.0.smithi043.stdout:2/360: rmdir d0/d26 39 2023-12-08T20:28:18.031 INFO:tasks.workunit.client.0.smithi043.stdout:9/345: rename d0/f10 to d0/d3d/f72 0 2023-12-08T20:28:18.032 INFO:tasks.workunit.client.0.smithi043.stdout:6/274: creat d0/d2/d14/d20/d49/f62 x:0 0 0 2023-12-08T20:28:18.034 INFO:tasks.workunit.client.0.smithi043.stdout:2/361: rename d0/d26/d53/c6b to d0/db/d18/d3d/c7a 0 2023-12-08T20:28:18.035 INFO:tasks.workunit.client.0.smithi043.stdout:9/346: unlink d0/c20 0 2023-12-08T20:28:18.037 INFO:tasks.workunit.client.0.smithi043.stdout:9/347: dread d0/d3d/f42 [0,4194304] 0 2023-12-08T20:28:18.037 INFO:tasks.workunit.client.0.smithi043.stdout:9/348: chown d0/d5e/d37/d6b/d6c 435652565 1 2023-12-08T20:28:18.037 INFO:tasks.workunit.client.0.smithi043.stdout:9/349: chown d0/d49/d53/l5f 624349 1 2023-12-08T20:28:18.038 INFO:tasks.workunit.client.0.smithi043.stdout:9/350: chown d0/d3d/f45 30067 1 2023-12-08T20:28:18.038 INFO:tasks.workunit.client.0.smithi043.stdout:9/351: chown d0/d3d/d4b/d61/f62 17 1 2023-12-08T20:28:18.038 INFO:tasks.workunit.client.0.smithi043.stdout:2/362: symlink d0/db/l7b 0 2023-12-08T20:28:18.039 INFO:tasks.workunit.client.0.smithi043.stdout:9/352: mkdir d0/d5e/d73 0 2023-12-08T20:28:18.041 INFO:tasks.workunit.client.0.smithi043.stdout:2/363: getdents d0 0 2023-12-08T20:28:18.042 INFO:tasks.workunit.client.0.smithi043.stdout:9/353: dread d0/d21/f4e [0,4194304] 0 2023-12-08T20:28:18.043 INFO:tasks.workunit.client.0.smithi043.stdout:2/364: rename d0/f57 to d0/d2b/d4e/d79/f7c 0 2023-12-08T20:28:18.044 INFO:tasks.workunit.client.0.smithi043.stdout:2/365: link d0/d20/f4d d0/f7d 0 2023-12-08T20:28:18.045 INFO:tasks.workunit.client.0.smithi043.stdout:2/366: readlink d0/d20/l2e 0 2023-12-08T20:28:18.045 INFO:tasks.workunit.client.0.smithi043.stdout:2/367: creat d0/db/d18/f7e x:0 0 0 2023-12-08T20:28:18.047 INFO:tasks.workunit.client.0.smithi043.stdout:2/368: link d0/cc d0/d20/d42/c7f 0 2023-12-08T20:28:18.047 INFO:tasks.workunit.client.0.smithi043.stdout:2/369: readlink d0/d26/d37/l3a 0 2023-12-08T20:28:18.048 INFO:tasks.workunit.client.0.smithi043.stdout:2/370: chown d0/d26/d53/d6a 0 1 2023-12-08T20:28:18.048 INFO:tasks.workunit.client.0.smithi043.stdout:2/371: symlink d0/d20/l80 0 2023-12-08T20:28:18.049 INFO:tasks.workunit.client.0.smithi043.stdout:2/372: write d0/d20/f76 [1973676,45116] 0 2023-12-08T20:28:18.053 INFO:tasks.workunit.client.0.smithi043.stdout:2/373: write d0/f4 [3362071,117411] 0 2023-12-08T20:28:18.054 INFO:tasks.workunit.client.0.smithi043.stdout:1/349: dwrite d1/d16/d1c/f55 [0,4194304] 0 2023-12-08T20:28:18.054 INFO:tasks.workunit.client.0.smithi043.stdout:1/350: fsync d1/d16/d30/d4f/d54/f78 0 2023-12-08T20:28:18.055 INFO:tasks.workunit.client.0.smithi043.stdout:4/307: dwrite d1/f11 [0,4194304] 0 2023-12-08T20:28:18.056 INFO:tasks.workunit.client.0.smithi043.stdout:2/374: rmdir d0/d26/d53/d6a 0 2023-12-08T20:28:18.057 INFO:tasks.workunit.client.0.smithi043.stdout:1/351: truncate d1/f2 1006812 0 2023-12-08T20:28:18.058 INFO:tasks.workunit.client.0.smithi043.stdout:4/308: creat d1/d14/d25/d39/d3d/d40/f6c x:0 0 0 2023-12-08T20:28:18.081 INFO:tasks.workunit.client.0.smithi043.stdout:2/375: write d0/d2b/d4e/d79/f7c [676415,107978] 0 2023-12-08T20:28:18.083 INFO:tasks.workunit.client.0.smithi043.stdout:0/314: dwrite d2/d3/d18/f2a [0,4194304] 0 2023-12-08T20:28:18.084 INFO:tasks.workunit.client.0.smithi043.stdout:2/376: mkdir d0/d81 0 2023-12-08T20:28:18.091 INFO:tasks.workunit.client.0.smithi043.stdout:2/377: dread d0/f28 [0,4194304] 0 2023-12-08T20:28:18.092 INFO:tasks.workunit.client.0.smithi043.stdout:1/352: dwrite d1/d16/d21/d42/f5c [0,4194304] 0 2023-12-08T20:28:18.103 INFO:tasks.workunit.client.0.smithi043.stdout:2/378: dread d0/d20/f2c [0,4194304] 0 2023-12-08T20:28:18.105 INFO:tasks.workunit.client.0.smithi043.stdout:1/353: mknod d1/d16/d21/d25/d3e/c7a 0 2023-12-08T20:28:18.108 INFO:tasks.workunit.client.0.smithi043.stdout:1/354: creat d1/d16/d1c/d4e/f7b x:0 0 0 2023-12-08T20:28:18.111 INFO:tasks.workunit.client.0.smithi043.stdout:1/355: dread d1/d16/d21/f51 [0,4194304] 0 2023-12-08T20:28:18.111 INFO:tasks.workunit.client.0.smithi043.stdout:0/315: dwrite d2/f24 [0,4194304] 0 2023-12-08T20:28:18.112 INFO:tasks.workunit.client.0.smithi043.stdout:1/356: creat d1/d16/d1c/f7c x:0 0 0 2023-12-08T20:28:18.112 INFO:tasks.workunit.client.0.smithi043.stdout:1/357: truncate d1/d16/d30/d4f/d54/f78 962664 0 2023-12-08T20:28:18.112 INFO:tasks.workunit.client.0.smithi043.stdout:1/358: dread - d1/d16/d1c/d4e/f7b zero size 2023-12-08T20:28:18.116 INFO:tasks.workunit.client.0.smithi043.stdout:2/379: dread d0/d20/f2a [0,4194304] 0 2023-12-08T20:28:18.116 INFO:tasks.workunit.client.0.smithi043.stdout:0/316: rmdir d2/d3/d55 0 2023-12-08T20:28:18.117 INFO:tasks.workunit.client.0.smithi043.stdout:1/359: mknod d1/d16/d1c/d71/c7d 0 2023-12-08T20:28:18.119 INFO:tasks.workunit.client.0.smithi043.stdout:0/317: truncate d2/d3/d18/d1e/f25 8038302 0 2023-12-08T20:28:18.126 INFO:tasks.workunit.client.0.smithi043.stdout:1/360: mkdir d1/d16/d7e 0 2023-12-08T20:28:18.131 INFO:tasks.workunit.client.0.smithi043.stdout:1/361: mknod d1/d16/d21/d6f/c7f 0 2023-12-08T20:28:18.135 INFO:tasks.workunit.client.0.smithi043.stdout:1/362: write d1/d16/d48/f4a [215117,74953] 0 2023-12-08T20:28:18.136 INFO:tasks.workunit.client.0.smithi043.stdout:1/363: getdents d1/d16/d21/d25/d3e/d72 0 2023-12-08T20:28:18.136 INFO:tasks.workunit.client.0.smithi043.stdout:1/364: write d1/d16/d1c/f50 [152458,39808] 0 2023-12-08T20:28:18.138 INFO:tasks.workunit.client.0.smithi043.stdout:1/365: creat d1/d16/d30/d6e/f80 x:0 0 0 2023-12-08T20:28:18.147 INFO:tasks.workunit.client.0.smithi043.stdout:2/380: dwrite d0/f24 [0,4194304] 0 2023-12-08T20:28:18.147 INFO:tasks.workunit.client.0.smithi043.stdout:0/318: dwrite d2/d3/d18/f43 [0,4194304] 0 2023-12-08T20:28:18.147 INFO:tasks.workunit.client.0.smithi043.stdout:0/319: dread - d2/d3/d6/f44 zero size 2023-12-08T20:28:18.148 INFO:tasks.workunit.client.0.smithi043.stdout:0/320: dread d2/d3/d18/d1e/f3c [0,4194304] 0 2023-12-08T20:28:18.153 INFO:tasks.workunit.client.0.smithi043.stdout:2/381: truncate d0/f7d 1986213 0 2023-12-08T20:28:18.153 INFO:tasks.workunit.client.0.smithi043.stdout:2/382: readlink d0/db/l73 0 2023-12-08T20:28:18.154 INFO:tasks.workunit.client.0.smithi043.stdout:2/383: link d0/d26/d53/c58 d0/db/d18/d66/c82 0 2023-12-08T20:28:18.165 INFO:tasks.workunit.client.0.smithi043.stdout:5/298: sync 2023-12-08T20:28:18.166 INFO:tasks.workunit.client.0.smithi043.stdout:5/299: write d3/f45 [319465,59414] 0 2023-12-08T20:28:18.167 INFO:tasks.workunit.client.0.smithi043.stdout:5/300: rename d3/f45 to d3/d7/d19/f59 0 2023-12-08T20:28:18.170 INFO:tasks.workunit.client.0.smithi043.stdout:0/321: dwrite d2/d3/d18/d2b/f36 [0,4194304] 0 2023-12-08T20:28:18.172 INFO:tasks.workunit.client.0.smithi043.stdout:0/322: mknod d2/d3/d18/d2b/d4f/d3f/c62 0 2023-12-08T20:28:18.173 INFO:tasks.workunit.client.0.smithi043.stdout:0/323: mkdir d2/d3/d6/d39/d63 0 2023-12-08T20:28:18.174 INFO:tasks.workunit.client.0.smithi043.stdout:0/324: creat d2/d3/d18/d1e/d53/f64 x:0 0 0 2023-12-08T20:28:18.174 INFO:tasks.workunit.client.0.smithi043.stdout:0/325: dread - d2/d3/d6/f44 zero size 2023-12-08T20:28:18.177 INFO:tasks.workunit.client.0.smithi043.stdout:2/384: write d0/d20/f4d [1542161,34980] 0 2023-12-08T20:28:18.180 INFO:tasks.workunit.client.0.smithi043.stdout:5/301: dread f2 [0,4194304] 0 2023-12-08T20:28:18.181 INFO:tasks.workunit.client.0.smithi043.stdout:5/302: dread - d3/d7/d21/d51/f54 zero size 2023-12-08T20:28:18.181 INFO:tasks.workunit.client.0.smithi043.stdout:5/303: stat d3/d7/d19/d3f 0 2023-12-08T20:28:18.182 INFO:tasks.workunit.client.0.smithi043.stdout:2/385: link d0/d26/l64 d0/d26/l83 0 2023-12-08T20:28:18.182 INFO:tasks.workunit.client.0.smithi043.stdout:2/386: readlink d0/d26/l83 0 2023-12-08T20:28:18.182 INFO:tasks.workunit.client.0.smithi043.stdout:2/387: chown d0/d20/d42/f72 33749 1 2023-12-08T20:28:18.182 INFO:tasks.workunit.client.0.smithi043.stdout:2/388: readlink d0/d26/l30 0 2023-12-08T20:28:18.188 INFO:tasks.workunit.client.0.smithi043.stdout:5/304: write d3/fc [6871352,97835] 0 2023-12-08T20:28:18.190 INFO:tasks.workunit.client.0.smithi043.stdout:5/305: unlink d3/d7/de/d43/f4a 0 2023-12-08T20:28:18.190 INFO:tasks.workunit.client.0.smithi043.stdout:5/306: chown d3/d7/d19 2 1 2023-12-08T20:28:18.192 INFO:tasks.workunit.client.0.smithi043.stdout:5/307: mknod d3/d7/d21/c5a 0 2023-12-08T20:28:18.192 INFO:tasks.workunit.client.0.smithi043.stdout:5/308: chown d3/d7/d19 273749209 1 2023-12-08T20:28:18.205 INFO:tasks.workunit.client.0.smithi043.stdout:0/326: dwrite d2/d3/fb [0,4194304] 0 2023-12-08T20:28:18.205 INFO:tasks.workunit.client.0.smithi043.stdout:0/327: stat d2/d3/d18/d1e/d53 0 2023-12-08T20:28:18.206 INFO:tasks.workunit.client.0.smithi043.stdout:0/328: creat d2/d3/d6/d39/d5e/f65 x:0 0 0 2023-12-08T20:28:18.218 INFO:tasks.workunit.client.0.smithi043.stdout:0/329: dread d2/f24 [0,4194304] 0 2023-12-08T20:28:18.219 INFO:tasks.workunit.client.0.smithi043.stdout:2/389: dwrite d0/f6c [0,4194304] 0 2023-12-08T20:28:18.219 INFO:tasks.workunit.client.0.smithi043.stdout:0/330: read - d2/d3/d18/d2b/d4f/f5c zero size 2023-12-08T20:28:18.219 INFO:tasks.workunit.client.0.smithi043.stdout:5/309: dwrite d3/d7/d29/f3c [0,4194304] 0 2023-12-08T20:28:18.219 INFO:tasks.workunit.client.0.smithi043.stdout:5/310: chown d3/c1b 241 1 2023-12-08T20:28:18.219 INFO:tasks.workunit.client.0.smithi043.stdout:5/311: chown d3/d7/d21/d51/f54 62 1 2023-12-08T20:28:18.219 INFO:tasks.workunit.client.0.smithi043.stdout:5/312: getdents d3/d7/d19/d3f/d52 0 2023-12-08T20:28:18.223 INFO:tasks.workunit.client.0.smithi043.stdout:2/390: creat d0/d26/d37/d38/f84 x:0 0 0 2023-12-08T20:28:18.228 INFO:tasks.workunit.client.0.smithi043.stdout:5/313: unlink d3/d7/de/d17/f4e 0 2023-12-08T20:28:18.229 INFO:tasks.workunit.client.0.smithi043.stdout:2/391: truncate d0/db/d18/d3d/f56 2888506 0 2023-12-08T20:28:18.232 INFO:tasks.workunit.client.0.smithi043.stdout:2/392: symlink d0/d20/d42/d49/l85 0 2023-12-08T20:28:18.233 INFO:tasks.workunit.client.0.smithi043.stdout:5/314: symlink d3/l5b 0 2023-12-08T20:28:18.234 INFO:tasks.workunit.client.0.smithi043.stdout:2/393: creat d0/d26/d37/d38/f86 x:0 0 0 2023-12-08T20:28:18.234 INFO:tasks.workunit.client.0.smithi043.stdout:2/394: write d0/f17 [495082,109855] 0 2023-12-08T20:28:18.237 INFO:tasks.workunit.client.0.smithi043.stdout:5/315: dread d3/f37 [0,4194304] 0 2023-12-08T20:28:18.238 INFO:tasks.workunit.client.0.smithi043.stdout:5/316: fdatasync f2 0 2023-12-08T20:28:18.238 INFO:tasks.workunit.client.0.smithi043.stdout:5/317: chown f2 50 1 2023-12-08T20:28:18.243 INFO:tasks.workunit.client.0.smithi043.stdout:5/318: write d3/d7/d29/f3c [298007,39189] 0 2023-12-08T20:28:18.243 INFO:tasks.workunit.client.0.smithi043.stdout:5/319: write d3/d7/d19/f59 [1317118,62700] 0 2023-12-08T20:28:18.243 INFO:tasks.workunit.client.0.smithi043.stdout:0/331: dwrite d2/d3/d18/f2a [4194304,4194304] 0 2023-12-08T20:28:18.244 INFO:tasks.workunit.client.0.smithi043.stdout:5/320: read d3/d7/f13 [3771938,15963] 0 2023-12-08T20:28:18.246 INFO:tasks.workunit.client.0.smithi043.stdout:0/332: rename d2/d4/f26 to d2/d4/f66 0 2023-12-08T20:28:18.247 INFO:tasks.workunit.client.0.smithi043.stdout:5/321: mkdir d3/d7/d21/d51/d5c 0 2023-12-08T20:28:18.249 INFO:tasks.workunit.client.0.smithi043.stdout:0/333: mkdir d2/d61/d67 0 2023-12-08T20:28:18.250 INFO:tasks.workunit.client.0.smithi043.stdout:5/322: creat d3/d7/d29/f5d x:0 0 0 2023-12-08T20:28:18.251 INFO:tasks.workunit.client.0.smithi043.stdout:0/334: creat d2/d3/d6/f68 x:0 0 0 2023-12-08T20:28:18.251 INFO:tasks.workunit.client.0.smithi043.stdout:0/335: fsync d2/d3/f4e 0 2023-12-08T20:28:18.252 INFO:tasks.workunit.client.0.smithi043.stdout:5/323: rename d3/d7/d19/d3f/f4c to d3/d7/d19/d3f/d52/f5e 0 2023-12-08T20:28:18.253 INFO:tasks.workunit.client.0.smithi043.stdout:0/336: creat d2/d3/d18/d2b/d4f/f69 x:0 0 0 2023-12-08T20:28:18.255 INFO:tasks.workunit.client.0.smithi043.stdout:0/337: write d2/d3/d18/d2b/f37 [1473117,46309] 0 2023-12-08T20:28:18.255 INFO:tasks.workunit.client.0.smithi043.stdout:5/324: symlink d3/d7/d19/d3f/l5f 0 2023-12-08T20:28:18.256 INFO:tasks.workunit.client.0.smithi043.stdout:0/338: creat d2/d3/d6/f6a x:0 0 0 2023-12-08T20:28:18.256 INFO:tasks.workunit.client.0.smithi043.stdout:0/339: dread - d2/d3/d6/f68 zero size 2023-12-08T20:28:18.256 INFO:tasks.workunit.client.0.smithi043.stdout:5/325: creat d3/d7/d29/f60 x:0 0 0 2023-12-08T20:28:18.256 INFO:tasks.workunit.client.0.smithi043.stdout:5/326: chown f2 79590 1 2023-12-08T20:28:18.257 INFO:tasks.workunit.client.0.smithi043.stdout:5/327: fdatasync f2 0 2023-12-08T20:28:18.258 INFO:tasks.workunit.client.0.smithi043.stdout:0/340: mknod d2/d3/d6/d39/c6b 0 2023-12-08T20:28:18.258 INFO:tasks.workunit.client.0.smithi043.stdout:0/341: write d2/d3/d18/d2b/d4f/f5c [184982,102132] 0 2023-12-08T20:28:18.260 INFO:tasks.workunit.client.0.smithi043.stdout:2/395: dwrite d0/d26/d37/d38/f6e [0,4194304] 0 2023-12-08T20:28:18.260 INFO:tasks.workunit.client.0.smithi043.stdout:2/396: chown d0/db/d18/d3d 1 1 2023-12-08T20:28:18.260 INFO:tasks.workunit.client.0.smithi043.stdout:5/328: creat d3/d7/d21/f61 x:0 0 0 2023-12-08T20:28:18.261 INFO:tasks.workunit.client.0.smithi043.stdout:0/342: creat d2/d3/d6/f6c x:0 0 0 2023-12-08T20:28:18.262 INFO:tasks.workunit.client.0.smithi043.stdout:0/343: read - d2/d3/d18/d2b/d4f/f69 zero size 2023-12-08T20:28:18.267 INFO:tasks.workunit.client.0.smithi043.stdout:0/344: creat d2/d3/d18/d2b/d4f/d5f/f6d x:0 0 0 2023-12-08T20:28:18.268 INFO:tasks.workunit.client.0.smithi043.stdout:0/345: mknod d2/d3/d18/d2b/d4f/d3f/c6e 0 2023-12-08T20:28:18.269 INFO:tasks.workunit.client.0.smithi043.stdout:0/346: mknod d2/d3/d18/c6f 0 2023-12-08T20:28:18.270 INFO:tasks.workunit.client.0.smithi043.stdout:0/347: write d2/f8 [808212,21898] 0 2023-12-08T20:28:18.280 INFO:tasks.workunit.client.0.smithi043.stdout:2/397: dwrite d0/d26/d37/d38/f4f [0,4194304] 0 2023-12-08T20:28:18.281 INFO:tasks.workunit.client.0.smithi043.stdout:2/398: write d0/d26/f3b [671886,96977] 0 2023-12-08T20:28:18.281 INFO:tasks.workunit.client.0.smithi043.stdout:0/348: dread d2/d3/d18/f22 [0,4194304] 0 2023-12-08T20:28:18.284 INFO:tasks.workunit.client.0.smithi043.stdout:0/349: creat d2/d3/f70 x:0 0 0 2023-12-08T20:28:18.286 INFO:tasks.workunit.client.0.smithi043.stdout:0/350: rename d2/d3/d6/l11 to d2/d3/d18/d1e/l71 0 2023-12-08T20:28:18.288 INFO:tasks.workunit.client.0.smithi043.stdout:5/329: dwrite d3/d7/d29/f60 [0,4194304] 0 2023-12-08T20:28:18.290 INFO:tasks.workunit.client.0.smithi043.stdout:0/351: rename d2/d4/f30 to d2/d3/d6/d39/d63/f72 0 2023-12-08T20:28:18.290 INFO:tasks.workunit.client.0.smithi043.stdout:0/352: chown d2/d3/d18/d2b/d4f/d3f/c62 513 1 2023-12-08T20:28:18.294 INFO:tasks.workunit.client.0.smithi043.stdout:5/330: unlink d3/d7/d21/c33 0 2023-12-08T20:28:18.295 INFO:tasks.workunit.client.0.smithi043.stdout:0/353: rmdir d2/d61 39 2023-12-08T20:28:18.295 INFO:tasks.workunit.client.0.smithi043.stdout:2/399: dwrite d0/f9 [0,4194304] 0 2023-12-08T20:28:18.295 INFO:tasks.workunit.client.0.smithi043.stdout:0/354: write d2/d3/d18/d2b/d4f/f69 [975503,70100] 0 2023-12-08T20:28:18.295 INFO:tasks.workunit.client.0.smithi043.stdout:0/355: fsync d2/d3/f4e 0 2023-12-08T20:28:18.296 INFO:tasks.workunit.client.0.smithi043.stdout:0/356: write d2/d3/d6/f6a [419903,89694] 0 2023-12-08T20:28:18.296 INFO:tasks.workunit.client.0.smithi043.stdout:2/400: rename d0/d26/d37/d38/f47 to d0/db/d18/d66/d71/f87 0 2023-12-08T20:28:18.296 INFO:tasks.workunit.client.0.smithi043.stdout:2/401: chown d0/d20/l74 25688796 1 2023-12-08T20:28:18.296 INFO:tasks.workunit.client.0.smithi043.stdout:5/331: dread f2 [8388608,4194304] 0 2023-12-08T20:28:18.296 INFO:tasks.workunit.client.0.smithi043.stdout:5/332: chown d3/d7 71 1 2023-12-08T20:28:18.297 INFO:tasks.workunit.client.0.smithi043.stdout:5/333: dread - d3/d7/d19/d3f/d52/f5e zero size 2023-12-08T20:28:18.298 INFO:tasks.workunit.client.0.smithi043.stdout:0/357: unlink d2/d4/fc 0 2023-12-08T20:28:18.300 INFO:tasks.workunit.client.0.smithi043.stdout:5/334: creat d3/d7/d19/d3f/f62 x:0 0 0 2023-12-08T20:28:18.300 INFO:tasks.workunit.client.0.smithi043.stdout:5/335: dread - d3/d7/d19/d3f/f62 zero size 2023-12-08T20:28:18.301 INFO:tasks.workunit.client.0.smithi043.stdout:0/358: symlink d2/d3/d6/l73 0 2023-12-08T20:28:18.302 INFO:tasks.workunit.client.0.smithi043.stdout:5/336: rename d3/d7/d29/c3a to d3/d7/d19/d3f/c63 0 2023-12-08T20:28:18.303 INFO:tasks.workunit.client.0.smithi043.stdout:0/359: unlink d2/d3/d6/l42 0 2023-12-08T20:28:18.305 INFO:tasks.workunit.client.0.smithi043.stdout:5/337: rmdir d3/d7/d21/d57 0 2023-12-08T20:28:18.309 INFO:tasks.workunit.client.0.smithi043.stdout:0/360: mknod d2/d3/c74 0 2023-12-08T20:28:18.309 INFO:tasks.workunit.client.0.smithi043.stdout:0/361: creat d2/d3/d6/d39/d5e/f75 x:0 0 0 2023-12-08T20:28:18.309 INFO:tasks.workunit.client.0.smithi043.stdout:0/362: chown d2/d3/d6/c29 3 1 2023-12-08T20:28:18.309 INFO:tasks.workunit.client.0.smithi043.stdout:0/363: getdents d2/d61/d67 0 2023-12-08T20:28:18.309 INFO:tasks.workunit.client.0.smithi043.stdout:2/402: dread d0/f6c [0,4194304] 0 2023-12-08T20:28:18.309 INFO:tasks.workunit.client.0.smithi043.stdout:5/338: mknod d3/d7/de/c64 0 2023-12-08T20:28:18.310 INFO:tasks.workunit.client.0.smithi043.stdout:5/339: write d3/d7/de/f1d [3062095,36647] 0 2023-12-08T20:28:18.311 INFO:tasks.workunit.client.0.smithi043.stdout:6/275: sync 2023-12-08T20:28:18.311 INFO:tasks.workunit.client.0.smithi043.stdout:8/368: sync 2023-12-08T20:28:18.311 INFO:tasks.workunit.client.0.smithi043.stdout:3/278: sync 2023-12-08T20:28:18.311 INFO:tasks.workunit.client.0.smithi043.stdout:7/247: sync 2023-12-08T20:28:18.311 INFO:tasks.workunit.client.0.smithi043.stdout:7/248: chown d0/d6/l2d 1271 1 2023-12-08T20:28:18.311 INFO:tasks.workunit.client.0.smithi043.stdout:7/249: chown d0/d6/d17/l2f 934933603 1 2023-12-08T20:28:18.311 INFO:tasks.workunit.client.0.smithi043.stdout:9/354: sync 2023-12-08T20:28:18.311 INFO:tasks.workunit.client.0.smithi043.stdout:4/309: sync 2023-12-08T20:28:18.311 INFO:tasks.workunit.client.0.smithi043.stdout:1/366: sync 2023-12-08T20:28:18.311 INFO:tasks.workunit.client.0.smithi043.stdout:1/367: truncate d1/d6/f29 602138 0 2023-12-08T20:28:18.312 INFO:tasks.workunit.client.0.smithi043.stdout:9/355: write d0/d5e/f59 [281228,104936] 0 2023-12-08T20:28:18.312 INFO:tasks.workunit.client.0.smithi043.stdout:5/340: getdents d3/d7/de/d43 0 2023-12-08T20:28:18.312 INFO:tasks.workunit.client.0.smithi043.stdout:2/403: mknod d0/d20/d42/c88 0 2023-12-08T20:28:18.313 INFO:tasks.workunit.client.0.smithi043.stdout:0/364: fdatasync d2/d3/d6/f6a 0 2023-12-08T20:28:18.314 INFO:tasks.workunit.client.0.smithi043.stdout:0/365: chown d2/d3/d18/d2b/d4f/f3b 5628 1 2023-12-08T20:28:18.314 INFO:tasks.workunit.client.0.smithi043.stdout:6/276: creat d0/d2/de/d4a/d56/f63 x:0 0 0 2023-12-08T20:28:18.314 INFO:tasks.workunit.client.0.smithi043.stdout:0/366: readlink d2/d4/l12 0 2023-12-08T20:28:18.314 INFO:tasks.workunit.client.0.smithi043.stdout:6/277: truncate d0/d2/d14/d20/d49/f62 722655 0 2023-12-08T20:28:18.314 INFO:tasks.workunit.client.0.smithi043.stdout:1/368: dread d1/d6/f32 [0,4194304] 0 2023-12-08T20:28:18.315 INFO:tasks.workunit.client.0.smithi043.stdout:3/279: mknod d1/d9/d2d/d42/c51 0 2023-12-08T20:28:18.315 INFO:tasks.workunit.client.0.smithi043.stdout:3/280: chown d1/d9/c3c 1009615 1 2023-12-08T20:28:18.317 INFO:tasks.workunit.client.0.smithi043.stdout:7/250: rmdir d0/d2 39 2023-12-08T20:28:18.318 INFO:tasks.workunit.client.0.smithi043.stdout:8/369: symlink d2/de/d37/d5a/l70 0 2023-12-08T20:28:18.322 INFO:tasks.workunit.client.0.smithi043.stdout:2/404: creat d0/db/d18/d66/d71/f89 x:0 0 0 2023-12-08T20:28:18.328 INFO:tasks.workunit.client.0.smithi043.stdout:0/367: mknod d2/d3/d18/d2b/d4f/c76 0 2023-12-08T20:28:18.329 INFO:tasks.workunit.client.0.smithi043.stdout:6/278: rmdir d0/d2/d14/d2c/d22 39 2023-12-08T20:28:18.329 INFO:tasks.workunit.client.0.smithi043.stdout:1/369: mkdir d1/d16/d1c/d81 0 2023-12-08T20:28:18.329 INFO:tasks.workunit.client.0.smithi043.stdout:4/310: dwrite d1/f10 [0,4194304] 0 2023-12-08T20:28:18.329 INFO:tasks.workunit.client.0.smithi043.stdout:4/311: write d1/d14/d1d/f1e [8660229,71167] 0 2023-12-08T20:28:18.329 INFO:tasks.workunit.client.0.smithi043.stdout:3/281: unlink d1/d9/c3c 0 2023-12-08T20:28:18.329 INFO:tasks.workunit.client.0.smithi043.stdout:7/251: rename d0/d2/fc to d0/d2/d12/d19/d38/f55 0 2023-12-08T20:28:18.329 INFO:tasks.workunit.client.0.smithi043.stdout:8/370: mkdir d2/de/d29/d30/d71 0 2023-12-08T20:28:18.331 INFO:tasks.workunit.client.0.smithi043.stdout:0/368: unlink d2/d4/f35 0 2023-12-08T20:28:18.331 INFO:tasks.workunit.client.0.smithi043.stdout:0/369: write d2/d4/f4b [1977251,42926] 0 2023-12-08T20:28:18.331 INFO:tasks.workunit.client.0.smithi043.stdout:0/370: truncate d2/d3/d18/d2b/f41 659407 0 2023-12-08T20:28:18.332 INFO:tasks.workunit.client.0.smithi043.stdout:9/356: dwrite d0/d21/f4f [0,4194304] 0 2023-12-08T20:28:18.334 INFO:tasks.workunit.client.0.smithi043.stdout:1/370: mkdir d1/d16/d21/d25/d3e/d82 0 2023-12-08T20:28:18.335 INFO:tasks.workunit.client.0.smithi043.stdout:4/312: symlink d1/d14/d25/l6d 0 2023-12-08T20:28:18.337 INFO:tasks.workunit.client.0.smithi043.stdout:3/282: unlink d1/d9/df/c11 0 2023-12-08T20:28:18.337 INFO:tasks.workunit.client.0.smithi043.stdout:3/283: readlink d1/d9/l23 0 2023-12-08T20:28:18.339 INFO:tasks.workunit.client.0.smithi043.stdout:7/252: getdents d0/d2/d12/d19 0 2023-12-08T20:28:18.341 INFO:tasks.workunit.client.0.smithi043.stdout:8/371: mknod d2/d27/d2d/d31/d4f/c72 0 2023-12-08T20:28:18.344 INFO:tasks.workunit.client.0.smithi043.stdout:0/371: rename d2/c58 to d2/d3/d18/d2b/d4f/c77 0 2023-12-08T20:28:18.344 INFO:tasks.workunit.client.0.smithi043.stdout:0/372: write d2/d4/f3d [4958737,42900] 0 2023-12-08T20:28:18.344 INFO:tasks.workunit.client.0.smithi043.stdout:0/373: write d2/d3/d18/d2b/f41 [1619842,53823] 0 2023-12-08T20:28:18.344 INFO:tasks.workunit.client.0.smithi043.stdout:0/374: write d2/d3/d18/d2b/d4f/f3b [767831,24589] 0 2023-12-08T20:28:18.344 INFO:tasks.workunit.client.0.smithi043.stdout:0/375: write d2/d3/d6/d39/d5e/f75 [496065,29801] 0 2023-12-08T20:28:18.347 INFO:tasks.workunit.client.0.smithi043.stdout:2/405: dwrite d0/db/d18/d3d/f40 [0,4194304] 0 2023-12-08T20:28:18.348 INFO:tasks.workunit.client.0.smithi043.stdout:1/371: mkdir d1/d16/d30/d6e/d83 0 2023-12-08T20:28:18.348 INFO:tasks.workunit.client.0.smithi043.stdout:1/372: truncate d1/d16/d21/d42/f5c 4206066 0 2023-12-08T20:28:18.348 INFO:tasks.workunit.client.0.smithi043.stdout:1/373: stat d1/d16/d1c/d4e 0 2023-12-08T20:28:18.348 INFO:tasks.workunit.client.0.smithi043.stdout:4/313: creat d1/d14/d1d/f6e x:0 0 0 2023-12-08T20:28:18.348 INFO:tasks.workunit.client.0.smithi043.stdout:4/314: fdatasync d1/d14/d25/f29 0 2023-12-08T20:28:18.349 INFO:tasks.workunit.client.0.smithi043.stdout:4/315: truncate d1/d14/f26 9146421 0 2023-12-08T20:28:18.349 INFO:tasks.workunit.client.0.smithi043.stdout:7/253: truncate d0/d6/d8/f9 1118746 0 2023-12-08T20:28:18.356 INFO:tasks.workunit.client.0.smithi043.stdout:8/372: symlink d2/d6f/l73 0 2023-12-08T20:28:18.356 INFO:tasks.workunit.client.0.smithi043.stdout:0/376: rmdir d2/d3/d6/d39 39 2023-12-08T20:28:18.356 INFO:tasks.workunit.client.0.smithi043.stdout:0/377: fdatasync d2/d3/d18/d2b/d4f/f69 0 2023-12-08T20:28:18.356 INFO:tasks.workunit.client.0.smithi043.stdout:2/406: rename d0/d26/d37/d38/f86 to d0/d81/f8a 0 2023-12-08T20:28:18.356 INFO:tasks.workunit.client.0.smithi043.stdout:4/316: mknod d1/d14/d25/d39/d3d/d40/c6f 0 2023-12-08T20:28:18.356 INFO:tasks.workunit.client.0.smithi043.stdout:1/374: mknod d1/d16/d21/d25/d3e/d77/c84 0 2023-12-08T20:28:18.356 INFO:tasks.workunit.client.0.smithi043.stdout:0/378: getdents d2/d3/d18/d2b/d4f/d5f 0 2023-12-08T20:28:18.357 INFO:tasks.workunit.client.0.smithi043.stdout:7/254: mknod d0/d2/c56 0 2023-12-08T20:28:18.360 INFO:tasks.workunit.client.0.smithi043.stdout:4/317: symlink d1/d14/d25/d39/d3d/d40/l70 0 2023-12-08T20:28:18.361 INFO:tasks.workunit.client.0.smithi043.stdout:1/375: rename d1/f2c to d1/d16/d21/d25/d35/f85 0 2023-12-08T20:28:18.361 INFO:tasks.workunit.client.0.smithi043.stdout:0/379: mknod d2/d4/c78 0 2023-12-08T20:28:18.361 INFO:tasks.workunit.client.0.smithi043.stdout:1/376: mkdir d1/d16/d86 0 2023-12-08T20:28:18.361 INFO:tasks.workunit.client.0.smithi043.stdout:0/380: truncate d2/d3/d18/d2b/f36 1921660 0 2023-12-08T20:28:18.363 INFO:tasks.workunit.client.0.smithi043.stdout:3/284: dwrite d1/d9/f4e [0,4194304] 0 2023-12-08T20:28:18.363 INFO:tasks.workunit.client.0.smithi043.stdout:2/407: dread d0/d20/f4d [0,4194304] 0 2023-12-08T20:28:18.363 INFO:tasks.workunit.client.0.smithi043.stdout:2/408: chown d0/f17 2428 1 2023-12-08T20:28:18.363 INFO:tasks.workunit.client.0.smithi043.stdout:2/409: truncate d0/db/f63 609497 0 2023-12-08T20:28:18.364 INFO:tasks.workunit.client.0.smithi043.stdout:6/279: dwrite d0/d2/de/f40 [0,4194304] 0 2023-12-08T20:28:18.365 INFO:tasks.workunit.client.0.smithi043.stdout:1/377: creat d1/d16/d21/d60/f87 x:0 0 0 2023-12-08T20:28:18.365 INFO:tasks.workunit.client.0.smithi043.stdout:0/381: mkdir d2/d3/d18/d2b/d4f/d5f/d79 0 2023-12-08T20:28:18.366 INFO:tasks.workunit.client.0.smithi043.stdout:9/357: dwrite d0/d3d/d4b/f71 [0,4194304] 0 2023-12-08T20:28:18.373 INFO:tasks.workunit.client.0.smithi043.stdout:6/280: rmdir d0/d2/de/d4a 39 2023-12-08T20:28:18.373 INFO:tasks.workunit.client.0.smithi043.stdout:6/281: truncate d0/d2/f12 2834747 0 2023-12-08T20:28:18.373 INFO:tasks.workunit.client.0.smithi043.stdout:1/378: symlink d1/d16/d1c/d81/l88 0 2023-12-08T20:28:18.373 INFO:tasks.workunit.client.0.smithi043.stdout:2/410: mkdir d0/db/d18/d8b 0 2023-12-08T20:28:18.375 INFO:tasks.workunit.client.0.smithi043.stdout:9/358: read d0/d5e/f3c [3343769,67375] 0 2023-12-08T20:28:18.375 INFO:tasks.workunit.client.0.smithi043.stdout:3/285: mkdir d1/d9/d38/d4f/d52 0 2023-12-08T20:28:18.376 INFO:tasks.workunit.client.0.smithi043.stdout:1/379: creat d1/d16/d30/d4f/f89 x:0 0 0 2023-12-08T20:28:18.377 INFO:tasks.workunit.client.0.smithi043.stdout:2/411: link d0/db/d18/f22 d0/d26/d37/d38/f8c 0 2023-12-08T20:28:18.381 INFO:tasks.workunit.client.0.smithi043.stdout:3/286: rename d1/f1e to d1/d1c/f53 0 2023-12-08T20:28:18.384 INFO:tasks.workunit.client.0.smithi043.stdout:1/380: rmdir d1/d16/d1c/d4e 39 2023-12-08T20:28:18.384 INFO:tasks.workunit.client.0.smithi043.stdout:1/381: write d1/d16/f18 [725309,32903] 0 2023-12-08T20:28:18.390 INFO:tasks.workunit.client.0.smithi043.stdout:3/287: mknod d1/d9/df/c54 0 2023-12-08T20:28:18.391 INFO:tasks.workunit.client.0.smithi043.stdout:1/382: creat d1/d16/d30/d4f/d54/f8a x:0 0 0 2023-12-08T20:28:18.391 INFO:tasks.workunit.client.0.smithi043.stdout:1/383: read - d1/d16/d1c/d4e/f7b zero size 2023-12-08T20:28:18.393 INFO:tasks.workunit.client.0.smithi043.stdout:8/373: dwrite d2/de/d29/d30/f49 [0,4194304] 0 2023-12-08T20:28:18.393 INFO:tasks.workunit.client.0.smithi043.stdout:8/374: write d2/d27/f6d [151672,95447] 0 2023-12-08T20:28:18.394 INFO:tasks.workunit.client.0.smithi043.stdout:8/375: stat d2/d27/d2d/d31/d4f/c67 0 2023-12-08T20:28:18.394 INFO:tasks.workunit.client.0.smithi043.stdout:9/359: dread d0/d5e/d37/f54 [0,4194304] 0 2023-12-08T20:28:18.394 INFO:tasks.workunit.client.0.smithi043.stdout:3/288: symlink d1/d9/d2d/l55 0 2023-12-08T20:28:18.394 INFO:tasks.workunit.client.0.smithi043.stdout:3/289: fdatasync d1/d9/f32 0 2023-12-08T20:28:18.394 INFO:tasks.workunit.client.0.smithi043.stdout:1/384: unlink d1/d16/d1c/c76 0 2023-12-08T20:28:18.395 INFO:tasks.workunit.client.0.smithi043.stdout:3/290: chown d1/d9/df/f47 2 1 2023-12-08T20:28:18.395 INFO:tasks.workunit.client.0.smithi043.stdout:7/255: dwrite d0/d2/d12/f51 [0,4194304] 0 2023-12-08T20:28:18.404 INFO:tasks.workunit.client.0.smithi043.stdout:8/376: mkdir d2/d27/d2d/d31/d74 0 2023-12-08T20:28:18.408 INFO:tasks.workunit.client.0.smithi043.stdout:9/360: unlink d0/f16 0 2023-12-08T20:28:18.411 INFO:tasks.workunit.client.0.smithi043.stdout:1/385: dread d1/d16/d48/f56 [0,4194304] 0 2023-12-08T20:28:18.412 INFO:tasks.workunit.client.0.smithi043.stdout:8/377: symlink d2/d20/l75 0 2023-12-08T20:28:18.413 INFO:tasks.workunit.client.0.smithi043.stdout:9/361: getdents d0/d3d/d4b 0 2023-12-08T20:28:18.424 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:18 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:18.424 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:18 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:18.424 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:18 smithi111 ceph-mon[121341]: Reconfiguring node-exporter.smithi111 (dependencies changed)... 2023-12-08T20:28:18.424 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:18 smithi111 ceph-mon[121341]: Reconfiguring daemon node-exporter.smithi111 on smithi111 2023-12-08T20:28:18.424 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:18 smithi111 ceph-mon[121341]: pgmap v30: 65 pgs: 65 active+clean; 1.9 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 21 MiB/s rd, 45 MiB/s wr, 131 op/s 2023-12-08T20:28:18.425 INFO:tasks.workunit.client.0.smithi043.stdout:4/318: dwrite d1/d14/d25/d39/d3f/d3c/d41/f43 [0,4194304] 0 2023-12-08T20:28:18.425 INFO:tasks.workunit.client.0.smithi043.stdout:6/282: dwrite d0/d2/f28 [0,4194304] 0 2023-12-08T20:28:18.427 INFO:tasks.workunit.client.0.smithi043.stdout:0/382: dwrite d2/d3/d6/d39/d5e/f75 [0,4194304] 0 2023-12-08T20:28:18.429 INFO:tasks.workunit.client.0.smithi043.stdout:2/412: dwrite d0/d2b/f5b [0,4194304] 0 2023-12-08T20:28:18.430 INFO:tasks.workunit.client.0.smithi043.stdout:3/291: dwrite d1/f18 [4194304,4194304] 0 2023-12-08T20:28:18.431 INFO:tasks.workunit.client.0.smithi043.stdout:6/283: write d0/d2/f12 [861470,61429] 0 2023-12-08T20:28:18.431 INFO:tasks.workunit.client.0.smithi043.stdout:1/386: dwrite d1/d16/d21/d25/d35/f73 [0,4194304] 0 2023-12-08T20:28:18.431 INFO:tasks.workunit.client.0.smithi043.stdout:8/378: creat d2/de/d29/d30/d71/f76 x:0 0 0 2023-12-08T20:28:18.431 INFO:tasks.workunit.client.0.smithi043.stdout:8/379: chown d2/de/d37/d5a/l70 2 1 2023-12-08T20:28:18.431 INFO:tasks.workunit.client.0.smithi043.stdout:8/380: chown d2/c48 11713 1 2023-12-08T20:28:18.433 INFO:tasks.workunit.client.0.smithi043.stdout:4/319: getdents d1/d14/d25/d39/d3d/d40/d67 0 2023-12-08T20:28:18.433 INFO:tasks.workunit.client.0.smithi043.stdout:4/320: stat d1/d14/d1d/f6e 0 2023-12-08T20:28:18.433 INFO:tasks.workunit.client.0.smithi043.stdout:4/321: write d1/d14/d25/d39/d3d/d40/f69 [859484,118622] 0 2023-12-08T20:28:18.433 INFO:tasks.workunit.client.0.smithi043.stdout:9/362: dwrite d0/d21/f4f [0,4194304] 0 2023-12-08T20:28:18.440 INFO:tasks.workunit.client.0.smithi043.stdout:0/383: dread d2/d3/f1a [0,4194304] 0 2023-12-08T20:28:18.441 INFO:tasks.workunit.client.0.smithi043.stdout:0/384: read d2/d3/d18/d2b/d4f/f3b [669753,53395] 0 2023-12-08T20:28:18.441 INFO:tasks.workunit.client.0.smithi043.stdout:0/385: chown d2/d3/d18/f22 5988 1 2023-12-08T20:28:18.441 INFO:tasks.workunit.client.0.smithi043.stdout:0/386: dread - d2/d3/d18/d2b/d4f/f49 zero size 2023-12-08T20:28:18.441 INFO:tasks.workunit.client.0.smithi043.stdout:0/387: chown d2/d3/d18/d1e/c56 1 1 2023-12-08T20:28:18.441 INFO:tasks.workunit.client.0.smithi043.stdout:0/388: dread - d2/d3/d6/d39/d63/f72 zero size 2023-12-08T20:28:18.441 INFO:tasks.workunit.client.0.smithi043.stdout:0/389: stat d2/d3/d18/d2b/d4f/f5c 0 2023-12-08T20:28:18.444 INFO:tasks.workunit.client.0.smithi043.stdout:8/381: dread d2/de/f13 [0,4194304] 0 2023-12-08T20:28:18.446 INFO:tasks.workunit.client.0.smithi043.stdout:6/284: rename d0/d2/d14/f30 to d0/d2/d14/d20/d49/f64 0 2023-12-08T20:28:18.450 INFO:tasks.workunit.client.0.smithi043.stdout:4/322: creat d1/d14/d25/d39/f71 x:0 0 0 2023-12-08T20:28:18.450 INFO:tasks.workunit.client.0.smithi043.stdout:1/387: mknod d1/d16/d30/d4f/d54/c8b 0 2023-12-08T20:28:18.450 INFO:tasks.workunit.client.0.smithi043.stdout:1/388: chown d1/d16/d30/d6e 1681487 1 2023-12-08T20:28:18.450 INFO:tasks.workunit.client.0.smithi043.stdout:9/363: creat d0/d21/f74 x:0 0 0 2023-12-08T20:28:18.452 INFO:tasks.workunit.client.0.smithi043.stdout:2/413: dwrite d0/fa [0,4194304] 0 2023-12-08T20:28:18.452 INFO:tasks.workunit.client.0.smithi043.stdout:8/382: link d2/de/d29/f66 d2/de/f77 0 2023-12-08T20:28:18.456 INFO:tasks.workunit.client.0.smithi043.stdout:6/285: write d0/d2/d14/d2c/f3b [3981591,41730] 0 2023-12-08T20:28:18.456 INFO:tasks.workunit.client.0.smithi043.stdout:6/286: truncate d0/d2/f4d 4342 0 2023-12-08T20:28:18.456 INFO:tasks.workunit.client.0.smithi043.stdout:1/389: dread d1/d16/d21/d25/d35/f85 [0,4194304] 0 2023-12-08T20:28:18.470 INFO:tasks.workunit.client.0.smithi043.stdout:0/390: dwrite d2/d3/d18/d2b/f37 [0,4194304] 0 2023-12-08T20:28:18.471 INFO:tasks.workunit.client.0.smithi043.stdout:3/292: dwrite d1/d9/df/f3a [0,4194304] 0 2023-12-08T20:28:18.471 INFO:tasks.workunit.client.0.smithi043.stdout:3/293: stat d1/d1c/d2c/f3e 0 2023-12-08T20:28:18.473 INFO:tasks.workunit.client.0.smithi043.stdout:3/294: mkdir d1/d9/d38/d30/d56 0 2023-12-08T20:28:18.475 INFO:tasks.workunit.client.0.smithi043.stdout:3/295: creat d1/d1c/d29/f57 x:0 0 0 2023-12-08T20:28:18.476 INFO:tasks.workunit.client.0.smithi043.stdout:4/323: dwrite d1/d14/d25/d28/f2b [0,4194304] 0 2023-12-08T20:28:18.478 INFO:tasks.workunit.client.0.smithi043.stdout:3/296: unlink d1/d9/df/c20 0 2023-12-08T20:28:18.478 INFO:tasks.workunit.client.0.smithi043.stdout:3/297: chown d1/d1c/d29/l4d 0 1 2023-12-08T20:28:18.480 INFO:tasks.workunit.client.0.smithi043.stdout:4/324: write d1/f1c [943247,31270] 0 2023-12-08T20:28:18.481 INFO:tasks.workunit.client.0.smithi043.stdout:3/298: rename d1/d9/f1f to d1/d25/d2a/d45/f58 0 2023-12-08T20:28:18.481 INFO:tasks.workunit.client.0.smithi043.stdout:3/299: chown d1/c4 1157 1 2023-12-08T20:28:18.482 INFO:tasks.workunit.client.0.smithi043.stdout:2/414: dwrite d0/d20/f76 [0,4194304] 0 2023-12-08T20:28:18.484 INFO:tasks.workunit.client.0.smithi043.stdout:4/325: unlink d1/d14/d25/c38 0 2023-12-08T20:28:18.485 INFO:tasks.workunit.client.0.smithi043.stdout:4/326: fsync d1/f11 0 2023-12-08T20:28:18.485 INFO:tasks.workunit.client.0.smithi043.stdout:4/327: chown d1/d14/d25/d28/f2b 973057 1 2023-12-08T20:28:18.485 INFO:tasks.workunit.client.0.smithi043.stdout:4/328: write d1/d14/f31 [1724246,94117] 0 2023-12-08T20:28:18.485 INFO:tasks.workunit.client.0.smithi043.stdout:4/329: chown d1/l27 3217916 1 2023-12-08T20:28:18.485 INFO:tasks.workunit.client.0.smithi043.stdout:3/300: creat d1/d9/d38/d30/f59 x:0 0 0 2023-12-08T20:28:18.486 INFO:tasks.workunit.client.0.smithi043.stdout:4/330: mknod d1/d14/d25/d39/d3d/d40/c72 0 2023-12-08T20:28:18.487 INFO:tasks.workunit.client.0.smithi043.stdout:3/301: mkdir d1/d9/d38/d4f/d5a 0 2023-12-08T20:28:18.487 INFO:tasks.workunit.client.0.smithi043.stdout:3/302: chown d1/d9/d38/d30/f40 1 1 2023-12-08T20:28:18.489 INFO:tasks.workunit.client.0.smithi043.stdout:4/331: creat d1/f73 x:0 0 0 2023-12-08T20:28:18.491 INFO:tasks.workunit.client.0.smithi043.stdout:4/332: mknod d1/d14/d25/d39/d3f/d59/c74 0 2023-12-08T20:28:18.494 INFO:tasks.workunit.client.0.smithi043.stdout:4/333: unlink d1/d14/d25/d28/l44 0 2023-12-08T20:28:18.494 INFO:tasks.workunit.client.0.smithi043.stdout:4/334: dread - d1/f73 zero size 2023-12-08T20:28:18.499 INFO:tasks.workunit.client.0.smithi043.stdout:2/415: dwrite d0/db/d18/f22 [0,4194304] 0 2023-12-08T20:28:18.500 INFO:tasks.workunit.client.0.smithi043.stdout:2/416: symlink d0/d2b/d4e/d79/l8d 0 2023-12-08T20:28:18.501 INFO:tasks.workunit.client.0.smithi043.stdout:2/417: rename d0/db/d18/d3d/f56 to d0/d81/f8e 0 2023-12-08T20:28:18.503 INFO:tasks.workunit.client.0.smithi043.stdout:2/418: unlink d0/d2b/f68 0 2023-12-08T20:28:18.503 INFO:tasks.workunit.client.0.smithi043.stdout:2/419: mknod d0/d26/d37/d38/c8f 0 2023-12-08T20:28:18.504 INFO:tasks.workunit.client.0.smithi043.stdout:2/420: creat d0/db/d18/d8b/f90 x:0 0 0 2023-12-08T20:28:18.504 INFO:tasks.workunit.client.0.smithi043.stdout:2/421: write d0/f28 [4843866,46866] 0 2023-12-08T20:28:18.505 INFO:tasks.workunit.client.0.smithi043.stdout:2/422: symlink d0/l91 0 2023-12-08T20:28:18.505 INFO:tasks.workunit.client.0.smithi043.stdout:8/383: dwrite d2/de/f4d [4194304,4194304] 0 2023-12-08T20:28:18.508 INFO:tasks.workunit.client.0.smithi043.stdout:8/384: write d2/de/f26 [4184795,50680] 0 2023-12-08T20:28:18.509 INFO:tasks.workunit.client.0.smithi043.stdout:0/391: dwrite d2/d4/f66 [4194304,4194304] 0 2023-12-08T20:28:18.509 INFO:tasks.workunit.client.0.smithi043.stdout:1/390: dwrite d1/fb [0,4194304] 0 2023-12-08T20:28:18.509 INFO:tasks.workunit.client.0.smithi043.stdout:1/391: chown d1/d16/d21/d25 26723 1 2023-12-08T20:28:18.509 INFO:tasks.workunit.client.0.smithi043.stdout:1/392: read - d1/d6/f68 zero size 2023-12-08T20:28:18.510 INFO:tasks.workunit.client.0.smithi043.stdout:6/287: dwrite d0/d2/d14/d20/d49/f4f [0,4194304] 0 2023-12-08T20:28:18.510 INFO:tasks.workunit.client.0.smithi043.stdout:6/288: chown d0/c15 84 1 2023-12-08T20:28:18.510 INFO:tasks.workunit.client.0.smithi043.stdout:3/303: dwrite d1/d9/d38/f3d [0,4194304] 0 2023-12-08T20:28:18.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:18 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:18.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:18 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:18.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:18 smithi043 ceph-mon[111966]: Reconfiguring node-exporter.smithi111 (dependencies changed)... 2023-12-08T20:28:18.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:18 smithi043 ceph-mon[111966]: Reconfiguring daemon node-exporter.smithi111 on smithi111 2023-12-08T20:28:18.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:18 smithi043 ceph-mon[111966]: pgmap v30: 65 pgs: 65 active+clean; 1.9 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 21 MiB/s rd, 45 MiB/s wr, 131 op/s 2023-12-08T20:28:18.514 INFO:tasks.workunit.client.0.smithi043.stdout:8/385: read d2/d27/d2d/d31/f36 [2556791,71938] 0 2023-12-08T20:28:18.515 INFO:tasks.workunit.client.0.smithi043.stdout:8/386: stat d2/d27/d2d/f3c 0 2023-12-08T20:28:18.515 INFO:tasks.workunit.client.0.smithi043.stdout:8/387: stat d2/de/d29/d30/f49 0 2023-12-08T20:28:18.515 INFO:tasks.workunit.client.0.smithi043.stdout:1/393: creat d1/d16/d21/d25/d3e/d77/f8c x:0 0 0 2023-12-08T20:28:18.519 INFO:tasks.workunit.client.0.smithi043.stdout:6/289: unlink d0/d2/d14/d20/f44 0 2023-12-08T20:28:18.519 INFO:tasks.workunit.client.0.smithi043.stdout:6/290: truncate d0/d2/d14/d20/ff 5206196 0 2023-12-08T20:28:18.519 INFO:tasks.workunit.client.0.smithi043.stdout:6/291: truncate d0/f34 92687 0 2023-12-08T20:28:18.519 INFO:tasks.workunit.client.0.smithi043.stdout:3/304: rmdir d1/d9/df/d41 39 2023-12-08T20:28:18.520 INFO:tasks.workunit.client.0.smithi043.stdout:8/388: creat d2/d20/f78 x:0 0 0 2023-12-08T20:28:18.521 INFO:tasks.workunit.client.0.smithi043.stdout:0/392: dread d2/d3/d18/f2a [0,4194304] 0 2023-12-08T20:28:18.522 INFO:tasks.workunit.client.0.smithi043.stdout:0/393: dread - d2/d3/d18/d1e/d53/f5d zero size 2023-12-08T20:28:18.522 INFO:tasks.workunit.client.0.smithi043.stdout:1/394: mkdir d1/d16/d48/d8d 0 2023-12-08T20:28:18.522 INFO:tasks.workunit.client.0.smithi043.stdout:2/423: dwrite d0/d20/d42/d49/f69 [0,4194304] 0 2023-12-08T20:28:18.522 INFO:tasks.workunit.client.0.smithi043.stdout:8/389: dread d2/de/d29/d59/f65 [0,4194304] 0 2023-12-08T20:28:18.522 INFO:tasks.workunit.client.0.smithi043.stdout:8/390: dread - d2/de/d29/f66 zero size 2023-12-08T20:28:18.524 INFO:tasks.workunit.client.0.smithi043.stdout:0/394: creat d2/d3/d18/d2b/d4f/f7a x:0 0 0 2023-12-08T20:28:18.527 INFO:tasks.workunit.client.0.smithi043.stdout:2/424: rmdir d0/db 39 2023-12-08T20:28:18.529 INFO:tasks.workunit.client.0.smithi043.stdout:1/395: dread d1/d16/f4d [0,4194304] 0 2023-12-08T20:28:18.529 INFO:tasks.workunit.client.0.smithi043.stdout:0/395: mknod d2/d3/d18/d2b/d4f/c7b 0 2023-12-08T20:28:18.531 INFO:tasks.workunit.client.0.smithi043.stdout:2/425: mkdir d0/db/d18/d3d/d92 0 2023-12-08T20:28:18.531 INFO:tasks.workunit.client.0.smithi043.stdout:2/426: write d0/db/d18/d3d/f40 [5273132,15170] 0 2023-12-08T20:28:18.532 INFO:tasks.workunit.client.0.smithi043.stdout:1/396: symlink d1/d16/d21/d25/l8e 0 2023-12-08T20:28:18.536 INFO:tasks.workunit.client.0.smithi043.stdout:8/391: dread d2/de/f26 [0,4194304] 0 2023-12-08T20:28:18.537 INFO:tasks.workunit.client.0.smithi043.stdout:8/392: write d2/de/f77 [907926,40141] 0 2023-12-08T20:28:18.539 INFO:tasks.workunit.client.0.smithi043.stdout:2/427: dread d0/d81/f8e [0,4194304] 0 2023-12-08T20:28:18.541 INFO:tasks.workunit.client.0.smithi043.stdout:8/393: mknod d2/d27/c79 0 2023-12-08T20:28:18.542 INFO:tasks.workunit.client.0.smithi043.stdout:6/292: dwrite d0/f35 [4194304,4194304] 0 2023-12-08T20:28:18.543 INFO:tasks.workunit.client.0.smithi043.stdout:2/428: mkdir d0/d2b/d4e/d93 0 2023-12-08T20:28:18.545 INFO:tasks.workunit.client.0.smithi043.stdout:8/394: link d2/d20/f2b d2/d27/d2d/f7a 0 2023-12-08T20:28:18.545 INFO:tasks.workunit.client.0.smithi043.stdout:8/395: dread - d2/de/d37/d5a/f62 zero size 2023-12-08T20:28:18.549 INFO:tasks.workunit.client.0.smithi043.stdout:3/305: dwrite d1/d9/f19 [8388608,4194304] 0 2023-12-08T20:28:18.549 INFO:tasks.workunit.client.0.smithi043.stdout:6/293: read d0/d2/d14/d2c/d22/d3f/d45/f51 [2612115,99695] 0 2023-12-08T20:28:18.550 INFO:tasks.workunit.client.0.smithi043.stdout:6/294: write d0/d2/d14/f18 [2511544,11500] 0 2023-12-08T20:28:18.550 INFO:tasks.workunit.client.0.smithi043.stdout:6/295: truncate d0/f34 310104 0 2023-12-08T20:28:18.552 INFO:tasks.workunit.client.0.smithi043.stdout:3/306: dread d1/d9/f48 [0,4194304] 0 2023-12-08T20:28:18.552 INFO:tasks.workunit.client.0.smithi043.stdout:3/307: fdatasync d1/d9/df/f47 0 2023-12-08T20:28:18.552 INFO:tasks.workunit.client.0.smithi043.stdout:2/429: truncate d0/db/f19 2474061 0 2023-12-08T20:28:18.553 INFO:tasks.workunit.client.0.smithi043.stdout:3/308: read d1/d9/f4e [141373,64273] 0 2023-12-08T20:28:18.553 INFO:tasks.workunit.client.0.smithi043.stdout:3/309: stat d1/d25/d2a 0 2023-12-08T20:28:18.553 INFO:tasks.workunit.client.0.smithi043.stdout:3/310: write d1/d25/f31 [769506,107009] 0 2023-12-08T20:28:18.554 INFO:tasks.workunit.client.0.smithi043.stdout:0/396: dwrite d2/d3/d18/f2a [0,4194304] 0 2023-12-08T20:28:18.555 INFO:tasks.workunit.client.0.smithi043.stdout:6/296: getdents d0 0 2023-12-08T20:28:18.556 INFO:tasks.workunit.client.0.smithi043.stdout:2/430: symlink d0/d26/d37/l94 0 2023-12-08T20:28:18.557 INFO:tasks.workunit.client.0.smithi043.stdout:3/311: creat d1/d9/df/d41/f5b x:0 0 0 2023-12-08T20:28:18.563 INFO:tasks.workunit.client.0.smithi043.stdout:6/297: dread d0/f35 [0,4194304] 0 2023-12-08T20:28:18.564 INFO:tasks.workunit.client.0.smithi043.stdout:8/396: dwrite d2/f21 [0,4194304] 0 2023-12-08T20:28:18.566 INFO:tasks.workunit.client.0.smithi043.stdout:3/312: dread d1/d9/df/f17 [0,4194304] 0 2023-12-08T20:28:18.568 INFO:tasks.workunit.client.0.smithi043.stdout:3/313: write d1/d9/df/f17 [3253001,129599] 0 2023-12-08T20:28:18.568 INFO:tasks.workunit.client.0.smithi043.stdout:0/397: symlink d2/d3/d18/d2b/l7c 0 2023-12-08T20:28:18.569 INFO:tasks.workunit.client.0.smithi043.stdout:2/431: mknod d0/d2b/d4e/d79/c95 0 2023-12-08T20:28:18.569 INFO:tasks.workunit.client.0.smithi043.stdout:2/432: chown d0/d2b/f5b 248326252 1 2023-12-08T20:28:18.569 INFO:tasks.workunit.client.0.smithi043.stdout:2/433: write d0/db/d18/f4b [14618,13292] 0 2023-12-08T20:28:18.570 INFO:tasks.workunit.client.0.smithi043.stdout:6/298: creat d0/d2/d14/d2c/f65 x:0 0 0 2023-12-08T20:28:18.570 INFO:tasks.workunit.client.0.smithi043.stdout:6/299: write d0/d2/d29/f52 [323164,129709] 0 2023-12-08T20:28:18.570 INFO:tasks.workunit.client.0.smithi043.stdout:6/300: dread - d0/d2/d14/d20/d3c/f55 zero size 2023-12-08T20:28:18.570 INFO:tasks.workunit.client.0.smithi043.stdout:6/301: write d0/d2/de/d4a/d56/f5c [705421,51410] 0 2023-12-08T20:28:18.571 INFO:tasks.workunit.client.0.smithi043.stdout:6/302: write d0/f35 [4373350,95023] 0 2023-12-08T20:28:18.572 INFO:tasks.workunit.client.0.smithi043.stdout:8/397: link d2/de/d29/d30/c4a d2/de/d29/d30/c7b 0 2023-12-08T20:28:18.574 INFO:tasks.workunit.client.0.smithi043.stdout:3/314: link d1/d1c/d2c/f3e d1/d1c/d29/f5c 0 2023-12-08T20:28:18.576 INFO:tasks.workunit.client.0.smithi043.stdout:0/398: mkdir d2/d3/d18/d1e/d53/d7d 0 2023-12-08T20:28:18.576 INFO:tasks.workunit.client.0.smithi043.stdout:2/434: mknod d0/c96 0 2023-12-08T20:28:18.576 INFO:tasks.workunit.client.0.smithi043.stdout:8/398: write d2/f3e [1232475,72899] 0 2023-12-08T20:28:18.576 INFO:tasks.workunit.client.0.smithi043.stdout:8/399: chown d2/de/d37/d5a/f63 3566 1 2023-12-08T20:28:18.576 INFO:tasks.workunit.client.0.smithi043.stdout:8/400: read - d2/d27/d2d/f55 zero size 2023-12-08T20:28:18.583 INFO:tasks.workunit.client.0.smithi043.stdout:3/315: link d1/d9/d38/d30/f59 d1/d9/d38/d33/f5d 0 2023-12-08T20:28:18.584 INFO:tasks.workunit.client.0.smithi043.stdout:0/399: rmdir d2/d3/d18/d1e 39 2023-12-08T20:28:18.584 INFO:tasks.workunit.client.0.smithi043.stdout:8/401: mkdir d2/de/d29/d30/d7c 0 2023-12-08T20:28:18.585 INFO:tasks.workunit.client.0.smithi043.stdout:3/316: rename d1/d9/df/d41/d34 to d1/d25/d2a/d5e 0 2023-12-08T20:28:18.586 INFO:tasks.workunit.client.0.smithi043.stdout:0/400: link d2/d3/c4c d2/d3/d6/d39/c7e 0 2023-12-08T20:28:18.595 INFO:tasks.workunit.client.0.smithi043.stdout:6/303: dwrite d0/d2/f3e [0,4194304] 0 2023-12-08T20:28:18.596 INFO:tasks.workunit.client.0.smithi043.stdout:6/304: write d0/d2/d29/f61 [1116044,113545] 0 2023-12-08T20:28:18.596 INFO:tasks.workunit.client.0.smithi043.stdout:5/341: sync 2023-12-08T20:28:18.596 INFO:tasks.workunit.client.0.smithi043.stdout:3/317: getdents d1/d25/d2a/d5e 0 2023-12-08T20:28:18.596 INFO:tasks.workunit.client.0.smithi043.stdout:0/401: truncate d2/d3/d18/d2b/d4f/f69 940169 0 2023-12-08T20:28:18.596 INFO:tasks.workunit.client.0.smithi043.stdout:0/402: chown d2/d4/l46 2627 1 2023-12-08T20:28:18.596 INFO:tasks.workunit.client.0.smithi043.stdout:0/403: dread - d2/d3/d18/d1e/d53/f64 zero size 2023-12-08T20:28:18.596 INFO:tasks.workunit.client.0.smithi043.stdout:0/404: fdatasync d2/d3/d6/f6c 0 2023-12-08T20:28:18.596 INFO:tasks.workunit.client.0.smithi043.stdout:0/405: stat d2/d3/d18/d1e/d53 0 2023-12-08T20:28:18.596 INFO:tasks.workunit.client.0.smithi043.stdout:6/305: mkdir d0/d2/d14/d2c/d66 0 2023-12-08T20:28:18.596 INFO:tasks.workunit.client.0.smithi043.stdout:6/306: chown d0/d2/l38 0 1 2023-12-08T20:28:18.596 INFO:tasks.workunit.client.0.smithi043.stdout:5/342: creat d3/f65 x:0 0 0 2023-12-08T20:28:18.597 INFO:tasks.workunit.client.0.smithi043.stdout:0/406: unlink d2/d3/d18/d2b/d4f/d5f/f6d 0 2023-12-08T20:28:18.597 INFO:tasks.workunit.client.0.smithi043.stdout:0/407: dread - d2/d3/d18/d1e/d53/f5d zero size 2023-12-08T20:28:18.597 INFO:tasks.workunit.client.0.smithi043.stdout:3/318: fsync d1/d1c/d2c/f3e 0 2023-12-08T20:28:18.598 INFO:tasks.workunit.client.0.smithi043.stdout:6/307: getdents d0/d2/d14/d20/d3c/d50 0 2023-12-08T20:28:18.599 INFO:tasks.workunit.client.0.smithi043.stdout:2/435: dwrite d0/d81/f8a [0,4194304] 0 2023-12-08T20:28:18.599 INFO:tasks.workunit.client.0.smithi043.stdout:0/408: truncate d2/d4/f3d 4117440 0 2023-12-08T20:28:18.602 INFO:tasks.workunit.client.0.smithi043.stdout:3/319: unlink d1/d1c/d2c/f3e 0 2023-12-08T20:28:18.603 INFO:tasks.workunit.client.0.smithi043.stdout:6/308: symlink d0/d2/d14/l67 0 2023-12-08T20:28:18.604 INFO:tasks.workunit.client.0.smithi043.stdout:5/343: dread f1 [0,4194304] 0 2023-12-08T20:28:18.607 INFO:tasks.workunit.client.0.smithi043.stdout:8/402: rename d2/de to d2/d20/d7d 0 2023-12-08T20:28:18.609 INFO:tasks.workunit.client.0.smithi043.stdout:8/403: write d2/d20/d7d/d37/d5a/f5d [181331,23203] 0 2023-12-08T20:28:18.609 INFO:tasks.workunit.client.0.smithi043.stdout:2/436: symlink d0/d20/l97 0 2023-12-08T20:28:18.610 INFO:tasks.workunit.client.0.smithi043.stdout:0/409: creat d2/d3/d18/d2b/d4f/d3f/f7f x:0 0 0 2023-12-08T20:28:18.612 INFO:tasks.workunit.client.0.smithi043.stdout:6/309: symlink d0/d2/d14/d8/d47/l68 0 2023-12-08T20:28:18.614 INFO:tasks.workunit.client.0.smithi043.stdout:6/310: write d0/d2/d14/d20/d49/f4f [1831388,72227] 0 2023-12-08T20:28:18.618 INFO:tasks.workunit.client.0.smithi043.stdout:3/320: rename d1/d9/d38/d4f/d52 to d1/d1c/d2c/d5f 0 2023-12-08T20:28:18.619 INFO:tasks.workunit.client.0.smithi043.stdout:8/404: symlink d2/d20/d7d/d29/d30/d60/l7e 0 2023-12-08T20:28:18.619 INFO:tasks.workunit.client.0.smithi043.stdout:2/437: link d0/f9 d0/d26/f98 0 2023-12-08T20:28:18.624 INFO:tasks.workunit.client.0.smithi043.stdout:6/311: mkdir d0/d2/d14/d2c/d22/d3f/d45/d69 0 2023-12-08T20:28:18.624 INFO:tasks.workunit.client.0.smithi043.stdout:6/312: read - d0/d2/d14/f57 zero size 2023-12-08T20:28:18.626 INFO:tasks.workunit.client.0.smithi043.stdout:3/321: mknod d1/d9/df/d26/c60 0 2023-12-08T20:28:18.627 INFO:tasks.workunit.client.0.smithi043.stdout:3/322: link d1/d1c/f53 d1/d1c/d2c/f61 0 2023-12-08T20:28:18.631 INFO:tasks.workunit.client.0.smithi043.stdout:3/323: creat d1/d9/df/f62 x:0 0 0 2023-12-08T20:28:18.631 INFO:tasks.workunit.client.0.smithi043.stdout:3/324: write d1/d1c/d29/f57 [1047740,118358] 0 2023-12-08T20:28:18.633 INFO:tasks.workunit.client.0.smithi043.stdout:8/405: fdatasync d2/f3e 0 2023-12-08T20:28:18.633 INFO:tasks.workunit.client.0.smithi043.stdout:8/406: read - d2/d20/d7d/f61 zero size 2023-12-08T20:28:18.633 INFO:tasks.workunit.client.0.smithi043.stdout:8/407: chown d2/d27/d2d/d31/d4f 833659 1 2023-12-08T20:28:18.634 INFO:tasks.workunit.client.0.smithi043.stdout:8/408: chown d2/c48 6572 1 2023-12-08T20:28:18.634 INFO:tasks.workunit.client.0.smithi043.stdout:3/325: rename d1/d9/df/d26/f2f to d1/d9/d38/d33/f63 0 2023-12-08T20:28:18.634 INFO:tasks.workunit.client.0.smithi043.stdout:3/326: stat d1/d9/d2d/d42 0 2023-12-08T20:28:18.634 INFO:tasks.workunit.client.0.smithi043.stdout:3/327: write d1/d9/f32 [125206,110460] 0 2023-12-08T20:28:18.634 INFO:tasks.workunit.client.0.smithi043.stdout:5/344: dwrite d3/f3d [0,4194304] 0 2023-12-08T20:28:18.634 INFO:tasks.workunit.client.0.smithi043.stdout:5/345: readlink d3/l39 0 2023-12-08T20:28:18.638 INFO:tasks.workunit.client.0.smithi043.stdout:2/438: dwrite d0/f25 [0,4194304] 0 2023-12-08T20:28:18.643 INFO:tasks.workunit.client.0.smithi043.stdout:3/328: mknod d1/d9/d2d/d42/c64 0 2023-12-08T20:28:18.644 INFO:tasks.workunit.client.0.smithi043.stdout:5/346: creat d3/d7/d19/d3f/d52/f66 x:0 0 0 2023-12-08T20:28:18.646 INFO:tasks.workunit.client.0.smithi043.stdout:2/439: creat d0/db/d18/f99 x:0 0 0 2023-12-08T20:28:18.648 INFO:tasks.workunit.client.0.smithi043.stdout:3/329: link d1/d9/d38/d30/f40 d1/d1c/d2c/f65 0 2023-12-08T20:28:18.650 INFO:tasks.workunit.client.0.smithi043.stdout:5/347: creat d3/d7/d21/d51/d5c/f67 x:0 0 0 2023-12-08T20:28:18.650 INFO:tasks.workunit.client.0.smithi043.stdout:8/409: dwrite d2/d20/d7d/d29/d30/d71/f76 [0,4194304] 0 2023-12-08T20:28:18.650 INFO:tasks.workunit.client.0.smithi043.stdout:6/313: dwrite d0/d2/d14/d2c/d22/d2a/f5a [0,4194304] 0 2023-12-08T20:28:18.654 INFO:tasks.workunit.client.0.smithi043.stdout:3/330: mkdir d1/d9/d2d/d66 0 2023-12-08T20:28:18.655 INFO:tasks.workunit.client.0.smithi043.stdout:5/348: write d3/d7/d21/f2d [5626870,18926] 0 2023-12-08T20:28:18.655 INFO:tasks.workunit.client.0.smithi043.stdout:5/349: chown d3/c4 197436 1 2023-12-08T20:28:18.655 INFO:tasks.workunit.client.0.smithi043.stdout:5/350: readlink d3/l6 0 2023-12-08T20:28:18.655 INFO:tasks.workunit.client.0.smithi043.stdout:6/314: write d0/d2/d29/f61 [245116,33232] 0 2023-12-08T20:28:18.656 INFO:tasks.workunit.client.0.smithi043.stdout:6/315: write d0/d2/d14/d8/f1e [1063623,66827] 0 2023-12-08T20:28:18.656 INFO:tasks.workunit.client.0.smithi043.stdout:6/316: fsync d0/d2/f4d 0 2023-12-08T20:28:18.656 INFO:tasks.workunit.client.0.smithi043.stdout:6/317: fsync d0/d2/de/f40 0 2023-12-08T20:28:18.661 INFO:tasks.workunit.client.0.smithi043.stdout:8/410: mkdir d2/d27/d2d/d31/d7f 0 2023-12-08T20:28:18.662 INFO:tasks.workunit.client.0.smithi043.stdout:2/440: dwrite d0/db/d18/f4b [0,4194304] 0 2023-12-08T20:28:18.666 INFO:tasks.workunit.client.0.smithi043.stdout:3/331: mkdir d1/d9/d38/d33/d67 0 2023-12-08T20:28:18.669 INFO:tasks.workunit.client.0.smithi043.stdout:5/351: getdents d3/d7/de/d17 0 2023-12-08T20:28:18.671 INFO:tasks.workunit.client.0.smithi043.stdout:8/411: rename d2/d20/d7d/d29/l4b to d2/d27/d2d/d31/d7f/l80 0 2023-12-08T20:28:18.675 INFO:tasks.workunit.client.0.smithi043.stdout:3/332: rename d1/d9/df/f3a to d1/d9/d38/d33/f68 0 2023-12-08T20:28:18.676 INFO:tasks.workunit.client.0.smithi043.stdout:3/333: creat d1/d9/d38/d33/f69 x:0 0 0 2023-12-08T20:28:18.678 INFO:tasks.workunit.client.0.smithi043.stdout:3/334: unlink d1/d9/df/c54 0 2023-12-08T20:28:18.678 INFO:tasks.workunit.client.0.smithi043.stdout:3/335: chown d1/d25/d2a/d45/f58 6697 1 2023-12-08T20:28:18.679 INFO:tasks.workunit.client.0.smithi043.stdout:6/318: dwrite d0/d2/f36 [0,4194304] 0 2023-12-08T20:28:18.679 INFO:tasks.workunit.client.0.smithi043.stdout:6/319: read d0/d2/f3e [1786248,75802] 0 2023-12-08T20:28:18.679 INFO:tasks.workunit.client.0.smithi043.stdout:6/320: chown d0/d2/f28 366941 1 2023-12-08T20:28:18.680 INFO:tasks.workunit.client.0.smithi043.stdout:2/441: dwrite d0/d26/f3b [0,4194304] 0 2023-12-08T20:28:18.680 INFO:tasks.workunit.client.0.smithi043.stdout:3/336: creat d1/d25/d2a/f6a x:0 0 0 2023-12-08T20:28:18.680 INFO:tasks.workunit.client.0.smithi043.stdout:3/337: fsync d1/f50 0 2023-12-08T20:28:18.684 INFO:tasks.workunit.client.0.smithi043.stdout:6/321: rename d0/d2/c31 to d0/d2/d14/d2c/d22/c6a 0 2023-12-08T20:28:18.684 INFO:tasks.workunit.client.0.smithi043.stdout:6/322: readlink d0/d2/d14/l26 0 2023-12-08T20:28:18.686 INFO:tasks.workunit.client.0.smithi043.stdout:3/338: mknod d1/d1c/d29/c6b 0 2023-12-08T20:28:18.692 INFO:tasks.workunit.client.0.smithi043.stdout:5/352: dwrite d3/d7/d19/d3f/d52/f66 [0,4194304] 0 2023-12-08T20:28:18.692 INFO:tasks.workunit.client.0.smithi043.stdout:5/353: dread - d3/d7/d19/d3f/d52/f5e zero size 2023-12-08T20:28:18.695 INFO:tasks.workunit.client.0.smithi043.stdout:6/323: dread d0/d2/d14/f18 [0,4194304] 0 2023-12-08T20:28:18.697 INFO:tasks.workunit.client.0.smithi043.stdout:6/324: mkdir d0/d2/d14/d2c/d22/d3f/d45/d6b 0 2023-12-08T20:28:18.701 INFO:tasks.workunit.client.0.smithi043.stdout:5/354: dread d3/d7/de/d17/f27 [4194304,4194304] 0 2023-12-08T20:28:18.701 INFO:tasks.workunit.client.0.smithi043.stdout:2/442: dwrite d0/db/f63 [0,4194304] 0 2023-12-08T20:28:18.701 INFO:tasks.workunit.client.0.smithi043.stdout:2/443: stat d0/d20/f4d 0 2023-12-08T20:28:18.701 INFO:tasks.workunit.client.0.smithi043.stdout:2/444: chown d0/d26/c51 25297478 1 2023-12-08T20:28:18.701 INFO:tasks.workunit.client.0.smithi043.stdout:6/325: getdents d0/d2/de/d4a 0 2023-12-08T20:28:18.705 INFO:tasks.workunit.client.0.smithi043.stdout:5/355: dread d3/d7/d19/f59 [0,4194304] 0 2023-12-08T20:28:18.705 INFO:tasks.workunit.client.0.smithi043.stdout:3/339: dwrite d1/d9/d38/d30/f59 [0,4194304] 0 2023-12-08T20:28:18.705 INFO:tasks.workunit.client.0.smithi043.stdout:6/326: mkdir d0/d2/d14/d20/d3c/d6c 0 2023-12-08T20:28:18.706 INFO:tasks.workunit.client.0.smithi043.stdout:6/327: truncate d0/d2/d14/d8/f4e 1121698 0 2023-12-08T20:28:18.706 INFO:tasks.workunit.client.0.smithi043.stdout:6/328: truncate d0/d2/d14/d20/d49/f4f 4706882 0 2023-12-08T20:28:18.707 INFO:tasks.workunit.client.0.smithi043.stdout:2/445: rename d0/d26/d53/c58 to d0/db/c9a 0 2023-12-08T20:28:18.711 INFO:tasks.workunit.client.0.smithi043.stdout:3/340: mknod d1/d25/d2a/d5e/c6c 0 2023-12-08T20:28:18.711 INFO:tasks.workunit.client.0.smithi043.stdout:3/341: chown d1/d9/d38/d33/f68 293973 1 2023-12-08T20:28:18.712 INFO:tasks.workunit.client.0.smithi043.stdout:3/342: read d1/d1c/f22 [3998933,27444] 0 2023-12-08T20:28:18.712 INFO:tasks.workunit.client.0.smithi043.stdout:5/356: mkdir d3/d7/de/d43/d68 0 2023-12-08T20:28:18.713 INFO:tasks.workunit.client.0.smithi043.stdout:2/446: rmdir d0/db/d18/d66/d71 39 2023-12-08T20:28:18.716 INFO:tasks.workunit.client.0.smithi043.stdout:6/329: dread d0/d2/d14/d2c/d22/d2a/f5a [0,4194304] 0 2023-12-08T20:28:18.716 INFO:tasks.workunit.client.0.smithi043.stdout:6/330: chown d0/d2/de/f40 210225 1 2023-12-08T20:28:18.716 INFO:tasks.workunit.client.0.smithi043.stdout:6/331: stat d0/d2/d14/d2c/d66 0 2023-12-08T20:28:18.717 INFO:tasks.workunit.client.0.smithi043.stdout:2/447: write d0/db/f31 [967578,56618] 0 2023-12-08T20:28:18.718 INFO:tasks.workunit.client.0.smithi043.stdout:3/343: rename d1/d9/df/f17 to d1/f6d 0 2023-12-08T20:28:18.719 INFO:tasks.workunit.client.0.smithi043.stdout:6/332: creat d0/d2/d14/d2c/d22/d3f/d45/f6d x:0 0 0 2023-12-08T20:28:18.719 INFO:tasks.workunit.client.0.smithi043.stdout:6/333: readlink d0/l3d 0 2023-12-08T20:28:18.720 INFO:tasks.workunit.client.0.smithi043.stdout:7/256: sync 2023-12-08T20:28:18.722 INFO:tasks.workunit.client.0.smithi043.stdout:2/448: rename d0/d2b/d4e/f6d to d0/db/d18/d66/f9b 0 2023-12-08T20:28:18.722 INFO:tasks.workunit.client.0.smithi043.stdout:2/449: fdatasync d0/db/d18/f4b 0 2023-12-08T20:28:18.722 INFO:tasks.workunit.client.0.smithi043.stdout:5/357: dread d3/d7/d21/f2d [4194304,4194304] 0 2023-12-08T20:28:18.723 INFO:tasks.workunit.client.0.smithi043.stdout:3/344: mkdir d1/d9/df/d6e 0 2023-12-08T20:28:18.723 INFO:tasks.workunit.client.0.smithi043.stdout:3/345: stat d1/d25/d2a/d5e 0 2023-12-08T20:28:18.723 INFO:tasks.workunit.client.0.smithi043.stdout:7/257: dread d0/d2/d12/d19/f2b [0,4194304] 0 2023-12-08T20:28:18.724 INFO:tasks.workunit.client.0.smithi043.stdout:6/334: symlink d0/d2/d14/d2c/d66/l6e 0 2023-12-08T20:28:18.724 INFO:tasks.workunit.client.0.smithi043.stdout:6/335: fsync d0/d2/d14/d20/d53/f5e 0 2023-12-08T20:28:18.725 INFO:tasks.workunit.client.0.smithi043.stdout:2/450: getdents d0/db/d18/d8b 0 2023-12-08T20:28:18.725 INFO:tasks.workunit.client.0.smithi043.stdout:2/451: write d0/d26/d37/d38/f5d [236489,118731] 0 2023-12-08T20:28:18.726 INFO:tasks.workunit.client.0.smithi043.stdout:5/358: creat d3/d7/f69 x:0 0 0 2023-12-08T20:28:18.726 INFO:tasks.workunit.client.0.smithi043.stdout:5/359: stat d3/d7/de/d17/l41 0 2023-12-08T20:28:18.728 INFO:tasks.workunit.client.0.smithi043.stdout:3/346: mknod d1/d9/d2d/d66/c6f 0 2023-12-08T20:28:18.728 INFO:tasks.workunit.client.0.smithi043.stdout:3/347: chown d1/d9/df/d41/f5b 291 1 2023-12-08T20:28:18.731 INFO:tasks.workunit.client.0.smithi043.stdout:7/258: mkdir d0/d6/d8/d57 0 2023-12-08T20:28:18.731 INFO:tasks.workunit.client.0.smithi043.stdout:7/259: truncate d0/f1b 4807392 0 2023-12-08T20:28:18.731 INFO:tasks.workunit.client.0.smithi043.stdout:6/336: mknod d0/d2/d14/d20/d53/c6f 0 2023-12-08T20:28:18.734 INFO:tasks.workunit.client.0.smithi043.stdout:2/452: mknod d0/db/d18/d3d/c9c 0 2023-12-08T20:28:18.734 INFO:tasks.workunit.client.0.smithi043.stdout:2/453: stat d0/db/f14 0 2023-12-08T20:28:18.734 INFO:tasks.workunit.client.0.smithi043.stdout:2/454: stat d0/f25 0 2023-12-08T20:28:18.734 INFO:tasks.workunit.client.0.smithi043.stdout:6/337: symlink d0/d2/d14/d8/d47/l70 0 2023-12-08T20:28:18.734 INFO:tasks.workunit.client.0.smithi043.stdout:2/455: mkdir d0/db/d18/d8b/d9d 0 2023-12-08T20:28:18.736 INFO:tasks.workunit.client.0.smithi043.stdout:6/338: rename d0/d2/d14/d20/d53/c6f to d0/d2/d29/c71 0 2023-12-08T20:28:18.742 INFO:tasks.workunit.client.0.smithi043.stdout:2/456: read d0/db/d18/f4b [2680188,36833] 0 2023-12-08T20:28:18.743 INFO:tasks.workunit.client.0.smithi043.stdout:2/457: fsync d0/d20/f76 0 2023-12-08T20:28:18.743 INFO:tasks.workunit.client.0.smithi043.stdout:5/360: dwrite d3/d7/d19/d3f/f58 [0,4194304] 0 2023-12-08T20:28:18.744 INFO:tasks.workunit.client.0.smithi043.stdout:5/361: read - d3/d7/d21/f50 zero size 2023-12-08T20:28:18.748 INFO:tasks.workunit.client.0.smithi043.stdout:2/458: write d0/d20/f2c [1867805,62238] 0 2023-12-08T20:28:18.749 INFO:tasks.workunit.client.0.smithi043.stdout:5/362: mkdir d3/d7/de/d6a 0 2023-12-08T20:28:18.750 INFO:tasks.workunit.client.0.smithi043.stdout:5/363: write d3/fc [3991737,14582] 0 2023-12-08T20:28:18.759 INFO:tasks.workunit.client.0.smithi043.stdout:5/364: dread d3/d7/de/d17/f27 [4194304,4194304] 0 2023-12-08T20:28:18.760 INFO:tasks.workunit.client.0.smithi043.stdout:5/365: symlink d3/d7/d21/l6b 0 2023-12-08T20:28:18.760 INFO:tasks.workunit.client.0.smithi043.stdout:5/366: chown d3/d7/de/d17/l41 56 1 2023-12-08T20:28:18.761 INFO:tasks.workunit.client.0.smithi043.stdout:5/367: write d3/f65 [354448,129303] 0 2023-12-08T20:28:18.761 INFO:tasks.workunit.client.0.smithi043.stdout:7/260: dwrite d0/d2/d12/f32 [0,4194304] 0 2023-12-08T20:28:18.761 INFO:tasks.workunit.client.0.smithi043.stdout:5/368: symlink d3/d7/d19/d3f/l6c 0 2023-12-08T20:28:18.763 INFO:tasks.workunit.client.0.smithi043.stdout:7/261: creat d0/d2/d12/d19/d38/f58 x:0 0 0 2023-12-08T20:28:18.763 INFO:tasks.workunit.client.0.smithi043.stdout:5/369: creat d3/d7/d19/f6d x:0 0 0 2023-12-08T20:28:18.765 INFO:tasks.workunit.client.0.smithi043.stdout:7/262: creat d0/d6/d17/d54/f59 x:0 0 0 2023-12-08T20:28:18.765 INFO:tasks.workunit.client.0.smithi043.stdout:7/263: truncate d0/d2/d12/d19/f40 1100544 0 2023-12-08T20:28:18.767 INFO:tasks.workunit.client.0.smithi043.stdout:7/264: symlink d0/d2/d12/d19/l5a 0 2023-12-08T20:28:18.768 INFO:tasks.workunit.client.0.smithi043.stdout:7/265: rename d0/d6/d8/d57 to d0/d5b 0 2023-12-08T20:28:18.771 INFO:tasks.workunit.client.0.smithi043.stdout:6/339: dwrite d0/d2/de/f40 [0,4194304] 0 2023-12-08T20:28:18.771 INFO:tasks.workunit.client.0.smithi043.stdout:3/348: dwrite d1/d25/f24 [0,4194304] 0 2023-12-08T20:28:18.772 INFO:tasks.workunit.client.0.smithi043.stdout:2/459: dwrite d0/db/f4a [0,4194304] 0 2023-12-08T20:28:18.772 INFO:tasks.workunit.client.0.smithi043.stdout:2/460: readlink d0/d20/l80 0 2023-12-08T20:28:18.773 INFO:tasks.workunit.client.0.smithi043.stdout:6/340: rename d0/d2/de/d4a/d56/f5c to d0/d2/de/d4a/d56/f72 0 2023-12-08T20:28:18.776 INFO:tasks.workunit.client.0.smithi043.stdout:2/461: creat d0/d2b/d4e/d93/f9e x:0 0 0 2023-12-08T20:28:18.778 INFO:tasks.workunit.client.0.smithi043.stdout:2/462: write d0/f6c [2036586,11163] 0 2023-12-08T20:28:18.782 INFO:tasks.workunit.client.0.smithi043.stdout:6/341: rmdir d0/d2/d14 39 2023-12-08T20:28:18.789 INFO:tasks.workunit.client.0.smithi043.stdout:6/342: mkdir d0/d2/d14/d20/d53/d73 0 2023-12-08T20:28:18.789 INFO:tasks.workunit.client.0.smithi043.stdout:5/370: dread d3/fc [4194304,4194304] 0 2023-12-08T20:28:18.789 INFO:tasks.workunit.client.0.smithi043.stdout:5/371: chown d3/d7/d29/f3c 205673 1 2023-12-08T20:28:18.789 INFO:tasks.workunit.client.0.smithi043.stdout:5/372: creat d3/f6e x:0 0 0 2023-12-08T20:28:18.790 INFO:tasks.workunit.client.0.smithi043.stdout:5/373: creat d3/d7/f6f x:0 0 0 2023-12-08T20:28:18.791 INFO:tasks.workunit.client.0.smithi043.stdout:5/374: chown d3/l5b 5203 1 2023-12-08T20:28:18.792 INFO:tasks.workunit.client.0.smithi043.stdout:5/375: rename d3/d7/f6f to d3/d7/d19/d3f/d52/f70 0 2023-12-08T20:28:18.794 INFO:tasks.workunit.client.0.smithi043.stdout:5/376: creat d3/d7/d19/d3f/d52/f71 x:0 0 0 2023-12-08T20:28:18.795 INFO:tasks.workunit.client.0.smithi043.stdout:2/463: dwrite d0/d2b/f46 [0,4194304] 0 2023-12-08T20:28:18.796 INFO:tasks.workunit.client.0.smithi043.stdout:3/349: dwrite d1/d1c/d29/f5c [0,4194304] 0 2023-12-08T20:28:18.796 INFO:tasks.workunit.client.0.smithi043.stdout:3/350: write d1/d25/f36 [1902169,120597] 0 2023-12-08T20:28:18.796 INFO:tasks.workunit.client.0.smithi043.stdout:5/377: unlink d3/d7/d21/c4b 0 2023-12-08T20:28:18.799 INFO:tasks.workunit.client.0.smithi043.stdout:2/464: symlink d0/db/d18/d8b/d9d/l9f 0 2023-12-08T20:28:18.799 INFO:tasks.workunit.client.0.smithi043.stdout:2/465: dread - d0/d2b/f35 zero size 2023-12-08T20:28:18.799 INFO:tasks.workunit.client.0.smithi043.stdout:3/351: creat d1/d9/d2d/f70 x:0 0 0 2023-12-08T20:28:18.801 INFO:tasks.workunit.client.0.smithi043.stdout:2/466: rmdir d0/db/d18/d3d/d92 0 2023-12-08T20:28:18.801 INFO:tasks.workunit.client.0.smithi043.stdout:3/352: truncate d1/d9/d38/d33/f5d 1879776 0 2023-12-08T20:28:18.801 INFO:tasks.workunit.client.0.smithi043.stdout:3/353: chown d1/d9/fe 15057325 1 2023-12-08T20:28:18.801 INFO:tasks.workunit.client.0.smithi043.stdout:3/354: chown d1/d25/l49 148570 1 2023-12-08T20:28:18.802 INFO:tasks.workunit.client.0.smithi043.stdout:2/467: getdents d0/d26/d53 0 2023-12-08T20:28:18.803 INFO:tasks.workunit.client.0.smithi043.stdout:3/355: mknod d1/d25/d2a/c71 0 2023-12-08T20:28:18.804 INFO:tasks.workunit.client.0.smithi043.stdout:2/468: unlink d0/d26/d37/l3a 0 2023-12-08T20:28:18.804 INFO:tasks.workunit.client.0.smithi043.stdout:3/356: symlink d1/d9/df/d41/l72 0 2023-12-08T20:28:18.807 INFO:tasks.workunit.client.0.smithi043.stdout:6/343: dwrite d0/d2/d14/d20/d3c/f55 [0,4194304] 0 2023-12-08T20:28:18.810 INFO:tasks.workunit.client.0.smithi043.stdout:6/344: mknod d0/d2/de/c74 0 2023-12-08T20:28:18.812 INFO:tasks.workunit.client.0.smithi043.stdout:6/345: rename d0/d2/d14/d8/c16 to d0/d2/de/d4a/d56/d59/c75 0 2023-12-08T20:28:18.813 INFO:tasks.workunit.client.0.smithi043.stdout:5/378: dread d3/d7/de/f18 [0,4194304] 0 2023-12-08T20:28:18.814 INFO:tasks.workunit.client.0.smithi043.stdout:6/346: mknod d0/d2/d14/d20/d49/c76 0 2023-12-08T20:28:18.820 INFO:tasks.workunit.client.0.smithi043.stdout:5/379: truncate d3/d32/f47 2569248 0 2023-12-08T20:28:18.821 INFO:tasks.workunit.client.0.smithi043.stdout:6/347: truncate d0/d2/f12 121891 0 2023-12-08T20:28:18.823 INFO:tasks.workunit.client.0.smithi043.stdout:5/380: mkdir d3/d7/d21/d72 0 2023-12-08T20:28:18.826 INFO:tasks.workunit.client.0.smithi043.stdout:6/348: rename d0/d2/f4d to d0/d2/d14/d20/d3c/d50/f77 0 2023-12-08T20:28:18.827 INFO:tasks.workunit.client.0.smithi043.stdout:5/381: rmdir d3/d7/d19/d3f/d52 39 2023-12-08T20:28:18.827 INFO:tasks.workunit.client.0.smithi043.stdout:5/382: chown d3/d7 31742 1 2023-12-08T20:28:18.827 INFO:tasks.workunit.client.0.smithi043.stdout:5/383: chown d3/d7/d19/d3f/d52/f5e 49901 1 2023-12-08T20:28:18.828 INFO:tasks.workunit.client.0.smithi043.stdout:2/469: dwrite d0/d26/f34 [4194304,4194304] 0 2023-12-08T20:28:18.829 INFO:tasks.workunit.client.0.smithi043.stdout:3/357: dwrite d1/d1c/d2c/f61 [0,4194304] 0 2023-12-08T20:28:18.829 INFO:tasks.workunit.client.0.smithi043.stdout:6/349: symlink d0/d2/d14/d2c/d22/d3f/l78 0 2023-12-08T20:28:18.831 INFO:tasks.workunit.client.0.smithi043.stdout:2/470: mknod d0/d26/d37/d38/ca0 0 2023-12-08T20:28:18.834 INFO:tasks.workunit.client.0.smithi043.stdout:3/358: mknod d1/d1c/d2c/d5f/c73 0 2023-12-08T20:28:18.834 INFO:tasks.workunit.client.0.smithi043.stdout:3/359: truncate d1/d9/d38/d33/f69 911945 0 2023-12-08T20:28:18.835 INFO:tasks.workunit.client.0.smithi043.stdout:6/350: symlink d0/d2/d14/d8/d47/d60/l79 0 2023-12-08T20:28:18.836 INFO:tasks.workunit.client.0.smithi043.stdout:5/384: mkdir d3/d73 0 2023-12-08T20:28:18.837 INFO:tasks.workunit.client.0.smithi043.stdout:2/471: getdents d0/d20/d42 0 2023-12-08T20:28:18.839 INFO:tasks.workunit.client.0.smithi043.stdout:6/351: symlink d0/d2/d14/d2c/l7a 0 2023-12-08T20:28:18.842 INFO:tasks.workunit.client.0.smithi043.stdout:2/472: rename d0/f7d to d0/d2b/d4e/fa1 0 2023-12-08T20:28:18.842 INFO:tasks.workunit.client.0.smithi043.stdout:2/473: chown d0/db/d18 610419853 1 2023-12-08T20:28:18.844 INFO:tasks.workunit.client.0.smithi043.stdout:3/360: dread d1/d9/fe [0,4194304] 0 2023-12-08T20:28:18.844 INFO:tasks.workunit.client.0.smithi043.stdout:3/361: chown d1/d9/d2d/d66 2 1 2023-12-08T20:28:18.845 INFO:tasks.workunit.client.0.smithi043.stdout:2/474: mkdir d0/db/d18/d8b/da2 0 2023-12-08T20:28:18.845 INFO:tasks.workunit.client.0.smithi043.stdout:2/475: write d0/d26/f45 [55995,129786] 0 2023-12-08T20:28:18.849 INFO:tasks.workunit.client.0.smithi043.stdout:3/362: creat d1/d9/d2d/d66/f74 x:0 0 0 2023-12-08T20:28:18.850 INFO:tasks.workunit.client.0.smithi043.stdout:2/476: dread d0/d26/f27 [0,4194304] 0 2023-12-08T20:28:18.850 INFO:tasks.workunit.client.0.smithi043.stdout:2/477: chown d0/f55 59 1 2023-12-08T20:28:18.850 INFO:tasks.workunit.client.0.smithi043.stdout:2/478: readlink d0/d26/d37/l94 0 2023-12-08T20:28:18.851 INFO:tasks.workunit.client.0.smithi043.stdout:2/479: mkdir d0/db/d18/da3 0 2023-12-08T20:28:18.851 INFO:tasks.workunit.client.0.smithi043.stdout:2/480: chown d0/f25 3 1 2023-12-08T20:28:18.858 INFO:tasks.workunit.client.0.smithi043.stdout:6/352: dwrite d0/d2/d14/d8/f4e [0,4194304] 0 2023-12-08T20:28:18.862 INFO:tasks.workunit.client.0.smithi043.stdout:6/353: unlink d0/d2/d29/c71 0 2023-12-08T20:28:18.868 INFO:tasks.workunit.client.0.smithi043.stdout:6/354: write d0/d2/d14/f18 [615069,39607] 0 2023-12-08T20:28:18.872 INFO:tasks.workunit.client.0.smithi043.stdout:3/363: dwrite d1/d9/d38/f3d [4194304,4194304] 0 2023-12-08T20:28:18.876 INFO:tasks.workunit.client.0.smithi043.stdout:2/481: dwrite d0/d20/d42/f78 [0,4194304] 0 2023-12-08T20:28:18.876 INFO:tasks.workunit.client.0.smithi043.stdout:2/482: chown d0/db/d18/f3e 2148658 1 2023-12-08T20:28:18.879 INFO:tasks.workunit.client.0.smithi043.stdout:6/355: dread d0/d2/f3e [0,4194304] 0 2023-12-08T20:28:18.879 INFO:tasks.workunit.client.0.smithi043.stdout:6/356: chown d0/d2/d14/d20 8024 1 2023-12-08T20:28:18.883 INFO:tasks.workunit.client.0.smithi043.stdout:2/483: truncate d0/f28 89113 0 2023-12-08T20:28:18.889 INFO:tasks.workunit.client.0.smithi043.stdout:6/357: dread d0/d2/d14/d2c/d22/d2a/f5a [0,4194304] 0 2023-12-08T20:28:18.889 INFO:tasks.workunit.client.0.smithi043.stdout:2/484: read d0/d26/d37/d38/f6e [1426714,83155] 0 2023-12-08T20:28:18.890 INFO:tasks.workunit.client.0.smithi043.stdout:6/358: creat d0/d2/d14/d8/f7b x:0 0 0 2023-12-08T20:28:18.891 INFO:tasks.workunit.client.0.smithi043.stdout:3/364: dwrite d1/d25/d2a/f6a [0,4194304] 0 2023-12-08T20:28:18.891 INFO:tasks.workunit.client.0.smithi043.stdout:3/365: truncate d1/f50 739143 0 2023-12-08T20:28:18.891 INFO:tasks.workunit.client.0.smithi043.stdout:6/359: mknod d0/d2/d14/d20/d3c/d50/c7c 0 2023-12-08T20:28:18.894 INFO:tasks.workunit.client.0.smithi043.stdout:3/366: mkdir d1/d9/df/d41/d75 0 2023-12-08T20:28:18.894 INFO:tasks.workunit.client.0.smithi043.stdout:4/335: sync 2023-12-08T20:28:18.898 INFO:tasks.workunit.client.0.smithi043.stdout:6/360: creat d0/d2/d14/d2c/d22/d3f/f7d x:0 0 0 2023-12-08T20:28:18.898 INFO:tasks.workunit.client.0.smithi043.stdout:3/367: write d1/d9/df/f47 [1466843,119169] 0 2023-12-08T20:28:18.898 INFO:tasks.workunit.client.0.smithi043.stdout:9/364: sync 2023-12-08T20:28:18.898 INFO:tasks.workunit.client.0.smithi043.stdout:9/365: stat d0/d3d/f5d 0 2023-12-08T20:28:18.899 INFO:tasks.workunit.client.0.smithi043.stdout:4/336: mkdir d1/d14/d1d/d75 0 2023-12-08T20:28:18.900 INFO:tasks.workunit.client.0.smithi043.stdout:3/368: getdents d1/d9/df/d26 0 2023-12-08T20:28:18.901 INFO:tasks.workunit.client.0.smithi043.stdout:9/366: mknod d0/d5e/c75 0 2023-12-08T20:28:18.902 INFO:tasks.workunit.client.0.smithi043.stdout:4/337: link d1/l17 d1/d14/d25/d39/d3f/l76 0 2023-12-08T20:28:18.904 INFO:tasks.workunit.client.0.smithi043.stdout:9/367: unlink d0/d21/f4e 0 2023-12-08T20:28:18.906 INFO:tasks.workunit.client.0.smithi043.stdout:4/338: mkdir d1/d14/d25/d77 0 2023-12-08T20:28:18.906 INFO:tasks.workunit.client.0.smithi043.stdout:4/339: chown d1/d14/d1d/d75 0 1 2023-12-08T20:28:18.907 INFO:tasks.workunit.client.0.smithi043.stdout:9/368: unlink d0/d3d/d4b/d61/c66 0 2023-12-08T20:28:18.909 INFO:tasks.workunit.client.0.smithi043.stdout:2/485: dwrite d0/db/d18/f36 [0,4194304] 0 2023-12-08T20:28:18.911 INFO:tasks.workunit.client.0.smithi043.stdout:9/369: rename d0/d49 to d0/d5e/d37/d6b/d76 0 2023-12-08T20:28:18.911 INFO:tasks.workunit.client.0.smithi043.stdout:9/370: chown d0/d5e/d37/d6b/d76/l5a 9672704 1 2023-12-08T20:28:18.912 INFO:tasks.workunit.client.0.smithi043.stdout:6/361: dread d0/d2/de/f40 [0,4194304] 0 2023-12-08T20:28:18.912 INFO:tasks.workunit.client.0.smithi043.stdout:2/486: write d0/db/d18/f36 [951723,121881] 0 2023-12-08T20:28:18.913 INFO:tasks.workunit.client.0.smithi043.stdout:6/362: read d0/d2/d14/d20/d49/f62 [652724,109885] 0 2023-12-08T20:28:18.913 INFO:tasks.workunit.client.0.smithi043.stdout:2/487: creat d0/d20/d42/d49/fa4 x:0 0 0 2023-12-08T20:28:18.914 INFO:tasks.workunit.client.0.smithi043.stdout:6/363: creat d0/d2/d14/d2c/d22/f7e x:0 0 0 2023-12-08T20:28:18.918 INFO:tasks.workunit.client.0.smithi043.stdout:3/369: dwrite d1/f50 [0,4194304] 0 2023-12-08T20:28:18.919 INFO:tasks.workunit.client.0.smithi043.stdout:6/364: creat d0/f7f x:0 0 0 2023-12-08T20:28:18.919 INFO:tasks.workunit.client.0.smithi043.stdout:6/365: read - d0/d2/d14/d20/d49/f64 zero size 2023-12-08T20:28:18.923 INFO:tasks.workunit.client.0.smithi043.stdout:2/488: dread d0/db/f14 [0,4194304] 0 2023-12-08T20:28:18.924 INFO:tasks.workunit.client.0.smithi043.stdout:4/340: dread d1/d14/d25/d39/f51 [0,4194304] 0 2023-12-08T20:28:18.925 INFO:tasks.workunit.client.0.smithi043.stdout:4/341: dread - d1/d14/d25/d39/d3d/d40/f5b zero size 2023-12-08T20:28:18.925 INFO:tasks.workunit.client.0.smithi043.stdout:4/342: write d1/d14/d25/f2c [363779,7981] 0 2023-12-08T20:28:18.925 INFO:tasks.workunit.client.0.smithi043.stdout:3/370: mkdir d1/d1c/d2c/d76 0 2023-12-08T20:28:18.925 INFO:tasks.workunit.client.0.smithi043.stdout:6/366: creat d0/d2/d14/d8/d47/f80 x:0 0 0 2023-12-08T20:28:18.926 INFO:tasks.workunit.client.0.smithi043.stdout:3/371: write d1/f6d [3105417,122950] 0 2023-12-08T20:28:18.928 INFO:tasks.workunit.client.0.smithi043.stdout:6/367: mknod d0/d2/d14/d20/d3c/d50/c81 0 2023-12-08T20:28:18.928 INFO:tasks.workunit.client.0.smithi043.stdout:6/368: readlink d0/d2/d14/d8/d47/l68 0 2023-12-08T20:28:18.930 INFO:tasks.workunit.client.0.smithi043.stdout:2/489: dread d0/d20/f2c [0,4194304] 0 2023-12-08T20:28:18.930 INFO:tasks.workunit.client.0.smithi043.stdout:2/490: chown d0/d20/f4d 1 1 2023-12-08T20:28:18.932 INFO:tasks.workunit.client.0.smithi043.stdout:2/491: read d0/d2b/d4e/fa1 [266917,2528] 0 2023-12-08T20:28:18.932 INFO:tasks.workunit.client.0.smithi043.stdout:3/372: read d1/d9/f4e [2001460,64927] 0 2023-12-08T20:28:18.932 INFO:tasks.workunit.client.0.smithi043.stdout:3/373: chown d1/d9/df/d41/c3b 27476 1 2023-12-08T20:28:18.933 INFO:tasks.workunit.client.0.smithi043.stdout:9/371: getdents d0 0 2023-12-08T20:28:18.933 INFO:tasks.workunit.client.0.smithi043.stdout:9/372: chown d0/d5e/d37/f3a 5710573 1 2023-12-08T20:28:18.933 INFO:tasks.workunit.client.0.smithi043.stdout:9/373: dread - d0/d3d/f48 zero size 2023-12-08T20:28:18.935 INFO:tasks.workunit.client.0.smithi043.stdout:3/374: link d1/d9/df/c43 d1/d1c/d2c/d76/c77 0 2023-12-08T20:28:18.935 INFO:tasks.workunit.client.0.smithi043.stdout:3/375: getdents d1/d9/d38/d4f/d5a 0 2023-12-08T20:28:18.935 INFO:tasks.workunit.client.0.smithi043.stdout:3/376: chown d1/d9/f32 873 1 2023-12-08T20:28:18.935 INFO:tasks.workunit.client.0.smithi043.stdout:3/377: stat d1/d9/d38/d33/f63 0 2023-12-08T20:28:18.936 INFO:tasks.workunit.client.0.smithi043.stdout:9/374: unlink d0/c43 0 2023-12-08T20:28:18.938 INFO:tasks.workunit.client.0.smithi043.stdout:3/378: unlink d1/d25/d2a/d5e/c37 0 2023-12-08T20:28:18.939 INFO:tasks.workunit.client.0.smithi043.stdout:9/375: creat d0/d5e/d37/d6b/d76/f77 x:0 0 0 2023-12-08T20:28:18.939 INFO:tasks.workunit.client.0.smithi043.stdout:9/376: write d0/f34 [1147361,87266] 0 2023-12-08T20:28:18.939 INFO:tasks.workunit.client.0.smithi043.stdout:9/377: readlink d0/l3f 0 2023-12-08T20:28:18.939 INFO:tasks.workunit.client.0.smithi043.stdout:9/378: chown d0/f34 54672 1 2023-12-08T20:28:18.941 INFO:tasks.workunit.client.0.smithi043.stdout:3/379: link d1/d1c/l44 d1/d25/d2a/l78 0 2023-12-08T20:28:18.944 INFO:tasks.workunit.client.0.smithi043.stdout:9/379: symlink d0/d3d/d4b/d65/l78 0 2023-12-08T20:28:18.944 INFO:tasks.workunit.client.0.smithi043.stdout:4/343: dwrite d1/d14/d1d/d58/f62 [0,4194304] 0 2023-12-08T20:28:18.944 INFO:tasks.workunit.client.0.smithi043.stdout:4/344: getdents d1/d14/d25/d39/d3f/d3c/d41/d65 0 2023-12-08T20:28:18.946 INFO:tasks.workunit.client.0.smithi043.stdout:2/492: dread d0/d26/d37/d38/f6e [0,4194304] 0 2023-12-08T20:28:18.946 INFO:tasks.workunit.client.0.smithi043.stdout:3/380: rmdir d1/d1c/d29 39 2023-12-08T20:28:18.951 INFO:tasks.workunit.client.0.smithi043.stdout:4/345: creat d1/d14/d25/d39/d3f/f78 x:0 0 0 2023-12-08T20:28:18.951 INFO:tasks.workunit.client.0.smithi043.stdout:4/346: chown d1/d14/d25/d39/d3d/d40 42425 1 2023-12-08T20:28:18.958 INFO:tasks.workunit.client.0.smithi043.stdout:4/347: truncate d1/d14/d25/d39/d3f/f3a 3329782 0 2023-12-08T20:28:18.959 INFO:tasks.workunit.client.0.smithi043.stdout:4/348: write d1/d14/d25/d39/d3d/f61 [732638,100136] 0 2023-12-08T20:28:18.961 INFO:tasks.workunit.client.0.smithi043.stdout:4/349: truncate d1/d14/f24 4898031 0 2023-12-08T20:28:18.961 INFO:tasks.workunit.client.0.smithi043.stdout:4/350: chown d1/cf 0 1 2023-12-08T20:28:18.963 INFO:tasks.workunit.client.0.smithi043.stdout:6/369: dwrite d0/d2/d14/d8/f1e [0,4194304] 0 2023-12-08T20:28:18.969 INFO:tasks.workunit.client.0.smithi043.stdout:4/351: creat d1/d14/d25/d39/f79 x:0 0 0 2023-12-08T20:28:18.971 INFO:tasks.workunit.client.0.smithi043.stdout:9/380: dwrite d0/d5e/f47 [0,4194304] 0 2023-12-08T20:28:18.974 INFO:tasks.workunit.client.0.smithi043.stdout:2/493: dwrite d0/db/d18/f22 [0,4194304] 0 2023-12-08T20:28:18.974 INFO:tasks.workunit.client.0.smithi043.stdout:2/494: chown d0/db/d18/f22 36441682 1 2023-12-08T20:28:18.978 INFO:tasks.workunit.client.0.smithi043.stdout:6/370: link d0/l1 d0/d2/d14/d20/d3c/d50/l82 0 2023-12-08T20:28:18.980 INFO:tasks.workunit.client.0.smithi043.stdout:4/352: creat d1/d14/d50/f7a x:0 0 0 2023-12-08T20:28:18.980 INFO:tasks.workunit.client.0.smithi043.stdout:4/353: chown d1/f5f 63788360 1 2023-12-08T20:28:18.983 INFO:tasks.workunit.client.0.smithi043.stdout:2/495: truncate d0/d2b/d4e/d79/f7c 1071347 0 2023-12-08T20:28:18.985 INFO:tasks.workunit.client.0.smithi043.stdout:2/496: write d0/db/f63 [1246622,47174] 0 2023-12-08T20:28:18.987 INFO:tasks.workunit.client.0.smithi043.stdout:6/371: creat d0/d2/d29/f83 x:0 0 0 2023-12-08T20:28:18.989 INFO:tasks.workunit.client.0.smithi043.stdout:4/354: link d1/f5 d1/f7b 0 2023-12-08T20:28:18.991 INFO:tasks.workunit.client.0.smithi043.stdout:6/372: mknod d0/d2/d14/d2c/d22/d2a/c84 0 2023-12-08T20:28:18.993 INFO:tasks.workunit.client.0.smithi043.stdout:4/355: symlink d1/d14/d25/d39/l7c 0 2023-12-08T20:28:18.993 INFO:tasks.workunit.client.0.smithi043.stdout:8/412: sync 2023-12-08T20:28:18.994 INFO:tasks.workunit.client.0.smithi043.stdout:1/397: sync 2023-12-08T20:28:18.994 INFO:tasks.workunit.client.0.smithi043.stdout:7/266: sync 2023-12-08T20:28:18.994 INFO:tasks.workunit.client.0.smithi043.stdout:0/410: sync 2023-12-08T20:28:18.995 INFO:tasks.workunit.client.0.smithi043.stdout:1/398: symlink d1/d16/d21/l8f 0 2023-12-08T20:28:18.996 INFO:tasks.workunit.client.0.smithi043.stdout:1/399: write d1/d16/f18 [1164210,11256] 0 2023-12-08T20:28:18.997 INFO:tasks.workunit.client.0.smithi043.stdout:7/267: mknod d0/d2/d12/d19/c5c 0 2023-12-08T20:28:18.997 INFO:tasks.workunit.client.0.smithi043.stdout:7/268: write d0/d2/f27 [351673,44080] 0 2023-12-08T20:28:18.997 INFO:tasks.workunit.client.0.smithi043.stdout:7/269: fdatasync d0/d6/d8/f15 0 2023-12-08T20:28:18.997 INFO:tasks.workunit.client.0.smithi043.stdout:7/270: dread - d0/d2/f46 zero size 2023-12-08T20:28:18.997 INFO:tasks.workunit.client.0.smithi043.stdout:5/385: sync 2023-12-08T20:28:18.998 INFO:tasks.workunit.client.0.smithi043.stdout:7/271: mknod d0/d5b/c5d 0 2023-12-08T20:28:19.001 INFO:tasks.workunit.client.0.smithi043.stdout:5/386: stat d3/c2f 0 2023-12-08T20:28:19.002 INFO:tasks.workunit.client.0.smithi043.stdout:5/387: chown d3/d7/de/d6a 431495 1 2023-12-08T20:28:19.002 INFO:tasks.workunit.client.0.smithi043.stdout:5/388: truncate d3/d7/d19/d3f/f62 249721 0 2023-12-08T20:28:19.002 INFO:tasks.workunit.client.0.smithi043.stdout:7/272: unlink d0/d6/d8/f1e 0 2023-12-08T20:28:19.007 INFO:tasks.workunit.client.0.smithi043.stdout:7/273: rename d0/d2/d12/f2c to d0/d5b/f5e 0 2023-12-08T20:28:19.007 INFO:tasks.workunit.client.0.smithi043.stdout:7/274: mknod d0/d2/d12/d19/c5f 0 2023-12-08T20:28:19.007 INFO:tasks.workunit.client.0.smithi043.stdout:7/275: chown d0/d5b/c5d 96325211 1 2023-12-08T20:28:19.023 INFO:tasks.workunit.client.0.smithi043.stdout:4/356: dwrite d1/d14/f18 [4194304,4194304] 0 2023-12-08T20:28:19.024 INFO:tasks.workunit.client.0.smithi043.stdout:8/413: dread d2/d20/d7d/d29/d30/f41 [0,4194304] 0 2023-12-08T20:28:19.029 INFO:tasks.workunit.client.0.smithi043.stdout:2/497: dwrite d0/d20/f32 [0,4194304] 0 2023-12-08T20:28:19.029 INFO:tasks.workunit.client.0.smithi043.stdout:0/411: dwrite d2/d3/f1a [0,4194304] 0 2023-12-08T20:28:19.029 INFO:tasks.workunit.client.0.smithi043.stdout:1/400: dwrite d1/d16/d21/d25/d3e/d72/f74 [0,4194304] 0 2023-12-08T20:28:19.029 INFO:tasks.workunit.client.0.smithi043.stdout:1/401: chown d1/d16/f4d 8246650 1 2023-12-08T20:28:19.029 INFO:tasks.workunit.client.0.smithi043.stdout:1/402: write d1/d16/d1c/d4e/f7b [108513,113948] 0 2023-12-08T20:28:19.030 INFO:tasks.workunit.client.0.smithi043.stdout:7/276: rename d0/d5b/f5e to d0/d6/d17/d54/f60 0 2023-12-08T20:28:19.031 INFO:tasks.workunit.client.0.smithi043.stdout:7/277: readlink d0/d6/l2d 0 2023-12-08T20:28:19.031 INFO:tasks.workunit.client.0.smithi043.stdout:7/278: write d0/f42 [65866,35896] 0 2023-12-08T20:28:19.031 INFO:tasks.workunit.client.0.smithi043.stdout:7/279: truncate d0/d2/f3a 2055738 0 2023-12-08T20:28:19.033 INFO:tasks.workunit.client.0.smithi043.stdout:2/498: creat d0/db/fa5 x:0 0 0 2023-12-08T20:28:19.037 INFO:tasks.workunit.client.0.smithi043.stdout:5/389: dwrite d3/d7/d19/d3f/f58 [0,4194304] 0 2023-12-08T20:28:19.041 INFO:tasks.workunit.client.0.smithi043.stdout:5/390: dread d3/d7/d19/d3f/f62 [0,4194304] 0 2023-12-08T20:28:19.041 INFO:tasks.workunit.client.0.smithi043.stdout:5/391: write d3/d7/d19/d3f/d52/f70 [350477,96187] 0 2023-12-08T20:28:19.042 INFO:tasks.workunit.client.0.smithi043.stdout:0/412: symlink d2/d3/d6/d39/d63/l80 0 2023-12-08T20:28:19.042 INFO:tasks.workunit.client.0.smithi043.stdout:1/403: unlink d1/d6/c10 0 2023-12-08T20:28:19.042 INFO:tasks.workunit.client.0.smithi043.stdout:4/357: rename d1/d14/d25/d39/d3d/f61 to d1/d14/d25/d39/d3f/d3c/d41/d65/f7d 0 2023-12-08T20:28:19.047 INFO:tasks.workunit.client.0.smithi043.stdout:2/499: truncate d0/db/f19 3352525 0 2023-12-08T20:28:19.048 INFO:tasks.workunit.client.0.smithi043.stdout:0/413: rename d2/d3/d18/d2b/c5b to d2/d4/c81 0 2023-12-08T20:28:19.048 INFO:tasks.workunit.client.0.smithi043.stdout:0/414: fsync d2/d4/fe 0 2023-12-08T20:28:19.051 INFO:tasks.workunit.client.0.smithi043.stdout:7/280: dwrite d0/f1b [4194304,4194304] 0 2023-12-08T20:28:19.051 INFO:tasks.workunit.client.0.smithi043.stdout:2/500: mkdir d0/da6 0 2023-12-08T20:28:19.051 INFO:tasks.workunit.client.0.smithi043.stdout:5/392: dread d3/d7/d19/d3f/f58 [0,4194304] 0 2023-12-08T20:28:19.051 INFO:tasks.workunit.client.0.smithi043.stdout:5/393: read - d3/d7/d21/d51/d5c/f67 zero size 2023-12-08T20:28:19.052 INFO:tasks.workunit.client.0.smithi043.stdout:0/415: write d2/d4/f4b [935156,38033] 0 2023-12-08T20:28:19.066 INFO:tasks.workunit.client.0.smithi043.stdout:7/281: mkdir d0/d61 0 2023-12-08T20:28:19.066 INFO:tasks.workunit.client.0.smithi043.stdout:5/394: dread d3/d7/d19/d3f/d52/f66 [0,4194304] 0 2023-12-08T20:28:19.066 INFO:tasks.workunit.client.0.smithi043.stdout:5/395: chown d3/d7/de/d17/c26 0 1 2023-12-08T20:28:19.066 INFO:tasks.workunit.client.0.smithi043.stdout:5/396: dread - d3/d7/d21/d51/d5c/f67 zero size 2023-12-08T20:28:19.067 INFO:tasks.workunit.client.0.smithi043.stdout:7/282: symlink d0/d6/d17/l62 0 2023-12-08T20:28:19.070 INFO:tasks.workunit.client.0.smithi043.stdout:0/416: dread d2/f24 [0,4194304] 0 2023-12-08T20:28:19.070 INFO:tasks.workunit.client.0.smithi043.stdout:4/358: dwrite d1/f11 [0,4194304] 0 2023-12-08T20:28:19.070 INFO:tasks.workunit.client.0.smithi043.stdout:4/359: dread - d1/d14/d50/f7a zero size 2023-12-08T20:28:19.070 INFO:tasks.workunit.client.0.smithi043.stdout:4/360: chown d1/d14/d25/d39/d3d/d40/l5d 135841294 1 2023-12-08T20:28:19.073 INFO:tasks.workunit.client.0.smithi043.stdout:0/417: creat d2/d4/f82 x:0 0 0 2023-12-08T20:28:19.073 INFO:tasks.workunit.client.0.smithi043.stdout:4/361: creat d1/d14/d25/d39/d3f/f7e x:0 0 0 2023-12-08T20:28:19.073 INFO:tasks.workunit.client.0.smithi043.stdout:4/362: chown d1/d14/d25/d39/d3d/d40/d67/c6a 60 1 2023-12-08T20:28:19.073 INFO:tasks.workunit.client.0.smithi043.stdout:0/418: mkdir d2/d3/d6/d39/d83 0 2023-12-08T20:28:19.074 INFO:tasks.workunit.client.0.smithi043.stdout:4/363: write d1/f6 [4944203,36620] 0 2023-12-08T20:28:19.074 INFO:tasks.workunit.client.0.smithi043.stdout:4/364: write d1/d14/d25/d39/d3f/d3c/d41/d65/f7d [223377,72470] 0 2023-12-08T20:28:19.075 INFO:tasks.workunit.client.0.smithi043.stdout:0/419: symlink d2/d3/d6/d39/d83/l84 0 2023-12-08T20:28:19.077 INFO:tasks.workunit.client.0.smithi043.stdout:2/501: dwrite d0/db/d18/f22 [0,4194304] 0 2023-12-08T20:28:19.080 INFO:tasks.workunit.client.0.smithi043.stdout:2/502: write d0/d26/f3b [3939815,117853] 0 2023-12-08T20:28:19.082 INFO:tasks.workunit.client.0.smithi043.stdout:5/397: write d3/d7/de/f24 [841701,59426] 0 2023-12-08T20:28:19.082 INFO:tasks.workunit.client.0.smithi043.stdout:5/398: chown d3/d7/de/d17/c26 72 1 2023-12-08T20:28:19.082 INFO:tasks.workunit.client.0.smithi043.stdout:5/399: chown d3/d7/d19/d3f/c63 52 1 2023-12-08T20:28:19.084 INFO:tasks.workunit.client.0.smithi043.stdout:2/503: dread d0/db/d18/d3d/f40 [0,4194304] 0 2023-12-08T20:28:19.086 INFO:tasks.workunit.client.0.smithi043.stdout:4/365: truncate d1/f10 1416352 0 2023-12-08T20:28:19.086 INFO:tasks.workunit.client.0.smithi043.stdout:0/420: mknod d2/d3/d18/d1e/c85 0 2023-12-08T20:28:19.086 INFO:tasks.workunit.client.0.smithi043.stdout:0/421: chown d2/d3/d6/d39/d63/l80 3838 1 2023-12-08T20:28:19.097 INFO:tasks.workunit.client.0.smithi043.stdout:2/504: mkdir d0/d26/da7 0 2023-12-08T20:28:19.102 INFO:tasks.workunit.client.0.smithi043.stdout:7/283: dwrite d0/d2/d12/d19/d38/f55 [0,4194304] 0 2023-12-08T20:28:19.107 INFO:tasks.workunit.client.0.smithi043.stdout:4/366: dread d1/d14/d25/d39/d3f/d3c/d41/f43 [0,4194304] 0 2023-12-08T20:28:19.108 INFO:tasks.workunit.client.0.smithi043.stdout:2/505: unlink d0/db/d18/d3d/c7a 0 2023-12-08T20:28:19.111 INFO:tasks.workunit.client.0.smithi043.stdout:0/422: dwrite d2/d4/f82 [0,4194304] 0 2023-12-08T20:28:19.117 INFO:tasks.workunit.client.0.smithi043.stdout:2/506: creat d0/d26/fa8 x:0 0 0 2023-12-08T20:28:19.117 INFO:tasks.workunit.client.0.smithi043.stdout:2/507: fdatasync d0/db/d18/f4b 0 2023-12-08T20:28:19.117 INFO:tasks.workunit.client.0.smithi043.stdout:4/367: write d1/d14/d1d/f1e [3863074,127367] 0 2023-12-08T20:28:19.117 INFO:tasks.workunit.client.0.smithi043.stdout:4/368: fdatasync d1/f5f 0 2023-12-08T20:28:19.117 INFO:tasks.workunit.client.0.smithi043.stdout:4/369: chown d1/d14/d25/d28/f2b 5730014 1 2023-12-08T20:28:19.118 INFO:tasks.workunit.client.0.smithi043.stdout:2/508: write d0/f9 [1965857,48597] 0 2023-12-08T20:28:19.119 INFO:tasks.workunit.client.0.smithi043.stdout:0/423: unlink d2/d3/d18/l31 0 2023-12-08T20:28:19.120 INFO:tasks.workunit.client.0.smithi043.stdout:4/370: mkdir d1/d14/d25/d39/d3d/d40/d67/d7f 0 2023-12-08T20:28:19.121 INFO:tasks.workunit.client.0.smithi043.stdout:2/509: mkdir d0/d2b/d4e/d93/da9 0 2023-12-08T20:28:19.121 INFO:tasks.workunit.client.0.smithi043.stdout:2/510: fsync d0/db/f4a 0 2023-12-08T20:28:19.122 INFO:tasks.workunit.client.0.smithi043.stdout:0/424: mkdir d2/d3/d18/d2b/d4f/d5f/d79/d86 0 2023-12-08T20:28:19.123 INFO:tasks.workunit.client.0.smithi043.stdout:2/511: truncate d0/d20/f76 977336 0 2023-12-08T20:28:19.123 INFO:tasks.workunit.client.0.smithi043.stdout:2/512: write d0/db/d18/f7e [885898,24632] 0 2023-12-08T20:28:19.125 INFO:tasks.workunit.client.0.smithi043.stdout:7/284: dwrite d0/d6/f29 [0,4194304] 0 2023-12-08T20:28:19.127 INFO:tasks.workunit.client.0.smithi043.stdout:7/285: creat d0/d5b/f63 x:0 0 0 2023-12-08T20:28:19.129 INFO:tasks.workunit.client.0.smithi043.stdout:3/381: sync 2023-12-08T20:28:19.130 INFO:tasks.workunit.client.0.smithi043.stdout:2/513: dread d0/db/d18/f1a [0,4194304] 0 2023-12-08T20:28:19.130 INFO:tasks.workunit.client.0.smithi043.stdout:7/286: dread d0/d2/f21 [0,4194304] 0 2023-12-08T20:28:19.132 INFO:tasks.workunit.client.0.smithi043.stdout:3/382: write d1/d9/d38/d30/f59 [1878299,74324] 0 2023-12-08T20:28:19.132 INFO:tasks.workunit.client.0.smithi043.stdout:4/371: dread d1/d14/f48 [0,4194304] 0 2023-12-08T20:28:19.132 INFO:tasks.workunit.client.0.smithi043.stdout:4/372: chown d1/f11 53656287 1 2023-12-08T20:28:19.135 INFO:tasks.workunit.client.0.smithi043.stdout:2/514: mkdir d0/d81/daa 0 2023-12-08T20:28:19.139 INFO:tasks.workunit.client.0.smithi043.stdout:2/515: dread d0/d2b/d4e/d79/f7c [0,4194304] 0 2023-12-08T20:28:19.141 INFO:tasks.workunit.client.0.smithi043.stdout:3/383: creat d1/d9/d38/d4f/f79 x:0 0 0 2023-12-08T20:28:19.142 INFO:tasks.workunit.client.0.smithi043.stdout:3/384: write d1/d1c/d29/f57 [1192183,128434] 0 2023-12-08T20:28:19.142 INFO:tasks.workunit.client.0.smithi043.stdout:4/373: mkdir d1/d14/d25/d39/d3f/d3c/d80 0 2023-12-08T20:28:19.156 INFO:tasks.workunit.client.0.smithi043.stdout:3/385: dread d1/d1c/f22 [0,4194304] 0 2023-12-08T20:28:19.159 INFO:tasks.workunit.client.0.smithi043.stdout:4/374: dread d1/f6 [0,4194304] 0 2023-12-08T20:28:19.162 INFO:tasks.workunit.client.0.smithi043.stdout:4/375: link d1/d14/d25/d39/d3d/d40/f6c d1/d14/d25/d28/f81 0 2023-12-08T20:28:19.162 INFO:tasks.workunit.client.0.smithi043.stdout:4/376: truncate d1/d14/f18 8946166 0 2023-12-08T20:28:19.162 INFO:tasks.workunit.client.0.smithi043.stdout:4/377: chown d1/d14 21643377 1 2023-12-08T20:28:19.166 INFO:tasks.workunit.client.0.smithi043.stdout:2/516: dwrite d0/db/f54 [0,4194304] 0 2023-12-08T20:28:19.168 INFO:tasks.workunit.client.0.smithi043.stdout:7/287: dwrite d0/d2/d12/f32 [4194304,4194304] 0 2023-12-08T20:28:19.170 INFO:tasks.workunit.client.0.smithi043.stdout:2/517: mkdir d0/db/d18/d66/d71/dab 0 2023-12-08T20:28:19.173 INFO:tasks.workunit.client.0.smithi043.stdout:7/288: getdents d0/d6 0 2023-12-08T20:28:19.175 INFO:tasks.workunit.client.0.smithi043.stdout:2/518: creat d0/db/d18/d66/d71/fac x:0 0 0 2023-12-08T20:28:19.176 INFO:tasks.workunit.client.0.smithi043.stdout:7/289: creat d0/d6/d8/f64 x:0 0 0 2023-12-08T20:28:19.183 INFO:tasks.workunit.client.0.smithi043.stdout:2/519: dread d0/db/f14 [0,4194304] 0 2023-12-08T20:28:19.184 INFO:tasks.workunit.client.0.smithi043.stdout:2/520: readlink d0/db/l73 0 2023-12-08T20:28:19.185 INFO:tasks.workunit.client.0.smithi043.stdout:3/386: dwrite d1/d25/f24 [4194304,4194304] 0 2023-12-08T20:28:19.186 INFO:tasks.workunit.client.0.smithi043.stdout:2/521: symlink d0/d2b/lad 0 2023-12-08T20:28:19.186 INFO:tasks.workunit.client.0.smithi043.stdout:2/522: chown d0/d26/d37/d38/f84 101076559 1 2023-12-08T20:28:19.188 INFO:tasks.workunit.client.0.smithi043.stdout:7/290: dread d0/d6/d8/f15 [0,4194304] 0 2023-12-08T20:28:19.188 INFO:tasks.workunit.client.0.smithi043.stdout:4/378: dwrite d1/f7b [0,4194304] 0 2023-12-08T20:28:19.188 INFO:tasks.workunit.client.0.smithi043.stdout:4/379: truncate d1/d14/d25/d39/d3d/d40/d67/f68 3991576 0 2023-12-08T20:28:19.188 INFO:tasks.workunit.client.0.smithi043.stdout:4/380: fdatasync d1/f5 0 2023-12-08T20:28:19.188 INFO:tasks.workunit.client.0.smithi043.stdout:4/381: readlink d1/d14/d25/d39/d3d/d40/l70 0 2023-12-08T20:28:19.188 INFO:tasks.workunit.client.0.smithi043.stdout:4/382: chown d1/d14/d25/d39/d3f/f3a 282311 1 2023-12-08T20:28:19.188 INFO:tasks.workunit.client.0.smithi043.stdout:4/383: truncate d1/d14/d25/d39/d3f/f78 32883 0 2023-12-08T20:28:19.188 INFO:tasks.workunit.client.0.smithi043.stdout:3/387: rename d1/d9/fe to d1/d1c/d2c/d76/f7a 0 2023-12-08T20:28:19.190 INFO:tasks.workunit.client.0.smithi043.stdout:3/388: mknod d1/d25/c7b 0 2023-12-08T20:28:19.190 INFO:tasks.workunit.client.0.smithi043.stdout:4/384: creat d1/d14/d25/d39/d3f/d3c/d80/f82 x:0 0 0 2023-12-08T20:28:19.192 INFO:tasks.workunit.client.0.smithi043.stdout:3/389: symlink d1/d25/d2a/l7c 0 2023-12-08T20:28:19.192 INFO:tasks.workunit.client.0.smithi043.stdout:3/390: truncate d1/d1c/d2c/d76/f7a 4385372 0 2023-12-08T20:28:19.194 INFO:tasks.workunit.client.0.smithi043.stdout:3/391: mkdir d1/d9/df/d6e/d7d 0 2023-12-08T20:28:19.194 INFO:tasks.workunit.client.0.smithi043.stdout:3/392: chown d1/d1c/l44 46790006 1 2023-12-08T20:28:19.201 INFO:tasks.workunit.client.0.smithi043.stdout:7/291: dread d0/d6/f1a [0,4194304] 0 2023-12-08T20:28:19.206 INFO:tasks.workunit.client.0.smithi043.stdout:4/385: truncate d1/f7b 2724570 0 2023-12-08T20:28:19.208 INFO:tasks.workunit.client.0.smithi043.stdout:4/386: getdents d1/d14/d50 0 2023-12-08T20:28:19.209 INFO:tasks.workunit.client.0.smithi043.stdout:4/387: fdatasync d1/d14/d50/f53 0 2023-12-08T20:28:19.209 INFO:tasks.workunit.client.0.smithi043.stdout:4/388: truncate d1/d14/d25/d28/f4f 480004 0 2023-12-08T20:28:19.209 INFO:tasks.workunit.client.0.smithi043.stdout:4/389: truncate d1/d14/d25/d28/f81 719176 0 2023-12-08T20:28:19.212 INFO:tasks.workunit.client.0.smithi043.stdout:4/390: write d1/d14/f18 [6327821,108793] 0 2023-12-08T20:28:19.216 INFO:tasks.workunit.client.0.smithi043.stdout:2/523: dwrite d0/d26/f3b [0,4194304] 0 2023-12-08T20:28:19.216 INFO:tasks.workunit.client.0.smithi043.stdout:2/524: chown d0/d20/d42/d49/l85 357 1 2023-12-08T20:28:19.216 INFO:tasks.workunit.client.0.smithi043.stdout:2/525: chown d0/d2b 1 1 2023-12-08T20:28:19.218 INFO:tasks.workunit.client.0.smithi043.stdout:4/391: link d1/f73 d1/d14/d25/d39/d3d/d40/d67/f83 0 2023-12-08T20:28:19.219 INFO:tasks.workunit.client.0.smithi043.stdout:2/526: unlink d0/d20/d42/f72 0 2023-12-08T20:28:19.220 INFO:tasks.workunit.client.0.smithi043.stdout:4/392: creat d1/d14/d25/d77/f84 x:0 0 0 2023-12-08T20:28:19.220 INFO:tasks.workunit.client.0.smithi043.stdout:2/527: rmdir d0/d2b/d4e/d93 39 2023-12-08T20:28:19.222 INFO:tasks.workunit.client.0.smithi043.stdout:4/393: rmdir d1/d14/d25/d39/d3f/d59 39 2023-12-08T20:28:19.222 INFO:tasks.workunit.client.0.smithi043.stdout:2/528: write d0/d81/f8a [913638,9635] 0 2023-12-08T20:28:19.225 INFO:tasks.workunit.client.0.smithi043.stdout:7/292: dwrite d0/d6/f29 [0,4194304] 0 2023-12-08T20:28:19.226 INFO:tasks.workunit.client.0.smithi043.stdout:4/394: symlink d1/d14/d25/d39/d3d/d40/l85 0 2023-12-08T20:28:19.227 INFO:tasks.workunit.client.0.smithi043.stdout:2/529: mkdir d0/d26/d37/d38/dae 0 2023-12-08T20:28:19.228 INFO:tasks.workunit.client.0.smithi043.stdout:2/530: read d0/db/f4a [236611,30732] 0 2023-12-08T20:28:19.229 INFO:tasks.workunit.client.0.smithi043.stdout:2/531: dread - d0/db/d18/d3d/f50 zero size 2023-12-08T20:28:19.229 INFO:tasks.workunit.client.0.smithi043.stdout:2/532: chown d0/d20/d42/f78 171 1 2023-12-08T20:28:19.232 INFO:tasks.workunit.client.0.smithi043.stdout:7/293: rmdir d0/d6 39 2023-12-08T20:28:19.235 INFO:tasks.workunit.client.0.smithi043.stdout:7/294: mkdir d0/d2/d65 0 2023-12-08T20:28:19.235 INFO:tasks.workunit.client.0.smithi043.stdout:7/295: write d0/d6/d8/f64 [1013533,57652] 0 2023-12-08T20:28:19.235 INFO:tasks.workunit.client.0.smithi043.stdout:7/296: write d0/d2/d12/d19/f41 [1035719,20965] 0 2023-12-08T20:28:19.237 INFO:tasks.workunit.client.0.smithi043.stdout:7/297: rmdir d0/d6 39 2023-12-08T20:28:19.240 INFO:tasks.workunit.client.0.smithi043.stdout:7/298: link d0/c4 d0/d5b/c66 0 2023-12-08T20:28:19.241 INFO:tasks.workunit.client.0.smithi043.stdout:7/299: read - d0/d5b/f63 zero size 2023-12-08T20:28:19.241 INFO:tasks.workunit.client.0.smithi043.stdout:7/300: stat d0/d6/d8 0 2023-12-08T20:28:19.248 INFO:tasks.workunit.client.0.smithi043.stdout:2/533: dread d0/d2b/d4e/f5a [0,4194304] 0 2023-12-08T20:28:19.253 INFO:tasks.workunit.client.0.smithi043.stdout:4/395: dwrite d1/d14/d25/d39/d3d/d40/f69 [0,4194304] 0 2023-12-08T20:28:19.255 INFO:tasks.workunit.client.0.smithi043.stdout:2/534: rename d0/d26/d37/d38/f6e to d0/db/faf 0 2023-12-08T20:28:19.255 INFO:tasks.workunit.client.0.smithi043.stdout:2/535: dread - d0/db/d18/f99 zero size 2023-12-08T20:28:19.258 INFO:tasks.workunit.client.0.smithi043.stdout:4/396: mknod d1/d14/d25/d77/c86 0 2023-12-08T20:28:19.258 INFO:tasks.workunit.client.0.smithi043.stdout:9/381: sync 2023-12-08T20:28:19.258 INFO:tasks.workunit.client.0.smithi043.stdout:9/382: stat d0/cc 0 2023-12-08T20:28:19.259 INFO:tasks.workunit.client.0.smithi043.stdout:6/373: sync 2023-12-08T20:28:19.259 INFO:tasks.workunit.client.0.smithi043.stdout:6/374: rename d0/d2 to d0/d2/d14/d2c/d66/d85 22 2023-12-08T20:28:19.263 INFO:tasks.workunit.client.0.smithi043.stdout:4/397: creat d1/d14/f87 x:0 0 0 2023-12-08T20:28:19.268 INFO:tasks.workunit.client.0.smithi043.stdout:4/398: mkdir d1/d14/d25/d39/d3d/d40/d67/d88 0 2023-12-08T20:28:19.270 INFO:tasks.workunit.client.0.smithi043.stdout:7/301: dwrite d0/d6/f18 [0,4194304] 0 2023-12-08T20:28:19.273 INFO:tasks.workunit.client.0.smithi043.stdout:7/302: symlink d0/d2/d12/l67 0 2023-12-08T20:28:19.282 INFO:tasks.workunit.client.0.smithi043.stdout:2/536: dwrite d0/d26/d37/d38/f41 [4194304,4194304] 0 2023-12-08T20:28:19.283 INFO:tasks.workunit.client.0.smithi043.stdout:2/537: write d0/db/f31 [112121,96427] 0 2023-12-08T20:28:19.284 INFO:tasks.workunit.client.0.smithi043.stdout:7/303: dread d0/d6/d17/d54/f60 [0,4194304] 0 2023-12-08T20:28:19.285 INFO:tasks.workunit.client.0.smithi043.stdout:6/375: dwrite d0/d2/d14/d20/d49/f64 [0,4194304] 0 2023-12-08T20:28:19.286 INFO:tasks.workunit.client.0.smithi043.stdout:6/376: chown d0/d2/d14/d20/d3c/d50/c5b 2238942 1 2023-12-08T20:28:19.286 INFO:tasks.workunit.client.0.smithi043.stdout:6/377: truncate d0/d2/d14/d2c/f65 65773 0 2023-12-08T20:28:19.287 INFO:tasks.workunit.client.0.smithi043.stdout:2/538: rename d0/d26/d37/d38/f8c to d0/db/d18/d8b/fb0 0 2023-12-08T20:28:19.289 INFO:tasks.workunit.client.0.smithi043.stdout:2/539: write d0/d2b/f46 [2679136,29475] 0 2023-12-08T20:28:19.289 INFO:tasks.workunit.client.0.smithi043.stdout:2/540: stat d0/d26/d37/d38 0 2023-12-08T20:28:19.289 INFO:tasks.workunit.client.0.smithi043.stdout:2/541: chown d0/f25 17 1 2023-12-08T20:28:19.290 INFO:tasks.workunit.client.0.smithi043.stdout:2/542: chown d0/db/fa5 1 1 2023-12-08T20:28:19.290 INFO:tasks.workunit.client.0.smithi043.stdout:7/304: mknod d0/d6/d17/d54/c68 0 2023-12-08T20:28:19.290 INFO:tasks.workunit.client.0.smithi043.stdout:9/383: dwrite d0/d5e/f33 [0,4194304] 0 2023-12-08T20:28:19.293 INFO:tasks.workunit.client.0.smithi043.stdout:2/543: mknod d0/db/d18/cb1 0 2023-12-08T20:28:19.293 INFO:tasks.workunit.client.0.smithi043.stdout:6/378: truncate d0/f54 25203 0 2023-12-08T20:28:19.294 INFO:tasks.workunit.client.0.smithi043.stdout:7/305: mkdir d0/d69 0 2023-12-08T20:28:19.296 INFO:tasks.workunit.client.0.smithi043.stdout:6/379: write d0/d2/d29/f52 [121187,59418] 0 2023-12-08T20:28:19.297 INFO:tasks.workunit.client.0.smithi043.stdout:9/384: rmdir d0/d3d 39 2023-12-08T20:28:19.299 INFO:tasks.workunit.client.0.smithi043.stdout:7/306: link d0/d2/f27 d0/f6a 0 2023-12-08T20:28:19.300 INFO:tasks.workunit.client.0.smithi043.stdout:6/380: mknod d0/d2/de/d4a/d56/c86 0 2023-12-08T20:28:19.301 INFO:tasks.workunit.client.0.smithi043.stdout:9/385: creat d0/d5e/f79 x:0 0 0 2023-12-08T20:28:19.308 INFO:tasks.workunit.client.0.smithi043.stdout:2/544: truncate d0/db/f31 2038525 0 2023-12-08T20:28:19.308 INFO:tasks.workunit.client.0.smithi043.stdout:2/545: chown d0/db 868 1 2023-12-08T20:28:19.308 INFO:tasks.workunit.client.0.smithi043.stdout:7/307: unlink d0/d2/d12/d19/f2b 0 2023-12-08T20:28:19.310 INFO:tasks.workunit.client.0.smithi043.stdout:6/381: rename d0/d2/d14/d20/ff to d0/d2/d14/d20/d3c/f87 0 2023-12-08T20:28:19.311 INFO:tasks.workunit.client.0.smithi043.stdout:6/382: chown d0/d2/de/d4a/d56/d59 52 1 2023-12-08T20:28:19.311 INFO:tasks.workunit.client.0.smithi043.stdout:6/383: chown d0/d2/d14/d2c/f3b 5755 1 2023-12-08T20:28:19.311 INFO:tasks.workunit.client.0.smithi043.stdout:9/386: mknod d0/d3d/c7a 0 2023-12-08T20:28:19.314 INFO:tasks.workunit.client.0.smithi043.stdout:9/387: rename d0/d21/f4f to d0/d5e/d37/d6b/d6c/f7b 0 2023-12-08T20:28:19.318 INFO:tasks.workunit.client.0.smithi043.stdout:7/308: dread d0/d6/d8/f10 [0,4194304] 0 2023-12-08T20:28:19.325 INFO:tasks.workunit.client.0.smithi043.stdout:6/384: dread d0/f35 [0,4194304] 0 2023-12-08T20:28:19.326 INFO:tasks.workunit.client.0.smithi043.stdout:6/385: write d0/d2/d14/d8/d47/f80 [724744,734] 0 2023-12-08T20:28:19.326 INFO:tasks.workunit.client.0.smithi043.stdout:9/388: write d0/d5e/f47 [884375,48997] 0 2023-12-08T20:28:19.327 INFO:tasks.workunit.client.0.smithi043.stdout:6/386: creat d0/d2/d14/d8/d47/d60/f88 x:0 0 0 2023-12-08T20:28:19.328 INFO:tasks.workunit.client.0.smithi043.stdout:6/387: chown d0/d2/d14/d2c/d22/d2a/l2f 1871 1 2023-12-08T20:28:19.328 INFO:tasks.workunit.client.0.smithi043.stdout:6/388: stat d0/d2/d29/f52 0 2023-12-08T20:28:19.328 INFO:tasks.workunit.client.0.smithi043.stdout:2/546: dwrite d0/db/f19 [0,4194304] 0 2023-12-08T20:28:19.329 INFO:tasks.workunit.client.0.smithi043.stdout:9/389: unlink d0/d5e/d37/d6b/d76/f77 0 2023-12-08T20:28:19.329 INFO:tasks.workunit.client.0.smithi043.stdout:9/390: readlink d0/d21/l24 0 2023-12-08T20:28:19.330 INFO:tasks.workunit.client.0.smithi043.stdout:9/391: read d0/d3d/f45 [27062,99987] 0 2023-12-08T20:28:19.330 INFO:tasks.workunit.client.0.smithi043.stdout:6/389: mknod d0/d2/d29/c89 0 2023-12-08T20:28:19.333 INFO:tasks.workunit.client.0.smithi043.stdout:9/392: creat d0/d3d/d4b/f7c x:0 0 0 2023-12-08T20:28:19.333 INFO:tasks.workunit.client.0.smithi043.stdout:9/393: read - d0/d3d/f48 zero size 2023-12-08T20:28:19.333 INFO:tasks.workunit.client.0.smithi043.stdout:9/394: write d0/d5e/f40 [4435731,29610] 0 2023-12-08T20:28:19.334 INFO:tasks.workunit.client.0.smithi043.stdout:9/395: creat d0/d5e/d37/d6b/d6c/f7d x:0 0 0 2023-12-08T20:28:19.343 INFO:tasks.workunit.client.0.smithi043.stdout:2/547: truncate d0/d2b/d4e/f5a 3988056 0 2023-12-08T20:28:19.344 INFO:tasks.workunit.client.0.smithi043.stdout:6/390: dread d0/d2/d14/d8/d47/f80 [0,4194304] 0 2023-12-08T20:28:19.346 INFO:tasks.workunit.client.0.smithi043.stdout:6/391: creat d0/d2/d14/d2c/d22/d3f/d45/d6b/f8a x:0 0 0 2023-12-08T20:28:19.347 INFO:tasks.workunit.client.0.smithi043.stdout:6/392: symlink d0/d2/d14/d8/l8b 0 2023-12-08T20:28:19.348 INFO:tasks.workunit.client.0.smithi043.stdout:6/393: fdatasync d0/d2/de/d4a/d56/f72 0 2023-12-08T20:28:19.349 INFO:tasks.workunit.client.0.smithi043.stdout:6/394: creat d0/d2/d14/d2c/d22/f8c x:0 0 0 2023-12-08T20:28:19.349 INFO:tasks.workunit.client.0.smithi043.stdout:6/395: write d0/d2/d14/d20/d49/f62 [994087,21209] 0 2023-12-08T20:28:19.349 INFO:tasks.workunit.client.0.smithi043.stdout:7/309: dwrite d0/d2/f3a [0,4194304] 0 2023-12-08T20:28:19.349 INFO:tasks.workunit.client.0.smithi043.stdout:9/396: dread d0/d3d/f4c [0,4194304] 0 2023-12-08T20:28:19.350 INFO:tasks.workunit.client.0.smithi043.stdout:7/310: fsync d0/d2/f11 0 2023-12-08T20:28:19.350 INFO:tasks.workunit.client.0.smithi043.stdout:2/548: dread d0/d26/d37/d38/f5d [0,4194304] 0 2023-12-08T20:28:19.350 INFO:tasks.workunit.client.0.smithi043.stdout:6/396: creat d0/d2/d14/d8/d47/d60/f8d x:0 0 0 2023-12-08T20:28:19.350 INFO:tasks.workunit.client.0.smithi043.stdout:6/397: chown d0/d2/d14/d20/d3c/d50/c81 260766 1 2023-12-08T20:28:19.351 INFO:tasks.workunit.client.0.smithi043.stdout:7/311: unlink d0/c30 0 2023-12-08T20:28:19.352 INFO:tasks.workunit.client.0.smithi043.stdout:7/312: readlink d0/d2/l3f 0 2023-12-08T20:28:19.352 INFO:tasks.workunit.client.0.smithi043.stdout:6/398: mkdir d0/d2/d14/d2c/d66/d8e 0 2023-12-08T20:28:19.353 INFO:tasks.workunit.client.0.smithi043.stdout:7/313: unlink d0/d6/c28 0 2023-12-08T20:28:19.354 INFO:tasks.workunit.client.0.smithi043.stdout:6/399: dread d0/f34 [0,4194304] 0 2023-12-08T20:28:19.356 INFO:tasks.workunit.client.0.smithi043.stdout:6/400: rename d0/l37 to d0/d2/d14/l8f 0 2023-12-08T20:28:19.357 INFO:tasks.workunit.client.0.smithi043.stdout:2/549: dread d0/f9 [0,4194304] 0 2023-12-08T20:28:19.359 INFO:tasks.workunit.client.0.smithi043.stdout:2/550: creat d0/d26/d53/fb2 x:0 0 0 2023-12-08T20:28:19.360 INFO:tasks.workunit.client.0.smithi043.stdout:2/551: creat d0/db/d18/d3d/fb3 x:0 0 0 2023-12-08T20:28:19.370 INFO:tasks.workunit.client.0.smithi043.stdout:7/314: dwrite d0/d2/d12/d19/f40 [0,4194304] 0 2023-12-08T20:28:19.371 INFO:tasks.workunit.client.0.smithi043.stdout:7/315: read d0/d2/f21 [85965,87394] 0 2023-12-08T20:28:19.373 INFO:tasks.workunit.client.0.smithi043.stdout:6/401: dwrite d0/d2/d14/d2c/d22/d3f/d45/f6d [0,4194304] 0 2023-12-08T20:28:19.389 INFO:tasks.workunit.client.0.smithi043.stdout:7/316: dwrite d0/d2/d12/f32 [0,4194304] 0 2023-12-08T20:28:19.405 INFO:tasks.workunit.client.0.smithi043.stdout:7/317: dwrite d0/d2/f21 [0,4194304] 0 2023-12-08T20:28:19.406 INFO:tasks.workunit.client.0.smithi043.stdout:7/318: mknod d0/d6/d8/d47/c6b 0 2023-12-08T20:28:19.407 INFO:tasks.workunit.client.0.smithi043.stdout:7/319: creat d0/d6/d8/d47/f6c x:0 0 0 2023-12-08T20:28:19.407 INFO:tasks.workunit.client.0.smithi043.stdout:7/320: fsync d0/d2/f11 0 2023-12-08T20:28:19.408 INFO:tasks.workunit.client.0.smithi043.stdout:7/321: mkdir d0/d69/d6d 0 2023-12-08T20:28:19.408 INFO:tasks.workunit.client.0.smithi043.stdout:7/322: chown d0/d6/d8/c45 388 1 2023-12-08T20:28:19.408 INFO:tasks.workunit.client.0.smithi043.stdout:7/323: mknod d0/d2/d12/c6e 0 2023-12-08T20:28:19.409 INFO:tasks.workunit.client.0.smithi043.stdout:7/324: readlink d0/d6/d8/le 0 2023-12-08T20:28:19.409 INFO:tasks.workunit.client.0.smithi043.stdout:7/325: fsync d0/f6a 0 2023-12-08T20:28:19.410 INFO:tasks.workunit.client.0.smithi043.stdout:7/326: symlink d0/d6/l6f 0 2023-12-08T20:28:19.415 INFO:tasks.workunit.client.0.smithi043.stdout:7/327: symlink d0/d69/d6d/l70 0 2023-12-08T20:28:19.415 INFO:tasks.workunit.client.0.smithi043.stdout:7/328: chown d0/l25 91828716 1 2023-12-08T20:28:19.415 INFO:tasks.workunit.client.0.smithi043.stdout:7/329: dread d0/f3d [0,4194304] 0 2023-12-08T20:28:19.415 INFO:tasks.workunit.client.0.smithi043.stdout:7/330: creat d0/d2/d65/f71 x:0 0 0 2023-12-08T20:28:19.415 INFO:tasks.workunit.client.0.smithi043.stdout:7/331: chown d0 6805 1 2023-12-08T20:28:19.416 INFO:tasks.workunit.client.0.smithi043.stdout:7/332: truncate d0/d2/d12/f2e 267540 0 2023-12-08T20:28:19.416 INFO:tasks.workunit.client.0.smithi043.stdout:7/333: fsync d0/d6/d17/d54/f59 0 2023-12-08T20:28:19.425 INFO:tasks.workunit.client.0.smithi043.stdout:7/334: dread d0/d6/f29 [0,4194304] 0 2023-12-08T20:28:19.432 INFO:tasks.workunit.client.0.smithi043.stdout:7/335: dread d0/d2/d12/d19/f40 [0,4194304] 0 2023-12-08T20:28:19.433 INFO:tasks.workunit.client.0.smithi043.stdout:7/336: getdents d0 0 2023-12-08T20:28:19.435 INFO:tasks.workunit.client.0.smithi043.stdout:7/337: dread d0/fb [0,4194304] 0 2023-12-08T20:28:19.435 INFO:tasks.workunit.client.0.smithi043.stdout:7/338: write d0/d6/d8/f10 [4553715,66606] 0 2023-12-08T20:28:19.437 INFO:tasks.workunit.client.0.smithi043.stdout:7/339: unlink d0/d6/d8/c1d 0 2023-12-08T20:28:19.438 INFO:tasks.workunit.client.0.smithi043.stdout:7/340: write d0/d2/d12/d19/f41 [313195,49457] 0 2023-12-08T20:28:19.439 INFO:tasks.workunit.client.0.smithi043.stdout:7/341: symlink d0/d2/l72 0 2023-12-08T20:28:19.440 INFO:tasks.workunit.client.0.smithi043.stdout:7/342: write d0/d2/d12/f51 [2151325,126715] 0 2023-12-08T20:28:19.440 INFO:tasks.workunit.client.0.smithi043.stdout:7/343: rename d0/d2/d12 to d0/d2/d12/d19/d73 22 2023-12-08T20:28:19.440 INFO:tasks.workunit.client.0.smithi043.stdout:7/344: readlink d0/d6/d8/l13 0 2023-12-08T20:28:19.441 INFO:tasks.workunit.client.0.smithi043.stdout:7/345: getdents d0/d6/d8/d47 0 2023-12-08T20:28:19.441 INFO:tasks.workunit.client.0.smithi043.stdout:7/346: read d0/d2/f5 [2137690,43324] 0 2023-12-08T20:28:19.442 INFO:tasks.workunit.client.0.smithi043.stdout:7/347: truncate d0/d6/d17/d54/f60 2713802 0 2023-12-08T20:28:19.442 INFO:tasks.workunit.client.0.smithi043.stdout:7/348: readlink d0/d69/d6d/l70 0 2023-12-08T20:28:19.444 INFO:tasks.workunit.client.0.smithi043.stdout:7/349: creat d0/d6/d17/d52/f74 x:0 0 0 2023-12-08T20:28:19.444 INFO:tasks.workunit.client.0.smithi043.stdout:7/350: fsync d0/d2/d12/f32 0 2023-12-08T20:28:19.447 INFO:tasks.workunit.client.0.smithi043.stdout:7/351: unlink d0/d2/l72 0 2023-12-08T20:28:19.467 INFO:tasks.workunit.client.0.smithi043.stdout:7/352: dwrite d0/f1b [0,4194304] 0 2023-12-08T20:28:19.474 INFO:tasks.workunit.client.0.smithi043.stdout:8/414: sync 2023-12-08T20:28:19.481 INFO:tasks.workunit.client.0.smithi043.stdout:0/425: sync 2023-12-08T20:28:19.481 INFO:tasks.workunit.client.0.smithi043.stdout:5/400: sync 2023-12-08T20:28:19.481 INFO:tasks.workunit.client.0.smithi043.stdout:1/404: sync 2023-12-08T20:28:19.481 INFO:tasks.workunit.client.0.smithi043.stdout:1/405: dread - d1/d16/d48/f53 zero size 2023-12-08T20:28:19.485 INFO:tasks.workunit.client.0.smithi043.stdout:0/426: creat d2/d61/d67/f87 x:0 0 0 2023-12-08T20:28:19.485 INFO:tasks.workunit.client.0.smithi043.stdout:1/406: mkdir d1/d16/d21/d25/d3e/d77/d90 0 2023-12-08T20:28:19.486 INFO:tasks.workunit.client.0.smithi043.stdout:7/353: dwrite d0/d6/d17/f37 [0,4194304] 0 2023-12-08T20:28:19.486 INFO:tasks.workunit.client.0.smithi043.stdout:0/427: mkdir d2/d3/d18/d1e/d88 0 2023-12-08T20:28:19.486 INFO:tasks.workunit.client.0.smithi043.stdout:0/428: truncate d2/f7 694671 0 2023-12-08T20:28:19.486 INFO:tasks.workunit.client.0.smithi043.stdout:0/429: read - d2/d3/d6/d39/d63/f72 zero size 2023-12-08T20:28:19.486 INFO:tasks.workunit.client.0.smithi043.stdout:1/407: creat d1/d16/d1c/f91 x:0 0 0 2023-12-08T20:28:19.489 INFO:tasks.workunit.client.0.smithi043.stdout:8/415: dwrite d2/d20/d7d/f26 [0,4194304] 0 2023-12-08T20:28:19.489 INFO:tasks.workunit.client.0.smithi043.stdout:8/416: chown d2/d27/d2d/d31 103 1 2023-12-08T20:28:19.489 INFO:tasks.workunit.client.0.smithi043.stdout:7/354: rename d0/d6/l2d to d0/d2/d12/l75 0 2023-12-08T20:28:19.489 INFO:tasks.workunit.client.0.smithi043.stdout:7/355: dread - d0/d2/d12/d19/f4f zero size 2023-12-08T20:28:19.490 INFO:tasks.workunit.client.0.smithi043.stdout:7/356: write d0/d2/d65/f71 [613220,108344] 0 2023-12-08T20:28:19.490 INFO:tasks.workunit.client.0.smithi043.stdout:0/430: fsync d2/d4/f3d 0 2023-12-08T20:28:19.491 INFO:tasks.workunit.client.0.smithi043.stdout:1/408: link d1/d16/d48/l66 d1/d16/d30/d4f/d54/l92 0 2023-12-08T20:28:19.494 INFO:tasks.workunit.client.0.smithi043.stdout:1/409: getdents d1/d16/d21/d25 0 2023-12-08T20:28:19.496 INFO:tasks.workunit.client.0.smithi043.stdout:1/410: unlink d1/d16/d21/d25/d3e/c7a 0 2023-12-08T20:28:19.503 INFO:tasks.workunit.client.0.smithi043.stdout:5/401: dwrite d3/d7/de/f55 [0,4194304] 0 2023-12-08T20:28:19.503 INFO:tasks.workunit.client.0.smithi043.stdout:5/402: truncate d3/f6e 472023 0 2023-12-08T20:28:19.503 INFO:tasks.workunit.client.0.smithi043.stdout:5/403: chown d3/d7/d19/c44 7 1 2023-12-08T20:28:19.503 INFO:tasks.workunit.client.0.smithi043.stdout:5/404: read - d3/d7/f69 zero size 2023-12-08T20:28:19.503 INFO:tasks.workunit.client.0.smithi043.stdout:5/405: truncate d3/d7/d19/d3f/d52/f5e 131373 0 2023-12-08T20:28:19.503 INFO:tasks.workunit.client.0.smithi043.stdout:3/393: sync 2023-12-08T20:28:19.505 INFO:tasks.workunit.client.0.smithi043.stdout:4/399: sync 2023-12-08T20:28:19.507 INFO:tasks.workunit.client.0.smithi043.stdout:5/406: truncate d3/d7/de/f24 2996663 0 2023-12-08T20:28:19.507 INFO:tasks.workunit.client.0.smithi043.stdout:3/394: unlink d1/d9/df/l35 0 2023-12-08T20:28:19.508 INFO:tasks.workunit.client.0.smithi043.stdout:4/400: getdents d1/d14/d25/d39/d3d/d40/d67 0 2023-12-08T20:28:19.508 INFO:tasks.workunit.client.0.smithi043.stdout:4/401: dread - d1/d14/d25/d39/d3d/d40/f5b zero size 2023-12-08T20:28:19.510 INFO:tasks.workunit.client.0.smithi043.stdout:5/407: creat d3/d7/d21/d51/d5c/f74 x:0 0 0 2023-12-08T20:28:19.512 INFO:tasks.workunit.client.0.smithi043.stdout:3/395: creat d1/d1c/d29/f7e x:0 0 0 2023-12-08T20:28:19.513 INFO:tasks.workunit.client.0.smithi043.stdout:4/402: symlink d1/d14/d25/d39/d3f/d3c/d41/l89 0 2023-12-08T20:28:19.513 INFO:tasks.workunit.client.0.smithi043.stdout:4/403: chown d1/d14/d1d/c4c 244403 1 2023-12-08T20:28:19.516 INFO:tasks.workunit.client.0.smithi043.stdout:5/408: rename d3/f3d to d3/d32/f75 0 2023-12-08T20:28:19.516 INFO:tasks.workunit.client.0.smithi043.stdout:5/409: mknod d3/d7/d19/c76 0 2023-12-08T20:28:19.519 INFO:tasks.workunit.client.0.smithi043.stdout:5/410: creat d3/d7/d29/f77 x:0 0 0 2023-12-08T20:28:19.524 INFO:tasks.workunit.client.0.smithi043.stdout:5/411: mkdir d3/d78 0 2023-12-08T20:28:19.543 INFO:tasks.workunit.client.0.smithi043.stdout:0/431: dwrite d2/d3/d18/d2b/f41 [0,4194304] 0 2023-12-08T20:28:19.543 INFO:tasks.workunit.client.0.smithi043.stdout:1/411: dwrite d1/d16/d1c/f50 [0,4194304] 0 2023-12-08T20:28:19.543 INFO:tasks.workunit.client.0.smithi043.stdout:7/357: dwrite d0/d2/f46 [0,4194304] 0 2023-12-08T20:28:19.543 INFO:tasks.workunit.client.0.smithi043.stdout:4/404: dwrite d1/d14/d25/d39/d3d/d40/f69 [0,4194304] 0 2023-12-08T20:28:19.544 INFO:tasks.workunit.client.0.smithi043.stdout:8/417: dwrite d2/d27/f35 [4194304,4194304] 0 2023-12-08T20:28:19.544 INFO:tasks.workunit.client.0.smithi043.stdout:8/418: write d2/d20/d7d/d29/d30/f49 [5104917,72436] 0 2023-12-08T20:28:19.547 INFO:tasks.workunit.client.0.smithi043.stdout:1/412: rename d1/d16/d21/d25/l45 to d1/d16/l93 0 2023-12-08T20:28:19.553 INFO:tasks.workunit.client.0.smithi043.stdout:0/432: dread d2/d4/f3d [0,4194304] 0 2023-12-08T20:28:19.557 INFO:tasks.workunit.client.0.smithi043.stdout:8/419: unlink d2/d20/l75 0 2023-12-08T20:28:19.557 INFO:tasks.workunit.client.0.smithi043.stdout:1/413: creat d1/d16/d30/d6e/d83/f94 x:0 0 0 2023-12-08T20:28:19.557 INFO:tasks.workunit.client.0.smithi043.stdout:5/412: dwrite d3/d7/d21/f4d [4194304,4194304] 0 2023-12-08T20:28:19.558 INFO:tasks.workunit.client.0.smithi043.stdout:0/433: truncate d2/d3/d18/d1e/f3c 446535 0 2023-12-08T20:28:19.559 INFO:tasks.workunit.client.0.smithi043.stdout:8/420: truncate d2/f21 2952915 0 2023-12-08T20:28:19.560 INFO:tasks.workunit.client.0.smithi043.stdout:5/413: truncate d3/d7/d19/d3f/f58 3163350 0 2023-12-08T20:28:19.562 INFO:tasks.workunit.client.0.smithi043.stdout:7/358: dwrite d0/d5b/f63 [0,4194304] 0 2023-12-08T20:28:19.563 INFO:tasks.workunit.client.0.smithi043.stdout:7/359: write d0/d2/f27 [775639,126198] 0 2023-12-08T20:28:19.563 INFO:tasks.workunit.client.0.smithi043.stdout:4/405: dwrite d1/d14/d1d/f6e [0,4194304] 0 2023-12-08T20:28:19.563 INFO:tasks.workunit.client.0.smithi043.stdout:0/434: rename d2/d3/d18/f2a to d2/d3/d6/d39/d63/f89 0 2023-12-08T20:28:19.565 INFO:tasks.workunit.client.0.smithi043.stdout:8/421: creat d2/d20/d7d/d37/d5a/f81 x:0 0 0 2023-12-08T20:28:19.565 INFO:tasks.workunit.client.0.smithi043.stdout:5/414: creat d3/d7/de/d17/f79 x:0 0 0 2023-12-08T20:28:19.568 INFO:tasks.workunit.client.0.smithi043.stdout:1/414: dread d1/d16/d21/d25/d35/f73 [0,4194304] 0 2023-12-08T20:28:19.572 INFO:tasks.workunit.client.0.smithi043.stdout:4/406: mkdir d1/d14/d25/d28/d8a 0 2023-12-08T20:28:19.574 INFO:tasks.workunit.client.0.smithi043.stdout:0/435: mkdir d2/d61/d8a 0 2023-12-08T20:28:19.575 INFO:tasks.workunit.client.0.smithi043.stdout:5/415: unlink d3/c1b 0 2023-12-08T20:28:19.578 INFO:tasks.workunit.client.0.smithi043.stdout:1/415: getdents d1/d16/d21/d25/d35 0 2023-12-08T20:28:19.580 INFO:tasks.workunit.client.0.smithi043.stdout:4/407: truncate d1/d14/d25/d28/f34 394533 0 2023-12-08T20:28:19.580 INFO:tasks.workunit.client.0.smithi043.stdout:7/360: dwrite d0/d2/f11 [0,4194304] 0 2023-12-08T20:28:19.581 INFO:tasks.workunit.client.0.smithi043.stdout:0/436: creat d2/d3/d18/d1e/d88/f8b x:0 0 0 2023-12-08T20:28:19.581 INFO:tasks.workunit.client.0.smithi043.stdout:0/437: chown d2/c51 5932549 1 2023-12-08T20:28:19.581 INFO:tasks.workunit.client.0.smithi043.stdout:0/438: chown d2/d3/d18/d1e/f25 235213390 1 2023-12-08T20:28:19.581 INFO:tasks.workunit.client.0.smithi043.stdout:0/439: fdatasync d2/f24 0 2023-12-08T20:28:19.584 INFO:tasks.workunit.client.0.smithi043.stdout:5/416: rmdir d3/d7/de/d17 39 2023-12-08T20:28:19.584 INFO:tasks.workunit.client.0.smithi043.stdout:5/417: fdatasync d3/d7/de/f55 0 2023-12-08T20:28:19.584 INFO:tasks.workunit.client.0.smithi043.stdout:1/416: symlink d1/d16/d21/d25/d3e/d82/l95 0 2023-12-08T20:28:19.584 INFO:tasks.workunit.client.0.smithi043.stdout:1/417: dread - d1/d16/d1c/f7c zero size 2023-12-08T20:28:19.585 INFO:tasks.workunit.client.0.smithi043.stdout:1/418: readlink d1/d16/d21/d25/d35/l6b 0 2023-12-08T20:28:19.585 INFO:tasks.workunit.client.0.smithi043.stdout:4/408: mknod d1/d14/d25/d77/c8b 0 2023-12-08T20:28:19.588 INFO:tasks.workunit.client.0.smithi043.stdout:5/418: mknod d3/d73/c7a 0 2023-12-08T20:28:19.590 INFO:tasks.workunit.client.0.smithi043.stdout:1/419: mknod d1/d16/d21/d60/c96 0 2023-12-08T20:28:19.592 INFO:tasks.workunit.client.0.smithi043.stdout:4/409: symlink d1/d14/d1d/d75/l8c 0 2023-12-08T20:28:19.593 INFO:tasks.workunit.client.0.smithi043.stdout:5/419: creat d3/d7/de/f7b x:0 0 0 2023-12-08T20:28:19.595 INFO:tasks.workunit.client.0.smithi043.stdout:1/420: creat d1/d16/d21/d25/d3e/d77/d90/f97 x:0 0 0 2023-12-08T20:28:19.598 INFO:tasks.workunit.client.0.smithi043.stdout:5/420: rmdir d3/d73 39 2023-12-08T20:28:19.598 INFO:tasks.workunit.client.0.smithi043.stdout:5/421: chown d3/d7/d21 1321 1 2023-12-08T20:28:19.599 INFO:tasks.workunit.client.0.smithi043.stdout:1/421: mkdir d1/d16/d1c/d71/d98 0 2023-12-08T20:28:19.600 INFO:tasks.workunit.client.0.smithi043.stdout:1/422: symlink d1/d6/d63/l99 0 2023-12-08T20:28:19.601 INFO:tasks.workunit.client.0.smithi043.stdout:1/423: rename d1/d6/f3d to d1/d6/f9a 0 2023-12-08T20:28:19.601 INFO:tasks.workunit.client.0.smithi043.stdout:1/424: chown d1/d16/d48/f56 90755232 1 2023-12-08T20:28:19.603 INFO:tasks.workunit.client.0.smithi043.stdout:5/422: write d3/d7/d21/f4d [1681010,68231] 0 2023-12-08T20:28:19.605 INFO:tasks.workunit.client.0.smithi043.stdout:5/423: truncate d3/d7/d19/d3f/f58 1799133 0 2023-12-08T20:28:19.605 INFO:tasks.workunit.client.0.smithi043.stdout:5/424: write d3/d7/d21/d51/f54 [668639,42471] 0 2023-12-08T20:28:19.605 INFO:tasks.workunit.client.0.smithi043.stdout:5/425: mknod d3/d7/d29/c7c 0 2023-12-08T20:28:19.608 INFO:tasks.workunit.client.0.smithi043.stdout:5/426: write d3/d32/f75 [756091,119876] 0 2023-12-08T20:28:19.608 INFO:tasks.workunit.client.0.smithi043.stdout:1/425: dread d1/d16/d21/d25/d35/f73 [0,4194304] 0 2023-12-08T20:28:19.609 INFO:tasks.workunit.client.0.smithi043.stdout:5/427: getdents d3/d32 0 2023-12-08T20:28:19.609 INFO:tasks.workunit.client.0.smithi043.stdout:5/428: fsync d3/d7/d21/d51/d5c/f74 0 2023-12-08T20:28:19.610 INFO:tasks.workunit.client.0.smithi043.stdout:5/429: read d3/f6e [88150,97419] 0 2023-12-08T20:28:19.610 INFO:tasks.workunit.client.0.smithi043.stdout:5/430: truncate d3/d7/d21/d51/d5c/f67 514243 0 2023-12-08T20:28:19.612 INFO:tasks.workunit.client.0.smithi043.stdout:0/440: dwrite d2/d3/d18/d2b/d4f/f3b [0,4194304] 0 2023-12-08T20:28:19.613 INFO:tasks.workunit.client.0.smithi043.stdout:0/441: stat d2/d3/d18/c6f 0 2023-12-08T20:28:19.613 INFO:tasks.workunit.client.0.smithi043.stdout:0/442: chown d2/d3/d18/d1e 127089728 1 2023-12-08T20:28:19.613 INFO:tasks.workunit.client.0.smithi043.stdout:4/410: dwrite d1/d14/d1d/f1e [4194304,4194304] 0 2023-12-08T20:28:19.614 INFO:tasks.workunit.client.0.smithi043.stdout:5/431: mkdir d3/d7/d21/d51/d7d 0 2023-12-08T20:28:19.614 INFO:tasks.workunit.client.0.smithi043.stdout:7/361: dwrite d0/d6/f29 [0,4194304] 0 2023-12-08T20:28:19.614 INFO:tasks.workunit.client.0.smithi043.stdout:7/362: fdatasync d0/d6/d8/f15 0 2023-12-08T20:28:19.614 INFO:tasks.workunit.client.0.smithi043.stdout:0/443: mknod d2/d61/d8a/c8c 0 2023-12-08T20:28:19.616 INFO:tasks.workunit.client.0.smithi043.stdout:4/411: mkdir d1/d14/d25/d77/d8d 0 2023-12-08T20:28:19.617 INFO:tasks.workunit.client.0.smithi043.stdout:5/432: creat d3/d73/f7e x:0 0 0 2023-12-08T20:28:19.617 INFO:tasks.workunit.client.0.smithi043.stdout:5/433: dread - d3/d7/d21/d51/d5c/f74 zero size 2023-12-08T20:28:19.619 INFO:tasks.workunit.client.0.smithi043.stdout:7/363: symlink d0/d2/d12/d19/d38/l76 0 2023-12-08T20:28:19.621 INFO:tasks.workunit.client.0.smithi043.stdout:5/434: symlink d3/d78/l7f 0 2023-12-08T20:28:19.621 INFO:tasks.workunit.client.0.smithi043.stdout:7/364: creat d0/d6/d8/d47/f77 x:0 0 0 2023-12-08T20:28:19.627 INFO:tasks.workunit.client.0.smithi043.stdout:7/365: rmdir d0/d61 0 2023-12-08T20:28:19.629 INFO:tasks.workunit.client.0.smithi043.stdout:7/366: unlink d0/d2/f11 0 2023-12-08T20:28:19.634 INFO:tasks.workunit.client.0.smithi043.stdout:5/435: dread d3/d7/de/f1d [0,4194304] 0 2023-12-08T20:28:19.634 INFO:tasks.workunit.client.0.smithi043.stdout:5/436: fsync d3/fc 0 2023-12-08T20:28:19.635 INFO:tasks.workunit.client.0.smithi043.stdout:5/437: rename d3/c4 to d3/d73/c80 0 2023-12-08T20:28:19.636 INFO:tasks.workunit.client.0.smithi043.stdout:4/412: dwrite d1/d14/f26 [0,4194304] 0 2023-12-08T20:28:19.636 INFO:tasks.workunit.client.0.smithi043.stdout:4/413: readlink d1/d14/d25/d39/d3f/d3c/d41/l89 0 2023-12-08T20:28:19.636 INFO:tasks.workunit.client.0.smithi043.stdout:0/444: dwrite d2/d3/d18/f22 [4194304,4194304] 0 2023-12-08T20:28:19.636 INFO:tasks.workunit.client.0.smithi043.stdout:0/445: readlink d2/d3/d18/l33 0 2023-12-08T20:28:19.640 INFO:tasks.workunit.client.0.smithi043.stdout:5/438: mkdir d3/d7/d21/d51/d5c/d81 0 2023-12-08T20:28:19.642 INFO:tasks.workunit.client.0.smithi043.stdout:4/414: truncate d1/d14/f24 3775757 0 2023-12-08T20:28:19.642 INFO:tasks.workunit.client.0.smithi043.stdout:4/415: chown d1/d14/d25/d39/d3d/d40/d67/f83 30146588 1 2023-12-08T20:28:19.644 INFO:tasks.workunit.client.0.smithi043.stdout:0/446: creat d2/d3/d6/d39/f8d x:0 0 0 2023-12-08T20:28:19.645 INFO:tasks.workunit.client.0.smithi043.stdout:7/367: getdents d0 0 2023-12-08T20:28:19.645 INFO:tasks.workunit.client.0.smithi043.stdout:7/368: readlink d0/d6/d17/l53 0 2023-12-08T20:28:19.647 INFO:tasks.workunit.client.0.smithi043.stdout:4/416: creat d1/d14/d25/d39/d3f/d3c/d41/d65/f8e x:0 0 0 2023-12-08T20:28:19.647 INFO:tasks.workunit.client.0.smithi043.stdout:4/417: fsync d1/d14/d50/f7a 0 2023-12-08T20:28:19.648 INFO:tasks.workunit.client.0.smithi043.stdout:0/447: mkdir d2/d3/d18/d2b/d4f/d8e 0 2023-12-08T20:28:19.649 INFO:tasks.workunit.client.0.smithi043.stdout:5/439: mkdir d3/d7/de/d82 0 2023-12-08T20:28:19.649 INFO:tasks.workunit.client.0.smithi043.stdout:5/440: chown d3/d7/d21/l46 485856842 1 2023-12-08T20:28:19.649 INFO:tasks.workunit.client.0.smithi043.stdout:5/441: write d3/d7/f69 [289387,45131] 0 2023-12-08T20:28:19.650 INFO:tasks.workunit.client.0.smithi043.stdout:4/418: creat d1/d14/d25/d39/d3d/d40/d67/f8f x:0 0 0 2023-12-08T20:28:19.650 INFO:tasks.workunit.client.0.smithi043.stdout:0/448: creat d2/d4/f8f x:0 0 0 2023-12-08T20:28:19.651 INFO:tasks.workunit.client.0.smithi043.stdout:5/442: mkdir d3/d73/d83 0 2023-12-08T20:28:19.652 INFO:tasks.workunit.client.0.smithi043.stdout:5/443: chown d3/d7/d21/f2d 268 1 2023-12-08T20:28:19.652 INFO:tasks.workunit.client.0.smithi043.stdout:4/419: mkdir d1/d14/d25/d39/d3f/d3c/d90 0 2023-12-08T20:28:19.653 INFO:tasks.workunit.client.0.smithi043.stdout:0/449: getdents d2/d3/d18/d1e/d53 0 2023-12-08T20:28:19.654 INFO:tasks.workunit.client.0.smithi043.stdout:5/444: mkdir d3/d7/de/d17/d84 0 2023-12-08T20:28:19.656 INFO:tasks.workunit.client.0.smithi043.stdout:4/420: mknod d1/d14/d25/d28/c91 0 2023-12-08T20:28:19.656 INFO:tasks.workunit.client.0.smithi043.stdout:4/421: fdatasync d1/d14/d25/d39/f71 0 2023-12-08T20:28:19.658 INFO:tasks.workunit.client.0.smithi043.stdout:7/369: dwrite d0/d6/d17/f37 [0,4194304] 0 2023-12-08T20:28:19.658 INFO:tasks.workunit.client.0.smithi043.stdout:4/422: rename d1/d14/d25/d39/f51 to d1/f92 0 2023-12-08T20:28:19.658 INFO:tasks.workunit.client.0.smithi043.stdout:0/450: dread d2/d3/d18/d2b/f36 [0,4194304] 0 2023-12-08T20:28:19.659 INFO:tasks.workunit.client.0.smithi043.stdout:5/445: symlink d3/l85 0 2023-12-08T20:28:19.660 INFO:tasks.workunit.client.0.smithi043.stdout:4/423: dread d1/d14/d25/f29 [0,4194304] 0 2023-12-08T20:28:19.660 INFO:tasks.workunit.client.0.smithi043.stdout:4/424: dread - d1/d14/d1d/f47 zero size 2023-12-08T20:28:19.661 INFO:tasks.workunit.client.0.smithi043.stdout:7/370: rename d0/d2/f27 to d0/d6/d17/f78 0 2023-12-08T20:28:19.661 INFO:tasks.workunit.client.0.smithi043.stdout:7/371: write d0/d6/d17/f78 [5517,37100] 0 2023-12-08T20:28:19.661 INFO:tasks.workunit.client.0.smithi043.stdout:7/372: truncate d0/d2/d12/f32 8812381 0 2023-12-08T20:28:19.662 INFO:tasks.workunit.client.0.smithi043.stdout:5/446: creat d3/d7/d19/d3f/f86 x:0 0 0 2023-12-08T20:28:19.662 INFO:tasks.workunit.client.0.smithi043.stdout:0/451: dread d2/f34 [0,4194304] 0 2023-12-08T20:28:19.663 INFO:tasks.workunit.client.0.smithi043.stdout:4/425: mkdir d1/d14/d25/d77/d93 0 2023-12-08T20:28:19.665 INFO:tasks.workunit.client.0.smithi043.stdout:5/447: creat d3/d7/de/d17/d84/f87 x:0 0 0 2023-12-08T20:28:19.670 INFO:tasks.workunit.client.0.smithi043.stdout:4/426: dread d1/f6 [0,4194304] 0 2023-12-08T20:28:19.670 INFO:tasks.workunit.client.0.smithi043.stdout:4/427: write d1/d14/d25/d39/d3d/d40/d67/f8f [702591,115622] 0 2023-12-08T20:28:19.676 INFO:tasks.workunit.client.0.smithi043.stdout:7/373: truncate d0/f6a 452778 0 2023-12-08T20:28:19.676 INFO:tasks.workunit.client.0.smithi043.stdout:7/374: chown d0/d2/ld 9937 1 2023-12-08T20:28:19.676 INFO:tasks.workunit.client.0.smithi043.stdout:7/375: chown d0/d69/d6d/l70 101667585 1 2023-12-08T20:28:19.678 INFO:tasks.workunit.client.0.smithi043.stdout:4/428: dread d1/d14/d25/d39/d3d/d40/d67/f68 [0,4194304] 0 2023-12-08T20:28:19.679 INFO:tasks.workunit.client.0.smithi043.stdout:7/376: mknod d0/d2/d12/d19/d38/c79 0 2023-12-08T20:28:19.679 INFO:tasks.workunit.client.0.smithi043.stdout:7/377: fsync d0/d6/d8/f64 0 2023-12-08T20:28:19.680 INFO:tasks.workunit.client.0.smithi043.stdout:7/378: symlink d0/d69/d6d/l7a 0 2023-12-08T20:28:19.680 INFO:tasks.workunit.client.0.smithi043.stdout:0/452: dwrite d2/d4/f8f [0,4194304] 0 2023-12-08T20:28:19.681 INFO:tasks.workunit.client.0.smithi043.stdout:7/379: creat d0/d6/f7b x:0 0 0 2023-12-08T20:28:19.682 INFO:tasks.workunit.client.0.smithi043.stdout:0/453: dread d2/d3/d18/d2b/d4f/f69 [0,4194304] 0 2023-12-08T20:28:19.684 INFO:tasks.workunit.client.0.smithi043.stdout:7/380: creat d0/d2/f7c x:0 0 0 2023-12-08T20:28:19.687 INFO:tasks.workunit.client.0.smithi043.stdout:4/429: dread d1/d14/f18 [0,4194304] 0 2023-12-08T20:28:19.688 INFO:tasks.workunit.client.0.smithi043.stdout:4/430: mkdir d1/d14/d25/d28/d94 0 2023-12-08T20:28:19.691 INFO:tasks.workunit.client.0.smithi043.stdout:4/431: read d1/d14/d25/d28/f2e [1804106,103022] 0 2023-12-08T20:28:19.691 INFO:tasks.workunit.client.0.smithi043.stdout:4/432: chown d1/d14/d1d/d58 0 1 2023-12-08T20:28:19.693 INFO:tasks.workunit.client.0.smithi043.stdout:4/433: creat d1/d14/d25/d39/d3f/d3c/d41/f95 x:0 0 0 2023-12-08T20:28:19.696 INFO:tasks.workunit.client.0.smithi043.stdout:4/434: rename d1/d14/d25/d39/d3d/d40/f69 to d1/d14/d25/d39/d3f/d59/f96 0 2023-12-08T20:28:19.696 INFO:tasks.workunit.client.0.smithi043.stdout:0/454: dread d2/d4/f66 [4194304,4194304] 0 2023-12-08T20:28:19.696 INFO:tasks.workunit.client.0.smithi043.stdout:4/435: read d1/f5f [386776,95389] 0 2023-12-08T20:28:19.697 INFO:tasks.workunit.client.0.smithi043.stdout:0/455: unlink d2/d3/d18/d2b/d4f/f3b 0 2023-12-08T20:28:19.699 INFO:tasks.workunit.client.0.smithi043.stdout:4/436: creat d1/d14/d25/d39/d3d/f97 x:0 0 0 2023-12-08T20:28:19.699 INFO:tasks.workunit.client.0.smithi043.stdout:4/437: write d1/d14/d25/d39/d3d/d40/f6c [1397094,102894] 0 2023-12-08T20:28:19.699 INFO:tasks.workunit.client.0.smithi043.stdout:4/438: truncate d1/d14/f45 2412864 0 2023-12-08T20:28:19.699 INFO:tasks.workunit.client.0.smithi043.stdout:4/439: write d1/d14/d25/d39/d3f/f78 [1066215,60541] 0 2023-12-08T20:28:19.699 INFO:tasks.workunit.client.0.smithi043.stdout:0/456: creat d2/d3/d18/f90 x:0 0 0 2023-12-08T20:28:19.699 INFO:tasks.workunit.client.0.smithi043.stdout:0/457: chown d2/d3/d6/d39/d63/f89 244 1 2023-12-08T20:28:19.699 INFO:tasks.workunit.client.0.smithi043.stdout:0/458: stat d2/l57 0 2023-12-08T20:28:19.700 INFO:tasks.workunit.client.0.smithi043.stdout:4/440: creat d1/d14/d50/f98 x:0 0 0 2023-12-08T20:28:19.700 INFO:tasks.workunit.client.0.smithi043.stdout:0/459: mknod d2/d3/d18/c91 0 2023-12-08T20:28:19.701 INFO:tasks.workunit.client.0.smithi043.stdout:0/460: fsync d2/d3/f4e 0 2023-12-08T20:28:19.701 INFO:tasks.workunit.client.0.smithi043.stdout:4/441: symlink d1/d14/d25/d39/d3d/d40/l99 0 2023-12-08T20:28:19.701 INFO:tasks.workunit.client.0.smithi043.stdout:0/461: readlink d2/d4/l12 0 2023-12-08T20:28:19.702 INFO:tasks.workunit.client.0.smithi043.stdout:0/462: rmdir d2/d3/d6/d39/d5e 39 2023-12-08T20:28:19.706 INFO:tasks.workunit.client.0.smithi043.stdout:4/442: read d1/f11 [2452056,96084] 0 2023-12-08T20:28:19.706 INFO:tasks.workunit.client.0.smithi043.stdout:4/443: truncate d1/d14/d25/d39/d3d/d40/d67/f83 106875 0 2023-12-08T20:28:19.707 INFO:tasks.workunit.client.0.smithi043.stdout:7/381: dwrite d0/d6/d17/f78 [0,4194304] 0 2023-12-08T20:28:19.707 INFO:tasks.workunit.client.0.smithi043.stdout:4/444: truncate d1/d14/d25/d39/d3f/f7e 401569 0 2023-12-08T20:28:19.708 INFO:tasks.workunit.client.0.smithi043.stdout:0/463: dread d2/f34 [0,4194304] 0 2023-12-08T20:28:19.708 INFO:tasks.workunit.client.0.smithi043.stdout:0/464: chown d2/d3/d18/d2b/f36 71587219 1 2023-12-08T20:28:19.709 INFO:tasks.workunit.client.0.smithi043.stdout:4/445: rename d1/d14/d25/d28/f4f to d1/d14/d50/f9a 0 2023-12-08T20:28:19.710 INFO:tasks.workunit.client.0.smithi043.stdout:4/446: write d1/d14/d25/d39/d3f/d3c/d41/f43 [1321154,21383] 0 2023-12-08T20:28:19.710 INFO:tasks.workunit.client.0.smithi043.stdout:4/447: truncate d1/d14/d25/f2f 981256 0 2023-12-08T20:28:19.711 INFO:tasks.workunit.client.0.smithi043.stdout:7/382: creat d0/d6/d8/f7d x:0 0 0 2023-12-08T20:28:19.712 INFO:tasks.workunit.client.0.smithi043.stdout:0/465: stat d2/c17 0 2023-12-08T20:28:19.723 INFO:tasks.workunit.client.0.smithi043.stdout:7/383: write d0/d2/d12/f51 [2439622,94804] 0 2023-12-08T20:28:19.723 INFO:tasks.workunit.client.0.smithi043.stdout:7/384: readlink d0/d2/l4e 0 2023-12-08T20:28:19.728 INFO:tasks.workunit.client.0.smithi043.stdout:0/466: dwrite d2/f8 [0,4194304] 0 2023-12-08T20:28:19.728 INFO:tasks.workunit.client.0.smithi043.stdout:4/448: dwrite d1/d14/d50/f98 [0,4194304] 0 2023-12-08T20:28:19.729 INFO:tasks.workunit.client.0.smithi043.stdout:4/449: write d1/d14/f18 [8269541,125200] 0 2023-12-08T20:28:19.736 INFO:tasks.workunit.client.0.smithi043.stdout:0/467: rename d2/d4/l46 to d2/d3/d6/d39/d83/l92 0 2023-12-08T20:28:19.737 INFO:tasks.workunit.client.0.smithi043.stdout:4/450: dread d1/d14/d25/d28/f2b [0,4194304] 0 2023-12-08T20:28:19.737 INFO:tasks.workunit.client.0.smithi043.stdout:4/451: chown d1/d14/d25 2807 1 2023-12-08T20:28:19.737 INFO:tasks.workunit.client.0.smithi043.stdout:0/468: creat d2/d3/d18/d1e/d53/d7d/f93 x:0 0 0 2023-12-08T20:28:19.738 INFO:tasks.workunit.client.0.smithi043.stdout:0/469: fsync d2/d3/f4e 0 2023-12-08T20:28:19.738 INFO:tasks.workunit.client.0.smithi043.stdout:4/452: creat d1/d14/d25/d28/d8a/f9b x:0 0 0 2023-12-08T20:28:19.739 INFO:tasks.workunit.client.0.smithi043.stdout:0/470: getdents d2/d3/d6/d39 0 2023-12-08T20:28:19.741 INFO:tasks.workunit.client.0.smithi043.stdout:4/453: creat d1/d14/d25/d39/d3d/d40/d67/f9c x:0 0 0 2023-12-08T20:28:19.742 INFO:tasks.workunit.client.0.smithi043.stdout:0/471: rename d2/c14 to d2/d3/c94 0 2023-12-08T20:28:19.743 INFO:tasks.workunit.client.0.smithi043.stdout:0/472: creat d2/d61/d67/f95 x:0 0 0 2023-12-08T20:28:19.743 INFO:tasks.workunit.client.0.smithi043.stdout:0/473: chown d2/d61/d8a/c8c 376709279 1 2023-12-08T20:28:19.744 INFO:tasks.workunit.client.0.smithi043.stdout:0/474: chown d2/d3/d6/f6c 1239 1 2023-12-08T20:28:19.744 INFO:tasks.workunit.client.0.smithi043.stdout:0/475: write d2/d3/d18/f43 [8024345,100387] 0 2023-12-08T20:28:19.745 INFO:tasks.workunit.client.0.smithi043.stdout:0/476: write d2/d3/d18/d2b/f37 [2029172,65049] 0 2023-12-08T20:28:19.746 INFO:tasks.workunit.client.0.smithi043.stdout:0/477: unlink d2/c2c 0 2023-12-08T20:28:19.747 INFO:tasks.workunit.client.0.smithi043.stdout:0/478: creat d2/d3/d6/d39/d5e/f96 x:0 0 0 2023-12-08T20:28:19.749 INFO:tasks.workunit.client.0.smithi043.stdout:0/479: link d2/d3/d6/f44 d2/d3/d18/d2b/d4f/d5f/d79/d86/f97 0 2023-12-08T20:28:19.753 INFO:tasks.workunit.client.0.smithi043.stdout:0/480: dread d2/d4/f3d [0,4194304] 0 2023-12-08T20:28:19.754 INFO:tasks.workunit.client.0.smithi043.stdout:0/481: symlink d2/d3/d6/d39/d83/l98 0 2023-12-08T20:28:19.755 INFO:tasks.workunit.client.0.smithi043.stdout:0/482: truncate d2/d3/d18/d2b/d4f/f5c 1268133 0 2023-12-08T20:28:19.755 INFO:tasks.workunit.client.0.smithi043.stdout:0/483: symlink d2/d61/d67/l99 0 2023-12-08T20:28:19.756 INFO:tasks.workunit.client.0.smithi043.stdout:0/484: symlink d2/d3/d18/d2b/d4f/d5f/d79/l9a 0 2023-12-08T20:28:19.757 INFO:tasks.workunit.client.0.smithi043.stdout:0/485: creat d2/f9b x:0 0 0 2023-12-08T20:28:19.758 INFO:tasks.workunit.client.0.smithi043.stdout:0/486: creat d2/d4/f9c x:0 0 0 2023-12-08T20:28:19.758 INFO:tasks.workunit.client.0.smithi043.stdout:0/487: readlink d2/d3/d18/d2b/l60 0 2023-12-08T20:28:19.759 INFO:tasks.workunit.client.0.smithi043.stdout:0/488: write d2/f24 [1260546,105683] 0 2023-12-08T20:28:19.761 INFO:tasks.workunit.client.0.smithi043.stdout:0/489: dread d2/d3/d18/d2b/d4f/f5c [0,4194304] 0 2023-12-08T20:28:19.763 INFO:tasks.workunit.client.0.smithi043.stdout:0/490: mkdir d2/d3/d6/d39/d83/d9d 0 2023-12-08T20:28:19.763 INFO:tasks.workunit.client.0.smithi043.stdout:0/491: stat d2/d3/d6/f68 0 2023-12-08T20:28:19.763 INFO:tasks.workunit.client.0.smithi043.stdout:0/492: chown d2/d3/d6/d39/d5e 0 1 2023-12-08T20:28:19.774 INFO:tasks.workunit.client.0.smithi043.stdout:0/493: dwrite d2/d4/f9c [0,4194304] 0 2023-12-08T20:28:19.774 INFO:tasks.workunit.client.0.smithi043.stdout:0/494: fsync d2/d3/f4e 0 2023-12-08T20:28:19.776 INFO:tasks.workunit.client.0.smithi043.stdout:0/495: mkdir d2/d61/d67/d9e 0 2023-12-08T20:28:19.781 INFO:tasks.workunit.client.0.smithi043.stdout:0/496: dread d2/d4/f3d [0,4194304] 0 2023-12-08T20:28:19.781 INFO:tasks.workunit.client.0.smithi043.stdout:0/497: creat d2/d4/f9f x:0 0 0 2023-12-08T20:28:19.782 INFO:tasks.workunit.client.0.smithi043.stdout:0/498: creat d2/d3/d18/d2b/d4f/fa0 x:0 0 0 2023-12-08T20:28:19.783 INFO:tasks.workunit.client.0.smithi043.stdout:0/499: creat d2/d3/d6/d39/d83/fa1 x:0 0 0 2023-12-08T20:28:19.783 INFO:tasks.workunit.client.0.smithi043.stdout:0/500: chown d2/d3/d18/d1e/d53/d7d 38586 1 2023-12-08T20:28:19.784 INFO:tasks.workunit.client.0.smithi043.stdout:0/501: creat d2/d3/d18/d2b/fa2 x:0 0 0 2023-12-08T20:28:19.784 INFO:tasks.workunit.client.0.smithi043.stdout:0/502: dread - d2/d3/d18/d1e/d53/f5d zero size 2023-12-08T20:28:19.786 INFO:tasks.workunit.client.0.smithi043.stdout:0/503: mkdir d2/d3/d18/d2b/d4f/da3 0 2023-12-08T20:28:19.786 INFO:tasks.workunit.client.0.smithi043.stdout:0/504: chown d2/d3/d18/l33 3255993 1 2023-12-08T20:28:19.786 INFO:tasks.workunit.client.0.smithi043.stdout:0/505: fsync d2/d3/d18/d2b/f41 0 2023-12-08T20:28:19.786 INFO:tasks.workunit.client.0.smithi043.stdout:0/506: truncate d2/d4/f9c 5136104 0 2023-12-08T20:28:19.786 INFO:tasks.workunit.client.0.smithi043.stdout:0/507: stat d2/d3/d6 0 2023-12-08T20:28:19.786 INFO:tasks.workunit.client.0.smithi043.stdout:0/508: fdatasync d2/d4/f3d 0 2023-12-08T20:28:19.786 INFO:tasks.workunit.client.0.smithi043.stdout:0/509: creat d2/d3/d18/d1e/d88/fa4 x:0 0 0 2023-12-08T20:28:19.791 INFO:tasks.workunit.client.0.smithi043.stdout:0/510: rename d2/d3/d18/d2b/d4f to d2/d3/d18/d2b/da5 0 2023-12-08T20:28:19.793 INFO:tasks.workunit.client.0.smithi043.stdout:0/511: mkdir d2/d3/d6/d39/d63/da6 0 2023-12-08T20:28:19.793 INFO:tasks.workunit.client.0.smithi043.stdout:0/512: dread - d2/d3/d18/d2b/da5/d5f/d79/d86/f97 zero size 2023-12-08T20:28:19.794 INFO:tasks.workunit.client.0.smithi043.stdout:0/513: getdents d2/d3/d6 0 2023-12-08T20:28:19.794 INFO:tasks.workunit.client.0.smithi043.stdout:0/514: readlink d2/d3/d18/d1e/l71 0 2023-12-08T20:28:19.794 INFO:tasks.workunit.client.0.smithi043.stdout:0/515: getdents d2/d3/d18/d2b/da5/d3f 0 2023-12-08T20:28:19.796 INFO:tasks.workunit.client.0.smithi043.stdout:0/516: unlink d2/d4/f8f 0 2023-12-08T20:28:19.803 INFO:tasks.workunit.client.0.smithi043.stdout:0/517: dread d2/d3/fb [0,4194304] 0 2023-12-08T20:28:19.823 INFO:tasks.workunit.client.0.smithi043.stdout:0/518: dwrite d2/f7 [0,4194304] 0 2023-12-08T20:28:19.823 INFO:tasks.workunit.client.0.smithi043.stdout:0/519: creat d2/d3/d18/d2b/fa7 x:0 0 0 2023-12-08T20:28:19.823 INFO:tasks.workunit.client.0.smithi043.stdout:0/520: write d2/f9b [307346,124025] 0 2023-12-08T20:28:19.823 INFO:tasks.workunit.client.0.smithi043.stdout:0/521: rename d2/d3/d6/d39 to d2/d3/d6/d39/da8 22 2023-12-08T20:28:19.823 INFO:tasks.workunit.client.0.smithi043.stdout:0/522: creat d2/d3/d18/d1e/fa9 x:0 0 0 2023-12-08T20:28:19.823 INFO:tasks.workunit.client.0.smithi043.stdout:0/523: write d2/d3/d6/f2e [1743251,41479] 0 2023-12-08T20:28:19.824 INFO:tasks.workunit.client.0.smithi043.stdout:0/524: chown d2/d3/d18/d2b/da5/c7b 563 1 2023-12-08T20:28:19.824 INFO:tasks.workunit.client.0.smithi043.stdout:0/525: write d2/d4/f4b [1047689,71183] 0 2023-12-08T20:28:19.831 INFO:tasks.workunit.client.0.smithi043.stdout:0/526: dread d2/d3/d6/d39/d5e/f75 [0,4194304] 0 2023-12-08T20:28:19.831 INFO:tasks.workunit.client.0.smithi043.stdout:0/527: creat d2/d3/d18/d2b/faa x:0 0 0 2023-12-08T20:28:19.831 INFO:tasks.workunit.client.0.smithi043.stdout:0/528: fdatasync d2/d3/d18/d2b/fa7 0 2023-12-08T20:28:19.833 INFO:tasks.workunit.client.0.smithi043.stdout:0/529: unlink d2/d3/d18/d1e/d53/f5d 0 2023-12-08T20:28:19.833 INFO:tasks.workunit.client.0.smithi043.stdout:0/530: write d2/d3/d18/d2b/f37 [5088048,42890] 0 2023-12-08T20:28:19.833 INFO:tasks.workunit.client.0.smithi043.stdout:0/531: mknod d2/d61/d67/d9e/cab 0 2023-12-08T20:28:19.834 INFO:tasks.workunit.client.0.smithi043.stdout:0/532: readlink d2/d3/d18/l23 0 2023-12-08T20:28:19.834 INFO:tasks.workunit.client.0.smithi043.stdout:0/533: unlink d2/d3/d6/l73 0 2023-12-08T20:28:19.835 INFO:tasks.workunit.client.0.smithi043.stdout:0/534: write d2/d3/fb [3340294,67190] 0 2023-12-08T20:28:19.837 INFO:tasks.workunit.client.0.smithi043.stdout:0/535: rename d2/d3/d18/d1e/d53/c5a to d2/d3/d18/d2b/da5/d3f/cac 0 2023-12-08T20:28:19.838 INFO:tasks.workunit.client.0.smithi043.stdout:0/536: creat d2/fad x:0 0 0 2023-12-08T20:28:19.838 INFO:tasks.workunit.client.0.smithi043.stdout:0/537: write d2/d61/d67/f87 [151413,94909] 0 2023-12-08T20:28:19.838 INFO:tasks.workunit.client.0.smithi043.stdout:0/538: fdatasync d2/d4/f9f 0 2023-12-08T20:28:19.839 INFO:tasks.workunit.client.0.smithi043.stdout:0/539: mkdir d2/d3/d6/d39/d63/da6/dae 0 2023-12-08T20:28:19.840 INFO:tasks.workunit.client.0.smithi043.stdout:0/540: creat d2/d3/d6/d39/d83/d9d/faf x:0 0 0 2023-12-08T20:28:19.840 INFO:tasks.workunit.client.0.smithi043.stdout:0/541: dread - d2/d3/d18/d2b/da5/d5f/d79/d86/f97 zero size 2023-12-08T20:28:19.840 INFO:tasks.workunit.client.0.smithi043.stdout:0/542: truncate d2/f24 4525899 0 2023-12-08T20:28:19.841 INFO:tasks.workunit.client.0.smithi043.stdout:0/543: write d2/d3/d18/d2b/f37 [3075368,19140] 0 2023-12-08T20:28:19.842 INFO:tasks.workunit.client.0.smithi043.stdout:0/544: creat d2/d3/d18/d2b/da5/fb0 x:0 0 0 2023-12-08T20:28:19.844 INFO:tasks.workunit.client.0.smithi043.stdout:0/545: read d2/d4/f82 [1597840,66495] 0 2023-12-08T20:28:19.844 INFO:tasks.workunit.client.0.smithi043.stdout:0/546: dread - d2/d3/d6/d39/d83/d9d/faf zero size 2023-12-08T20:28:19.844 INFO:tasks.workunit.client.0.smithi043.stdout:0/547: creat d2/d61/d67/fb1 x:0 0 0 2023-12-08T20:28:19.845 INFO:tasks.workunit.client.0.smithi043.stdout:0/548: creat d2/d3/d6/d39/d63/fb2 x:0 0 0 2023-12-08T20:28:19.845 INFO:tasks.workunit.client.0.smithi043.stdout:0/549: write d2/d61/d67/f87 [444322,69218] 0 2023-12-08T20:28:19.847 INFO:tasks.workunit.client.0.smithi043.stdout:0/550: unlink d2/f34 0 2023-12-08T20:28:19.854 INFO:tasks.workunit.client.0.smithi043.stdout:0/551: getdents d2/d3/d18/d2b/da5 0 2023-12-08T20:28:19.855 INFO:tasks.workunit.client.0.smithi043.stdout:0/552: link d2/d3/d18/l33 d2/d3/d18/d2b/da5/d5f/d79/d86/lb3 0 2023-12-08T20:28:19.856 INFO:tasks.workunit.client.0.smithi043.stdout:0/553: readlink d2/d3/d18/d1e/l27 0 2023-12-08T20:28:19.856 INFO:tasks.workunit.client.0.smithi043.stdout:0/554: dread - d2/d3/d6/f6c zero size 2023-12-08T20:28:19.857 INFO:tasks.workunit.client.0.smithi043.stdout:0/555: link d2/d3/d18/d1e/c56 d2/d3/d6/d39/cb4 0 2023-12-08T20:28:19.866 INFO:tasks.workunit.client.0.smithi043.stdout:0/556: dread d2/f7 [0,4194304] 0 2023-12-08T20:28:19.867 INFO:tasks.workunit.client.0.smithi043.stdout:0/557: write d2/d3/d18/d2b/da5/f69 [791345,109416] 0 2023-12-08T20:28:19.868 INFO:tasks.workunit.client.0.smithi043.stdout:9/397: sync 2023-12-08T20:28:19.870 INFO:tasks.workunit.client.0.smithi043.stdout:0/558: rename d2/d3/d18/d2b/da5/d5f/d79/d86/f97 to d2/d3/d6/d39/d83/fb5 0 2023-12-08T20:28:19.871 INFO:tasks.workunit.client.0.smithi043.stdout:9/398: creat d0/d5e/d37/d6b/f7e x:0 0 0 2023-12-08T20:28:19.871 INFO:tasks.workunit.client.0.smithi043.stdout:9/399: symlink d0/d3d/d4b/l7f 0 2023-12-08T20:28:19.878 INFO:tasks.workunit.client.0.smithi043.stdout:0/559: truncate d2/d3/fb 4172524 0 2023-12-08T20:28:19.879 INFO:tasks.workunit.client.0.smithi043.stdout:0/560: symlink d2/d3/d18/d1e/lb6 0 2023-12-08T20:28:19.880 INFO:tasks.workunit.client.0.smithi043.stdout:0/561: creat d2/d61/d8a/fb7 x:0 0 0 2023-12-08T20:28:19.882 INFO:tasks.workunit.client.0.smithi043.stdout:0/562: rename d2/c51 to d2/cb8 0 2023-12-08T20:28:19.882 INFO:tasks.workunit.client.0.smithi043.stdout:0/563: dread - d2/d3/d6/f68 zero size 2023-12-08T20:28:19.882 INFO:tasks.workunit.client.0.smithi043.stdout:0/564: chown d2/d4/f9c 8721 1 2023-12-08T20:28:19.884 INFO:tasks.workunit.client.0.smithi043.stdout:0/565: mknod d2/d4/cb9 0 2023-12-08T20:28:19.884 INFO:tasks.workunit.client.0.smithi043.stdout:0/566: dread - d2/d3/d18/d1e/d53/d7d/f93 zero size 2023-12-08T20:28:19.885 INFO:tasks.workunit.client.0.smithi043.stdout:0/567: symlink d2/d3/d18/d2b/da5/d8e/lba 0 2023-12-08T20:28:19.888 INFO:tasks.workunit.client.0.smithi043.stdout:9/400: dwrite d0/d5e/f63 [0,4194304] 0 2023-12-08T20:28:19.891 INFO:tasks.workunit.client.0.smithi043.stdout:9/401: mkdir d0/d21/d80 0 2023-12-08T20:28:19.892 INFO:tasks.workunit.client.0.smithi043.stdout:9/402: creat d0/d5e/f81 x:0 0 0 2023-12-08T20:28:19.893 INFO:tasks.workunit.client.0.smithi043.stdout:9/403: rename d0/d5e/d37/d6b/d76/l50 to d0/d21/d80/l82 0 2023-12-08T20:28:19.941 INFO:tasks.workunit.client.0.smithi043.stdout:0/568: dwrite d2/d3/d6/d39/d83/d9d/faf [0,4194304] 0 2023-12-08T20:28:19.943 INFO:tasks.workunit.client.0.smithi043.stdout:9/404: dwrite d0/d5e/f57 [0,4194304] 0 2023-12-08T20:28:19.943 INFO:tasks.workunit.client.0.smithi043.stdout:0/569: rename d2/d3/d6/d39/d5e/f75 to d2/d3/d18/d1e/d53/d7d/fbb 0 2023-12-08T20:28:19.950 INFO:tasks.workunit.client.0.smithi043.stdout:9/405: creat d0/d3d/f83 x:0 0 0 2023-12-08T20:28:19.952 INFO:tasks.workunit.client.0.smithi043.stdout:0/570: mknod d2/d3/d18/d2b/da5/d3f/cbc 0 2023-12-08T20:28:19.953 INFO:tasks.workunit.client.0.smithi043.stdout:0/571: rename d2/d3/d18/d2b/da5/c76 to d2/d3/d18/d2b/da5/da3/cbd 0 2023-12-08T20:28:19.954 INFO:tasks.workunit.client.0.smithi043.stdout:0/572: symlink d2/d3/d18/d2b/da5/d8e/lbe 0 2023-12-08T20:28:19.954 INFO:tasks.workunit.client.0.smithi043.stdout:0/573: read d2/d3/d18/d1e/f3c [286152,90933] 0 2023-12-08T20:28:19.955 INFO:tasks.workunit.client.0.smithi043.stdout:0/574: creat d2/d3/d18/fbf x:0 0 0 2023-12-08T20:28:19.955 INFO:tasks.workunit.client.0.smithi043.stdout:0/575: fdatasync d2/d3/f4e 0 2023-12-08T20:28:19.959 INFO:tasks.workunit.client.0.smithi043.stdout:9/406: dread d0/d5e/d37/d6b/d76/d53/f6d [0,4194304] 0 2023-12-08T20:28:19.960 INFO:tasks.workunit.client.0.smithi043.stdout:9/407: dread - d0/d3d/f83 zero size 2023-12-08T20:28:19.962 INFO:tasks.workunit.client.0.smithi043.stdout:9/408: mknod d0/d5e/d37/c84 0 2023-12-08T20:28:19.964 INFO:tasks.workunit.client.0.smithi043.stdout:9/409: truncate d0/f6 4199756 0 2023-12-08T20:28:19.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:19 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:19.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:19 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:19.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:19 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-08T20:28:19.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:19 smithi111 ceph-mon[121341]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-08T20:28:19.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:19 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-08T20:28:19.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:19 smithi111 ceph-mon[121341]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-08T20:28:19.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:19 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-08T20:28:19.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:19 smithi111 ceph-mon[121341]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-08T20:28:19.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:19 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:28:19.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:19 smithi111 ceph-mon[121341]: Upgrade: Need to upgrade myself (mgr.smithi111.mtcffu) 2023-12-08T20:28:19.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:19 smithi111 ceph-mon[121341]: Upgrade: Need to upgrade myself (mgr.smithi111.mtcffu) 2023-12-08T20:28:19.972 INFO:tasks.workunit.client.0.smithi043.stdout:6/402: sync 2023-12-08T20:28:19.972 INFO:tasks.workunit.client.0.smithi043.stdout:2/552: sync 2023-12-08T20:28:19.972 INFO:tasks.workunit.client.0.smithi043.stdout:2/553: fdatasync d0/d20/f4d 0 2023-12-08T20:28:19.974 INFO:tasks.workunit.client.0.smithi043.stdout:6/403: creat d0/d2/d14/f90 x:0 0 0 2023-12-08T20:28:19.975 INFO:tasks.workunit.client.0.smithi043.stdout:2/554: truncate d0/db/f4a 910677 0 2023-12-08T20:28:19.982 INFO:tasks.workunit.client.0.smithi043.stdout:2/555: write d0/d26/f34 [6456651,35072] 0 2023-12-08T20:28:19.983 INFO:tasks.workunit.client.0.smithi043.stdout:2/556: mkdir d0/db/d18/d8b/db4 0 2023-12-08T20:28:19.983 INFO:tasks.workunit.client.0.smithi043.stdout:0/576: dwrite d2/d3/f4e [0,4194304] 0 2023-12-08T20:28:19.984 INFO:tasks.workunit.client.0.smithi043.stdout:9/410: dwrite d0/d5e/f59 [0,4194304] 0 2023-12-08T20:28:19.984 INFO:tasks.workunit.client.0.smithi043.stdout:9/411: truncate d0/d3d/d4b/f7c 78068 0 2023-12-08T20:28:19.984 INFO:tasks.workunit.client.0.smithi043.stdout:2/557: creat d0/db/d18/d8b/db4/fb5 x:0 0 0 2023-12-08T20:28:19.988 INFO:tasks.workunit.client.0.smithi043.stdout:0/577: getdents d2/d3/d18/d2b/da5/d8e 0 2023-12-08T20:28:19.992 INFO:tasks.workunit.client.0.smithi043.stdout:2/558: creat d0/db/d18/d66/d71/fb6 x:0 0 0 2023-12-08T20:28:19.992 INFO:tasks.workunit.client.0.smithi043.stdout:2/559: readlink d0/d26/d37/l94 0 2023-12-08T20:28:19.993 INFO:tasks.workunit.client.0.smithi043.stdout:6/404: getdents d0/d2/d14 0 2023-12-08T20:28:19.993 INFO:tasks.workunit.client.0.smithi043.stdout:6/405: fdatasync d0/d2/f1f 0 2023-12-08T20:28:19.993 INFO:tasks.workunit.client.0.smithi043.stdout:6/406: chown d0/d2/d14/d2c 7310456 1 2023-12-08T20:28:19.995 INFO:tasks.workunit.client.0.smithi043.stdout:0/578: mkdir d2/d61/dc0 0 2023-12-08T20:28:19.998 INFO:tasks.workunit.client.0.smithi043.stdout:2/560: rmdir d0/db/d18/d8b/d9d 39 2023-12-08T20:28:19.998 INFO:tasks.workunit.client.0.smithi043.stdout:0/579: unlink d2/d3/d6/d39/d63/f72 0 2023-12-08T20:28:19.998 INFO:tasks.workunit.client.0.smithi043.stdout:0/580: chown d2/d3/d6/d39/f8d 84 1 2023-12-08T20:28:19.999 INFO:tasks.workunit.client.0.smithi043.stdout:0/581: mkdir d2/d61/dc1 0 2023-12-08T20:28:20.000 INFO:tasks.workunit.client.0.smithi043.stdout:0/582: getdents d2/d61/dc1 0 2023-12-08T20:28:20.000 INFO:tasks.workunit.client.0.smithi043.stdout:0/583: read d2/d3/d18/d2b/da5/f5c [414932,53088] 0 2023-12-08T20:28:20.004 INFO:tasks.workunit.client.0.smithi043.stdout:0/584: symlink d2/d3/d18/d2b/da5/d5f/d79/d86/lc2 0 2023-12-08T20:28:20.004 INFO:tasks.workunit.client.0.smithi043.stdout:0/585: read - d2/d61/d67/f95 zero size 2023-12-08T20:28:20.005 INFO:tasks.workunit.client.0.smithi043.stdout:0/586: mknod d2/d61/d8a/cc3 0 2023-12-08T20:28:20.005 INFO:tasks.workunit.client.0.smithi043.stdout:0/587: write d2/d3/d18/d2b/da5/f7a [253220,70326] 0 2023-12-08T20:28:20.005 INFO:tasks.workunit.client.0.smithi043.stdout:0/588: fsync d2/d3/d18/d1e/d88/f8b 0 2023-12-08T20:28:20.008 INFO:tasks.workunit.client.0.smithi043.stdout:0/589: rename d2/l47 to d2/d3/d6/d39/lc4 0 2023-12-08T20:28:20.008 INFO:tasks.workunit.client.0.smithi043.stdout:2/561: dread d0/d20/f2c [0,4194304] 0 2023-12-08T20:28:20.008 INFO:tasks.workunit.client.0.smithi043.stdout:0/590: write d2/d3/d18/d2b/f37 [27208,56359] 0 2023-12-08T20:28:20.009 INFO:tasks.workunit.client.0.smithi043.stdout:0/591: fsync d2/d61/d67/f95 0 2023-12-08T20:28:20.009 INFO:tasks.workunit.client.0.smithi043.stdout:2/562: symlink d0/db/d18/d66/d71/dab/lb7 0 2023-12-08T20:28:20.009 INFO:tasks.workunit.client.0.smithi043.stdout:0/592: write d2/d4/f9c [4348492,103989] 0 2023-12-08T20:28:20.010 INFO:tasks.workunit.client.0.smithi043.stdout:0/593: write d2/d3/d18/d1e/d53/d7d/fbb [3952552,88423] 0 2023-12-08T20:28:20.012 INFO:tasks.workunit.client.0.smithi043.stdout:0/594: unlink d2/d3/d18/f90 0 2023-12-08T20:28:20.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:19 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:20.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:19 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:20.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:19 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-08T20:28:20.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:19 smithi043 ceph-mon[111966]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-08T20:28:20.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:19 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-08T20:28:20.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:19 smithi043 ceph-mon[111966]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-08T20:28:20.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:19 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-08T20:28:20.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:19 smithi043 ceph-mon[111966]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-08T20:28:20.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:19 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:28:20.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:19 smithi043 ceph-mon[111966]: Upgrade: Need to upgrade myself (mgr.smithi111.mtcffu) 2023-12-08T20:28:20.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:19 smithi043 ceph-mon[111966]: Upgrade: Need to upgrade myself (mgr.smithi111.mtcffu) 2023-12-08T20:28:20.014 INFO:tasks.workunit.client.0.smithi043.stdout:6/407: dwrite d0/d2/d14/d20/d3c/f55 [0,4194304] 0 2023-12-08T20:28:20.015 INFO:tasks.workunit.client.0.smithi043.stdout:0/595: rename d2/cb8 to d2/d3/d18/d2b/da5/d3f/cc5 0 2023-12-08T20:28:20.016 INFO:tasks.workunit.client.0.smithi043.stdout:0/596: mknod d2/d3/d6/d39/d63/cc6 0 2023-12-08T20:28:20.018 INFO:tasks.workunit.client.0.smithi043.stdout:0/597: creat d2/d3/d18/fc7 x:0 0 0 2023-12-08T20:28:20.018 INFO:tasks.workunit.client.0.smithi043.stdout:0/598: stat d2/d3/d18/l23 0 2023-12-08T20:28:20.018 INFO:tasks.workunit.client.0.smithi043.stdout:0/599: fdatasync d2/d3/d18/fbf 0 2023-12-08T20:28:20.018 INFO:tasks.workunit.client.0.smithi043.stdout:0/600: getdents d2/d3/d6/d39/d63/da6 0 2023-12-08T20:28:20.020 INFO:tasks.workunit.client.0.smithi043.stdout:0/601: symlink d2/d3/d18/lc8 0 2023-12-08T20:28:20.033 INFO:tasks.workunit.client.0.smithi043.stdout:2/563: dwrite d0/d20/f60 [0,4194304] 0 2023-12-08T20:28:20.035 INFO:tasks.workunit.client.0.smithi043.stdout:2/564: mknod d0/d2b/d4e/cb8 0 2023-12-08T20:28:20.036 INFO:tasks.workunit.client.0.smithi043.stdout:2/565: mkdir d0/da6/db9 0 2023-12-08T20:28:20.036 INFO:tasks.workunit.client.0.smithi043.stdout:2/566: chown d0/d26/d53/f75 24412676 1 2023-12-08T20:28:20.036 INFO:tasks.workunit.client.0.smithi043.stdout:2/567: readlink d0/db/l1b 0 2023-12-08T20:28:20.037 INFO:tasks.workunit.client.0.smithi043.stdout:6/408: dwrite d0/d2/f36 [0,4194304] 0 2023-12-08T20:28:20.037 INFO:tasks.workunit.client.0.smithi043.stdout:6/409: fdatasync d0/d2/d29/f83 0 2023-12-08T20:28:20.037 INFO:tasks.workunit.client.0.smithi043.stdout:6/410: write d0/d2/d14/f57 [128638,131045] 0 2023-12-08T20:28:20.037 INFO:tasks.workunit.client.0.smithi043.stdout:6/411: fdatasync d0/d2/d14/d2c/f3b 0 2023-12-08T20:28:20.038 INFO:tasks.workunit.client.0.smithi043.stdout:0/602: dwrite d2/f8 [0,4194304] 0 2023-12-08T20:28:20.038 INFO:tasks.workunit.client.0.smithi043.stdout:6/412: write d0/d2/de/d4a/d56/f72 [79282,76139] 0 2023-12-08T20:28:20.038 INFO:tasks.workunit.client.0.smithi043.stdout:2/568: write d0/f4 [2036066,44728] 0 2023-12-08T20:28:20.039 INFO:tasks.workunit.client.0.smithi043.stdout:6/413: dread d0/f34 [0,4194304] 0 2023-12-08T20:28:20.039 INFO:tasks.workunit.client.0.smithi043.stdout:2/569: write d0/db/f19 [501010,16670] 0 2023-12-08T20:28:20.039 INFO:tasks.workunit.client.0.smithi043.stdout:0/603: mknod d2/d3/d18/d1e/d53/d7d/cc9 0 2023-12-08T20:28:20.040 INFO:tasks.workunit.client.0.smithi043.stdout:2/570: symlink d0/d26/d37/d38/dae/lba 0 2023-12-08T20:28:20.040 INFO:tasks.workunit.client.0.smithi043.stdout:2/571: dread - d0/f61 zero size 2023-12-08T20:28:20.042 INFO:tasks.workunit.client.0.smithi043.stdout:0/604: truncate d2/d3/d18/d2b/da5/f69 600239 0 2023-12-08T20:28:20.062 INFO:tasks.workunit.client.0.smithi043.stdout:6/414: dwrite d0/d2/d14/d20/d3c/d50/f77 [0,4194304] 0 2023-12-08T20:28:20.069 INFO:tasks.workunit.client.0.smithi043.stdout:0/605: dwrite d2/d3/d18/d2b/da5/f69 [0,4194304] 0 2023-12-08T20:28:20.070 INFO:tasks.workunit.client.0.smithi043.stdout:0/606: readlink d2/d4/l12 0 2023-12-08T20:28:20.070 INFO:tasks.workunit.client.0.smithi043.stdout:0/607: write d2/d3/d6/d39/d83/fb5 [811505,108069] 0 2023-12-08T20:28:20.071 INFO:tasks.workunit.client.0.smithi043.stdout:2/572: dwrite d0/d26/f27 [0,4194304] 0 2023-12-08T20:28:20.071 INFO:tasks.workunit.client.0.smithi043.stdout:2/573: chown d0/d26/d37/d38/c8f 169692063 1 2023-12-08T20:28:20.071 INFO:tasks.workunit.client.0.smithi043.stdout:2/574: fdatasync d0/db/d18/f1d 0 2023-12-08T20:28:20.071 INFO:tasks.workunit.client.0.smithi043.stdout:2/575: readlink d0/db/d18/d66/d71/dab/lb7 0 2023-12-08T20:28:20.071 INFO:tasks.workunit.client.0.smithi043.stdout:2/576: stat d0/d2b/d4e/cb8 0 2023-12-08T20:28:20.077 INFO:tasks.workunit.client.0.smithi043.stdout:0/608: dread d2/d4/f3d [0,4194304] 0 2023-12-08T20:28:20.077 INFO:tasks.workunit.client.0.smithi043.stdout:2/577: creat d0/d26/d53/fbb x:0 0 0 2023-12-08T20:28:20.080 INFO:tasks.workunit.client.0.smithi043.stdout:2/578: rename d0/d26/d37 to d0/d26/dbc 0 2023-12-08T20:28:20.083 INFO:tasks.workunit.client.0.smithi043.stdout:2/579: rmdir d0/db/d18/d8b/db4 39 2023-12-08T20:28:20.089 INFO:tasks.workunit.client.0.smithi043.stdout:2/580: dread d0/d2b/d4e/d79/f7c [0,4194304] 0 2023-12-08T20:28:20.089 INFO:tasks.workunit.client.0.smithi043.stdout:6/415: dwrite d0/d2/d29/f61 [4194304,4194304] 0 2023-12-08T20:28:20.089 INFO:tasks.workunit.client.0.smithi043.stdout:6/416: fsync d0/d2/d14/d8/f1e 0 2023-12-08T20:28:20.089 INFO:tasks.workunit.client.0.smithi043.stdout:6/417: dread - d0/d2/de/d4a/d56/f63 zero size 2023-12-08T20:28:20.089 INFO:tasks.workunit.client.0.smithi043.stdout:6/418: chown d0/d2/d14/d20/d3c/d50/c81 84427847 1 2023-12-08T20:28:20.094 INFO:tasks.workunit.client.0.smithi043.stdout:2/581: rmdir d0/d26/d53 39 2023-12-08T20:28:20.096 INFO:tasks.workunit.client.0.smithi043.stdout:6/419: mknod d0/d2/d14/d8/c91 0 2023-12-08T20:28:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:0/609: dwrite d2/d3/d18/f43 [4194304,4194304] 0 2023-12-08T20:28:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:0/610: write d2/fad [250661,879] 0 2023-12-08T20:28:20.101 INFO:tasks.workunit.client.0.smithi043.stdout:0/611: write d2/d4/f3d [1849887,33073] 0 2023-12-08T20:28:20.107 INFO:tasks.workunit.client.0.smithi043.stdout:0/612: rmdir d2/d3/d18/d2b/da5 39 2023-12-08T20:28:20.107 INFO:tasks.workunit.client.0.smithi043.stdout:0/613: truncate d2/d3/d18/d2b/da5/f7a 816551 0 2023-12-08T20:28:20.107 INFO:tasks.workunit.client.0.smithi043.stdout:0/614: write d2/d3/d6/d39/d5e/f65 [686548,30979] 0 2023-12-08T20:28:20.107 INFO:tasks.workunit.client.0.smithi043.stdout:0/615: write d2/d3/d18/d1e/fa9 [134278,98233] 0 2023-12-08T20:28:20.109 INFO:tasks.workunit.client.0.smithi043.stdout:0/616: getdents d2/d3/d18/d1e 0 2023-12-08T20:28:20.109 INFO:tasks.workunit.client.0.smithi043.stdout:0/617: write d2/d3/d18/d2b/da5/d3f/f7f [413555,128799] 0 2023-12-08T20:28:20.112 INFO:tasks.workunit.client.0.smithi043.stdout:6/420: dread d0/f48 [0,4194304] 0 2023-12-08T20:28:20.112 INFO:tasks.workunit.client.0.smithi043.stdout:0/618: unlink d2/f8 0 2023-12-08T20:28:20.112 INFO:tasks.workunit.client.0.smithi043.stdout:0/619: getdents d2/d3/d6/d39/d63/da6 0 2023-12-08T20:28:20.115 INFO:tasks.workunit.client.0.smithi043.stdout:0/620: creat d2/fca x:0 0 0 2023-12-08T20:28:20.118 INFO:tasks.workunit.client.0.smithi043.stdout:2/582: dwrite d0/db/d18/d66/d71/fb6 [0,4194304] 0 2023-12-08T20:28:20.118 INFO:tasks.workunit.client.0.smithi043.stdout:2/583: dread - d0/db/d18/d66/f9b zero size 2023-12-08T20:28:20.124 INFO:tasks.workunit.client.0.smithi043.stdout:2/584: mknod d0/d20/cbd 0 2023-12-08T20:28:20.127 INFO:tasks.workunit.client.0.smithi043.stdout:2/585: link d0/db/d18/d8b/db4/fb5 d0/db/d18/d66/d71/fbe 0 2023-12-08T20:28:20.127 INFO:tasks.workunit.client.0.smithi043.stdout:2/586: fsync d0/db/d18/d66/d71/fac 0 2023-12-08T20:28:20.129 INFO:tasks.workunit.client.0.smithi043.stdout:2/587: rename d0/d26/fa8 to d0/db/d18/da3/fbf 0 2023-12-08T20:28:20.130 INFO:tasks.workunit.client.0.smithi043.stdout:2/588: mkdir d0/d26/dbc/d38/dae/dc0 0 2023-12-08T20:28:20.131 INFO:tasks.workunit.client.0.smithi043.stdout:2/589: symlink d0/d26/da7/lc1 0 2023-12-08T20:28:20.132 INFO:tasks.workunit.client.0.smithi043.stdout:2/590: dread - d0/db/fa5 zero size 2023-12-08T20:28:20.132 INFO:tasks.workunit.client.0.smithi043.stdout:2/591: read - d0/db/d18/d66/f77 zero size 2023-12-08T20:28:20.132 INFO:tasks.workunit.client.0.smithi043.stdout:2/592: write d0/d2b/d4e/fa1 [2678026,13212] 0 2023-12-08T20:28:20.132 INFO:tasks.workunit.client.0.smithi043.stdout:2/593: write d0/f28 [103624,22338] 0 2023-12-08T20:28:20.148 INFO:tasks.workunit.client.0.smithi043.stdout:0/621: dwrite d2/d3/d18/d2b/da5/f49 [0,4194304] 0 2023-12-08T20:28:20.153 INFO:tasks.workunit.client.0.smithi043.stdout:0/622: unlink d2/d3/d6/d39/cb4 0 2023-12-08T20:28:20.153 INFO:tasks.workunit.client.0.smithi043.stdout:0/623: dread - d2/d3/d18/d1e/d88/f8b zero size 2023-12-08T20:28:20.163 INFO:tasks.workunit.client.0.smithi043.stdout:6/421: dwrite d0/d2/de/d4a/d56/f72 [0,4194304] 0 2023-12-08T20:28:20.163 INFO:tasks.workunit.client.0.smithi043.stdout:6/422: fsync d0/d2/d14/d8/f7b 0 2023-12-08T20:28:20.163 INFO:tasks.workunit.client.0.smithi043.stdout:6/423: write d0/f34 [1055270,19578] 0 2023-12-08T20:28:20.165 INFO:tasks.workunit.client.0.smithi043.stdout:6/424: mkdir d0/d2/d92 0 2023-12-08T20:28:20.165 INFO:tasks.workunit.client.0.smithi043.stdout:6/425: chown d0/d2/d29/c89 1936952 1 2023-12-08T20:28:20.166 INFO:tasks.workunit.client.0.smithi043.stdout:2/594: dwrite d0/d81/f8a [0,4194304] 0 2023-12-08T20:28:20.168 INFO:tasks.workunit.client.0.smithi043.stdout:6/426: mknod d0/d2/d14/d2c/d22/d3f/d45/d69/c93 0 2023-12-08T20:28:20.169 INFO:tasks.workunit.client.0.smithi043.stdout:2/595: getdents d0/d20 0 2023-12-08T20:28:20.171 INFO:tasks.workunit.client.0.smithi043.stdout:2/596: creat d0/db/d18/d3d/fc2 x:0 0 0 2023-12-08T20:28:20.171 INFO:tasks.workunit.client.0.smithi043.stdout:2/597: chown d0/fa 13 1 2023-12-08T20:28:20.173 INFO:tasks.workunit.client.0.smithi043.stdout:2/598: mkdir d0/d26/dbc/d38/dae/dc0/dc3 0 2023-12-08T20:28:20.178 INFO:tasks.workunit.client.0.smithi043.stdout:6/427: dread d0/d2/d14/d8/f1e [0,4194304] 0 2023-12-08T20:28:20.182 INFO:tasks.workunit.client.0.smithi043.stdout:6/428: symlink d0/d2/de/d4a/d56/l94 0 2023-12-08T20:28:20.188 INFO:tasks.workunit.client.0.smithi043.stdout:8/422: sync 2023-12-08T20:28:20.188 INFO:tasks.workunit.client.0.smithi043.stdout:3/396: sync 2023-12-08T20:28:20.188 INFO:tasks.workunit.client.0.smithi043.stdout:3/397: chown d1/d1c/l44 1460646 1 2023-12-08T20:28:20.189 INFO:tasks.workunit.client.0.smithi043.stdout:8/423: unlink d2/d20/f2b 0 2023-12-08T20:28:20.189 INFO:tasks.workunit.client.0.smithi043.stdout:8/424: chown d2/d27/d2d/d31/f58 3870096 1 2023-12-08T20:28:20.191 INFO:tasks.workunit.client.0.smithi043.stdout:2/599: dwrite d0/db/f31 [0,4194304] 0 2023-12-08T20:28:20.191 INFO:tasks.workunit.client.0.smithi043.stdout:3/398: mkdir d1/d1c/d2c/d7f 0 2023-12-08T20:28:20.191 INFO:tasks.workunit.client.0.smithi043.stdout:3/399: dread - d1/d9/d38/d4f/f79 zero size 2023-12-08T20:28:20.192 INFO:tasks.workunit.client.0.smithi043.stdout:8/425: rmdir d2/d6f 39 2023-12-08T20:28:20.192 INFO:tasks.workunit.client.0.smithi043.stdout:8/426: readlink d2/d27/l5f 0 2023-12-08T20:28:20.193 INFO:tasks.workunit.client.0.smithi043.stdout:2/600: mknod d0/d2b/d4e/d79/cc4 0 2023-12-08T20:28:20.196 INFO:tasks.workunit.client.0.smithi043.stdout:2/601: rename d0/f55 to d0/db/d18/d3d/fc5 0 2023-12-08T20:28:20.196 INFO:tasks.workunit.client.0.smithi043.stdout:2/602: chown d0/d26/dbc/d38/dae/dc0/dc3 0 1 2023-12-08T20:28:20.202 INFO:tasks.workunit.client.0.smithi043.stdout:3/400: dread d1/d1c/d2c/d76/f7a [0,4194304] 0 2023-12-08T20:28:20.204 INFO:tasks.workunit.client.0.smithi043.stdout:3/401: mkdir d1/d1c/d2c/d5f/d80 0 2023-12-08T20:28:20.204 INFO:tasks.workunit.client.0.smithi043.stdout:3/402: rmdir d1/d25/d2a/d45 39 2023-12-08T20:28:20.205 INFO:tasks.workunit.client.0.smithi043.stdout:3/403: mknod d1/d1c/c81 0 2023-12-08T20:28:20.206 INFO:tasks.workunit.client.0.smithi043.stdout:3/404: link d1/c21 d1/d9/df/d6e/c82 0 2023-12-08T20:28:20.206 INFO:tasks.workunit.client.0.smithi043.stdout:3/405: stat d1/d25/c1d 0 2023-12-08T20:28:20.215 INFO:tasks.workunit.client.0.smithi043.stdout:2/603: dread d0/d20/f2c [4194304,4194304] 0 2023-12-08T20:28:20.215 INFO:tasks.workunit.client.0.smithi043.stdout:8/427: dwrite d2/d27/d2d/f55 [0,4194304] 0 2023-12-08T20:28:20.215 INFO:tasks.workunit.client.0.smithi043.stdout:6/429: dwrite d0/f7f [0,4194304] 0 2023-12-08T20:28:20.216 INFO:tasks.workunit.client.0.smithi043.stdout:8/428: fdatasync d2/d27/d2d/f55 0 2023-12-08T20:28:20.216 INFO:tasks.workunit.client.0.smithi043.stdout:8/429: dread - d2/d20/f78 zero size 2023-12-08T20:28:20.216 INFO:tasks.workunit.client.0.smithi043.stdout:8/430: write d2/d20/d7d/f14 [1342322,47327] 0 2023-12-08T20:28:20.220 INFO:tasks.workunit.client.0.smithi043.stdout:6/430: rmdir d0/d2/d14/d2c/d66/d8e 0 2023-12-08T20:28:20.220 INFO:tasks.workunit.client.0.smithi043.stdout:8/431: creat d2/d6f/f82 x:0 0 0 2023-12-08T20:28:20.223 INFO:tasks.workunit.client.0.smithi043.stdout:8/432: creat d2/d27/d2d/d31/d74/f83 x:0 0 0 2023-12-08T20:28:20.224 INFO:tasks.workunit.client.0.smithi043.stdout:6/431: symlink d0/d2/de/d4a/d56/l95 0 2023-12-08T20:28:20.224 INFO:tasks.workunit.client.0.smithi043.stdout:6/432: fsync d0/d2/d14/d2c/d22/f7e 0 2023-12-08T20:28:20.225 INFO:tasks.workunit.client.0.smithi043.stdout:8/433: mknod d2/d20/d7d/d37/d5a/c84 0 2023-12-08T20:28:20.230 INFO:tasks.workunit.client.0.smithi043.stdout:8/434: rename d2/c6 to d2/d20/d7d/d29/d59/c85 0 2023-12-08T20:28:20.230 INFO:tasks.workunit.client.0.smithi043.stdout:8/435: fdatasync d2/d27/f6d 0 2023-12-08T20:28:20.230 INFO:tasks.workunit.client.0.smithi043.stdout:3/406: dwrite d1/d9/fd [4194304,4194304] 0 2023-12-08T20:28:20.230 INFO:tasks.workunit.client.0.smithi043.stdout:8/436: mkdir d2/d20/d7d/d29/d59/d86 0 2023-12-08T20:28:20.230 INFO:tasks.workunit.client.0.smithi043.stdout:8/437: truncate d2/d20/d7d/f61 681165 0 2023-12-08T20:28:20.231 INFO:tasks.workunit.client.0.smithi043.stdout:2/604: dwrite d0/db/f4a [0,4194304] 0 2023-12-08T20:28:20.231 INFO:tasks.workunit.client.0.smithi043.stdout:3/407: unlink d1/d9/d38/d30/f40 0 2023-12-08T20:28:20.232 INFO:tasks.workunit.client.0.smithi043.stdout:3/408: stat d1/d9/d38/d4a 0 2023-12-08T20:28:20.233 INFO:tasks.workunit.client.0.smithi043.stdout:3/409: write d1/d9/df/f47 [4135522,58027] 0 2023-12-08T20:28:20.233 INFO:tasks.workunit.client.0.smithi043.stdout:3/410: readlink d1/d9/l23 0 2023-12-08T20:28:20.235 INFO:tasks.workunit.client.0.smithi043.stdout:2/605: read d0/d20/d42/f78 [1055191,115666] 0 2023-12-08T20:28:20.235 INFO:tasks.workunit.client.0.smithi043.stdout:2/606: stat d0/d26/f3b 0 2023-12-08T20:28:20.235 INFO:tasks.workunit.client.0.smithi043.stdout:8/438: symlink d2/d27/d2d/d31/l87 0 2023-12-08T20:28:20.235 INFO:tasks.workunit.client.0.smithi043.stdout:8/439: fdatasync d2/d20/d7d/f61 0 2023-12-08T20:28:20.235 INFO:tasks.workunit.client.0.smithi043.stdout:8/440: chown d2/d20/d7d/d37/d5a/c84 1312613 1 2023-12-08T20:28:20.240 INFO:tasks.workunit.client.0.smithi043.stdout:3/411: rmdir d1/d9/d38/d33/d67 0 2023-12-08T20:28:20.240 INFO:tasks.workunit.client.0.smithi043.stdout:3/412: chown d1/d9/df/f62 16634941 1 2023-12-08T20:28:20.244 INFO:tasks.workunit.client.0.smithi043.stdout:2/607: creat d0/d2b/d4e/fc6 x:0 0 0 2023-12-08T20:28:20.247 INFO:tasks.workunit.client.0.smithi043.stdout:8/441: rename d2/d20/c33 to d2/d20/d7d/d29/d68/c88 0 2023-12-08T20:28:20.247 INFO:tasks.workunit.client.0.smithi043.stdout:2/608: dread d0/db/d18/f7e [0,4194304] 0 2023-12-08T20:28:20.252 INFO:tasks.workunit.client.0.smithi043.stdout:2/609: creat d0/d2b/d4e/fc7 x:0 0 0 2023-12-08T20:28:20.256 INFO:tasks.workunit.client.0.smithi043.stdout:3/413: link d1/d1c/d29/l4d d1/d25/d2a/d5e/l83 0 2023-12-08T20:28:20.257 INFO:tasks.workunit.client.0.smithi043.stdout:3/414: getdents d1/d9/df/d6e/d7d 0 2023-12-08T20:28:20.260 INFO:tasks.workunit.client.0.smithi043.stdout:3/415: mkdir d1/d25/d84 0 2023-12-08T20:28:20.260 INFO:tasks.workunit.client.0.smithi043.stdout:2/610: dread d0/d2b/d4e/fa1 [0,4194304] 0 2023-12-08T20:28:20.261 INFO:tasks.workunit.client.0.smithi043.stdout:3/416: mkdir d1/d25/d2a/d85 0 2023-12-08T20:28:20.263 INFO:tasks.workunit.client.0.smithi043.stdout:2/611: rename d0/d2b/f35 to d0/d81/fc8 0 2023-12-08T20:28:20.266 INFO:tasks.workunit.client.0.smithi043.stdout:3/417: rename d1/d1c/d2c/d76 to d1/d9/d38/d4a/d86 0 2023-12-08T20:28:20.269 INFO:tasks.workunit.client.0.smithi043.stdout:2/612: creat d0/db/d18/da3/fc9 x:0 0 0 2023-12-08T20:28:20.271 INFO:tasks.workunit.client.0.smithi043.stdout:8/442: dwrite d2/d20/d7d/f13 [0,4194304] 0 2023-12-08T20:28:20.271 INFO:tasks.workunit.client.0.smithi043.stdout:3/418: truncate d1/d1c/d29/f5c 2136146 0 2023-12-08T20:28:20.276 INFO:tasks.workunit.client.0.smithi043.stdout:2/613: dread d0/fa [0,4194304] 0 2023-12-08T20:28:20.280 INFO:tasks.workunit.client.0.smithi043.stdout:3/419: mknod d1/d1c/d2c/d7f/c87 0 2023-12-08T20:28:20.286 INFO:tasks.workunit.client.0.smithi043.stdout:8/443: mknod d2/d27/d2d/d31/d4f/c89 0 2023-12-08T20:28:20.287 INFO:tasks.workunit.client.0.smithi043.stdout:2/614: rename d0/db/d18/d8b/f90 to d0/d26/fca 0 2023-12-08T20:28:20.296 INFO:tasks.workunit.client.0.smithi043.stdout:8/444: dread d2/f9 [0,4194304] 0 2023-12-08T20:28:20.298 INFO:tasks.workunit.client.0.smithi043.stdout:3/420: dwrite d1/d9/f32 [0,4194304] 0 2023-12-08T20:28:20.298 INFO:tasks.workunit.client.0.smithi043.stdout:3/421: truncate d1/d9/d38/d4f/f79 206251 0 2023-12-08T20:28:20.298 INFO:tasks.workunit.client.0.smithi043.stdout:8/445: creat d2/d20/d7d/f8a x:0 0 0 2023-12-08T20:28:20.300 INFO:tasks.workunit.client.0.smithi043.stdout:3/422: symlink d1/d9/d38/d30/l88 0 2023-12-08T20:28:20.301 INFO:tasks.workunit.client.0.smithi043.stdout:3/423: creat d1/d9/d38/d30/d56/f89 x:0 0 0 2023-12-08T20:28:20.313 INFO:tasks.workunit.client.0.smithi043.stdout:2/615: dwrite d0/db/fa5 [0,4194304] 0 2023-12-08T20:28:20.315 INFO:tasks.workunit.client.0.smithi043.stdout:2/616: rmdir d0/d81 39 2023-12-08T20:28:20.321 INFO:tasks.workunit.client.0.smithi043.stdout:3/424: dwrite d1/d25/d2a/f6a [0,4194304] 0 2023-12-08T20:28:20.325 INFO:tasks.workunit.client.0.smithi043.stdout:8/446: dwrite d2/d20/d7d/d37/d5a/f63 [0,4194304] 0 2023-12-08T20:28:20.326 INFO:tasks.workunit.client.0.smithi043.stdout:8/447: rename d2/d20/d7d/c5c to d2/d20/d7d/d29/c8b 0 2023-12-08T20:28:20.327 INFO:tasks.workunit.client.0.smithi043.stdout:8/448: symlink d2/d20/d7d/d37/l8c 0 2023-12-08T20:28:20.327 INFO:tasks.workunit.client.0.smithi043.stdout:8/449: stat d2/d27/d2d/d31/f36 0 2023-12-08T20:28:20.331 INFO:tasks.workunit.client.0.smithi043.stdout:3/425: dread d1/d9/f32 [0,4194304] 0 2023-12-08T20:28:20.331 INFO:tasks.workunit.client.0.smithi043.stdout:2/617: dwrite d0/d20/f2a [4194304,4194304] 0 2023-12-08T20:28:20.346 INFO:tasks.workunit.client.0.smithi043.stdout:3/426: dread d1/d9/f19 [8388608,4194304] 0 2023-12-08T20:28:20.355 INFO:tasks.workunit.client.0.smithi043.stdout:2/618: dwrite d0/d26/f34 [0,4194304] 0 2023-12-08T20:28:20.355 INFO:tasks.workunit.client.0.smithi043.stdout:2/619: chown d0/d2b/d4e/f5a 4 1 2023-12-08T20:28:20.356 INFO:tasks.workunit.client.0.smithi043.stdout:2/620: mkdir d0/d20/d42/dcb 0 2023-12-08T20:28:20.357 INFO:tasks.workunit.client.0.smithi043.stdout:8/450: dwrite d2/d20/d7d/d37/d5a/f63 [0,4194304] 0 2023-12-08T20:28:20.358 INFO:tasks.workunit.client.0.smithi043.stdout:2/621: creat d0/d20/d42/dcb/fcc x:0 0 0 2023-12-08T20:28:20.360 INFO:tasks.workunit.client.0.smithi043.stdout:2/622: creat d0/d2b/d4e/d93/da9/fcd x:0 0 0 2023-12-08T20:28:20.361 INFO:tasks.workunit.client.0.smithi043.stdout:2/623: write d0/db/d18/d3d/fc5 [533071,30636] 0 2023-12-08T20:28:20.361 INFO:tasks.workunit.client.0.smithi043.stdout:2/624: read - d0/db/d18/d3d/fb3 zero size 2023-12-08T20:28:20.361 INFO:tasks.workunit.client.0.smithi043.stdout:2/625: stat d0/d26/d53/f75 0 2023-12-08T20:28:20.361 INFO:tasks.workunit.client.0.smithi043.stdout:2/626: creat d0/fce x:0 0 0 2023-12-08T20:28:20.362 INFO:tasks.workunit.client.0.smithi043.stdout:3/427: dwrite d1/d25/f24 [4194304,4194304] 0 2023-12-08T20:28:20.363 INFO:tasks.workunit.client.0.smithi043.stdout:3/428: mknod d1/d1c/c8a 0 2023-12-08T20:28:20.365 INFO:tasks.workunit.client.0.smithi043.stdout:3/429: mkdir d1/d1c/d8b 0 2023-12-08T20:28:20.365 INFO:tasks.workunit.client.0.smithi043.stdout:2/627: write d0/f17 [81362,97845] 0 2023-12-08T20:28:20.365 INFO:tasks.workunit.client.0.smithi043.stdout:2/628: stat d0/db/d18/d66/f9b 0 2023-12-08T20:28:20.368 INFO:tasks.workunit.client.0.smithi043.stdout:5/448: sync 2023-12-08T20:28:20.368 INFO:tasks.workunit.client.0.smithi043.stdout:5/449: chown d3/d7/d21/c5a 2780 1 2023-12-08T20:28:20.369 INFO:tasks.workunit.client.0.smithi043.stdout:2/629: link d0/db/d18/f1d d0/db/d18/d3d/fcf 0 2023-12-08T20:28:20.370 INFO:tasks.workunit.client.0.smithi043.stdout:2/630: dread - d0/d2b/d4e/d93/f9e zero size 2023-12-08T20:28:20.371 INFO:tasks.workunit.client.0.smithi043.stdout:5/450: unlink d3/d7/d21/l2b 0 2023-12-08T20:28:20.371 INFO:tasks.workunit.client.0.smithi043.stdout:5/451: getdents d3/d7/d21/d51/d7d 0 2023-12-08T20:28:20.372 INFO:tasks.workunit.client.0.smithi043.stdout:1/426: sync 2023-12-08T20:28:20.372 INFO:tasks.workunit.client.0.smithi043.stdout:1/427: readlink d1/d16/d21/d25/d35/l6b 0 2023-12-08T20:28:20.372 INFO:tasks.workunit.client.0.smithi043.stdout:2/631: creat d0/d26/fd0 x:0 0 0 2023-12-08T20:28:20.372 INFO:tasks.workunit.client.0.smithi043.stdout:2/632: chown d0/db/f14 98713 1 2023-12-08T20:28:20.372 INFO:tasks.workunit.client.0.smithi043.stdout:2/633: chown d0/d20/d42 23059898 1 2023-12-08T20:28:20.373 INFO:tasks.workunit.client.0.smithi043.stdout:5/452: creat d3/d7/de/d43/d68/f88 x:0 0 0 2023-12-08T20:28:20.374 INFO:tasks.workunit.client.0.smithi043.stdout:1/428: symlink d1/d16/d30/d4f/l9b 0 2023-12-08T20:28:20.375 INFO:tasks.workunit.client.0.smithi043.stdout:2/634: creat d0/d26/d53/fd1 x:0 0 0 2023-12-08T20:28:20.375 INFO:tasks.workunit.client.0.smithi043.stdout:5/453: mkdir d3/d7/de/d6a/d89 0 2023-12-08T20:28:20.375 INFO:tasks.workunit.client.0.smithi043.stdout:5/454: chown d3/d7/d21/f61 624 1 2023-12-08T20:28:20.377 INFO:tasks.workunit.client.0.smithi043.stdout:1/429: creat d1/d16/d7e/f9c x:0 0 0 2023-12-08T20:28:20.377 INFO:tasks.workunit.client.0.smithi043.stdout:1/430: getdents d1/d16/d21/d25/d3e/d72 0 2023-12-08T20:28:20.377 INFO:tasks.workunit.client.0.smithi043.stdout:1/431: dread - d1/d16/d30/d4f/d54/f79 zero size 2023-12-08T20:28:20.377 INFO:tasks.workunit.client.0.smithi043.stdout:1/432: write d1/d16/d21/f51 [1168436,87127] 0 2023-12-08T20:28:20.377 INFO:tasks.workunit.client.0.smithi043.stdout:1/433: dread - d1/d16/d21/d25/d35/f64 zero size 2023-12-08T20:28:20.377 INFO:tasks.workunit.client.0.smithi043.stdout:8/451: dwrite d2/f9 [0,4194304] 0 2023-12-08T20:28:20.378 INFO:tasks.workunit.client.0.smithi043.stdout:2/635: rmdir d0/d26/dbc/d38/dae/dc0/dc3 0 2023-12-08T20:28:20.379 INFO:tasks.workunit.client.0.smithi043.stdout:5/455: rmdir d3/d7/de/d6a/d89 0 2023-12-08T20:28:20.379 INFO:tasks.workunit.client.0.smithi043.stdout:1/434: dread d1/d16/f49 [0,4194304] 0 2023-12-08T20:28:20.381 INFO:tasks.workunit.client.0.smithi043.stdout:5/456: dread d3/d7/de/f18 [8388608,4194304] 0 2023-12-08T20:28:20.386 INFO:tasks.workunit.client.0.smithi043.stdout:8/452: creat d2/d20/d7d/d29/d30/d71/f8d x:0 0 0 2023-12-08T20:28:20.386 INFO:tasks.workunit.client.0.smithi043.stdout:8/453: stat d2/d20/d7d/ff 0 2023-12-08T20:28:20.386 INFO:tasks.workunit.client.0.smithi043.stdout:8/454: write d2/d20/d7d/d37/d5a/f63 [2044952,2582] 0 2023-12-08T20:28:20.386 INFO:tasks.workunit.client.0.smithi043.stdout:8/455: chown d2/d27/d2d/d31/d74/f83 71537 1 2023-12-08T20:28:20.386 INFO:tasks.workunit.client.0.smithi043.stdout:2/636: symlink d0/db/d18/d8b/ld2 0 2023-12-08T20:28:20.386 INFO:tasks.workunit.client.0.smithi043.stdout:2/637: truncate d0/d2b/d4e/fc6 169053 0 2023-12-08T20:28:20.387 INFO:tasks.workunit.client.0.smithi043.stdout:8/456: write d2/d20/d7d/d29/d30/f49 [275708,25992] 0 2023-12-08T20:28:20.387 INFO:tasks.workunit.client.0.smithi043.stdout:1/435: truncate d1/d6/fa 793763 0 2023-12-08T20:28:20.387 INFO:tasks.workunit.client.0.smithi043.stdout:8/457: read d2/d27/d2d/d31/f58 [802280,124574] 0 2023-12-08T20:28:20.387 INFO:tasks.workunit.client.0.smithi043.stdout:8/458: chown d2/d20/d7d/f8a 16594 1 2023-12-08T20:28:20.387 INFO:tasks.workunit.client.0.smithi043.stdout:3/430: dwrite d1/d1c/f22 [0,4194304] 0 2023-12-08T20:28:20.387 INFO:tasks.workunit.client.0.smithi043.stdout:3/431: write d1/d9/df/d41/f5b [477763,109574] 0 2023-12-08T20:28:20.389 INFO:tasks.workunit.client.0.smithi043.stdout:2/638: truncate d0/db/d18/f1d 2950586 0 2023-12-08T20:28:20.389 INFO:tasks.workunit.client.0.smithi043.stdout:5/457: creat d3/d7/de/d43/f8a x:0 0 0 2023-12-08T20:28:20.389 INFO:tasks.workunit.client.0.smithi043.stdout:5/458: chown d3/d7/de/d17/d84/f87 3021336 1 2023-12-08T20:28:20.391 INFO:tasks.workunit.client.0.smithi043.stdout:8/459: symlink d2/d20/d7d/d37/l8e 0 2023-12-08T20:28:20.394 INFO:tasks.workunit.client.0.smithi043.stdout:2/639: write d0/db/d18/d66/d71/fb6 [1177746,43773] 0 2023-12-08T20:28:20.394 INFO:tasks.workunit.client.0.smithi043.stdout:8/460: mknod d2/d20/d7d/d29/d68/c8f 0 2023-12-08T20:28:20.394 INFO:tasks.workunit.client.0.smithi043.stdout:8/461: chown d2/d20/d7d 227123268 1 2023-12-08T20:28:20.396 INFO:tasks.workunit.client.0.smithi043.stdout:8/462: symlink d2/l90 0 2023-12-08T20:28:20.399 INFO:tasks.workunit.client.0.smithi043.stdout:3/432: write d1/d9/f19 [3363361,24987] 0 2023-12-08T20:28:20.400 INFO:tasks.workunit.client.0.smithi043.stdout:3/433: creat d1/d9/d38/d4f/f8c x:0 0 0 2023-12-08T20:28:20.401 INFO:tasks.workunit.client.0.smithi043.stdout:3/434: fdatasync d1/d25/f31 0 2023-12-08T20:28:20.407 INFO:tasks.workunit.client.0.smithi043.stdout:1/436: dwrite d1/d16/d48/f4a [0,4194304] 0 2023-12-08T20:28:20.408 INFO:tasks.workunit.client.0.smithi043.stdout:9/412: sync 2023-12-08T20:28:20.410 INFO:tasks.workunit.client.0.smithi043.stdout:1/437: unlink d1/d16/d21/d60/f87 0 2023-12-08T20:28:20.411 INFO:tasks.workunit.client.0.smithi043.stdout:3/435: symlink d1/d1c/d2c/d7f/l8d 0 2023-12-08T20:28:20.412 INFO:tasks.workunit.client.0.smithi043.stdout:9/413: mknod d0/d5e/d37/d6b/d6c/c85 0 2023-12-08T20:28:20.413 INFO:tasks.workunit.client.0.smithi043.stdout:1/438: creat d1/d16/d21/d25/d35/f9d x:0 0 0 2023-12-08T20:28:20.415 INFO:tasks.workunit.client.0.smithi043.stdout:3/436: symlink d1/d1c/d2c/d5f/d80/l8e 0 2023-12-08T20:28:20.415 INFO:tasks.workunit.client.0.smithi043.stdout:2/640: dwrite d0/f25 [0,4194304] 0 2023-12-08T20:28:20.415 INFO:tasks.workunit.client.0.smithi043.stdout:2/641: fdatasync d0/d2b/f5b 0 2023-12-08T20:28:20.415 INFO:tasks.workunit.client.0.smithi043.stdout:2/642: read d0/db/f14 [611766,14401] 0 2023-12-08T20:28:20.416 INFO:tasks.workunit.client.0.smithi043.stdout:3/437: mkdir d1/d9/d38/d4f/d8f 0 2023-12-08T20:28:20.434 INFO:tasks.workunit.client.0.smithi043.stdout:2/643: dread d0/db/d18/d3d/fcf [0,4194304] 0 2023-12-08T20:28:20.434 INFO:tasks.workunit.client.0.smithi043.stdout:2/644: getdents d0/db/d18/d8b/d9d 0 2023-12-08T20:28:20.434 INFO:tasks.workunit.client.0.smithi043.stdout:2/645: creat d0/db/d18/d66/d71/dab/fd3 x:0 0 0 2023-12-08T20:28:20.435 INFO:tasks.workunit.client.0.smithi043.stdout:2/646: truncate d0/db/f4a 272961 0 2023-12-08T20:28:20.436 INFO:tasks.workunit.client.0.smithi043.stdout:9/414: dwrite d0/d3d/d4b/f7c [0,4194304] 0 2023-12-08T20:28:20.436 INFO:tasks.workunit.client.0.smithi043.stdout:3/438: dwrite d1/d9/d38/d33/f69 [0,4194304] 0 2023-12-08T20:28:20.443 INFO:tasks.workunit.client.0.smithi043.stdout:3/439: rename d1/d9/l23 to d1/d9/df/l90 0 2023-12-08T20:28:20.443 INFO:tasks.workunit.client.0.smithi043.stdout:3/440: fsync d1/d9/df/d41/f5b 0 2023-12-08T20:28:20.443 INFO:tasks.workunit.client.0.smithi043.stdout:1/439: dwrite d1/d6/f32 [0,4194304] 0 2023-12-08T20:28:20.443 INFO:tasks.workunit.client.0.smithi043.stdout:1/440: dread - d1/d16/d30/d6e/f80 zero size 2023-12-08T20:28:20.443 INFO:tasks.workunit.client.0.smithi043.stdout:1/441: readlink d1/d16/d21/d25/d35/l3c 0 2023-12-08T20:28:20.444 INFO:tasks.workunit.client.0.smithi043.stdout:3/441: mkdir d1/d9/d2d/d91 0 2023-12-08T20:28:20.445 INFO:tasks.workunit.client.0.smithi043.stdout:1/442: creat d1/d16/d21/d25/d35/f9e x:0 0 0 2023-12-08T20:28:20.447 INFO:tasks.workunit.client.0.smithi043.stdout:3/442: link d1/d9/d38/f3d d1/d25/d2a/d85/f92 0 2023-12-08T20:28:20.447 INFO:tasks.workunit.client.0.smithi043.stdout:1/443: mkdir d1/d16/d21/d25/d3e/d77/d9f 0 2023-12-08T20:28:20.447 INFO:tasks.workunit.client.0.smithi043.stdout:1/444: truncate d1/d16/d48/f53 344961 0 2023-12-08T20:28:20.448 INFO:tasks.workunit.client.0.smithi043.stdout:3/443: rmdir d1/d1c/d29 39 2023-12-08T20:28:20.451 INFO:tasks.workunit.client.0.smithi043.stdout:1/445: mkdir d1/d16/d21/d25/d3e/d77/da0 0 2023-12-08T20:28:20.452 INFO:tasks.workunit.client.0.smithi043.stdout:3/444: rmdir d1/d9/df/d41/d75 0 2023-12-08T20:28:20.452 INFO:tasks.workunit.client.0.smithi043.stdout:3/445: chown d1 48 1 2023-12-08T20:28:20.453 INFO:tasks.workunit.client.0.smithi043.stdout:1/446: mknod d1/d16/d48/ca1 0 2023-12-08T20:28:20.454 INFO:tasks.workunit.client.0.smithi043.stdout:3/446: read d1/d1c/d29/f5c [122782,112612] 0 2023-12-08T20:28:20.454 INFO:tasks.workunit.client.0.smithi043.stdout:1/447: mknod d1/d16/d1c/d81/ca2 0 2023-12-08T20:28:20.454 INFO:tasks.workunit.client.0.smithi043.stdout:1/448: write d1/d16/d30/d4f/d54/f79 [1040814,42099] 0 2023-12-08T20:28:20.456 INFO:tasks.workunit.client.0.smithi043.stdout:1/449: symlink d1/d16/d21/d25/d3e/la3 0 2023-12-08T20:28:20.456 INFO:tasks.workunit.client.0.smithi043.stdout:1/450: truncate d1/d16/f49 1276308 0 2023-12-08T20:28:20.456 INFO:tasks.workunit.client.0.smithi043.stdout:1/451: write d1/d16/d30/d4f/f89 [34087,2269] 0 2023-12-08T20:28:20.456 INFO:tasks.workunit.client.0.smithi043.stdout:1/452: readlink d1/d16/d48/l5e 0 2023-12-08T20:28:20.457 INFO:tasks.workunit.client.0.smithi043.stdout:2/647: dwrite d0/db/d18/d66/d71/fb6 [0,4194304] 0 2023-12-08T20:28:20.457 INFO:tasks.workunit.client.0.smithi043.stdout:2/648: chown d0/d20/l74 31551109 1 2023-12-08T20:28:20.458 INFO:tasks.workunit.client.0.smithi043.stdout:9/415: dwrite d0/d5e/f63 [0,4194304] 0 2023-12-08T20:28:20.459 INFO:tasks.workunit.client.0.smithi043.stdout:9/416: read d0/f27 [2769405,70298] 0 2023-12-08T20:28:20.459 INFO:tasks.workunit.client.0.smithi043.stdout:3/447: dread d1/d25/f31 [0,4194304] 0 2023-12-08T20:28:20.462 INFO:tasks.workunit.client.0.smithi043.stdout:3/448: dread d1/d9/f48 [0,4194304] 0 2023-12-08T20:28:20.462 INFO:tasks.workunit.client.0.smithi043.stdout:3/449: mknod d1/d25/c93 0 2023-12-08T20:28:20.464 INFO:tasks.workunit.client.0.smithi043.stdout:2/649: dread d0/d26/dbc/d38/f5d [0,4194304] 0 2023-12-08T20:28:20.480 INFO:tasks.workunit.client.0.smithi043.stdout:1/453: dwrite d1/d16/d30/d6e/f80 [0,4194304] 0 2023-12-08T20:28:20.481 INFO:tasks.workunit.client.0.smithi043.stdout:1/454: write d1/d6/f29 [699082,100162] 0 2023-12-08T20:28:20.483 INFO:tasks.workunit.client.0.smithi043.stdout:1/455: symlink d1/d16/d21/d25/d3e/la4 0 2023-12-08T20:28:20.483 INFO:tasks.workunit.client.0.smithi043.stdout:1/456: readlink d1/d16/l93 0 2023-12-08T20:28:20.484 INFO:tasks.workunit.client.0.smithi043.stdout:1/457: creat d1/d16/d86/fa5 x:0 0 0 2023-12-08T20:28:20.484 INFO:tasks.workunit.client.0.smithi043.stdout:1/458: symlink d1/d16/d21/d42/la6 0 2023-12-08T20:28:20.485 INFO:tasks.workunit.client.0.smithi043.stdout:1/459: mknod d1/d16/d21/d42/ca7 0 2023-12-08T20:28:20.486 INFO:tasks.workunit.client.0.smithi043.stdout:1/460: write d1/d16/d21/d25/d35/f62 [505848,106442] 0 2023-12-08T20:28:20.486 INFO:tasks.workunit.client.0.smithi043.stdout:1/461: stat d1/d16/d48/f4a 0 2023-12-08T20:28:20.486 INFO:tasks.workunit.client.0.smithi043.stdout:1/462: creat d1/d16/d1c/fa8 x:0 0 0 2023-12-08T20:28:20.487 INFO:tasks.workunit.client.0.smithi043.stdout:1/463: creat d1/d16/d21/d25/d3e/d77/d9f/fa9 x:0 0 0 2023-12-08T20:28:20.487 INFO:tasks.workunit.client.0.smithi043.stdout:1/464: readlink d1/d16/d21/l8f 0 2023-12-08T20:28:20.495 INFO:tasks.workunit.client.0.smithi043.stdout:9/417: dwrite d0/d3d/f48 [0,4194304] 0 2023-12-08T20:28:20.499 INFO:tasks.workunit.client.0.smithi043.stdout:9/418: truncate d0/d3d/d4b/d61/f62 1758511 0 2023-12-08T20:28:20.500 INFO:tasks.workunit.client.0.smithi043.stdout:9/419: fsync d0/d21/f26 0 2023-12-08T20:28:20.500 INFO:tasks.workunit.client.0.smithi043.stdout:3/450: dwrite d1/d9/f48 [0,4194304] 0 2023-12-08T20:28:20.500 INFO:tasks.workunit.client.0.smithi043.stdout:3/451: fdatasync d1/d9/f4e 0 2023-12-08T20:28:20.500 INFO:tasks.workunit.client.0.smithi043.stdout:9/420: write d0/d5e/f57 [1201656,39207] 0 2023-12-08T20:28:20.501 INFO:tasks.workunit.client.0.smithi043.stdout:2/650: dwrite d0/d26/dbc/d38/f84 [0,4194304] 0 2023-12-08T20:28:20.501 INFO:tasks.workunit.client.0.smithi043.stdout:1/465: dwrite d1/d16/d48/f53 [0,4194304] 0 2023-12-08T20:28:20.501 INFO:tasks.workunit.client.0.smithi043.stdout:1/466: read d1/d16/f4d [3767427,51080] 0 2023-12-08T20:28:20.502 INFO:tasks.workunit.client.0.smithi043.stdout:3/452: creat d1/d9/d2d/d66/f94 x:0 0 0 2023-12-08T20:28:20.503 INFO:tasks.workunit.client.0.smithi043.stdout:9/421: symlink d0/d3d/d4b/d5c/l86 0 2023-12-08T20:28:20.503 INFO:tasks.workunit.client.0.smithi043.stdout:9/422: write d0/d5e/f47 [4697640,107968] 0 2023-12-08T20:28:20.507 INFO:tasks.workunit.client.0.smithi043.stdout:2/651: mkdir d0/dd4 0 2023-12-08T20:28:20.514 INFO:tasks.workunit.client.0.smithi043.stdout:1/467: mkdir d1/d16/d21/d6f/daa 0 2023-12-08T20:28:20.514 INFO:tasks.workunit.client.0.smithi043.stdout:1/468: chown d1/d6/f32 57036 1 2023-12-08T20:28:20.515 INFO:tasks.workunit.client.0.smithi043.stdout:3/453: link d1/d9/f1a d1/d9/d2d/d42/f95 0 2023-12-08T20:28:20.519 INFO:tasks.workunit.client.0.smithi043.stdout:1/469: mknod d1/d16/d21/d25/d3e/cab 0 2023-12-08T20:28:20.521 INFO:tasks.workunit.client.0.smithi043.stdout:3/454: creat d1/d1c/d2c/d7f/f96 x:0 0 0 2023-12-08T20:28:20.521 INFO:tasks.workunit.client.0.smithi043.stdout:2/652: dwrite d0/db/d18/f22 [0,4194304] 0 2023-12-08T20:28:20.521 INFO:tasks.workunit.client.0.smithi043.stdout:2/653: chown d0/fce 382646 1 2023-12-08T20:28:20.521 INFO:tasks.workunit.client.0.smithi043.stdout:2/654: chown d0/d26/fd0 2480053 1 2023-12-08T20:28:20.521 INFO:tasks.workunit.client.0.smithi043.stdout:2/655: write d0/d2b/d4e/d93/da9/fcd [488477,8816] 0 2023-12-08T20:28:20.521 INFO:tasks.workunit.client.0.smithi043.stdout:1/470: creat d1/d16/d21/d25/d35/fac x:0 0 0 2023-12-08T20:28:20.522 INFO:tasks.workunit.client.0.smithi043.stdout:3/455: mknod d1/d25/d2a/c97 0 2023-12-08T20:28:20.523 INFO:tasks.workunit.client.0.smithi043.stdout:2/656: symlink d0/d2b/d4e/d79/ld5 0 2023-12-08T20:28:20.524 INFO:tasks.workunit.client.0.smithi043.stdout:1/471: mkdir d1/d16/d1c/d81/dad 0 2023-12-08T20:28:20.524 INFO:tasks.workunit.client.0.smithi043.stdout:2/657: write d0/d20/f32 [3011724,82843] 0 2023-12-08T20:28:20.526 INFO:tasks.workunit.client.0.smithi043.stdout:1/472: rename d1/d16/d21/d25/d3e/d77/f8c to d1/d16/d1c/d81/dad/fae 0 2023-12-08T20:28:20.528 INFO:tasks.workunit.client.0.smithi043.stdout:2/658: rename d0/db/c9a to d0/db/d18/cd6 0 2023-12-08T20:28:20.529 INFO:tasks.workunit.client.0.smithi043.stdout:1/473: symlink d1/d16/d21/d42/laf 0 2023-12-08T20:28:20.529 INFO:tasks.workunit.client.0.smithi043.stdout:1/474: chown d1/d16/d21/d25/d3e/d82 417730 1 2023-12-08T20:28:20.530 INFO:tasks.workunit.client.0.smithi043.stdout:2/659: unlink d0/db/d18/f22 0 2023-12-08T20:28:20.531 INFO:tasks.workunit.client.0.smithi043.stdout:1/475: link d1/d16/d21/d25/d35/f73 d1/d16/d21/d25/d35/fb0 0 2023-12-08T20:28:20.532 INFO:tasks.workunit.client.0.smithi043.stdout:2/660: mknod d0/d26/cd7 0 2023-12-08T20:28:20.532 INFO:tasks.workunit.client.0.smithi043.stdout:1/476: write d1/d16/d30/d4f/d54/f79 [667034,49034] 0 2023-12-08T20:28:20.533 INFO:tasks.workunit.client.0.smithi043.stdout:2/661: fsync d0/d2b/f5b 0 2023-12-08T20:28:20.538 INFO:tasks.workunit.client.0.smithi043.stdout:2/662: dread d0/d26/f98 [0,4194304] 0 2023-12-08T20:28:20.539 INFO:tasks.workunit.client.0.smithi043.stdout:2/663: creat d0/d81/fd8 x:0 0 0 2023-12-08T20:28:20.540 INFO:tasks.workunit.client.0.smithi043.stdout:2/664: mknod d0/d2b/cd9 0 2023-12-08T20:28:20.541 INFO:tasks.workunit.client.0.smithi043.stdout:2/665: getdents d0/d20/d42/dcb 0 2023-12-08T20:28:20.542 INFO:tasks.workunit.client.0.smithi043.stdout:2/666: creat d0/d20/d42/d49/fda x:0 0 0 2023-12-08T20:28:20.542 INFO:tasks.workunit.client.0.smithi043.stdout:2/667: dread - d0/db/d18/d3d/f50 zero size 2023-12-08T20:28:20.542 INFO:tasks.workunit.client.0.smithi043.stdout:2/668: chown d0/d20/f2a 25 1 2023-12-08T20:28:20.542 INFO:tasks.workunit.client.0.smithi043.stdout:2/669: readlink d0/d26/da7/lc1 0 2023-12-08T20:28:20.542 INFO:tasks.workunit.client.0.smithi043.stdout:2/670: dread - d0/db/d18/d66/d71/f89 zero size 2023-12-08T20:28:20.542 INFO:tasks.workunit.client.0.smithi043.stdout:2/671: truncate d0/db/f54 967778 0 2023-12-08T20:28:20.543 INFO:tasks.workunit.client.0.smithi043.stdout:2/672: creat d0/db/d18/d3d/fdb x:0 0 0 2023-12-08T20:28:20.543 INFO:tasks.workunit.client.0.smithi043.stdout:2/673: readlink d0/d2b/d4e/d79/l8d 0 2023-12-08T20:28:20.544 INFO:tasks.workunit.client.0.smithi043.stdout:2/674: write d0/db/d18/f3e [82014,93212] 0 2023-12-08T20:28:20.545 INFO:tasks.workunit.client.0.smithi043.stdout:2/675: mknod d0/d26/dbc/d38/dae/dc0/cdc 0 2023-12-08T20:28:20.547 INFO:tasks.workunit.client.0.smithi043.stdout:2/676: unlink d0/db/d18/d66/d71/dab/fd3 0 2023-12-08T20:28:20.547 INFO:tasks.workunit.client.0.smithi043.stdout:2/677: readlink d0/l91 0 2023-12-08T20:28:20.563 INFO:tasks.workunit.client.0.smithi043.stdout:2/678: dwrite d0/d26/f3b [0,4194304] 0 2023-12-08T20:28:20.564 INFO:tasks.workunit.client.0.smithi043.stdout:2/679: write d0/db/d18/d66/d71/fac [774119,115392] 0 2023-12-08T20:28:20.566 INFO:tasks.workunit.client.0.smithi043.stdout:2/680: symlink d0/d81/ldd 0 2023-12-08T20:28:20.566 INFO:tasks.workunit.client.0.smithi043.stdout:2/681: dread - d0/d20/d42/d49/f5f zero size 2023-12-08T20:28:20.566 INFO:tasks.workunit.client.0.smithi043.stdout:2/682: fsync d0/d26/f27 0 2023-12-08T20:28:20.567 INFO:tasks.workunit.client.0.smithi043.stdout:2/683: truncate d0/d2b/d4e/d93/da9/fcd 177409 0 2023-12-08T20:28:20.567 INFO:tasks.workunit.client.0.smithi043.stdout:2/684: dread - d0/d20/d42/d49/f5f zero size 2023-12-08T20:28:20.567 INFO:tasks.workunit.client.0.smithi043.stdout:2/685: stat d0/d2b/d4e/d93/da9/fcd 0 2023-12-08T20:28:20.567 INFO:tasks.workunit.client.0.smithi043.stdout:7/385: sync 2023-12-08T20:28:20.567 INFO:tasks.workunit.client.0.smithi043.stdout:6/433: sync 2023-12-08T20:28:20.567 INFO:tasks.workunit.client.0.smithi043.stdout:4/454: sync 2023-12-08T20:28:20.568 INFO:tasks.workunit.client.0.smithi043.stdout:2/686: mknod d0/d81/cde 0 2023-12-08T20:28:20.568 INFO:tasks.workunit.client.0.smithi043.stdout:2/687: fdatasync d0/d26/f34 0 2023-12-08T20:28:20.568 INFO:tasks.workunit.client.0.smithi043.stdout:2/688: truncate d0/d2b/d4e/fc7 928699 0 2023-12-08T20:28:20.568 INFO:tasks.workunit.client.0.smithi043.stdout:2/689: write d0/d20/d42/d49/f5f [562357,3846] 0 2023-12-08T20:28:20.569 INFO:tasks.workunit.client.0.smithi043.stdout:7/386: rename d0/d2/d12/l33 to d0/d6/l7e 0 2023-12-08T20:28:20.570 INFO:tasks.workunit.client.0.smithi043.stdout:4/455: creat d1/d14/d1d/f9d x:0 0 0 2023-12-08T20:28:20.572 INFO:tasks.workunit.client.0.smithi043.stdout:2/690: unlink d0/d26/l83 0 2023-12-08T20:28:20.573 INFO:tasks.workunit.client.0.smithi043.stdout:6/434: rename d0/d2/de/d4a/d56/d59/c75 to d0/d2/d14/d20/d53/d73/c96 0 2023-12-08T20:28:20.574 INFO:tasks.workunit.client.0.smithi043.stdout:7/387: getdents d0/d6/d17/d54 0 2023-12-08T20:28:20.574 INFO:tasks.workunit.client.0.smithi043.stdout:7/388: fsync d0/d2/f21 0 2023-12-08T20:28:20.574 INFO:tasks.workunit.client.0.smithi043.stdout:7/389: chown d0/d6/d17/c35 12481 1 2023-12-08T20:28:20.575 INFO:tasks.workunit.client.0.smithi043.stdout:2/691: symlink d0/d26/d53/ldf 0 2023-12-08T20:28:20.577 INFO:tasks.workunit.client.0.smithi043.stdout:2/692: write d0/d2b/f5b [4031403,62691] 0 2023-12-08T20:28:20.577 INFO:tasks.workunit.client.0.smithi043.stdout:6/435: rmdir d0/d2/d14/d8/d47 39 2023-12-08T20:28:20.578 INFO:tasks.workunit.client.0.smithi043.stdout:4/456: dread d1/d14/d25/d39/d3d/d40/d67/f68 [0,4194304] 0 2023-12-08T20:28:20.579 INFO:tasks.workunit.client.0.smithi043.stdout:7/390: symlink d0/d2/d12/l7f 0 2023-12-08T20:28:20.582 INFO:tasks.workunit.client.0.smithi043.stdout:2/693: creat d0/d20/fe0 x:0 0 0 2023-12-08T20:28:20.590 INFO:tasks.workunit.client.0.smithi043.stdout:6/436: getdents d0/d2/d14/d20/d53 0 2023-12-08T20:28:20.590 INFO:tasks.workunit.client.0.smithi043.stdout:4/457: link d1/d14/d25/d39/d3f/d3c/d41/l4a d1/d14/d25/d39/d3f/d3c/d41/d65/l9e 0 2023-12-08T20:28:20.590 INFO:tasks.workunit.client.0.smithi043.stdout:4/458: chown d1/d14/d25/d39/d3d/d40/d67/c6a 9 1 2023-12-08T20:28:20.590 INFO:tasks.workunit.client.0.smithi043.stdout:2/694: mknod d0/d20/d42/d49/ce1 0 2023-12-08T20:28:20.591 INFO:tasks.workunit.client.0.smithi043.stdout:2/695: symlink d0/d26/dbc/d38/le2 0 2023-12-08T20:28:20.591 INFO:tasks.workunit.client.0.smithi043.stdout:2/696: chown d0/db/d18/f4b 4 1 2023-12-08T20:28:20.592 INFO:tasks.workunit.client.0.smithi043.stdout:2/697: symlink d0/d26/dbc/d38/le3 0 2023-12-08T20:28:20.592 INFO:tasks.workunit.client.0.smithi043.stdout:2/698: fdatasync d0/d20/d42/dcb/fcc 0 2023-12-08T20:28:20.596 INFO:tasks.workunit.client.0.smithi043.stdout:4/459: dread d1/d14/f18 [0,4194304] 0 2023-12-08T20:28:20.596 INFO:tasks.workunit.client.0.smithi043.stdout:4/460: chown d1/d14/d1d/cc 72260291 1 2023-12-08T20:28:20.596 INFO:tasks.workunit.client.0.smithi043.stdout:6/437: write d0/d2/d14/f18 [2281870,101094] 0 2023-12-08T20:28:20.597 INFO:tasks.workunit.client.0.smithi043.stdout:4/461: creat d1/d14/d25/d39/d3f/d3c/d80/f9f x:0 0 0 2023-12-08T20:28:20.597 INFO:tasks.workunit.client.0.smithi043.stdout:6/438: creat d0/d2/d29/f97 x:0 0 0 2023-12-08T20:28:20.598 INFO:tasks.workunit.client.0.smithi043.stdout:4/462: mknod d1/d14/d1d/d75/ca0 0 2023-12-08T20:28:20.600 INFO:tasks.workunit.client.0.smithi043.stdout:7/391: dwrite d0/d6/f18 [4194304,4194304] 0 2023-12-08T20:28:20.600 INFO:tasks.workunit.client.0.smithi043.stdout:7/392: chown d0/d6/d8/f10 8314364 1 2023-12-08T20:28:20.620 INFO:tasks.workunit.client.0.smithi043.stdout:4/463: dwrite d1/d14/d1d/d58/f62 [0,4194304] 0 2023-12-08T20:28:20.620 INFO:tasks.workunit.client.0.smithi043.stdout:4/464: readlink d1/d14/d25/d39/d3f/d3c/d41/l66 0 2023-12-08T20:28:20.620 INFO:tasks.workunit.client.0.smithi043.stdout:4/465: stat d1/f5 0 2023-12-08T20:28:20.621 INFO:tasks.workunit.client.0.smithi043.stdout:4/466: mknod d1/d14/d1d/d58/ca1 0 2023-12-08T20:28:20.621 INFO:tasks.workunit.client.0.smithi043.stdout:4/467: fsync d1/d14/f26 0 2023-12-08T20:28:20.622 INFO:tasks.workunit.client.0.smithi043.stdout:7/393: dwrite d0/d2/d12/f32 [0,4194304] 0 2023-12-08T20:28:20.623 INFO:tasks.workunit.client.0.smithi043.stdout:7/394: creat d0/d6/d17/d54/f80 x:0 0 0 2023-12-08T20:28:20.623 INFO:tasks.workunit.client.0.smithi043.stdout:7/395: chown d0/d2/f21 3462 1 2023-12-08T20:28:20.623 INFO:tasks.workunit.client.0.smithi043.stdout:7/396: write d0/d6/d8/d47/f6c [610283,43520] 0 2023-12-08T20:28:20.624 INFO:tasks.workunit.client.0.smithi043.stdout:7/397: creat d0/d6/d17/d54/f81 x:0 0 0 2023-12-08T20:28:20.624 INFO:tasks.workunit.client.0.smithi043.stdout:7/398: truncate d0/d6/d8/f7d 90367 0 2023-12-08T20:28:20.624 INFO:tasks.workunit.client.0.smithi043.stdout:7/399: write d0/d6/d8/f7d [429881,102191] 0 2023-12-08T20:28:20.624 INFO:tasks.workunit.client.0.smithi043.stdout:7/400: fdatasync d0/d6/f24 0 2023-12-08T20:28:20.628 INFO:tasks.workunit.client.0.smithi043.stdout:7/401: read d0/d2/d12/f51 [2554363,73876] 0 2023-12-08T20:28:20.630 INFO:tasks.workunit.client.0.smithi043.stdout:7/402: rename d0/d6/d17/f78 to d0/d6/d17/d54/f82 0 2023-12-08T20:28:20.631 INFO:tasks.workunit.client.0.smithi043.stdout:7/403: mkdir d0/d2/d65/d83 0 2023-12-08T20:28:20.633 INFO:tasks.workunit.client.0.smithi043.stdout:7/404: rename d0/d2/c39 to d0/d2/d12/c84 0 2023-12-08T20:28:20.633 INFO:tasks.workunit.client.0.smithi043.stdout:7/405: readlink d0/d2/d12/l4c 0 2023-12-08T20:28:20.633 INFO:tasks.workunit.client.0.smithi043.stdout:7/406: chown d0/d2/d12/f51 0 1 2023-12-08T20:28:20.633 INFO:tasks.workunit.client.0.smithi043.stdout:7/407: stat d0/d2/d12/d19/c5f 0 2023-12-08T20:28:20.634 INFO:tasks.workunit.client.0.smithi043.stdout:7/408: mkdir d0/d2/d12/d19/d38/d85 0 2023-12-08T20:28:20.634 INFO:tasks.workunit.client.0.smithi043.stdout:7/409: write d0/d2/d12/f2e [953718,98419] 0 2023-12-08T20:28:20.639 INFO:tasks.workunit.client.0.smithi043.stdout:4/468: dwrite d1/d14/d25/d39/d3f/d3c/d80/f9f [0,4194304] 0 2023-12-08T20:28:20.641 INFO:tasks.workunit.client.0.smithi043.stdout:4/469: creat d1/d14/d25/d39/d3d/d40/d67/fa2 x:0 0 0 2023-12-08T20:28:20.641 INFO:tasks.workunit.client.0.smithi043.stdout:4/470: chown d1/d14/d25/d39/d3f/f7e 187 1 2023-12-08T20:28:20.642 INFO:tasks.workunit.client.0.smithi043.stdout:4/471: mkdir d1/d14/d25/d39/da3 0 2023-12-08T20:28:20.642 INFO:tasks.workunit.client.0.smithi043.stdout:7/410: dread d0/d6/d8/f15 [0,4194304] 0 2023-12-08T20:28:20.643 INFO:tasks.workunit.client.0.smithi043.stdout:4/472: mkdir d1/d14/d25/d77/da4 0 2023-12-08T20:28:20.645 INFO:tasks.workunit.client.0.smithi043.stdout:7/411: creat d0/d6/d17/f86 x:0 0 0 2023-12-08T20:28:20.650 INFO:tasks.workunit.client.0.smithi043.stdout:4/473: rmdir d1/d14/d25/d39/d3d/d40/d67 39 2023-12-08T20:28:20.652 INFO:tasks.workunit.client.0.smithi043.stdout:4/474: link d1/d14/d1d/d58/ca1 d1/d14/d25/d77/d8d/ca5 0 2023-12-08T20:28:20.656 INFO:tasks.workunit.client.0.smithi043.stdout:7/412: dread d0/d2/d12/d19/d38/f55 [0,4194304] 0 2023-12-08T20:28:20.668 INFO:tasks.workunit.client.0.smithi043.stdout:7/413: dread d0/d2/d12/f51 [0,4194304] 0 2023-12-08T20:28:20.668 INFO:tasks.workunit.client.0.smithi043.stdout:7/414: truncate d0/d6/d17/d54/f60 2366276 0 2023-12-08T20:28:20.672 INFO:tasks.workunit.client.0.smithi043.stdout:4/475: dwrite d1/d14/d1d/f4b [0,4194304] 0 2023-12-08T20:28:20.678 INFO:tasks.workunit.client.0.smithi043.stdout:4/476: symlink d1/d14/d25/d39/d3d/d40/d67/d88/la6 0 2023-12-08T20:28:20.680 INFO:tasks.workunit.client.0.smithi043.stdout:4/477: link d1/d14/d25/d39/d3d/d40/d67/f83 d1/d14/d25/d39/d3d/d40/d67/d7f/fa7 0 2023-12-08T20:28:20.680 INFO:tasks.workunit.client.0.smithi043.stdout:4/478: truncate d1/d14/d50/f98 4339163 0 2023-12-08T20:28:20.680 INFO:tasks.workunit.client.0.smithi043.stdout:4/479: getdents d1/d14/d25/d39/d3f/d3c/d90 0 2023-12-08T20:28:20.680 INFO:tasks.workunit.client.0.smithi043.stdout:4/480: fsync d1/d14/d25/d39/d3f/d3c/d41/d65/f7d 0 2023-12-08T20:28:20.680 INFO:tasks.workunit.client.0.smithi043.stdout:4/481: read - d1/d14/d1d/f47 zero size 2023-12-08T20:28:20.683 INFO:tasks.workunit.client.0.smithi043.stdout:7/415: dwrite d0/d6/d8/f64 [0,4194304] 0 2023-12-08T20:28:20.689 INFO:tasks.workunit.client.0.smithi043.stdout:4/482: dread d1/d14/f18 [0,4194304] 0 2023-12-08T20:28:20.689 INFO:tasks.workunit.client.0.smithi043.stdout:4/483: truncate d1/d14/d25/d39/d3d/d40/d67/fa2 410997 0 2023-12-08T20:28:20.689 INFO:tasks.workunit.client.0.smithi043.stdout:7/416: mkdir d0/d69/d6d/d87 0 2023-12-08T20:28:20.690 INFO:tasks.workunit.client.0.smithi043.stdout:7/417: readlink d0/l25 0 2023-12-08T20:28:20.690 INFO:tasks.workunit.client.0.smithi043.stdout:7/418: fsync d0/d6/d17/d54/f82 0 2023-12-08T20:28:20.690 INFO:tasks.workunit.client.0.smithi043.stdout:4/484: truncate d1/f1c 1350270 0 2023-12-08T20:28:20.691 INFO:tasks.workunit.client.0.smithi043.stdout:7/419: getdents d0/d2/d65 0 2023-12-08T20:28:20.695 INFO:tasks.workunit.client.0.smithi043.stdout:4/485: rmdir d1/d14 39 2023-12-08T20:28:20.696 INFO:tasks.workunit.client.0.smithi043.stdout:7/420: creat d0/f88 x:0 0 0 2023-12-08T20:28:20.699 INFO:tasks.workunit.client.0.smithi043.stdout:7/421: symlink d0/d6/d17/d52/l89 0 2023-12-08T20:28:20.715 INFO:tasks.workunit.client.0.smithi043.stdout:4/486: dwrite d1/d14/d50/f53 [0,4194304] 0 2023-12-08T20:28:20.715 INFO:tasks.workunit.client.0.smithi043.stdout:7/422: dwrite d0/f42 [0,4194304] 0 2023-12-08T20:28:20.717 INFO:tasks.workunit.client.0.smithi043.stdout:4/487: symlink d1/d14/d25/d39/d3f/d3c/la8 0 2023-12-08T20:28:20.722 INFO:tasks.workunit.client.0.smithi043.stdout:7/423: symlink d0/d6/d17/d54/l8a 0 2023-12-08T20:28:20.723 INFO:tasks.workunit.client.0.smithi043.stdout:4/488: getdents d1/d14/d25/d39/d3d/d40/d67/d7f 0 2023-12-08T20:28:20.724 INFO:tasks.workunit.client.0.smithi043.stdout:7/424: creat d0/d5b/f8b x:0 0 0 2023-12-08T20:28:20.731 INFO:tasks.workunit.client.0.smithi043.stdout:4/489: dread d1/d14/f48 [0,4194304] 0 2023-12-08T20:28:20.731 INFO:tasks.workunit.client.0.smithi043.stdout:4/490: truncate d1/d14/d25/d39/f79 897963 0 2023-12-08T20:28:20.731 INFO:tasks.workunit.client.0.smithi043.stdout:7/425: dread d0/d2/d12/f51 [0,4194304] 0 2023-12-08T20:28:20.733 INFO:tasks.workunit.client.0.smithi043.stdout:4/491: mknod d1/d14/ca9 0 2023-12-08T20:28:20.733 INFO:tasks.workunit.client.0.smithi043.stdout:7/426: creat d0/d2/d12/f8c x:0 0 0 2023-12-08T20:28:20.736 INFO:tasks.workunit.client.0.smithi043.stdout:4/492: symlink d1/d14/d25/d39/laa 0 2023-12-08T20:28:20.738 INFO:tasks.workunit.client.0.smithi043.stdout:7/427: rmdir d0/d6/d17/d54 39 2023-12-08T20:28:20.738 INFO:tasks.workunit.client.0.smithi043.stdout:7/428: fdatasync d0/d6/d8/f7d 0 2023-12-08T20:28:20.738 INFO:tasks.workunit.client.0.smithi043.stdout:7/429: readlink d0/d2/d12/d19/l5a 0 2023-12-08T20:28:20.761 INFO:tasks.workunit.client.0.smithi043.stdout:7/430: dwrite d0/d2/d12/f2e [0,4194304] 0 2023-12-08T20:28:20.761 INFO:tasks.workunit.client.0.smithi043.stdout:4/493: dwrite d1/d14/d50/f98 [0,4194304] 0 2023-12-08T20:28:20.774 INFO:tasks.workunit.client.0.smithi043.stdout:4/494: truncate d1/d14/d25/d28/f2b 3884348 0 2023-12-08T20:28:20.776 INFO:tasks.workunit.client.0.smithi043.stdout:4/495: truncate d1/d14/f48 49731 0 2023-12-08T20:28:20.779 INFO:tasks.workunit.client.0.smithi043.stdout:5/459: sync 2023-12-08T20:28:20.779 INFO:tasks.workunit.client.0.smithi043.stdout:0/624: sync 2023-12-08T20:28:20.779 INFO:tasks.workunit.client.0.smithi043.stdout:4/496: mkdir d1/d14/d25/d39/d3f/d3c/d41/dab 0 2023-12-08T20:28:20.780 INFO:tasks.workunit.client.0.smithi043.stdout:5/460: dread d3/f6e [0,4194304] 0 2023-12-08T20:28:20.782 INFO:tasks.workunit.client.0.smithi043.stdout:5/461: dread d3/d7/de/f18 [8388608,4194304] 0 2023-12-08T20:28:20.782 INFO:tasks.workunit.client.0.smithi043.stdout:0/625: creat d2/d3/d18/d2b/da5/d5f/d79/fcb x:0 0 0 2023-12-08T20:28:20.784 INFO:tasks.workunit.client.0.smithi043.stdout:4/497: link d1/d14/d25/d39/d3f/d3c/d41/f43 d1/d14/d25/d39/d3f/d59/fac 0 2023-12-08T20:28:20.784 INFO:tasks.workunit.client.0.smithi043.stdout:4/498: fsync d1/d14/d25/d28/f81 0 2023-12-08T20:28:20.785 INFO:tasks.workunit.client.0.smithi043.stdout:5/462: getdents d3/d73 0 2023-12-08T20:28:20.787 INFO:tasks.workunit.client.0.smithi043.stdout:0/626: mkdir d2/d3/d18/d1e/dcc 0 2023-12-08T20:28:20.789 INFO:tasks.workunit.client.0.smithi043.stdout:5/463: mkdir d3/d7/de/d82/d8b 0 2023-12-08T20:28:20.802 INFO:tasks.workunit.client.0.smithi043.stdout:5/464: dread d3/d7/de/f18 [0,4194304] 0 2023-12-08T20:28:20.802 INFO:tasks.workunit.client.0.smithi043.stdout:5/465: chown d3/d7/de/d43/d68/f88 7674 1 2023-12-08T20:28:20.807 INFO:tasks.workunit.client.0.smithi043.stdout:4/499: dwrite d1/d14/d25/d39/d3f/d59/f96 [0,4194304] 0 2023-12-08T20:28:20.808 INFO:tasks.workunit.client.0.smithi043.stdout:0/627: dwrite d2/d3/d18/d1e/f25 [0,4194304] 0 2023-12-08T20:28:20.813 INFO:tasks.workunit.client.0.smithi043.stdout:4/500: symlink d1/d14/d25/d39/d3d/d40/d67/d88/lad 0 2023-12-08T20:28:20.813 INFO:tasks.workunit.client.0.smithi043.stdout:0/628: mkdir d2/d3/d6/d39/d63/da6/dcd 0 2023-12-08T20:28:20.814 INFO:tasks.workunit.client.0.smithi043.stdout:0/629: creat d2/d61/fce x:0 0 0 2023-12-08T20:28:20.814 INFO:tasks.workunit.client.0.smithi043.stdout:0/630: write d2/d3/f70 [40433,120943] 0 2023-12-08T20:28:20.816 INFO:tasks.workunit.client.0.smithi043.stdout:4/501: dread d1/d14/f31 [0,4194304] 0 2023-12-08T20:28:20.817 INFO:tasks.workunit.client.0.smithi043.stdout:7/431: unlink d0/d2/l4e 0 2023-12-08T20:28:20.818 INFO:tasks.workunit.client.0.smithi043.stdout:4/502: unlink d1/d14/d25/d77/c86 0 2023-12-08T20:28:20.820 INFO:tasks.workunit.client.0.smithi043.stdout:5/466: dwrite d3/d7/de/d17/f79 [0,4194304] 0 2023-12-08T20:28:20.820 INFO:tasks.workunit.client.0.smithi043.stdout:7/432: dread d0/d6/d8/d47/f6c [0,4194304] 0 2023-12-08T20:28:20.821 INFO:tasks.workunit.client.0.smithi043.stdout:4/503: unlink d1/d14/d25/d39/d3d/d40/l99 0 2023-12-08T20:28:20.821 INFO:tasks.workunit.client.0.smithi043.stdout:4/504: chown d1 2620684 1 2023-12-08T20:28:20.823 INFO:tasks.workunit.client.0.smithi043.stdout:0/631: dread d2/d4/f82 [0,4194304] 0 2023-12-08T20:28:20.823 INFO:tasks.workunit.client.0.smithi043.stdout:0/632: stat d2/d3/d6/d39/d5e/f96 0 2023-12-08T20:28:20.824 INFO:tasks.workunit.client.0.smithi043.stdout:0/633: fsync d2/d3/f4e 0 2023-12-08T20:28:20.824 INFO:tasks.workunit.client.0.smithi043.stdout:0/634: dread - d2/d61/d8a/fb7 zero size 2023-12-08T20:28:20.824 INFO:tasks.workunit.client.0.smithi043.stdout:5/467: creat d3/d7/de/d82/f8c x:0 0 0 2023-12-08T20:28:20.825 INFO:tasks.workunit.client.0.smithi043.stdout:0/635: dread d2/d3/d18/d2b/da5/f7a [0,4194304] 0 2023-12-08T20:28:20.825 INFO:tasks.workunit.client.0.smithi043.stdout:0/636: stat d2/d3/d18/d2b/f41 0 2023-12-08T20:28:20.825 INFO:tasks.workunit.client.0.smithi043.stdout:0/637: write d2/d3/d18/d2b/da5/d3f/f7f [1537101,12112] 0 2023-12-08T20:28:20.825 INFO:tasks.workunit.client.0.smithi043.stdout:7/433: rename d0/d6/d8/l4a to d0/d6/l8d 0 2023-12-08T20:28:20.826 INFO:tasks.workunit.client.0.smithi043.stdout:4/505: mkdir d1/d14/d25/d39/da3/dae 0 2023-12-08T20:28:20.828 INFO:tasks.workunit.client.0.smithi043.stdout:5/468: creat d3/d7/de/f8d x:0 0 0 2023-12-08T20:28:20.828 INFO:tasks.workunit.client.0.smithi043.stdout:5/469: fdatasync f1 0 2023-12-08T20:28:20.828 INFO:tasks.workunit.client.0.smithi043.stdout:5/470: read d3/f6e [90271,94654] 0 2023-12-08T20:28:20.828 INFO:tasks.workunit.client.0.smithi043.stdout:5/471: fdatasync d3/d73/f7e 0 2023-12-08T20:28:20.830 INFO:tasks.workunit.client.0.smithi043.stdout:0/638: truncate d2/d3/d6/d39/d83/d9d/faf 3032392 0 2023-12-08T20:28:20.831 INFO:tasks.workunit.client.0.smithi043.stdout:7/434: creat d0/d2/f8e x:0 0 0 2023-12-08T20:28:20.833 INFO:tasks.workunit.client.0.smithi043.stdout:4/506: unlink d1/d14/d25/d39/d3d/d40/d67/c6a 0 2023-12-08T20:28:20.834 INFO:tasks.workunit.client.0.smithi043.stdout:5/472: rename d3/d7/d19/l3e to d3/d73/d83/l8e 0 2023-12-08T20:28:20.835 INFO:tasks.workunit.client.0.smithi043.stdout:7/435: creat d0/f8f x:0 0 0 2023-12-08T20:28:20.837 INFO:tasks.workunit.client.0.smithi043.stdout:4/507: creat d1/d14/faf x:0 0 0 2023-12-08T20:28:20.838 INFO:tasks.workunit.client.0.smithi043.stdout:5/473: symlink d3/d7/d19/d3f/l8f 0 2023-12-08T20:28:20.841 INFO:tasks.workunit.client.0.smithi043.stdout:5/474: read f1 [2078258,45723] 0 2023-12-08T20:28:20.843 INFO:tasks.workunit.client.0.smithi043.stdout:7/436: unlink d0/d2/d12/d19/l5a 0 2023-12-08T20:28:20.843 INFO:tasks.workunit.client.0.smithi043.stdout:4/508: rmdir d1/d14/d25/d39/d3f/d3c/d41/d65 39 2023-12-08T20:28:20.843 INFO:tasks.workunit.client.0.smithi043.stdout:0/639: dread d2/d3/d18/f43 [0,4194304] 0 2023-12-08T20:28:20.843 INFO:tasks.workunit.client.0.smithi043.stdout:0/640: chown d2/d3/d6/d39/d83 31344194 1 2023-12-08T20:28:20.843 INFO:tasks.workunit.client.0.smithi043.stdout:0/641: truncate d2/d61/fce 893596 0 2023-12-08T20:28:20.843 INFO:tasks.workunit.client.0.smithi043.stdout:5/475: rmdir d3/d7/de/d43 39 2023-12-08T20:28:20.843 INFO:tasks.workunit.client.0.smithi043.stdout:5/476: stat d3/l39 0 2023-12-08T20:28:20.844 INFO:tasks.workunit.client.0.smithi043.stdout:7/437: rename d0/d2/ld to d0/d6/l90 0 2023-12-08T20:28:20.845 INFO:tasks.workunit.client.0.smithi043.stdout:4/509: mkdir d1/d14/d25/d39/d3d/db0 0 2023-12-08T20:28:20.845 INFO:tasks.workunit.client.0.smithi043.stdout:4/510: truncate d1/d14/d25/d39/f71 369672 0 2023-12-08T20:28:20.846 INFO:tasks.workunit.client.0.smithi043.stdout:4/511: write d1/d14/f24 [3766983,82944] 0 2023-12-08T20:28:20.846 INFO:tasks.workunit.client.0.smithi043.stdout:0/642: mknod d2/d3/d18/d2b/da5/ccf 0 2023-12-08T20:28:20.849 INFO:tasks.workunit.client.0.smithi043.stdout:7/438: symlink d0/d5b/l91 0 2023-12-08T20:28:20.851 INFO:tasks.workunit.client.0.smithi043.stdout:7/439: unlink d0/d6/f29 0 2023-12-08T20:28:20.853 INFO:tasks.workunit.client.0.smithi043.stdout:7/440: rmdir d0/d2/d12/d19/d38 39 2023-12-08T20:28:20.856 INFO:tasks.workunit.client.0.smithi043.stdout:7/441: symlink d0/d2/d65/d83/l92 0 2023-12-08T20:28:20.856 INFO:tasks.workunit.client.0.smithi043.stdout:7/442: chown d0/d2/c26 327 1 2023-12-08T20:28:20.856 INFO:tasks.workunit.client.0.smithi043.stdout:0/643: dread d2/d3/d18/d2b/da5/f69 [0,4194304] 0 2023-12-08T20:28:20.856 INFO:tasks.workunit.client.0.smithi043.stdout:0/644: dread - d2/d3/d18/d2b/fa7 zero size 2023-12-08T20:28:20.856 INFO:tasks.workunit.client.0.smithi043.stdout:7/443: mknod d0/d6/d8/d47/c93 0 2023-12-08T20:28:20.857 INFO:tasks.workunit.client.0.smithi043.stdout:7/444: dread - d0/d2/d12/d19/d38/f58 zero size 2023-12-08T20:28:20.857 INFO:tasks.workunit.client.0.smithi043.stdout:0/645: creat d2/d4/fd0 x:0 0 0 2023-12-08T20:28:20.857 INFO:tasks.workunit.client.0.smithi043.stdout:0/646: dread - d2/d3/d6/f6c zero size 2023-12-08T20:28:20.858 INFO:tasks.workunit.client.0.smithi043.stdout:7/445: unlink d0/d2/d12/f8c 0 2023-12-08T20:28:20.858 INFO:tasks.workunit.client.0.smithi043.stdout:7/446: truncate d0/d6/d8/f7d 896110 0 2023-12-08T20:28:20.859 INFO:tasks.workunit.client.0.smithi043.stdout:0/647: mknod d2/d3/d18/d2b/da5/d3f/cd1 0 2023-12-08T20:28:20.867 INFO:tasks.workunit.client.0.smithi043.stdout:7/447: dread d0/d2/d12/d19/d38/f55 [0,4194304] 0 2023-12-08T20:28:20.867 INFO:tasks.workunit.client.0.smithi043.stdout:7/448: readlink d0/d2/d12/l67 0 2023-12-08T20:28:20.867 INFO:tasks.workunit.client.0.smithi043.stdout:7/449: chown d0/f88 156 1 2023-12-08T20:28:20.867 INFO:tasks.workunit.client.0.smithi043.stdout:5/477: dwrite d3/d7/de/d43/d68/f88 [0,4194304] 0 2023-12-08T20:28:20.868 INFO:tasks.workunit.client.0.smithi043.stdout:4/512: dwrite d1/d14/d25/d39/d3d/d40/d67/f8f [0,4194304] 0 2023-12-08T20:28:20.874 INFO:tasks.workunit.client.0.smithi043.stdout:7/450: creat d0/d2/d12/d19/f94 x:0 0 0 2023-12-08T20:28:20.875 INFO:tasks.workunit.client.0.smithi043.stdout:7/451: symlink d0/d69/l95 0 2023-12-08T20:28:20.875 INFO:tasks.workunit.client.0.smithi043.stdout:7/452: chown d0/d6/d8/d47/c49 11256031 1 2023-12-08T20:28:20.880 INFO:tasks.workunit.client.0.smithi043.stdout:7/453: dread d0/d6/d17/d54/f60 [0,4194304] 0 2023-12-08T20:28:20.881 INFO:tasks.workunit.client.0.smithi043.stdout:7/454: fsync d0/d2/d65/f71 0 2023-12-08T20:28:20.881 INFO:tasks.workunit.client.0.smithi043.stdout:0/648: dwrite d2/d3/d18/d1e/d53/d7d/f93 [0,4194304] 0 2023-12-08T20:28:20.883 INFO:tasks.workunit.client.0.smithi043.stdout:7/455: link d0/d2/c14 d0/d6/d17/c96 0 2023-12-08T20:28:20.886 INFO:tasks.workunit.client.0.smithi043.stdout:7/456: dread d0/d2/d12/d19/f41 [0,4194304] 0 2023-12-08T20:28:20.888 INFO:tasks.workunit.client.0.smithi043.stdout:7/457: symlink d0/d2/d65/l97 0 2023-12-08T20:28:20.890 INFO:tasks.workunit.client.0.smithi043.stdout:7/458: mknod d0/d2/d12/d19/d38/c98 0 2023-12-08T20:28:20.890 INFO:tasks.workunit.client.0.smithi043.stdout:4/513: dwrite d1/d14/d25/d39/f71 [0,4194304] 0 2023-12-08T20:28:20.890 INFO:tasks.workunit.client.0.smithi043.stdout:7/459: fdatasync d0/fb 0 2023-12-08T20:28:20.890 INFO:tasks.workunit.client.0.smithi043.stdout:5/478: dwrite d3/d7/d21/f4d [0,4194304] 0 2023-12-08T20:28:20.891 INFO:tasks.workunit.client.0.smithi043.stdout:4/514: read d1/d14/d25/f2c [343498,79468] 0 2023-12-08T20:28:20.891 INFO:tasks.workunit.client.0.smithi043.stdout:4/515: fsync d1/d14/d50/f9a 0 2023-12-08T20:28:20.891 INFO:tasks.workunit.client.0.smithi043.stdout:4/516: truncate d1/d14/f1a 4946680 0 2023-12-08T20:28:20.893 INFO:tasks.workunit.client.0.smithi043.stdout:5/479: mkdir d3/d7/d90 0 2023-12-08T20:28:20.895 INFO:tasks.workunit.client.0.smithi043.stdout:4/517: mkdir d1/d14/d25/d39/db1 0 2023-12-08T20:28:20.895 INFO:tasks.workunit.client.0.smithi043.stdout:4/518: write d1/d14/d25/d39/d3d/f97 [548771,114820] 0 2023-12-08T20:28:20.897 INFO:tasks.workunit.client.0.smithi043.stdout:5/480: mknod d3/d73/d83/c91 0 2023-12-08T20:28:20.899 INFO:tasks.workunit.client.0.smithi043.stdout:4/519: dread d1/d14/d25/f2f [0,4194304] 0 2023-12-08T20:28:20.900 INFO:tasks.workunit.client.0.smithi043.stdout:5/481: link d3/d7/f13 d3/d73/d83/f92 0 2023-12-08T20:28:20.901 INFO:tasks.workunit.client.0.smithi043.stdout:4/520: mknod d1/d14/d25/d39/db1/cb2 0 2023-12-08T20:28:20.902 INFO:tasks.workunit.client.0.smithi043.stdout:5/482: creat d3/d7/de/d82/d8b/f93 x:0 0 0 2023-12-08T20:28:20.903 INFO:tasks.workunit.client.0.smithi043.stdout:4/521: mknod d1/d14/d25/d39/d3f/d3c/d90/cb3 0 2023-12-08T20:28:20.903 INFO:tasks.workunit.client.0.smithi043.stdout:4/522: stat d1/d14/d25/d39/d3d/d40 0 2023-12-08T20:28:20.904 INFO:tasks.workunit.client.0.smithi043.stdout:5/483: mknod d3/d7/d29/c94 0 2023-12-08T20:28:20.907 INFO:tasks.workunit.client.0.smithi043.stdout:0/649: dwrite d2/d4/fd0 [0,4194304] 0 2023-12-08T20:28:20.907 INFO:tasks.workunit.client.0.smithi043.stdout:0/650: truncate d2/d4/f9f 863220 0 2023-12-08T20:28:20.909 INFO:tasks.workunit.client.0.smithi043.stdout:4/523: write d1/d14/d25/d39/d3f/d59/fac [2840614,15527] 0 2023-12-08T20:28:20.911 INFO:tasks.workunit.client.0.smithi043.stdout:8/463: sync 2023-12-08T20:28:20.911 INFO:tasks.workunit.client.0.smithi043.stdout:8/464: chown d2/d27/d2d/d31/d4f 6401328 1 2023-12-08T20:28:20.912 INFO:tasks.workunit.client.0.smithi043.stdout:7/460: dwrite d0/d6/d17/d54/f80 [0,4194304] 0 2023-12-08T20:28:20.912 INFO:tasks.workunit.client.0.smithi043.stdout:0/651: link d2/d4/fd0 d2/d61/d8a/fd2 0 2023-12-08T20:28:20.914 INFO:tasks.workunit.client.0.smithi043.stdout:8/465: truncate d2/d27/d2d/d31/f58 282752 0 2023-12-08T20:28:20.915 INFO:tasks.workunit.client.0.smithi043.stdout:8/466: write d2/d20/d7d/d37/f1f [1106445,1489] 0 2023-12-08T20:28:20.919 INFO:tasks.workunit.client.0.smithi043.stdout:7/461: rename d0/d6/d8 to d0/d2/d65/d99 0 2023-12-08T20:28:20.921 INFO:tasks.workunit.client.0.smithi043.stdout:0/652: creat d2/d61/dc0/fd3 x:0 0 0 2023-12-08T20:28:20.924 INFO:tasks.workunit.client.0.smithi043.stdout:0/653: symlink d2/d3/d18/d2b/da5/d5f/ld4 0 2023-12-08T20:28:20.924 INFO:tasks.workunit.client.0.smithi043.stdout:0/654: chown d2/fca 15 1 2023-12-08T20:28:20.925 INFO:tasks.workunit.client.0.smithi043.stdout:9/423: sync 2023-12-08T20:28:20.929 INFO:tasks.workunit.client.0.smithi043.stdout:2/699: sync 2023-12-08T20:28:20.929 INFO:tasks.workunit.client.0.smithi043.stdout:7/462: dread d0/d2/d65/d99/f64 [0,4194304] 0 2023-12-08T20:28:20.929 INFO:tasks.workunit.client.0.smithi043.stdout:7/463: fdatasync d0/f1b 0 2023-12-08T20:28:20.929 INFO:tasks.workunit.client.0.smithi043.stdout:1/477: sync 2023-12-08T20:28:20.929 INFO:tasks.workunit.client.0.smithi043.stdout:3/456: sync 2023-12-08T20:28:20.929 INFO:tasks.workunit.client.0.smithi043.stdout:3/457: write d1/d9/d38/d33/f63 [4984515,82225] 0 2023-12-08T20:28:20.930 INFO:tasks.workunit.client.0.smithi043.stdout:7/464: symlink d0/d6/d17/d52/l9a 0 2023-12-08T20:28:20.931 INFO:tasks.workunit.client.0.smithi043.stdout:6/439: sync 2023-12-08T20:28:20.933 INFO:tasks.workunit.client.0.smithi043.stdout:9/424: write d0/d3d/f4c [1670518,79298] 0 2023-12-08T20:28:20.934 INFO:tasks.workunit.client.0.smithi043.stdout:4/524: dwrite d1/d14/d25/d39/d3f/f3a [0,4194304] 0 2023-12-08T20:28:20.939 INFO:tasks.workunit.client.0.smithi043.stdout:1/478: mkdir d1/db1 0 2023-12-08T20:28:20.939 INFO:tasks.workunit.client.0.smithi043.stdout:1/479: truncate d1/d16/d30/d6e/d83/f94 146709 0 2023-12-08T20:28:20.939 INFO:tasks.workunit.client.0.smithi043.stdout:7/465: creat d0/f9b x:0 0 0 2023-12-08T20:28:20.941 INFO:tasks.workunit.client.0.smithi043.stdout:3/458: dread d1/d1c/d29/f5c [0,4194304] 0 2023-12-08T20:28:20.944 INFO:tasks.workunit.client.0.smithi043.stdout:7/466: write d0/d2/d12/d19/f40 [3256221,51122] 0 2023-12-08T20:28:20.944 INFO:tasks.workunit.client.0.smithi043.stdout:3/459: link d1/d9/d38/d4f/f8c d1/d9/d2d/d66/f98 0 2023-12-08T20:28:20.948 INFO:tasks.workunit.client.0.smithi043.stdout:0/655: dwrite d2/d3/d18/d1e/d88/f8b [0,4194304] 0 2023-12-08T20:28:20.951 INFO:tasks.workunit.client.0.smithi043.stdout:1/480: dread d1/d16/f46 [0,4194304] 0 2023-12-08T20:28:20.951 INFO:tasks.workunit.client.0.smithi043.stdout:1/481: write d1/d16/d7e/f9c [304065,45953] 0 2023-12-08T20:28:20.952 INFO:tasks.workunit.client.0.smithi043.stdout:3/460: link d1/d9/d38/d30/f59 d1/d9/d38/d4f/d8f/f99 0 2023-12-08T20:28:20.954 INFO:tasks.workunit.client.0.smithi043.stdout:1/482: link d1/d16/d21/d25/d35/l6b d1/d16/d21/d42/lb2 0 2023-12-08T20:28:20.959 INFO:tasks.workunit.client.0.smithi043.stdout:3/461: rename d1/d9/d38/d4a/d86 to d1/d25/d84/d9a 0 2023-12-08T20:28:20.959 INFO:tasks.workunit.client.0.smithi043.stdout:7/467: dread d0/d6/d17/f37 [0,4194304] 0 2023-12-08T20:28:20.960 INFO:tasks.workunit.client.0.smithi043.stdout:7/468: mkdir d0/d2/d12/d19/d38/d9c 0 2023-12-08T20:28:20.962 INFO:tasks.workunit.client.0.smithi043.stdout:3/462: mknod d1/d9/d2d/d66/c9b 0 2023-12-08T20:28:20.962 INFO:tasks.workunit.client.0.smithi043.stdout:3/463: fdatasync d1/f4b 0 2023-12-08T20:28:20.963 INFO:tasks.workunit.client.0.smithi043.stdout:7/469: link d0/f6a d0/d2/d12/d19/d38/f9d 0 2023-12-08T20:28:20.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:20 smithi111 ceph-mon[121341]: pgmap v31: 65 pgs: 65 active+clean; 1.9 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 21 MiB/s rd, 45 MiB/s wr, 131 op/s 2023-12-08T20:28:20.968 INFO:tasks.workunit.client.0.smithi043.stdout:3/464: write d1/d1c/f22 [2896769,107906] 0 2023-12-08T20:28:20.973 INFO:tasks.workunit.client.0.smithi043.stdout:4/525: dwrite d1/d14/f45 [0,4194304] 0 2023-12-08T20:28:20.976 INFO:tasks.workunit.client.0.smithi043.stdout:4/526: link d1/d14/d25/d39/f71 d1/d14/d25/d39/da3/dae/fb4 0 2023-12-08T20:28:20.976 INFO:tasks.workunit.client.0.smithi043.stdout:4/527: chown d1/d14/d50/c60 4 1 2023-12-08T20:28:20.977 INFO:tasks.workunit.client.0.smithi043.stdout:4/528: creat d1/d14/d25/d39/d3d/d40/fb5 x:0 0 0 2023-12-08T20:28:20.978 INFO:tasks.workunit.client.0.smithi043.stdout:3/465: dread d1/d9/d38/d33/f5d [0,4194304] 0 2023-12-08T20:28:20.981 INFO:tasks.workunit.client.0.smithi043.stdout:2/700: dwrite d0/d26/f45 [0,4194304] 0 2023-12-08T20:28:20.983 INFO:tasks.workunit.client.0.smithi043.stdout:9/425: dwrite d0/d5e/d37/d6b/d6c/f7d [0,4194304] 0 2023-12-08T20:28:20.983 INFO:tasks.workunit.client.0.smithi043.stdout:4/529: mkdir d1/d14/d25/d39/d3f/d3c/d41/db6 0 2023-12-08T20:28:20.983 INFO:tasks.workunit.client.0.smithi043.stdout:0/656: dwrite d2/d3/d18/d2b/da5/f5c [0,4194304] 0 2023-12-08T20:28:20.984 INFO:tasks.workunit.client.0.smithi043.stdout:6/440: dwrite d0/d2/d14/d2c/f3b [0,4194304] 0 2023-12-08T20:28:20.984 INFO:tasks.workunit.client.0.smithi043.stdout:6/441: truncate d0/f34 1382200 0 2023-12-08T20:28:20.984 INFO:tasks.workunit.client.0.smithi043.stdout:6/442: dread - d0/d2/d14/d8/d47/d60/f88 zero size 2023-12-08T20:28:20.984 INFO:tasks.workunit.client.0.smithi043.stdout:6/443: chown d0/d2/d14/d20/d3c/f87 49 1 2023-12-08T20:28:20.984 INFO:tasks.workunit.client.0.smithi043.stdout:6/444: fdatasync d0/d2/f1f 0 2023-12-08T20:28:20.984 INFO:tasks.workunit.client.0.smithi043.stdout:1/483: dwrite d1/d6/f9a [0,4194304] 0 2023-12-08T20:28:20.987 INFO:tasks.workunit.client.0.smithi043.stdout:7/470: dwrite d0/d2/d12/d19/d38/f55 [0,4194304] 0 2023-12-08T20:28:20.988 INFO:tasks.workunit.client.0.smithi043.stdout:2/701: getdents d0/d26/dbc/d38 0 2023-12-08T20:28:20.988 INFO:tasks.workunit.client.0.smithi043.stdout:2/702: fdatasync d0/d20/f76 0 2023-12-08T20:28:20.992 INFO:tasks.workunit.client.0.smithi043.stdout:4/530: truncate d1/d14/d50/f53 1239494 0 2023-12-08T20:28:20.993 INFO:tasks.workunit.client.0.smithi043.stdout:4/531: write d1/d14/d25/d39/d3d/d40/f6c [1229660,70139] 0 2023-12-08T20:28:20.995 INFO:tasks.workunit.client.0.smithi043.stdout:0/657: creat d2/d61/d67/d9e/fd5 x:0 0 0 2023-12-08T20:28:20.995 INFO:tasks.workunit.client.0.smithi043.stdout:0/658: fdatasync d2/d3/d18/d2b/f36 0 2023-12-08T20:28:20.995 INFO:tasks.workunit.client.0.smithi043.stdout:0/659: readlink d2/d3/d18/d2b/da5/l19 0 2023-12-08T20:28:20.995 INFO:tasks.workunit.client.0.smithi043.stdout:6/445: getdents d0/d2/d14/d20 0 2023-12-08T20:28:20.996 INFO:tasks.workunit.client.0.smithi043.stdout:6/446: dread d0/d2/d14/d2c/f65 [0,4194304] 0 2023-12-08T20:28:20.996 INFO:tasks.workunit.client.0.smithi043.stdout:1/484: unlink d1/d16/d30/d6e/d83/f94 0 2023-12-08T20:28:20.997 INFO:tasks.workunit.client.0.smithi043.stdout:4/532: write d1/d14/d1d/fb [272873,109620] 0 2023-12-08T20:28:20.997 INFO:tasks.workunit.client.0.smithi043.stdout:1/485: write d1/d16/f47 [3484870,380] 0 2023-12-08T20:28:20.997 INFO:tasks.workunit.client.0.smithi043.stdout:1/486: fsync d1/d16/f28 0 2023-12-08T20:28:20.997 INFO:tasks.workunit.client.0.smithi043.stdout:7/471: creat d0/f9e x:0 0 0 2023-12-08T20:28:20.998 INFO:tasks.workunit.client.0.smithi043.stdout:3/466: dwrite d1/d9/d38/d30/f59 [0,4194304] 0 2023-12-08T20:28:20.998 INFO:tasks.workunit.client.0.smithi043.stdout:2/703: creat d0/db/d18/d8b/fe4 x:0 0 0 2023-12-08T20:28:21.000 INFO:tasks.workunit.client.0.smithi043.stdout:4/533: write d1/d14/d25/d39/d3f/f3a [2715489,7711] 0 2023-12-08T20:28:21.000 INFO:tasks.workunit.client.0.smithi043.stdout:4/534: write d1/d14/d50/f7a [271476,92765] 0 2023-12-08T20:28:21.001 INFO:tasks.workunit.client.0.smithi043.stdout:7/472: dread d0/d2/d65/d99/f7d [0,4194304] 0 2023-12-08T20:28:21.001 INFO:tasks.workunit.client.0.smithi043.stdout:7/473: truncate d0/d2/d65/d99/d47/f6c 961853 0 2023-12-08T20:28:21.001 INFO:tasks.workunit.client.0.smithi043.stdout:0/660: link d2/c3e d2/d61/d67/cd6 0 2023-12-08T20:28:21.001 INFO:tasks.workunit.client.0.smithi043.stdout:0/661: write d2/d3/d18/d1e/f3c [846460,87087] 0 2023-12-08T20:28:21.001 INFO:tasks.workunit.client.0.smithi043.stdout:2/704: dread d0/db/d18/d3d/fc5 [0,4194304] 0 2023-12-08T20:28:21.003 INFO:tasks.workunit.client.0.smithi043.stdout:0/662: read d2/d3/d18/d1e/d53/d7d/fbb [2577868,128161] 0 2023-12-08T20:28:21.005 INFO:tasks.workunit.client.0.smithi043.stdout:6/447: rename d0/d2/d14/d20/d3c/f55 to d0/d2/d14/d2c/d22/d3f/d45/f98 0 2023-12-08T20:28:21.007 INFO:tasks.workunit.client.0.smithi043.stdout:1/487: creat d1/d16/d30/fb3 x:0 0 0 2023-12-08T20:28:21.007 INFO:tasks.workunit.client.0.smithi043.stdout:1/488: getdents d1/db1 0 2023-12-08T20:28:21.008 INFO:tasks.workunit.client.0.smithi043.stdout:3/467: mknod d1/d9/d38/d4f/c9c 0 2023-12-08T20:28:21.009 INFO:tasks.workunit.client.0.smithi043.stdout:9/426: getdents d0 0 2023-12-08T20:28:21.010 INFO:tasks.workunit.client.0.smithi043.stdout:7/474: mkdir d0/d6/d17/d9f 0 2023-12-08T20:28:21.011 INFO:tasks.workunit.client.0.smithi043.stdout:2/705: symlink d0/d20/d42/d49/le5 0 2023-12-08T20:28:21.011 INFO:tasks.workunit.client.0.smithi043.stdout:2/706: chown d0/d26/dbc/d38/dae/lba 7973 1 2023-12-08T20:28:21.013 INFO:tasks.workunit.client.0.smithi043.stdout:0/663: symlink d2/d3/d6/d39/d83/ld7 0 2023-12-08T20:28:21.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:20 smithi043 ceph-mon[111966]: pgmap v31: 65 pgs: 65 active+clean; 1.9 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 21 MiB/s rd, 45 MiB/s wr, 131 op/s 2023-12-08T20:28:21.016 INFO:tasks.workunit.client.0.smithi043.stdout:6/448: mknod d0/d2/de/c99 0 2023-12-08T20:28:21.019 INFO:tasks.workunit.client.0.smithi043.stdout:6/449: read d0/d2/d14/d8/f43 [2047306,60554] 0 2023-12-08T20:28:21.019 INFO:tasks.workunit.client.0.smithi043.stdout:6/450: chown d0/d2/d14/d8/l8b 44275 1 2023-12-08T20:28:21.021 INFO:tasks.workunit.client.0.smithi043.stdout:1/489: getdents d1/d16/d21/d25/d3e/d77 0 2023-12-08T20:28:21.024 INFO:tasks.workunit.client.0.smithi043.stdout:3/468: creat d1/d9/d38/d33/f9d x:0 0 0 2023-12-08T20:28:21.024 INFO:tasks.workunit.client.0.smithi043.stdout:2/707: fdatasync d0/db/d18/d8b/fb0 0 2023-12-08T20:28:21.024 INFO:tasks.workunit.client.0.smithi043.stdout:0/664: mkdir d2/d3/d6/d39/dd8 0 2023-12-08T20:28:21.026 INFO:tasks.workunit.client.0.smithi043.stdout:6/451: creat d0/d2/de/d4a/d56/d59/f9a x:0 0 0 2023-12-08T20:28:21.027 INFO:tasks.workunit.client.0.smithi043.stdout:1/490: mknod d1/d16/d21/d25/cb4 0 2023-12-08T20:28:21.030 INFO:tasks.workunit.client.0.smithi043.stdout:0/665: link d2/d3/d18/d2b/da5/d5f/d79/fcb d2/d3/d18/d2b/fd9 0 2023-12-08T20:28:21.030 INFO:tasks.workunit.client.0.smithi043.stdout:6/452: link d0/d2/d14/d20/d49/f4f d0/d2/d14/d20/d3c/d6c/f9b 0 2023-12-08T20:28:21.030 INFO:tasks.workunit.client.0.smithi043.stdout:6/453: dread - d0/d2/d14/d8/d47/d60/f8d zero size 2023-12-08T20:28:21.030 INFO:tasks.workunit.client.0.smithi043.stdout:6/454: fsync d0/d2/d14/d2c/f65 0 2023-12-08T20:28:21.031 INFO:tasks.workunit.client.0.smithi043.stdout:1/491: unlink d1/d16/d1c/f59 0 2023-12-08T20:28:21.032 INFO:tasks.workunit.client.0.smithi043.stdout:9/427: dwrite d0/d3d/d4b/d61/f62 [0,4194304] 0 2023-12-08T20:28:21.032 INFO:tasks.workunit.client.0.smithi043.stdout:2/708: dread d0/fa [0,4194304] 0 2023-12-08T20:28:21.035 INFO:tasks.workunit.client.0.smithi043.stdout:2/709: chown d0/d20/d42/c7f 29979 1 2023-12-08T20:28:21.035 INFO:tasks.workunit.client.0.smithi043.stdout:7/475: dwrite d0/d2/d12/d19/f40 [0,4194304] 0 2023-12-08T20:28:21.036 INFO:tasks.workunit.client.0.smithi043.stdout:6/455: creat d0/d2/d14/d20/d3c/f9c x:0 0 0 2023-12-08T20:28:21.036 INFO:tasks.workunit.client.0.smithi043.stdout:1/492: creat d1/d16/d86/fb5 x:0 0 0 2023-12-08T20:28:21.036 INFO:tasks.workunit.client.0.smithi043.stdout:1/493: write d1/d16/d21/f6c [331550,81012] 0 2023-12-08T20:28:21.039 INFO:tasks.workunit.client.0.smithi043.stdout:9/428: creat d0/d21/f87 x:0 0 0 2023-12-08T20:28:21.039 INFO:tasks.workunit.client.0.smithi043.stdout:9/429: stat d0/d5e/d37/d6b/d6c/c85 0 2023-12-08T20:28:21.041 INFO:tasks.workunit.client.0.smithi043.stdout:6/456: creat d0/d2/d14/d2c/d66/f9d x:0 0 0 2023-12-08T20:28:21.047 INFO:tasks.workunit.client.0.smithi043.stdout:1/494: rmdir d1/d16/d21/d25/d3e/d77/da0 0 2023-12-08T20:28:21.048 INFO:tasks.workunit.client.0.smithi043.stdout:3/469: dwrite d1/f6d [0,4194304] 0 2023-12-08T20:28:21.048 INFO:tasks.workunit.client.0.smithi043.stdout:9/430: link d0/d3d/d4b/d65/l78 d0/d5e/d37/d6b/l88 0 2023-12-08T20:28:21.048 INFO:tasks.workunit.client.0.smithi043.stdout:9/431: fsync d0/f1e 0 2023-12-08T20:28:21.048 INFO:tasks.workunit.client.0.smithi043.stdout:9/432: read d0/d3d/f45 [525202,108929] 0 2023-12-08T20:28:21.048 INFO:tasks.workunit.client.0.smithi043.stdout:6/457: creat d0/d2/d14/d20/d3c/d6c/f9e x:0 0 0 2023-12-08T20:28:21.048 INFO:tasks.workunit.client.0.smithi043.stdout:6/458: stat d0/d2/d14/d20/d3c/d50 0 2023-12-08T20:28:21.049 INFO:tasks.workunit.client.0.smithi043.stdout:1/495: creat d1/d16/d21/d25/d3e/d77/d9f/fb6 x:0 0 0 2023-12-08T20:28:21.049 INFO:tasks.workunit.client.0.smithi043.stdout:3/470: creat d1/f9e x:0 0 0 2023-12-08T20:28:21.050 INFO:tasks.workunit.client.0.smithi043.stdout:0/666: truncate d2/d3/d18/d1e/f3c 271809 0 2023-12-08T20:28:21.051 INFO:tasks.workunit.client.0.smithi043.stdout:9/433: rename d0/d5e/f47 to d0/d5e/f89 0 2023-12-08T20:28:21.053 INFO:tasks.workunit.client.0.smithi043.stdout:1/496: read d1/d16/d21/d42/f5c [3810883,43892] 0 2023-12-08T20:28:21.053 INFO:tasks.workunit.client.0.smithi043.stdout:2/710: dwrite d0/d2b/d4e/fa1 [0,4194304] 0 2023-12-08T20:28:21.053 INFO:tasks.workunit.client.0.smithi043.stdout:2/711: chown d0/d26/dbc/d38/dae/dc0/cdc 5595725 1 2023-12-08T20:28:21.054 INFO:tasks.workunit.client.0.smithi043.stdout:7/476: dwrite d0/d2/d65/d99/f15 [0,4194304] 0 2023-12-08T20:28:21.055 INFO:tasks.workunit.client.0.smithi043.stdout:7/477: read d0/d2/d65/d99/f9 [652170,108785] 0 2023-12-08T20:28:21.056 INFO:tasks.workunit.client.0.smithi043.stdout:3/471: rename d1/d25/d2a/d5e/c6c to d1/d1c/d2c/d5f/c9f 0 2023-12-08T20:28:21.058 INFO:tasks.workunit.client.0.smithi043.stdout:7/478: read d0/d2/d12/d19/d38/f9d [2073636,51593] 0 2023-12-08T20:28:21.060 INFO:tasks.workunit.client.0.smithi043.stdout:1/497: creat d1/d16/d21/d25/d3e/d72/fb7 x:0 0 0 2023-12-08T20:28:21.060 INFO:tasks.workunit.client.0.smithi043.stdout:1/498: chown d1/d16/d1c/d4e 362697 1 2023-12-08T20:28:21.062 INFO:tasks.workunit.client.0.smithi043.stdout:3/472: symlink d1/d1c/d2c/d5f/la0 0 2023-12-08T20:28:21.062 INFO:tasks.workunit.client.0.smithi043.stdout:3/473: truncate d1/f9e 163097 0 2023-12-08T20:28:21.062 INFO:tasks.workunit.client.0.smithi043.stdout:3/474: chown d1/d9/d2d/d42 44529 1 2023-12-08T20:28:21.065 INFO:tasks.workunit.client.0.smithi043.stdout:0/667: rename d2/fad to d2/d3/d18/d2b/da5/da3/fda 0 2023-12-08T20:28:21.066 INFO:tasks.workunit.client.0.smithi043.stdout:1/499: mkdir d1/d16/d21/d25/d3e/d82/db8 0 2023-12-08T20:28:21.067 INFO:tasks.workunit.client.0.smithi043.stdout:3/475: readlink d1/d1c/d2c/l4c 0 2023-12-08T20:28:21.068 INFO:tasks.workunit.client.0.smithi043.stdout:7/479: dread d0/d6/f18 [4194304,4194304] 0 2023-12-08T20:28:21.069 INFO:tasks.workunit.client.0.smithi043.stdout:1/500: creat d1/d16/d21/d42/fb9 x:0 0 0 2023-12-08T20:28:21.070 INFO:tasks.workunit.client.0.smithi043.stdout:6/459: getdents d0/d2/de/d4a/d56/d59 0 2023-12-08T20:28:21.070 INFO:tasks.workunit.client.0.smithi043.stdout:3/476: mknod d1/d9/d2d/d66/ca1 0 2023-12-08T20:28:21.071 INFO:tasks.workunit.client.0.smithi043.stdout:6/460: write d0/d2/d14/d2c/d22/d3f/d45/f98 [2414591,38885] 0 2023-12-08T20:28:21.073 INFO:tasks.workunit.client.0.smithi043.stdout:7/480: symlink d0/d6/d17/la0 0 2023-12-08T20:28:21.073 INFO:tasks.workunit.client.0.smithi043.stdout:7/481: fsync d0/f88 0 2023-12-08T20:28:21.075 INFO:tasks.workunit.client.0.smithi043.stdout:2/712: rename d0/db/d18/d8b/ld2 to d0/da6/le6 0 2023-12-08T20:28:21.075 INFO:tasks.workunit.client.0.smithi043.stdout:6/461: creat d0/d2/d14/d8/f9f x:0 0 0 2023-12-08T20:28:21.077 INFO:tasks.workunit.client.0.smithi043.stdout:0/668: rename d2/d3/l28 to d2/d3/d18/d2b/da5/d5f/d79/d86/ldb 0 2023-12-08T20:28:21.078 INFO:tasks.workunit.client.0.smithi043.stdout:2/713: rmdir d0/d20/d42/dcb 39 2023-12-08T20:28:21.081 INFO:tasks.workunit.client.0.smithi043.stdout:3/477: dread d1/d25/d2a/d45/f58 [0,4194304] 0 2023-12-08T20:28:21.082 INFO:tasks.workunit.client.0.smithi043.stdout:2/714: link d0/d20/l97 d0/db/d18/d66/d71/dab/le7 0 2023-12-08T20:28:21.082 INFO:tasks.workunit.client.0.smithi043.stdout:2/715: getdents d0/d81/daa 0 2023-12-08T20:28:21.082 INFO:tasks.workunit.client.0.smithi043.stdout:9/434: rmdir d0/d5e/d37/d6b 39 2023-12-08T20:28:21.084 INFO:tasks.workunit.client.0.smithi043.stdout:2/716: creat d0/d20/fe8 x:0 0 0 2023-12-08T20:28:21.086 INFO:tasks.workunit.client.0.smithi043.stdout:9/435: mkdir d0/d3d/d8a 0 2023-12-08T20:28:21.087 INFO:tasks.workunit.client.0.smithi043.stdout:2/717: mknod d0/d20/d42/ce9 0 2023-12-08T20:28:21.088 INFO:tasks.workunit.client.0.smithi043.stdout:0/669: unlink d2/d3/d18/d1e/f3c 0 2023-12-08T20:28:21.089 INFO:tasks.workunit.client.0.smithi043.stdout:9/436: getdents d0/d5e/d37/d6b 0 2023-12-08T20:28:21.090 INFO:tasks.workunit.client.0.smithi043.stdout:2/718: creat d0/db/fea x:0 0 0 2023-12-08T20:28:21.092 INFO:tasks.workunit.client.0.smithi043.stdout:0/670: symlink d2/d3/d18/d2b/da5/d5f/d79/ldc 0 2023-12-08T20:28:21.092 INFO:tasks.workunit.client.0.smithi043.stdout:0/671: readlink d2/d3/d18/d2b/da5/d8e/lba 0 2023-12-08T20:28:21.093 INFO:tasks.workunit.client.0.smithi043.stdout:9/437: link d0/d5e/c75 d0/d5e/d73/c8b 0 2023-12-08T20:28:21.096 INFO:tasks.workunit.client.0.smithi043.stdout:2/719: dread d0/f9 [0,4194304] 0 2023-12-08T20:28:21.096 INFO:tasks.workunit.client.0.smithi043.stdout:2/720: chown d0/d26/d53/fb2 432970193 1 2023-12-08T20:28:21.096 INFO:tasks.workunit.client.0.smithi043.stdout:2/721: truncate d0/d2b/d4e/fc7 1818396 0 2023-12-08T20:28:21.096 INFO:tasks.workunit.client.0.smithi043.stdout:9/438: mkdir d0/d3d/d8c 0 2023-12-08T20:28:21.097 INFO:tasks.workunit.client.0.smithi043.stdout:0/672: dread d2/d4/fe [0,4194304] 0 2023-12-08T20:28:21.106 INFO:tasks.workunit.client.0.smithi043.stdout:0/673: dread d2/d3/f1a [0,4194304] 0 2023-12-08T20:28:21.107 INFO:tasks.workunit.client.0.smithi043.stdout:0/674: symlink d2/d3/d18/d2b/da5/d3f/ldd 0 2023-12-08T20:28:21.109 INFO:tasks.workunit.client.0.smithi043.stdout:0/675: mknod d2/d3/d18/d2b/cde 0 2023-12-08T20:28:21.110 INFO:tasks.workunit.client.0.smithi043.stdout:0/676: symlink d2/d61/ldf 0 2023-12-08T20:28:21.110 INFO:tasks.workunit.client.0.smithi043.stdout:0/677: getdents d2/d3/d18/d1e/dcc 0 2023-12-08T20:28:21.110 INFO:tasks.workunit.client.0.smithi043.stdout:0/678: fdatasync d2/d3/f4e 0 2023-12-08T20:28:21.112 INFO:tasks.workunit.client.0.smithi043.stdout:0/679: rename d2/d3/d18/d1e/f25 to d2/d3/d6/d39/d63/da6/dcd/fe0 0 2023-12-08T20:28:21.113 INFO:tasks.workunit.client.0.smithi043.stdout:0/680: rename d2/d3/d18/l23 to d2/d3/d6/d39/d5e/le1 0 2023-12-08T20:28:21.114 INFO:tasks.workunit.client.0.smithi043.stdout:0/681: creat d2/d3/d18/d2b/fe2 x:0 0 0 2023-12-08T20:28:21.114 INFO:tasks.workunit.client.0.smithi043.stdout:0/682: truncate d2/d3/d6/d39/d5e/f96 430320 0 2023-12-08T20:28:21.118 INFO:tasks.workunit.client.0.smithi043.stdout:2/722: dwrite d0/db/d18/d66/d71/f87 [0,4194304] 0 2023-12-08T20:28:21.147 INFO:tasks.workunit.client.0.smithi043.stdout:1/501: dwrite d1/f2 [0,4194304] 0 2023-12-08T20:28:21.147 INFO:tasks.workunit.client.0.smithi043.stdout:1/502: chown d1/d6/d63 3 1 2023-12-08T20:28:21.147 INFO:tasks.workunit.client.0.smithi043.stdout:1/503: chown d1/d16/d21/d25/d3e/l52 109333 1 2023-12-08T20:28:21.152 INFO:tasks.workunit.client.0.smithi043.stdout:1/504: creat d1/d16/d48/fba x:0 0 0 2023-12-08T20:28:21.154 INFO:tasks.workunit.client.0.smithi043.stdout:1/505: creat d1/d16/d1c/d71/d98/fbb x:0 0 0 2023-12-08T20:28:21.155 INFO:tasks.workunit.client.0.smithi043.stdout:1/506: write d1/d16/f28 [4488066,1451] 0 2023-12-08T20:28:21.155 INFO:tasks.workunit.client.0.smithi043.stdout:1/507: fsync d1/d16/f4d 0 2023-12-08T20:28:21.159 INFO:tasks.workunit.client.0.smithi043.stdout:9/439: dwrite d0/f1e [0,4194304] 0 2023-12-08T20:28:21.159 INFO:tasks.workunit.client.0.smithi043.stdout:9/440: fsync d0/d3d/f83 0 2023-12-08T20:28:21.161 INFO:tasks.workunit.client.0.smithi043.stdout:9/441: unlink d0/d21/f28 0 2023-12-08T20:28:21.161 INFO:tasks.workunit.client.0.smithi043.stdout:9/442: truncate d0/d21/f74 1009947 0 2023-12-08T20:28:21.161 INFO:tasks.workunit.client.0.smithi043.stdout:9/443: chown d0/d5e/f89 11385005 1 2023-12-08T20:28:21.161 INFO:tasks.workunit.client.0.smithi043.stdout:9/444: chown d0/d5e/d37/d6b/d76/d53 210867186 1 2023-12-08T20:28:21.161 INFO:tasks.workunit.client.0.smithi043.stdout:9/445: chown d0/d21/f55 242 1 2023-12-08T20:28:21.162 INFO:tasks.workunit.client.0.smithi043.stdout:9/446: symlink d0/d3d/d4b/d5c/l8d 0 2023-12-08T20:28:21.165 INFO:tasks.workunit.client.0.smithi043.stdout:7/482: dwrite d0/d6/f24 [0,4194304] 0 2023-12-08T20:28:21.165 INFO:tasks.workunit.client.0.smithi043.stdout:3/478: dwrite d1/d9/d38/d4f/f79 [0,4194304] 0 2023-12-08T20:28:21.165 INFO:tasks.workunit.client.0.smithi043.stdout:3/479: chown d1/d25/d2a/d45/l46 18567967 1 2023-12-08T20:28:21.167 INFO:tasks.workunit.client.0.smithi043.stdout:0/683: dwrite d2/d3/d6/f2e [0,4194304] 0 2023-12-08T20:28:21.170 INFO:tasks.workunit.client.0.smithi043.stdout:6/462: dwrite d0/d2/d14/d2c/d22/d2a/f5a [0,4194304] 0 2023-12-08T20:28:21.170 INFO:tasks.workunit.client.0.smithi043.stdout:2/723: dwrite d0/d26/fca [0,4194304] 0 2023-12-08T20:28:21.171 INFO:tasks.workunit.client.0.smithi043.stdout:2/724: truncate d0/d26/f98 4919187 0 2023-12-08T20:28:21.171 INFO:tasks.workunit.client.0.smithi043.stdout:2/725: truncate d0/d20/d42/d49/fda 928022 0 2023-12-08T20:28:21.171 INFO:tasks.workunit.client.0.smithi043.stdout:2/726: truncate d0/d20/fe8 728800 0 2023-12-08T20:28:21.171 INFO:tasks.workunit.client.0.smithi043.stdout:2/727: dread - d0/d26/fd0 zero size 2023-12-08T20:28:21.171 INFO:tasks.workunit.client.0.smithi043.stdout:3/480: unlink d1/d9/df/c43 0 2023-12-08T20:28:21.172 INFO:tasks.workunit.client.0.smithi043.stdout:9/447: dread d0/f6 [0,4194304] 0 2023-12-08T20:28:21.174 INFO:tasks.workunit.client.0.smithi043.stdout:9/448: write d0/d3d/f48 [3712060,45802] 0 2023-12-08T20:28:21.174 INFO:tasks.workunit.client.0.smithi043.stdout:9/449: stat d0/d5e/d37/c84 0 2023-12-08T20:28:21.175 INFO:tasks.workunit.client.0.smithi043.stdout:2/728: mknod d0/d2b/d4e/ceb 0 2023-12-08T20:28:21.179 INFO:tasks.workunit.client.0.smithi043.stdout:3/481: link d1/d9/df/l90 d1/d1c/d29/la2 0 2023-12-08T20:28:21.180 INFO:tasks.workunit.client.0.smithi043.stdout:9/450: read d0/d5e/f63 [902622,57407] 0 2023-12-08T20:28:21.180 INFO:tasks.workunit.client.0.smithi043.stdout:2/729: symlink d0/d2b/d4e/lec 0 2023-12-08T20:28:21.185 INFO:tasks.workunit.client.0.smithi043.stdout:9/451: mkdir d0/d21/d80/d8e 0 2023-12-08T20:28:21.185 INFO:tasks.workunit.client.0.smithi043.stdout:2/730: link d0/db/d18/cb1 d0/d26/dbc/ced 0 2023-12-08T20:28:21.185 INFO:tasks.workunit.client.0.smithi043.stdout:1/508: dread d1/d16/d48/f56 [4194304,4194304] 0 2023-12-08T20:28:21.186 INFO:tasks.workunit.client.0.smithi043.stdout:9/452: read d0/d3d/f72 [2537257,11552] 0 2023-12-08T20:28:21.191 INFO:tasks.workunit.client.0.smithi043.stdout:9/453: symlink d0/d5e/d37/d6b/d76/d53/l8f 0 2023-12-08T20:28:21.191 INFO:tasks.workunit.client.0.smithi043.stdout:9/454: write d0/d5e/f3c [4917286,4939] 0 2023-12-08T20:28:21.195 INFO:tasks.workunit.client.0.smithi043.stdout:9/455: rename d0/d5e/d37/d6b/d76/l5a to d0/d5e/d37/l90 0 2023-12-08T20:28:21.196 INFO:tasks.workunit.client.0.smithi043.stdout:2/731: write d0/d81/f8e [2388918,8716] 0 2023-12-08T20:28:21.197 INFO:tasks.workunit.client.0.smithi043.stdout:9/456: creat d0/d3d/d4b/f91 x:0 0 0 2023-12-08T20:28:21.197 INFO:tasks.workunit.client.0.smithi043.stdout:9/457: fdatasync d0/d3d/f5d 0 2023-12-08T20:28:21.198 INFO:tasks.workunit.client.0.smithi043.stdout:2/732: rmdir d0/da6/db9 0 2023-12-08T20:28:21.202 INFO:tasks.workunit.client.0.smithi043.stdout:7/483: dwrite d0/d6/d17/f86 [0,4194304] 0 2023-12-08T20:28:21.209 INFO:tasks.workunit.client.0.smithi043.stdout:0/684: dwrite d2/f9b [0,4194304] 0 2023-12-08T20:28:21.213 INFO:tasks.workunit.client.0.smithi043.stdout:0/685: creat d2/d61/dc1/fe3 x:0 0 0 2023-12-08T20:28:21.214 INFO:tasks.workunit.client.0.smithi043.stdout:9/458: dread d0/f1e [0,4194304] 0 2023-12-08T20:28:21.214 INFO:tasks.workunit.client.0.smithi043.stdout:3/482: dwrite d1/d9/f48 [4194304,4194304] 0 2023-12-08T20:28:21.215 INFO:tasks.workunit.client.0.smithi043.stdout:3/483: write d1/d9/d38/d33/f9d [816860,13762] 0 2023-12-08T20:28:21.216 INFO:tasks.workunit.client.0.smithi043.stdout:6/463: dwrite d0/d2/d29/f97 [0,4194304] 0 2023-12-08T20:28:21.219 INFO:tasks.workunit.client.0.smithi043.stdout:9/459: mknod d0/d21/d80/d8e/c92 0 2023-12-08T20:28:21.219 INFO:tasks.workunit.client.0.smithi043.stdout:0/686: dread d2/d3/d18/d2b/f36 [0,4194304] 0 2023-12-08T20:28:21.223 INFO:tasks.workunit.client.0.smithi043.stdout:6/464: symlink d0/d2/d14/d20/la0 0 2023-12-08T20:28:21.223 INFO:tasks.workunit.client.0.smithi043.stdout:6/465: chown d0/d2/d14/d8/f4e 75046191 1 2023-12-08T20:28:21.226 INFO:tasks.workunit.client.0.smithi043.stdout:9/460: dread d0/f13 [0,4194304] 0 2023-12-08T20:28:21.228 INFO:tasks.workunit.client.0.smithi043.stdout:9/461: symlink d0/d5e/d37/d6b/l93 0 2023-12-08T20:28:21.230 INFO:tasks.workunit.client.0.smithi043.stdout:9/462: mkdir d0/d5e/d37/d6b/d94 0 2023-12-08T20:28:21.232 INFO:tasks.workunit.client.0.smithi043.stdout:9/463: unlink d0/f1c 0 2023-12-08T20:28:21.233 INFO:tasks.workunit.client.0.smithi043.stdout:9/464: symlink d0/d21/l95 0 2023-12-08T20:28:21.234 INFO:tasks.workunit.client.0.smithi043.stdout:9/465: link d0/d21/f56 d0/f96 0 2023-12-08T20:28:21.235 INFO:tasks.workunit.client.0.smithi043.stdout:9/466: getdents d0/d5e 0 2023-12-08T20:28:21.235 INFO:tasks.workunit.client.0.smithi043.stdout:9/467: fdatasync d0/d3d/f42 0 2023-12-08T20:28:21.235 INFO:tasks.workunit.client.0.smithi043.stdout:9/468: readlink d0/d21/d80/l82 0 2023-12-08T20:28:21.238 INFO:tasks.workunit.client.0.smithi043.stdout:9/469: write d0/d5e/d37/d6b/d76/d53/f6d [2861036,32098] 0 2023-12-08T20:28:21.239 INFO:tasks.workunit.client.0.smithi043.stdout:9/470: fsync d0/d5e/f63 0 2023-12-08T20:28:21.239 INFO:tasks.workunit.client.0.smithi043.stdout:9/471: truncate d0/d21/f55 265923 0 2023-12-08T20:28:21.240 INFO:tasks.workunit.client.0.smithi043.stdout:9/472: rmdir d0/d21/d80/d8e 39 2023-12-08T20:28:21.240 INFO:tasks.workunit.client.0.smithi043.stdout:9/473: write d0/d21/f87 [311916,69173] 0 2023-12-08T20:28:21.250 INFO:tasks.workunit.client.0.smithi043.stdout:3/484: dwrite d1/d9/d2d/d66/f74 [0,4194304] 0 2023-12-08T20:28:21.250 INFO:tasks.workunit.client.0.smithi043.stdout:1/509: dwrite d1/d16/d21/d25/d3e/d77/d9f/fb6 [0,4194304] 0 2023-12-08T20:28:21.251 INFO:tasks.workunit.client.0.smithi043.stdout:7/484: dwrite d0/d2/d12/d19/f94 [0,4194304] 0 2023-12-08T20:28:21.254 INFO:tasks.workunit.client.0.smithi043.stdout:0/687: dwrite d2/d3/d18/d2b/f36 [0,4194304] 0 2023-12-08T20:28:21.254 INFO:tasks.workunit.client.0.smithi043.stdout:0/688: dread - d2/d3/d18/d2b/fa7 zero size 2023-12-08T20:28:21.254 INFO:tasks.workunit.client.0.smithi043.stdout:0/689: write d2/d3/d6/d39/d63/fb2 [472900,26079] 0 2023-12-08T20:28:21.256 INFO:tasks.workunit.client.0.smithi043.stdout:2/733: dwrite d0/db/d18/d3d/fcf [0,4194304] 0 2023-12-08T20:28:21.259 INFO:tasks.workunit.client.0.smithi043.stdout:1/510: rename d1/d16/d21/d25/d3e/d82 to d1/d16/d21/d25/d3e/dbc 0 2023-12-08T20:28:21.259 INFO:tasks.workunit.client.0.smithi043.stdout:1/511: chown d1/d16/d21/d25/d3e/dbc/db8 83334603 1 2023-12-08T20:28:21.263 INFO:tasks.workunit.client.0.smithi043.stdout:7/485: link d0/d2/d12/d19/d38/f9d d0/fa1 0 2023-12-08T20:28:21.265 INFO:tasks.workunit.client.0.smithi043.stdout:7/486: dread d0/d2/d12/d19/f41 [0,4194304] 0 2023-12-08T20:28:21.269 INFO:tasks.workunit.client.0.smithi043.stdout:0/690: mknod d2/d61/d67/ce4 0 2023-12-08T20:28:21.272 INFO:tasks.workunit.client.0.smithi043.stdout:2/734: unlink d0/d81/f8a 0 2023-12-08T20:28:21.274 INFO:tasks.workunit.client.0.smithi043.stdout:3/485: symlink d1/d1c/d29/la3 0 2023-12-08T20:28:21.274 INFO:tasks.workunit.client.0.smithi043.stdout:3/486: dread - d1/d1c/d2c/d7f/f96 zero size 2023-12-08T20:28:21.275 INFO:tasks.workunit.client.0.smithi043.stdout:9/474: dwrite d0/d5e/d37/d6b/d76/d53/f6d [0,4194304] 0 2023-12-08T20:28:21.275 INFO:tasks.workunit.client.0.smithi043.stdout:9/475: write d0/f96 [252068,78591] 0 2023-12-08T20:28:21.275 INFO:tasks.workunit.client.0.smithi043.stdout:9/476: truncate d0/f51 857169 0 2023-12-08T20:28:21.275 INFO:tasks.workunit.client.0.smithi043.stdout:1/512: creat d1/d16/d30/d4f/fbd x:0 0 0 2023-12-08T20:28:21.276 INFO:tasks.workunit.client.0.smithi043.stdout:9/477: write d0/d21/f3e [77271,4940] 0 2023-12-08T20:28:21.277 INFO:tasks.workunit.client.0.smithi043.stdout:7/487: rename d0/d6/d17/d9f to d0/d2/d12/da2 0 2023-12-08T20:28:21.279 INFO:tasks.workunit.client.0.smithi043.stdout:3/487: read d1/d9/f48 [6128633,121341] 0 2023-12-08T20:28:21.280 INFO:tasks.workunit.client.0.smithi043.stdout:0/691: mkdir d2/d3/de5 0 2023-12-08T20:28:21.282 INFO:tasks.workunit.client.0.smithi043.stdout:1/513: creat d1/d16/d21/d6f/daa/fbe x:0 0 0 2023-12-08T20:28:21.283 INFO:tasks.workunit.client.0.smithi043.stdout:1/514: chown d1/d16/d30/d4f/d54/l92 3656 1 2023-12-08T20:28:21.283 INFO:tasks.workunit.client.0.smithi043.stdout:1/515: chown d1/d16/f46 882370681 1 2023-12-08T20:28:21.287 INFO:tasks.workunit.client.0.smithi043.stdout:7/488: link d0/d6/d17/d54/f82 d0/d2/d65/d99/fa3 0 2023-12-08T20:28:21.288 INFO:tasks.workunit.client.0.smithi043.stdout:2/735: dread d0/db/f31 [0,4194304] 0 2023-12-08T20:28:21.289 INFO:tasks.workunit.client.0.smithi043.stdout:9/478: dread d0/d3d/d4b/f71 [0,4194304] 0 2023-12-08T20:28:21.290 INFO:tasks.workunit.client.0.smithi043.stdout:0/692: mkdir d2/d3/d6/d39/dd8/de6 0 2023-12-08T20:28:21.291 INFO:tasks.workunit.client.0.smithi043.stdout:2/736: write d0/d26/fca [2420840,7145] 0 2023-12-08T20:28:21.291 INFO:tasks.workunit.client.0.smithi043.stdout:9/479: write d0/d5e/f57 [3113703,108416] 0 2023-12-08T20:28:21.291 INFO:tasks.workunit.client.0.smithi043.stdout:9/480: getdents d0/d67 0 2023-12-08T20:28:21.294 INFO:tasks.workunit.client.0.smithi043.stdout:1/516: getdents d1/d16/d21/d25/d3e/d77/d90 0 2023-12-08T20:28:21.294 INFO:tasks.workunit.client.0.smithi043.stdout:7/489: unlink d0/d6/d17/d52/l9a 0 2023-12-08T20:28:21.296 INFO:tasks.workunit.client.0.smithi043.stdout:3/488: mknod d1/d25/d84/d9a/ca4 0 2023-12-08T20:28:21.298 INFO:tasks.workunit.client.0.smithi043.stdout:9/481: mkdir d0/d21/d80/d97 0 2023-12-08T20:28:21.299 INFO:tasks.workunit.client.0.smithi043.stdout:2/737: write d0/f9 [4202560,114149] 0 2023-12-08T20:28:21.299 INFO:tasks.workunit.client.0.smithi043.stdout:7/490: creat d0/d2/fa4 x:0 0 0 2023-12-08T20:28:21.301 INFO:tasks.workunit.client.0.smithi043.stdout:1/517: truncate d1/d16/d48/f4a 1679752 0 2023-12-08T20:28:21.302 INFO:tasks.workunit.client.0.smithi043.stdout:3/489: rmdir d1/d1c/d29 39 2023-12-08T20:28:21.303 INFO:tasks.workunit.client.0.smithi043.stdout:3/490: write d1/d1c/f22 [1288618,31569] 0 2023-12-08T20:28:21.306 INFO:tasks.workunit.client.0.smithi043.stdout:2/738: creat d0/d26/fee x:0 0 0 2023-12-08T20:28:21.306 INFO:tasks.workunit.client.0.smithi043.stdout:2/739: fdatasync d0/db/f4a 0 2023-12-08T20:28:21.306 INFO:tasks.workunit.client.0.smithi043.stdout:7/491: mknod d0/d69/ca5 0 2023-12-08T20:28:21.306 INFO:tasks.workunit.client.0.smithi043.stdout:9/482: dread d0/d3d/d4b/f71 [0,4194304] 0 2023-12-08T20:28:21.307 INFO:tasks.workunit.client.0.smithi043.stdout:1/518: mknod d1/d16/d1c/d81/cbf 0 2023-12-08T20:28:21.309 INFO:tasks.workunit.client.0.smithi043.stdout:3/491: getdents d1/d9/d2d 0 2023-12-08T20:28:21.309 INFO:tasks.workunit.client.0.smithi043.stdout:3/492: fsync d1/d25/f24 0 2023-12-08T20:28:21.311 INFO:tasks.workunit.client.0.smithi043.stdout:2/740: creat d0/fef x:0 0 0 2023-12-08T20:28:21.311 INFO:tasks.workunit.client.0.smithi043.stdout:2/741: chown d0/d20/d42/d49/le5 23373205 1 2023-12-08T20:28:21.313 INFO:tasks.workunit.client.0.smithi043.stdout:9/483: mknod d0/d5e/d37/d6b/d76/c98 0 2023-12-08T20:28:21.313 INFO:tasks.workunit.client.0.smithi043.stdout:9/484: fdatasync d0/d5e/f63 0 2023-12-08T20:28:21.314 INFO:tasks.workunit.client.0.smithi043.stdout:1/519: getdents d1/d16/d21/d25 0 2023-12-08T20:28:21.315 INFO:tasks.workunit.client.0.smithi043.stdout:1/520: stat d1/d16/d21/d25 0 2023-12-08T20:28:21.315 INFO:tasks.workunit.client.0.smithi043.stdout:2/742: rename d0/d2b/d4e/d93/f9e to d0/d26/dbc/ff0 0 2023-12-08T20:28:21.316 INFO:tasks.workunit.client.0.smithi043.stdout:9/485: mknod d0/d5e/d37/c99 0 2023-12-08T20:28:21.316 INFO:tasks.workunit.client.0.smithi043.stdout:9/486: readlink d0/d3d/d4b/d5c/l60 0 2023-12-08T20:28:21.318 INFO:tasks.workunit.client.0.smithi043.stdout:0/693: dwrite d2/d61/d8a/fd2 [0,4194304] 0 2023-12-08T20:28:21.318 INFO:tasks.workunit.client.0.smithi043.stdout:1/521: symlink d1/d16/d21/d25/lc0 0 2023-12-08T20:28:21.322 INFO:tasks.workunit.client.0.smithi043.stdout:2/743: write d0/db/f19 [3153368,26446] 0 2023-12-08T20:28:21.323 INFO:tasks.workunit.client.0.smithi043.stdout:2/744: read d0/d26/f34 [2048907,108496] 0 2023-12-08T20:28:21.323 INFO:tasks.workunit.client.0.smithi043.stdout:2/745: readlink d0/da6/le6 0 2023-12-08T20:28:21.326 INFO:tasks.workunit.client.0.smithi043.stdout:9/487: mkdir d0/d3d/d8a/d9a 0 2023-12-08T20:28:21.328 INFO:tasks.workunit.client.0.smithi043.stdout:0/694: rmdir d2/d3/d18/d2b/da5/d3f 39 2023-12-08T20:28:21.330 INFO:tasks.workunit.client.0.smithi043.stdout:1/522: symlink d1/db1/lc1 0 2023-12-08T20:28:21.330 INFO:tasks.workunit.client.0.smithi043.stdout:1/523: dread - d1/d16/d1c/f91 zero size 2023-12-08T20:28:21.330 INFO:tasks.workunit.client.0.smithi043.stdout:1/524: fdatasync d1/d16/d21/d25/d35/fb0 0 2023-12-08T20:28:21.330 INFO:tasks.workunit.client.0.smithi043.stdout:1/525: write d1/d16/d21/d25/d3e/d77/d90/f97 [211781,20011] 0 2023-12-08T20:28:21.333 INFO:tasks.workunit.client.0.smithi043.stdout:2/746: mknod d0/d2b/cf1 0 2023-12-08T20:28:21.334 INFO:tasks.workunit.client.0.smithi043.stdout:7/492: getdents d0/d6/d17/d52 0 2023-12-08T20:28:21.336 INFO:tasks.workunit.client.0.smithi043.stdout:9/488: truncate d0/d3d/d4b/f71 801402 0 2023-12-08T20:28:21.340 INFO:tasks.workunit.client.0.smithi043.stdout:0/695: unlink d2/d3/d18/d2b/f37 0 2023-12-08T20:28:21.344 INFO:tasks.workunit.client.0.smithi043.stdout:2/747: rename d0/fa to d0/db/d18/ff2 0 2023-12-08T20:28:21.344 INFO:tasks.workunit.client.0.smithi043.stdout:1/526: creat d1/d16/d21/d25/d3e/dbc/db8/fc2 x:0 0 0 2023-12-08T20:28:21.345 INFO:tasks.workunit.client.0.smithi043.stdout:7/493: creat d0/d5b/fa6 x:0 0 0 2023-12-08T20:28:21.345 INFO:tasks.workunit.client.0.smithi043.stdout:7/494: fdatasync d0/f8f 0 2023-12-08T20:28:21.348 INFO:tasks.workunit.client.0.smithi043.stdout:2/748: unlink d0/d81/fc8 0 2023-12-08T20:28:21.350 INFO:tasks.workunit.client.0.smithi043.stdout:7/495: mknod d0/d6/d17/d54/ca7 0 2023-12-08T20:28:21.350 INFO:tasks.workunit.client.0.smithi043.stdout:7/496: truncate d0/f88 895077 0 2023-12-08T20:28:21.353 INFO:tasks.workunit.client.0.smithi043.stdout:7/497: symlink d0/d69/d6d/la8 0 2023-12-08T20:28:21.383 INFO:tasks.workunit.client.0.smithi043.stdout:0/696: dwrite d2/d3/d6/d39/d83/fb5 [0,4194304] 0 2023-12-08T20:28:21.384 INFO:tasks.workunit.client.0.smithi043.stdout:0/697: chown d2/f9b 38662 1 2023-12-08T20:28:21.384 INFO:tasks.workunit.client.0.smithi043.stdout:1/527: dwrite d1/d16/d21/d25/d35/f62 [0,4194304] 0 2023-12-08T20:28:21.384 INFO:tasks.workunit.client.0.smithi043.stdout:7/498: dwrite d0/f9e [0,4194304] 0 2023-12-08T20:28:21.384 INFO:tasks.workunit.client.0.smithi043.stdout:2/749: dwrite d0/d20/f32 [0,4194304] 0 2023-12-08T20:28:21.386 INFO:tasks.workunit.client.0.smithi043.stdout:7/499: read d0/f42 [3666903,82661] 0 2023-12-08T20:28:21.391 INFO:tasks.workunit.client.0.smithi043.stdout:2/750: mknod d0/db/d18/d66/cf3 0 2023-12-08T20:28:21.395 INFO:tasks.workunit.client.0.smithi043.stdout:2/751: dread d0/db/d18/d3d/f40 [0,4194304] 0 2023-12-08T20:28:21.396 INFO:tasks.workunit.client.0.smithi043.stdout:7/500: dread d0/d6/d17/d54/f60 [0,4194304] 0 2023-12-08T20:28:21.396 INFO:tasks.workunit.client.0.smithi043.stdout:7/501: write d0/d2/d65/d99/f10 [5348636,43778] 0 2023-12-08T20:28:21.397 INFO:tasks.workunit.client.0.smithi043.stdout:7/502: truncate d0/d2/f46 2424945 0 2023-12-08T20:28:21.398 INFO:tasks.workunit.client.0.smithi043.stdout:2/752: symlink d0/db/d18/d8b/lf4 0 2023-12-08T20:28:21.398 INFO:tasks.workunit.client.0.smithi043.stdout:2/753: readlink d0/d20/l2e 0 2023-12-08T20:28:21.400 INFO:tasks.workunit.client.0.smithi043.stdout:7/503: unlink d0/d69/l95 0 2023-12-08T20:28:21.400 INFO:tasks.workunit.client.0.smithi043.stdout:7/504: write d0/d2/fa4 [996265,8223] 0 2023-12-08T20:28:21.400 INFO:tasks.workunit.client.0.smithi043.stdout:7/505: dread - d0/f8f zero size 2023-12-08T20:28:21.405 INFO:tasks.workunit.client.0.smithi043.stdout:0/698: dwrite d2/d3/d6/f2e [0,4194304] 0 2023-12-08T20:28:21.405 INFO:tasks.workunit.client.0.smithi043.stdout:1/528: dwrite d1/d16/d30/f5f [0,4194304] 0 2023-12-08T20:28:21.407 INFO:tasks.workunit.client.0.smithi043.stdout:0/699: creat d2/d3/d6/d39/d83/fe7 x:0 0 0 2023-12-08T20:28:21.410 INFO:tasks.workunit.client.0.smithi043.stdout:0/700: write d2/d3/d6/d39/d5e/f96 [25224,23622] 0 2023-12-08T20:28:21.418 INFO:tasks.workunit.client.0.smithi043.stdout:7/506: dwrite d0/d2/d65/d99/d47/f77 [0,4194304] 0 2023-12-08T20:28:21.418 INFO:tasks.workunit.client.0.smithi043.stdout:7/507: write d0/d2/d12/f2e [4366561,63686] 0 2023-12-08T20:28:21.418 INFO:tasks.workunit.client.0.smithi043.stdout:2/754: dwrite d0/db/d18/d66/f9b [0,4194304] 0 2023-12-08T20:28:21.421 INFO:tasks.workunit.client.0.smithi043.stdout:7/508: dread d0/fb [0,4194304] 0 2023-12-08T20:28:21.425 INFO:tasks.workunit.client.0.smithi043.stdout:7/509: unlink d0/d6/d17/l53 0 2023-12-08T20:28:21.426 INFO:tasks.workunit.client.0.smithi043.stdout:7/510: getdents d0/d6/d17/d54 0 2023-12-08T20:28:21.426 INFO:tasks.workunit.client.0.smithi043.stdout:7/511: readlink d0/d6/d17/l62 0 2023-12-08T20:28:21.427 INFO:tasks.workunit.client.0.smithi043.stdout:7/512: stat d0/d2/d12/d19/d38 0 2023-12-08T20:28:21.427 INFO:tasks.workunit.client.0.smithi043.stdout:7/513: chown d0/d5b/l91 43 1 2023-12-08T20:28:21.432 INFO:tasks.workunit.client.0.smithi043.stdout:0/701: dwrite d2/d3/d18/d2b/f41 [0,4194304] 0 2023-12-08T20:28:21.433 INFO:tasks.workunit.client.0.smithi043.stdout:0/702: write d2/d3/d18/d2b/da5/f49 [3733572,129503] 0 2023-12-08T20:28:21.433 INFO:tasks.workunit.client.0.smithi043.stdout:0/703: chown d2/d3/f1a 186427656 1 2023-12-08T20:28:21.435 INFO:tasks.workunit.client.0.smithi043.stdout:0/704: creat d2/d3/d6/d39/dd8/de6/fe8 x:0 0 0 2023-12-08T20:28:21.435 INFO:tasks.workunit.client.0.smithi043.stdout:0/705: fdatasync d2/d4/fd0 0 2023-12-08T20:28:21.435 INFO:tasks.workunit.client.0.smithi043.stdout:0/706: write d2/d3/d18/d2b/fa7 [908659,64642] 0 2023-12-08T20:28:21.440 INFO:tasks.workunit.client.0.smithi043.stdout:0/707: fdatasync d2/d3/d18/d2b/da5/f49 0 2023-12-08T20:28:21.441 INFO:tasks.workunit.client.0.smithi043.stdout:0/708: unlink d2/d3/c52 0 2023-12-08T20:28:21.442 INFO:tasks.workunit.client.0.smithi043.stdout:0/709: creat d2/d3/d18/d2b/da5/da3/fe9 x:0 0 0 2023-12-08T20:28:21.449 INFO:tasks.workunit.client.0.smithi043.stdout:7/514: dwrite d0/d2/d12/d19/d38/f55 [0,4194304] 0 2023-12-08T20:28:21.453 INFO:tasks.workunit.client.0.smithi043.stdout:7/515: symlink d0/d6/d17/d54/la9 0 2023-12-08T20:28:21.453 INFO:tasks.workunit.client.0.smithi043.stdout:7/516: fdatasync d0/fb 0 2023-12-08T20:28:21.453 INFO:tasks.workunit.client.0.smithi043.stdout:7/517: fsync d0/fa1 0 2023-12-08T20:28:21.454 INFO:tasks.workunit.client.0.smithi043.stdout:7/518: write d0/d2/d12/d19/d38/f9d [2171750,104450] 0 2023-12-08T20:28:21.455 INFO:tasks.workunit.client.0.smithi043.stdout:7/519: write d0/f9e [642035,38364] 0 2023-12-08T20:28:21.455 INFO:tasks.workunit.client.0.smithi043.stdout:0/710: dwrite d2/d3/d18/d2b/fe2 [0,4194304] 0 2023-12-08T20:28:21.459 INFO:tasks.workunit.client.0.smithi043.stdout:0/711: rename d2/d3/de5 to d2/d3/d18/d1e/dcc/dea 0 2023-12-08T20:28:21.459 INFO:tasks.workunit.client.0.smithi043.stdout:0/712: chown d2/d3/d18/d1e/c56 1 1 2023-12-08T20:28:21.460 INFO:tasks.workunit.client.0.smithi043.stdout:0/713: symlink d2/d61/dc0/leb 0 2023-12-08T20:28:21.460 INFO:tasks.workunit.client.0.smithi043.stdout:0/714: chown d2/d3/d6/d39/d63/fb2 3 1 2023-12-08T20:28:21.461 INFO:tasks.workunit.client.0.smithi043.stdout:0/715: link d2/d3/c74 d2/d61/d67/d9e/cec 0 2023-12-08T20:28:21.462 INFO:tasks.workunit.client.0.smithi043.stdout:0/716: creat d2/d61/d67/d9e/fed x:0 0 0 2023-12-08T20:28:21.463 INFO:tasks.workunit.client.0.smithi043.stdout:7/520: dread d0/d2/d12/f2e [0,4194304] 0 2023-12-08T20:28:21.463 INFO:tasks.workunit.client.0.smithi043.stdout:0/717: unlink d2/d3/d6/d39/d63/da6/dcd/fe0 0 2023-12-08T20:28:21.464 INFO:tasks.workunit.client.0.smithi043.stdout:4/535: sync 2023-12-08T20:28:21.464 INFO:tasks.workunit.client.0.smithi043.stdout:5/484: sync 2023-12-08T20:28:21.464 INFO:tasks.workunit.client.0.smithi043.stdout:8/467: sync 2023-12-08T20:28:21.464 INFO:tasks.workunit.client.0.smithi043.stdout:5/485: chown d3/d7/d19/l1f 208 1 2023-12-08T20:28:21.465 INFO:tasks.workunit.client.0.smithi043.stdout:8/468: write d2/d20/d7d/d29/f66 [750884,118267] 0 2023-12-08T20:28:21.466 INFO:tasks.workunit.client.0.smithi043.stdout:7/521: link d0/d6/c23 d0/d6/d17/d52/caa 0 2023-12-08T20:28:21.466 INFO:tasks.workunit.client.0.smithi043.stdout:0/718: mknod d2/d61/dc1/cee 0 2023-12-08T20:28:21.467 INFO:tasks.workunit.client.0.smithi043.stdout:5/486: mkdir d3/d7/de/d82/d95 0 2023-12-08T20:28:21.470 INFO:tasks.workunit.client.0.smithi043.stdout:8/469: rename d2/d20/d7d/d29/d68 to d2/d27/d2d/d31/d91 0 2023-12-08T20:28:21.471 INFO:tasks.workunit.client.0.smithi043.stdout:7/522: mkdir d0/d6/d17/dab 0 2023-12-08T20:28:21.472 INFO:tasks.workunit.client.0.smithi043.stdout:7/523: read d0/d2/d12/d19/f94 [545382,64263] 0 2023-12-08T20:28:21.473 INFO:tasks.workunit.client.0.smithi043.stdout:7/524: write d0/d2/fa4 [678416,81233] 0 2023-12-08T20:28:21.473 INFO:tasks.workunit.client.0.smithi043.stdout:5/487: creat d3/d7/d21/d51/d7d/f96 x:0 0 0 2023-12-08T20:28:21.475 INFO:tasks.workunit.client.0.smithi043.stdout:7/525: write d0/d2/d65/d99/f15 [3969502,62762] 0 2023-12-08T20:28:21.475 INFO:tasks.workunit.client.0.smithi043.stdout:8/470: rename d2/d20/d7d/d37/d5a/f62 to d2/d27/d2d/d31/f92 0 2023-12-08T20:28:21.475 INFO:tasks.workunit.client.0.smithi043.stdout:8/471: fsync d2/d6f/f82 0 2023-12-08T20:28:21.477 INFO:tasks.workunit.client.0.smithi043.stdout:5/488: mknod d3/d7/de/d43/c97 0 2023-12-08T20:28:21.479 INFO:tasks.workunit.client.0.smithi043.stdout:7/526: rmdir d0/d5b 39 2023-12-08T20:28:21.481 INFO:tasks.workunit.client.0.smithi043.stdout:0/719: dwrite d2/d3/d18/fc7 [0,4194304] 0 2023-12-08T20:28:21.481 INFO:tasks.workunit.client.0.smithi043.stdout:0/720: chown d2/d3/d18/d2b/da5/d5f/d79/d86/ldb 3 1 2023-12-08T20:28:21.482 INFO:tasks.workunit.client.0.smithi043.stdout:8/472: creat d2/d27/d2d/d31/d7f/f93 x:0 0 0 2023-12-08T20:28:21.483 INFO:tasks.workunit.client.0.smithi043.stdout:8/473: dread d2/d20/d7d/f61 [0,4194304] 0 2023-12-08T20:28:21.484 INFO:tasks.workunit.client.0.smithi043.stdout:7/527: mkdir d0/d6/d17/d52/dac 0 2023-12-08T20:28:21.484 INFO:tasks.workunit.client.0.smithi043.stdout:7/528: write d0/d2/d65/d99/f7d [1594064,104146] 0 2023-12-08T20:28:21.484 INFO:tasks.workunit.client.0.smithi043.stdout:8/474: write d2/d27/d2d/d31/f58 [91986,114261] 0 2023-12-08T20:28:21.484 INFO:tasks.workunit.client.0.smithi043.stdout:8/475: fdatasync d2/d20/d7d/d29/f6c 0 2023-12-08T20:28:21.490 INFO:tasks.workunit.client.0.smithi043.stdout:0/721: creat d2/d3/fef x:0 0 0 2023-12-08T20:28:21.493 INFO:tasks.workunit.client.0.smithi043.stdout:7/529: mknod d0/d6/d17/d52/dac/cad 0 2023-12-08T20:28:21.494 INFO:tasks.workunit.client.0.smithi043.stdout:7/530: dread - d0/f9b zero size 2023-12-08T20:28:21.494 INFO:tasks.workunit.client.0.smithi043.stdout:7/531: readlink d0/d2/d65/d99/l13 0 2023-12-08T20:28:21.494 INFO:tasks.workunit.client.0.smithi043.stdout:7/532: write d0/d2/d12/d19/d38/f58 [493302,78332] 0 2023-12-08T20:28:21.494 INFO:tasks.workunit.client.0.smithi043.stdout:7/533: dread - d0/d2/f8e zero size 2023-12-08T20:28:21.494 INFO:tasks.workunit.client.0.smithi043.stdout:0/722: getdents d2/d61/dc0 0 2023-12-08T20:28:21.498 INFO:tasks.workunit.client.0.smithi043.stdout:7/534: write d0/d6/d17/d54/f80 [3412452,54419] 0 2023-12-08T20:28:21.498 INFO:tasks.workunit.client.0.smithi043.stdout:7/535: read - d0/f9b zero size 2023-12-08T20:28:21.499 INFO:tasks.workunit.client.0.smithi043.stdout:7/536: rmdir d0/d2/d65/d99/d47 39 2023-12-08T20:28:21.500 INFO:tasks.workunit.client.0.smithi043.stdout:7/537: chown d0/d2/d12/l75 903348 1 2023-12-08T20:28:21.501 INFO:tasks.workunit.client.0.smithi043.stdout:7/538: creat d0/d2/d65/fae x:0 0 0 2023-12-08T20:28:21.504 INFO:tasks.workunit.client.0.smithi043.stdout:5/489: dwrite d3/d7/d19/d3f/f86 [0,4194304] 0 2023-12-08T20:28:21.505 INFO:tasks.workunit.client.0.smithi043.stdout:8/476: dwrite d2/d20/d7d/ff [0,4194304] 0 2023-12-08T20:28:21.505 INFO:tasks.workunit.client.0.smithi043.stdout:8/477: chown d2/d27/d2d/d31/d4f/c72 355403933 1 2023-12-08T20:28:21.507 INFO:tasks.workunit.client.0.smithi043.stdout:5/490: mkdir d3/d7/d21/d51/d5c/d81/d98 0 2023-12-08T20:28:21.509 INFO:tasks.workunit.client.0.smithi043.stdout:8/478: symlink d2/d20/d7d/d37/d5a/l94 0 2023-12-08T20:28:21.510 INFO:tasks.workunit.client.0.smithi043.stdout:8/479: creat d2/d27/d2d/d31/d91/f95 x:0 0 0 2023-12-08T20:28:21.510 INFO:tasks.workunit.client.0.smithi043.stdout:8/480: fsync d2/d20/d7d/d29/d30/f49 0 2023-12-08T20:28:21.514 INFO:tasks.workunit.client.0.smithi043.stdout:8/481: write d2/d20/d7d/f4d [7340371,95057] 0 2023-12-08T20:28:21.516 INFO:tasks.workunit.client.0.smithi043.stdout:0/723: dwrite d2/fca [0,4194304] 0 2023-12-08T20:28:21.517 INFO:tasks.workunit.client.0.smithi043.stdout:8/482: write d2/d20/d7d/d29/d30/f49 [1631971,7591] 0 2023-12-08T20:28:21.522 INFO:tasks.workunit.client.0.smithi043.stdout:8/483: creat d2/d20/d7d/d29/d30/d71/f96 x:0 0 0 2023-12-08T20:28:21.523 INFO:tasks.workunit.client.0.smithi043.stdout:5/491: dwrite d3/d7/d19/d3f/d52/f71 [0,4194304] 0 2023-12-08T20:28:21.524 INFO:tasks.workunit.client.0.smithi043.stdout:8/484: write d2/d20/d7d/f14 [265166,67070] 0 2023-12-08T20:28:21.531 INFO:tasks.workunit.client.0.smithi043.stdout:8/485: link d2/d27/d2d/d31/c42 d2/d20/d7d/d29/d30/d7c/c97 0 2023-12-08T20:28:21.534 INFO:tasks.workunit.client.0.smithi043.stdout:8/486: link d2/d27/d2d/c52 d2/d20/d7d/d29/d59/c98 0 2023-12-08T20:28:21.535 INFO:tasks.workunit.client.0.smithi043.stdout:8/487: mkdir d2/d27/d2d/d31/d99 0 2023-12-08T20:28:21.536 INFO:tasks.workunit.client.0.smithi043.stdout:8/488: truncate d2/f9 921078 0 2023-12-08T20:28:21.537 INFO:tasks.workunit.client.0.smithi043.stdout:8/489: rename d2/d20/d7d/d37/d5a/f81 to d2/d20/d7d/d37/d5a/f9a 0 2023-12-08T20:28:21.539 INFO:tasks.workunit.client.0.smithi043.stdout:8/490: dread d2/d20/d7d/d29/d59/f65 [0,4194304] 0 2023-12-08T20:28:21.540 INFO:tasks.workunit.client.0.smithi043.stdout:8/491: mkdir d2/d20/d7d/d29/d30/d60/d9b 0 2023-12-08T20:28:21.541 INFO:tasks.workunit.client.0.smithi043.stdout:8/492: symlink d2/l9c 0 2023-12-08T20:28:21.542 INFO:tasks.workunit.client.0.smithi043.stdout:0/724: dwrite d2/d4/f9f [0,4194304] 0 2023-12-08T20:28:21.542 INFO:tasks.workunit.client.0.smithi043.stdout:5/492: dwrite d3/d7/d21/d51/d5c/f74 [0,4194304] 0 2023-12-08T20:28:21.551 INFO:tasks.workunit.client.0.smithi043.stdout:5/493: mkdir d3/d73/d83/d99 0 2023-12-08T20:28:21.555 INFO:tasks.workunit.client.0.smithi043.stdout:5/494: dread d3/d7/d19/f59 [0,4194304] 0 2023-12-08T20:28:21.557 INFO:tasks.workunit.client.0.smithi043.stdout:8/493: dread d2/d20/d7d/d37/f1f [4194304,4194304] 0 2023-12-08T20:28:21.557 INFO:tasks.workunit.client.0.smithi043.stdout:8/494: truncate d2/d20/d7d/f46 2343555 0 2023-12-08T20:28:21.560 INFO:tasks.workunit.client.0.smithi043.stdout:5/495: creat d3/d7/d21/d72/f9a x:0 0 0 2023-12-08T20:28:21.560 INFO:tasks.workunit.client.0.smithi043.stdout:5/496: truncate d3/d7/de/f7b 877286 0 2023-12-08T20:28:21.560 INFO:tasks.workunit.client.0.smithi043.stdout:6/466: sync 2023-12-08T20:28:21.560 INFO:tasks.workunit.client.0.smithi043.stdout:5/497: write d3/d7/de/d43/f8a [489845,39605] 0 2023-12-08T20:28:21.560 INFO:tasks.workunit.client.0.smithi043.stdout:8/495: creat d2/f9d x:0 0 0 2023-12-08T20:28:21.564 INFO:tasks.workunit.client.0.smithi043.stdout:0/725: dwrite d2/d4/fd0 [0,4194304] 0 2023-12-08T20:28:21.564 INFO:tasks.workunit.client.0.smithi043.stdout:0/726: stat d2/d3/d18/d2b/da5/c7b 0 2023-12-08T20:28:21.564 INFO:tasks.workunit.client.0.smithi043.stdout:6/467: rename d0/d2/de/c99 to d0/d2/de/d4a/d56/ca1 0 2023-12-08T20:28:21.565 INFO:tasks.workunit.client.0.smithi043.stdout:6/468: truncate d0/d2/d14/f57 103319 0 2023-12-08T20:28:21.575 INFO:tasks.workunit.client.0.smithi043.stdout:6/469: dread d0/d2/f3e [0,4194304] 0 2023-12-08T20:28:21.575 INFO:tasks.workunit.client.0.smithi043.stdout:6/470: chown d0/d2/d14/d2c/f65 11296 1 2023-12-08T20:28:21.577 INFO:tasks.workunit.client.0.smithi043.stdout:6/471: link d0/d2/d14/d8/d47/d60/l79 d0/d2/de/d4a/d56/la2 0 2023-12-08T20:28:21.577 INFO:tasks.workunit.client.0.smithi043.stdout:6/472: chown d0/d2/d29/f83 6 1 2023-12-08T20:28:21.579 INFO:tasks.workunit.client.0.smithi043.stdout:5/498: dwrite f2 [4194304,4194304] 0 2023-12-08T20:28:21.582 INFO:tasks.workunit.client.0.smithi043.stdout:6/473: write d0/d2/d14/d2c/d22/d2a/f5a [1823887,127721] 0 2023-12-08T20:28:21.582 INFO:tasks.workunit.client.0.smithi043.stdout:6/474: stat d0/d2/d14/d20/d53 0 2023-12-08T20:28:21.582 INFO:tasks.workunit.client.0.smithi043.stdout:6/475: write d0/d2/d14/d2c/d22/f7e [393890,118530] 0 2023-12-08T20:28:21.583 INFO:tasks.workunit.client.0.smithi043.stdout:6/476: creat d0/d2/d14/d20/fa3 x:0 0 0 2023-12-08T20:28:21.585 INFO:tasks.workunit.client.0.smithi043.stdout:5/499: write d3/d7/d21/f2d [1369494,67746] 0 2023-12-08T20:28:21.585 INFO:tasks.workunit.client.0.smithi043.stdout:6/477: mkdir d0/d2/d14/d2c/d66/da4 0 2023-12-08T20:28:21.585 INFO:tasks.workunit.client.0.smithi043.stdout:6/478: getdents d0/d2/d14 0 2023-12-08T20:28:21.585 INFO:tasks.workunit.client.0.smithi043.stdout:6/479: chown d0/d2/d14/d2c/d22/f7e 1196235 1 2023-12-08T20:28:21.585 INFO:tasks.workunit.client.0.smithi043.stdout:6/480: mknod d0/d2/ca5 0 2023-12-08T20:28:21.586 INFO:tasks.workunit.client.0.smithi043.stdout:6/481: creat d0/d2/fa6 x:0 0 0 2023-12-08T20:28:21.587 INFO:tasks.workunit.client.0.smithi043.stdout:6/482: stat d0/d2/d14/d2c/d22 0 2023-12-08T20:28:21.587 INFO:tasks.workunit.client.0.smithi043.stdout:6/483: dread - d0/d2/fa6 zero size 2023-12-08T20:28:21.588 INFO:tasks.workunit.client.0.smithi043.stdout:6/484: unlink d0/d2/d14/c11 0 2023-12-08T20:28:21.589 INFO:tasks.workunit.client.0.smithi043.stdout:0/727: dwrite d2/d3/d18/d1e/d53/d7d/fbb [0,4194304] 0 2023-12-08T20:28:21.589 INFO:tasks.workunit.client.0.smithi043.stdout:0/728: readlink d2/d3/d18/d1e/l71 0 2023-12-08T20:28:21.589 INFO:tasks.workunit.client.0.smithi043.stdout:0/729: chown d2/d3/d18/d2b/da5/d8e 3 1 2023-12-08T20:28:21.589 INFO:tasks.workunit.client.0.smithi043.stdout:0/730: chown d2/c17 3 1 2023-12-08T20:28:21.589 INFO:tasks.workunit.client.0.smithi043.stdout:6/485: read d0/d2/d14/d20/d49/f62 [851485,92694] 0 2023-12-08T20:28:21.590 INFO:tasks.workunit.client.0.smithi043.stdout:5/500: dread d3/d7/de/f1d [0,4194304] 0 2023-12-08T20:28:21.590 INFO:tasks.workunit.client.0.smithi043.stdout:0/731: mkdir d2/d3/d18/d2b/da5/d5f/df0 0 2023-12-08T20:28:21.590 INFO:tasks.workunit.client.0.smithi043.stdout:0/732: chown d2/d61/ldf 43531 1 2023-12-08T20:28:21.591 INFO:tasks.workunit.client.0.smithi043.stdout:5/501: mknod d3/d73/d83/c9b 0 2023-12-08T20:28:21.591 INFO:tasks.workunit.client.0.smithi043.stdout:5/502: chown d3/d7/d19/f30 6704 1 2023-12-08T20:28:21.591 INFO:tasks.workunit.client.0.smithi043.stdout:0/733: write d2/d3/d6/f44 [3651225,10149] 0 2023-12-08T20:28:21.591 INFO:tasks.workunit.client.0.smithi043.stdout:0/734: chown d2/l13 364129 1 2023-12-08T20:28:21.592 INFO:tasks.workunit.client.0.smithi043.stdout:0/735: creat d2/d61/ff1 x:0 0 0 2023-12-08T20:28:21.592 INFO:tasks.workunit.client.0.smithi043.stdout:0/736: dread - d2/d61/d67/f95 zero size 2023-12-08T20:28:21.594 INFO:tasks.workunit.client.0.smithi043.stdout:0/737: symlink d2/d3/d18/d1e/d53/d7d/lf2 0 2023-12-08T20:28:21.596 INFO:tasks.workunit.client.0.smithi043.stdout:0/738: link d2/d3/f70 d2/d3/d18/d1e/d53/d7d/ff3 0 2023-12-08T20:28:21.597 INFO:tasks.workunit.client.0.smithi043.stdout:0/739: read d2/d61/fce [581182,8014] 0 2023-12-08T20:28:21.602 INFO:tasks.workunit.client.0.smithi043.stdout:0/740: getdents d2/d3/d18/d2b/da5/da3 0 2023-12-08T20:28:21.602 INFO:tasks.workunit.client.0.smithi043.stdout:0/741: dread - d2/d3/d18/d2b/fa2 zero size 2023-12-08T20:28:21.603 INFO:tasks.workunit.client.0.smithi043.stdout:0/742: symlink d2/d3/d18/d2b/da5/d8e/lf4 0 2023-12-08T20:28:21.605 INFO:tasks.workunit.client.0.smithi043.stdout:0/743: mkdir d2/d3/d18/d1e/df5 0 2023-12-08T20:28:21.605 INFO:tasks.workunit.client.0.smithi043.stdout:6/486: dwrite d0/d2/d14/d20/d53/f5e [0,4194304] 0 2023-12-08T20:28:21.606 INFO:tasks.workunit.client.0.smithi043.stdout:0/744: mknod d2/d3/d18/d2b/cf6 0 2023-12-08T20:28:21.607 INFO:tasks.workunit.client.0.smithi043.stdout:5/503: dwrite d3/d7/de/d82/f8c [0,4194304] 0 2023-12-08T20:28:21.609 INFO:tasks.workunit.client.0.smithi043.stdout:6/487: dread d0/d2/d29/f52 [0,4194304] 0 2023-12-08T20:28:21.610 INFO:tasks.workunit.client.0.smithi043.stdout:6/488: chown d0/d2/de/f40 173404689 1 2023-12-08T20:28:21.610 INFO:tasks.workunit.client.0.smithi043.stdout:6/489: chown d0/d2/d14/d8/c2e 0 1 2023-12-08T20:28:21.612 INFO:tasks.workunit.client.0.smithi043.stdout:6/490: creat d0/d2/d14/d2c/d22/d3f/d45/d69/fa7 x:0 0 0 2023-12-08T20:28:21.622 INFO:tasks.workunit.client.0.smithi043.stdout:6/491: dread d0/d2/d14/d20/d3c/d50/f77 [0,4194304] 0 2023-12-08T20:28:21.622 INFO:tasks.workunit.client.0.smithi043.stdout:6/492: readlink d0/d2/d14/d20/la0 0 2023-12-08T20:28:21.622 INFO:tasks.workunit.client.0.smithi043.stdout:6/493: dread - d0/d2/d14/d8/f9f zero size 2023-12-08T20:28:21.622 INFO:tasks.workunit.client.0.smithi043.stdout:0/745: dwrite d2/d3/d18/fc7 [0,4194304] 0 2023-12-08T20:28:21.623 INFO:tasks.workunit.client.0.smithi043.stdout:6/494: mknod d0/d2/d14/d8/d47/ca8 0 2023-12-08T20:28:21.624 INFO:tasks.workunit.client.0.smithi043.stdout:0/746: creat d2/d61/d8a/ff7 x:0 0 0 2023-12-08T20:28:21.624 INFO:tasks.workunit.client.0.smithi043.stdout:0/747: write d2/d3/d18/d2b/da5/fb0 [527446,121557] 0 2023-12-08T20:28:21.625 INFO:tasks.workunit.client.0.smithi043.stdout:0/748: creat d2/d3/d18/d2b/da5/d3f/ff8 x:0 0 0 2023-12-08T20:28:21.625 INFO:tasks.workunit.client.0.smithi043.stdout:0/749: write d2/d3/d18/d2b/fa7 [1374822,120540] 0 2023-12-08T20:28:21.626 INFO:tasks.workunit.client.0.smithi043.stdout:0/750: write d2/d3/d18/d1e/d53/f64 [502293,131072] 0 2023-12-08T20:28:21.651 INFO:tasks.workunit.client.0.smithi043.stdout:0/751: dwrite d2/d3/d18/fbf [0,4194304] 0 2023-12-08T20:28:21.651 INFO:tasks.workunit.client.0.smithi043.stdout:0/752: stat d2/d61/d8a/fb7 0 2023-12-08T20:28:21.651 INFO:tasks.workunit.client.0.smithi043.stdout:6/495: dwrite d0/d2/d14/d2c/d22/d2a/f5a [0,4194304] 0 2023-12-08T20:28:21.654 INFO:tasks.workunit.client.0.smithi043.stdout:0/753: getdents d2/d61/d67 0 2023-12-08T20:28:21.655 INFO:tasks.workunit.client.0.smithi043.stdout:6/496: mknod d0/d2/d14/d20/d3c/d6c/ca9 0 2023-12-08T20:28:21.655 INFO:tasks.workunit.client.0.smithi043.stdout:6/497: write d0/d2/d14/d20/d3c/f9c [83933,88545] 0 2023-12-08T20:28:21.656 INFO:tasks.workunit.client.0.smithi043.stdout:0/754: mknod d2/d3/d18/cf9 0 2023-12-08T20:28:21.661 INFO:tasks.workunit.client.0.smithi043.stdout:6/498: rename d0/d2/de/d4a/d56/f63 to d0/d2/d14/d2c/d22/d2a/faa 0 2023-12-08T20:28:21.663 INFO:tasks.workunit.client.0.smithi043.stdout:0/755: rmdir d2/d61/d8a 39 2023-12-08T20:28:21.665 INFO:tasks.workunit.client.0.smithi043.stdout:0/756: creat d2/d61/ffa x:0 0 0 2023-12-08T20:28:21.665 INFO:tasks.workunit.client.0.smithi043.stdout:0/757: fsync d2/d61/d8a/fb7 0 2023-12-08T20:28:21.665 INFO:tasks.workunit.client.0.smithi043.stdout:0/758: chown d2/c17 638660070 1 2023-12-08T20:28:21.665 INFO:tasks.workunit.client.0.smithi043.stdout:0/759: fsync d2/d3/d18/d1e/d53/d7d/fbb 0 2023-12-08T20:28:21.666 INFO:tasks.workunit.client.0.smithi043.stdout:0/760: creat d2/d3/d18/d2b/da5/d5f/df0/ffb x:0 0 0 2023-12-08T20:28:21.697 INFO:tasks.workunit.client.0.smithi043.stdout:6/499: dwrite d0/d2/d14/d8/d47/d60/f8d [0,4194304] 0 2023-12-08T20:28:21.697 INFO:tasks.workunit.client.0.smithi043.stdout:0/761: dwrite d2/d3/d6/d39/d5e/f65 [0,4194304] 0 2023-12-08T20:28:21.698 INFO:tasks.workunit.client.0.smithi043.stdout:6/500: symlink d0/d2/d14/d2c/d22/d3f/d45/lab 0 2023-12-08T20:28:21.701 INFO:tasks.workunit.client.0.smithi043.stdout:0/762: creat d2/d3/d18/d2b/da5/ffc x:0 0 0 2023-12-08T20:28:21.701 INFO:tasks.workunit.client.0.smithi043.stdout:0/763: fsync d2/d61/d8a/ff7 0 2023-12-08T20:28:21.704 INFO:tasks.workunit.client.0.smithi043.stdout:0/764: unlink d2/d3/d6/d39/d5e/le1 0 2023-12-08T20:28:21.729 INFO:tasks.workunit.client.0.smithi043.stdout:6/501: dwrite d0/f7f [0,4194304] 0 2023-12-08T20:28:21.730 INFO:tasks.workunit.client.0.smithi043.stdout:6/502: rename d0/d2/d14/d20 to d0/d2/d14/d20/d3c/d50/dac 22 2023-12-08T20:28:21.730 INFO:tasks.workunit.client.0.smithi043.stdout:0/765: dwrite d2/d3/d6/d39/f8d [0,4194304] 0 2023-12-08T20:28:21.731 INFO:tasks.workunit.client.0.smithi043.stdout:6/503: rename d0/d2/d14/d2c/d22/d2a/c84 to d0/d2/d14/d8/d47/cad 0 2023-12-08T20:28:21.731 INFO:tasks.workunit.client.0.smithi043.stdout:6/504: write d0/d2/de/d4a/d56/d59/f9a [801511,5587] 0 2023-12-08T20:28:21.732 INFO:tasks.workunit.client.0.smithi043.stdout:6/505: write d0/d2/d14/d8/f43 [2113176,53775] 0 2023-12-08T20:28:21.733 INFO:tasks.workunit.client.0.smithi043.stdout:0/766: creat d2/d4/ffd x:0 0 0 2023-12-08T20:28:21.733 INFO:tasks.workunit.client.0.smithi043.stdout:6/506: dread d0/d2/f12 [0,4194304] 0 2023-12-08T20:28:21.735 INFO:tasks.workunit.client.0.smithi043.stdout:0/767: mknod d2/d3/d18/d2b/da5/da3/cfe 0 2023-12-08T20:28:21.737 INFO:tasks.workunit.client.0.smithi043.stdout:6/507: rename d0/d2/d14/d20/fa3 to d0/d2/fae 0 2023-12-08T20:28:21.738 INFO:tasks.workunit.client.0.smithi043.stdout:6/508: symlink d0/laf 0 2023-12-08T20:28:21.738 INFO:tasks.workunit.client.0.smithi043.stdout:6/509: readlink d0/d2/de/l3a 0 2023-12-08T20:28:21.741 INFO:tasks.workunit.client.0.smithi043.stdout:6/510: dread d0/d2/d14/d8/d47/f80 [0,4194304] 0 2023-12-08T20:28:21.741 INFO:tasks.workunit.client.0.smithi043.stdout:6/511: dread - d0/d2/d14/d20/d3c/d6c/f9e zero size 2023-12-08T20:28:21.741 INFO:tasks.workunit.client.0.smithi043.stdout:6/512: chown d0/d2/d14/d2c/d66/da4 26574329 1 2023-12-08T20:28:21.742 INFO:tasks.workunit.client.0.smithi043.stdout:6/513: creat d0/d2/d14/d20/d3c/d6c/fb0 x:0 0 0 2023-12-08T20:28:21.744 INFO:tasks.workunit.client.0.smithi043.stdout:6/514: unlink d0/d2/d14/f57 0 2023-12-08T20:28:21.744 INFO:tasks.workunit.client.0.smithi043.stdout:6/515: stat d0/f54 0 2023-12-08T20:28:21.752 INFO:tasks.workunit.client.0.smithi043.stdout:0/768: dwrite d2/d61/d67/d9e/fd5 [0,4194304] 0 2023-12-08T20:28:21.753 INFO:tasks.workunit.client.0.smithi043.stdout:0/769: readlink d2/d3/d6/d39/d83/l84 0 2023-12-08T20:28:21.754 INFO:tasks.workunit.client.0.smithi043.stdout:0/770: dread d2/d4/fe [0,4194304] 0 2023-12-08T20:28:21.755 INFO:tasks.workunit.client.0.smithi043.stdout:0/771: dread - d2/d3/d18/d2b/fd9 zero size 2023-12-08T20:28:21.755 INFO:tasks.workunit.client.0.smithi043.stdout:0/772: truncate d2/d3/d18/d2b/da5/da3/fe9 425486 0 2023-12-08T20:28:21.755 INFO:tasks.workunit.client.0.smithi043.stdout:0/773: write d2/fca [5020545,80640] 0 2023-12-08T20:28:21.757 INFO:tasks.workunit.client.0.smithi043.stdout:0/774: rename d2/d3/d18/d2b/da5/c45 to d2/d3/d6/d39/d63/da6/dae/cff 0 2023-12-08T20:28:21.758 INFO:tasks.workunit.client.0.smithi043.stdout:0/775: truncate d2/d4/f3d 2206828 0 2023-12-08T20:28:21.759 INFO:tasks.workunit.client.0.smithi043.stdout:0/776: mkdir d2/d61/d8a/d100 0 2023-12-08T20:28:21.760 INFO:tasks.workunit.client.0.smithi043.stdout:0/777: symlink d2/d3/d6/d39/d63/da6/dae/l101 0 2023-12-08T20:28:21.763 INFO:tasks.workunit.client.0.smithi043.stdout:0/778: unlink d2/d61/d67/l99 0 2023-12-08T20:28:21.763 INFO:tasks.workunit.client.0.smithi043.stdout:0/779: truncate d2/d3/d18/d2b/faa 986688 0 2023-12-08T20:28:21.764 INFO:tasks.workunit.client.0.smithi043.stdout:0/780: write d2/d3/d6/d39/f8d [395199,67573] 0 2023-12-08T20:28:21.764 INFO:tasks.workunit.client.0.smithi043.stdout:0/781: chown d2/d61 830703106 1 2023-12-08T20:28:21.764 INFO:tasks.workunit.client.0.smithi043.stdout:0/782: truncate d2/d61/d67/f95 229669 0 2023-12-08T20:28:21.764 INFO:tasks.workunit.client.0.smithi043.stdout:0/783: mknod d2/d3/d18/d2b/da5/d5f/c102 0 2023-12-08T20:28:21.765 INFO:tasks.workunit.client.0.smithi043.stdout:0/784: creat d2/d61/dc0/f103 x:0 0 0 2023-12-08T20:28:21.767 INFO:tasks.workunit.client.0.smithi043.stdout:0/785: creat d2/d3/d18/d1e/d88/f104 x:0 0 0 2023-12-08T20:28:21.775 INFO:tasks.workunit.client.0.smithi043.stdout:0/786: dread d2/d3/d6/d39/d83/fb5 [0,4194304] 0 2023-12-08T20:28:21.775 INFO:tasks.workunit.client.0.smithi043.stdout:0/787: stat d2/d3/d18/d2b/da5/da3/fe9 0 2023-12-08T20:28:21.778 INFO:tasks.workunit.client.0.smithi043.stdout:0/788: rmdir d2/d3/d6/d39/d63/da6/dcd 0 2023-12-08T20:28:21.778 INFO:tasks.workunit.client.0.smithi043.stdout:0/789: fsync d2/d3/d18/d2b/fe2 0 2023-12-08T20:28:21.855 INFO:tasks.workunit.client.0.smithi043.stdout:3/493: sync 2023-12-08T20:28:21.855 INFO:tasks.workunit.client.0.smithi043.stdout:9/489: sync 2023-12-08T20:28:21.855 INFO:tasks.workunit.client.0.smithi043.stdout:3/494: chown d1/d1c/f53 181 1 2023-12-08T20:28:21.856 INFO:tasks.workunit.client.0.smithi043.stdout:3/495: rmdir d1/d9/d38/d30 39 2023-12-08T20:28:21.857 INFO:tasks.workunit.client.0.smithi043.stdout:3/496: creat d1/d1c/d29/fa5 x:0 0 0 2023-12-08T20:28:21.858 INFO:tasks.workunit.client.0.smithi043.stdout:3/497: mkdir d1/d25/d2a/d85/da6 0 2023-12-08T20:28:21.870 INFO:tasks.workunit.client.0.smithi043.stdout:3/498: dread d1/d9/fd [8388608,4194304] 0 2023-12-08T20:28:21.870 INFO:tasks.workunit.client.0.smithi043.stdout:3/499: mkdir d1/d9/d2d/d91/da7 0 2023-12-08T20:28:21.870 INFO:tasks.workunit.client.0.smithi043.stdout:3/500: symlink d1/d25/d84/la8 0 2023-12-08T20:28:21.871 INFO:tasks.workunit.client.0.smithi043.stdout:3/501: getdents d1/d9/d38/d4f 0 2023-12-08T20:28:21.872 INFO:tasks.workunit.client.0.smithi043.stdout:3/502: getdents d1/d1c/d2c/d5f/d80 0 2023-12-08T20:28:21.873 INFO:tasks.workunit.client.0.smithi043.stdout:3/503: write d1/d9/d38/f3d [2861326,35590] 0 2023-12-08T20:28:21.873 INFO:tasks.workunit.client.0.smithi043.stdout:3/504: stat d1/d9/d38/d4f/f79 0 2023-12-08T20:28:21.874 INFO:tasks.workunit.client.0.smithi043.stdout:9/490: dwrite d0/d3d/f83 [0,4194304] 0 2023-12-08T20:28:21.875 INFO:tasks.workunit.client.0.smithi043.stdout:3/505: link d1/d1c/d29/f5c d1/d9/d2d/fa9 0 2023-12-08T20:28:21.875 INFO:tasks.workunit.client.0.smithi043.stdout:9/491: dread d0/d3d/f45 [0,4194304] 0 2023-12-08T20:28:21.880 INFO:tasks.workunit.client.0.smithi043.stdout:3/506: mknod d1/caa 0 2023-12-08T20:28:21.881 INFO:tasks.workunit.client.0.smithi043.stdout:3/507: creat d1/d9/d38/fab x:0 0 0 2023-12-08T20:28:21.882 INFO:tasks.workunit.client.0.smithi043.stdout:3/508: getdents d1/d25/d2a/d45 0 2023-12-08T20:28:21.883 INFO:tasks.workunit.client.0.smithi043.stdout:3/509: link d1/d9/df/d6e/c82 d1/d9/cac 0 2023-12-08T20:28:21.884 INFO:tasks.workunit.client.0.smithi043.stdout:3/510: read d1/d25/f31 [215972,6006] 0 2023-12-08T20:28:21.885 INFO:tasks.workunit.client.0.smithi043.stdout:3/511: truncate d1/d9/d2d/d66/f94 208557 0 2023-12-08T20:28:21.886 INFO:tasks.workunit.client.0.smithi043.stdout:3/512: mkdir d1/d25/d2a/d85/da6/dad 0 2023-12-08T20:28:21.887 INFO:tasks.workunit.client.0.smithi043.stdout:3/513: mknod d1/d25/d84/d9a/cae 0 2023-12-08T20:28:21.887 INFO:tasks.workunit.client.0.smithi043.stdout:3/514: chown d1/d25/c93 2 1 2023-12-08T20:28:21.897 INFO:tasks.workunit.client.0.smithi043.stdout:3/515: dread d1/d25/d84/d9a/f7a [0,4194304] 0 2023-12-08T20:28:21.897 INFO:tasks.workunit.client.0.smithi043.stdout:9/492: dwrite d0/d3d/d4b/f71 [0,4194304] 0 2023-12-08T20:28:21.898 INFO:tasks.workunit.client.0.smithi043.stdout:3/516: write d1/d9/d38/d33/f69 [2540260,49242] 0 2023-12-08T20:28:21.898 INFO:tasks.workunit.client.0.smithi043.stdout:9/493: read d0/f1e [851265,31421] 0 2023-12-08T20:28:21.898 INFO:tasks.workunit.client.0.smithi043.stdout:9/494: readlink d0/l18 0 2023-12-08T20:28:21.898 INFO:tasks.workunit.client.0.smithi043.stdout:3/517: dread - d1/d9/d2d/d66/f98 zero size 2023-12-08T20:28:21.899 INFO:tasks.workunit.client.0.smithi043.stdout:3/518: write d1/d9/fd [11004034,77366] 0 2023-12-08T20:28:21.899 INFO:tasks.workunit.client.0.smithi043.stdout:9/495: symlink d0/d5e/d37/d6b/l9b 0 2023-12-08T20:28:21.899 INFO:tasks.workunit.client.0.smithi043.stdout:9/496: mknod d0/d3d/d8a/d9a/c9c 0 2023-12-08T20:28:21.901 INFO:tasks.workunit.client.0.smithi043.stdout:9/497: write d0/d5e/f3c [658845,104016] 0 2023-12-08T20:28:21.901 INFO:tasks.workunit.client.0.smithi043.stdout:9/498: stat d0/cd 0 2023-12-08T20:28:21.902 INFO:tasks.workunit.client.0.smithi043.stdout:3/519: dread d1/d9/d2d/d42/f95 [0,4194304] 0 2023-12-08T20:28:21.902 INFO:tasks.workunit.client.0.smithi043.stdout:3/520: fdatasync d1/d9/d38/d33/f5d 0 2023-12-08T20:28:21.902 INFO:tasks.workunit.client.0.smithi043.stdout:9/499: rename d0/d3d/d8a/d9a/c9c to d0/d3d/d4b/c9d 0 2023-12-08T20:28:21.903 INFO:tasks.workunit.client.0.smithi043.stdout:9/500: read d0/f51 [745847,98022] 0 2023-12-08T20:28:21.904 INFO:tasks.workunit.client.0.smithi043.stdout:9/501: creat d0/d21/f9e x:0 0 0 2023-12-08T20:28:21.904 INFO:tasks.workunit.client.0.smithi043.stdout:9/502: chown d0/d5e/c6f 816736823 1 2023-12-08T20:28:21.904 INFO:tasks.workunit.client.0.smithi043.stdout:3/521: write d1/d1c/f53 [3318282,81986] 0 2023-12-08T20:28:21.904 INFO:tasks.workunit.client.0.smithi043.stdout:9/503: write d0/d21/f87 [91995,25114] 0 2023-12-08T20:28:21.905 INFO:tasks.workunit.client.0.smithi043.stdout:3/522: creat d1/d1c/d2c/d5f/faf x:0 0 0 2023-12-08T20:28:21.908 INFO:tasks.workunit.client.0.smithi043.stdout:3/523: fsync d1/d1c/f53 0 2023-12-08T20:28:21.908 INFO:tasks.workunit.client.0.smithi043.stdout:3/524: chown d1/d9 281734573 1 2023-12-08T20:28:21.908 INFO:tasks.workunit.client.0.smithi043.stdout:3/525: fsync d1/d1c/f22 0 2023-12-08T20:28:21.908 INFO:tasks.workunit.client.0.smithi043.stdout:3/526: chown d1/d1c/d29/la3 24420612 1 2023-12-08T20:28:21.908 INFO:tasks.workunit.client.0.smithi043.stdout:3/527: stat d1/d25/f24 0 2023-12-08T20:28:21.908 INFO:tasks.workunit.client.0.smithi043.stdout:3/528: symlink d1/d1c/d8b/lb0 0 2023-12-08T20:28:21.910 INFO:tasks.workunit.client.0.smithi043.stdout:3/529: rmdir d1/d25/d2a/d85 39 2023-12-08T20:28:21.910 INFO:tasks.workunit.client.0.smithi043.stdout:3/530: write d1/d25/d2a/d85/f92 [8706093,13173] 0 2023-12-08T20:28:21.910 INFO:tasks.workunit.client.0.smithi043.stdout:3/531: chown d1/d1c/d2c/d7f 35317 1 2023-12-08T20:28:21.910 INFO:tasks.workunit.client.0.smithi043.stdout:3/532: dread - d1/d9/d38/d4f/f8c zero size 2023-12-08T20:28:21.910 INFO:tasks.workunit.client.0.smithi043.stdout:3/533: chown d1/d9/d2d/f70 7 1 2023-12-08T20:28:21.910 INFO:tasks.workunit.client.0.smithi043.stdout:3/534: read d1/d9/f1a [2070576,42402] 0 2023-12-08T20:28:21.911 INFO:tasks.workunit.client.0.smithi043.stdout:3/535: dread - d1/d1c/d2c/d5f/faf zero size 2023-12-08T20:28:21.911 INFO:tasks.workunit.client.0.smithi043.stdout:3/536: symlink d1/d9/lb1 0 2023-12-08T20:28:21.912 INFO:tasks.workunit.client.0.smithi043.stdout:3/537: truncate d1/d9/f48 3268963 0 2023-12-08T20:28:21.913 INFO:tasks.workunit.client.0.smithi043.stdout:3/538: symlink d1/d1c/d2c/d7f/lb2 0 2023-12-08T20:28:21.918 INFO:tasks.workunit.client.0.smithi043.stdout:3/539: rmdir d1/d1c/d2c/d5f 39 2023-12-08T20:28:21.919 INFO:tasks.workunit.client.0.smithi043.stdout:3/540: rmdir d1/d25/d84 39 2023-12-08T20:28:21.921 INFO:tasks.workunit.client.0.smithi043.stdout:9/504: write d0/f6 [1639059,74623] 0 2023-12-08T20:28:21.925 INFO:tasks.workunit.client.0.smithi043.stdout:9/505: unlink d0/d3d/d4b/f7c 0 2023-12-08T20:28:21.925 INFO:tasks.workunit.client.0.smithi043.stdout:9/506: write d0/f1b [4272097,27428] 0 2023-12-08T20:28:21.926 INFO:tasks.workunit.client.0.smithi043.stdout:9/507: mknod d0/d5e/d37/d6b/c9f 0 2023-12-08T20:28:21.927 INFO:tasks.workunit.client.0.smithi043.stdout:9/508: rename d0/d21/f58 to d0/d5e/d37/d6b/d94/fa0 0 2023-12-08T20:28:21.928 INFO:tasks.workunit.client.0.smithi043.stdout:9/509: mknod d0/d5e/d37/d6b/d94/ca1 0 2023-12-08T20:28:21.929 INFO:tasks.workunit.client.0.smithi043.stdout:9/510: readlink d0/d5e/l3b 0 2023-12-08T20:28:21.935 INFO:tasks.workunit.client.0.smithi043.stdout:9/511: dread d0/f6 [0,4194304] 0 2023-12-08T20:28:21.935 INFO:tasks.workunit.client.0.smithi043.stdout:9/512: write d0/f96 [460720,66024] 0 2023-12-08T20:28:21.938 INFO:tasks.workunit.client.0.smithi043.stdout:9/513: dread d0/d5e/d37/d6b/d94/fa0 [0,4194304] 0 2023-12-08T20:28:21.940 INFO:tasks.workunit.client.0.smithi043.stdout:9/514: mkdir d0/d3d/d4b/da2 0 2023-12-08T20:28:21.941 INFO:tasks.workunit.client.0.smithi043.stdout:9/515: creat d0/d21/d80/d97/fa3 x:0 0 0 2023-12-08T20:28:21.942 INFO:tasks.workunit.client.0.smithi043.stdout:9/516: rename d0/d21/f55 to d0/d5e/fa4 0 2023-12-08T20:28:21.951 INFO:tasks.workunit.client.0.smithi043.stdout:9/517: dread d0/d3d/f48 [0,4194304] 0 2023-12-08T20:28:21.951 INFO:tasks.workunit.client.0.smithi043.stdout:9/518: chown d0/cc 4 1 2023-12-08T20:28:21.952 INFO:tasks.workunit.client.0.smithi043.stdout:9/519: creat d0/fa5 x:0 0 0 2023-12-08T20:28:21.969 INFO:tasks.workunit.client.0.smithi043.stdout:9/520: dwrite d0/d5e/f59 [0,4194304] 0 2023-12-08T20:28:21.969 INFO:tasks.workunit.client.0.smithi043.stdout:9/521: chown d0/d5e/d37/d6b/d94/ca1 195531861 1 2023-12-08T20:28:21.969 INFO:tasks.workunit.client.0.smithi043.stdout:9/522: stat d0/d3d/d4b/c64 0 2023-12-08T20:28:21.969 INFO:tasks.workunit.client.0.smithi043.stdout:9/523: write d0/d5e/fa4 [268397,127317] 0 2023-12-08T20:28:21.970 INFO:tasks.workunit.client.0.smithi043.stdout:9/524: symlink d0/d5e/d37/d6b/d6c/la6 0 2023-12-08T20:28:21.970 INFO:tasks.workunit.client.0.smithi043.stdout:9/525: dread - d0/d5e/d37/d6b/f7e zero size 2023-12-08T20:28:21.971 INFO:tasks.workunit.client.0.smithi043.stdout:9/526: symlink d0/d3d/d8a/la7 0 2023-12-08T20:28:21.971 INFO:tasks.workunit.client.0.smithi043.stdout:9/527: truncate d0/d5e/d37/d6b/d76/f68 12705 0 2023-12-08T20:28:21.971 INFO:tasks.workunit.client.0.smithi043.stdout:9/528: read d0/d21/f56 [56761,92559] 0 2023-12-08T20:28:21.986 INFO:tasks.workunit.client.0.smithi043.stdout:9/529: dwrite d0/d21/f26 [0,4194304] 0 2023-12-08T20:28:21.986 INFO:tasks.workunit.client.0.smithi043.stdout:9/530: dread - d0/d21/f9e zero size 2023-12-08T20:28:21.986 INFO:tasks.workunit.client.0.smithi043.stdout:9/531: fsync d0/d5e/f81 0 2023-12-08T20:28:21.986 INFO:tasks.workunit.client.0.smithi043.stdout:9/532: write d0/d5e/f57 [3516024,88896] 0 2023-12-08T20:28:21.988 INFO:tasks.workunit.client.0.smithi043.stdout:9/533: write d0/d5e/f33 [5798224,3085] 0 2023-12-08T20:28:21.989 INFO:tasks.workunit.client.0.smithi043.stdout:9/534: rename d0/d3d/d4b/c64 to d0/d3d/d4b/ca8 0 2023-12-08T20:28:21.994 INFO:tasks.workunit.client.0.smithi043.stdout:9/535: dread d0/d3d/f72 [0,4194304] 0 2023-12-08T20:28:21.995 INFO:tasks.workunit.client.0.smithi043.stdout:9/536: mknod d0/d5e/d37/d6b/d6c/ca9 0 2023-12-08T20:28:21.996 INFO:tasks.workunit.client.0.smithi043.stdout:9/537: creat d0/d5e/d37/d6b/d6c/faa x:0 0 0 2023-12-08T20:28:21.997 INFO:tasks.workunit.client.0.smithi043.stdout:9/538: symlink d0/d3d/d4b/d5c/lab 0 2023-12-08T20:28:22.001 INFO:tasks.workunit.client.0.smithi043.stdout:1/529: sync 2023-12-08T20:28:22.001 INFO:tasks.workunit.client.0.smithi043.stdout:4/536: sync 2023-12-08T20:28:22.001 INFO:tasks.workunit.client.0.smithi043.stdout:2/755: sync 2023-12-08T20:28:22.002 INFO:tasks.workunit.client.0.smithi043.stdout:2/756: stat d0/d26/d53/fbb 0 2023-12-08T20:28:22.002 INFO:tasks.workunit.client.0.smithi043.stdout:4/537: stat d1/d14/d25/d39/d3f/d3c/d80/f82 0 2023-12-08T20:28:22.002 INFO:tasks.workunit.client.0.smithi043.stdout:2/757: symlink d0/d26/dbc/lf5 0 2023-12-08T20:28:22.034 INFO:tasks.workunit.client.0.smithi043.stdout:2/758: dwrite d0/d26/d53/fd1 [0,4194304] 0 2023-12-08T20:28:22.034 INFO:tasks.workunit.client.0.smithi043.stdout:1/530: dwrite d1/d16/d21/d25/d35/fb0 [0,4194304] 0 2023-12-08T20:28:22.034 INFO:tasks.workunit.client.0.smithi043.stdout:1/531: write d1/d16/d7e/f9c [598099,33303] 0 2023-12-08T20:28:22.034 INFO:tasks.workunit.client.0.smithi043.stdout:1/532: write d1/d16/d1c/f50 [4600822,73768] 0 2023-12-08T20:28:22.034 INFO:tasks.workunit.client.0.smithi043.stdout:1/533: truncate d1/d16/d21/d25/d35/f85 1161821 0 2023-12-08T20:28:22.034 INFO:tasks.workunit.client.0.smithi043.stdout:4/538: dwrite d1/d14/f48 [0,4194304] 0 2023-12-08T20:28:22.034 INFO:tasks.workunit.client.0.smithi043.stdout:4/539: chown d1/d14/d25/d77/da4 1716282 1 2023-12-08T20:28:22.036 INFO:tasks.workunit.client.0.smithi043.stdout:2/759: getdents d0/d2b/d4e 0 2023-12-08T20:28:22.036 INFO:tasks.workunit.client.0.smithi043.stdout:2/760: write d0/db/d18/d66/f77 [154663,103221] 0 2023-12-08T20:28:22.037 INFO:tasks.workunit.client.0.smithi043.stdout:4/540: write d1/d14/d25/d39/d3f/d3c/d41/d65/f7d [68522,13555] 0 2023-12-08T20:28:22.037 INFO:tasks.workunit.client.0.smithi043.stdout:4/541: fsync d1/d14/f45 0 2023-12-08T20:28:22.037 INFO:tasks.workunit.client.0.smithi043.stdout:1/534: mkdir d1/d16/d21/d25/d3e/d77/d9f/dc3 0 2023-12-08T20:28:22.042 INFO:tasks.workunit.client.0.smithi043.stdout:2/761: creat d0/dd4/ff6 x:0 0 0 2023-12-08T20:28:22.042 INFO:tasks.workunit.client.0.smithi043.stdout:4/542: mknod d1/cb7 0 2023-12-08T20:28:22.042 INFO:tasks.workunit.client.0.smithi043.stdout:2/762: fdatasync d0/db/d18/f4b 0 2023-12-08T20:28:22.042 INFO:tasks.workunit.client.0.smithi043.stdout:2/763: readlink d0/d26/dbc/d38/le3 0 2023-12-08T20:28:22.042 INFO:tasks.workunit.client.0.smithi043.stdout:1/535: unlink d1/d16/d21/d60/l6d 0 2023-12-08T20:28:22.043 INFO:tasks.workunit.client.0.smithi043.stdout:1/536: stat d1/d16/c17 0 2023-12-08T20:28:22.043 INFO:tasks.workunit.client.0.smithi043.stdout:1/537: truncate d1/d16/d21/d25/d35/f9d 566858 0 2023-12-08T20:28:22.043 INFO:tasks.workunit.client.0.smithi043.stdout:1/538: read - d1/d16/d21/d25/d35/f9e zero size 2023-12-08T20:28:22.043 INFO:tasks.workunit.client.0.smithi043.stdout:2/764: dread d0/d2b/d4e/fc6 [0,4194304] 0 2023-12-08T20:28:22.043 INFO:tasks.workunit.client.0.smithi043.stdout:2/765: fsync d0/d26/d53/f75 0 2023-12-08T20:28:22.044 INFO:tasks.workunit.client.0.smithi043.stdout:4/543: creat d1/d14/d25/d39/d3f/d3c/d41/fb8 x:0 0 0 2023-12-08T20:28:22.044 INFO:tasks.workunit.client.0.smithi043.stdout:4/544: fdatasync d1/d14/d25/d39/d3d/d40/f6c 0 2023-12-08T20:28:22.044 INFO:tasks.workunit.client.0.smithi043.stdout:4/545: chown d1/d14/d25/d39/d3f/d3c 72318 1 2023-12-08T20:28:22.046 INFO:tasks.workunit.client.0.smithi043.stdout:1/539: symlink d1/d16/lc4 0 2023-12-08T20:28:22.047 INFO:tasks.workunit.client.0.smithi043.stdout:2/766: rmdir d0/db/d18/d3d 39 2023-12-08T20:28:22.048 INFO:tasks.workunit.client.0.smithi043.stdout:4/546: link d1/d14/d25/d39/d3f/f3a d1/d14/d25/d39/d3f/d3c/d41/db6/fb9 0 2023-12-08T20:28:22.049 INFO:tasks.workunit.client.0.smithi043.stdout:4/547: write d1/f6 [1392832,1794] 0 2023-12-08T20:28:22.049 INFO:tasks.workunit.client.0.smithi043.stdout:4/548: stat d1/d14/d25/d28/c4d 0 2023-12-08T20:28:22.050 INFO:tasks.workunit.client.0.smithi043.stdout:1/540: mkdir d1/d16/d1c/d71/dc5 0 2023-12-08T20:28:22.051 INFO:tasks.workunit.client.0.smithi043.stdout:2/767: mknod d0/db/d18/cf7 0 2023-12-08T20:28:22.054 INFO:tasks.workunit.client.0.smithi043.stdout:4/549: link d1/d14/d25/d39/d3d/d40/d67/d88/la6 d1/d14/d25/d39/d3f/d3c/d41/dab/lba 0 2023-12-08T20:28:22.055 INFO:tasks.workunit.client.0.smithi043.stdout:1/541: getdents d1/d16/d30/d4f/d54 0 2023-12-08T20:28:22.059 INFO:tasks.workunit.client.0.smithi043.stdout:2/768: mknod d0/d26/cf8 0 2023-12-08T20:28:22.060 INFO:tasks.workunit.client.0.smithi043.stdout:4/550: symlink d1/d14/d25/d39/d3d/lbb 0 2023-12-08T20:28:22.062 INFO:tasks.workunit.client.0.smithi043.stdout:4/551: write d1/d14/d25/d39/d3f/f3a [1189712,36501] 0 2023-12-08T20:28:22.062 INFO:tasks.workunit.client.0.smithi043.stdout:4/552: dread - d1/d14/d25/d39/d3d/d40/d67/f9c zero size 2023-12-08T20:28:22.062 INFO:tasks.workunit.client.0.smithi043.stdout:2/769: mkdir d0/dd4/df9 0 2023-12-08T20:28:22.062 INFO:tasks.workunit.client.0.smithi043.stdout:2/770: chown d0/d2b/cf1 37 1 2023-12-08T20:28:22.063 INFO:tasks.workunit.client.0.smithi043.stdout:4/553: write d1/d14/d1d/f6e [635340,127431] 0 2023-12-08T20:28:22.067 INFO:tasks.workunit.client.0.smithi043.stdout:4/554: truncate d1/d14/d50/f98 3514966 0 2023-12-08T20:28:22.067 INFO:tasks.workunit.client.0.smithi043.stdout:4/555: chown d1/f6 9165419 1 2023-12-08T20:28:22.068 INFO:tasks.workunit.client.0.smithi043.stdout:2/771: symlink d0/db/d18/d8b/lfa 0 2023-12-08T20:28:22.068 INFO:tasks.workunit.client.0.smithi043.stdout:2/772: readlink d0/d26/dbc/lf5 0 2023-12-08T20:28:22.069 INFO:tasks.workunit.client.0.smithi043.stdout:2/773: write d0/db/d18/d3d/fdb [694156,82266] 0 2023-12-08T20:28:22.069 INFO:tasks.workunit.client.0.smithi043.stdout:2/774: chown d0/db/d18/d8b/fe4 247180 1 2023-12-08T20:28:22.070 INFO:tasks.workunit.client.0.smithi043.stdout:4/556: creat d1/d14/d25/d39/fbc x:0 0 0 2023-12-08T20:28:22.074 INFO:tasks.workunit.client.0.smithi043.stdout:4/557: creat d1/d14/fbd x:0 0 0 2023-12-08T20:28:22.075 INFO:tasks.workunit.client.0.smithi043.stdout:4/558: truncate d1/d14/d25/d28/f2b 2372500 0 2023-12-08T20:28:22.075 INFO:tasks.workunit.client.0.smithi043.stdout:4/559: creat d1/d14/d25/d39/db1/fbe x:0 0 0 2023-12-08T20:28:22.075 INFO:tasks.workunit.client.0.smithi043.stdout:4/560: stat d1/d14/d1d/d58/f62 0 2023-12-08T20:28:22.075 INFO:tasks.workunit.client.0.smithi043.stdout:4/561: write d1/d14/d50/f7a [327314,100315] 0 2023-12-08T20:28:22.076 INFO:tasks.workunit.client.0.smithi043.stdout:4/562: creat d1/d14/d25/d39/da3/dae/fbf x:0 0 0 2023-12-08T20:28:22.078 INFO:tasks.workunit.client.0.smithi043.stdout:4/563: mkdir d1/d14/d25/d77/da4/dc0 0 2023-12-08T20:28:22.080 INFO:tasks.workunit.client.0.smithi043.stdout:4/564: creat d1/d14/d25/d28/fc1 x:0 0 0 2023-12-08T20:28:22.080 INFO:tasks.workunit.client.0.smithi043.stdout:4/565: truncate d1/f5f 2749150 0 2023-12-08T20:28:22.081 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-08T20:28:22.081 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2023-12-08T20:28:22.082 INFO:tasks.workunit.client.0.smithi043.stdout:2/775: dwrite d0/d26/f45 [0,4194304] 0 2023-12-08T20:28:22.084 INFO:tasks.workunit.client.0.smithi043.stdout:2/776: symlink d0/d20/d42/lfb 0 2023-12-08T20:28:22.084 INFO:tasks.workunit.client.0.smithi043.stdout:2/777: write d0/db/fea [823442,121590] 0 2023-12-08T20:28:22.089 INFO:tasks.workunit.client.0.smithi043.stdout:2/778: dread d0/d81/f8e [0,4194304] 0 2023-12-08T20:28:22.089 INFO:tasks.workunit.client.0.smithi043.stdout:2/779: chown d0/db/d18/d66/d71/dab/lb7 2459428 1 2023-12-08T20:28:22.089 INFO:tasks.workunit.client.0.smithi043.stdout:2/780: fdatasync d0/db/f14 0 2023-12-08T20:28:22.090 INFO:tasks.workunit.client.0.smithi043.stdout:2/781: mknod d0/db/d18/d66/d71/cfc 0 2023-12-08T20:28:22.090 INFO:tasks.workunit.client.0.smithi043.stdout:2/782: readlink d0/d26/dbc/l94 0 2023-12-08T20:28:22.090 INFO:tasks.workunit.client.0.smithi043.stdout:2/783: mkdir d0/d2b/d4e/d79/dfd 0 2023-12-08T20:28:22.091 INFO:tasks.workunit.client.0.smithi043.stdout:2/784: chown d0/d26/dbc/d38/c8f 3463 1 2023-12-08T20:28:22.091 INFO:tasks.workunit.client.0.smithi043.stdout:2/785: chown d0/d26/dbc/d38/dae/lba 119986 1 2023-12-08T20:28:22.091 INFO:tasks.workunit.client.0.smithi043.stdout:2/786: creat d0/db/d18/d66/d71/ffe x:0 0 0 2023-12-08T20:28:22.091 INFO:tasks.workunit.client.0.smithi043.stdout:2/787: readlink d0/db/d18/d8b/lfa 0 2023-12-08T20:28:22.091 INFO:tasks.workunit.client.0.smithi043.stdout:2/788: stat d0/db/d18/d66 0 2023-12-08T20:28:22.092 INFO:tasks.workunit.client.0.smithi043.stdout:2/789: mkdir d0/d2b/d4e/d79/dfd/dff 0 2023-12-08T20:28:22.096 INFO:tasks.workunit.client.0.smithi043.stdout:2/790: dread d0/db/d18/f1a [0,4194304] 0 2023-12-08T20:28:22.107 INFO:tasks.workunit.client.0.smithi043.stdout:4/566: dread d1/d14/d1d/f1e [4194304,4194304] 0 2023-12-08T20:28:22.109 INFO:tasks.workunit.client.0.smithi043.stdout:2/791: write d0/db/fea [386842,24605] 0 2023-12-08T20:28:22.126 INFO:tasks.workunit.client.0.smithi043.stdout:4/567: dwrite d1/d14/d25/d77/f84 [0,4194304] 0 2023-12-08T20:28:22.126 INFO:tasks.workunit.client.0.smithi043.stdout:2/792: dread d0/d20/f2a [4194304,4194304] 0 2023-12-08T20:28:22.129 INFO:tasks.workunit.client.0.smithi043.stdout:4/568: symlink d1/d14/d25/d39/d3d/db0/lc2 0 2023-12-08T20:28:22.142 INFO:tasks.workunit.client.0.smithi043.stdout:2/793: dread d0/db/fa5 [0,4194304] 0 2023-12-08T20:28:22.143 INFO:tasks.workunit.client.0.smithi043.stdout:2/794: creat d0/dd4/f100 x:0 0 0 2023-12-08T20:28:22.144 INFO:tasks.workunit.client.0.smithi043.stdout:2/795: symlink d0/dd4/df9/l101 0 2023-12-08T20:28:22.153 INFO:tasks.workunit.client.0.smithi043.stdout:4/569: dwrite d1/d14/d25/d39/d3d/d40/d67/f9c [0,4194304] 0 2023-12-08T20:28:22.156 INFO:tasks.workunit.client.0.smithi043.stdout:4/570: creat d1/d14/d25/d39/d3f/d59/fc3 x:0 0 0 2023-12-08T20:28:22.157 INFO:tasks.workunit.client.0.smithi043.stdout:4/571: creat d1/d14/d1d/d58/fc4 x:0 0 0 2023-12-08T20:28:22.158 INFO:tasks.workunit.client.0.smithi043.stdout:4/572: creat d1/d14/d25/d39/da3/dae/fc5 x:0 0 0 2023-12-08T20:28:22.161 INFO:tasks.workunit.client.0.smithi043.stdout:2/796: dwrite d0/db/f4a [0,4194304] 0 2023-12-08T20:28:22.161 INFO:tasks.workunit.client.0.smithi043.stdout:2/797: chown d0/d26/dbc/d38/le2 59951 1 2023-12-08T20:28:22.186 INFO:tasks.workunit.client.0.smithi043.stdout:2/798: dwrite d0/db/f54 [0,4194304] 0 2023-12-08T20:28:22.186 INFO:tasks.workunit.client.0.smithi043.stdout:4/573: dwrite d1/d14/d1d/f4b [0,4194304] 0 2023-12-08T20:28:22.188 INFO:tasks.workunit.client.0.smithi043.stdout:4/574: truncate d1/d14/d1d/f1e 2615222 0 2023-12-08T20:28:22.192 INFO:tasks.workunit.client.0.smithi043.stdout:4/575: write d1/d14/d1d/f6e [3618596,18268] 0 2023-12-08T20:28:22.193 INFO:tasks.workunit.client.0.smithi043.stdout:2/799: dread d0/d20/f4d [0,4194304] 0 2023-12-08T20:28:22.193 INFO:tasks.workunit.client.0.smithi043.stdout:4/576: creat d1/fc6 x:0 0 0 2023-12-08T20:28:22.193 INFO:tasks.workunit.client.0.smithi043.stdout:4/577: write d1/d14/fbd [182813,107513] 0 2023-12-08T20:28:22.195 INFO:tasks.workunit.client.0.smithi043.stdout:2/800: mknod d0/c102 0 2023-12-08T20:28:22.195 INFO:tasks.workunit.client.0.smithi043.stdout:2/801: chown d0/d26/d53 202491 1 2023-12-08T20:28:22.196 INFO:tasks.workunit.client.0.smithi043.stdout:2/802: chown d0/d81/cde 16 1 2023-12-08T20:28:22.196 INFO:tasks.workunit.client.0.smithi043.stdout:2/803: write d0/d20/d42/d49/f5f [691561,112242] 0 2023-12-08T20:28:22.196 INFO:tasks.workunit.client.0.smithi043.stdout:8/496: sync 2023-12-08T20:28:22.196 INFO:tasks.workunit.client.0.smithi043.stdout:7/539: sync 2023-12-08T20:28:22.196 INFO:tasks.workunit.client.0.smithi043.stdout:8/497: fsync d2/d27/d2d/d31/f36 0 2023-12-08T20:28:22.196 INFO:tasks.workunit.client.0.smithi043.stdout:7/540: fdatasync d0/d2/f8e 0 2023-12-08T20:28:22.196 INFO:tasks.workunit.client.0.smithi043.stdout:7/541: write d0/d2/d65/d99/f7d [1736368,21877] 0 2023-12-08T20:28:22.197 INFO:tasks.workunit.client.0.smithi043.stdout:7/542: readlink d0/d2/d65/d99/le 0 2023-12-08T20:28:22.199 INFO:tasks.workunit.client.0.smithi043.stdout:6/516: sync 2023-12-08T20:28:22.200 INFO:tasks.workunit.client.0.smithi043.stdout:0/790: sync 2023-12-08T20:28:22.200 INFO:tasks.workunit.client.0.smithi043.stdout:6/517: truncate d0/d2/d14/d8/d47/f80 1111174 0 2023-12-08T20:28:22.200 INFO:tasks.workunit.client.0.smithi043.stdout:5/504: sync 2023-12-08T20:28:22.200 INFO:tasks.workunit.client.0.smithi043.stdout:8/498: read d2/d27/d2d/f3c [336627,107928] 0 2023-12-08T20:28:22.200 INFO:tasks.workunit.client.0.smithi043.stdout:2/804: write d0/db/d18/ff2 [3924995,26623] 0 2023-12-08T20:28:22.201 INFO:tasks.workunit.client.0.smithi043.stdout:8/499: write d2/d27/d2d/f3c [233897,71510] 0 2023-12-08T20:28:22.208 INFO:tasks.workunit.client.0.smithi043.stdout:6/518: rmdir d0/d2 39 2023-12-08T20:28:22.208 INFO:tasks.workunit.client.0.smithi043.stdout:0/791: mkdir d2/d3/d6/d39/d63/da6/dae/d105 0 2023-12-08T20:28:22.209 INFO:tasks.workunit.client.0.smithi043.stdout:8/500: mknod d2/d20/d7d/d29/d30/d7c/c9e 0 2023-12-08T20:28:22.209 INFO:tasks.workunit.client.0.smithi043.stdout:0/792: write d2/d3/d18/d2b/f41 [69904,34758] 0 2023-12-08T20:28:22.210 INFO:tasks.workunit.client.0.smithi043.stdout:6/519: creat d0/d2/d14/d2c/d22/d3f/fb1 x:0 0 0 2023-12-08T20:28:22.212 INFO:tasks.workunit.client.0.smithi043.stdout:5/505: mknod d3/d7/de/c9c 0 2023-12-08T20:28:22.212 INFO:tasks.workunit.client.0.smithi043.stdout:5/506: chown d3/d7/d19/d3f/l5f 151 1 2023-12-08T20:28:22.212 INFO:tasks.workunit.client.0.smithi043.stdout:2/805: rmdir d0/db/d18/d8b/db4 39 2023-12-08T20:28:22.214 INFO:tasks.workunit.client.0.smithi043.stdout:8/501: mkdir d2/d20/d7d/d29/d59/d9f 0 2023-12-08T20:28:22.214 INFO:tasks.workunit.client.0.smithi043.stdout:0/793: stat d2/d3/d18/d2b/da5/d5f/d79/d86/lb3 0 2023-12-08T20:28:22.214 INFO:tasks.workunit.client.0.smithi043.stdout:0/794: stat d2/d3/d18/d2b/fa7 0 2023-12-08T20:28:22.215 INFO:tasks.workunit.client.0.smithi043.stdout:6/520: mkdir d0/d2/d14/d2c/d22/d2a/db2 0 2023-12-08T20:28:22.215 INFO:tasks.workunit.client.0.smithi043.stdout:6/521: chown d0/d2/d14/d2c/d22/d2a/faa 0 1 2023-12-08T20:28:22.216 INFO:tasks.workunit.client.0.smithi043.stdout:2/806: truncate d0/d26/dbc/d38/f41 4277387 0 2023-12-08T20:28:22.216 INFO:tasks.workunit.client.0.smithi043.stdout:2/807: fdatasync d0/d26/fca 0 2023-12-08T20:28:22.216 INFO:tasks.workunit.client.0.smithi043.stdout:8/502: getdents d2/d20/d7d/d37 0 2023-12-08T20:28:22.218 INFO:tasks.workunit.client.0.smithi043.stdout:6/522: rename d0/d2/de/d4a/d56/d59 to d0/d2/d14/db3 0 2023-12-08T20:28:22.219 INFO:tasks.workunit.client.0.smithi043.stdout:2/808: link d0/d20/f76 d0/dd4/df9/f103 0 2023-12-08T20:28:22.219 INFO:tasks.workunit.client.0.smithi043.stdout:2/809: chown d0/d20/d42/dcb 187183 1 2023-12-08T20:28:22.220 INFO:tasks.workunit.client.0.smithi043.stdout:6/523: truncate d0/d2/d14/d8/d47/d60/f8d 3579804 0 2023-12-08T20:28:22.221 INFO:tasks.workunit.client.0.smithi043.stdout:6/524: symlink d0/d2/d14/d2c/d22/d3f/d45/d6b/lb4 0 2023-12-08T20:28:22.221 INFO:tasks.workunit.client.0.smithi043.stdout:6/525: chown d0/d2/d14/d20/d3c/d6c 20585698 1 2023-12-08T20:28:22.223 INFO:tasks.workunit.client.0.smithi043.stdout:6/526: link d0/d2/d14/d8/d47/d60/l79 d0/d2/de/d4a/lb5 0 2023-12-08T20:28:22.223 INFO:tasks.workunit.client.0.smithi043.stdout:6/527: chown d0/d2/d14/d20/d49/f64 12338 1 2023-12-08T20:28:22.223 INFO:tasks.workunit.client.0.smithi043.stdout:8/503: dread d2/f9 [0,4194304] 0 2023-12-08T20:28:22.225 INFO:tasks.workunit.client.0.smithi043.stdout:6/528: link d0/d2/f3e d0/d2/d14/d2c/d22/d3f/d45/d69/fb6 0 2023-12-08T20:28:22.225 INFO:tasks.workunit.client.0.smithi043.stdout:6/529: write d0/d2/d14/d2c/d22/d3f/d45/d6b/f8a [378533,88518] 0 2023-12-08T20:28:22.225 INFO:tasks.workunit.client.0.smithi043.stdout:7/543: dwrite d0/d2/d65/d99/d47/f77 [0,4194304] 0 2023-12-08T20:28:22.226 INFO:tasks.workunit.client.0.smithi043.stdout:4/578: dwrite d1/d14/d50/f9a [0,4194304] 0 2023-12-08T20:28:22.226 INFO:tasks.workunit.client.0.smithi043.stdout:8/504: mknod d2/d27/d2d/d31/d74/ca0 0 2023-12-08T20:28:22.226 INFO:tasks.workunit.client.0.smithi043.stdout:8/505: dread - d2/d20/f78 zero size 2023-12-08T20:28:22.227 INFO:tasks.workunit.client.0.smithi043.stdout:8/506: write d2/d20/d7d/d29/d30/d71/f96 [387436,109159] 0 2023-12-08T20:28:22.227 INFO:tasks.workunit.client.0.smithi043.stdout:0/795: write d2/d3/d18/d2b/f41 [3728446,14565] 0 2023-12-08T20:28:22.227 INFO:tasks.workunit.client.0.smithi043.stdout:0/796: truncate d2/d3/d18/d2b/fd9 143123 0 2023-12-08T20:28:22.227 INFO:tasks.workunit.client.0.smithi043.stdout:6/530: dread d0/f34 [0,4194304] 0 2023-12-08T20:28:22.227 INFO:tasks.workunit.client.0.smithi043.stdout:6/531: stat d0/d2/d14/d2c/d22/d3f/d45/d69/fb6 0 2023-12-08T20:28:22.228 INFO:tasks.workunit.client.0.smithi043.stdout:7/544: creat d0/d2/d12/d19/faf x:0 0 0 2023-12-08T20:28:22.228 INFO:tasks.workunit.client.0.smithi043.stdout:5/507: dread d3/d7/de/d17/f79 [0,4194304] 0 2023-12-08T20:28:22.231 INFO:tasks.workunit.client.0.smithi043.stdout:4/579: rename d1/d14/d25/d39/d3f/d3c/d80/f82 to d1/d14/d25/d39/fc7 0 2023-12-08T20:28:22.232 INFO:tasks.workunit.client.0.smithi043.stdout:8/507: mknod d2/d20/ca1 0 2023-12-08T20:28:22.235 INFO:tasks.workunit.client.0.smithi043.stdout:8/508: dread d2/d20/d7d/f77 [0,4194304] 0 2023-12-08T20:28:22.235 INFO:tasks.workunit.client.0.smithi043.stdout:8/509: truncate d2/d20/d7d/f8a 122593 0 2023-12-08T20:28:22.237 INFO:tasks.workunit.client.0.smithi043.stdout:6/532: symlink d0/d2/d14/d20/d3c/d50/lb7 0 2023-12-08T20:28:22.240 INFO:tasks.workunit.client.0.smithi043.stdout:7/545: mkdir d0/d2/db0 0 2023-12-08T20:28:22.241 INFO:tasks.workunit.client.0.smithi043.stdout:7/546: fsync d0/f6a 0 2023-12-08T20:28:22.241 INFO:tasks.workunit.client.0.smithi043.stdout:7/547: write d0/d2/d65/d99/f9 [1807150,98364] 0 2023-12-08T20:28:22.247 INFO:tasks.workunit.client.0.smithi043.stdout:5/508: mknod d3/d7/de/d17/c9d 0 2023-12-08T20:28:22.249 INFO:tasks.workunit.client.0.smithi043.stdout:0/797: rename d2/d3/d18/d2b/da5/f49 to d2/d3/d18/d2b/f106 0 2023-12-08T20:28:22.249 INFO:tasks.workunit.client.0.smithi043.stdout:0/798: fdatasync d2/d3/d6/d39/d83/fb5 0 2023-12-08T20:28:22.250 INFO:tasks.workunit.client.0.smithi043.stdout:8/510: truncate d2/d20/d7d/f26 2009463 0 2023-12-08T20:28:22.251 INFO:tasks.workunit.client.0.smithi043.stdout:6/533: truncate d0/d2/f1f 4122944 0 2023-12-08T20:28:22.251 INFO:tasks.workunit.client.0.smithi043.stdout:6/534: fdatasync d0/d2/fae 0 2023-12-08T20:28:22.252 INFO:tasks.workunit.client.0.smithi043.stdout:5/509: truncate d3/d7/f1a 1663289 0 2023-12-08T20:28:22.253 INFO:tasks.workunit.client.0.smithi043.stdout:6/535: write d0/d2/d14/d20/d3c/d50/f77 [127026,87261] 0 2023-12-08T20:28:22.253 INFO:tasks.workunit.client.0.smithi043.stdout:6/536: chown d0/d2/d14/d20/d3c/d50/c81 126926 1 2023-12-08T20:28:22.253 INFO:tasks.workunit.client.0.smithi043.stdout:6/537: readlink d0/d2/d14/l8f 0 2023-12-08T20:28:22.253 INFO:tasks.workunit.client.0.smithi043.stdout:6/538: write d0/d2/d14/d8/f9f [800796,91557] 0 2023-12-08T20:28:22.254 INFO:tasks.workunit.client.0.smithi043.stdout:0/799: creat d2/d3/d6/d39/f107 x:0 0 0 2023-12-08T20:28:22.254 INFO:tasks.workunit.client.0.smithi043.stdout:0/800: rename d2 to d2/d3/d18/d2b/da5/d5f/d108 22 2023-12-08T20:28:22.255 INFO:tasks.workunit.client.0.smithi043.stdout:8/511: symlink d2/d27/d2d/d31/d74/la2 0 2023-12-08T20:28:22.255 INFO:tasks.workunit.client.0.smithi043.stdout:8/512: chown d2/d20/d7d/d29/d30/l34 68832345 1 2023-12-08T20:28:22.257 INFO:tasks.workunit.client.0.smithi043.stdout:0/801: mkdir d2/d3/d6/d39/d63/da6/dae/d109 0 2023-12-08T20:28:22.257 INFO:tasks.workunit.client.0.smithi043.stdout:0/802: fsync d2/d61/dc1/fe3 0 2023-12-08T20:28:22.258 INFO:tasks.workunit.client.0.smithi043.stdout:6/539: write d0/f7f [645837,107338] 0 2023-12-08T20:28:22.259 INFO:tasks.workunit.client.0.smithi043.stdout:7/548: dwrite d0/d6/d17/d54/f59 [0,4194304] 0 2023-12-08T20:28:22.259 INFO:tasks.workunit.client.0.smithi043.stdout:8/513: rename d2/d27/d2d/d31/f92 to d2/d27/d2d/d31/d91/fa3 0 2023-12-08T20:28:22.261 INFO:tasks.workunit.client.0.smithi043.stdout:0/803: creat d2/d3/d18/d1e/f10a x:0 0 0 2023-12-08T20:28:22.262 INFO:tasks.workunit.client.0.smithi043.stdout:0/804: chown d2/d3/d18/d1e 1159321 1 2023-12-08T20:28:22.262 INFO:tasks.workunit.client.0.smithi043.stdout:0/805: getdents d2/d61/d8a/d100 0 2023-12-08T20:28:22.264 INFO:tasks.workunit.client.0.smithi043.stdout:6/540: rename d0/d2/d14/d8/d47/l70 to d0/d2/d14/lb8 0 2023-12-08T20:28:22.265 INFO:tasks.workunit.client.0.smithi043.stdout:8/514: symlink d2/d20/d7d/d29/d30/d60/la4 0 2023-12-08T20:28:22.267 INFO:tasks.workunit.client.0.smithi043.stdout:5/510: dread d3/d7/d29/f3c [0,4194304] 0 2023-12-08T20:28:22.268 INFO:tasks.workunit.client.0.smithi043.stdout:7/549: dread d0/d2/d12/f51 [0,4194304] 0 2023-12-08T20:28:22.269 INFO:tasks.workunit.client.0.smithi043.stdout:7/550: read d0/d6/d17/d54/f59 [4077670,86295] 0 2023-12-08T20:28:22.270 INFO:tasks.workunit.client.0.smithi043.stdout:7/551: write d0/d2/d12/d19/f94 [176485,81406] 0 2023-12-08T20:28:22.273 INFO:tasks.workunit.client.0.smithi043.stdout:1/542: sync 2023-12-08T20:28:22.273 INFO:tasks.workunit.client.0.smithi043.stdout:9/539: sync 2023-12-08T20:28:22.273 INFO:tasks.workunit.client.0.smithi043.stdout:3/541: sync 2023-12-08T20:28:22.275 INFO:tasks.workunit.client.0.smithi043.stdout:1/543: rmdir d1/d16/d48/d8d 0 2023-12-08T20:28:22.277 INFO:tasks.workunit.client.0.smithi043.stdout:9/540: read d0/d3d/f4c [3687130,80072] 0 2023-12-08T20:28:22.277 INFO:tasks.workunit.client.0.smithi043.stdout:3/542: creat d1/d9/d38/d4a/fb3 x:0 0 0 2023-12-08T20:28:22.277 INFO:tasks.workunit.client.0.smithi043.stdout:3/543: write d1/d9/df/f47 [4361675,128339] 0 2023-12-08T20:28:22.277 INFO:tasks.workunit.client.0.smithi043.stdout:3/544: stat d1/f50 0 2023-12-08T20:28:22.279 INFO:tasks.workunit.client.0.smithi043.stdout:5/511: dread d3/d7/d21/f4d [0,4194304] 0 2023-12-08T20:28:22.281 INFO:tasks.workunit.client.0.smithi043.stdout:1/544: unlink d1/d16/d21/d42/la6 0 2023-12-08T20:28:22.281 INFO:tasks.workunit.client.0.smithi043.stdout:1/545: readlink d1/d16/d1c/l2f 0 2023-12-08T20:28:22.281 INFO:tasks.workunit.client.0.smithi043.stdout:9/541: read d0/d21/f56 [129391,44116] 0 2023-12-08T20:28:22.281 INFO:tasks.workunit.client.0.smithi043.stdout:7/552: dread d0/f1b [4194304,4194304] 0 2023-12-08T20:28:22.281 INFO:tasks.workunit.client.0.smithi043.stdout:9/542: write d0/d5e/d37/d6b/d94/fa0 [1553994,110930] 0 2023-12-08T20:28:22.281 INFO:tasks.workunit.client.0.smithi043.stdout:9/543: fdatasync d0/d5e/f63 0 2023-12-08T20:28:22.281 INFO:tasks.workunit.client.0.smithi043.stdout:3/545: mknod d1/d25/d2a/cb4 0 2023-12-08T20:28:22.284 INFO:tasks.workunit.client.0.smithi043.stdout:5/512: dread d3/d7/f69 [0,4194304] 0 2023-12-08T20:28:22.284 INFO:tasks.workunit.client.0.smithi043.stdout:6/541: dwrite d0/d2/d14/d2c/d22/d3f/d45/f51 [0,4194304] 0 2023-12-08T20:28:22.284 INFO:tasks.workunit.client.0.smithi043.stdout:6/542: dread - d0/d2/d14/d2c/d22/f8c zero size 2023-12-08T20:28:22.285 INFO:tasks.workunit.client.0.smithi043.stdout:0/806: rename d2/d3/d6 to d2/d3/d18/d1e/d53/d10b 0 2023-12-08T20:28:22.285 INFO:tasks.workunit.client.0.smithi043.stdout:7/553: rename d0/d6 to d0/d6/d17/dab/db1 22 2023-12-08T20:28:22.285 INFO:tasks.workunit.client.0.smithi043.stdout:0/807: fsync d2/d61/dc1/fe3 0 2023-12-08T20:28:22.286 INFO:tasks.workunit.client.0.smithi043.stdout:3/546: truncate d1/d25/f24 1861452 0 2023-12-08T20:28:22.291 INFO:tasks.workunit.client.0.smithi043.stdout:0/808: creat d2/d3/d18/d2b/da5/d5f/df0/f10c x:0 0 0 2023-12-08T20:28:22.293 INFO:tasks.workunit.client.0.smithi043.stdout:3/547: creat d1/d1c/d2c/d5f/fb5 x:0 0 0 2023-12-08T20:28:22.294 INFO:tasks.workunit.client.0.smithi043.stdout:8/515: rmdir d2 39 2023-12-08T20:28:22.294 INFO:tasks.workunit.client.0.smithi043.stdout:8/516: fdatasync d2/d27/d2d/d31/d91/fa3 0 2023-12-08T20:28:22.294 INFO:tasks.workunit.client.0.smithi043.stdout:8/517: fsync d2/d27/d2d/d31/d91/fa3 0 2023-12-08T20:28:22.296 INFO:tasks.workunit.client.0.smithi043.stdout:0/809: truncate d2/f24 2139011 0 2023-12-08T20:28:22.296 INFO:tasks.workunit.client.0.smithi043.stdout:0/810: write d2/d4/f4b [2787985,52003] 0 2023-12-08T20:28:22.300 INFO:tasks.workunit.client.0.smithi043.stdout:3/548: mknod d1/d25/d2a/d45/cb6 0 2023-12-08T20:28:22.303 INFO:tasks.workunit.client.0.smithi043.stdout:0/811: link d2/d3/d18/d2b/da5/d8e/lba d2/d3/l10d 0 2023-12-08T20:28:22.303 INFO:tasks.workunit.client.0.smithi043.stdout:8/518: creat d2/d27/d2d/d31/d74/fa5 x:0 0 0 2023-12-08T20:28:22.305 INFO:tasks.workunit.client.0.smithi043.stdout:3/549: mkdir d1/d9/db7 0 2023-12-08T20:28:22.307 INFO:tasks.workunit.client.0.smithi043.stdout:8/519: mknod d2/d20/d7d/d37/ca6 0 2023-12-08T20:28:22.308 INFO:tasks.workunit.client.0.smithi043.stdout:8/520: write d2/d27/d2d/d31/d91/f95 [849802,22765] 0 2023-12-08T20:28:22.308 INFO:tasks.workunit.client.0.smithi043.stdout:0/812: rename d2/d61/dc0/leb to d2/d3/d18/d2b/l10e 0 2023-12-08T20:28:22.308 INFO:tasks.workunit.client.0.smithi043.stdout:9/544: dread d0/d5e/d37/f54 [0,4194304] 0 2023-12-08T20:28:22.313 INFO:tasks.workunit.client.0.smithi043.stdout:0/813: truncate d2/d3/d18/fc7 465998 0 2023-12-08T20:28:22.313 INFO:tasks.workunit.client.0.smithi043.stdout:0/814: dread - d2/d61/dc0/fd3 zero size 2023-12-08T20:28:22.313 INFO:tasks.workunit.client.0.smithi043.stdout:9/545: creat d0/d21/d80/fac x:0 0 0 2023-12-08T20:28:22.313 INFO:tasks.workunit.client.0.smithi043.stdout:9/546: stat d0/d5e/d37/d6b/d76 0 2023-12-08T20:28:22.321 INFO:tasks.workunit.client.0.smithi043.stdout:5/513: dread d3/d7/f1a [0,4194304] 0 2023-12-08T20:28:22.322 INFO:tasks.workunit.client.0.smithi043.stdout:5/514: truncate d3/d7/d21/f61 923909 0 2023-12-08T20:28:22.323 INFO:tasks.workunit.client.0.smithi043.stdout:7/554: dwrite d0/d2/d65/d99/f9 [0,4194304] 0 2023-12-08T20:28:22.323 INFO:tasks.workunit.client.0.smithi043.stdout:7/555: fdatasync d0/d6/d17/d54/f60 0 2023-12-08T20:28:22.323 INFO:tasks.workunit.client.0.smithi043.stdout:5/515: mknod d3/d7/de/d82/d95/c9e 0 2023-12-08T20:28:22.323 INFO:tasks.workunit.client.0.smithi043.stdout:5/516: chown d3/d73/d83/l8e 22760 1 2023-12-08T20:28:22.325 INFO:tasks.workunit.client.0.smithi043.stdout:6/543: dwrite d0/d2/d14/d20/d3c/d6c/fb0 [0,4194304] 0 2023-12-08T20:28:22.326 INFO:tasks.workunit.client.0.smithi043.stdout:7/556: symlink d0/d6/d17/d54/lb2 0 2023-12-08T20:28:22.327 INFO:tasks.workunit.client.0.smithi043.stdout:1/546: dwrite d1/d16/d21/d25/d35/f85 [0,4194304] 0 2023-12-08T20:28:22.333 INFO:tasks.workunit.client.0.smithi043.stdout:7/557: rmdir d0/d69 39 2023-12-08T20:28:22.333 INFO:tasks.workunit.client.0.smithi043.stdout:5/517: mknod d3/d73/d83/d99/c9f 0 2023-12-08T20:28:22.333 INFO:tasks.workunit.client.0.smithi043.stdout:5/518: readlink d3/d7/de/d17/l41 0 2023-12-08T20:28:22.334 INFO:tasks.workunit.client.0.smithi043.stdout:7/558: write d0/d2/d12/f2e [3907500,121185] 0 2023-12-08T20:28:22.335 INFO:tasks.workunit.client.0.smithi043.stdout:1/547: creat d1/d16/d1c/d71/fc6 x:0 0 0 2023-12-08T20:28:22.342 INFO:tasks.workunit.client.0.smithi043.stdout:5/519: symlink d3/d7/de/d82/d95/la0 0 2023-12-08T20:28:22.342 INFO:tasks.workunit.client.0.smithi043.stdout:5/520: read d3/d7/de/f7b [201892,65066] 0 2023-12-08T20:28:22.346 INFO:tasks.workunit.client.0.smithi043.stdout:1/548: rename d1/d16/d1c/d71/d98/fbb to d1/d16/d1c/d71/fc7 0 2023-12-08T20:28:22.348 INFO:tasks.workunit.client.0.smithi043.stdout:5/521: unlink d3/d7/d19/d3f/f58 0 2023-12-08T20:28:22.348 INFO:tasks.workunit.client.0.smithi043.stdout:1/549: mkdir d1/d16/d21/dc8 0 2023-12-08T20:28:22.356 INFO:tasks.workunit.client.0.smithi043.stdout:1/550: dread d1/d16/d21/d25/d3e/d72/f74 [0,4194304] 0 2023-12-08T20:28:22.357 INFO:tasks.workunit.client.0.smithi043.stdout:1/551: mkdir d1/db1/dc9 0 2023-12-08T20:28:22.357 INFO:tasks.workunit.client.0.smithi043.stdout:1/552: write d1/d16/d21/d25/d3e/d77/d9f/fa9 [779854,35495] 0 2023-12-08T20:28:22.357 INFO:tasks.workunit.client.0.smithi043.stdout:1/553: chown d1/d16/d21/d25/d3e/la4 185144 1 2023-12-08T20:28:22.357 INFO:tasks.workunit.client.0.smithi043.stdout:1/554: stat d1/d16/d1c/d81/dad 0 2023-12-08T20:28:22.358 INFO:tasks.workunit.client.0.smithi043.stdout:1/555: mknod d1/d16/d21/d25/cca 0 2023-12-08T20:28:22.358 INFO:tasks.workunit.client.0.smithi043.stdout:8/521: dwrite d2/d27/d2d/f7a [0,4194304] 0 2023-12-08T20:28:22.365 INFO:tasks.workunit.client.0.smithi043.stdout:3/550: dwrite d1/d1c/d2c/d5f/faf [0,4194304] 0 2023-12-08T20:28:22.366 INFO:tasks.workunit.client.0.smithi043.stdout:3/551: chown d1/d9/d2d/f70 2457767 1 2023-12-08T20:28:22.368 INFO:tasks.workunit.client.0.smithi043.stdout:7/559: rmdir d0/d6/d17 39 2023-12-08T20:28:22.369 INFO:tasks.workunit.client.0.smithi043.stdout:6/544: dwrite d0/d2/de/f40 [0,4194304] 0 2023-12-08T20:28:22.369 INFO:tasks.workunit.client.0.smithi043.stdout:0/815: dwrite d2/d3/d18/d2b/da5/d5f/df0/f10c [0,4194304] 0 2023-12-08T20:28:22.369 INFO:tasks.workunit.client.0.smithi043.stdout:0/816: stat d2/d3/d18/d2b/da5/ffc 0 2023-12-08T20:28:22.369 INFO:tasks.workunit.client.0.smithi043.stdout:0/817: readlink d2/d3/d18/d2b/da5/d5f/d79/d86/ldb 0 2023-12-08T20:28:22.372 INFO:tasks.workunit.client.0.smithi043.stdout:3/552: truncate d1/f18 7763267 0 2023-12-08T20:28:22.373 INFO:tasks.workunit.client.0.smithi043.stdout:7/560: rmdir d0/d6/d17/d52 39 2023-12-08T20:28:22.375 INFO:tasks.workunit.client.0.smithi043.stdout:9/547: dwrite d0/d3d/f83 [0,4194304] 0 2023-12-08T20:28:22.375 INFO:tasks.workunit.client.0.smithi043.stdout:5/522: dread d3/d7/d19/d3f/f86 [0,4194304] 0 2023-12-08T20:28:22.375 INFO:tasks.workunit.client.0.smithi043.stdout:5/523: stat d3/d7/de/f1d 0 2023-12-08T20:28:22.381 INFO:tasks.workunit.client.0.smithi043.stdout:6/545: getdents d0/d2/d14/d2c/d22/d3f/d45/d6b 0 2023-12-08T20:28:22.382 INFO:tasks.workunit.client.0.smithi043.stdout:0/818: creat d2/d3/d18/d1e/d53/d10b/d39/d83/f10f x:0 0 0 2023-12-08T20:28:22.382 INFO:tasks.workunit.client.0.smithi043.stdout:3/553: symlink d1/d9/d2d/d42/lb8 0 2023-12-08T20:28:22.383 INFO:tasks.workunit.client.0.smithi043.stdout:3/554: read d1/d25/d2a/d45/f58 [1704658,123871] 0 2023-12-08T20:28:22.384 INFO:tasks.workunit.client.0.smithi043.stdout:7/561: creat d0/d2/d12/d19/d38/fb3 x:0 0 0 2023-12-08T20:28:22.384 INFO:tasks.workunit.client.0.smithi043.stdout:7/562: truncate d0/d2/d12/d19/faf 945589 0 2023-12-08T20:28:22.385 INFO:tasks.workunit.client.0.smithi043.stdout:9/548: rename d0/d5e/d37 to d0/d5e/dad 0 2023-12-08T20:28:22.386 INFO:tasks.workunit.client.0.smithi043.stdout:9/549: write d0/d5e/f63 [3048157,45778] 0 2023-12-08T20:28:22.386 INFO:tasks.workunit.client.0.smithi043.stdout:5/524: getdents d3/d7/de 0 2023-12-08T20:28:22.386 INFO:tasks.workunit.client.0.smithi043.stdout:3/555: write d1/d9/d38/d33/f68 [593082,109834] 0 2023-12-08T20:28:22.386 INFO:tasks.workunit.client.0.smithi043.stdout:5/525: write d3/d7/de/f7b [219891,61826] 0 2023-12-08T20:28:22.387 INFO:tasks.workunit.client.0.smithi043.stdout:5/526: chown d3/d7/d19/d3f/f62 8198449 1 2023-12-08T20:28:22.387 INFO:tasks.workunit.client.0.smithi043.stdout:5/527: chown d3/d7/d21 90104195 1 2023-12-08T20:28:22.389 INFO:tasks.workunit.client.0.smithi043.stdout:1/556: dwrite d1/d16/d48/f56 [0,4194304] 0 2023-12-08T20:28:22.389 INFO:tasks.workunit.client.0.smithi043.stdout:8/522: dwrite d2/d27/d2d/d31/d91/fa3 [0,4194304] 0 2023-12-08T20:28:22.396 INFO:tasks.workunit.client.0.smithi043.stdout:6/546: rename d0/d2/d29/f97 to d0/d2/d14/d2c/fb9 0 2023-12-08T20:28:22.396 INFO:tasks.workunit.client.0.smithi043.stdout:0/819: unlink d2/d3/fb 0 2023-12-08T20:28:22.396 INFO:tasks.workunit.client.0.smithi043.stdout:0/820: write d2/d4/fe [1281833,15658] 0 2023-12-08T20:28:22.396 INFO:tasks.workunit.client.0.smithi043.stdout:7/563: creat d0/d6/d17/dab/fb4 x:0 0 0 2023-12-08T20:28:22.396 INFO:tasks.workunit.client.0.smithi043.stdout:9/550: mknod d0/d3d/d4b/d61/cae 0 2023-12-08T20:28:22.396 INFO:tasks.workunit.client.0.smithi043.stdout:3/556: creat d1/d9/d2d/d91/da7/fb9 x:0 0 0 2023-12-08T20:28:22.398 INFO:tasks.workunit.client.0.smithi043.stdout:5/528: creat d3/d7/d21/fa1 x:0 0 0 2023-12-08T20:28:22.398 INFO:tasks.workunit.client.0.smithi043.stdout:5/529: fsync d3/f6e 0 2023-12-08T20:28:22.398 INFO:tasks.workunit.client.0.smithi043.stdout:5/530: fsync d3/d7/de/f1d 0 2023-12-08T20:28:22.398 INFO:tasks.workunit.client.0.smithi043.stdout:5/531: fsync d3/d7/de/f24 0 2023-12-08T20:28:22.398 INFO:tasks.workunit.client.0.smithi043.stdout:5/532: chown d3/l85 103528714 1 2023-12-08T20:28:22.398 INFO:tasks.workunit.client.0.smithi043.stdout:5/533: fdatasync d3/d7/d21/f4d 0 2023-12-08T20:28:22.399 INFO:tasks.workunit.client.0.smithi043.stdout:1/557: mknod d1/d16/d1c/d71/dc5/ccb 0 2023-12-08T20:28:22.399 INFO:tasks.workunit.client.0.smithi043.stdout:1/558: chown d1/d16/d1c/f91 0 1 2023-12-08T20:28:22.399 INFO:tasks.workunit.client.0.smithi043.stdout:1/559: write d1/d16/d30/d4f/fbd [177284,1232] 0 2023-12-08T20:28:22.407 INFO:tasks.workunit.client.0.smithi043.stdout:8/523: mknod d2/d27/d2d/d31/d7f/ca7 0 2023-12-08T20:28:22.409 INFO:tasks.workunit.client.0.smithi043.stdout:6/547: mkdir d0/d2/d14/d2c/d22/d2a/db2/dba 0 2023-12-08T20:28:22.412 INFO:tasks.workunit.client.0.smithi043.stdout:0/821: rename d2/d3/d18/d1e/d53/d10b/d39/d83/fa1 to d2/d3/d18/d1e/d53/d10b/d39/dd8/f110 0 2023-12-08T20:28:22.416 INFO:tasks.workunit.client.0.smithi043.stdout:1/560: mknod d1/d16/d1c/d81/dad/ccc 0 2023-12-08T20:28:22.417 INFO:tasks.workunit.client.0.smithi043.stdout:1/561: read d1/d16/d21/d25/d3e/d77/d9f/fb6 [3679439,26988] 0 2023-12-08T20:28:22.417 INFO:tasks.workunit.client.0.smithi043.stdout:1/562: read - d1/d16/d86/fb5 zero size 2023-12-08T20:28:22.418 INFO:tasks.workunit.client.0.smithi043.stdout:8/524: symlink d2/d20/d7d/la8 0 2023-12-08T20:28:22.418 INFO:tasks.workunit.client.0.smithi043.stdout:3/557: dwrite d1/d25/d2a/d45/f58 [4194304,4194304] 0 2023-12-08T20:28:22.420 INFO:tasks.workunit.client.0.smithi043.stdout:9/551: rename d0/d3d/d4b/d5c/l60 to d0/d3d/d4b/d65/laf 0 2023-12-08T20:28:22.421 INFO:tasks.workunit.client.0.smithi043.stdout:3/558: write d1/f18 [3556639,63459] 0 2023-12-08T20:28:22.421 INFO:tasks.workunit.client.0.smithi043.stdout:0/822: getdents d2/d3/d18/d2b/da5/d5f 0 2023-12-08T20:28:22.423 INFO:tasks.workunit.client.0.smithi043.stdout:0/823: write d2/d4/f66 [6978996,94411] 0 2023-12-08T20:28:22.423 INFO:tasks.workunit.client.0.smithi043.stdout:0/824: chown d2/d3/d18/d1e/d53/d10b/d39/d5e 0 1 2023-12-08T20:28:22.424 INFO:tasks.workunit.client.0.smithi043.stdout:8/525: creat d2/d20/d7d/fa9 x:0 0 0 2023-12-08T20:28:22.424 INFO:tasks.workunit.client.0.smithi043.stdout:8/526: dread - d2/d20/d7d/d29/f6c zero size 2023-12-08T20:28:22.424 INFO:tasks.workunit.client.0.smithi043.stdout:8/527: chown d2/d6f/l73 1258452306 1 2023-12-08T20:28:22.424 INFO:tasks.workunit.client.0.smithi043.stdout:8/528: fdatasync d2/d27/d2d/f7a 0 2023-12-08T20:28:22.424 INFO:tasks.workunit.client.0.smithi043.stdout:8/529: chown d2/d20/d7d/f61 53161167 1 2023-12-08T20:28:22.426 INFO:tasks.workunit.client.0.smithi043.stdout:7/564: dwrite d0/d6/d17/dab/fb4 [0,4194304] 0 2023-12-08T20:28:22.426 INFO:tasks.workunit.client.0.smithi043.stdout:7/565: getdents d0/d69/d6d/d87 0 2023-12-08T20:28:22.427 INFO:tasks.workunit.client.0.smithi043.stdout:6/548: rename d0/d2/d14/d2c/fb9 to d0/d2/d14/d2c/d22/d2a/db2/dba/fbb 0 2023-12-08T20:28:22.427 INFO:tasks.workunit.client.0.smithi043.stdout:6/549: fdatasync d0/d2/d14/d2c/f3b 0 2023-12-08T20:28:22.429 INFO:tasks.workunit.client.0.smithi043.stdout:0/825: symlink d2/d3/d18/d1e/dcc/l111 0 2023-12-08T20:28:22.429 INFO:tasks.workunit.client.0.smithi043.stdout:0/826: truncate d2/d61/ff1 459740 0 2023-12-08T20:28:22.429 INFO:tasks.workunit.client.0.smithi043.stdout:0/827: chown d2/d3/d18/d1e/d53/d10b/c29 41097 1 2023-12-08T20:28:22.431 INFO:tasks.workunit.client.0.smithi043.stdout:4/580: sync 2023-12-08T20:28:22.431 INFO:tasks.workunit.client.0.smithi043.stdout:2/810: sync 2023-12-08T20:28:22.436 INFO:tasks.workunit.client.0.smithi043.stdout:8/530: mkdir d2/d20/d7d/d29/d30/d7c/daa 0 2023-12-08T20:28:22.437 INFO:tasks.workunit.client.0.smithi043.stdout:7/566: creat d0/d2/d65/fb5 x:0 0 0 2023-12-08T20:28:22.439 INFO:tasks.workunit.client.0.smithi043.stdout:4/581: symlink d1/d14/d25/d28/lc8 0 2023-12-08T20:28:22.441 INFO:tasks.workunit.client.0.smithi043.stdout:1/563: rename d1/d16/d1c/d81 to d1/d16/d1c/d4e/dcd 0 2023-12-08T20:28:22.443 INFO:tasks.workunit.client.0.smithi043.stdout:2/811: creat d0/db/d18/d8b/f104 x:0 0 0 2023-12-08T20:28:22.443 INFO:tasks.workunit.client.0.smithi043.stdout:5/534: write d3/d7/f1a [230550,124785] 0 2023-12-08T20:28:22.445 INFO:tasks.workunit.client.0.smithi043.stdout:8/531: getdents d2/d27/d2d 0 2023-12-08T20:28:22.447 INFO:tasks.workunit.client.0.smithi043.stdout:4/582: rename d1/d14/d25/d28/fc1 to d1/d14/d25/d39/d3f/d3c/d41/db6/fc9 0 2023-12-08T20:28:22.448 INFO:tasks.workunit.client.0.smithi043.stdout:1/564: link d1/d16/d21/d25/l8e d1/d16/d21/d6f/daa/lce 0 2023-12-08T20:28:22.449 INFO:tasks.workunit.client.0.smithi043.stdout:5/535: symlink d3/d7/d21/d51/la2 0 2023-12-08T20:28:22.450 INFO:tasks.workunit.client.0.smithi043.stdout:8/532: mkdir d2/d27/dab 0 2023-12-08T20:28:22.450 INFO:tasks.workunit.client.0.smithi043.stdout:8/533: write d2/d27/d2d/d31/d74/fa5 [265320,26737] 0 2023-12-08T20:28:22.450 INFO:tasks.workunit.client.0.smithi043.stdout:8/534: fsync d2/d27/d2d/d31/d7f/f93 0 2023-12-08T20:28:22.451 INFO:tasks.workunit.client.0.smithi043.stdout:4/583: creat d1/d14/d25/d77/d93/fca x:0 0 0 2023-12-08T20:28:22.451 INFO:tasks.workunit.client.0.smithi043.stdout:1/565: mknod d1/d16/d30/ccf 0 2023-12-08T20:28:22.451 INFO:tasks.workunit.client.0.smithi043.stdout:2/812: dread d0/db/f63 [0,4194304] 0 2023-12-08T20:28:22.451 INFO:tasks.workunit.client.0.smithi043.stdout:4/584: write d1/f92 [1350796,115799] 0 2023-12-08T20:28:22.452 INFO:tasks.workunit.client.0.smithi043.stdout:8/535: link d2/d20/c3f d2/d20/d7d/d29/d30/d60/d9b/cac 0 2023-12-08T20:28:22.453 INFO:tasks.workunit.client.0.smithi043.stdout:8/536: write d2/d20/f78 [1002657,101073] 0 2023-12-08T20:28:22.453 INFO:tasks.workunit.client.0.smithi043.stdout:1/566: unlink d1/d16/f47 0 2023-12-08T20:28:22.455 INFO:tasks.workunit.client.0.smithi043.stdout:2/813: link d0/d26/d53/f75 d0/d20/f105 0 2023-12-08T20:28:22.455 INFO:tasks.workunit.client.0.smithi043.stdout:2/814: dread - d0/d26/dbc/ff0 zero size 2023-12-08T20:28:22.457 INFO:tasks.workunit.client.0.smithi043.stdout:1/567: rename d1/d16/d30/d4f/d54/f79 to d1/d16/d30/fd0 0 2023-12-08T20:28:22.457 INFO:tasks.workunit.client.0.smithi043.stdout:8/537: dread d2/d20/d7d/f26 [0,4194304] 0 2023-12-08T20:28:22.458 INFO:tasks.workunit.client.0.smithi043.stdout:8/538: dread - d2/d20/d7d/d37/d5a/f9a zero size 2023-12-08T20:28:22.458 INFO:tasks.workunit.client.0.smithi043.stdout:9/552: dwrite d0/f14 [0,4194304] 0 2023-12-08T20:28:22.459 INFO:tasks.workunit.client.0.smithi043.stdout:0/828: dwrite d2/d3/d18/d1e/d53/d10b/d39/dd8/de6/fe8 [0,4194304] 0 2023-12-08T20:28:22.459 INFO:tasks.workunit.client.0.smithi043.stdout:2/815: link d0/d26/d53/ldf d0/l106 0 2023-12-08T20:28:22.459 INFO:tasks.workunit.client.0.smithi043.stdout:6/550: dwrite d0/d2/d14/d2c/d22/d3f/d45/d69/fb6 [0,4194304] 0 2023-12-08T20:28:22.460 INFO:tasks.workunit.client.0.smithi043.stdout:3/559: dwrite d1/d25/f24 [0,4194304] 0 2023-12-08T20:28:22.460 INFO:tasks.workunit.client.0.smithi043.stdout:2/816: write d0/d26/dbc/d38/f4f [1008174,7214] 0 2023-12-08T20:28:22.460 INFO:tasks.workunit.client.0.smithi043.stdout:1/568: symlink d1/d16/d21/d25/d3e/dbc/db8/ld1 0 2023-12-08T20:28:22.460 INFO:tasks.workunit.client.0.smithi043.stdout:1/569: truncate d1/d16/d21/d25/d35/f9e 151321 0 2023-12-08T20:28:22.461 INFO:tasks.workunit.client.0.smithi043.stdout:9/553: mknod d0/d5e/dad/d6b/cb0 0 2023-12-08T20:28:22.462 INFO:tasks.workunit.client.0.smithi043.stdout:9/554: stat d0/l18 0 2023-12-08T20:28:22.463 INFO:tasks.workunit.client.0.smithi043.stdout:5/536: dread d3/d7/de/f18 [4194304,4194304] 0 2023-12-08T20:28:22.464 INFO:tasks.workunit.client.0.smithi043.stdout:0/829: truncate d2/d61/d8a/fd2 993778 0 2023-12-08T20:28:22.465 INFO:tasks.workunit.client.0.smithi043.stdout:6/551: rename d0/d2/d14/d20/d3c/d50/l82 to d0/d2/d14/d20/d53/lbc 0 2023-12-08T20:28:22.465 INFO:tasks.workunit.client.0.smithi043.stdout:6/552: readlink d0/d2/de/d4a/d56/la2 0 2023-12-08T20:28:22.466 INFO:tasks.workunit.client.0.smithi043.stdout:7/567: rmdir d0/d2/d65 39 2023-12-08T20:28:22.468 INFO:tasks.workunit.client.0.smithi043.stdout:3/560: getdents d1/d1c/d2c/d7f 0 2023-12-08T20:28:22.474 INFO:tasks.workunit.client.0.smithi043.stdout:1/570: symlink d1/d16/d30/d4f/ld2 0 2023-12-08T20:28:22.474 INFO:tasks.workunit.client.0.smithi043.stdout:1/571: write d1/d16/d86/fa5 [517853,29376] 0 2023-12-08T20:28:22.475 INFO:tasks.workunit.client.0.smithi043.stdout:9/555: getdents d0/d3d/d4b/d65 0 2023-12-08T20:28:22.476 INFO:tasks.workunit.client.0.smithi043.stdout:9/556: read d0/d5e/dad/d6b/d94/fa0 [1004343,77777] 0 2023-12-08T20:28:22.477 INFO:tasks.workunit.client.0.smithi043.stdout:5/537: creat d3/d7/d21/fa3 x:0 0 0 2023-12-08T20:28:22.478 INFO:tasks.workunit.client.0.smithi043.stdout:8/539: dwrite d2/d20/d7d/f77 [0,4194304] 0 2023-12-08T20:28:22.482 INFO:tasks.workunit.client.0.smithi043.stdout:0/830: mkdir d2/d3/d18/d2b/da5/d3f/d112 0 2023-12-08T20:28:22.482 INFO:tasks.workunit.client.0.smithi043.stdout:6/553: rmdir d0/d2/de/d4a/d56 39 2023-12-08T20:28:22.482 INFO:tasks.workunit.client.0.smithi043.stdout:0/831: chown d2/d3/fef 724390 1 2023-12-08T20:28:22.482 INFO:tasks.workunit.client.0.smithi043.stdout:6/554: stat d0/d2/d14/d2c/d22/d3f/d45 0 2023-12-08T20:28:22.482 INFO:tasks.workunit.client.0.smithi043.stdout:6/555: write d0/d2/de/d4a/d56/f72 [5235136,125809] 0 2023-12-08T20:28:22.483 INFO:tasks.workunit.client.0.smithi043.stdout:7/568: symlink d0/d2/d12/d19/d38/d85/lb6 0 2023-12-08T20:28:22.483 INFO:tasks.workunit.client.0.smithi043.stdout:7/569: stat d0/d2/d65/d99/d47/c93 0 2023-12-08T20:28:22.484 INFO:tasks.workunit.client.0.smithi043.stdout:2/817: creat d0/db/d18/d8b/d9d/f107 x:0 0 0 2023-12-08T20:28:22.484 INFO:tasks.workunit.client.0.smithi043.stdout:2/818: fsync d0/db/d18/d8b/fe4 0 2023-12-08T20:28:22.486 INFO:tasks.workunit.client.0.smithi043.stdout:1/572: rename d1/d16/d30/d4f/d54/c8b to d1/d16/d21/dc8/cd3 0 2023-12-08T20:28:22.487 INFO:tasks.workunit.client.0.smithi043.stdout:9/557: link d0/d5e/c41 d0/d5e/dad/d6b/d76/d53/cb1 0 2023-12-08T20:28:22.488 INFO:tasks.workunit.client.0.smithi043.stdout:5/538: mkdir d3/d73/da4 0 2023-12-08T20:28:22.491 INFO:tasks.workunit.client.0.smithi043.stdout:0/832: dread d2/d3/d18/d2b/da5/f5c [0,4194304] 0 2023-12-08T20:28:22.491 INFO:tasks.workunit.client.0.smithi043.stdout:0/833: chown d2/d3/d18/fc7 2189094 1 2023-12-08T20:28:22.497 INFO:tasks.workunit.client.0.smithi043.stdout:8/540: dwrite d2/d6f/f82 [0,4194304] 0 2023-12-08T20:28:22.497 INFO:tasks.workunit.client.0.smithi043.stdout:8/541: fsync d2/d20/d7d/d29/d30/d71/f8d 0 2023-12-08T20:28:22.497 INFO:tasks.workunit.client.0.smithi043.stdout:6/556: link d0/d2/d14/d2c/d22/d3f/d45/d6b/lb4 d0/d2/de/d4a/lbd 0 2023-12-08T20:28:22.500 INFO:tasks.workunit.client.0.smithi043.stdout:2/819: creat d0/d26/d53/f108 x:0 0 0 2023-12-08T20:28:22.500 INFO:tasks.workunit.client.0.smithi043.stdout:7/570: symlink d0/d2/d12/d19/d38/d85/lb7 0 2023-12-08T20:28:22.502 INFO:tasks.workunit.client.0.smithi043.stdout:9/558: creat d0/d3d/d4b/d5c/fb2 x:0 0 0 2023-12-08T20:28:22.503 INFO:tasks.workunit.client.0.smithi043.stdout:0/834: mkdir d2/d61/d67/d113 0 2023-12-08T20:28:22.503 INFO:tasks.workunit.client.0.smithi043.stdout:0/835: chown d2/d3/d18/d1e/d53/d10b/d39/d63/cc6 189988724 1 2023-12-08T20:28:22.507 INFO:tasks.workunit.client.0.smithi043.stdout:0/836: dread d2/d3/d18/d2b/da5/da3/fda [0,4194304] 0 2023-12-08T20:28:22.507 INFO:tasks.workunit.client.0.smithi043.stdout:2/820: truncate d0/f24 1658784 0 2023-12-08T20:28:22.508 INFO:tasks.workunit.client.0.smithi043.stdout:1/573: dwrite d1/d16/d21/d25/d3e/d72/fb7 [0,4194304] 0 2023-12-08T20:28:22.509 INFO:tasks.workunit.client.0.smithi043.stdout:1/574: stat d1/d16/d21/d25/cca 0 2023-12-08T20:28:22.509 INFO:tasks.workunit.client.0.smithi043.stdout:7/571: getdents d0/d2/d65/d83 0 2023-12-08T20:28:22.510 INFO:tasks.workunit.client.0.smithi043.stdout:1/575: read d1/f2 [3923241,57216] 0 2023-12-08T20:28:22.511 INFO:tasks.workunit.client.0.smithi043.stdout:2/821: dread d0/db/d18/f7e [0,4194304] 0 2023-12-08T20:28:22.513 INFO:tasks.workunit.client.0.smithi043.stdout:6/557: dread d0/d2/d14/d2c/d22/d3f/d45/f6d [0,4194304] 0 2023-12-08T20:28:22.516 INFO:tasks.workunit.client.0.smithi043.stdout:9/559: link d0/d5e/dad/d6b/d6c/f7d d0/d21/d80/fb3 0 2023-12-08T20:28:22.517 INFO:tasks.workunit.client.0.smithi043.stdout:9/560: dread - d0/d5e/dad/d6b/d6c/faa zero size 2023-12-08T20:28:22.517 INFO:tasks.workunit.client.0.smithi043.stdout:4/585: dwrite d1/d14/f1a [0,4194304] 0 2023-12-08T20:28:22.518 INFO:tasks.workunit.client.0.smithi043.stdout:8/542: dwrite d2/d27/d2d/d31/d74/fa5 [0,4194304] 0 2023-12-08T20:28:22.519 INFO:tasks.workunit.client.0.smithi043.stdout:0/837: truncate d2/d3/d18/d1e/d53/d10b/d39/f8d 846252 0 2023-12-08T20:28:22.519 INFO:tasks.workunit.client.0.smithi043.stdout:0/838: chown d2/d3/d18/cf9 1284 1 2023-12-08T20:28:22.521 INFO:tasks.workunit.client.0.smithi043.stdout:1/576: unlink d1/l6a 0 2023-12-08T20:28:22.521 INFO:tasks.workunit.client.0.smithi043.stdout:1/577: fsync d1/d16/d1c/f44 0 2023-12-08T20:28:22.523 INFO:tasks.workunit.client.0.smithi043.stdout:8/543: write d2/d27/f35 [2765580,111309] 0 2023-12-08T20:28:22.523 INFO:tasks.workunit.client.0.smithi043.stdout:2/822: creat d0/d26/dbc/f109 x:0 0 0 2023-12-08T20:28:22.523 INFO:tasks.workunit.client.0.smithi043.stdout:2/823: write d0/db/d18/d8b/db4/fb5 [154108,108006] 0 2023-12-08T20:28:22.525 INFO:tasks.workunit.client.0.smithi043.stdout:6/558: mknod d0/d2/de/cbe 0 2023-12-08T20:28:22.531 INFO:tasks.workunit.client.0.smithi043.stdout:7/572: dread d0/d2/d65/d99/fa3 [0,4194304] 0 2023-12-08T20:28:22.532 INFO:tasks.workunit.client.0.smithi043.stdout:7/573: fdatasync d0/d2/d12/f32 0 2023-12-08T20:28:22.532 INFO:tasks.workunit.client.0.smithi043.stdout:7/574: chown d0/d6/l7e 84 1 2023-12-08T20:28:22.532 INFO:tasks.workunit.client.0.smithi043.stdout:0/839: unlink d2/d3/d18/d1e/d53/d10b/d39/d63/l80 0 2023-12-08T20:28:22.533 INFO:tasks.workunit.client.0.smithi043.stdout:8/544: creat d2/d20/d7d/d29/d59/d86/fad x:0 0 0 2023-12-08T20:28:22.533 INFO:tasks.workunit.client.0.smithi043.stdout:8/545: readlink d2/d20/d7d/d29/d30/l3d 0 2023-12-08T20:28:22.533 INFO:tasks.workunit.client.0.smithi043.stdout:8/546: read - d2/d27/d2d/d31/d7f/f93 zero size 2023-12-08T20:28:22.536 INFO:tasks.workunit.client.0.smithi043.stdout:2/824: creat d0/d26/dbc/d38/dae/dc0/f10a x:0 0 0 2023-12-08T20:28:22.536 INFO:tasks.workunit.client.0.smithi043.stdout:7/575: dread d0/d2/d12/d19/d38/f58 [0,4194304] 0 2023-12-08T20:28:22.538 INFO:tasks.workunit.client.0.smithi043.stdout:6/559: unlink d0/d2/d14/d20/d53/d73/c96 0 2023-12-08T20:28:22.538 INFO:tasks.workunit.client.0.smithi043.stdout:6/560: chown d0/d2/d14/d2c/d22/d3f/d45/f98 9 1 2023-12-08T20:28:22.538 INFO:tasks.workunit.client.0.smithi043.stdout:6/561: fdatasync d0/d2/d14/d2c/d22/d3f/d45/f98 0 2023-12-08T20:28:22.540 INFO:tasks.workunit.client.0.smithi043.stdout:6/562: dread d0/d2/d14/d8/d47/f80 [0,4194304] 0 2023-12-08T20:28:22.540 INFO:tasks.workunit.client.0.smithi043.stdout:8/547: link d2/f9d d2/d6f/fae 0 2023-12-08T20:28:22.541 INFO:tasks.workunit.client.0.smithi043.stdout:4/586: dwrite d1/d14/d1d/d58/fc4 [0,4194304] 0 2023-12-08T20:28:22.544 INFO:tasks.workunit.client.0.smithi043.stdout:7/576: rename d0/d6/d17/d54/f59 to d0/d69/fb8 0 2023-12-08T20:28:22.544 INFO:tasks.workunit.client.0.smithi043.stdout:6/563: truncate d0/d2/f36 866720 0 2023-12-08T20:28:22.546 INFO:tasks.workunit.client.0.smithi043.stdout:8/548: link d2/d20/d7d/d37/f1f d2/d27/d2d/d31/d99/faf 0 2023-12-08T20:28:22.547 INFO:tasks.workunit.client.0.smithi043.stdout:9/561: dwrite d0/d5e/dad/f3a [0,4194304] 0 2023-12-08T20:28:22.547 INFO:tasks.workunit.client.0.smithi043.stdout:0/840: dread d2/d3/d18/d1e/d53/d10b/d39/d63/f89 [4194304,4194304] 0 2023-12-08T20:28:22.547 INFO:tasks.workunit.client.0.smithi043.stdout:0/841: fsync d2/d3/d18/f22 0 2023-12-08T20:28:22.547 INFO:tasks.workunit.client.0.smithi043.stdout:0/842: fsync d2/d3/d18/f22 0 2023-12-08T20:28:22.549 INFO:tasks.workunit.client.0.smithi043.stdout:1/578: dwrite d1/d16/d21/d42/fb9 [0,4194304] 0 2023-12-08T20:28:22.549 INFO:tasks.workunit.client.0.smithi043.stdout:1/579: write d1/d16/d86/fb5 [691870,8559] 0 2023-12-08T20:28:22.549 INFO:tasks.workunit.client.0.smithi043.stdout:1/580: fsync d1/d16/d21/d25/d35/fac 0 2023-12-08T20:28:22.549 INFO:tasks.workunit.client.0.smithi043.stdout:1/581: readlink d1/l11 0 2023-12-08T20:28:22.549 INFO:tasks.workunit.client.0.smithi043.stdout:1/582: chown d1/d16/d48/f53 5283289 1 2023-12-08T20:28:22.550 INFO:tasks.workunit.client.0.smithi043.stdout:1/583: truncate d1/d16/f49 1510375 0 2023-12-08T20:28:22.550 INFO:tasks.workunit.client.0.smithi043.stdout:1/584: truncate d1/d16/d48/f65 390802 0 2023-12-08T20:28:22.550 INFO:tasks.workunit.client.0.smithi043.stdout:2/825: symlink d0/db/l10b 0 2023-12-08T20:28:22.550 INFO:tasks.workunit.client.0.smithi043.stdout:4/587: rename d1/f1c to d1/d14/d25/d77/da4/dc0/fcb 0 2023-12-08T20:28:22.552 INFO:tasks.workunit.client.0.smithi043.stdout:7/577: creat d0/d2/d65/d83/fb9 x:0 0 0 2023-12-08T20:28:22.553 INFO:tasks.workunit.client.0.smithi043.stdout:6/564: rmdir d0/d2 39 2023-12-08T20:28:22.556 INFO:tasks.workunit.client.0.smithi043.stdout:9/562: creat d0/d5e/dad/fb4 x:0 0 0 2023-12-08T20:28:22.556 INFO:tasks.workunit.client.0.smithi043.stdout:9/563: chown d0/d21/f74 903 1 2023-12-08T20:28:22.560 INFO:tasks.workunit.client.0.smithi043.stdout:1/585: read d1/d16/f46 [141955,51993] 0 2023-12-08T20:28:22.560 INFO:tasks.workunit.client.0.smithi043.stdout:1/586: readlink d1/d16/d1c/l27 0 2023-12-08T20:28:22.563 INFO:tasks.workunit.client.0.smithi043.stdout:7/578: unlink d0/d2/d65/d99/c4d 0 2023-12-08T20:28:22.566 INFO:tasks.workunit.client.0.smithi043.stdout:9/564: creat d0/d3d/d4b/d61/fb5 x:0 0 0 2023-12-08T20:28:22.571 INFO:tasks.workunit.client.0.smithi043.stdout:1/587: unlink d1/fb 0 2023-12-08T20:28:22.572 INFO:tasks.workunit.client.0.smithi043.stdout:7/579: link d0/d2/f5 d0/d6/fba 0 2023-12-08T20:28:22.575 INFO:tasks.workunit.client.0.smithi043.stdout:9/565: link d0/l3f d0/d5e/dad/d6b/d94/lb6 0 2023-12-08T20:28:22.577 INFO:tasks.workunit.client.0.smithi043.stdout:7/580: write d0/d2/d12/d19/d38/f9d [1794684,53429] 0 2023-12-08T20:28:22.577 INFO:tasks.workunit.client.0.smithi043.stdout:7/581: chown d0/f3d 1419 1 2023-12-08T20:28:22.577 INFO:tasks.workunit.client.0.smithi043.stdout:7/582: chown d0/d2/c3e 21 1 2023-12-08T20:28:22.582 INFO:tasks.workunit.client.0.smithi043.stdout:7/583: unlink d0/d2/d65/d83/l92 0 2023-12-08T20:28:22.591 INFO:tasks.workunit.client.0.smithi043.stdout:0/843: dwrite d2/d3/d18/d1e/d53/d10b/d39/d5e/f96 [0,4194304] 0 2023-12-08T20:28:22.593 INFO:tasks.workunit.client.0.smithi043.stdout:0/844: getdents d2/d3/d18/d1e 0 2023-12-08T20:28:22.594 INFO:tasks.workunit.client.0.smithi043.stdout:0/845: creat d2/d3/d18/d1e/dcc/f114 x:0 0 0 2023-12-08T20:28:22.595 INFO:tasks.workunit.client.0.smithi043.stdout:0/846: getdents d2/d3/d18/d2b/da5/d3f/d112 0 2023-12-08T20:28:22.595 INFO:tasks.workunit.client.0.smithi043.stdout:0/847: chown d2/d4/ffd 1007715 1 2023-12-08T20:28:22.595 INFO:tasks.workunit.client.0.smithi043.stdout:0/848: read - d2/d61/dc0/f103 zero size 2023-12-08T20:28:22.595 INFO:tasks.workunit.client.0.smithi043.stdout:8/549: dwrite d2/d27/d2d/d31/d99/faf [4194304,4194304] 0 2023-12-08T20:28:22.595 INFO:tasks.workunit.client.0.smithi043.stdout:4/588: dwrite d1/d14/d50/f9a [0,4194304] 0 2023-12-08T20:28:22.595 INFO:tasks.workunit.client.0.smithi043.stdout:0/849: truncate d2/f7 2472990 0 2023-12-08T20:28:22.597 INFO:tasks.workunit.client.0.smithi043.stdout:8/550: creat d2/d27/d2d/d31/d4f/fb0 x:0 0 0 2023-12-08T20:28:22.598 INFO:tasks.workunit.client.0.smithi043.stdout:4/589: creat d1/d14/d25/d39/d3d/d40/d67/d7f/fcc x:0 0 0 2023-12-08T20:28:22.598 INFO:tasks.workunit.client.0.smithi043.stdout:4/590: truncate d1/d14/d25/d39/da3/dae/fbf 313952 0 2023-12-08T20:28:22.600 INFO:tasks.workunit.client.0.smithi043.stdout:6/565: dwrite d0/d2/d14/d2c/f65 [0,4194304] 0 2023-12-08T20:28:22.600 INFO:tasks.workunit.client.0.smithi043.stdout:2/826: dwrite d0/d26/d53/fbb [0,4194304] 0 2023-12-08T20:28:22.600 INFO:tasks.workunit.client.0.smithi043.stdout:6/566: fsync d0/d2/d14/d2c/d22/d2a/db2/dba/fbb 0 2023-12-08T20:28:22.600 INFO:tasks.workunit.client.0.smithi043.stdout:2/827: chown d0/d20/d42/d49/c5e 1942966 1 2023-12-08T20:28:22.600 INFO:tasks.workunit.client.0.smithi043.stdout:2/828: readlink d0/l4c 0 2023-12-08T20:28:22.600 INFO:tasks.workunit.client.0.smithi043.stdout:0/850: mkdir d2/d3/d18/d1e/d53/d10b/d39/d83/d115 0 2023-12-08T20:28:22.600 INFO:tasks.workunit.client.0.smithi043.stdout:1/588: dwrite d1/d16/d21/d25/d3e/d72/f74 [0,4194304] 0 2023-12-08T20:28:22.600 INFO:tasks.workunit.client.0.smithi043.stdout:8/551: creat d2/d20/fb1 x:0 0 0 2023-12-08T20:28:22.602 INFO:tasks.workunit.client.0.smithi043.stdout:4/591: mknod d1/d14/d25/d28/ccd 0 2023-12-08T20:28:22.613 INFO:tasks.workunit.client.0.smithi043.stdout:2/829: link d0/d26/c1f d0/d81/c10c 0 2023-12-08T20:28:22.614 INFO:tasks.workunit.client.0.smithi043.stdout:6/567: symlink d0/d2/d14/d20/d3c/d50/lbf 0 2023-12-08T20:28:22.616 INFO:tasks.workunit.client.0.smithi043.stdout:0/851: mknod d2/d3/d18/d2b/da5/d3f/d112/c116 0 2023-12-08T20:28:22.618 INFO:tasks.workunit.client.0.smithi043.stdout:1/589: mkdir d1/d16/d48/dd4 0 2023-12-08T20:28:22.619 INFO:tasks.workunit.client.0.smithi043.stdout:8/552: stat d2/d27/d2d/d31/d7f/l80 0 2023-12-08T20:28:22.620 INFO:tasks.workunit.client.0.smithi043.stdout:4/592: truncate d1/d14/d25/d39/d3d/d40/d67/f68 2149673 0 2023-12-08T20:28:22.623 INFO:tasks.workunit.client.0.smithi043.stdout:2/830: rename d0/l4c to d0/db/d18/d66/d71/l10d 0 2023-12-08T20:28:22.625 INFO:tasks.workunit.client.0.smithi043.stdout:0/852: unlink d2/d3/d18/d2b/f106 0 2023-12-08T20:28:22.626 INFO:tasks.workunit.client.0.smithi043.stdout:1/590: creat d1/d16/d21/d25/d3e/dbc/db8/fd5 x:0 0 0 2023-12-08T20:28:22.627 INFO:tasks.workunit.client.0.smithi043.stdout:1/591: write d1/d16/d30/d4f/d54/f78 [849142,94732] 0 2023-12-08T20:28:22.628 INFO:tasks.workunit.client.0.smithi043.stdout:4/593: rename d1/cf to d1/d14/d25/d39/d3f/d3c/d41/d65/cce 0 2023-12-08T20:28:22.629 INFO:tasks.workunit.client.0.smithi043.stdout:6/568: dwrite d0/d2/d14/d20/d49/f64 [0,4194304] 0 2023-12-08T20:28:22.632 INFO:tasks.workunit.client.0.smithi043.stdout:0/853: creat d2/d3/d18/d1e/d53/d10b/d39/d63/da6/dae/f117 x:0 0 0 2023-12-08T20:28:22.632 INFO:tasks.workunit.client.0.smithi043.stdout:2/831: symlink d0/d20/l10e 0 2023-12-08T20:28:22.632 INFO:tasks.workunit.client.0.smithi043.stdout:0/854: chown d2/d3/d18/d1e/d88/f104 1813 1 2023-12-08T20:28:22.632 INFO:tasks.workunit.client.0.smithi043.stdout:2/832: write d0/db/d18/d8b/d9d/f107 [570651,18849] 0 2023-12-08T20:28:22.632 INFO:tasks.workunit.client.0.smithi043.stdout:2/833: chown d0/db/f4a 68599910 1 2023-12-08T20:28:22.632 INFO:tasks.workunit.client.0.smithi043.stdout:6/569: mkdir d0/d2/d14/d20/dc0 0 2023-12-08T20:28:22.634 INFO:tasks.workunit.client.0.smithi043.stdout:2/834: creat d0/d81/daa/f10f x:0 0 0 2023-12-08T20:28:22.634 INFO:tasks.workunit.client.0.smithi043.stdout:2/835: write d0/d20/d42/d49/f5f [1596053,62203] 0 2023-12-08T20:28:22.634 INFO:tasks.workunit.client.0.smithi043.stdout:2/836: getdents d0/d20/d42/dcb 0 2023-12-08T20:28:22.635 INFO:tasks.workunit.client.0.smithi043.stdout:6/570: creat d0/d2/d14/d2c/d22/d2a/db2/fc1 x:0 0 0 2023-12-08T20:28:22.643 INFO:tasks.workunit.client.0.smithi043.stdout:0/855: dread d2/d3/d18/d1e/d53/d7d/f93 [0,4194304] 0 2023-12-08T20:28:22.643 INFO:tasks.workunit.client.0.smithi043.stdout:0/856: mknod d2/d61/d67/d113/c118 0 2023-12-08T20:28:22.645 INFO:tasks.workunit.client.0.smithi043.stdout:0/857: creat d2/d3/d18/d1e/df5/f119 x:0 0 0 2023-12-08T20:28:22.645 INFO:tasks.workunit.client.0.smithi043.stdout:2/837: dread d0/db/fa5 [0,4194304] 0 2023-12-08T20:28:22.645 INFO:tasks.workunit.client.0.smithi043.stdout:1/592: dwrite d1/d16/d48/f4a [0,4194304] 0 2023-12-08T20:28:22.646 INFO:tasks.workunit.client.0.smithi043.stdout:2/838: creat d0/d26/dbc/d38/dae/f110 x:0 0 0 2023-12-08T20:28:22.649 INFO:tasks.workunit.client.0.smithi043.stdout:1/593: rename d1/d16/d30/d4f/f89 to d1/d16/d1c/d71/d98/fd6 0 2023-12-08T20:28:22.649 INFO:tasks.workunit.client.0.smithi043.stdout:1/594: write d1/d16/d21/d25/d3e/d72/fb7 [4675597,27302] 0 2023-12-08T20:28:22.649 INFO:tasks.workunit.client.0.smithi043.stdout:1/595: stat d1/d16/d30/d6e 0 2023-12-08T20:28:22.649 INFO:tasks.workunit.client.0.smithi043.stdout:1/596: truncate d1/d16/f28 5653025 0 2023-12-08T20:28:22.649 INFO:tasks.workunit.client.0.smithi043.stdout:0/858: dread d2/d3/d18/d1e/d53/d10b/d39/f8d [0,4194304] 0 2023-12-08T20:28:22.649 INFO:tasks.workunit.client.0.smithi043.stdout:0/859: dread - d2/d61/dc1/fe3 zero size 2023-12-08T20:28:22.651 INFO:tasks.workunit.client.0.smithi043.stdout:1/597: creat d1/d16/d1c/fd7 x:0 0 0 2023-12-08T20:28:22.651 INFO:tasks.workunit.client.0.smithi043.stdout:0/860: getdents d2/d3/d18/d1e/d53/d10b/d39/d5e 0 2023-12-08T20:28:22.651 INFO:tasks.workunit.client.0.smithi043.stdout:0/861: chown d2/d3/d18/d1e/dcc/dea 1 1 2023-12-08T20:28:22.652 INFO:tasks.workunit.client.0.smithi043.stdout:6/571: dread d0/f7f [0,4194304] 0 2023-12-08T20:28:22.654 INFO:tasks.workunit.client.0.smithi043.stdout:1/598: link d1/d16/f4d d1/d16/d30/d4f/fd8 0 2023-12-08T20:28:22.655 INFO:tasks.workunit.client.0.smithi043.stdout:0/862: rename d2/d3/c5 to d2/d3/d18/d1e/d53/d10b/d39/d83/c11a 0 2023-12-08T20:28:22.661 INFO:tasks.workunit.client.0.smithi043.stdout:6/572: mkdir d0/d2/de/d4a/d56/dc2 0 2023-12-08T20:28:22.661 INFO:tasks.workunit.client.0.smithi043.stdout:6/573: read d0/d2/d14/db3/f9a [229354,57136] 0 2023-12-08T20:28:22.662 INFO:tasks.workunit.client.0.smithi043.stdout:1/599: mknod d1/d16/d30/d4f/cd9 0 2023-12-08T20:28:22.662 INFO:tasks.workunit.client.0.smithi043.stdout:6/574: write d0/d2/d14/d2c/d22/d3f/d45/f51 [3013996,111765] 0 2023-12-08T20:28:22.663 INFO:tasks.workunit.client.0.smithi043.stdout:6/575: read d0/d2/f12 [45596,1074] 0 2023-12-08T20:28:22.663 INFO:tasks.workunit.client.0.smithi043.stdout:1/600: mkdir d1/d16/d1c/d71/dda 0 2023-12-08T20:28:22.664 INFO:tasks.workunit.client.0.smithi043.stdout:6/576: mkdir d0/dc3 0 2023-12-08T20:28:22.664 INFO:tasks.workunit.client.0.smithi043.stdout:6/577: fsync d0/d2/d29/f83 0 2023-12-08T20:28:22.664 INFO:tasks.workunit.client.0.smithi043.stdout:6/578: chown d0/d2/d14/d20 4544 1 2023-12-08T20:28:22.665 INFO:tasks.workunit.client.0.smithi043.stdout:1/601: symlink d1/d16/d21/dc8/ldb 0 2023-12-08T20:28:22.667 INFO:tasks.workunit.client.0.smithi043.stdout:6/579: mknod d0/d2/d14/d20/dc0/cc4 0 2023-12-08T20:28:22.668 INFO:tasks.workunit.client.0.smithi043.stdout:1/602: creat d1/db1/dc9/fdc x:0 0 0 2023-12-08T20:28:22.671 INFO:tasks.workunit.client.0.smithi043.stdout:1/603: dread d1/d16/d7e/f9c [0,4194304] 0 2023-12-08T20:28:22.671 INFO:tasks.workunit.client.0.smithi043.stdout:6/580: creat d0/d2/d14/d20/dc0/fc5 x:0 0 0 2023-12-08T20:28:22.671 INFO:tasks.workunit.client.0.smithi043.stdout:6/581: write d0/d2/d14/d2c/d22/d3f/d45/f98 [4766267,39249] 0 2023-12-08T20:28:22.673 INFO:tasks.workunit.client.0.smithi043.stdout:1/604: creat d1/d16/d21/d25/d3e/d77/fdd x:0 0 0 2023-12-08T20:28:22.673 INFO:tasks.workunit.client.0.smithi043.stdout:1/605: read d1/d16/d21/d25/d35/fb0 [3203958,67748] 0 2023-12-08T20:28:22.674 INFO:tasks.workunit.client.0.smithi043.stdout:1/606: symlink d1/db1/lde 0 2023-12-08T20:28:22.674 INFO:tasks.workunit.client.0.smithi043.stdout:1/607: dread - d1/d16/d21/d6f/daa/fbe zero size 2023-12-08T20:28:22.676 INFO:tasks.workunit.client.0.smithi043.stdout:1/608: link d1/d16/d48/f4a d1/d16/d30/d6e/d83/fdf 0 2023-12-08T20:28:22.677 INFO:tasks.workunit.client.0.smithi043.stdout:1/609: unlink d1/d16/d1c/d4e/dcd/cbf 0 2023-12-08T20:28:22.677 INFO:tasks.workunit.client.0.smithi043.stdout:1/610: write d1/d16/d21/d25/d35/f9d [1233827,78484] 0 2023-12-08T20:28:22.677 INFO:tasks.workunit.client.0.smithi043.stdout:1/611: fdatasync d1/d16/d21/d25/d3e/d77/d9f/fb6 0 2023-12-08T20:28:22.678 INFO:tasks.workunit.client.0.smithi043.stdout:1/612: symlink d1/d16/d1c/d71/dda/le0 0 2023-12-08T20:28:22.680 INFO:tasks.workunit.client.0.smithi043.stdout:6/582: dread d0/d2/d14/d20/d3c/d50/f77 [0,4194304] 0 2023-12-08T20:28:22.680 INFO:tasks.workunit.client.0.smithi043.stdout:6/583: write d0/d2/f1f [576092,15879] 0 2023-12-08T20:28:22.682 INFO:tasks.workunit.client.0.smithi043.stdout:6/584: mknod d0/d2/d14/d20/d53/cc6 0 2023-12-08T20:28:22.685 INFO:tasks.workunit.client.0.smithi043.stdout:6/585: creat d0/d2/d14/d2c/d22/fc7 x:0 0 0 2023-12-08T20:28:22.685 INFO:tasks.workunit.client.0.smithi043.stdout:6/586: write d0/d2/d14/d2c/d22/d2a/db2/dba/fbb [4519242,55042] 0 2023-12-08T20:28:22.685 INFO:tasks.workunit.client.0.smithi043.stdout:6/587: creat d0/d2/d14/d2c/d22/fc8 x:0 0 0 2023-12-08T20:28:22.686 INFO:tasks.workunit.client.0.smithi043.stdout:6/588: truncate d0/d2/d14/d8/d47/f80 260992 0 2023-12-08T20:28:22.688 INFO:tasks.workunit.client.0.smithi043.stdout:6/589: rename d0/f48 to d0/d2/d14/d2c/d22/d3f/fc9 0 2023-12-08T20:28:22.691 INFO:tasks.workunit.client.0.smithi043.stdout:6/590: creat d0/dc3/fca x:0 0 0 2023-12-08T20:28:22.699 INFO:tasks.workunit.client.0.smithi043.stdout:6/591: dread d0/d2/d14/d20/d53/f5e [0,4194304] 0 2023-12-08T20:28:22.701 INFO:tasks.workunit.client.0.smithi043.stdout:6/592: mknod d0/d2/d14/d2c/d22/d3f/ccb 0 2023-12-08T20:28:22.701 INFO:tasks.workunit.client.0.smithi043.stdout:1/613: dwrite d1/d16/d1c/f44 [0,4194304] 0 2023-12-08T20:28:22.702 INFO:tasks.workunit.client.0.smithi043.stdout:6/593: unlink d0/d2/d14/l26 0 2023-12-08T20:28:22.703 INFO:tasks.workunit.client.0.smithi043.stdout:6/594: write d0/d2/d14/d2c/d22/d2a/f5a [1898697,118678] 0 2023-12-08T20:28:22.706 INFO:tasks.workunit.client.0.smithi043.stdout:1/614: rename d1/d16/d48/ca1 to d1/d16/d86/ce1 0 2023-12-08T20:28:22.725 INFO:tasks.workunit.client.0.smithi043.stdout:1/615: dwrite d1/d16/d48/f4a [0,4194304] 0 2023-12-08T20:28:22.725 INFO:tasks.workunit.client.0.smithi043.stdout:1/616: write d1/d6/f68 [581793,74578] 0 2023-12-08T20:28:22.726 INFO:tasks.workunit.client.0.smithi043.stdout:1/617: symlink d1/d6/le2 0 2023-12-08T20:28:22.727 INFO:tasks.workunit.client.0.smithi043.stdout:6/595: dwrite d0/d2/d14/d2c/f65 [0,4194304] 0 2023-12-08T20:28:22.727 INFO:tasks.workunit.client.0.smithi043.stdout:6/596: readlink d0/d2/d14/l1b 0 2023-12-08T20:28:22.728 INFO:tasks.workunit.client.0.smithi043.stdout:1/618: rename d1/d16/d21/l8f to d1/d16/d1c/d71/dc5/le3 0 2023-12-08T20:28:22.728 INFO:tasks.workunit.client.0.smithi043.stdout:1/619: stat d1/d16/d21/d25/d3e/d77/d9f 0 2023-12-08T20:28:22.729 INFO:tasks.workunit.client.0.smithi043.stdout:1/620: creat d1/d6/d63/fe4 x:0 0 0 2023-12-08T20:28:22.732 INFO:tasks.workunit.client.0.smithi043.stdout:1/621: read d1/d6/f32 [2854618,49612] 0 2023-12-08T20:28:22.733 INFO:tasks.workunit.client.0.smithi043.stdout:1/622: creat d1/d16/d21/d25/d3e/dbc/fe5 x:0 0 0 2023-12-08T20:28:22.734 INFO:tasks.workunit.client.0.smithi043.stdout:1/623: write d1/f2 [1473649,70284] 0 2023-12-08T20:28:22.736 INFO:tasks.workunit.client.0.smithi043.stdout:1/624: mknod d1/d16/d48/dd4/ce6 0 2023-12-08T20:28:22.744 INFO:tasks.workunit.client.0.smithi043.stdout:6/597: dwrite d0/d2/d14/f18 [0,4194304] 0 2023-12-08T20:28:22.746 INFO:tasks.workunit.client.0.smithi043.stdout:6/598: dread d0/d2/d14/db3/f9a [0,4194304] 0 2023-12-08T20:28:22.746 INFO:tasks.workunit.client.0.smithi043.stdout:6/599: write d0/d2/d14/f90 [949466,28898] 0 2023-12-08T20:28:22.748 INFO:tasks.workunit.client.0.smithi043.stdout:6/600: link d0/d2/d14/d2c/d22/d3f/d45/d6b/lb4 d0/d2/d14/d2c/d22/d3f/d45/lcc 0 2023-12-08T20:28:22.750 INFO:tasks.workunit.client.0.smithi043.stdout:6/601: creat d0/d2/d14/d2c/d22/fcd x:0 0 0 2023-12-08T20:28:22.751 INFO:tasks.workunit.client.0.smithi043.stdout:6/602: creat d0/d2/d14/d20/d3c/d6c/fce x:0 0 0 2023-12-08T20:28:22.754 INFO:tasks.workunit.client.0.smithi043.stdout:6/603: dread d0/d2/d14/d8/f9f [0,4194304] 0 2023-12-08T20:28:22.755 INFO:tasks.workunit.client.0.smithi043.stdout:6/604: creat d0/d2/d14/d2c/d22/d2a/db2/fcf x:0 0 0 2023-12-08T20:28:22.756 INFO:tasks.workunit.client.0.smithi043.stdout:9/566: sync 2023-12-08T20:28:22.756 INFO:tasks.workunit.client.0.smithi043.stdout:3/561: sync 2023-12-08T20:28:22.758 INFO:tasks.workunit.client.0.smithi043.stdout:6/605: mkdir d0/d2/d29/dd0 0 2023-12-08T20:28:22.758 INFO:tasks.workunit.client.0.smithi043.stdout:6/606: chown d0/d2/d14/d2c/d22/d2a/db2/dba 1 1 2023-12-08T20:28:22.758 INFO:tasks.workunit.client.0.smithi043.stdout:5/539: sync 2023-12-08T20:28:22.758 INFO:tasks.workunit.client.0.smithi043.stdout:5/540: chown d3/d7/d21/l46 7182550 1 2023-12-08T20:28:22.758 INFO:tasks.workunit.client.0.smithi043.stdout:9/567: creat d0/d3d/d4b/d5c/fb7 x:0 0 0 2023-12-08T20:28:22.760 INFO:tasks.workunit.client.0.smithi043.stdout:6/607: mknod d0/d2/d14/d20/dc0/cd1 0 2023-12-08T20:28:22.760 INFO:tasks.workunit.client.0.smithi043.stdout:5/541: creat d3/d73/d83/d99/fa5 x:0 0 0 2023-12-08T20:28:22.761 INFO:tasks.workunit.client.0.smithi043.stdout:1/625: dwrite d1/f2 [0,4194304] 0 2023-12-08T20:28:22.762 INFO:tasks.workunit.client.0.smithi043.stdout:5/542: dread d3/d7/d21/d51/f54 [0,4194304] 0 2023-12-08T20:28:22.762 INFO:tasks.workunit.client.0.smithi043.stdout:6/608: creat d0/d2/d14/d2c/d22/fd2 x:0 0 0 2023-12-08T20:28:22.764 INFO:tasks.workunit.client.0.smithi043.stdout:1/626: creat d1/d16/d1c/d4e/fe7 x:0 0 0 2023-12-08T20:28:22.765 INFO:tasks.workunit.client.0.smithi043.stdout:6/609: creat d0/d2/fd3 x:0 0 0 2023-12-08T20:28:22.765 INFO:tasks.workunit.client.0.smithi043.stdout:6/610: write d0/d2/fa6 [727421,55693] 0 2023-12-08T20:28:22.767 INFO:tasks.workunit.client.0.smithi043.stdout:1/627: rmdir d1/d16/d1c/d4e/dcd/dad 39 2023-12-08T20:28:22.769 INFO:tasks.workunit.client.0.smithi043.stdout:1/628: link d1/d6/f9a d1/d6/fe8 0 2023-12-08T20:28:22.771 INFO:tasks.workunit.client.0.smithi043.stdout:1/629: creat d1/d16/d21/d6f/daa/fe9 x:0 0 0 2023-12-08T20:28:22.771 INFO:tasks.workunit.client.0.smithi043.stdout:1/630: truncate d1/d16/d86/fa5 1031240 0 2023-12-08T20:28:22.775 INFO:tasks.workunit.client.0.smithi043.stdout:1/631: getdents d1/d16/d30 0 2023-12-08T20:28:22.775 INFO:tasks.workunit.client.0.smithi043.stdout:1/632: truncate d1/d16/d21/d6f/daa/fbe 101490 0 2023-12-08T20:28:22.777 INFO:tasks.workunit.client.0.smithi043.stdout:3/562: dwrite d1/d9/d2d/d91/da7/fb9 [0,4194304] 0 2023-12-08T20:28:22.777 INFO:tasks.workunit.client.0.smithi043.stdout:3/563: chown d1/d25/d2a/d45/l46 1855743 1 2023-12-08T20:28:22.777 INFO:tasks.workunit.client.0.smithi043.stdout:3/564: chown d1/d9/d38/d30/l88 78103935 1 2023-12-08T20:28:22.787 INFO:tasks.workunit.client.0.smithi043.stdout:3/565: dread d1/d25/d2a/d85/f92 [0,4194304] 0 2023-12-08T20:28:22.788 INFO:tasks.workunit.client.0.smithi043.stdout:3/566: write d1/d25/f24 [767923,81785] 0 2023-12-08T20:28:22.788 INFO:tasks.workunit.client.0.smithi043.stdout:3/567: dread - d1/d9/d38/d4a/fb3 zero size 2023-12-08T20:28:22.798 INFO:tasks.workunit.client.0.smithi043.stdout:9/568: dwrite d0/d21/d80/fb3 [0,4194304] 0 2023-12-08T20:28:22.799 INFO:tasks.workunit.client.0.smithi043.stdout:9/569: chown d0/d3d/f83 1009720922 1 2023-12-08T20:28:22.799 INFO:tasks.workunit.client.0.smithi043.stdout:9/570: dread - d0/d21/d80/d97/fa3 zero size 2023-12-08T20:28:22.799 INFO:tasks.workunit.client.0.smithi043.stdout:6/611: dwrite d0/d2/d14/d2c/d22/d3f/fc9 [0,4194304] 0 2023-12-08T20:28:22.799 INFO:tasks.workunit.client.0.smithi043.stdout:6/612: dread - d0/d2/d29/f83 zero size 2023-12-08T20:28:22.799 INFO:tasks.workunit.client.0.smithi043.stdout:6/613: dread - d0/d2/d14/d8/d47/d60/f88 zero size 2023-12-08T20:28:22.799 INFO:tasks.workunit.client.0.smithi043.stdout:5/543: dwrite d3/d7/d29/f5d [0,4194304] 0 2023-12-08T20:28:22.799 INFO:tasks.workunit.client.0.smithi043.stdout:5/544: chown d3/f37 1712 1 2023-12-08T20:28:22.800 INFO:tasks.workunit.client.0.smithi043.stdout:1/633: dwrite d1/d6/d63/fe4 [0,4194304] 0 2023-12-08T20:28:22.800 INFO:tasks.workunit.client.0.smithi043.stdout:9/571: write d0/d3d/f48 [3462488,26500] 0 2023-12-08T20:28:22.801 INFO:tasks.workunit.client.0.smithi043.stdout:3/568: dread d1/d9/fd [0,4194304] 0 2023-12-08T20:28:22.801 INFO:tasks.workunit.client.0.smithi043.stdout:6/614: dread d0/d2/d14/d20/d49/f62 [0,4194304] 0 2023-12-08T20:28:22.801 INFO:tasks.workunit.client.0.smithi043.stdout:5/545: creat d3/d7/d21/d72/fa6 x:0 0 0 2023-12-08T20:28:22.813 INFO:tasks.workunit.client.0.smithi043.stdout:1/634: getdents d1/d16/d30/d6e/d83 0 2023-12-08T20:28:22.814 INFO:tasks.workunit.client.0.smithi043.stdout:9/572: creat d0/d21/d80/d8e/fb8 x:0 0 0 2023-12-08T20:28:22.814 INFO:tasks.workunit.client.0.smithi043.stdout:1/635: chown d1/d6/fa 195 1 2023-12-08T20:28:22.814 INFO:tasks.workunit.client.0.smithi043.stdout:3/569: unlink d1/d1c/d2c/d5f/faf 0 2023-12-08T20:28:22.814 INFO:tasks.workunit.client.0.smithi043.stdout:6/615: creat d0/d2/d14/d2c/d22/d3f/fd4 x:0 0 0 2023-12-08T20:28:22.814 INFO:tasks.workunit.client.0.smithi043.stdout:5/546: getdents d3/d7/d21/d51/d7d 0 2023-12-08T20:28:22.814 INFO:tasks.workunit.client.0.smithi043.stdout:1/636: write d1/d16/d21/d6f/daa/fe9 [615042,110093] 0 2023-12-08T20:28:22.814 INFO:tasks.workunit.client.0.smithi043.stdout:1/637: truncate d1/d16/d30/d6e/d83/fdf 5110025 0 2023-12-08T20:28:22.815 INFO:tasks.workunit.client.0.smithi043.stdout:9/573: creat d0/d67/fb9 x:0 0 0 2023-12-08T20:28:22.816 INFO:tasks.workunit.client.0.smithi043.stdout:3/570: mkdir d1/d1c/d2c/d5f/d80/dba 0 2023-12-08T20:28:22.816 INFO:tasks.workunit.client.0.smithi043.stdout:3/571: write d1/d9/d38/d4f/f8c [651580,45814] 0 2023-12-08T20:28:22.816 INFO:tasks.workunit.client.0.smithi043.stdout:9/574: dread d0/d21/f74 [0,4194304] 0 2023-12-08T20:28:22.816 INFO:tasks.workunit.client.0.smithi043.stdout:6/616: symlink d0/d2/d29/dd0/ld5 0 2023-12-08T20:28:22.818 INFO:tasks.workunit.client.0.smithi043.stdout:1/638: link d1/d16/d1c/d4e/f7b d1/d6/d63/fea 0 2023-12-08T20:28:22.818 INFO:tasks.workunit.client.0.smithi043.stdout:1/639: fdatasync d1/d16/d30/f75 0 2023-12-08T20:28:22.819 INFO:tasks.workunit.client.0.smithi043.stdout:3/572: rename d1/d9/df/d26/l27 to d1/d9/d2d/d91/da7/lbb 0 2023-12-08T20:28:22.823 INFO:tasks.workunit.client.0.smithi043.stdout:9/575: dread d0/d3d/f72 [0,4194304] 0 2023-12-08T20:28:22.823 INFO:tasks.workunit.client.0.smithi043.stdout:9/576: stat d0/d21/d80/d8e/c92 0 2023-12-08T20:28:22.823 INFO:tasks.workunit.client.0.smithi043.stdout:1/640: truncate d1/d16/d21/d25/d3e/d72/f74 2020 0 2023-12-08T20:28:22.823 INFO:tasks.workunit.client.0.smithi043.stdout:1/641: dread - d1/d16/d30/f75 zero size 2023-12-08T20:28:22.823 INFO:tasks.workunit.client.0.smithi043.stdout:1/642: write d1/d16/d21/d25/d35/f64 [274659,56037] 0 2023-12-08T20:28:22.823 INFO:tasks.workunit.client.0.smithi043.stdout:1/643: fdatasync d1/d16/d1c/d4e/dcd/dad/fae 0 2023-12-08T20:28:22.829 INFO:tasks.workunit.client.0.smithi043.stdout:3/573: dread d1/d9/d38/d4f/f8c [0,4194304] 0 2023-12-08T20:28:22.832 INFO:tasks.workunit.client.0.smithi043.stdout:1/644: creat d1/d16/d21/d60/feb x:0 0 0 2023-12-08T20:28:22.834 INFO:tasks.workunit.client.0.smithi043.stdout:5/547: dwrite d3/d7/f69 [0,4194304] 0 2023-12-08T20:28:22.834 INFO:tasks.workunit.client.0.smithi043.stdout:5/548: chown d3/d7/de/c53 2 1 2023-12-08T20:28:22.836 INFO:tasks.workunit.client.0.smithi043.stdout:3/574: unlink d1/d1c/d2c/f61 0 2023-12-08T20:28:22.836 INFO:tasks.workunit.client.0.smithi043.stdout:6/617: dwrite d0/d2/d14/d2c/d22/fc8 [0,4194304] 0 2023-12-08T20:28:22.838 INFO:tasks.workunit.client.0.smithi043.stdout:3/575: rename d1/d9/d2d/d66/f74 to d1/d9/d2d/d66/fbc 0 2023-12-08T20:28:22.845 INFO:tasks.workunit.client.0.smithi043.stdout:9/577: truncate d0/d3d/f48 3078996 0 2023-12-08T20:28:22.849 INFO:tasks.workunit.client.0.smithi043.stdout:6/618: mknod d0/d2/d14/d2c/d22/d3f/d45/d69/cd6 0 2023-12-08T20:28:22.849 INFO:tasks.workunit.client.0.smithi043.stdout:6/619: readlink d0/d2/d14/d2c/d22/d3f/d45/lab 0 2023-12-08T20:28:22.850 INFO:tasks.workunit.client.0.smithi043.stdout:3/576: mkdir d1/d9/d38/d4a/dbd 0 2023-12-08T20:28:22.851 INFO:tasks.workunit.client.0.smithi043.stdout:1/645: dread d1/d16/d21/d25/d35/f85 [0,4194304] 0 2023-12-08T20:28:22.856 INFO:tasks.workunit.client.0.smithi043.stdout:8/553: sync 2023-12-08T20:28:22.857 INFO:tasks.workunit.client.0.smithi043.stdout:4/594: sync 2023-12-08T20:28:22.857 INFO:tasks.workunit.client.0.smithi043.stdout:7/584: sync 2023-12-08T20:28:22.858 INFO:tasks.workunit.client.0.smithi043.stdout:4/595: rmdir d1/d14/d25/d39/d3d/d40 39 2023-12-08T20:28:22.860 INFO:tasks.workunit.client.0.smithi043.stdout:4/596: getdents d1/d14/d1d/d75 0 2023-12-08T20:28:22.861 INFO:tasks.workunit.client.0.smithi043.stdout:7/585: creat d0/fbb x:0 0 0 2023-12-08T20:28:22.862 INFO:tasks.workunit.client.0.smithi043.stdout:4/597: creat d1/d14/d1d/d75/fcf x:0 0 0 2023-12-08T20:28:22.866 INFO:tasks.workunit.client.0.smithi043.stdout:7/586: symlink d0/d69/d6d/d87/lbc 0 2023-12-08T20:28:22.866 INFO:tasks.workunit.client.0.smithi043.stdout:7/587: readlink d0/l31 0 2023-12-08T20:28:22.881 INFO:tasks.workunit.client.0.smithi043.stdout:5/549: dwrite d3/d7/d21/f4d [4194304,4194304] 0 2023-12-08T20:28:22.882 INFO:tasks.workunit.client.0.smithi043.stdout:3/577: write d1/d1c/f22 [2471913,109603] 0 2023-12-08T20:28:22.884 INFO:tasks.workunit.client.0.smithi043.stdout:1/646: dwrite d1/f2a [0,4194304] 0 2023-12-08T20:28:22.886 INFO:tasks.workunit.client.0.smithi043.stdout:6/620: dwrite d0/d2/f12 [0,4194304] 0 2023-12-08T20:28:22.886 INFO:tasks.workunit.client.0.smithi043.stdout:9/578: dwrite d0/d3d/d4b/f71 [0,4194304] 0 2023-12-08T20:28:22.886 INFO:tasks.workunit.client.0.smithi043.stdout:9/579: dread - d0/d21/d80/d97/fa3 zero size 2023-12-08T20:28:22.887 INFO:tasks.workunit.client.0.smithi043.stdout:5/550: mkdir d3/d7/d21/d51/d5c/da7 0 2023-12-08T20:28:22.888 INFO:tasks.workunit.client.0.smithi043.stdout:3/578: truncate d1/d9/d38/d30/f59 189402 0 2023-12-08T20:28:22.888 INFO:tasks.workunit.client.0.smithi043.stdout:5/551: write d3/d7/de/f7b [850599,128683] 0 2023-12-08T20:28:22.890 INFO:tasks.workunit.client.0.smithi043.stdout:6/621: mkdir d0/d2/d14/d2c/dd7 0 2023-12-08T20:28:22.891 INFO:tasks.workunit.client.0.smithi043.stdout:2/839: sync 2023-12-08T20:28:22.892 INFO:tasks.workunit.client.0.smithi043.stdout:9/580: getdents d0/d5e 0 2023-12-08T20:28:22.892 INFO:tasks.workunit.client.0.smithi043.stdout:9/581: chown d0/c69 96 1 2023-12-08T20:28:22.892 INFO:tasks.workunit.client.0.smithi043.stdout:0/863: sync 2023-12-08T20:28:22.892 INFO:tasks.workunit.client.0.smithi043.stdout:0/864: chown d2/d3/f4e 3 1 2023-12-08T20:28:22.894 INFO:tasks.workunit.client.0.smithi043.stdout:7/588: dwrite d0/d2/f5 [4194304,4194304] 0 2023-12-08T20:28:22.898 INFO:tasks.workunit.client.0.smithi043.stdout:6/622: symlink d0/d2/d14/d2c/d66/ld8 0 2023-12-08T20:28:22.898 INFO:tasks.workunit.client.0.smithi043.stdout:2/840: symlink d0/db/d18/l111 0 2023-12-08T20:28:22.898 INFO:tasks.workunit.client.0.smithi043.stdout:2/841: stat d0/d26/d53/fb2 0 2023-12-08T20:28:22.898 INFO:tasks.workunit.client.0.smithi043.stdout:8/554: dwrite d2/d20/d7d/d29/d30/d71/f76 [0,4194304] 0 2023-12-08T20:28:22.900 INFO:tasks.workunit.client.0.smithi043.stdout:0/865: creat d2/d61/dc0/f11b x:0 0 0 2023-12-08T20:28:22.901 INFO:tasks.workunit.client.0.smithi043.stdout:5/552: dread d3/d32/f47 [0,4194304] 0 2023-12-08T20:28:22.903 INFO:tasks.workunit.client.0.smithi043.stdout:6/623: rename d0/d2/d14/d8/f7b to d0/d2/d29/fd9 0 2023-12-08T20:28:22.903 INFO:tasks.workunit.client.0.smithi043.stdout:6/624: stat d0/d2/d14/d2c/d22/d2a/db2 0 2023-12-08T20:28:22.905 INFO:tasks.workunit.client.0.smithi043.stdout:2/842: mknod d0/d2b/d4e/d79/dfd/c112 0 2023-12-08T20:28:22.905 INFO:tasks.workunit.client.0.smithi043.stdout:2/843: write d0/db/d18/da3/fc9 [43839,98397] 0 2023-12-08T20:28:22.905 INFO:tasks.workunit.client.0.smithi043.stdout:2/844: dread - d0/d20/d42/d49/fa4 zero size 2023-12-08T20:28:22.908 INFO:tasks.workunit.client.0.smithi043.stdout:8/555: mkdir d2/d27/d2d/d31/d7f/db2 0 2023-12-08T20:28:22.908 INFO:tasks.workunit.client.0.smithi043.stdout:7/589: dread d0/d69/fb8 [0,4194304] 0 2023-12-08T20:28:22.908 INFO:tasks.workunit.client.0.smithi043.stdout:7/590: dread - d0/d2/f7c zero size 2023-12-08T20:28:22.910 INFO:tasks.workunit.client.0.smithi043.stdout:5/553: rmdir d3/d7/de/d17/d84 39 2023-12-08T20:28:22.910 INFO:tasks.workunit.client.0.smithi043.stdout:5/554: fdatasync d3/d7/de/f1d 0 2023-12-08T20:28:22.912 INFO:tasks.workunit.client.0.smithi043.stdout:5/555: link d3/d7/de/c64 d3/d7/d19/ca8 0 2023-12-08T20:28:22.913 INFO:tasks.workunit.client.0.smithi043.stdout:8/556: write d2/d20/d7d/f77 [892740,45509] 0 2023-12-08T20:28:22.913 INFO:tasks.workunit.client.0.smithi043.stdout:5/556: stat d3/d7/d19/c44 0 2023-12-08T20:28:22.915 INFO:tasks.workunit.client.0.smithi043.stdout:8/557: creat d2/d27/d2d/d31/d7f/fb3 x:0 0 0 2023-12-08T20:28:22.916 INFO:tasks.workunit.client.0.smithi043.stdout:5/557: rename d3/d7/d19/f30 to d3/d7/de/fa9 0 2023-12-08T20:28:22.918 INFO:tasks.workunit.client.0.smithi043.stdout:2/845: dread d0/d20/f4d [0,4194304] 0 2023-12-08T20:28:22.918 INFO:tasks.workunit.client.0.smithi043.stdout:2/846: chown d0/d26/dbc/d38/dae/dc0/f10a 1545 1 2023-12-08T20:28:22.919 INFO:tasks.workunit.client.0.smithi043.stdout:2/847: symlink d0/d20/l113 0 2023-12-08T20:28:22.920 INFO:tasks.workunit.client.0.smithi043.stdout:8/558: write d2/d27/d2d/d31/d91/fa3 [4136933,98733] 0 2023-12-08T20:28:22.920 INFO:tasks.workunit.client.0.smithi043.stdout:8/559: truncate d2/d20/d7d/fa9 485107 0 2023-12-08T20:28:22.922 INFO:tasks.workunit.client.0.smithi043.stdout:2/848: write d0/db/d18/f1d [2716660,91241] 0 2023-12-08T20:28:22.923 INFO:tasks.workunit.client.0.smithi043.stdout:5/558: write d3/d7/de/d43/d68/f88 [1887931,51981] 0 2023-12-08T20:28:22.923 INFO:tasks.workunit.client.0.smithi043.stdout:7/591: dread d0/d6/f24 [0,4194304] 0 2023-12-08T20:28:22.924 INFO:tasks.workunit.client.0.smithi043.stdout:5/559: write d3/d7/de/d17/d84/f87 [510857,31959] 0 2023-12-08T20:28:22.924 INFO:tasks.workunit.client.0.smithi043.stdout:7/592: fsync d0/d6/f24 0 2023-12-08T20:28:22.924 INFO:tasks.workunit.client.0.smithi043.stdout:7/593: truncate d0/d2/d65/d99/f15 3045412 0 2023-12-08T20:28:22.925 INFO:tasks.workunit.client.0.smithi043.stdout:7/594: creat d0/d2/d12/fbd x:0 0 0 2023-12-08T20:28:22.930 INFO:tasks.workunit.client.0.smithi043.stdout:9/582: dwrite d0/d3d/d4b/d5c/fb7 [0,4194304] 0 2023-12-08T20:28:22.931 INFO:tasks.workunit.client.0.smithi043.stdout:1/647: dwrite d1/d16/d1c/f44 [0,4194304] 0 2023-12-08T20:28:22.933 INFO:tasks.workunit.client.0.smithi043.stdout:3/579: dwrite d1/d9/d2d/d66/f98 [0,4194304] 0 2023-12-08T20:28:22.934 INFO:tasks.workunit.client.0.smithi043.stdout:1/648: mknod d1/d16/d30/d4f/cec 0 2023-12-08T20:28:22.935 INFO:tasks.workunit.client.0.smithi043.stdout:6/625: dwrite d0/d2/d14/d2c/f65 [0,4194304] 0 2023-12-08T20:28:22.939 INFO:tasks.workunit.client.0.smithi043.stdout:3/580: rename d1/d9/db7 to d1/d1c/d2c/d7f/dbe 0 2023-12-08T20:28:22.943 INFO:tasks.workunit.client.0.smithi043.stdout:1/649: mknod d1/d16/d21/d25/d3e/ced 0 2023-12-08T20:28:22.943 INFO:tasks.workunit.client.0.smithi043.stdout:8/560: dread d2/d27/d2d/d31/d91/fa3 [0,4194304] 0 2023-12-08T20:28:22.943 INFO:tasks.workunit.client.0.smithi043.stdout:8/561: write d2/d20/d7d/d29/d30/f41 [4622235,11792] 0 2023-12-08T20:28:22.943 INFO:tasks.workunit.client.0.smithi043.stdout:8/562: write d2/d20/d7d/f8a [329041,19906] 0 2023-12-08T20:28:22.944 INFO:tasks.workunit.client.0.smithi043.stdout:8/563: truncate d2/d20/d7d/d29/d59/f65 1528162 0 2023-12-08T20:28:22.945 INFO:tasks.workunit.client.0.smithi043.stdout:2/849: dwrite d0/db/d18/d3d/fdb [0,4194304] 0 2023-12-08T20:28:22.947 INFO:tasks.workunit.client.0.smithi043.stdout:6/626: rename d0/d2/de/d4a/d56/f72 to d0/d2/d14/d8/fda 0 2023-12-08T20:28:22.947 INFO:tasks.workunit.client.0.smithi043.stdout:7/595: dread d0/d2/d65/f71 [0,4194304] 0 2023-12-08T20:28:22.948 INFO:tasks.workunit.client.0.smithi043.stdout:3/581: truncate d1/d9/d2d/fa9 1825541 0 2023-12-08T20:28:22.948 INFO:tasks.workunit.client.0.smithi043.stdout:3/582: fsync d1/d25/f36 0 2023-12-08T20:28:22.949 INFO:tasks.workunit.client.0.smithi043.stdout:1/650: mknod d1/d16/d21/d25/d3e/d77/cee 0 2023-12-08T20:28:22.950 INFO:tasks.workunit.client.0.smithi043.stdout:1/651: write d1/d16/d21/d25/d3e/d77/d9f/fa9 [244293,130037] 0 2023-12-08T20:28:22.953 INFO:tasks.workunit.client.0.smithi043.stdout:8/564: mknod d2/d27/d2d/cb4 0 2023-12-08T20:28:22.955 INFO:tasks.workunit.client.0.smithi043.stdout:2/850: truncate d0/d26/f98 82667 0 2023-12-08T20:28:22.957 INFO:tasks.workunit.client.0.smithi043.stdout:6/627: rmdir d0/d2/d14/d2c/d22/d3f/d45/d6b 39 2023-12-08T20:28:22.957 INFO:tasks.workunit.client.0.smithi043.stdout:6/628: fdatasync d0/d2/d14/d20/d49/f4f 0 2023-12-08T20:28:22.958 INFO:tasks.workunit.client.0.smithi043.stdout:7/596: mknod d0/d69/cbe 0 2023-12-08T20:28:22.960 INFO:tasks.workunit.client.0.smithi043.stdout:2/851: symlink d0/db/d18/d8b/db4/l114 0 2023-12-08T20:28:22.960 INFO:tasks.workunit.client.0.smithi043.stdout:6/629: creat d0/d2/d14/d20/d3c/d6c/fdb x:0 0 0 2023-12-08T20:28:22.960 INFO:tasks.workunit.client.0.smithi043.stdout:6/630: chown d0/d2/d14/d8/d47/d60/f8d 45833457 1 2023-12-08T20:28:22.962 INFO:tasks.workunit.client.0.smithi043.stdout:2/852: symlink d0/d2b/l115 0 2023-12-08T20:28:22.962 INFO:tasks.workunit.client.0.smithi043.stdout:2/853: read d0/f17 [250253,58760] 0 2023-12-08T20:28:22.962 INFO:tasks.workunit.client.0.smithi043.stdout:2/854: stat d0/db/d18/d3d/fc5 0 2023-12-08T20:28:22.963 INFO:tasks.workunit.client.0.smithi043.stdout:2/855: chown d0/d81 218 1 2023-12-08T20:28:22.963 INFO:tasks.workunit.client.0.smithi043.stdout:6/631: truncate d0/d2/f28 1245709 0 2023-12-08T20:28:22.963 INFO:tasks.workunit.client.0.smithi043.stdout:6/632: truncate d0/d2/f1f 4281004 0 2023-12-08T20:28:22.963 INFO:tasks.workunit.client.0.smithi043.stdout:2/856: getdents d0/da6 0 2023-12-08T20:28:22.964 INFO:tasks.workunit.client.0.smithi043.stdout:2/857: read d0/db/d18/d66/f77 [88345,66832] 0 2023-12-08T20:28:22.964 INFO:tasks.workunit.client.0.smithi043.stdout:2/858: truncate d0/db/faf 1877287 0 2023-12-08T20:28:22.965 INFO:tasks.workunit.client.0.smithi043.stdout:2/859: mknod d0/db/d18/d3d/c116 0 2023-12-08T20:28:22.965 INFO:tasks.workunit.client.0.smithi043.stdout:5/560: dwrite f1 [0,4194304] 0 2023-12-08T20:28:22.966 INFO:tasks.workunit.client.0.smithi043.stdout:8/565: write d2/d20/d7d/d29/f66 [1807261,78490] 0 2023-12-08T20:28:22.967 INFO:tasks.workunit.client.0.smithi043.stdout:6/633: dread d0/d2/d14/d2c/d22/d3f/d45/f98 [4194304,4194304] 0 2023-12-08T20:28:22.967 INFO:tasks.workunit.client.0.smithi043.stdout:6/634: stat d0/d2/fa6 0 2023-12-08T20:28:22.967 INFO:tasks.workunit.client.0.smithi043.stdout:6/635: write d0/d2/d14/d8/d47/d60/f88 [484251,33296] 0 2023-12-08T20:28:22.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:22 smithi111 ceph-mon[121341]: pgmap v32: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 64 MiB/s rd, 131 MiB/s wr, 308 op/s 2023-12-08T20:28:22.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:22 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:22.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:22 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi043.hqcdcm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-08T20:28:22.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:22 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi043.hqcdcm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-08T20:28:22.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:22 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-08T20:28:22.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:22 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:28:22.968 INFO:tasks.workunit.client.0.smithi043.stdout:5/561: rename d3/d73/d83/c9b to d3/d78/caa 0 2023-12-08T20:28:22.968 INFO:tasks.workunit.client.0.smithi043.stdout:9/583: dwrite d0/d3d/f83 [0,4194304] 0 2023-12-08T20:28:22.969 INFO:tasks.workunit.client.0.smithi043.stdout:9/584: write d0/d21/f3e [160650,105939] 0 2023-12-08T20:28:22.971 INFO:tasks.workunit.client.0.smithi043.stdout:6/636: fdatasync d0/d2/d14/d8/d47/d60/f88 0 2023-12-08T20:28:22.971 INFO:tasks.workunit.client.0.smithi043.stdout:7/597: dread d0/d2/f21 [0,4194304] 0 2023-12-08T20:28:22.971 INFO:tasks.workunit.client.0.smithi043.stdout:7/598: fsync d0/d6/f7b 0 2023-12-08T20:28:22.971 INFO:tasks.workunit.client.0.smithi043.stdout:8/566: creat d2/d27/d2d/d31/d7f/db2/fb5 x:0 0 0 2023-12-08T20:28:22.972 INFO:tasks.workunit.client.0.smithi043.stdout:7/599: write d0/d2/d65/f71 [69591,72405] 0 2023-12-08T20:28:22.972 INFO:tasks.workunit.client.0.smithi043.stdout:7/600: chown d0/d6/d17/f86 3181366 1 2023-12-08T20:28:22.976 INFO:tasks.workunit.client.0.smithi043.stdout:5/562: getdents d3/d7/d21/d51/d5c 0 2023-12-08T20:28:22.976 INFO:tasks.workunit.client.0.smithi043.stdout:9/585: creat d0/d21/d80/d8e/fba x:0 0 0 2023-12-08T20:28:22.980 INFO:tasks.workunit.client.0.smithi043.stdout:8/567: creat d2/d20/d7d/d29/d30/d60/d9b/fb6 x:0 0 0 2023-12-08T20:28:22.981 INFO:tasks.workunit.client.0.smithi043.stdout:8/568: dread - d2/d20/d7d/d29/d30/d60/d9b/fb6 zero size 2023-12-08T20:28:22.981 INFO:tasks.workunit.client.0.smithi043.stdout:8/569: chown d2/d20/d7d/d29/c5b 235605 1 2023-12-08T20:28:22.983 INFO:tasks.workunit.client.0.smithi043.stdout:5/563: rename d3/d7/d19/d3f/c63 to d3/d7/d21/d72/cab 0 2023-12-08T20:28:22.984 INFO:tasks.workunit.client.0.smithi043.stdout:8/570: getdents d2/d6f 0 2023-12-08T20:28:22.986 INFO:tasks.workunit.client.0.smithi043.stdout:5/564: creat d3/d7/d21/d51/fac x:0 0 0 2023-12-08T20:28:22.990 INFO:tasks.workunit.client.0.smithi043.stdout:8/571: mkdir d2/d27/d2d/d31/d7f/db7 0 2023-12-08T20:28:22.990 INFO:tasks.workunit.client.0.smithi043.stdout:8/572: chown d2/d20/d7d 9214 1 2023-12-08T20:28:22.990 INFO:tasks.workunit.client.0.smithi043.stdout:8/573: readlink d2/d20/d7d/d29/d30/l54 0 2023-12-08T20:28:22.990 INFO:tasks.workunit.client.0.smithi043.stdout:5/565: creat d3/d7/d90/fad x:0 0 0 2023-12-08T20:28:22.991 INFO:tasks.workunit.client.0.smithi043.stdout:8/574: symlink d2/d27/dab/lb8 0 2023-12-08T20:28:22.992 INFO:tasks.workunit.client.0.smithi043.stdout:8/575: write d2/d27/d2d/d31/d4f/fb0 [495780,39640] 0 2023-12-08T20:28:22.993 INFO:tasks.workunit.client.0.smithi043.stdout:5/566: unlink d3/d7/de/d43/f8a 0 2023-12-08T20:28:22.995 INFO:tasks.workunit.client.0.smithi043.stdout:8/576: creat d2/d20/d7d/d29/fb9 x:0 0 0 2023-12-08T20:28:22.996 INFO:tasks.workunit.client.0.smithi043.stdout:2/860: dwrite d0/d20/f2a [4194304,4194304] 0 2023-12-08T20:28:22.996 INFO:tasks.workunit.client.0.smithi043.stdout:2/861: stat d0/db/d18/d8b/lf4 0 2023-12-08T20:28:22.996 INFO:tasks.workunit.client.0.smithi043.stdout:8/577: truncate d2/d20/d7d/d29/d30/f49 5707055 0 2023-12-08T20:28:22.996 INFO:tasks.workunit.client.0.smithi043.stdout:2/862: fsync d0/db/d18/d8b/f104 0 2023-12-08T20:28:22.996 INFO:tasks.workunit.client.0.smithi043.stdout:6/637: dwrite d0/f7f [0,4194304] 0 2023-12-08T20:28:22.997 INFO:tasks.workunit.client.0.smithi043.stdout:5/567: symlink d3/d7/d29/lae 0 2023-12-08T20:28:22.997 INFO:tasks.workunit.client.0.smithi043.stdout:9/586: dwrite d0/d21/d80/fac [0,4194304] 0 2023-12-08T20:28:22.999 INFO:tasks.workunit.client.0.smithi043.stdout:9/587: dread d0/d21/f87 [0,4194304] 0 2023-12-08T20:28:22.999 INFO:tasks.workunit.client.0.smithi043.stdout:9/588: readlink d0/d5e/dad/d6b/l93 0 2023-12-08T20:28:23.001 INFO:tasks.workunit.client.0.smithi043.stdout:2/863: rename d0/d2b/d4e/d79 to d0/d20/d42/dcb/d117 0 2023-12-08T20:28:23.002 INFO:tasks.workunit.client.0.smithi043.stdout:8/578: symlink d2/d20/d7d/d29/d30/d60/d9b/lba 0 2023-12-08T20:28:23.004 INFO:tasks.workunit.client.0.smithi043.stdout:6/638: mkdir d0/ddc 0 2023-12-08T20:28:23.004 INFO:tasks.workunit.client.0.smithi043.stdout:6/639: write d0/d2/d14/d8/d47/f80 [323751,76265] 0 2023-12-08T20:28:23.006 INFO:tasks.workunit.client.0.smithi043.stdout:5/568: getdents d3/d7/d21 0 2023-12-08T20:28:23.007 INFO:tasks.workunit.client.0.smithi043.stdout:5/569: read d3/f37 [190099,34213] 0 2023-12-08T20:28:23.010 INFO:tasks.workunit.client.0.smithi043.stdout:9/589: creat d0/d5e/dad/d6b/fbb x:0 0 0 2023-12-08T20:28:23.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:22 smithi043 ceph-mon[111966]: pgmap v32: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 64 MiB/s rd, 131 MiB/s wr, 308 op/s 2023-12-08T20:28:23.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:22 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:23.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:22 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi043.hqcdcm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-08T20:28:23.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:22 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi043.hqcdcm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-08T20:28:23.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:22 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-08T20:28:23.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:22 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:28:23.022 INFO:tasks.workunit.client.0.smithi043.stdout:8/579: truncate d2/d20/d7d/d29/d30/d71/f96 266813 0 2023-12-08T20:28:23.024 INFO:tasks.workunit.client.0.smithi043.stdout:9/590: getdents d0/d5e/dad/d6b/d6c 0 2023-12-08T20:28:23.025 INFO:tasks.workunit.client.0.smithi043.stdout:2/864: creat d0/db/d18/d8b/da2/f118 x:0 0 0 2023-12-08T20:28:23.027 INFO:tasks.workunit.client.0.smithi043.stdout:8/580: mkdir d2/d20/d7d/d29/d30/d60/d9b/dbb 0 2023-12-08T20:28:23.027 INFO:tasks.workunit.client.0.smithi043.stdout:8/581: chown d2/d27/d2d/d31/d4f/c69 9515117 1 2023-12-08T20:28:23.028 INFO:tasks.workunit.client.0.smithi043.stdout:2/865: creat d0/db/d18/d8b/da2/f119 x:0 0 0 2023-12-08T20:28:23.029 INFO:tasks.workunit.client.0.smithi043.stdout:5/570: dwrite d3/d7/d21/fa1 [0,4194304] 0 2023-12-08T20:28:23.031 INFO:tasks.workunit.client.0.smithi043.stdout:8/582: mknod d2/d20/d7d/d29/d59/d86/cbc 0 2023-12-08T20:28:23.033 INFO:tasks.workunit.client.0.smithi043.stdout:5/571: truncate d3/d7/de/f55 882605 0 2023-12-08T20:28:23.033 INFO:tasks.workunit.client.0.smithi043.stdout:5/572: truncate d3/d7/d29/f60 4879064 0 2023-12-08T20:28:23.033 INFO:tasks.workunit.client.0.smithi043.stdout:5/573: chown d3/d7/d19/f6d 1660658 1 2023-12-08T20:28:23.033 INFO:tasks.workunit.client.0.smithi043.stdout:5/574: chown d3/d7/d29/c2e 216131212 1 2023-12-08T20:28:23.034 INFO:tasks.workunit.client.0.smithi043.stdout:8/583: mknod d2/d27/d2d/d31/d74/cbd 0 2023-12-08T20:28:23.035 INFO:tasks.workunit.client.0.smithi043.stdout:8/584: write d2/d20/d7d/f26 [1149889,49971] 0 2023-12-08T20:28:23.037 INFO:tasks.workunit.client.0.smithi043.stdout:8/585: symlink d2/d20/d7d/d29/d30/d60/d9b/lbe 0 2023-12-08T20:28:23.038 INFO:tasks.workunit.client.0.smithi043.stdout:8/586: mknod d2/d27/d2d/cbf 0 2023-12-08T20:28:23.039 INFO:tasks.workunit.client.0.smithi043.stdout:8/587: chown d2/d27/d2d/d31/d99/faf 14017839 1 2023-12-08T20:28:23.039 INFO:tasks.workunit.client.0.smithi043.stdout:8/588: write d2/d20/d7d/d29/f66 [1467584,31212] 0 2023-12-08T20:28:23.040 INFO:tasks.workunit.client.0.smithi043.stdout:8/589: chown d2/d20/d7d/d29/d30/f41 147858148 1 2023-12-08T20:28:23.040 INFO:tasks.workunit.client.0.smithi043.stdout:8/590: truncate d2/d20/fb1 811738 0 2023-12-08T20:28:23.042 INFO:tasks.workunit.client.0.smithi043.stdout:8/591: creat d2/d27/d2d/d31/d7f/db2/fc0 x:0 0 0 2023-12-08T20:28:23.042 INFO:tasks.workunit.client.0.smithi043.stdout:8/592: chown d2/d20/d7d/d29/c5b 12 1 2023-12-08T20:28:23.043 INFO:tasks.workunit.client.0.smithi043.stdout:8/593: getdents d2/d20/d7d/d29/d30/d60 0 2023-12-08T20:28:23.053 INFO:tasks.workunit.client.0.smithi043.stdout:2/866: dwrite d0/f17 [0,4194304] 0 2023-12-08T20:28:23.054 INFO:tasks.workunit.client.0.smithi043.stdout:5/575: dwrite d3/d7/d21/d51/fac [0,4194304] 0 2023-12-08T20:28:23.061 INFO:tasks.workunit.client.0.smithi043.stdout:2/867: rename d0/db/f4a to d0/d2b/d4e/d93/da9/f11a 0 2023-12-08T20:28:23.061 INFO:tasks.workunit.client.0.smithi043.stdout:8/594: dwrite d2/d6f/f39 [4194304,4194304] 0 2023-12-08T20:28:23.063 INFO:tasks.workunit.client.0.smithi043.stdout:5/576: mknod d3/caf 0 2023-12-08T20:28:23.063 INFO:tasks.workunit.client.0.smithi043.stdout:2/868: mknod d0/d20/c11b 0 2023-12-08T20:28:23.066 INFO:tasks.workunit.client.0.smithi043.stdout:5/577: mkdir d3/d73/da4/db0 0 2023-12-08T20:28:23.067 INFO:tasks.workunit.client.0.smithi043.stdout:2/869: unlink d0/d20/d42/dcb/fcc 0 2023-12-08T20:28:23.071 INFO:tasks.workunit.client.0.smithi043.stdout:5/578: mkdir d3/d7/de/d43/d68/db1 0 2023-12-08T20:28:23.072 INFO:tasks.workunit.client.0.smithi043.stdout:2/870: creat d0/dd4/f11c x:0 0 0 2023-12-08T20:28:23.075 INFO:tasks.workunit.client.0.smithi043.stdout:5/579: write d3/d7/f69 [452909,28153] 0 2023-12-08T20:28:23.077 INFO:tasks.workunit.client.0.smithi043.stdout:2/871: symlink d0/db/l11d 0 2023-12-08T20:28:23.078 INFO:tasks.workunit.client.0.smithi043.stdout:2/872: mkdir d0/d20/d42/dcb/d117/dfd/dff/d11e 0 2023-12-08T20:28:23.078 INFO:tasks.workunit.client.0.smithi043.stdout:2/873: chown d0/d26/da7 819302 1 2023-12-08T20:28:23.080 INFO:tasks.workunit.client.0.smithi043.stdout:2/874: symlink d0/d2b/d4e/l11f 0 2023-12-08T20:28:23.095 INFO:tasks.workunit.client.0.smithi043.stdout:8/595: dwrite d2/d20/d7d/ff [0,4194304] 0 2023-12-08T20:28:23.096 INFO:tasks.workunit.client.0.smithi043.stdout:8/596: read d2/d20/f78 [694613,83516] 0 2023-12-08T20:28:23.096 INFO:tasks.workunit.client.0.smithi043.stdout:5/580: dwrite d3/d7/d19/f59 [0,4194304] 0 2023-12-08T20:28:23.098 INFO:tasks.workunit.client.0.smithi043.stdout:5/581: unlink d3/d7/de/d17/c25 0 2023-12-08T20:28:23.099 INFO:tasks.workunit.client.0.smithi043.stdout:5/582: write d3/d7/d21/d51/fac [157101,36214] 0 2023-12-08T20:28:23.102 INFO:tasks.workunit.client.0.smithi043.stdout:5/583: dread d3/d7/de/f55 [0,4194304] 0 2023-12-08T20:28:23.103 INFO:tasks.workunit.client.0.smithi043.stdout:5/584: mkdir d3/d7/de/d6a/db2 0 2023-12-08T20:28:23.105 INFO:tasks.workunit.client.0.smithi043.stdout:5/585: getdents d3/d7/de/d82 0 2023-12-08T20:28:23.106 INFO:tasks.workunit.client.0.smithi043.stdout:5/586: link d3/d7/de/c64 d3/d7/de/cb3 0 2023-12-08T20:28:23.108 INFO:tasks.workunit.client.0.smithi043.stdout:5/587: rmdir d3/d7/d21/d51 39 2023-12-08T20:28:23.116 INFO:tasks.workunit.client.0.smithi043.stdout:5/588: dread f1 [0,4194304] 0 2023-12-08T20:28:23.117 INFO:tasks.workunit.client.0.smithi043.stdout:5/589: creat d3/d73/da4/fb4 x:0 0 0 2023-12-08T20:28:23.118 INFO:tasks.workunit.client.0.smithi043.stdout:4/598: sync 2023-12-08T20:28:23.119 INFO:tasks.workunit.client.0.smithi043.stdout:5/590: read d3/d7/d21/fa1 [3702812,8392] 0 2023-12-08T20:28:23.122 INFO:tasks.workunit.client.0.smithi043.stdout:5/591: creat d3/d7/de/d82/d8b/fb5 x:0 0 0 2023-12-08T20:28:23.126 INFO:tasks.workunit.client.0.smithi043.stdout:5/592: symlink d3/d7/d21/d51/d5c/d81/d98/lb6 0 2023-12-08T20:28:23.126 INFO:tasks.workunit.client.0.smithi043.stdout:5/593: stat d3/d7/d21/d51/d5c/d81 0 2023-12-08T20:28:23.126 INFO:tasks.workunit.client.0.smithi043.stdout:5/594: fdatasync d3/d7/d90/fad 0 2023-12-08T20:28:23.129 INFO:tasks.workunit.client.0.smithi043.stdout:5/595: mknod d3/d7/de/d6a/cb7 0 2023-12-08T20:28:23.131 INFO:tasks.workunit.client.0.smithi043.stdout:5/596: mknod d3/d73/da4/db0/cb8 0 2023-12-08T20:28:23.133 INFO:tasks.workunit.client.0.smithi043.stdout:5/597: rename d3/d7/de/d17/c26 to d3/d7/de/d6a/db2/cb9 0 2023-12-08T20:28:23.134 INFO:tasks.workunit.client.0.smithi043.stdout:5/598: write d3/d7/de/f24 [2935921,105537] 0 2023-12-08T20:28:23.134 INFO:tasks.workunit.client.0.smithi043.stdout:5/599: chown d3/d7/d21/f2d 355 1 2023-12-08T20:28:23.138 INFO:tasks.workunit.client.0.smithi043.stdout:8/597: dwrite d2/d20/d7d/f26 [0,4194304] 0 2023-12-08T20:28:23.141 INFO:tasks.workunit.client.0.smithi043.stdout:8/598: symlink d2/d20/d7d/d37/lc1 0 2023-12-08T20:28:23.142 INFO:tasks.workunit.client.0.smithi043.stdout:8/599: mknod d2/d20/d7d/d29/d30/d60/d9b/dbb/cc2 0 2023-12-08T20:28:23.143 INFO:tasks.workunit.client.0.smithi043.stdout:4/599: dwrite d1/d14/d25/d39/d3f/d59/fc3 [0,4194304] 0 2023-12-08T20:28:23.143 INFO:tasks.workunit.client.0.smithi043.stdout:8/600: write d2/d20/d7d/f26 [2805094,19109] 0 2023-12-08T20:28:23.143 INFO:tasks.workunit.client.0.smithi043.stdout:8/601: chown d2/d20/d7d/c43 4 1 2023-12-08T20:28:23.144 INFO:tasks.workunit.client.0.smithi043.stdout:8/602: write d2/d20/d7d/d29/d59/f65 [139732,88514] 0 2023-12-08T20:28:23.146 INFO:tasks.workunit.client.0.smithi043.stdout:4/600: mkdir d1/d14/d25/d28/d94/dd0 0 2023-12-08T20:28:23.147 INFO:tasks.workunit.client.0.smithi043.stdout:8/603: creat d2/d20/d7d/d29/d59/d9f/fc3 x:0 0 0 2023-12-08T20:28:23.149 INFO:tasks.workunit.client.0.smithi043.stdout:8/604: getdents d2/d20/d7d/d29/d59/d86 0 2023-12-08T20:28:23.152 INFO:tasks.workunit.client.0.smithi043.stdout:8/605: rename d2/d27/d2d/d31/d4f/c89 to d2/d27/d2d/d31/d4f/cc4 0 2023-12-08T20:28:23.156 INFO:tasks.workunit.client.0.smithi043.stdout:8/606: rename d2/l90 to d2/d27/d2d/d31/lc5 0 2023-12-08T20:28:23.156 INFO:tasks.workunit.client.0.smithi043.stdout:8/607: write d2/d20/d7d/d29/d30/d71/f96 [1074672,8415] 0 2023-12-08T20:28:23.159 INFO:tasks.workunit.client.0.smithi043.stdout:8/608: creat d2/d20/d7d/d29/d30/d7c/daa/fc6 x:0 0 0 2023-12-08T20:28:23.162 INFO:tasks.workunit.client.0.smithi043.stdout:8/609: creat d2/d20/d7d/d29/d30/d60/d9b/dbb/fc7 x:0 0 0 2023-12-08T20:28:23.162 INFO:tasks.workunit.client.0.smithi043.stdout:8/610: chown d2/d20/d7d/d29/d59/d86/fad 164811 1 2023-12-08T20:28:23.163 INFO:tasks.workunit.client.0.smithi043.stdout:4/601: dwrite d1/d14/d1d/f9d [0,4194304] 0 2023-12-08T20:28:23.165 INFO:tasks.workunit.client.0.smithi043.stdout:8/611: creat d2/d27/d2d/d31/d91/fc8 x:0 0 0 2023-12-08T20:28:23.165 INFO:tasks.workunit.client.0.smithi043.stdout:8/612: chown d2/d20/d7d/d37/d5a 22432633 1 2023-12-08T20:28:23.169 INFO:tasks.workunit.client.0.smithi043.stdout:8/613: rename d2/d27/d2d/d31/d91/c88 to d2/d20/d7d/d29/d30/d60/cc9 0 2023-12-08T20:28:23.170 INFO:tasks.workunit.client.0.smithi043.stdout:8/614: chown d2/d20/d7d/d29/d30/d60/l6b 1277766672 1 2023-12-08T20:28:23.170 INFO:tasks.workunit.client.0.smithi043.stdout:8/615: write d2/d20/f2c [1725423,85516] 0 2023-12-08T20:28:23.176 INFO:tasks.workunit.client.0.smithi043.stdout:4/602: write d1/d14/d25/d28/f34 [707129,124584] 0 2023-12-08T20:28:23.179 INFO:tasks.workunit.client.0.smithi043.stdout:4/603: mknod d1/cd1 0 2023-12-08T20:28:23.180 INFO:tasks.workunit.client.0.smithi043.stdout:4/604: mknod d1/d14/d25/d39/d3f/d59/cd2 0 2023-12-08T20:28:23.181 INFO:tasks.workunit.client.0.smithi043.stdout:4/605: creat d1/fd3 x:0 0 0 2023-12-08T20:28:23.181 INFO:tasks.workunit.client.0.smithi043.stdout:4/606: fsync d1/d14/d25/d39/d3d/d40/d67/d7f/fcc 0 2023-12-08T20:28:23.181 INFO:tasks.workunit.client.0.smithi043.stdout:4/607: fsync d1/d14/f31 0 2023-12-08T20:28:23.412 INFO:tasks.workunit.client.0.smithi043.stdout:0/866: sync 2023-12-08T20:28:23.431 INFO:tasks.workunit.client.0.smithi043.stdout:0/867: dwrite d2/d3/d18/d1e/d53/d10b/d39/d63/fb2 [0,4194304] 0 2023-12-08T20:28:23.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:23 smithi111 ceph-mon[121341]: Upgrade: Updating mgr.smithi043.hqcdcm 2023-12-08T20:28:23.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:23 smithi111 ceph-mon[121341]: Deploying daemon mgr.smithi043.hqcdcm on smithi043 2023-12-08T20:28:23.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:23 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:28:23.969 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:23 smithi043 ceph-mon[111966]: Upgrade: Updating mgr.smithi043.hqcdcm 2023-12-08T20:28:23.969 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:23 smithi043 ceph-mon[111966]: Deploying daemon mgr.smithi043.hqcdcm on smithi043 2023-12-08T20:28:23.969 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:23 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:28:23.971 INFO:tasks.workunit.client.0.smithi043.stdout:4/608: sync 2023-12-08T20:28:23.971 INFO:tasks.workunit.client.0.smithi043.stdout:8/616: sync 2023-12-08T20:28:23.971 INFO:tasks.workunit.client.0.smithi043.stdout:4/609: chown d1/d14/d25/d77/da4/dc0/fcb 875465654 1 2023-12-08T20:28:23.971 INFO:tasks.workunit.client.0.smithi043.stdout:0/868: sync 2023-12-08T20:28:23.971 INFO:tasks.workunit.client.0.smithi043.stdout:2/875: sync 2023-12-08T20:28:23.971 INFO:tasks.workunit.client.0.smithi043.stdout:8/617: write d2/d20/d7d/f2a [1713570,37357] 0 2023-12-08T20:28:23.971 INFO:tasks.workunit.client.0.smithi043.stdout:9/591: sync 2023-12-08T20:28:23.973 INFO:tasks.workunit.client.0.smithi043.stdout:8/618: write d2/d27/d2d/d31/d74/f83 [332338,95131] 0 2023-12-08T20:28:23.973 INFO:tasks.workunit.client.0.smithi043.stdout:3/583: sync 2023-12-08T20:28:23.973 INFO:tasks.workunit.client.0.smithi043.stdout:5/600: sync 2023-12-08T20:28:23.973 INFO:tasks.workunit.client.0.smithi043.stdout:6/640: sync 2023-12-08T20:28:23.973 INFO:tasks.workunit.client.0.smithi043.stdout:1/652: sync 2023-12-08T20:28:23.973 INFO:tasks.workunit.client.0.smithi043.stdout:8/619: getdents d2/d6f 0 2023-12-08T20:28:23.973 INFO:tasks.workunit.client.0.smithi043.stdout:1/653: fdatasync d1/d16/d21/d6f/daa/fbe 0 2023-12-08T20:28:23.973 INFO:tasks.workunit.client.0.smithi043.stdout:3/584: write d1/d9/f4e [4442959,8700] 0 2023-12-08T20:28:23.973 INFO:tasks.workunit.client.0.smithi043.stdout:5/601: write d3/d7/de/d82/d8b/f93 [999526,458] 0 2023-12-08T20:28:23.973 INFO:tasks.workunit.client.0.smithi043.stdout:7/601: sync 2023-12-08T20:28:23.973 INFO:tasks.workunit.client.0.smithi043.stdout:7/602: write d0/d2/d12/d19/d38/f58 [1138849,65465] 0 2023-12-08T20:28:23.976 INFO:tasks.workunit.client.0.smithi043.stdout:4/610: link d1/d14/d25/d39/d3d/f97 d1/d14/d25/d39/fd4 0 2023-12-08T20:28:23.976 INFO:tasks.workunit.client.0.smithi043.stdout:4/611: stat d1/f5 0 2023-12-08T20:28:23.978 INFO:tasks.workunit.client.0.smithi043.stdout:9/592: mkdir d0/d3d/d4b/da2/dbc 0 2023-12-08T20:28:23.981 INFO:tasks.workunit.client.0.smithi043.stdout:6/641: truncate d0/d2/d14/d20/d3c/d50/f77 2585557 0 2023-12-08T20:28:23.983 INFO:tasks.workunit.client.0.smithi043.stdout:8/620: creat d2/d20/d7d/fca x:0 0 0 2023-12-08T20:28:23.983 INFO:tasks.workunit.client.0.smithi043.stdout:8/621: dread - d2/d27/d2d/d31/d7f/fb3 zero size 2023-12-08T20:28:23.983 INFO:tasks.workunit.client.0.smithi043.stdout:8/622: fsync d2/d20/fb1 0 2023-12-08T20:28:23.985 INFO:tasks.workunit.client.0.smithi043.stdout:1/654: creat d1/d16/d1c/d4e/fef x:0 0 0 2023-12-08T20:28:23.985 INFO:tasks.workunit.client.0.smithi043.stdout:1/655: readlink d1/d16/d21/d42/laf 0 2023-12-08T20:28:23.985 INFO:tasks.workunit.client.0.smithi043.stdout:5/602: creat d3/d7/de/d17/d84/fba x:0 0 0 2023-12-08T20:28:23.985 INFO:tasks.workunit.client.0.smithi043.stdout:5/603: write d3/d7/de/d17/d84/fba [711842,89084] 0 2023-12-08T20:28:23.985 INFO:tasks.workunit.client.0.smithi043.stdout:5/604: write d3/d73/da4/fb4 [820917,78663] 0 2023-12-08T20:28:23.991 INFO:tasks.workunit.client.0.smithi043.stdout:4/612: dread d1/d14/d25/d28/f81 [0,4194304] 0 2023-12-08T20:28:23.991 INFO:tasks.workunit.client.0.smithi043.stdout:3/585: dread d1/d25/d2a/f6a [0,4194304] 0 2023-12-08T20:28:23.994 INFO:tasks.workunit.client.0.smithi043.stdout:9/593: mknod d0/d5e/d73/cbd 0 2023-12-08T20:28:23.994 INFO:tasks.workunit.client.0.smithi043.stdout:9/594: chown d0/d5e/f59 80789186 1 2023-12-08T20:28:23.994 INFO:tasks.workunit.client.0.smithi043.stdout:5/605: truncate d3/d7/de/d82/f8c 2161038 0 2023-12-08T20:28:24.001 INFO:tasks.workunit.client.0.smithi043.stdout:1/656: dread d1/d6/f32 [0,4194304] 0 2023-12-08T20:28:24.003 INFO:tasks.workunit.client.0.smithi043.stdout:7/603: dwrite d0/f9e [0,4194304] 0 2023-12-08T20:28:24.008 INFO:tasks.workunit.client.0.smithi043.stdout:3/586: link d1/d9/d2d/d66/c9b d1/d9/df/d6e/d7d/cbf 0 2023-12-08T20:28:24.008 INFO:tasks.workunit.client.0.smithi043.stdout:3/587: chown d1/d9/d2d/d66/f94 826578 1 2023-12-08T20:28:24.009 INFO:tasks.workunit.client.0.smithi043.stdout:8/623: dwrite d2/d20/d7d/d29/f66 [0,4194304] 0 2023-12-08T20:28:24.009 INFO:tasks.workunit.client.0.smithi043.stdout:8/624: chown d2/d20/d7d/d29/d30/d7c/c9e 61670 1 2023-12-08T20:28:24.010 INFO:tasks.workunit.client.0.smithi043.stdout:9/595: creat d0/d21/d80/d97/fbe x:0 0 0 2023-12-08T20:28:24.012 INFO:tasks.workunit.client.0.smithi043.stdout:3/588: dread d1/d9/d2d/d42/f95 [0,4194304] 0 2023-12-08T20:28:24.012 INFO:tasks.workunit.client.0.smithi043.stdout:3/589: write d1/d9/d38/d4f/d8f/f99 [553422,51519] 0 2023-12-08T20:28:24.014 INFO:tasks.workunit.client.0.smithi043.stdout:4/613: dwrite d1/d14/d25/d77/da4/dc0/fcb [0,4194304] 0 2023-12-08T20:28:24.019 INFO:tasks.workunit.client.0.smithi043.stdout:7/604: unlink d0/d6/d17/d54/f60 0 2023-12-08T20:28:24.019 INFO:tasks.workunit.client.0.smithi043.stdout:9/596: write d0/d3d/f48 [231152,53988] 0 2023-12-08T20:28:24.019 INFO:tasks.workunit.client.0.smithi043.stdout:5/606: creat d3/d7/d21/d51/d5c/fbb x:0 0 0 2023-12-08T20:28:24.019 INFO:tasks.workunit.client.0.smithi043.stdout:7/605: readlink d0/d6/l7e 0 2023-12-08T20:28:24.020 INFO:tasks.workunit.client.0.smithi043.stdout:7/606: read d0/d2/d12/f51 [4188321,101467] 0 2023-12-08T20:28:24.022 INFO:tasks.workunit.client.0.smithi043.stdout:8/625: rename d2/d20/d7d/d29/d59/c98 to d2/d20/d7d/d29/d59/d9f/ccb 0 2023-12-08T20:28:24.024 INFO:tasks.workunit.client.0.smithi043.stdout:9/597: write d0/d21/d80/fb3 [3741732,18777] 0 2023-12-08T20:28:24.024 INFO:tasks.workunit.client.0.smithi043.stdout:9/598: stat d0/d5e/dad/d6b/d94/fa0 0 2023-12-08T20:28:24.024 INFO:tasks.workunit.client.0.smithi043.stdout:4/614: creat d1/fd5 x:0 0 0 2023-12-08T20:28:24.025 INFO:tasks.workunit.client.0.smithi043.stdout:5/607: symlink d3/d7/d21/d51/d5c/d81/lbc 0 2023-12-08T20:28:24.025 INFO:tasks.workunit.client.0.smithi043.stdout:7/607: mknod d0/d2/d65/cbf 0 2023-12-08T20:28:24.026 INFO:tasks.workunit.client.0.smithi043.stdout:3/590: dread d1/d9/d38/d4f/f8c [0,4194304] 0 2023-12-08T20:28:24.027 INFO:tasks.workunit.client.0.smithi043.stdout:8/626: rmdir d2/d20/d7d/d29/d30/d7c/daa 39 2023-12-08T20:28:24.028 INFO:tasks.workunit.client.0.smithi043.stdout:4/615: mkdir d1/d14/d25/d39/dd6 0 2023-12-08T20:28:24.032 INFO:tasks.workunit.client.0.smithi043.stdout:5/608: mknod d3/d7/d21/d51/d5c/cbd 0 2023-12-08T20:28:24.033 INFO:tasks.workunit.client.0.smithi043.stdout:7/608: unlink d0/c4 0 2023-12-08T20:28:24.034 INFO:tasks.workunit.client.0.smithi043.stdout:3/591: mknod d1/d25/cc0 0 2023-12-08T20:28:24.035 INFO:tasks.workunit.client.0.smithi043.stdout:8/627: truncate d2/d20/d7d/f8a 264902 0 2023-12-08T20:28:24.035 INFO:tasks.workunit.client.0.smithi043.stdout:5/609: write d3/d7/de/d17/f27 [1185515,90177] 0 2023-12-08T20:28:24.037 INFO:tasks.workunit.client.0.smithi043.stdout:8/628: read d2/d27/d2d/d31/f36 [2631655,69511] 0 2023-12-08T20:28:24.037 INFO:tasks.workunit.client.0.smithi043.stdout:8/629: dread - d2/d20/d7d/d29/fb9 zero size 2023-12-08T20:28:24.037 INFO:tasks.workunit.client.0.smithi043.stdout:8/630: stat d2/c48 0 2023-12-08T20:28:24.037 INFO:tasks.workunit.client.0.smithi043.stdout:3/592: write d1/d25/d2a/d85/f92 [1126979,106214] 0 2023-12-08T20:28:24.038 INFO:tasks.workunit.client.0.smithi043.stdout:7/609: symlink d0/d2/d65/d99/lc0 0 2023-12-08T20:28:24.038 INFO:tasks.workunit.client.0.smithi043.stdout:7/610: truncate d0/f8f 377289 0 2023-12-08T20:28:24.039 INFO:tasks.workunit.client.0.smithi043.stdout:9/599: dwrite d0/d5e/f81 [0,4194304] 0 2023-12-08T20:28:24.040 INFO:tasks.workunit.client.0.smithi043.stdout:5/610: mknod d3/d7/de/d82/cbe 0 2023-12-08T20:28:24.041 INFO:tasks.workunit.client.0.smithi043.stdout:9/600: dread d0/d21/f87 [0,4194304] 0 2023-12-08T20:28:24.041 INFO:tasks.workunit.client.0.smithi043.stdout:8/631: creat d2/d20/d7d/d29/d59/d9f/fcc x:0 0 0 2023-12-08T20:28:24.042 INFO:tasks.workunit.client.0.smithi043.stdout:7/611: truncate d0/d2/f5 5391071 0 2023-12-08T20:28:24.048 INFO:tasks.workunit.client.0.smithi043.stdout:5/611: link f2 d3/d32/fbf 0 2023-12-08T20:28:24.052 INFO:tasks.workunit.client.0.smithi043.stdout:3/593: dread d1/d1c/f53 [0,4194304] 0 2023-12-08T20:28:24.053 INFO:tasks.workunit.client.0.smithi043.stdout:9/601: rename d0/f13 to d0/d3d/d8c/fbf 0 2023-12-08T20:28:24.053 INFO:tasks.workunit.client.0.smithi043.stdout:8/632: symlink d2/lcd 0 2023-12-08T20:28:24.053 INFO:tasks.workunit.client.0.smithi043.stdout:8/633: write d2/d27/f6d [1231594,85020] 0 2023-12-08T20:28:24.054 INFO:tasks.workunit.client.0.smithi043.stdout:7/612: getdents d0/d2/d12/d19 0 2023-12-08T20:28:24.054 INFO:tasks.workunit.client.0.smithi043.stdout:7/613: fdatasync d0/d2/d12/d19/f4f 0 2023-12-08T20:28:24.060 INFO:tasks.workunit.client.0.smithi043.stdout:3/594: mkdir d1/d25/dc1 0 2023-12-08T20:28:24.062 INFO:tasks.workunit.client.0.smithi043.stdout:9/602: rmdir d0/d5e/dad/d6b/d76/d53 39 2023-12-08T20:28:24.064 INFO:tasks.workunit.client.0.smithi043.stdout:8/634: symlink d2/d27/d2d/d31/d7f/db7/lce 0 2023-12-08T20:28:24.073 INFO:tasks.workunit.client.0.smithi043.stdout:5/612: dwrite d3/d7/d19/d3f/d52/f70 [0,4194304] 0 2023-12-08T20:28:24.073 INFO:tasks.workunit.client.0.smithi043.stdout:5/613: fdatasync d3/d7/d21/d51/d5c/f74 0 2023-12-08T20:28:24.095 INFO:tasks.workunit.client.0.smithi043.stdout:7/614: symlink d0/d6/d17/d52/lc1 0 2023-12-08T20:28:24.101 INFO:tasks.workunit.client.0.smithi043.stdout:9/603: link d0/d5e/dad/d6b/l93 d0/d3d/d8c/lc0 0 2023-12-08T20:28:24.118 INFO:tasks.workunit.client.0.smithi043.stdout:7/615: dwrite d0/d6/d17/d54/f80 [0,4194304] 0 2023-12-08T20:28:24.119 INFO:tasks.workunit.client.0.smithi043.stdout:7/616: write d0/d2/f5 [1136778,36126] 0 2023-12-08T20:28:24.119 INFO:tasks.workunit.client.0.smithi043.stdout:7/617: write d0/d2/d12/d19/f94 [5045080,40362] 0 2023-12-08T20:28:24.128 INFO:tasks.workunit.client.0.smithi043.stdout:0/869: link d2/d3/d18/l33 d2/d3/d18/d1e/d53/d10b/d39/d63/da6/dae/l11c 0 2023-12-08T20:28:24.135 INFO:tasks.workunit.client.0.smithi043.stdout:8/635: creat d2/d20/d7d/d29/d59/d86/fcf x:0 0 0 2023-12-08T20:28:24.135 INFO:tasks.workunit.client.0.smithi043.stdout:8/636: readlink d2/d27/d2d/l2f 0 2023-12-08T20:28:24.136 INFO:tasks.workunit.client.0.smithi043.stdout:8/637: truncate d2/d20/d7d/f8a 363176 0 2023-12-08T20:28:24.136 INFO:tasks.workunit.client.0.smithi043.stdout:8/638: readlink d2/d27/l5f 0 2023-12-08T20:28:24.140 INFO:tasks.workunit.client.0.smithi043.stdout:5/614: creat d3/d7/d21/d51/d5c/d81/fc0 x:0 0 0 2023-12-08T20:28:24.141 INFO:tasks.workunit.client.0.smithi043.stdout:2/876: mknod d0/db/d18/d8b/da2/c120 0 2023-12-08T20:28:24.141 INFO:tasks.workunit.client.0.smithi043.stdout:2/877: dread - d0/d81/daa/f10f zero size 2023-12-08T20:28:24.141 INFO:tasks.workunit.client.0.smithi043.stdout:2/878: fdatasync d0/d26/dbc/d38/f4f 0 2023-12-08T20:28:24.141 INFO:tasks.workunit.client.0.smithi043.stdout:2/879: chown d0/d20/l80 167142 1 2023-12-08T20:28:24.142 INFO:tasks.workunit.client.0.smithi043.stdout:0/870: rename d2/c17 to d2/c11d 0 2023-12-08T20:28:24.143 INFO:tasks.workunit.client.0.smithi043.stdout:0/871: write d2/d3/d18/d2b/da5/d5f/df0/f10c [4705690,46978] 0 2023-12-08T20:28:24.146 INFO:tasks.workunit.client.0.smithi043.stdout:2/880: unlink d0/d20/d42/f78 0 2023-12-08T20:28:24.150 INFO:tasks.workunit.client.0.smithi043.stdout:0/872: rename d2/d3/d18/d2b/da5/d3f/d112 to d2/d3/d18/d2b/da5/d5f/df0/d11e 0 2023-12-08T20:28:24.151 INFO:tasks.workunit.client.0.smithi043.stdout:3/595: symlink d1/d1c/d29/lc2 0 2023-12-08T20:28:24.152 INFO:tasks.workunit.client.0.smithi043.stdout:0/873: getdents d2/d3/d18/d1e/d53 0 2023-12-08T20:28:24.154 INFO:tasks.workunit.client.0.smithi043.stdout:9/604: unlink d0/d5e/d73/cbd 0 2023-12-08T20:28:24.156 INFO:tasks.workunit.client.0.smithi043.stdout:0/874: creat d2/d3/d18/d1e/dcc/f11f x:0 0 0 2023-12-08T20:28:24.156 INFO:tasks.workunit.client.0.smithi043.stdout:0/875: stat d2/d3/d18/d2b/da5/d5f/d79/fcb 0 2023-12-08T20:28:24.157 INFO:tasks.workunit.client.0.smithi043.stdout:0/876: fsync d2/d3/d18/d1e/d53/d10b/f68 0 2023-12-08T20:28:24.157 INFO:tasks.workunit.client.0.smithi043.stdout:7/618: dread - d0/d5b/fa6 zero size 2023-12-08T20:28:24.157 INFO:tasks.workunit.client.0.smithi043.stdout:7/619: fsync d0/fbb 0 2023-12-08T20:28:24.160 INFO:tasks.workunit.client.0.smithi043.stdout:0/877: creat d2/d3/d18/d1e/d53/d10b/d39/d63/da6/dae/f120 x:0 0 0 2023-12-08T20:28:24.161 INFO:tasks.workunit.client.0.smithi043.stdout:8/639: link d2/f3e d2/d27/d2d/d31/d7f/db7/fd0 0 2023-12-08T20:28:24.162 INFO:tasks.workunit.client.0.smithi043.stdout:3/596: mkdir d1/d25/d2a/d85/da6/dc3 0 2023-12-08T20:28:24.162 INFO:tasks.workunit.client.0.smithi043.stdout:3/597: stat d1/d9/d38/d4f/c9c 0 2023-12-08T20:28:24.162 INFO:tasks.workunit.client.0.smithi043.stdout:3/598: write d1/d9/df/f62 [565587,54108] 0 2023-12-08T20:28:24.163 INFO:tasks.workunit.client.0.smithi043.stdout:9/605: mkdir d0/d21/dc1 0 2023-12-08T20:28:24.163 INFO:tasks.workunit.client.0.smithi043.stdout:9/606: readlink d0/d3d/d8c/lc0 0 2023-12-08T20:28:24.164 INFO:tasks.workunit.client.0.smithi043.stdout:7/620: rename d0/d2/d65/d99/d47/c93 to d0/d69/d6d/d87/cc2 0 2023-12-08T20:28:24.166 INFO:tasks.workunit.client.0.smithi043.stdout:5/615: dwrite d3/d7/f1a [0,4194304] 0 2023-12-08T20:28:24.168 INFO:tasks.workunit.client.0.smithi043.stdout:9/607: mknod d0/d3d/d4b/d61/cc2 0 2023-12-08T20:28:24.168 INFO:tasks.workunit.client.0.smithi043.stdout:8/640: creat d2/d20/d7d/d29/d30/fd1 x:0 0 0 2023-12-08T20:28:24.170 INFO:tasks.workunit.client.0.smithi043.stdout:7/621: creat d0/d6/d17/d54/fc3 x:0 0 0 2023-12-08T20:28:24.170 INFO:tasks.workunit.client.0.smithi043.stdout:3/599: fdatasync d1/d25/d2a/d85/f92 0 2023-12-08T20:28:24.172 INFO:tasks.workunit.client.0.smithi043.stdout:2/881: dwrite d0/dd4/df9/f103 [0,4194304] 0 2023-12-08T20:28:24.173 INFO:tasks.workunit.client.0.smithi043.stdout:2/882: read d0/dd4/df9/f103 [3364438,17556] 0 2023-12-08T20:28:24.173 INFO:tasks.workunit.client.0.smithi043.stdout:2/883: fsync d0/db/d18/d3d/f50 0 2023-12-08T20:28:24.173 INFO:tasks.workunit.client.0.smithi043.stdout:5/616: unlink d3/d7/de/d6a/db2/cb9 0 2023-12-08T20:28:24.173 INFO:tasks.workunit.client.0.smithi043.stdout:5/617: write d3/d73/da4/fb4 [1170801,85732] 0 2023-12-08T20:28:24.173 INFO:tasks.workunit.client.0.smithi043.stdout:5/618: readlink d3/d7/de/d17/l41 0 2023-12-08T20:28:24.174 INFO:tasks.workunit.client.0.smithi043.stdout:2/884: read d0/f24 [988188,117420] 0 2023-12-08T20:28:24.174 INFO:tasks.workunit.client.0.smithi043.stdout:2/885: stat d0/db/d18/l111 0 2023-12-08T20:28:24.174 INFO:tasks.workunit.client.0.smithi043.stdout:8/641: creat d2/d20/d7d/d29/d30/d71/fd2 x:0 0 0 2023-12-08T20:28:24.174 INFO:tasks.workunit.client.0.smithi043.stdout:8/642: fsync d2/d20/d7d/d29/fb9 0 2023-12-08T20:28:24.174 INFO:tasks.workunit.client.0.smithi043.stdout:8/643: fdatasync d2/d20/d7d/f26 0 2023-12-08T20:28:24.174 INFO:tasks.workunit.client.0.smithi043.stdout:8/644: readlink d2/d6f/l73 0 2023-12-08T20:28:24.174 INFO:tasks.workunit.client.0.smithi043.stdout:9/608: getdents d0/d3d/d8a 0 2023-12-08T20:28:24.174 INFO:tasks.workunit.client.0.smithi043.stdout:5/619: link d3/d7/d21/c5a d3/d7/de/d82/cc1 0 2023-12-08T20:28:24.174 INFO:tasks.workunit.client.0.smithi043.stdout:5/620: stat d3/d73 0 2023-12-08T20:28:24.175 INFO:tasks.workunit.client.0.smithi043.stdout:2/886: mkdir d0/dd4/d121 0 2023-12-08T20:28:24.175 INFO:tasks.workunit.client.0.smithi043.stdout:2/887: fdatasync d0/d2b/f46 0 2023-12-08T20:28:24.176 INFO:tasks.workunit.client.0.smithi043.stdout:8/645: unlink d2/d20/d7d/d29/d59/d86/fcf 0 2023-12-08T20:28:24.178 INFO:tasks.workunit.client.0.smithi043.stdout:5/621: truncate d3/d7/d29/f3c 1015465 0 2023-12-08T20:28:24.180 INFO:tasks.workunit.client.0.smithi043.stdout:8/646: link d2/d20/d7d/d29/d30/l3d d2/d20/d7d/d37/ld3 0 2023-12-08T20:28:24.180 INFO:tasks.workunit.client.0.smithi043.stdout:8/647: write d2/d27/d2d/d31/d4f/fb0 [1455377,116942] 0 2023-12-08T20:28:24.181 INFO:tasks.workunit.client.0.smithi043.stdout:8/648: mknod d2/d27/d2d/d31/d74/cd4 0 2023-12-08T20:28:24.184 INFO:tasks.workunit.client.0.smithi043.stdout:9/609: getdents d0/d5e/d73 0 2023-12-08T20:28:24.184 INFO:tasks.workunit.client.0.smithi043.stdout:2/888: rmdir d0/d2b 39 2023-12-08T20:28:24.185 INFO:tasks.workunit.client.0.smithi043.stdout:7/622: dread d0/d2/d12/f32 [0,4194304] 0 2023-12-08T20:28:24.186 INFO:tasks.workunit.client.0.smithi043.stdout:9/610: dread d0/d3d/f45 [0,4194304] 0 2023-12-08T20:28:24.187 INFO:tasks.workunit.client.0.smithi043.stdout:0/878: dwrite d2/d3/d18/d2b/da5/d5f/df0/ffb [0,4194304] 0 2023-12-08T20:28:24.187 INFO:tasks.workunit.client.0.smithi043.stdout:0/879: chown d2/d3/d18/d2b/da5/d5f/ld4 449 1 2023-12-08T20:28:24.189 INFO:tasks.workunit.client.0.smithi043.stdout:9/611: mkdir d0/d5e/dc3 0 2023-12-08T20:28:24.190 INFO:tasks.workunit.client.0.smithi043.stdout:2/889: unlink d0/db/d18/d66/d71/dab/lb7 0 2023-12-08T20:28:24.193 INFO:tasks.workunit.client.0.smithi043.stdout:5/622: write d3/d7/d21/d51/fac [3075104,83059] 0 2023-12-08T20:28:24.193 INFO:tasks.workunit.client.0.smithi043.stdout:5/623: read - d3/d7/d21/d51/d5c/fbb zero size 2023-12-08T20:28:24.195 INFO:tasks.workunit.client.0.smithi043.stdout:2/890: creat d0/d20/d42/dcb/d117/dfd/dff/d11e/f122 x:0 0 0 2023-12-08T20:28:24.196 INFO:tasks.workunit.client.0.smithi043.stdout:2/891: creat d0/db/d18/d66/f123 x:0 0 0 2023-12-08T20:28:24.197 INFO:tasks.workunit.client.0.smithi043.stdout:9/612: mknod d0/d3d/d4b/d5c/cc4 0 2023-12-08T20:28:24.197 INFO:tasks.workunit.client.0.smithi043.stdout:9/613: readlink d0/d5e/l3b 0 2023-12-08T20:28:24.198 INFO:tasks.workunit.client.0.smithi043.stdout:5/624: getdents d3/d73/da4/db0 0 2023-12-08T20:28:24.199 INFO:tasks.workunit.client.0.smithi043.stdout:9/614: rmdir d0/d5e/dc3 0 2023-12-08T20:28:24.200 INFO:tasks.workunit.client.0.smithi043.stdout:9/615: chown d0/c5b 44 1 2023-12-08T20:28:24.200 INFO:tasks.workunit.client.0.smithi043.stdout:3/600: dwrite d1/d9/d2d/fa9 [0,4194304] 0 2023-12-08T20:28:24.200 INFO:tasks.workunit.client.0.smithi043.stdout:5/625: creat d3/d7/d29/fc2 x:0 0 0 2023-12-08T20:28:24.205 INFO:tasks.workunit.client.0.smithi043.stdout:2/892: unlink d0/d26/f3b 0 2023-12-08T20:28:24.208 INFO:tasks.workunit.client.0.smithi043.stdout:8/649: dwrite d2/d27/f35 [8388608,4194304] 0 2023-12-08T20:28:24.214 INFO:tasks.workunit.client.0.smithi043.stdout:9/616: creat d0/d67/fc5 x:0 0 0 2023-12-08T20:28:24.215 INFO:tasks.workunit.client.0.smithi043.stdout:8/650: write d2/f9 [301051,3362] 0 2023-12-08T20:28:24.215 INFO:tasks.workunit.client.0.smithi043.stdout:3/601: rename d1/d9/df/d41/c3b to d1/d25/d2a/d85/da6/dad/cc4 0 2023-12-08T20:28:24.217 INFO:tasks.workunit.client.0.smithi043.stdout:9/617: creat d0/d3d/d8c/fc6 x:0 0 0 2023-12-08T20:28:24.217 INFO:tasks.workunit.client.0.smithi043.stdout:9/618: chown d0/d5e/dad/d6b/d94 148505943 1 2023-12-08T20:28:24.217 INFO:tasks.workunit.client.0.smithi043.stdout:9/619: chown d0/d3d/d4b/da2/dbc 3210 1 2023-12-08T20:28:24.225 INFO:tasks.workunit.client.0.smithi043.stdout:5/626: dwrite d3/d7/d19/d3f/d52/f5e [0,4194304] 0 2023-12-08T20:28:24.230 INFO:tasks.workunit.client.0.smithi043.stdout:7/623: truncate d0/d2/d12/d19/f94 3144184 0 2023-12-08T20:28:24.230 INFO:tasks.workunit.client.0.smithi043.stdout:9/620: dread d0/f6 [0,4194304] 0 2023-12-08T20:28:24.230 INFO:tasks.workunit.client.0.smithi043.stdout:5/627: unlink d3/d32/fbf 0 2023-12-08T20:28:24.230 INFO:tasks.workunit.client.0.smithi043.stdout:8/651: dread d2/d20/d7d/d37/d5a/f63 [0,4194304] 0 2023-12-08T20:28:24.230 INFO:tasks.workunit.client.0.smithi043.stdout:2/893: dwrite d0/db/d18/f36 [4194304,4194304] 0 2023-12-08T20:28:24.230 INFO:tasks.workunit.client.0.smithi043.stdout:2/894: truncate d0/d26/d53/fb2 827798 0 2023-12-08T20:28:24.230 INFO:tasks.workunit.client.0.smithi043.stdout:2/895: truncate d0/d2b/d4e/d93/da9/fcd 1197612 0 2023-12-08T20:28:24.230 INFO:tasks.workunit.client.0.smithi043.stdout:2/896: write d0/d20/d42/d49/f69 [1309502,15353] 0 2023-12-08T20:28:24.230 INFO:tasks.workunit.client.0.smithi043.stdout:2/897: truncate d0/db/d18/d3d/fdb 5216260 0 2023-12-08T20:28:24.231 INFO:tasks.workunit.client.0.smithi043.stdout:9/621: rename d0/d5e/dad/d6b/d6c/f7d to d0/d3d/d4b/d5c/fc7 0 2023-12-08T20:28:24.233 INFO:tasks.workunit.client.0.smithi043.stdout:8/652: creat d2/d27/dab/fd5 x:0 0 0 2023-12-08T20:28:24.233 INFO:tasks.workunit.client.0.smithi043.stdout:9/622: mknod d0/d21/cc8 0 2023-12-08T20:28:24.237 INFO:tasks.workunit.client.0.smithi043.stdout:9/623: rename d0/cc to d0/d3d/d4b/d5c/cc9 0 2023-12-08T20:28:24.237 INFO:tasks.workunit.client.0.smithi043.stdout:9/624: chown d0/d21/d80/fb3 7 1 2023-12-08T20:28:24.238 INFO:tasks.workunit.client.0.smithi043.stdout:7/624: dread d0/d2/d12/d19/f40 [0,4194304] 0 2023-12-08T20:28:24.238 INFO:tasks.workunit.client.0.smithi043.stdout:7/625: truncate d0/d2/d12/d19/d38/f55 4559132 0 2023-12-08T20:28:24.238 INFO:tasks.workunit.client.0.smithi043.stdout:7/626: stat d0/fb 0 2023-12-08T20:28:24.242 INFO:tasks.workunit.client.0.smithi043.stdout:3/602: truncate d1/d9/d2d/fa9 3736101 0 2023-12-08T20:28:24.242 INFO:tasks.workunit.client.0.smithi043.stdout:3/603: readlink d1/d9/d2d/d42/lb8 0 2023-12-08T20:28:24.244 INFO:tasks.workunit.client.0.smithi043.stdout:8/653: write d2/d20/d7d/d29/d59/f65 [648225,41084] 0 2023-12-08T20:28:24.244 INFO:tasks.workunit.client.0.smithi043.stdout:3/604: mknod d1/d25/dc1/cc5 0 2023-12-08T20:28:24.244 INFO:tasks.workunit.client.0.smithi043.stdout:3/605: write d1/d9/d38/fab [371278,110452] 0 2023-12-08T20:28:24.244 INFO:tasks.workunit.client.0.smithi043.stdout:3/606: stat d1/d25/d84/la8 0 2023-12-08T20:28:24.245 INFO:tasks.workunit.client.0.smithi043.stdout:3/607: write d1/d25/d2a/f6a [2653918,42623] 0 2023-12-08T20:28:24.248 INFO:tasks.workunit.client.0.smithi043.stdout:3/608: mknod d1/d9/d38/d4f/cc6 0 2023-12-08T20:28:24.249 INFO:tasks.workunit.client.0.smithi043.stdout:2/898: dwrite d0/db/d18/d66/d71/f89 [0,4194304] 0 2023-12-08T20:28:24.252 INFO:tasks.workunit.client.0.smithi043.stdout:9/625: dread d0/d5e/f59 [0,4194304] 0 2023-12-08T20:28:24.254 INFO:tasks.workunit.client.0.smithi043.stdout:3/609: rename d1/d25/d2a/d5e to d1/d25/d2a/dc7 0 2023-12-08T20:28:24.254 INFO:tasks.workunit.client.0.smithi043.stdout:8/654: dread d2/d6f/f39 [0,4194304] 0 2023-12-08T20:28:24.254 INFO:tasks.workunit.client.0.smithi043.stdout:8/655: readlink d2/d27/l5f 0 2023-12-08T20:28:24.254 INFO:tasks.workunit.client.0.smithi043.stdout:8/656: chown d2/d6f/l73 2 1 2023-12-08T20:28:24.254 INFO:tasks.workunit.client.0.smithi043.stdout:5/628: dwrite d3/d7/de/d17/d84/fba [0,4194304] 0 2023-12-08T20:28:24.255 INFO:tasks.workunit.client.0.smithi043.stdout:9/626: creat d0/fca x:0 0 0 2023-12-08T20:28:24.255 INFO:tasks.workunit.client.0.smithi043.stdout:2/899: mknod d0/d2b/c124 0 2023-12-08T20:28:24.257 INFO:tasks.workunit.client.0.smithi043.stdout:8/657: mkdir d2/d20/d7d/d29/d30/d60/d9b/dbb/dd6 0 2023-12-08T20:28:24.257 INFO:tasks.workunit.client.0.smithi043.stdout:8/658: readlink d2/d20/d7d/d37/d5a/l94 0 2023-12-08T20:28:24.258 INFO:tasks.workunit.client.0.smithi043.stdout:5/629: getdents d3/d7/d21/d51/d7d 0 2023-12-08T20:28:24.262 INFO:tasks.workunit.client.0.smithi043.stdout:2/900: creat d0/db/d18/d66/d71/f125 x:0 0 0 2023-12-08T20:28:24.265 INFO:tasks.workunit.client.0.smithi043.stdout:7/627: dwrite d0/d2/d12/d19/f94 [0,4194304] 0 2023-12-08T20:28:24.268 INFO:tasks.workunit.client.0.smithi043.stdout:5/630: creat d3/d7/d19/fc3 x:0 0 0 2023-12-08T20:28:24.268 INFO:tasks.workunit.client.0.smithi043.stdout:5/631: truncate d3/d7/d21/d72/fa6 802134 0 2023-12-08T20:28:24.268 INFO:tasks.workunit.client.0.smithi043.stdout:5/632: write d3/d7/d21/fa1 [4562908,3347] 0 2023-12-08T20:28:24.268 INFO:tasks.workunit.client.0.smithi043.stdout:9/627: write d0/d5e/f59 [3053652,110650] 0 2023-12-08T20:28:24.268 INFO:tasks.workunit.client.0.smithi043.stdout:9/628: truncate d0/f1e 4245161 0 2023-12-08T20:28:24.269 INFO:tasks.workunit.client.0.smithi043.stdout:7/628: mknod d0/d6/d17/cc4 0 2023-12-08T20:28:24.270 INFO:tasks.workunit.client.0.smithi043.stdout:7/629: dread - d0/d6/d17/d52/f74 zero size 2023-12-08T20:28:24.270 INFO:tasks.workunit.client.0.smithi043.stdout:7/630: chown d0/d2/d12/d19/f40 60 1 2023-12-08T20:28:24.270 INFO:tasks.workunit.client.0.smithi043.stdout:5/633: stat d3/d7/de/cb3 0 2023-12-08T20:28:24.273 INFO:tasks.workunit.client.0.smithi043.stdout:9/629: symlink d0/d3d/d4b/d5c/lcb 0 2023-12-08T20:28:24.273 INFO:tasks.workunit.client.0.smithi043.stdout:5/634: rmdir d3/d7/de/d17/d84 39 2023-12-08T20:28:24.273 INFO:tasks.workunit.client.0.smithi043.stdout:9/630: getdents d0/d3d/d4b/da2/dbc 0 2023-12-08T20:28:24.276 INFO:tasks.workunit.client.0.smithi043.stdout:7/631: dread d0/d69/fb8 [0,4194304] 0 2023-12-08T20:28:24.276 INFO:tasks.workunit.client.0.smithi043.stdout:9/631: rename d0/f6 to d0/d21/dc1/fcc 0 2023-12-08T20:28:24.276 INFO:tasks.workunit.client.0.smithi043.stdout:9/632: chown d0/d67 25403506 1 2023-12-08T20:28:24.278 INFO:tasks.workunit.client.0.smithi043.stdout:9/633: creat d0/d5e/dad/d6b/d76/d53/fcd x:0 0 0 2023-12-08T20:28:24.279 INFO:tasks.workunit.client.0.smithi043.stdout:9/634: fsync d0/d5e/dad/fb4 0 2023-12-08T20:28:24.280 INFO:tasks.workunit.client.0.smithi043.stdout:9/635: creat d0/d5e/dad/d6b/d76/fce x:0 0 0 2023-12-08T20:28:24.282 INFO:tasks.workunit.client.0.smithi043.stdout:8/659: dwrite d2/d20/d7d/d29/d30/d7c/daa/fc6 [0,4194304] 0 2023-12-08T20:28:24.285 INFO:tasks.workunit.client.0.smithi043.stdout:8/660: symlink d2/d27/d2d/d31/d7f/db7/ld7 0 2023-12-08T20:28:24.285 INFO:tasks.workunit.client.0.smithi043.stdout:8/661: fdatasync d2/d20/d7d/fa9 0 2023-12-08T20:28:24.286 INFO:tasks.workunit.client.0.smithi043.stdout:3/610: dwrite d1/d9/d2d/d66/f98 [4194304,4194304] 0 2023-12-08T20:28:24.288 INFO:tasks.workunit.client.0.smithi043.stdout:8/662: mkdir d2/d27/d2d/d31/d7f/db7/dd8 0 2023-12-08T20:28:24.288 INFO:tasks.workunit.client.0.smithi043.stdout:8/663: dread - d2/d27/d2d/d31/d7f/f93 zero size 2023-12-08T20:28:24.288 INFO:tasks.workunit.client.0.smithi043.stdout:8/664: write d2/d20/d7d/d29/d30/d71/f8d [729464,112358] 0 2023-12-08T20:28:24.288 INFO:tasks.workunit.client.0.smithi043.stdout:3/611: creat d1/d9/d2d/d91/fc8 x:0 0 0 2023-12-08T20:28:24.290 INFO:tasks.workunit.client.0.smithi043.stdout:8/665: rename d2/d20/d7d/d29/d30/d60/d9b/lba to d2/d20/d7d/d29/d30/d60/ld9 0 2023-12-08T20:28:24.292 INFO:tasks.workunit.client.0.smithi043.stdout:2/901: dwrite d0/d26/dbc/d38/dae/f110 [0,4194304] 0 2023-12-08T20:28:24.292 INFO:tasks.workunit.client.0.smithi043.stdout:2/902: chown d0/db/d18/d8b 266 1 2023-12-08T20:28:24.292 INFO:tasks.workunit.client.0.smithi043.stdout:2/903: readlink d0/db/l11d 0 2023-12-08T20:28:24.294 INFO:tasks.workunit.client.0.smithi043.stdout:2/904: read d0/db/faf [1335195,1206] 0 2023-12-08T20:28:24.296 INFO:tasks.workunit.client.0.smithi043.stdout:3/612: dread d1/d9/f4e [0,4194304] 0 2023-12-08T20:28:24.297 INFO:tasks.workunit.client.0.smithi043.stdout:3/613: write d1/d9/d2d/d42/f95 [3129558,73124] 0 2023-12-08T20:28:24.298 INFO:tasks.workunit.client.0.smithi043.stdout:3/614: symlink d1/d1c/d2c/d5f/d80/lc9 0 2023-12-08T20:28:24.304 INFO:tasks.workunit.client.0.smithi043.stdout:9/636: dread d0/d5e/f33 [4194304,4194304] 0 2023-12-08T20:28:24.304 INFO:tasks.workunit.client.0.smithi043.stdout:7/632: dwrite d0/d6/fba [4194304,4194304] 0 2023-12-08T20:28:24.305 INFO:tasks.workunit.client.0.smithi043.stdout:5/635: dwrite d3/d7/de/d17/d84/f87 [0,4194304] 0 2023-12-08T20:28:24.305 INFO:tasks.workunit.client.0.smithi043.stdout:5/636: readlink d3/l85 0 2023-12-08T20:28:24.306 INFO:tasks.workunit.client.0.smithi043.stdout:7/633: creat d0/d5b/fc5 x:0 0 0 2023-12-08T20:28:24.306 INFO:tasks.workunit.client.0.smithi043.stdout:7/634: chown d0/fbb 19638 1 2023-12-08T20:28:24.307 INFO:tasks.workunit.client.0.smithi043.stdout:7/635: dread - d0/d2/d65/fae zero size 2023-12-08T20:28:24.309 INFO:tasks.workunit.client.0.smithi043.stdout:8/666: dread d2/d20/d7d/d29/d30/d71/f8d [0,4194304] 0 2023-12-08T20:28:24.310 INFO:tasks.workunit.client.0.smithi043.stdout:5/637: truncate f1 3722661 0 2023-12-08T20:28:24.313 INFO:tasks.workunit.client.0.smithi043.stdout:7/636: creat d0/d2/fc6 x:0 0 0 2023-12-08T20:28:24.313 INFO:tasks.workunit.client.0.smithi043.stdout:3/615: dread d1/d9/d2d/fa9 [0,4194304] 0 2023-12-08T20:28:24.313 INFO:tasks.workunit.client.0.smithi043.stdout:7/637: chown d0/d6/d17/d54/ca7 0 1 2023-12-08T20:28:24.314 INFO:tasks.workunit.client.0.smithi043.stdout:2/905: dwrite d0/db/d18/d66/d71/f89 [0,4194304] 0 2023-12-08T20:28:24.314 INFO:tasks.workunit.client.0.smithi043.stdout:2/906: chown d0/d81/f8e 5042 1 2023-12-08T20:28:24.314 INFO:tasks.workunit.client.0.smithi043.stdout:2/907: dread - d0/db/d18/d8b/f104 zero size 2023-12-08T20:28:24.314 INFO:tasks.workunit.client.0.smithi043.stdout:2/908: stat d0/d20/d42/dcb 0 2023-12-08T20:28:24.315 INFO:tasks.workunit.client.0.smithi043.stdout:2/909: mknod d0/d26/dbc/d38/dae/c126 0 2023-12-08T20:28:24.315 INFO:tasks.workunit.client.0.smithi043.stdout:2/910: write d0/d20/fe0 [812856,124504] 0 2023-12-08T20:28:24.316 INFO:tasks.workunit.client.0.smithi043.stdout:3/616: write d1/d1c/d29/f5c [1023330,43110] 0 2023-12-08T20:28:24.317 INFO:tasks.workunit.client.0.smithi043.stdout:8/667: creat d2/d27/dab/fda x:0 0 0 2023-12-08T20:28:24.329 INFO:tasks.workunit.client.0.smithi043.stdout:9/637: dwrite d0/d21/d80/fb3 [0,4194304] 0 2023-12-08T20:28:24.329 INFO:tasks.workunit.client.0.smithi043.stdout:9/638: chown d0/d5e/dad/d6b/d94/fa0 483018213 1 2023-12-08T20:28:24.337 INFO:tasks.workunit.client.0.smithi043.stdout:7/638: rmdir d0/d69 39 2023-12-08T20:28:24.337 INFO:tasks.workunit.client.0.smithi043.stdout:7/639: readlink d0/d6/d17/d54/la9 0 2023-12-08T20:28:24.337 INFO:tasks.workunit.client.0.smithi043.stdout:7/640: chown d0/d2/d65/fae 15677 1 2023-12-08T20:28:24.339 INFO:tasks.workunit.client.0.smithi043.stdout:3/617: mkdir d1/d9/d2d/d66/dca 0 2023-12-08T20:28:24.339 INFO:tasks.workunit.client.0.smithi043.stdout:3/618: write d1/d9/d38/d33/f63 [5879390,19615] 0 2023-12-08T20:28:24.340 INFO:tasks.workunit.client.0.smithi043.stdout:8/668: creat d2/d20/fdb x:0 0 0 2023-12-08T20:28:24.340 INFO:tasks.workunit.client.0.smithi043.stdout:8/669: dread - d2/d20/d7d/d29/d59/d9f/fc3 zero size 2023-12-08T20:28:24.340 INFO:tasks.workunit.client.0.smithi043.stdout:8/670: fsync d2/f21 0 2023-12-08T20:28:24.344 INFO:tasks.workunit.client.0.smithi043.stdout:3/619: write d1/d9/f19 [10387688,82158] 0 2023-12-08T20:28:24.344 INFO:tasks.workunit.client.0.smithi043.stdout:3/620: chown d1/d1c/d29/f5c 50328 1 2023-12-08T20:28:24.348 INFO:tasks.workunit.client.0.smithi043.stdout:9/639: dwrite d0/d5e/f40 [0,4194304] 0 2023-12-08T20:28:24.348 INFO:tasks.workunit.client.0.smithi043.stdout:9/640: chown d0/d5e/dad/d6b/d6c/f7b 2968 1 2023-12-08T20:28:24.348 INFO:tasks.workunit.client.0.smithi043.stdout:7/641: dread d0/d2/d12/d19/f94 [0,4194304] 0 2023-12-08T20:28:24.354 INFO:tasks.workunit.client.0.smithi043.stdout:8/671: dread d2/d27/d2d/d31/d99/faf [4194304,4194304] 0 2023-12-08T20:28:24.364 INFO:tasks.workunit.client.0.smithi043.stdout:3/621: truncate d1/d25/d2a/f6a 1959596 0 2023-12-08T20:28:24.365 INFO:tasks.workunit.client.0.smithi043.stdout:9/641: mknod d0/d21/ccf 0 2023-12-08T20:28:24.366 INFO:tasks.workunit.client.0.smithi043.stdout:7/642: rmdir d0/d69/d6d/d87 39 2023-12-08T20:28:24.367 INFO:tasks.workunit.client.0.smithi043.stdout:3/622: getdents d1/d9/df/d41 0 2023-12-08T20:28:24.369 INFO:tasks.workunit.client.0.smithi043.stdout:9/642: symlink d0/d5e/dad/d6b/d76/ld0 0 2023-12-08T20:28:24.369 INFO:tasks.workunit.client.0.smithi043.stdout:9/643: write d0/d21/d80/d97/fbe [326992,82662] 0 2023-12-08T20:28:24.371 INFO:tasks.workunit.client.0.smithi043.stdout:3/623: unlink d1/d25/cc0 0 2023-12-08T20:28:24.371 INFO:tasks.workunit.client.0.smithi043.stdout:3/624: truncate d1/d9/d38/d4a/fb3 1023280 0 2023-12-08T20:28:24.373 INFO:tasks.workunit.client.0.smithi043.stdout:9/644: creat d0/d5e/fd1 x:0 0 0 2023-12-08T20:28:24.374 INFO:tasks.workunit.client.0.smithi043.stdout:3/625: unlink d1/d9/d38/d33/f9d 0 2023-12-08T20:28:24.375 INFO:tasks.workunit.client.0.smithi043.stdout:3/626: write d1/d25/f36 [1090927,45959] 0 2023-12-08T20:28:24.375 INFO:tasks.workunit.client.0.smithi043.stdout:9/645: creat d0/d3d/d8a/fd2 x:0 0 0 2023-12-08T20:28:24.375 INFO:tasks.workunit.client.0.smithi043.stdout:9/646: write d0/d5e/dad/d6b/d94/fa0 [149332,103353] 0 2023-12-08T20:28:24.377 INFO:tasks.workunit.client.0.smithi043.stdout:9/647: mkdir d0/d5e/dad/d6b/d76/dd3 0 2023-12-08T20:28:24.377 INFO:tasks.workunit.client.0.smithi043.stdout:9/648: fsync d0/d5e/fa4 0 2023-12-08T20:28:24.377 INFO:tasks.workunit.client.0.smithi043.stdout:9/649: mkdir d0/d3d/dd4 0 2023-12-08T20:28:24.379 INFO:tasks.workunit.client.0.smithi043.stdout:9/650: creat d0/d3d/d4b/d5c/fd5 x:0 0 0 2023-12-08T20:28:24.381 INFO:tasks.workunit.client.0.smithi043.stdout:9/651: creat d0/d5e/fd6 x:0 0 0 2023-12-08T20:28:24.382 INFO:tasks.workunit.client.0.smithi043.stdout:9/652: mknod d0/d5e/dad/d6b/d6c/cd7 0 2023-12-08T20:28:24.382 INFO:tasks.workunit.client.0.smithi043.stdout:9/653: truncate d0/d5e/dad/d6b/d76/f68 309418 0 2023-12-08T20:28:24.382 INFO:tasks.workunit.client.0.smithi043.stdout:9/654: fsync d0/d5e/dad/f3a 0 2023-12-08T20:28:24.383 INFO:tasks.workunit.client.0.smithi043.stdout:8/672: truncate d2/d20/d7d/f8a 171111 0 2023-12-08T20:28:24.384 INFO:tasks.workunit.client.0.smithi043.stdout:9/655: getdents d0/d3d/d8c 0 2023-12-08T20:28:24.386 INFO:tasks.workunit.client.0.smithi043.stdout:7/643: dwrite d0/d2/d65/d83/fb9 [0,4194304] 0 2023-12-08T20:28:24.386 INFO:tasks.workunit.client.0.smithi043.stdout:9/656: creat d0/d5e/dad/d6b/d94/fd8 x:0 0 0 2023-12-08T20:28:24.386 INFO:tasks.workunit.client.0.smithi043.stdout:9/657: dread - d0/d21/d80/d8e/fb8 zero size 2023-12-08T20:28:24.386 INFO:tasks.workunit.client.0.smithi043.stdout:9/658: fdatasync d0/d3d/f48 0 2023-12-08T20:28:24.390 INFO:tasks.workunit.client.0.smithi043.stdout:7/644: rename d0/d2/d12/d19/d38/d85 to d0/d6/dc7 0 2023-12-08T20:28:24.391 INFO:tasks.workunit.client.0.smithi043.stdout:7/645: write d0/d2/f7c [481412,58000] 0 2023-12-08T20:28:24.391 INFO:tasks.workunit.client.0.smithi043.stdout:7/646: write d0/d6/d17/d52/f74 [628027,90909] 0 2023-12-08T20:28:24.391 INFO:tasks.workunit.client.0.smithi043.stdout:9/659: creat d0/d3d/d8a/fd9 x:0 0 0 2023-12-08T20:28:24.393 INFO:tasks.workunit.client.0.smithi043.stdout:7/647: rmdir d0/d5b 39 2023-12-08T20:28:24.394 INFO:tasks.workunit.client.0.smithi043.stdout:9/660: creat d0/d21/d80/fda x:0 0 0 2023-12-08T20:28:24.395 INFO:tasks.workunit.client.0.smithi043.stdout:9/661: symlink d0/d67/ldb 0 2023-12-08T20:28:24.405 INFO:tasks.workunit.client.0.smithi043.stdout:7/648: dread d0/d6/d17/d54/f82 [0,4194304] 0 2023-12-08T20:28:24.405 INFO:tasks.workunit.client.0.smithi043.stdout:7/649: write d0/f8f [627963,32942] 0 2023-12-08T20:28:24.407 INFO:tasks.workunit.client.0.smithi043.stdout:7/650: getdents d0/d2/d65/d99/d47 0 2023-12-08T20:28:24.408 INFO:tasks.workunit.client.0.smithi043.stdout:7/651: link d0/d6/f1a d0/d69/d6d/fc8 0 2023-12-08T20:28:24.409 INFO:tasks.workunit.client.0.smithi043.stdout:7/652: truncate d0/d2/d65/d99/f10 5038297 0 2023-12-08T20:28:24.411 INFO:tasks.workunit.client.0.smithi043.stdout:9/662: dread d0/d21/d80/fb3 [0,4194304] 0 2023-12-08T20:28:24.411 INFO:tasks.workunit.client.0.smithi043.stdout:3/627: dwrite d1/d1c/d29/f57 [0,4194304] 0 2023-12-08T20:28:24.411 INFO:tasks.workunit.client.0.smithi043.stdout:8/673: dwrite d2/d27/dab/fd5 [0,4194304] 0 2023-12-08T20:28:24.411 INFO:tasks.workunit.client.0.smithi043.stdout:7/653: creat d0/d2/d12/d19/d38/fc9 x:0 0 0 2023-12-08T20:28:24.412 INFO:tasks.workunit.client.0.smithi043.stdout:9/663: creat d0/d5e/dad/d6b/d76/dd3/fdc x:0 0 0 2023-12-08T20:28:24.413 INFO:tasks.workunit.client.0.smithi043.stdout:9/664: write d0/d21/f26 [3878664,45119] 0 2023-12-08T20:28:24.414 INFO:tasks.workunit.client.0.smithi043.stdout:9/665: read d0/d5e/f59 [2413219,51462] 0 2023-12-08T20:28:24.415 INFO:tasks.workunit.client.0.smithi043.stdout:3/628: creat d1/d9/d2d/d66/dca/fcb x:0 0 0 2023-12-08T20:28:24.419 INFO:tasks.workunit.client.0.smithi043.stdout:3/629: dread d1/d9/d38/d33/f5d [0,4194304] 0 2023-12-08T20:28:24.419 INFO:tasks.workunit.client.0.smithi043.stdout:3/630: chown d1/d25/c1d 1266162 1 2023-12-08T20:28:24.419 INFO:tasks.workunit.client.0.smithi043.stdout:8/674: mknod d2/d27/d2d/d31/d7f/db7/cdc 0 2023-12-08T20:28:24.420 INFO:tasks.workunit.client.0.smithi043.stdout:7/654: mknod d0/cca 0 2023-12-08T20:28:24.421 INFO:tasks.workunit.client.0.smithi043.stdout:9/666: dread d0/d5e/dad/d6b/d6c/f7b [0,4194304] 0 2023-12-08T20:28:24.421 INFO:tasks.workunit.client.0.smithi043.stdout:9/667: dread - d0/fca zero size 2023-12-08T20:28:24.422 INFO:tasks.workunit.client.0.smithi043.stdout:3/631: creat d1/d9/d2d/d66/dca/fcc x:0 0 0 2023-12-08T20:28:24.424 INFO:tasks.workunit.client.0.smithi043.stdout:8/675: symlink d2/d20/d7d/d29/d59/d86/ldd 0 2023-12-08T20:28:24.426 INFO:tasks.workunit.client.0.smithi043.stdout:7/655: link d0/d2/d65/d99/c45 d0/d69/d6d/d87/ccb 0 2023-12-08T20:28:24.427 INFO:tasks.workunit.client.0.smithi043.stdout:8/676: symlink d2/d20/d7d/d29/d30/d7c/lde 0 2023-12-08T20:28:24.428 INFO:tasks.workunit.client.0.smithi043.stdout:7/656: mknod d0/d2/d12/da2/ccc 0 2023-12-08T20:28:24.434 INFO:tasks.workunit.client.0.smithi043.stdout:7/657: creat d0/d2/d12/fcd x:0 0 0 2023-12-08T20:28:24.437 INFO:tasks.workunit.client.0.smithi043.stdout:7/658: write d0/f42 [1350911,47334] 0 2023-12-08T20:28:24.439 INFO:tasks.workunit.client.0.smithi043.stdout:7/659: symlink d0/d2/d12/d19/lce 0 2023-12-08T20:28:24.439 INFO:tasks.workunit.client.0.smithi043.stdout:7/660: write d0/d2/d12/d19/f4f [312819,63229] 0 2023-12-08T20:28:24.439 INFO:tasks.workunit.client.0.smithi043.stdout:7/661: chown d0/d69/d6d/d87 0 1 2023-12-08T20:28:24.458 INFO:tasks.workunit.client.0.smithi043.stdout:9/668: dwrite d0/d67/fc5 [0,4194304] 0 2023-12-08T20:28:24.458 INFO:tasks.workunit.client.0.smithi043.stdout:7/662: dwrite d0/d2/d12/fbd [0,4194304] 0 2023-12-08T20:28:24.459 INFO:tasks.workunit.client.0.smithi043.stdout:8/677: dwrite d2/d27/d2d/d31/d74/fa5 [0,4194304] 0 2023-12-08T20:28:24.464 INFO:tasks.workunit.client.0.smithi043.stdout:8/678: unlink d2/d20/d7d/d29/fb9 0 2023-12-08T20:28:24.466 INFO:tasks.workunit.client.0.smithi043.stdout:7/663: mknod d0/d5b/ccf 0 2023-12-08T20:28:24.467 INFO:tasks.workunit.client.0.smithi043.stdout:8/679: mkdir d2/d20/d7d/d29/d59/d9f/ddf 0 2023-12-08T20:28:24.467 INFO:tasks.workunit.client.0.smithi043.stdout:7/664: dread - d0/d5b/f8b zero size 2023-12-08T20:28:24.467 INFO:tasks.workunit.client.0.smithi043.stdout:7/665: chown d0/d6/d17/dab 7559 1 2023-12-08T20:28:24.468 INFO:tasks.workunit.client.0.smithi043.stdout:8/680: creat d2/d27/fe0 x:0 0 0 2023-12-08T20:28:24.469 INFO:tasks.workunit.client.0.smithi043.stdout:8/681: chown d2/d27/d2d/d31/f58 489996207 1 2023-12-08T20:28:24.469 INFO:tasks.workunit.client.0.smithi043.stdout:8/682: write d2/d20/d7d/d37/d5a/f63 [3178569,92825] 0 2023-12-08T20:28:24.470 INFO:tasks.workunit.client.0.smithi043.stdout:8/683: readlink d2/d27/d2d/d31/d7f/l80 0 2023-12-08T20:28:24.470 INFO:tasks.workunit.client.0.smithi043.stdout:7/666: link d0/d2/fa4 d0/d2/d12/da2/fd0 0 2023-12-08T20:28:24.471 INFO:tasks.workunit.client.0.smithi043.stdout:8/684: symlink d2/d20/d7d/d29/d30/d7c/le1 0 2023-12-08T20:28:24.472 INFO:tasks.workunit.client.0.smithi043.stdout:7/667: link d0/d2/d12/d19/f4f d0/d6/d17/dab/fd1 0 2023-12-08T20:28:24.472 INFO:tasks.workunit.client.0.smithi043.stdout:7/668: write d0/d6/d17/dab/fb4 [4301259,18877] 0 2023-12-08T20:28:24.473 INFO:tasks.workunit.client.0.smithi043.stdout:8/685: mkdir d2/d27/d2d/de2 0 2023-12-08T20:28:24.473 INFO:tasks.workunit.client.0.smithi043.stdout:8/686: chown d2/d20/d7d/d37/d5a/f9a 80374492 1 2023-12-08T20:28:24.476 INFO:tasks.workunit.client.0.smithi043.stdout:7/669: creat d0/d6/d17/dab/fd2 x:0 0 0 2023-12-08T20:28:24.478 INFO:tasks.workunit.client.0.smithi043.stdout:7/670: unlink d0/d69/d6d/la8 0 2023-12-08T20:28:24.480 INFO:tasks.workunit.client.0.smithi043.stdout:7/671: creat d0/d2/d12/da2/fd3 x:0 0 0 2023-12-08T20:28:24.498 INFO:tasks.workunit.client.0.smithi043.stdout:8/687: dwrite d2/d20/d7d/d29/d30/f41 [4194304,4194304] 0 2023-12-08T20:28:24.499 INFO:tasks.workunit.client.0.smithi043.stdout:8/688: fsync d2/d27/d2d/f3c 0 2023-12-08T20:28:24.500 INFO:tasks.workunit.client.0.smithi043.stdout:8/689: link d2/d20/d7d/d29/d30/l34 d2/d20/d7d/d29/d30/d60/le3 0 2023-12-08T20:28:24.501 INFO:tasks.workunit.client.0.smithi043.stdout:8/690: creat d2/d27/dab/fe4 x:0 0 0 2023-12-08T20:28:24.502 INFO:tasks.workunit.client.0.smithi043.stdout:8/691: mknod d2/d20/d7d/d29/d30/d60/d9b/dbb/ce5 0 2023-12-08T20:28:24.502 INFO:tasks.workunit.client.0.smithi043.stdout:8/692: chown d2/d20/d7d/f26 11 1 2023-12-08T20:28:24.521 INFO:tasks.workunit.client.0.smithi043.stdout:8/693: dwrite d2/d20/d7d/f13 [0,4194304] 0 2023-12-08T20:28:24.522 INFO:tasks.workunit.client.0.smithi043.stdout:8/694: rmdir d2/d27/d2d 39 2023-12-08T20:28:24.526 INFO:tasks.workunit.client.0.smithi043.stdout:8/695: creat d2/d27/d2d/d31/d99/fe6 x:0 0 0 2023-12-08T20:28:24.526 INFO:tasks.workunit.client.0.smithi043.stdout:8/696: mkdir d2/d27/d2d/de7 0 2023-12-08T20:28:24.527 INFO:tasks.workunit.client.0.smithi043.stdout:8/697: write d2/d27/d2d/f55 [336065,7107] 0 2023-12-08T20:28:24.527 INFO:tasks.workunit.client.0.smithi043.stdout:8/698: chown d2/d20/d7d/d29/d59/d9f/fc3 535 1 2023-12-08T20:28:24.527 INFO:tasks.workunit.client.0.smithi043.stdout:8/699: write d2/d20/fdb [788693,35722] 0 2023-12-08T20:28:24.545 INFO:tasks.workunit.client.0.smithi043.stdout:8/700: dwrite d2/d20/d7d/d29/d30/f49 [0,4194304] 0 2023-12-08T20:28:24.546 INFO:tasks.workunit.client.0.smithi043.stdout:8/701: mkdir d2/d27/d2d/d31/de8 0 2023-12-08T20:28:24.562 INFO:tasks.workunit.client.0.smithi043.stdout:8/702: dwrite d2/d27/d2d/d31/d7f/db2/fc0 [0,4194304] 0 2023-12-08T20:28:24.563 INFO:tasks.workunit.client.0.smithi043.stdout:8/703: creat d2/d20/d7d/d29/fe9 x:0 0 0 2023-12-08T20:28:24.586 INFO:tasks.workunit.client.0.smithi043.stdout:8/704: dwrite d2/d27/d2d/d31/d74/f83 [0,4194304] 0 2023-12-08T20:28:24.586 INFO:tasks.workunit.client.0.smithi043.stdout:8/705: chown d2/d20/f78 93 1 2023-12-08T20:28:24.589 INFO:tasks.workunit.client.0.smithi043.stdout:8/706: unlink d2/d27/d2d/d31/d7f/db7/lce 0 2023-12-08T20:28:24.611 INFO:tasks.workunit.client.0.smithi043.stdout:8/707: dwrite d2/d27/d2d/d31/d74/f83 [0,4194304] 0 2023-12-08T20:28:24.619 INFO:tasks.workunit.client.0.smithi043.stdout:8/708: dread d2/d20/d7d/f2a [0,4194304] 0 2023-12-08T20:28:24.626 INFO:tasks.workunit.client.0.smithi043.stdout:8/709: unlink d2/d20/d7d/fa9 0 2023-12-08T20:28:24.628 INFO:tasks.workunit.client.0.smithi043.stdout:8/710: link d2/d20/d7d/d29/c5e d2/d20/d7d/d29/d30/d60/cea 0 2023-12-08T20:28:24.628 INFO:tasks.workunit.client.0.smithi043.stdout:8/711: truncate d2/d20/d7d/d29/d59/f65 2309885 0 2023-12-08T20:28:24.634 INFO:tasks.workunit.client.0.smithi043.stdout:8/712: dread d2/d27/dab/fd5 [0,4194304] 0 2023-12-08T20:28:24.637 INFO:tasks.workunit.client.0.smithi043.stdout:8/713: dread d2/d20/d7d/f2a [0,4194304] 0 2023-12-08T20:28:24.637 INFO:tasks.workunit.client.0.smithi043.stdout:8/714: write d2/d20/fb1 [1731744,48235] 0 2023-12-08T20:28:24.638 INFO:tasks.workunit.client.0.smithi043.stdout:8/715: truncate d2/d20/d7d/d37/d5a/f63 5517137 0 2023-12-08T20:28:24.638 INFO:tasks.workunit.client.0.smithi043.stdout:8/716: chown d2/d20/d7d/c43 2 1 2023-12-08T20:28:24.639 INFO:tasks.workunit.client.0.smithi043.stdout:8/717: symlink d2/d20/d7d/d29/d59/d9f/ddf/leb 0 2023-12-08T20:28:24.639 INFO:tasks.workunit.client.0.smithi043.stdout:8/718: rmdir d2/d20/d7d/d29/d30/d7c 39 2023-12-08T20:28:24.639 INFO:tasks.workunit.client.0.smithi043.stdout:8/719: dread - d2/d27/d2d/d31/d7f/fb3 zero size 2023-12-08T20:28:24.641 INFO:tasks.workunit.client.0.smithi043.stdout:8/720: write d2/d27/d2d/f7a [1118357,113321] 0 2023-12-08T20:28:24.642 INFO:tasks.workunit.client.0.smithi043.stdout:8/721: creat d2/d20/d7d/d29/d30/d71/fec x:0 0 0 2023-12-08T20:28:24.642 INFO:tasks.workunit.client.0.smithi043.stdout:8/722: write d2/d20/d7d/d29/d59/d9f/fc3 [698149,42796] 0 2023-12-08T20:28:24.642 INFO:tasks.workunit.client.0.smithi043.stdout:8/723: write d2/d27/d2d/d31/d99/fe6 [957962,46235] 0 2023-12-08T20:28:24.642 INFO:tasks.workunit.client.0.smithi043.stdout:8/724: creat d2/d27/dab/fed x:0 0 0 2023-12-08T20:28:24.649 INFO:tasks.workunit.client.0.smithi043.stdout:8/725: dread d2/d27/f6d [0,4194304] 0 2023-12-08T20:28:24.649 INFO:tasks.workunit.client.0.smithi043.stdout:8/726: readlink d2/d20/d7d/d29/l50 0 2023-12-08T20:28:24.650 INFO:tasks.workunit.client.0.smithi043.stdout:8/727: getdents d2/d27/d2d/d31/d7f/db2 0 2023-12-08T20:28:24.651 INFO:tasks.workunit.client.0.smithi043.stdout:8/728: mkdir d2/d20/d7d/d29/d30/d60/d9b/dee 0 2023-12-08T20:28:24.652 INFO:tasks.workunit.client.0.smithi043.stdout:8/729: rename d2/d20/ca1 to d2/d20/d7d/d29/d30/d60/cef 0 2023-12-08T20:28:24.653 INFO:tasks.workunit.client.0.smithi043.stdout:8/730: unlink d2/d27/d2d/d31/c57 0 2023-12-08T20:28:24.654 INFO:tasks.workunit.client.0.smithi043.stdout:8/731: creat d2/d27/d2d/ff0 x:0 0 0 2023-12-08T20:28:24.848 INFO:tasks.workunit.client.0.smithi043.stdout:6/642: sync 2023-12-08T20:28:24.866 INFO:tasks.workunit.client.0.smithi043.stdout:6/643: rename d0/d2/d14/lb8 to d0/d2/d14/ldd 0 2023-12-08T20:28:24.869 INFO:tasks.workunit.client.0.smithi043.stdout:6/644: mkdir d0/d2/d14/d2c/d22/d2a/db2/dba/dde 0 2023-12-08T20:28:24.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:24 smithi111 ceph-mon[121341]: pgmap v33: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 61 MiB/s rd, 123 MiB/s wr, 276 op/s 2023-12-08T20:28:25.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:24 smithi043 ceph-mon[111966]: pgmap v33: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 61 MiB/s rd, 123 MiB/s wr, 276 op/s 2023-12-08T20:28:25.016 INFO:tasks.workunit.client.0.smithi043.stdout:1/657: sync 2023-12-08T20:28:25.016 INFO:tasks.workunit.client.0.smithi043.stdout:4/616: sync 2023-12-08T20:28:25.017 INFO:tasks.workunit.client.0.smithi043.stdout:1/658: fsync d1/d6/d63/fe4 0 2023-12-08T20:28:25.017 INFO:tasks.workunit.client.0.smithi043.stdout:4/617: rmdir d1/d14/d25/d39/d3f/d3c/d41/db6 39 2023-12-08T20:28:25.017 INFO:tasks.workunit.client.0.smithi043.stdout:4/618: write d1/d14/d25/d39/db1/fbe [592541,121834] 0 2023-12-08T20:28:25.018 INFO:tasks.workunit.client.0.smithi043.stdout:4/619: dread d1/d14/d25/f2f [0,4194304] 0 2023-12-08T20:28:25.020 INFO:tasks.workunit.client.0.smithi043.stdout:4/620: symlink d1/d14/d25/d39/da3/ld7 0 2023-12-08T20:28:25.020 INFO:tasks.workunit.client.0.smithi043.stdout:4/621: write d1/d14/d25/f29 [1230341,86677] 0 2023-12-08T20:28:25.020 INFO:tasks.workunit.client.0.smithi043.stdout:4/622: write d1/d14/d25/d39/f71 [2538892,99581] 0 2023-12-08T20:28:25.022 INFO:tasks.workunit.client.0.smithi043.stdout:4/623: symlink d1/d14/d25/d39/da3/ld8 0 2023-12-08T20:28:25.022 INFO:tasks.workunit.client.0.smithi043.stdout:4/624: chown d1/d14/d25/d28 113969 1 2023-12-08T20:28:25.022 INFO:tasks.workunit.client.0.smithi043.stdout:4/625: fsync d1/d14/d25/d39/f79 0 2023-12-08T20:28:25.022 INFO:tasks.workunit.client.0.smithi043.stdout:4/626: fsync d1/f5f 0 2023-12-08T20:28:25.022 INFO:tasks.workunit.client.0.smithi043.stdout:4/627: write d1/d14/d25/d39/da3/dae/fb4 [4649928,59717] 0 2023-12-08T20:28:25.023 INFO:tasks.workunit.client.0.smithi043.stdout:1/659: dread d1/d16/d21/d25/d35/f85 [0,4194304] 0 2023-12-08T20:28:25.023 INFO:tasks.workunit.client.0.smithi043.stdout:4/628: rmdir d1/d14/d25/d28/d8a 39 2023-12-08T20:28:25.023 INFO:tasks.workunit.client.0.smithi043.stdout:1/660: write d1/d16/d30/d4f/fbd [162167,75393] 0 2023-12-08T20:28:25.023 INFO:tasks.workunit.client.0.smithi043.stdout:1/661: stat d1/d16/d21/d25/d3e/la4 0 2023-12-08T20:28:25.023 INFO:tasks.workunit.client.0.smithi043.stdout:1/662: write d1/d6/fa [1828803,60036] 0 2023-12-08T20:28:25.024 INFO:tasks.workunit.client.0.smithi043.stdout:1/663: write d1/d16/d21/d25/d3e/dbc/db8/fc2 [911107,125934] 0 2023-12-08T20:28:25.024 INFO:tasks.workunit.client.0.smithi043.stdout:1/664: truncate d1/db1/dc9/fdc 1015152 0 2023-12-08T20:28:25.024 INFO:tasks.workunit.client.0.smithi043.stdout:4/629: unlink d1/d14/d1d/f6e 0 2023-12-08T20:28:25.026 INFO:tasks.workunit.client.0.smithi043.stdout:4/630: mkdir d1/d14/d1d/d58/dd9 0 2023-12-08T20:28:25.027 INFO:tasks.workunit.client.0.smithi043.stdout:4/631: truncate d1/f7b 1628138 0 2023-12-08T20:28:25.028 INFO:tasks.workunit.client.0.smithi043.stdout:4/632: mknod d1/d14/d25/d28/d8a/cda 0 2023-12-08T20:28:25.029 INFO:tasks.workunit.client.0.smithi043.stdout:4/633: mknod d1/d14/d50/cdb 0 2023-12-08T20:28:25.048 INFO:tasks.workunit.client.0.smithi043.stdout:1/665: dwrite d1/d16/d48/fba [0,4194304] 0 2023-12-08T20:28:25.048 INFO:tasks.workunit.client.0.smithi043.stdout:1/666: read d1/d16/d1c/d71/d98/fd6 [34081,71428] 0 2023-12-08T20:28:25.048 INFO:tasks.workunit.client.0.smithi043.stdout:1/667: write d1/d16/d1c/d71/fc7 [295293,107795] 0 2023-12-08T20:28:25.048 INFO:tasks.workunit.client.0.smithi043.stdout:4/634: dwrite d1/d14/d25/d28/f81 [0,4194304] 0 2023-12-08T20:28:25.049 INFO:tasks.workunit.client.0.smithi043.stdout:4/635: write d1/d14/f45 [664676,4730] 0 2023-12-08T20:28:25.049 INFO:tasks.workunit.client.0.smithi043.stdout:4/636: stat d1/d14/d1d/c4c 0 2023-12-08T20:28:25.051 INFO:tasks.workunit.client.0.smithi043.stdout:4/637: mkdir d1/d14/d25/d39/d3f/d59/ddc 0 2023-12-08T20:28:25.051 INFO:tasks.workunit.client.0.smithi043.stdout:4/638: chown d1/d14/d25/d39/d3d/d40/d67/d7f 3442 1 2023-12-08T20:28:25.051 INFO:tasks.workunit.client.0.smithi043.stdout:1/668: mknod d1/db1/dc9/cf0 0 2023-12-08T20:28:25.052 INFO:tasks.workunit.client.0.smithi043.stdout:4/639: mknod d1/d14/d1d/d58/cdd 0 2023-12-08T20:28:25.055 INFO:tasks.workunit.client.0.smithi043.stdout:1/669: dread d1/d16/d21/f51 [0,4194304] 0 2023-12-08T20:28:25.055 INFO:tasks.workunit.client.0.smithi043.stdout:1/670: dread - d1/d16/d21/d60/feb zero size 2023-12-08T20:28:25.055 INFO:tasks.workunit.client.0.smithi043.stdout:1/671: chown d1/d16/d1c/fa8 265979991 1 2023-12-08T20:28:25.055 INFO:tasks.workunit.client.0.smithi043.stdout:1/672: fsync d1/f2a 0 2023-12-08T20:28:25.060 INFO:tasks.workunit.client.0.smithi043.stdout:4/640: dread d1/d14/d1d/d58/fc4 [0,4194304] 0 2023-12-08T20:28:25.062 INFO:tasks.workunit.client.0.smithi043.stdout:4/641: rmdir d1/d14/d25 39 2023-12-08T20:28:25.063 INFO:tasks.workunit.client.0.smithi043.stdout:1/673: dread d1/d16/d21/d25/d3e/d72/fb7 [0,4194304] 0 2023-12-08T20:28:25.064 INFO:tasks.workunit.client.0.smithi043.stdout:4/642: link d1/d14/f87 d1/d14/d25/d77/da4/dc0/fde 0 2023-12-08T20:28:25.066 INFO:tasks.workunit.client.0.smithi043.stdout:4/643: symlink d1/d14/d25/d39/d3f/d3c/d41/ldf 0 2023-12-08T20:28:25.066 INFO:tasks.workunit.client.0.smithi043.stdout:4/644: mkdir d1/d14/d25/d39/dd6/de0 0 2023-12-08T20:28:25.067 INFO:tasks.workunit.client.0.smithi043.stdout:1/674: symlink d1/d16/d1c/d4e/dcd/lf1 0 2023-12-08T20:28:25.069 INFO:tasks.workunit.client.0.smithi043.stdout:4/645: rmdir d1/d14/d25/d39/d3f/d3c 39 2023-12-08T20:28:25.069 INFO:tasks.workunit.client.0.smithi043.stdout:4/646: fsync d1/d14/d25/d39/d3d/d40/f6c 0 2023-12-08T20:28:25.076 INFO:tasks.workunit.client.0.smithi043.stdout:1/675: link d1/d16/d21/d25/d3e/la3 d1/d16/d1c/lf2 0 2023-12-08T20:28:25.077 INFO:tasks.workunit.client.0.smithi043.stdout:1/676: creat d1/db1/dc9/ff3 x:0 0 0 2023-12-08T20:28:25.079 INFO:tasks.workunit.client.0.smithi043.stdout:1/677: write d1/f2a [1703804,69002] 0 2023-12-08T20:28:25.079 INFO:tasks.workunit.client.0.smithi043.stdout:1/678: write d1/d16/d30/d4f/fbd [324583,97823] 0 2023-12-08T20:28:25.079 INFO:tasks.workunit.client.0.smithi043.stdout:1/679: write d1/d16/d21/d25/d3e/d72/f74 [438019,1881] 0 2023-12-08T20:28:25.079 INFO:tasks.workunit.client.0.smithi043.stdout:1/680: fdatasync d1/d16/f49 0 2023-12-08T20:28:25.083 INFO:tasks.workunit.client.0.smithi043.stdout:1/681: truncate d1/d16/d21/d25/d3e/d77/d9f/fa9 397276 0 2023-12-08T20:28:25.083 INFO:tasks.workunit.client.0.smithi043.stdout:1/682: write d1/d16/d30/fb3 [94897,129184] 0 2023-12-08T20:28:25.086 INFO:tasks.workunit.client.0.smithi043.stdout:4/647: dwrite d1/f5f [0,4194304] 0 2023-12-08T20:28:25.106 INFO:tasks.workunit.client.0.smithi043.stdout:4/648: dwrite d1/d14/d25/d39/d3f/d3c/d41/fb8 [0,4194304] 0 2023-12-08T20:28:25.107 INFO:tasks.workunit.client.0.smithi043.stdout:1/683: dwrite d1/d16/d21/d60/feb [0,4194304] 0 2023-12-08T20:28:25.107 INFO:tasks.workunit.client.0.smithi043.stdout:4/649: write d1/d14/d25/f2c [504980,43639] 0 2023-12-08T20:28:25.108 INFO:tasks.workunit.client.0.smithi043.stdout:4/650: creat d1/d14/d25/d77/da4/fe1 x:0 0 0 2023-12-08T20:28:25.110 INFO:tasks.workunit.client.0.smithi043.stdout:4/651: write d1/d14/d25/d77/da4/dc0/fcb [875852,24120] 0 2023-12-08T20:28:25.122 INFO:tasks.workunit.client.0.smithi043.stdout:1/684: dwrite d1/d16/d21/d25/d3e/d72/f74 [0,4194304] 0 2023-12-08T20:28:25.126 INFO:tasks.workunit.client.0.smithi043.stdout:4/652: dwrite d1/f10 [0,4194304] 0 2023-12-08T20:28:25.126 INFO:tasks.workunit.client.0.smithi043.stdout:4/653: dread - d1/d14/d25/d39/d3d/d40/fb5 zero size 2023-12-08T20:28:25.126 INFO:tasks.workunit.client.0.smithi043.stdout:4/654: truncate d1/d14/d25/d39/d3d/d40/f54 661735 0 2023-12-08T20:28:25.126 INFO:tasks.workunit.client.0.smithi043.stdout:1/685: symlink d1/db1/dc9/lf4 0 2023-12-08T20:28:25.126 INFO:tasks.workunit.client.0.smithi043.stdout:1/686: chown d1/l11 104 1 2023-12-08T20:28:25.127 INFO:tasks.workunit.client.0.smithi043.stdout:1/687: read d1/d16/d86/fb5 [239226,70662] 0 2023-12-08T20:28:25.127 INFO:tasks.workunit.client.0.smithi043.stdout:1/688: read d1/d16/d1c/f50 [3804431,46132] 0 2023-12-08T20:28:25.127 INFO:tasks.workunit.client.0.smithi043.stdout:1/689: chown d1/d16/d21/d25/d3e/l52 47458020 1 2023-12-08T20:28:25.127 INFO:tasks.workunit.client.0.smithi043.stdout:1/690: truncate d1/d16/d21/d25/d35/fac 351417 0 2023-12-08T20:28:25.127 INFO:tasks.workunit.client.0.smithi043.stdout:4/655: rename d1/d14/d25/d28/c4d to d1/d14/ce2 0 2023-12-08T20:28:25.127 INFO:tasks.workunit.client.0.smithi043.stdout:4/656: write d1/d14/d25/d39/fd4 [1578518,56911] 0 2023-12-08T20:28:25.128 INFO:tasks.workunit.client.0.smithi043.stdout:4/657: link d1/d14/d25/d39/d3f/d3c/d41/db6/fb9 d1/d14/d25/d28/d8a/fe3 0 2023-12-08T20:28:25.132 INFO:tasks.workunit.client.0.smithi043.stdout:4/658: dread d1/d14/d25/d39/d3f/f78 [0,4194304] 0 2023-12-08T20:28:25.133 INFO:tasks.workunit.client.0.smithi043.stdout:4/659: dread d1/d14/d25/f2f [0,4194304] 0 2023-12-08T20:28:25.142 INFO:tasks.workunit.client.0.smithi043.stdout:4/660: dread d1/d14/d1d/d58/f62 [0,4194304] 0 2023-12-08T20:28:25.143 INFO:tasks.workunit.client.0.smithi043.stdout:1/691: dwrite d1/d6/fa [0,4194304] 0 2023-12-08T20:28:25.144 INFO:tasks.workunit.client.0.smithi043.stdout:4/661: write d1/d14/d25/d77/da4/dc0/fcb [2870268,71768] 0 2023-12-08T20:28:25.144 INFO:tasks.workunit.client.0.smithi043.stdout:4/662: stat d1/d14/d1d/d75 0 2023-12-08T20:28:25.149 INFO:tasks.workunit.client.0.smithi043.stdout:4/663: read d1/d14/d25/d77/da4/dc0/fcb [3167540,15885] 0 2023-12-08T20:28:25.151 INFO:tasks.workunit.client.0.smithi043.stdout:4/664: symlink d1/d14/d25/d39/d3d/d40/le4 0 2023-12-08T20:28:25.151 INFO:tasks.workunit.client.0.smithi043.stdout:4/665: chown d1/d14/d25/d39/da3 10 1 2023-12-08T20:28:25.152 INFO:tasks.workunit.client.0.smithi043.stdout:4/666: unlink d1/f7b 0 2023-12-08T20:28:25.153 INFO:tasks.workunit.client.0.smithi043.stdout:4/667: rename d1/cb7 to d1/d14/d25/d39/db1/ce5 0 2023-12-08T20:28:25.166 INFO:tasks.workunit.client.0.smithi043.stdout:1/692: dwrite d1/d16/d30/f75 [0,4194304] 0 2023-12-08T20:28:25.167 INFO:tasks.workunit.client.0.smithi043.stdout:1/693: readlink d1/d16/d1c/l2f 0 2023-12-08T20:28:25.167 INFO:tasks.workunit.client.0.smithi043.stdout:1/694: fsync d1/d16/f49 0 2023-12-08T20:28:25.174 INFO:tasks.workunit.client.0.smithi043.stdout:1/695: creat d1/d16/d21/d25/d35/ff5 x:0 0 0 2023-12-08T20:28:25.174 INFO:tasks.workunit.client.0.smithi043.stdout:1/696: write d1/d16/d21/d25/d3e/dbc/fe5 [1020979,6908] 0 2023-12-08T20:28:25.174 INFO:tasks.workunit.client.0.smithi043.stdout:4/668: dwrite d1/d14/d25/d39/d3d/d40/d67/f8f [4194304,4194304] 0 2023-12-08T20:28:25.176 INFO:tasks.workunit.client.0.smithi043.stdout:4/669: link d1/d14/f18 d1/d14/d25/d39/dd6/fe6 0 2023-12-08T20:28:25.177 INFO:tasks.workunit.client.0.smithi043.stdout:1/697: link d1/d6/d63/fe4 d1/d16/d21/d60/ff6 0 2023-12-08T20:28:25.177 INFO:tasks.workunit.client.0.smithi043.stdout:1/698: write d1/d16/d21/d6f/daa/fbe [1122076,2432] 0 2023-12-08T20:28:25.177 INFO:tasks.workunit.client.0.smithi043.stdout:4/670: getdents d1/d14/d25/d39/d3d/d40/d67/d7f 0 2023-12-08T20:28:25.178 INFO:tasks.workunit.client.0.smithi043.stdout:4/671: mknod d1/ce7 0 2023-12-08T20:28:25.180 INFO:tasks.workunit.client.0.smithi043.stdout:1/699: link d1/d16/d21/d25/d35/f62 d1/d16/d30/d6e/d83/ff7 0 2023-12-08T20:28:25.182 INFO:tasks.workunit.client.0.smithi043.stdout:1/700: mkdir d1/d16/d21/d25/d3e/df8 0 2023-12-08T20:28:25.183 INFO:tasks.workunit.client.0.smithi043.stdout:1/701: stat d1/d16/d1c/d71/dda/le0 0 2023-12-08T20:28:25.184 INFO:tasks.workunit.client.0.smithi043.stdout:3/632: sync 2023-12-08T20:28:25.185 INFO:tasks.workunit.client.0.smithi043.stdout:0/880: sync 2023-12-08T20:28:25.185 INFO:tasks.workunit.client.0.smithi043.stdout:2/911: sync 2023-12-08T20:28:25.185 INFO:tasks.workunit.client.0.smithi043.stdout:5/638: sync 2023-12-08T20:28:25.186 INFO:tasks.workunit.client.0.smithi043.stdout:5/639: dread d3/d7/d21/f61 [0,4194304] 0 2023-12-08T20:28:25.186 INFO:tasks.workunit.client.0.smithi043.stdout:5/640: dread - d3/d7/d19/f6d zero size 2023-12-08T20:28:25.186 INFO:tasks.workunit.client.0.smithi043.stdout:5/641: read d3/d7/d19/d3f/f86 [147594,43784] 0 2023-12-08T20:28:25.187 INFO:tasks.workunit.client.0.smithi043.stdout:1/702: mknod d1/d16/d7e/cf9 0 2023-12-08T20:28:25.187 INFO:tasks.workunit.client.0.smithi043.stdout:1/703: chown d1/d16/d30/d4f/l9b 123912250 1 2023-12-08T20:28:25.187 INFO:tasks.workunit.client.0.smithi043.stdout:1/704: truncate d1/d16/d1c/fd7 698025 0 2023-12-08T20:28:25.187 INFO:tasks.workunit.client.0.smithi043.stdout:3/633: read d1/d9/df/f47 [2536915,75141] 0 2023-12-08T20:28:25.188 INFO:tasks.workunit.client.0.smithi043.stdout:4/672: dread d1/d14/d25/d39/dd6/fe6 [4194304,4194304] 0 2023-12-08T20:28:25.188 INFO:tasks.workunit.client.0.smithi043.stdout:5/642: write d3/d7/d29/f5d [561243,49144] 0 2023-12-08T20:28:25.188 INFO:tasks.workunit.client.0.smithi043.stdout:0/881: creat d2/d3/d18/f121 x:0 0 0 2023-12-08T20:28:25.189 INFO:tasks.workunit.client.0.smithi043.stdout:3/634: mknod d1/d9/d38/d30/ccd 0 2023-12-08T20:28:25.193 INFO:tasks.workunit.client.0.smithi043.stdout:5/643: dread d3/d7/d29/f3c [0,4194304] 0 2023-12-08T20:28:25.193 INFO:tasks.workunit.client.0.smithi043.stdout:2/912: creat d0/d26/dbc/d38/dae/f127 x:0 0 0 2023-12-08T20:28:25.194 INFO:tasks.workunit.client.0.smithi043.stdout:5/644: mkdir d3/d78/dc4 0 2023-12-08T20:28:25.194 INFO:tasks.workunit.client.0.smithi043.stdout:5/645: chown d3/d7/d29/f60 930914586 1 2023-12-08T20:28:25.194 INFO:tasks.workunit.client.0.smithi043.stdout:5/646: truncate d3/d7/d21/d72/f9a 84749 0 2023-12-08T20:28:25.194 INFO:tasks.workunit.client.0.smithi043.stdout:3/635: mknod d1/d9/d2d/d91/da7/cce 0 2023-12-08T20:28:25.195 INFO:tasks.workunit.client.0.smithi043.stdout:5/647: mknod d3/d73/cc5 0 2023-12-08T20:28:25.199 INFO:tasks.workunit.client.0.smithi043.stdout:1/705: unlink d1/d16/d21/d60/ff6 0 2023-12-08T20:28:25.203 INFO:tasks.workunit.client.0.smithi043.stdout:0/882: truncate d2/d3/d18/d2b/da5/f5c 3077666 0 2023-12-08T20:28:25.203 INFO:tasks.workunit.client.0.smithi043.stdout:0/883: write d2/d61/d67/d9e/fed [518901,34964] 0 2023-12-08T20:28:25.205 INFO:tasks.workunit.client.0.smithi043.stdout:2/913: dread d0/d20/f32 [0,4194304] 0 2023-12-08T20:28:25.206 INFO:tasks.workunit.client.0.smithi043.stdout:1/706: creat d1/d16/d21/d25/d3e/df8/ffa x:0 0 0 2023-12-08T20:28:25.206 INFO:tasks.workunit.client.0.smithi043.stdout:1/707: dread - d1/d16/d30/d4f/d54/f8a zero size 2023-12-08T20:28:25.206 INFO:tasks.workunit.client.0.smithi043.stdout:1/708: truncate d1/d16/d21/d25/d3e/d77/fdd 1002633 0 2023-12-08T20:28:25.206 INFO:tasks.workunit.client.0.smithi043.stdout:4/673: dwrite d1/d14/d25/d39/d3f/d3c/d41/fb8 [4194304,4194304] 0 2023-12-08T20:28:25.208 INFO:tasks.workunit.client.0.smithi043.stdout:0/884: getdents d2/d3/d18/d1e/d53/d10b/d39/d63/da6 0 2023-12-08T20:28:25.208 INFO:tasks.workunit.client.0.smithi043.stdout:0/885: readlink d2/d3/d18/d2b/da5/d5f/d79/l9a 0 2023-12-08T20:28:25.209 INFO:tasks.workunit.client.0.smithi043.stdout:4/674: mkdir d1/d14/d25/d28/d8a/de8 0 2023-12-08T20:28:25.213 INFO:tasks.workunit.client.0.smithi043.stdout:0/886: dread d2/d3/d18/d1e/d53/d10b/d39/f8d [0,4194304] 0 2023-12-08T20:28:25.213 INFO:tasks.workunit.client.0.smithi043.stdout:4/675: rename d1/d14/d25/f2f to d1/d14/d25/d77/fe9 0 2023-12-08T20:28:25.213 INFO:tasks.workunit.client.0.smithi043.stdout:4/676: chown d1/d14/d25/d39/l7c 1849694 1 2023-12-08T20:28:25.214 INFO:tasks.workunit.client.0.smithi043.stdout:3/636: dwrite d1/d9/d2d/d66/dca/fcb [0,4194304] 0 2023-12-08T20:28:25.219 INFO:tasks.workunit.client.0.smithi043.stdout:2/914: dread d0/d20/f60 [0,4194304] 0 2023-12-08T20:28:25.219 INFO:tasks.workunit.client.0.smithi043.stdout:4/677: rename d1/d14/d1d/f47 to d1/d14/d25/d77/d8d/fea 0 2023-12-08T20:28:25.219 INFO:tasks.workunit.client.0.smithi043.stdout:4/678: write d1/d14/d25/d39/da3/dae/fb4 [5148746,80035] 0 2023-12-08T20:28:25.219 INFO:tasks.workunit.client.0.smithi043.stdout:4/679: write d1/d14/d25/d77/da4/fe1 [737980,103842] 0 2023-12-08T20:28:25.225 INFO:tasks.workunit.client.0.smithi043.stdout:3/637: creat d1/d9/d2d/d91/fcf x:0 0 0 2023-12-08T20:28:25.225 INFO:tasks.workunit.client.0.smithi043.stdout:3/638: fdatasync d1/d25/f31 0 2023-12-08T20:28:25.225 INFO:tasks.workunit.client.0.smithi043.stdout:3/639: write d1/d9/d2d/d66/f98 [8879685,59405] 0 2023-12-08T20:28:25.225 INFO:tasks.workunit.client.0.smithi043.stdout:2/915: symlink d0/d81/l128 0 2023-12-08T20:28:25.229 INFO:tasks.workunit.client.0.smithi043.stdout:2/916: link d0/d26/dbc/d38/c8f d0/db/d18/d3d/c129 0 2023-12-08T20:28:25.229 INFO:tasks.workunit.client.0.smithi043.stdout:2/917: fdatasync d0/d20/f4d 0 2023-12-08T20:28:25.229 INFO:tasks.workunit.client.0.smithi043.stdout:2/918: write d0/db/d18/d8b/f104 [188218,108279] 0 2023-12-08T20:28:25.229 INFO:tasks.workunit.client.0.smithi043.stdout:2/919: fdatasync d0/d2b/d4e/fc7 0 2023-12-08T20:28:25.229 INFO:tasks.workunit.client.0.smithi043.stdout:2/920: truncate d0/d26/dbc/d38/dae/f127 150823 0 2023-12-08T20:28:25.231 INFO:tasks.workunit.client.0.smithi043.stdout:0/887: dwrite d2/d3/d18/d1e/d53/d10b/d39/d83/fe7 [0,4194304] 0 2023-12-08T20:28:25.233 INFO:tasks.workunit.client.0.smithi043.stdout:4/680: rename d1/d14/d25/d77/d8d/fea to d1/d14/d25/d39/feb 0 2023-12-08T20:28:25.233 INFO:tasks.workunit.client.0.smithi043.stdout:4/681: readlink d1/d14/d25/d39/d3d/l64 0 2023-12-08T20:28:25.233 INFO:tasks.workunit.client.0.smithi043.stdout:2/921: creat d0/d20/d42/dcb/d117/dfd/dff/d11e/f12a x:0 0 0 2023-12-08T20:28:25.239 INFO:tasks.workunit.client.0.smithi043.stdout:3/640: rename d1/d1c/d2c/d7f to d1/d25/d2a/dd0 0 2023-12-08T20:28:25.239 INFO:tasks.workunit.client.0.smithi043.stdout:4/682: mknod d1/d14/d25/d39/d3f/d3c/cec 0 2023-12-08T20:28:25.239 INFO:tasks.workunit.client.0.smithi043.stdout:4/683: fsync d1/d14/d50/f9a 0 2023-12-08T20:28:25.239 INFO:tasks.workunit.client.0.smithi043.stdout:4/684: chown d1/d14/d25/d77/fe9 3652 1 2023-12-08T20:28:25.241 INFO:tasks.workunit.client.0.smithi043.stdout:3/641: mknod d1/d25/cd1 0 2023-12-08T20:28:25.242 INFO:tasks.workunit.client.0.smithi043.stdout:4/685: creat d1/d14/d25/d39/d3d/d40/d67/fed x:0 0 0 2023-12-08T20:28:25.244 INFO:tasks.workunit.client.0.smithi043.stdout:3/642: creat d1/d9/df/d6e/fd2 x:0 0 0 2023-12-08T20:28:25.246 INFO:tasks.workunit.client.0.smithi043.stdout:2/922: link d0/d26/c51 d0/d26/dbc/d38/c12b 0 2023-12-08T20:28:25.246 INFO:tasks.workunit.client.0.smithi043.stdout:2/923: truncate d0/f24 2688495 0 2023-12-08T20:28:25.247 INFO:tasks.workunit.client.0.smithi043.stdout:3/643: rename d1/d9/d2d/d91/fcf to d1/d1c/d2c/fd3 0 2023-12-08T20:28:25.250 INFO:tasks.workunit.client.0.smithi043.stdout:3/644: getdents d1/d25/d2a/dd0 0 2023-12-08T20:28:25.250 INFO:tasks.workunit.client.0.smithi043.stdout:3/645: chown d1/d25/d84/d9a/ca4 1593 1 2023-12-08T20:28:25.251 INFO:tasks.workunit.client.0.smithi043.stdout:0/888: dwrite d2/d3/d18/d2b/da5/da3/fe9 [0,4194304] 0 2023-12-08T20:28:25.252 INFO:tasks.workunit.client.0.smithi043.stdout:3/646: mkdir d1/d9/d2d/d66/dca/dd4 0 2023-12-08T20:28:25.258 INFO:tasks.workunit.client.0.smithi043.stdout:0/889: rename d2/d3/d18/d2b/da5/f7a to d2/d61/d67/f122 0 2023-12-08T20:28:25.258 INFO:tasks.workunit.client.0.smithi043.stdout:3/647: read d1/f18 [5265530,91805] 0 2023-12-08T20:28:25.258 INFO:tasks.workunit.client.0.smithi043.stdout:3/648: dread - d1/d1c/d29/f7e zero size 2023-12-08T20:28:25.269 INFO:tasks.workunit.client.0.smithi043.stdout:0/890: dread d2/d3/d18/d1e/d53/d10b/d39/d83/fe7 [0,4194304] 0 2023-12-08T20:28:25.270 INFO:tasks.workunit.client.0.smithi043.stdout:4/686: dwrite d1/d14/d1d/d75/fcf [0,4194304] 0 2023-12-08T20:28:25.272 INFO:tasks.workunit.client.0.smithi043.stdout:2/924: dwrite d0/d26/dbc/ff0 [0,4194304] 0 2023-12-08T20:28:25.274 INFO:tasks.workunit.client.0.smithi043.stdout:0/891: getdents d2/d4 0 2023-12-08T20:28:25.274 INFO:tasks.workunit.client.0.smithi043.stdout:0/892: chown d2/f7 161 1 2023-12-08T20:28:25.276 INFO:tasks.workunit.client.0.smithi043.stdout:2/925: write d0/db/f54 [3267653,35786] 0 2023-12-08T20:28:25.277 INFO:tasks.workunit.client.0.smithi043.stdout:2/926: chown d0/db/l11d 9231672 1 2023-12-08T20:28:25.278 INFO:tasks.workunit.client.0.smithi043.stdout:2/927: write d0/d20/f4d [3199077,37470] 0 2023-12-08T20:28:25.281 INFO:tasks.workunit.client.0.smithi043.stdout:3/649: dwrite d1/d1c/d29/f5c [4194304,4194304] 0 2023-12-08T20:28:25.281 INFO:tasks.workunit.client.0.smithi043.stdout:3/650: readlink d1/d9/d38/d30/l88 0 2023-12-08T20:28:25.281 INFO:tasks.workunit.client.0.smithi043.stdout:3/651: write d1/d1c/d2c/d5f/fb5 [366190,123805] 0 2023-12-08T20:28:25.290 INFO:tasks.workunit.client.0.smithi043.stdout:0/893: rename d2/d3/d18/d1e/d53/d10b/d39/d5e to d2/d3/d18/d1e/d53/d10b/d123 0 2023-12-08T20:28:25.291 INFO:tasks.workunit.client.0.smithi043.stdout:0/894: fdatasync d2/d3/d18/d2b/da5/d5f/df0/f10c 0 2023-12-08T20:28:25.294 INFO:tasks.workunit.client.0.smithi043.stdout:4/687: dwrite d1/d14/f45 [0,4194304] 0 2023-12-08T20:28:25.294 INFO:tasks.workunit.client.0.smithi043.stdout:4/688: stat d1/d14/d25/d77/c8b 0 2023-12-08T20:28:25.295 INFO:tasks.workunit.client.0.smithi043.stdout:0/895: rmdir d2/d3/d18/d1e/d53/d10b/d39/d83/d115 0 2023-12-08T20:28:25.297 INFO:tasks.workunit.client.0.smithi043.stdout:2/928: symlink d0/l12c 0 2023-12-08T20:28:25.297 INFO:tasks.workunit.client.0.smithi043.stdout:2/929: write d0/d20/f105 [12175,79863] 0 2023-12-08T20:28:25.300 INFO:tasks.workunit.client.0.smithi043.stdout:0/896: creat d2/d3/d18/d1e/d53/d10b/d39/d63/da6/f124 x:0 0 0 2023-12-08T20:28:25.302 INFO:tasks.workunit.client.0.smithi043.stdout:3/652: dwrite d1/d9/d38/d33/f69 [4194304,4194304] 0 2023-12-08T20:28:25.302 INFO:tasks.workunit.client.0.smithi043.stdout:3/653: chown d1/d9/d38 1 1 2023-12-08T20:28:25.302 INFO:tasks.workunit.client.0.smithi043.stdout:3/654: chown d1/d9/df/f47 8 1 2023-12-08T20:28:25.305 INFO:tasks.workunit.client.0.smithi043.stdout:3/655: mknod d1/cd5 0 2023-12-08T20:28:25.310 INFO:tasks.workunit.client.0.smithi043.stdout:2/930: dread d0/d20/f2c [0,4194304] 0 2023-12-08T20:28:25.315 INFO:tasks.workunit.client.0.smithi043.stdout:3/656: dread d1/d1c/d29/f57 [0,4194304] 0 2023-12-08T20:28:25.317 INFO:tasks.workunit.client.0.smithi043.stdout:3/657: creat d1/d25/d84/d9a/fd6 x:0 0 0 2023-12-08T20:28:25.319 INFO:tasks.workunit.client.0.smithi043.stdout:3/658: creat d1/d9/d38/fd7 x:0 0 0 2023-12-08T20:28:25.319 INFO:tasks.workunit.client.0.smithi043.stdout:3/659: write d1/d9/d38/d30/f59 [890610,60382] 0 2023-12-08T20:28:25.321 INFO:tasks.workunit.client.0.smithi043.stdout:3/660: rename d1/d9/d2d/d91/da7/fb9 to d1/d9/df/d26/fd8 0 2023-12-08T20:28:25.322 INFO:tasks.workunit.client.0.smithi043.stdout:3/661: symlink d1/d9/d38/ld9 0 2023-12-08T20:28:25.322 INFO:tasks.workunit.client.0.smithi043.stdout:3/662: chown d1/d25/dc1 0 1 2023-12-08T20:28:25.333 INFO:tasks.workunit.client.0.smithi043.stdout:2/931: dwrite d0/db/d18/f1a [0,4194304] 0 2023-12-08T20:28:25.337 INFO:tasks.workunit.client.0.smithi043.stdout:2/932: mknod d0/d26/dbc/d38/c12d 0 2023-12-08T20:28:25.345 INFO:tasks.workunit.client.0.smithi043.stdout:2/933: dread d0/db/d18/d66/d71/fb6 [0,4194304] 0 2023-12-08T20:28:25.345 INFO:tasks.workunit.client.0.smithi043.stdout:2/934: chown d0/d2b/d4e 0 1 2023-12-08T20:28:25.347 INFO:tasks.workunit.client.0.smithi043.stdout:3/663: dwrite d1/d1c/f53 [4194304,4194304] 0 2023-12-08T20:28:25.347 INFO:tasks.workunit.client.0.smithi043.stdout:3/664: chown d1/d1c/d2c/d5f/c9f 57176781 1 2023-12-08T20:28:25.358 INFO:tasks.workunit.client.0.smithi043.stdout:3/665: dread d1/d9/d2d/d66/fbc [0,4194304] 0 2023-12-08T20:28:25.360 INFO:tasks.workunit.client.0.smithi043.stdout:3/666: rename d1/d1c/d2c/d5f/d80 to d1/d9/d2d/d91/dda 0 2023-12-08T20:28:25.361 INFO:tasks.workunit.client.0.smithi043.stdout:3/667: mkdir d1/d9/df/ddb 0 2023-12-08T20:28:25.364 INFO:tasks.workunit.client.0.smithi043.stdout:9/669: sync 2023-12-08T20:28:25.365 INFO:tasks.workunit.client.0.smithi043.stdout:3/668: getdents d1/d9/d2d/d91 0 2023-12-08T20:28:25.367 INFO:tasks.workunit.client.0.smithi043.stdout:9/670: truncate d0/d5e/f40 1737105 0 2023-12-08T20:28:25.382 INFO:tasks.workunit.client.0.smithi043.stdout:3/669: dwrite d1/d1c/d2c/d5f/fb5 [0,4194304] 0 2023-12-08T20:28:25.389 INFO:tasks.workunit.client.0.smithi043.stdout:3/670: dread d1/d9/d2d/d66/dca/fcb [0,4194304] 0 2023-12-08T20:28:25.391 INFO:tasks.workunit.client.0.smithi043.stdout:9/671: dwrite d0/d3d/d8c/fc6 [0,4194304] 0 2023-12-08T20:28:25.391 INFO:tasks.workunit.client.0.smithi043.stdout:3/671: creat d1/d1c/fdc x:0 0 0 2023-12-08T20:28:25.397 INFO:tasks.workunit.client.0.smithi043.stdout:9/672: rename d0/d5e/dad to d0/d3d/d8a/d9a/ddd 0 2023-12-08T20:28:25.399 INFO:tasks.workunit.client.0.smithi043.stdout:3/672: mknod d1/d9/d2d/d91/cdd 0 2023-12-08T20:28:25.399 INFO:tasks.workunit.client.0.smithi043.stdout:3/673: read d1/d25/d2a/f6a [750222,74716] 0 2023-12-08T20:28:25.399 INFO:tasks.workunit.client.0.smithi043.stdout:3/674: chown d1/d9/df/d26/fd8 68457462 1 2023-12-08T20:28:25.400 INFO:tasks.workunit.client.0.smithi043.stdout:3/675: rmdir d1/d25/d84 39 2023-12-08T20:28:25.400 INFO:tasks.workunit.client.0.smithi043.stdout:3/676: fdatasync d1/d9/f1a 0 2023-12-08T20:28:25.406 INFO:tasks.workunit.client.0.smithi043.stdout:9/673: dread d0/d5e/f57 [0,4194304] 0 2023-12-08T20:28:25.407 INFO:tasks.workunit.client.0.smithi043.stdout:9/674: creat d0/d3d/dd4/fde x:0 0 0 2023-12-08T20:28:25.418 INFO:tasks.workunit.client.0.smithi043.stdout:3/677: dwrite d1/d25/f24 [4194304,4194304] 0 2023-12-08T20:28:25.422 INFO:tasks.workunit.client.0.smithi043.stdout:9/675: dread d0/d5e/f89 [0,4194304] 0 2023-12-08T20:28:25.427 INFO:tasks.workunit.client.0.smithi043.stdout:7/672: sync 2023-12-08T20:28:25.427 INFO:tasks.workunit.client.0.smithi043.stdout:8/732: sync 2023-12-08T20:28:25.427 INFO:tasks.workunit.client.0.smithi043.stdout:6/645: sync 2023-12-08T20:28:25.428 INFO:tasks.workunit.client.0.smithi043.stdout:6/646: truncate d0/d2/d29/fd9 996564 0 2023-12-08T20:28:25.428 INFO:tasks.workunit.client.0.smithi043.stdout:8/733: creat d2/d27/d2d/d31/d91/ff1 x:0 0 0 2023-12-08T20:28:25.428 INFO:tasks.workunit.client.0.smithi043.stdout:8/734: fdatasync d2/f9 0 2023-12-08T20:28:25.432 INFO:tasks.workunit.client.0.smithi043.stdout:6/647: rename d0/f54 to d0/d2/d92/fdf 0 2023-12-08T20:28:25.434 INFO:tasks.workunit.client.0.smithi043.stdout:6/648: creat d0/d2/d14/d2c/d22/d2a/db2/dba/fe0 x:0 0 0 2023-12-08T20:28:25.437 INFO:tasks.workunit.client.0.smithi043.stdout:6/649: mkdir d0/d2/d14/d20/d53/d73/de1 0 2023-12-08T20:28:25.441 INFO:tasks.workunit.client.0.smithi043.stdout:8/735: dread d2/d20/d7d/d29/d30/d71/f76 [0,4194304] 0 2023-12-08T20:28:25.441 INFO:tasks.workunit.client.0.smithi043.stdout:3/678: dwrite d1/d9/d38/f3d [4194304,4194304] 0 2023-12-08T20:28:25.441 INFO:tasks.workunit.client.0.smithi043.stdout:6/650: mkdir d0/d2/de/d4a/de2 0 2023-12-08T20:28:25.441 INFO:tasks.workunit.client.0.smithi043.stdout:6/651: dread - d0/d2/fae zero size 2023-12-08T20:28:25.442 INFO:tasks.workunit.client.0.smithi043.stdout:3/679: unlink d1/d9/d2d/d91/cdd 0 2023-12-08T20:28:25.442 INFO:tasks.workunit.client.0.smithi043.stdout:8/736: symlink d2/d20/d7d/d29/d30/d71/lf2 0 2023-12-08T20:28:25.444 INFO:tasks.workunit.client.0.smithi043.stdout:8/737: rename d2/d20/d7d/f14 to d2/d20/d7d/d29/d30/d7c/ff3 0 2023-12-08T20:28:25.448 INFO:tasks.workunit.client.0.smithi043.stdout:9/676: dwrite d0/d3d/d4b/f91 [0,4194304] 0 2023-12-08T20:28:25.448 INFO:tasks.workunit.client.0.smithi043.stdout:7/673: dwrite d0/d2/d65/d99/d47/f77 [0,4194304] 0 2023-12-08T20:28:25.454 INFO:tasks.workunit.client.0.smithi043.stdout:9/677: rename d0/d21/d80/fac to d0/d3d/d8a/d9a/ddd/d6b/d76/dd3/fdf 0 2023-12-08T20:28:25.454 INFO:tasks.workunit.client.0.smithi043.stdout:9/678: chown d0/d3d/d8a/d9a/ddd/f3a 0 1 2023-12-08T20:28:25.455 INFO:tasks.workunit.client.0.smithi043.stdout:9/679: read d0/f27 [618993,23021] 0 2023-12-08T20:28:25.464 INFO:tasks.workunit.client.0.smithi043.stdout:6/652: dwrite d0/d2/d14/d8/d47/f80 [0,4194304] 0 2023-12-08T20:28:25.465 INFO:tasks.workunit.client.0.smithi043.stdout:8/738: dread d2/d20/d7d/d29/d30/d7c/daa/fc6 [0,4194304] 0 2023-12-08T20:28:25.465 INFO:tasks.workunit.client.0.smithi043.stdout:8/739: stat d2/d20/d7d/d29/d30/d60/d9b/dbb 0 2023-12-08T20:28:25.473 INFO:tasks.workunit.client.0.smithi043.stdout:7/674: dwrite d0/d6/f24 [4194304,4194304] 0 2023-12-08T20:28:25.473 INFO:tasks.workunit.client.0.smithi043.stdout:7/675: fsync d0/d6/d17/dab/fb4 0 2023-12-08T20:28:25.475 INFO:tasks.workunit.client.0.smithi043.stdout:8/740: dread d2/d20/d7d/f13 [0,4194304] 0 2023-12-08T20:28:25.475 INFO:tasks.workunit.client.0.smithi043.stdout:7/676: symlink d0/d6/d17/d54/ld4 0 2023-12-08T20:28:25.476 INFO:tasks.workunit.client.0.smithi043.stdout:7/677: dread - d0/d2/d12/d19/d38/fb3 zero size 2023-12-08T20:28:25.476 INFO:tasks.workunit.client.0.smithi043.stdout:8/741: mknod d2/d27/d2d/d31/d91/cf4 0 2023-12-08T20:28:25.478 INFO:tasks.workunit.client.0.smithi043.stdout:9/680: dwrite d0/d3d/d4b/f91 [0,4194304] 0 2023-12-08T20:28:25.479 INFO:tasks.workunit.client.0.smithi043.stdout:9/681: link d0/d3d/d8a/d9a/ddd/d6b/d76/ld0 d0/d21/le0 0 2023-12-08T20:28:25.480 INFO:tasks.workunit.client.0.smithi043.stdout:9/682: read d0/d5e/f63 [2218569,34894] 0 2023-12-08T20:28:25.480 INFO:tasks.workunit.client.0.smithi043.stdout:9/683: chown d0/l18 610 1 2023-12-08T20:28:25.480 INFO:tasks.workunit.client.0.smithi043.stdout:9/684: dread - d0/d3d/d8a/d9a/ddd/d6b/f7e zero size 2023-12-08T20:28:25.484 INFO:tasks.workunit.client.0.smithi043.stdout:8/742: write d2/d27/d2d/d31/d74/f83 [2454721,20793] 0 2023-12-08T20:28:25.484 INFO:tasks.workunit.client.0.smithi043.stdout:6/653: dwrite d0/dc3/fca [0,4194304] 0 2023-12-08T20:28:25.485 INFO:tasks.workunit.client.0.smithi043.stdout:8/743: truncate d2/d20/d7d/f46 1175159 0 2023-12-08T20:28:25.485 INFO:tasks.workunit.client.0.smithi043.stdout:8/744: chown d2/d20/d7d/d29/d30/c4a 3843 1 2023-12-08T20:28:25.485 INFO:tasks.workunit.client.0.smithi043.stdout:8/745: stat d2/d27/d2d/d31/l87 0 2023-12-08T20:28:25.485 INFO:tasks.workunit.client.0.smithi043.stdout:8/746: rename d2/d20/d7d/d29/d30 to d2/d20/d7d/d29/d30/d71/df5 22 2023-12-08T20:28:25.488 INFO:tasks.workunit.client.0.smithi043.stdout:6/654: unlink d0/d2/d14/l67 0 2023-12-08T20:28:25.489 INFO:tasks.workunit.client.0.smithi043.stdout:9/685: dread d0/d5e/f63 [0,4194304] 0 2023-12-08T20:28:25.490 INFO:tasks.workunit.client.0.smithi043.stdout:8/747: rename d2/d6f/fae to d2/d20/d7d/d29/d30/d71/ff6 0 2023-12-08T20:28:25.493 INFO:tasks.workunit.client.0.smithi043.stdout:9/686: dread d0/d5e/fa4 [0,4194304] 0 2023-12-08T20:28:25.493 INFO:tasks.workunit.client.0.smithi043.stdout:9/687: truncate d0/d3d/d8a/d9a/ddd/d6b/d76/dd3/fdc 884544 0 2023-12-08T20:28:25.493 INFO:tasks.workunit.client.0.smithi043.stdout:9/688: write d0/d21/f26 [173838,56571] 0 2023-12-08T20:28:25.495 INFO:tasks.workunit.client.0.smithi043.stdout:9/689: truncate d0/d3d/f4c 840111 0 2023-12-08T20:28:25.495 INFO:tasks.workunit.client.0.smithi043.stdout:9/690: readlink d0/d3d/d4b/d65/l78 0 2023-12-08T20:28:25.496 INFO:tasks.workunit.client.0.smithi043.stdout:9/691: symlink d0/d3d/d8a/d9a/ddd/le1 0 2023-12-08T20:28:25.498 INFO:tasks.workunit.client.0.smithi043.stdout:8/748: dread d2/d20/d7d/f4d [4194304,4194304] 0 2023-12-08T20:28:25.498 INFO:tasks.workunit.client.0.smithi043.stdout:7/678: dwrite d0/d6/d17/d52/f74 [0,4194304] 0 2023-12-08T20:28:25.498 INFO:tasks.workunit.client.0.smithi043.stdout:8/749: fsync d2/d27/dab/fed 0 2023-12-08T20:28:25.498 INFO:tasks.workunit.client.0.smithi043.stdout:7/679: fdatasync d0/d2/f5 0 2023-12-08T20:28:25.498 INFO:tasks.workunit.client.0.smithi043.stdout:8/750: write d2/d27/dab/fed [1042772,68238] 0 2023-12-08T20:28:25.499 INFO:tasks.workunit.client.0.smithi043.stdout:7/680: write d0/d6/d17/d54/f80 [3950003,56582] 0 2023-12-08T20:28:25.503 INFO:tasks.workunit.client.0.smithi043.stdout:7/681: unlink d0/f6a 0 2023-12-08T20:28:25.503 INFO:tasks.workunit.client.0.smithi043.stdout:8/751: truncate d2/d6f/f39 698734 0 2023-12-08T20:28:25.503 INFO:tasks.workunit.client.0.smithi043.stdout:8/752: fsync d2/d27/d2d/d31/d74/f83 0 2023-12-08T20:28:25.505 INFO:tasks.workunit.client.0.smithi043.stdout:8/753: unlink d2/d20/d7d/d29/c5e 0 2023-12-08T20:28:25.508 INFO:tasks.workunit.client.0.smithi043.stdout:8/754: symlink d2/d27/d2d/de2/lf7 0 2023-12-08T20:28:25.511 INFO:tasks.workunit.client.0.smithi043.stdout:8/755: link d2/d20/d7d/d29/d30/d71/f96 d2/d27/d2d/d31/de8/ff8 0 2023-12-08T20:28:25.512 INFO:tasks.workunit.client.0.smithi043.stdout:8/756: getdents d2/d27/d2d/d31/d91 0 2023-12-08T20:28:25.513 INFO:tasks.workunit.client.0.smithi043.stdout:8/757: dread - d2/d20/d7d/d29/d59/d86/fad zero size 2023-12-08T20:28:25.514 INFO:tasks.workunit.client.0.smithi043.stdout:8/758: symlink d2/d20/lf9 0 2023-12-08T20:28:25.516 INFO:tasks.workunit.client.0.smithi043.stdout:8/759: mkdir d2/d20/d7d/d29/d59/d9f/ddf/dfa 0 2023-12-08T20:28:25.516 INFO:tasks.workunit.client.0.smithi043.stdout:8/760: chown d2/d27/d2d/d31/d91/f95 290788 1 2023-12-08T20:28:25.517 INFO:tasks.workunit.client.0.smithi043.stdout:9/692: dwrite d0/d3d/d8a/d9a/ddd/d6b/d6c/faa [0,4194304] 0 2023-12-08T20:28:25.518 INFO:tasks.workunit.client.0.smithi043.stdout:8/761: unlink d2/d27/d2d/cbf 0 2023-12-08T20:28:25.518 INFO:tasks.workunit.client.0.smithi043.stdout:8/762: readlink d2/d20/d7d/d37/l8c 0 2023-12-08T20:28:25.518 INFO:tasks.workunit.client.0.smithi043.stdout:8/763: getdents d2/d27/d2d/d31/d91 0 2023-12-08T20:28:25.519 INFO:tasks.workunit.client.0.smithi043.stdout:7/682: dwrite d0/fb [0,4194304] 0 2023-12-08T20:28:25.521 INFO:tasks.workunit.client.0.smithi043.stdout:9/693: getdents d0/d3d/d4b 0 2023-12-08T20:28:25.524 INFO:tasks.workunit.client.0.smithi043.stdout:8/764: rename d2/d20/d7d/d29/d30/d60/d9b/lbe to d2/d20/d7d/d37/d5a/lfb 0 2023-12-08T20:28:25.524 INFO:tasks.workunit.client.0.smithi043.stdout:8/765: fsync d2/d27/d2d/d31/d91/f95 0 2023-12-08T20:28:25.525 INFO:tasks.workunit.client.0.smithi043.stdout:7/683: mknod d0/d6/dc7/cd5 0 2023-12-08T20:28:25.525 INFO:tasks.workunit.client.0.smithi043.stdout:7/684: fdatasync d0/d2/d12/d19/f41 0 2023-12-08T20:28:25.528 INFO:tasks.workunit.client.0.smithi043.stdout:8/766: creat d2/d20/d7d/d37/d5a/ffc x:0 0 0 2023-12-08T20:28:25.528 INFO:tasks.workunit.client.0.smithi043.stdout:8/767: dread - d2/d20/d7d/d29/d30/d71/fd2 zero size 2023-12-08T20:28:25.530 INFO:tasks.workunit.client.0.smithi043.stdout:7/685: mkdir d0/d2/d65/d99/d47/dd6 0 2023-12-08T20:28:25.534 INFO:tasks.workunit.client.0.smithi043.stdout:7/686: link d0/d5b/c66 d0/d2/d65/cd7 0 2023-12-08T20:28:25.535 INFO:tasks.workunit.client.0.smithi043.stdout:7/687: mkdir d0/d2/d65/d99/d47/dd6/dd8 0 2023-12-08T20:28:25.536 INFO:tasks.workunit.client.0.smithi043.stdout:7/688: rename d0/d6/d17/f86 to d0/d6/dc7/fd9 0 2023-12-08T20:28:25.538 INFO:tasks.workunit.client.0.smithi043.stdout:7/689: write d0/fa1 [1056792,98323] 0 2023-12-08T20:28:25.540 INFO:tasks.workunit.client.0.smithi043.stdout:7/690: mkdir d0/d2/d65/d99/d47/dda 0 2023-12-08T20:28:25.540 INFO:tasks.workunit.client.0.smithi043.stdout:7/691: write d0/d2/d65/f71 [791609,12782] 0 2023-12-08T20:28:25.541 INFO:tasks.workunit.client.0.smithi043.stdout:7/692: mknod d0/d6/d17/d54/cdb 0 2023-12-08T20:28:25.542 INFO:tasks.workunit.client.0.smithi043.stdout:7/693: rmdir d0/d5b 39 2023-12-08T20:28:25.543 INFO:tasks.workunit.client.0.smithi043.stdout:7/694: truncate d0/d6/fba 6488788 0 2023-12-08T20:28:25.544 INFO:tasks.workunit.client.0.smithi043.stdout:7/695: mknod d0/d2/d12/cdc 0 2023-12-08T20:28:25.545 INFO:tasks.workunit.client.0.smithi043.stdout:7/696: symlink d0/d69/ldd 0 2023-12-08T20:28:25.545 INFO:tasks.workunit.client.0.smithi043.stdout:7/697: dread - d0/d2/d12/d19/d38/fc9 zero size 2023-12-08T20:28:25.546 INFO:tasks.workunit.client.0.smithi043.stdout:7/698: truncate d0/d2/d12/da2/fd0 303186 0 2023-12-08T20:28:25.551 INFO:tasks.workunit.client.0.smithi043.stdout:8/768: dwrite d2/d20/d7d/f8a [0,4194304] 0 2023-12-08T20:28:25.552 INFO:tasks.workunit.client.0.smithi043.stdout:8/769: rename d2/d20/d7d/d37/l1b to d2/d20/d7d/d37/lfd 0 2023-12-08T20:28:25.554 INFO:tasks.workunit.client.0.smithi043.stdout:8/770: mknod d2/d27/d2d/de7/cfe 0 2023-12-08T20:28:25.555 INFO:tasks.workunit.client.0.smithi043.stdout:8/771: write d2/d27/d2d/d31/d4f/fb0 [364486,81059] 0 2023-12-08T20:28:25.555 INFO:tasks.workunit.client.0.smithi043.stdout:8/772: write d2/d20/d7d/f26 [4529920,120520] 0 2023-12-08T20:28:25.555 INFO:tasks.workunit.client.0.smithi043.stdout:8/773: read - d2/d27/d2d/d31/d7f/db2/fb5 zero size 2023-12-08T20:28:25.555 INFO:tasks.workunit.client.0.smithi043.stdout:8/774: read - d2/d20/d7d/d29/d59/d86/fad zero size 2023-12-08T20:28:25.573 INFO:tasks.workunit.client.0.smithi043.stdout:7/699: dwrite d0/d2/d12/da2/fd0 [0,4194304] 0 2023-12-08T20:28:25.573 INFO:tasks.workunit.client.0.smithi043.stdout:8/775: dwrite d2/d27/d2d/d31/d91/f95 [0,4194304] 0 2023-12-08T20:28:25.574 INFO:tasks.workunit.client.0.smithi043.stdout:7/700: dread - d0/d2/fc6 zero size 2023-12-08T20:28:25.576 INFO:tasks.workunit.client.0.smithi043.stdout:7/701: mknod d0/d2/d65/d99/d47/cde 0 2023-12-08T20:28:25.576 INFO:tasks.workunit.client.0.smithi043.stdout:7/702: truncate d0/f88 1331515 0 2023-12-08T20:28:25.576 INFO:tasks.workunit.client.0.smithi043.stdout:7/703: chown d0/d2/c3e 0 1 2023-12-08T20:28:25.577 INFO:tasks.workunit.client.0.smithi043.stdout:8/776: mknod d2/d20/d7d/d37/cff 0 2023-12-08T20:28:25.577 INFO:tasks.workunit.client.0.smithi043.stdout:8/777: write d2/d27/d2d/d31/d91/ff1 [218760,103394] 0 2023-12-08T20:28:25.577 INFO:tasks.workunit.client.0.smithi043.stdout:7/704: symlink d0/d2/d65/d99/d47/dd6/ldf 0 2023-12-08T20:28:25.579 INFO:tasks.workunit.client.0.smithi043.stdout:8/778: dread d2/d20/fdb [0,4194304] 0 2023-12-08T20:28:25.579 INFO:tasks.workunit.client.0.smithi043.stdout:8/779: mknod d2/d20/d7d/d29/d30/d60/c100 0 2023-12-08T20:28:25.581 INFO:tasks.workunit.client.0.smithi043.stdout:8/780: creat d2/f101 x:0 0 0 2023-12-08T20:28:25.581 INFO:tasks.workunit.client.0.smithi043.stdout:8/781: readlink d2/d6f/l51 0 2023-12-08T20:28:25.581 INFO:tasks.workunit.client.0.smithi043.stdout:8/782: dread - d2/f101 zero size 2023-12-08T20:28:25.593 INFO:tasks.workunit.client.0.smithi043.stdout:8/783: dread d2/d27/d2d/f55 [0,4194304] 0 2023-12-08T20:28:25.594 INFO:tasks.workunit.client.0.smithi043.stdout:7/705: dwrite d0/d2/d12/da2/fd0 [0,4194304] 0 2023-12-08T20:28:25.602 INFO:tasks.workunit.client.0.smithi043.stdout:8/784: dread d2/d20/d7d/ff [0,4194304] 0 2023-12-08T20:28:25.603 INFO:tasks.workunit.client.0.smithi043.stdout:8/785: truncate d2/d27/d2d/d31/d74/f83 9077 0 2023-12-08T20:28:25.605 INFO:tasks.workunit.client.0.smithi043.stdout:8/786: rename d2/d20/d7d/d29/d30/d71/f8d to d2/d27/d2d/d31/de8/f102 0 2023-12-08T20:28:25.606 INFO:tasks.workunit.client.0.smithi043.stdout:7/706: dread d0/d69/d6d/fc8 [0,4194304] 0 2023-12-08T20:28:25.606 INFO:tasks.workunit.client.0.smithi043.stdout:8/787: unlink d2/d27/d2d/c52 0 2023-12-08T20:28:25.608 INFO:tasks.workunit.client.0.smithi043.stdout:7/707: unlink d0/d6/dc7/cd5 0 2023-12-08T20:28:25.609 INFO:tasks.workunit.client.0.smithi043.stdout:8/788: unlink d2/d20/d7d/d37/d5a/l70 0 2023-12-08T20:28:25.609 INFO:tasks.workunit.client.0.smithi043.stdout:8/789: write d2/d20/d7d/d29/d30/d71/f96 [1831361,69951] 0 2023-12-08T20:28:25.610 INFO:tasks.workunit.client.0.smithi043.stdout:8/790: read d2/d6f/f82 [2956562,34061] 0 2023-12-08T20:28:25.610 INFO:tasks.workunit.client.0.smithi043.stdout:8/791: fsync d2/d27/d2d/d31/d91/f95 0 2023-12-08T20:28:25.611 INFO:tasks.workunit.client.0.smithi043.stdout:7/708: rename d0/d6/d17/d52/f74 to d0/d6/d17/fe0 0 2023-12-08T20:28:25.613 INFO:tasks.workunit.client.0.smithi043.stdout:8/792: truncate d2/d20/fb1 57584 0 2023-12-08T20:28:25.614 INFO:tasks.workunit.client.0.smithi043.stdout:8/793: symlink d2/d20/d7d/d29/l103 0 2023-12-08T20:28:25.637 INFO:tasks.workunit.client.0.smithi043.stdout:7/709: dwrite d0/f9e [0,4194304] 0 2023-12-08T20:28:25.637 INFO:tasks.workunit.client.0.smithi043.stdout:7/710: rename d0/d2/d12/d19 to d0/d2/d12/d19/d38/d9c/de1 22 2023-12-08T20:28:25.638 INFO:tasks.workunit.client.0.smithi043.stdout:7/711: chown d0/d6/d17/d52/l89 23 1 2023-12-08T20:28:25.638 INFO:tasks.workunit.client.0.smithi043.stdout:8/794: dwrite d2/d20/d7d/d29/d30/d60/d9b/dbb/fc7 [0,4194304] 0 2023-12-08T20:28:25.638 INFO:tasks.workunit.client.0.smithi043.stdout:7/712: read d0/d2/d65/d99/d47/f6c [552570,57021] 0 2023-12-08T20:28:25.640 INFO:tasks.workunit.client.0.smithi043.stdout:7/713: symlink d0/d2/d12/le2 0 2023-12-08T20:28:25.641 INFO:tasks.workunit.client.0.smithi043.stdout:7/714: read d0/d2/d12/d19/d38/f58 [445069,120691] 0 2023-12-08T20:28:25.641 INFO:tasks.workunit.client.0.smithi043.stdout:7/715: stat d0/d2/d65/fb5 0 2023-12-08T20:28:25.642 INFO:tasks.workunit.client.0.smithi043.stdout:7/716: mkdir d0/d2/d65/d99/de3 0 2023-12-08T20:28:25.651 INFO:tasks.workunit.client.0.smithi043.stdout:7/717: dread d0/d2/d65/d99/f10 [0,4194304] 0 2023-12-08T20:28:25.654 INFO:tasks.workunit.client.0.smithi043.stdout:8/795: dwrite d2/d20/d7d/d37/f1f [0,4194304] 0 2023-12-08T20:28:25.656 INFO:tasks.workunit.client.0.smithi043.stdout:8/796: getdents d2/d20/d7d/d29/d59 0 2023-12-08T20:28:25.658 INFO:tasks.workunit.client.0.smithi043.stdout:8/797: write d2/d20/d7d/d29/d30/d7c/daa/fc6 [2709245,100634] 0 2023-12-08T20:28:25.660 INFO:tasks.workunit.client.0.smithi043.stdout:8/798: mknod d2/c104 0 2023-12-08T20:28:25.660 INFO:tasks.workunit.client.0.smithi043.stdout:8/799: mkdir d2/d27/d105 0 2023-12-08T20:28:25.662 INFO:tasks.workunit.client.0.smithi043.stdout:8/800: rmdir d2/d20/d7d/d29/d59/d9f/ddf 39 2023-12-08T20:28:25.662 INFO:tasks.workunit.client.0.smithi043.stdout:8/801: chown d2/d27/d2d/de7 2111312281 1 2023-12-08T20:28:25.665 INFO:tasks.workunit.client.0.smithi043.stdout:7/718: dwrite d0/d2/d12/d19/d38/fb3 [0,4194304] 0 2023-12-08T20:28:25.668 INFO:tasks.workunit.client.0.smithi043.stdout:7/719: unlink d0/d2/c3e 0 2023-12-08T20:28:25.670 INFO:tasks.workunit.client.0.smithi043.stdout:7/720: dread d0/d2/d12/d19/f41 [0,4194304] 0 2023-12-08T20:28:25.670 INFO:tasks.workunit.client.0.smithi043.stdout:7/721: dread - d0/f9b zero size 2023-12-08T20:28:25.672 INFO:tasks.workunit.client.0.smithi043.stdout:7/722: creat d0/d2/d65/d99/d47/fe4 x:0 0 0 2023-12-08T20:28:25.674 INFO:tasks.workunit.client.0.smithi043.stdout:7/723: write d0/d2/f21 [1153049,59039] 0 2023-12-08T20:28:25.675 INFO:tasks.workunit.client.0.smithi043.stdout:7/724: creat d0/d2/d65/fe5 x:0 0 0 2023-12-08T20:28:25.675 INFO:tasks.workunit.client.0.smithi043.stdout:7/725: symlink d0/d6/dc7/le6 0 2023-12-08T20:28:25.676 INFO:tasks.workunit.client.0.smithi043.stdout:7/726: write d0/f8f [963937,126944] 0 2023-12-08T20:28:25.676 INFO:tasks.workunit.client.0.smithi043.stdout:7/727: dread - d0/d2/d12/d19/d38/fc9 zero size 2023-12-08T20:28:25.676 INFO:tasks.workunit.client.0.smithi043.stdout:7/728: mkdir d0/d2/d65/d99/de7 0 2023-12-08T20:28:25.676 INFO:tasks.workunit.client.0.smithi043.stdout:7/729: chown d0/d5b/fc5 3485640 1 2023-12-08T20:28:25.677 INFO:tasks.workunit.client.0.smithi043.stdout:7/730: symlink d0/d2/d65/d99/d47/dd6/dd8/le8 0 2023-12-08T20:28:25.678 INFO:tasks.workunit.client.0.smithi043.stdout:7/731: creat d0/d6/fe9 x:0 0 0 2023-12-08T20:28:25.678 INFO:tasks.workunit.client.0.smithi043.stdout:7/732: dread - d0/d6/fe9 zero size 2023-12-08T20:28:25.679 INFO:tasks.workunit.client.0.smithi043.stdout:8/802: dwrite d2/d27/d2d/f7a [0,4194304] 0 2023-12-08T20:28:25.679 INFO:tasks.workunit.client.0.smithi043.stdout:8/803: write d2/d20/d7d/d29/fe9 [287214,91208] 0 2023-12-08T20:28:25.681 INFO:tasks.workunit.client.0.smithi043.stdout:8/804: symlink d2/d27/d2d/d31/d99/l106 0 2023-12-08T20:28:25.681 INFO:tasks.workunit.client.0.smithi043.stdout:8/805: truncate d2/d20/d7d/d37/d5a/f9a 970873 0 2023-12-08T20:28:25.697 INFO:tasks.workunit.client.0.smithi043.stdout:8/806: dwrite d2/d27/d2d/d31/d99/fe6 [0,4194304] 0 2023-12-08T20:28:25.699 INFO:tasks.workunit.client.0.smithi043.stdout:8/807: creat d2/d20/d7d/d29/d30/d60/d9b/dee/f107 x:0 0 0 2023-12-08T20:28:25.700 INFO:tasks.workunit.client.0.smithi043.stdout:8/808: creat d2/d6f/f108 x:0 0 0 2023-12-08T20:28:25.700 INFO:tasks.workunit.client.0.smithi043.stdout:8/809: rename d2/d27/d2d to d2/d27/d2d/d31/d4f/d109 22 2023-12-08T20:28:25.702 INFO:tasks.workunit.client.0.smithi043.stdout:7/733: dwrite d0/d2/d12/f32 [4194304,4194304] 0 2023-12-08T20:28:25.703 INFO:tasks.workunit.client.0.smithi043.stdout:7/734: write d0/d2/d12/d19/d38/f55 [68515,7481] 0 2023-12-08T20:28:25.705 INFO:tasks.workunit.client.0.smithi043.stdout:1/709: sync 2023-12-08T20:28:25.705 INFO:tasks.workunit.client.0.smithi043.stdout:5/648: sync 2023-12-08T20:28:25.707 INFO:tasks.workunit.client.0.smithi043.stdout:5/649: dread - d3/d7/d90/fad zero size 2023-12-08T20:28:25.709 INFO:tasks.workunit.client.0.smithi043.stdout:5/650: link d3/d73/d83/l8e d3/d7/d19/lc6 0 2023-12-08T20:28:25.711 INFO:tasks.workunit.client.0.smithi043.stdout:8/810: rmdir d2/d20/d7d/d29/d30/d60/d9b 39 2023-12-08T20:28:25.714 INFO:tasks.workunit.client.0.smithi043.stdout:8/811: creat d2/d20/d7d/d29/d59/d9f/ddf/dfa/f10a x:0 0 0 2023-12-08T20:28:25.715 INFO:tasks.workunit.client.0.smithi043.stdout:8/812: rmdir d2/d27/d2d/d31/d7f/db7 39 2023-12-08T20:28:25.717 INFO:tasks.workunit.client.0.smithi043.stdout:8/813: creat d2/d27/d2d/d31/d4f/f10b x:0 0 0 2023-12-08T20:28:25.718 INFO:tasks.workunit.client.0.smithi043.stdout:5/651: dread d3/d7/de/d17/d84/fba [0,4194304] 0 2023-12-08T20:28:25.719 INFO:tasks.workunit.client.0.smithi043.stdout:8/814: write d2/d20/d7d/d37/d5a/f63 [396638,43710] 0 2023-12-08T20:28:25.719 INFO:tasks.workunit.client.0.smithi043.stdout:5/652: mknod d3/d7/de/d82/cc7 0 2023-12-08T20:28:25.721 INFO:tasks.workunit.client.0.smithi043.stdout:8/815: link d2/d20/d7d/d29/d30/d7c/c97 d2/d20/d7d/d29/d59/d9f/ddf/c10c 0 2023-12-08T20:28:25.722 INFO:tasks.workunit.client.0.smithi043.stdout:8/816: creat d2/d20/d7d/d29/d30/d60/d9b/dee/f10d x:0 0 0 2023-12-08T20:28:25.724 INFO:tasks.workunit.client.0.smithi043.stdout:8/817: creat d2/d20/d7d/d29/d59/f10e x:0 0 0 2023-12-08T20:28:25.725 INFO:tasks.workunit.client.0.smithi043.stdout:8/818: symlink d2/d27/d2d/d31/d74/l10f 0 2023-12-08T20:28:25.726 INFO:tasks.workunit.client.0.smithi043.stdout:8/819: mkdir d2/d20/d7d/d29/d30/d60/d9b/d110 0 2023-12-08T20:28:25.729 INFO:tasks.workunit.client.0.smithi043.stdout:7/735: dwrite d0/d2/f3a [4194304,4194304] 0 2023-12-08T20:28:25.731 INFO:tasks.workunit.client.0.smithi043.stdout:1/710: dwrite d1/d16/d7e/f9c [0,4194304] 0 2023-12-08T20:28:25.732 INFO:tasks.workunit.client.0.smithi043.stdout:7/736: creat d0/d2/d65/d99/de3/fea x:0 0 0 2023-12-08T20:28:25.733 INFO:tasks.workunit.client.0.smithi043.stdout:1/711: write d1/d16/d48/f4a [792580,88309] 0 2023-12-08T20:28:25.735 INFO:tasks.workunit.client.0.smithi043.stdout:7/737: mknod d0/d2/d65/d99/ceb 0 2023-12-08T20:28:25.735 INFO:tasks.workunit.client.0.smithi043.stdout:7/738: write d0/d2/d12/fcd [535446,84567] 0 2023-12-08T20:28:25.736 INFO:tasks.workunit.client.0.smithi043.stdout:1/712: creat d1/d16/d21/d6f/ffb x:0 0 0 2023-12-08T20:28:25.738 INFO:tasks.workunit.client.0.smithi043.stdout:5/653: dwrite d3/d7/de/d17/f27 [4194304,4194304] 0 2023-12-08T20:28:25.741 INFO:tasks.workunit.client.0.smithi043.stdout:7/739: dread d0/f8f [0,4194304] 0 2023-12-08T20:28:25.742 INFO:tasks.workunit.client.0.smithi043.stdout:5/654: creat d3/d7/de/d43/d68/fc8 x:0 0 0 2023-12-08T20:28:25.742 INFO:tasks.workunit.client.0.smithi043.stdout:5/655: read - d3/d7/d21/d51/d7d/f96 zero size 2023-12-08T20:28:25.742 INFO:tasks.workunit.client.0.smithi043.stdout:5/656: chown d3/d7/de/d17 2338 1 2023-12-08T20:28:25.742 INFO:tasks.workunit.client.0.smithi043.stdout:5/657: write d3/d7/d19/d3f/f62 [462735,113002] 0 2023-12-08T20:28:25.743 INFO:tasks.workunit.client.0.smithi043.stdout:5/658: stat d3/d32 0 2023-12-08T20:28:25.746 INFO:tasks.workunit.client.0.smithi043.stdout:8/820: dwrite d2/d27/d2d/f55 [0,4194304] 0 2023-12-08T20:28:25.754 INFO:tasks.workunit.client.0.smithi043.stdout:1/713: dwrite d1/d16/d21/d6f/ffb [0,4194304] 0 2023-12-08T20:28:25.754 INFO:tasks.workunit.client.0.smithi043.stdout:1/714: readlink d1/d6/le2 0 2023-12-08T20:28:25.760 INFO:tasks.workunit.client.0.smithi043.stdout:1/715: mknod d1/db1/dc9/cfc 0 2023-12-08T20:28:25.779 INFO:tasks.workunit.client.0.smithi043.stdout:1/716: dwrite d1/d16/d1c/f7c [0,4194304] 0 2023-12-08T20:28:25.779 INFO:tasks.workunit.client.0.smithi043.stdout:1/717: chown d1/d16/d21/d25/d3e/d77/c84 13202 1 2023-12-08T20:28:25.781 INFO:tasks.workunit.client.0.smithi043.stdout:1/718: mknod d1/d16/d21/d42/cfd 0 2023-12-08T20:28:25.782 INFO:tasks.workunit.client.0.smithi043.stdout:8/821: mknod d2/d27/d2d/de2/c111 0 2023-12-08T20:28:25.782 INFO:tasks.workunit.client.0.smithi043.stdout:8/822: stat d2/d27/d2d/d31/d4f/f10b 0 2023-12-08T20:28:25.794 INFO:tasks.workunit.client.0.smithi043.stdout:8/823: rmdir d2/d27/d2d/de2 39 2023-12-08T20:28:25.806 INFO:tasks.workunit.client.0.smithi043.stdout:5/659: creat d3/d7/d21/d51/fc9 x:0 0 0 2023-12-08T20:28:25.808 INFO:tasks.workunit.client.0.smithi043.stdout:7/740: rename d0/d69/ldd to d0/d6/d17/d54/lec 0 2023-12-08T20:28:25.808 INFO:tasks.workunit.client.0.smithi043.stdout:1/719: rename d1/d16/d21/d25 to d1/d16/d21/d25/d3e/df8/dfe 22 2023-12-08T20:28:25.810 INFO:tasks.workunit.client.0.smithi043.stdout:7/741: mknod d0/d69/d6d/ced 0 2023-12-08T20:28:25.810 INFO:tasks.workunit.client.0.smithi043.stdout:1/720: creat d1/d16/d48/fff x:0 0 0 2023-12-08T20:28:25.812 INFO:tasks.workunit.client.0.smithi043.stdout:7/742: mknod d0/d2/d12/d19/cee 0 2023-12-08T20:28:25.815 INFO:tasks.workunit.client.0.smithi043.stdout:8/824: dwrite d2/d27/d2d/d31/d99/faf [4194304,4194304] 0 2023-12-08T20:28:25.817 INFO:tasks.workunit.client.0.smithi043.stdout:5/660: dread d3/d7/de/d43/d68/f88 [0,4194304] 0 2023-12-08T20:28:25.818 INFO:tasks.workunit.client.0.smithi043.stdout:8/825: rmdir d2/d6f 39 2023-12-08T20:28:25.819 INFO:tasks.workunit.client.0.smithi043.stdout:5/661: mknod d3/d7/d21/d51/d5c/da7/cca 0 2023-12-08T20:28:25.820 INFO:tasks.workunit.client.0.smithi043.stdout:5/662: write d3/d7/d21/f61 [834578,7959] 0 2023-12-08T20:28:25.831 INFO:tasks.workunit.client.0.smithi043.stdout:8/826: dread d2/d27/d2d/d31/d99/fe6 [0,4194304] 0 2023-12-08T20:28:25.840 INFO:tasks.workunit.client.0.smithi043.stdout:7/743: symlink d0/d2/d65/d99/lef 0 2023-12-08T20:28:25.842 INFO:tasks.workunit.client.0.smithi043.stdout:1/721: dwrite d1/d16/d48/f53 [0,4194304] 0 2023-12-08T20:28:25.842 INFO:tasks.workunit.client.0.smithi043.stdout:1/722: stat d1/d16/d1c/d71/dc5 0 2023-12-08T20:28:25.842 INFO:tasks.workunit.client.0.smithi043.stdout:1/723: write d1/d16/d30/d4f/d54/f78 [1179011,63677] 0 2023-12-08T20:28:25.842 INFO:tasks.workunit.client.0.smithi043.stdout:1/724: truncate d1/d16/d21/d25/d35/f62 4402059 0 2023-12-08T20:28:25.842 INFO:tasks.workunit.client.0.smithi043.stdout:1/725: chown d1/d16/d21/f6c 395 1 2023-12-08T20:28:25.842 INFO:tasks.workunit.client.0.smithi043.stdout:8/827: mkdir d2/d27/dab/d112 0 2023-12-08T20:28:25.842 INFO:tasks.workunit.client.0.smithi043.stdout:7/744: truncate d0/d69/d6d/fc8 662041 0 2023-12-08T20:28:25.845 INFO:tasks.workunit.client.0.smithi043.stdout:1/726: creat d1/d16/d1c/d71/dc5/f100 x:0 0 0 2023-12-08T20:28:25.847 INFO:tasks.workunit.client.0.smithi043.stdout:9/694: sync 2023-12-08T20:28:25.847 INFO:tasks.workunit.client.0.smithi043.stdout:4/689: sync 2023-12-08T20:28:25.847 INFO:tasks.workunit.client.0.smithi043.stdout:7/745: creat d0/d2/db0/ff0 x:0 0 0 2023-12-08T20:28:25.848 INFO:tasks.workunit.client.0.smithi043.stdout:5/663: mknod d3/d7/d19/d3f/ccb 0 2023-12-08T20:28:25.848 INFO:tasks.workunit.client.0.smithi043.stdout:6/655: sync 2023-12-08T20:28:25.848 INFO:tasks.workunit.client.0.smithi043.stdout:5/664: fdatasync d3/d7/de/fa9 0 2023-12-08T20:28:25.848 INFO:tasks.workunit.client.0.smithi043.stdout:0/897: sync 2023-12-08T20:28:25.848 INFO:tasks.workunit.client.0.smithi043.stdout:2/935: sync 2023-12-08T20:28:25.848 INFO:tasks.workunit.client.0.smithi043.stdout:3/680: sync 2023-12-08T20:28:25.848 INFO:tasks.workunit.client.0.smithi043.stdout:9/695: symlink d0/d3d/d8a/d9a/ddd/d6b/d6c/le2 0 2023-12-08T20:28:25.849 INFO:tasks.workunit.client.0.smithi043.stdout:1/727: mknod d1/d16/d1c/d71/d98/c101 0 2023-12-08T20:28:25.850 INFO:tasks.workunit.client.0.smithi043.stdout:3/681: truncate d1/d9/d38/d33/f5d 51245 0 2023-12-08T20:28:25.850 INFO:tasks.workunit.client.0.smithi043.stdout:9/696: read d0/f27 [1698669,32434] 0 2023-12-08T20:28:25.851 INFO:tasks.workunit.client.0.smithi043.stdout:7/746: read d0/d2/d12/d19/f40 [1996926,12456] 0 2023-12-08T20:28:25.852 INFO:tasks.workunit.client.0.smithi043.stdout:8/828: dread d2/d27/d2d/d31/d91/fa3 [0,4194304] 0 2023-12-08T20:28:25.852 INFO:tasks.workunit.client.0.smithi043.stdout:8/829: write d2/d27/d2d/d31/d74/f83 [84402,34026] 0 2023-12-08T20:28:25.852 INFO:tasks.workunit.client.0.smithi043.stdout:8/830: write d2/d27/d2d/d31/d7f/db2/fc0 [5197380,120072] 0 2023-12-08T20:28:25.852 INFO:tasks.workunit.client.0.smithi043.stdout:8/831: truncate d2/d27/d2d/d31/d4f/f10b 860877 0 2023-12-08T20:28:25.852 INFO:tasks.workunit.client.0.smithi043.stdout:3/682: rename d1/d1c/d2c/f65 to d1/d9/d2d/d66/dca/dd4/fde 0 2023-12-08T20:28:25.852 INFO:tasks.workunit.client.0.smithi043.stdout:7/747: mknod d0/d6/dc7/cf1 0 2023-12-08T20:28:25.853 INFO:tasks.workunit.client.0.smithi043.stdout:5/665: mknod d3/d7/d21/d51/d5c/da7/ccc 0 2023-12-08T20:28:25.856 INFO:tasks.workunit.client.0.smithi043.stdout:8/832: chown d2/d20/d7d/d29/d59/d9f/fcc 7 1 2023-12-08T20:28:25.856 INFO:tasks.workunit.client.0.smithi043.stdout:7/748: unlink d0/d2/c22 0 2023-12-08T20:28:25.856 INFO:tasks.workunit.client.0.smithi043.stdout:4/690: dread d1/d14/d25/d39/da3/dae/fb4 [0,4194304] 0 2023-12-08T20:28:25.857 INFO:tasks.workunit.client.0.smithi043.stdout:4/691: write d1/d14/d25/d39/d3f/d3c/d41/db6/fc9 [634546,107030] 0 2023-12-08T20:28:25.857 INFO:tasks.workunit.client.0.smithi043.stdout:4/692: fdatasync d1/d14/d25/d39/d3f/d3c/d41/db6/fb9 0 2023-12-08T20:28:25.857 INFO:tasks.workunit.client.0.smithi043.stdout:4/693: readlink d1/d14/l1f 0 2023-12-08T20:28:25.857 INFO:tasks.workunit.client.0.smithi043.stdout:6/656: mkdir d0/d2/d14/d2c/d22/d2a/db2/dba/de3 0 2023-12-08T20:28:25.857 INFO:tasks.workunit.client.0.smithi043.stdout:3/683: mkdir d1/d9/d38/d4f/d8f/ddf 0 2023-12-08T20:28:25.858 INFO:tasks.workunit.client.0.smithi043.stdout:3/684: write d1/d9/d38/d33/f63 [4998715,17177] 0 2023-12-08T20:28:25.858 INFO:tasks.workunit.client.0.smithi043.stdout:3/685: chown d1/d25/d84/d9a/f7a 45447298 1 2023-12-08T20:28:25.860 INFO:tasks.workunit.client.0.smithi043.stdout:4/694: link d1/d14/d25/d39/d3f/d3c/d41/d65/f8e d1/d14/d25/d39/d3f/d3c/d41/d65/fee 0 2023-12-08T20:28:25.861 INFO:tasks.workunit.client.0.smithi043.stdout:0/898: link d2/d61/dc1/cee d2/d3/d18/d1e/d53/d10b/d39/d83/d9d/c125 0 2023-12-08T20:28:25.861 INFO:tasks.workunit.client.0.smithi043.stdout:8/833: write d2/d20/d7d/d29/d30/d71/f96 [487531,127405] 0 2023-12-08T20:28:25.862 INFO:tasks.workunit.client.0.smithi043.stdout:9/697: dread d0/d5e/f63 [0,4194304] 0 2023-12-08T20:28:25.862 INFO:tasks.workunit.client.0.smithi043.stdout:9/698: read - d0/d5e/fd1 zero size 2023-12-08T20:28:25.869 INFO:tasks.workunit.client.0.smithi043.stdout:4/695: mkdir d1/d14/d25/d77/da4/dc0/def 0 2023-12-08T20:28:25.872 INFO:tasks.workunit.client.0.smithi043.stdout:8/834: rename d2/d20/d7d/d37/cff to d2/d27/d2d/c113 0 2023-12-08T20:28:25.872 INFO:tasks.workunit.client.0.smithi043.stdout:8/835: read - d2/f9d zero size 2023-12-08T20:28:25.872 INFO:tasks.workunit.client.0.smithi043.stdout:9/699: rmdir d0/d5e/d73 39 2023-12-08T20:28:25.872 INFO:tasks.workunit.client.0.smithi043.stdout:8/836: write d2/d27/d2d/ff0 [899257,49385] 0 2023-12-08T20:28:25.873 INFO:tasks.workunit.client.0.smithi043.stdout:9/700: fsync d0/d21/f3e 0 2023-12-08T20:28:25.873 INFO:tasks.workunit.client.0.smithi043.stdout:2/936: dread d0/db/f31 [0,4194304] 0 2023-12-08T20:28:25.873 INFO:tasks.workunit.client.0.smithi043.stdout:1/728: dread d1/d6/f9a [0,4194304] 0 2023-12-08T20:28:25.873 INFO:tasks.workunit.client.0.smithi043.stdout:1/729: write d1/d16/d1c/d4e/fe7 [551646,87967] 0 2023-12-08T20:28:25.873 INFO:tasks.workunit.client.0.smithi043.stdout:6/657: write d0/d2/f36 [609702,95330] 0 2023-12-08T20:28:25.874 INFO:tasks.workunit.client.0.smithi043.stdout:2/937: write d0/d2b/f5b [2114499,66214] 0 2023-12-08T20:28:25.874 INFO:tasks.workunit.client.0.smithi043.stdout:3/686: dread d1/d9/d38/d4f/d8f/f99 [0,4194304] 0 2023-12-08T20:28:25.874 INFO:tasks.workunit.client.0.smithi043.stdout:4/696: link d1/d14/d25/d28/f2b d1/d14/d25/d77/d8d/ff0 0 2023-12-08T20:28:25.875 INFO:tasks.workunit.client.0.smithi043.stdout:3/687: read d1/d9/d2d/d42/f95 [2671961,61189] 0 2023-12-08T20:28:25.875 INFO:tasks.workunit.client.0.smithi043.stdout:1/730: mkdir d1/d16/d1c/d4e/dcd/dad/d102 0 2023-12-08T20:28:25.876 INFO:tasks.workunit.client.0.smithi043.stdout:8/837: mkdir d2/d27/d114 0 2023-12-08T20:28:25.876 INFO:tasks.workunit.client.0.smithi043.stdout:8/838: write d2/d20/d7d/d37/d5a/f63 [1132755,69533] 0 2023-12-08T20:28:25.878 INFO:tasks.workunit.client.0.smithi043.stdout:1/731: write d1/f2 [3494443,2685] 0 2023-12-08T20:28:25.878 INFO:tasks.workunit.client.0.smithi043.stdout:6/658: rename d0/d2/f3e to d0/d2/d14/d8/fe4 0 2023-12-08T20:28:25.878 INFO:tasks.workunit.client.0.smithi043.stdout:9/701: mkdir d0/d3d/d8a/de3 0 2023-12-08T20:28:25.880 INFO:tasks.workunit.client.0.smithi043.stdout:2/938: unlink d0/d2b/f5b 0 2023-12-08T20:28:25.880 INFO:tasks.workunit.client.0.smithi043.stdout:2/939: fdatasync d0/db/d18/f36 0 2023-12-08T20:28:25.880 INFO:tasks.workunit.client.0.smithi043.stdout:2/940: stat d0/db/l11d 0 2023-12-08T20:28:25.881 INFO:tasks.workunit.client.0.smithi043.stdout:8/839: truncate d2/d20/d7d/d29/d59/d9f/fc3 1383710 0 2023-12-08T20:28:25.881 INFO:tasks.workunit.client.0.smithi043.stdout:3/688: creat d1/d9/d2d/d66/dca/dd4/fe0 x:0 0 0 2023-12-08T20:28:25.881 INFO:tasks.workunit.client.0.smithi043.stdout:6/659: mknod d0/d2/d14/d2c/d22/d2a/db2/dba/dde/ce5 0 2023-12-08T20:28:25.882 INFO:tasks.workunit.client.0.smithi043.stdout:6/660: chown d0/d2/d14/d2c 13 1 2023-12-08T20:28:25.883 INFO:tasks.workunit.client.0.smithi043.stdout:8/840: rmdir d2/d27/d2d/d31/d4f 39 2023-12-08T20:28:25.884 INFO:tasks.workunit.client.0.smithi043.stdout:6/661: link d0/d2/d14/d8/d47/l68 d0/d2/le6 0 2023-12-08T20:28:25.886 INFO:tasks.workunit.client.0.smithi043.stdout:7/749: dwrite d0/d5b/f63 [0,4194304] 0 2023-12-08T20:28:25.889 INFO:tasks.workunit.client.0.smithi043.stdout:8/841: dread d2/d20/d7d/d29/d59/f65 [0,4194304] 0 2023-12-08T20:28:25.890 INFO:tasks.workunit.client.0.smithi043.stdout:8/842: chown d2/d27/d2d/d31/d91/fa3 651947779 1 2023-12-08T20:28:25.893 INFO:tasks.workunit.client.0.smithi043.stdout:6/662: rename d0/d2/d14/d20/dc0/cc4 to d0/d2/de/ce7 0 2023-12-08T20:28:25.893 INFO:tasks.workunit.client.0.smithi043.stdout:6/663: write d0/d2/d14/d2c/d22/d3f/d45/f98 [5127386,61734] 0 2023-12-08T20:28:25.893 INFO:tasks.workunit.client.0.smithi043.stdout:6/664: readlink d0/d2/d14/l8f 0 2023-12-08T20:28:25.898 INFO:tasks.workunit.client.0.smithi043.stdout:7/750: creat d0/d2/d65/d99/d47/ff2 x:0 0 0 2023-12-08T20:28:25.898 INFO:tasks.workunit.client.0.smithi043.stdout:7/751: readlink d0/d6/d17/d54/lec 0 2023-12-08T20:28:25.898 INFO:tasks.workunit.client.0.smithi043.stdout:7/752: write d0/d5b/fc5 [129106,112659] 0 2023-12-08T20:28:25.898 INFO:tasks.workunit.client.0.smithi043.stdout:2/941: dread d0/d26/dbc/d38/f84 [0,4194304] 0 2023-12-08T20:28:25.898 INFO:tasks.workunit.client.0.smithi043.stdout:3/689: dread d1/d9/f32 [0,4194304] 0 2023-12-08T20:28:25.898 INFO:tasks.workunit.client.0.smithi043.stdout:3/690: chown d1/d25/d2a/c71 22 1 2023-12-08T20:28:25.898 INFO:tasks.workunit.client.0.smithi043.stdout:3/691: truncate d1/d9/f32 126632 0 2023-12-08T20:28:25.898 INFO:tasks.workunit.client.0.smithi043.stdout:3/692: fsync d1/d9/d2d/fa9 0 2023-12-08T20:28:25.898 INFO:tasks.workunit.client.0.smithi043.stdout:8/843: creat d2/d27/d2d/de7/f115 x:0 0 0 2023-12-08T20:28:25.898 INFO:tasks.workunit.client.0.smithi043.stdout:8/844: chown d2/d27/d114 97222 1 2023-12-08T20:28:25.898 INFO:tasks.workunit.client.0.smithi043.stdout:8/845: dread - d2/d20/d7d/d29/d30/fd1 zero size 2023-12-08T20:28:25.899 INFO:tasks.workunit.client.0.smithi043.stdout:3/693: symlink d1/d9/d38/d4a/dbd/le1 0 2023-12-08T20:28:25.899 INFO:tasks.workunit.client.0.smithi043.stdout:7/753: read d0/d2/d65/d99/d47/f77 [2983764,77985] 0 2023-12-08T20:28:25.900 INFO:tasks.workunit.client.0.smithi043.stdout:8/846: unlink d2/d27/d2d/d31/d7f/db2/fc0 0 2023-12-08T20:28:25.901 INFO:tasks.workunit.client.0.smithi043.stdout:3/694: mknod d1/d25/dc1/ce2 0 2023-12-08T20:28:25.901 INFO:tasks.workunit.client.0.smithi043.stdout:8/847: creat d2/d20/d7d/d29/d59/d9f/ddf/dfa/f116 x:0 0 0 2023-12-08T20:28:25.902 INFO:tasks.workunit.client.0.smithi043.stdout:3/695: dread d1/f9e [0,4194304] 0 2023-12-08T20:28:25.903 INFO:tasks.workunit.client.0.smithi043.stdout:3/696: truncate d1/d9/d2d/d66/dca/dd4/fe0 105688 0 2023-12-08T20:28:25.903 INFO:tasks.workunit.client.0.smithi043.stdout:8/848: rmdir d2/d20/d7d/d37 39 2023-12-08T20:28:25.903 INFO:tasks.workunit.client.0.smithi043.stdout:8/849: read - d2/f101 zero size 2023-12-08T20:28:25.904 INFO:tasks.workunit.client.0.smithi043.stdout:3/697: creat d1/d9/df/d41/fe3 x:0 0 0 2023-12-08T20:28:25.905 INFO:tasks.workunit.client.0.smithi043.stdout:2/942: rename d0/d20/d42/dcb to d0/db/d18/d8b/da2/d12e 0 2023-12-08T20:28:25.906 INFO:tasks.workunit.client.0.smithi043.stdout:2/943: stat d0/d26/d53/l70 0 2023-12-08T20:28:25.906 INFO:tasks.workunit.client.0.smithi043.stdout:2/944: chown d0/db/d18/d8b/fe4 227 1 2023-12-08T20:28:25.906 INFO:tasks.workunit.client.0.smithi043.stdout:9/702: dwrite d0/d21/f26 [0,4194304] 0 2023-12-08T20:28:25.906 INFO:tasks.workunit.client.0.smithi043.stdout:2/945: mknod d0/dd4/c12f 0 2023-12-08T20:28:25.907 INFO:tasks.workunit.client.0.smithi043.stdout:2/946: read d0/d26/dbc/d38/f5d [40678,21232] 0 2023-12-08T20:28:25.909 INFO:tasks.workunit.client.0.smithi043.stdout:1/732: dwrite d1/d16/d30/f5a [0,4194304] 0 2023-12-08T20:28:25.910 INFO:tasks.workunit.client.0.smithi043.stdout:1/733: write d1/d16/d21/d25/d35/fac [719165,73331] 0 2023-12-08T20:28:25.910 INFO:tasks.workunit.client.0.smithi043.stdout:8/850: mkdir d2/d20/d7d/d29/d30/d60/d9b/d117 0 2023-12-08T20:28:25.911 INFO:tasks.workunit.client.0.smithi043.stdout:3/698: creat d1/d9/d38/d4f/d8f/ddf/fe4 x:0 0 0 2023-12-08T20:28:25.912 INFO:tasks.workunit.client.0.smithi043.stdout:0/899: dwrite d2/d4/f4b [0,4194304] 0 2023-12-08T20:28:25.913 INFO:tasks.workunit.client.0.smithi043.stdout:6/665: dwrite d0/d2/d14/d2c/d22/f7e [0,4194304] 0 2023-12-08T20:28:25.916 INFO:tasks.workunit.client.0.smithi043.stdout:0/900: mkdir d2/d61/dc1/d126 0 2023-12-08T20:28:25.916 INFO:tasks.workunit.client.0.smithi043.stdout:7/754: rename d0/d6/l7e to d0/d2/d65/d99/d47/lf3 0 2023-12-08T20:28:25.916 INFO:tasks.workunit.client.0.smithi043.stdout:8/851: rmdir d2/d20/d7d/d29/d30/d7c 39 2023-12-08T20:28:25.917 INFO:tasks.workunit.client.0.smithi043.stdout:7/755: write d0/d5b/f8b [696148,42403] 0 2023-12-08T20:28:25.919 INFO:tasks.workunit.client.0.smithi043.stdout:1/734: dread d1/d16/f18 [0,4194304] 0 2023-12-08T20:28:25.919 INFO:tasks.workunit.client.0.smithi043.stdout:9/703: rename d0/d3d/d8a/d9a/ddd/d6b/l93 to d0/d3d/d8a/d9a/ddd/le4 0 2023-12-08T20:28:25.920 INFO:tasks.workunit.client.0.smithi043.stdout:7/756: mknod d0/d2/d65/d99/de7/cf4 0 2023-12-08T20:28:25.921 INFO:tasks.workunit.client.0.smithi043.stdout:3/699: rename d1/f4b to d1/d9/d2d/d42/fe5 0 2023-12-08T20:28:25.924 INFO:tasks.workunit.client.0.smithi043.stdout:7/757: link d0/d6/f7b d0/ff5 0 2023-12-08T20:28:25.926 INFO:tasks.workunit.client.0.smithi043.stdout:3/700: rmdir d1/d9/df/d6e 39 2023-12-08T20:28:25.928 INFO:tasks.workunit.client.0.smithi043.stdout:9/704: dread d0/d3d/d8a/d9a/ddd/d6b/d76/f68 [0,4194304] 0 2023-12-08T20:28:25.929 INFO:tasks.workunit.client.0.smithi043.stdout:9/705: rename d0/d21/dc1/fcc to d0/d21/dc1/fe5 0 2023-12-08T20:28:25.929 INFO:tasks.workunit.client.0.smithi043.stdout:3/701: creat d1/d25/fe6 x:0 0 0 2023-12-08T20:28:25.930 INFO:tasks.workunit.client.0.smithi043.stdout:9/706: chown d0/d67/ldb 24068326 1 2023-12-08T20:28:25.930 INFO:tasks.workunit.client.0.smithi043.stdout:9/707: fdatasync d0/d5e/fa4 0 2023-12-08T20:28:25.931 INFO:tasks.workunit.client.0.smithi043.stdout:1/735: mkdir d1/d16/d21/d25/d35/d103 0 2023-12-08T20:28:25.933 INFO:tasks.workunit.client.0.smithi043.stdout:9/708: write d0/d3d/d4b/d61/f62 [795832,25073] 0 2023-12-08T20:28:25.934 INFO:tasks.workunit.client.0.smithi043.stdout:3/702: dread d1/d9/df/f62 [0,4194304] 0 2023-12-08T20:28:25.934 INFO:tasks.workunit.client.0.smithi043.stdout:6/666: rename d0/d2/d14/d2c/d22/d3f/d45/d69/fa7 to d0/d2/d14/d20/d49/fe8 0 2023-12-08T20:28:25.934 INFO:tasks.workunit.client.0.smithi043.stdout:6/667: truncate d0/d2/d14/d2c/d22/d2a/db2/dba/fe0 264696 0 2023-12-08T20:28:25.934 INFO:tasks.workunit.client.0.smithi043.stdout:1/736: write d1/d16/d1c/f7c [1561454,109522] 0 2023-12-08T20:28:25.938 INFO:tasks.workunit.client.0.smithi043.stdout:8/852: rename d2/d27/d2d/d31/d4f/cc4 to d2/d27/d2d/d31/d7f/db7/c118 0 2023-12-08T20:28:25.938 INFO:tasks.workunit.client.0.smithi043.stdout:2/947: dwrite d0/d26/d53/fbb [4194304,4194304] 0 2023-12-08T20:28:25.940 INFO:tasks.workunit.client.0.smithi043.stdout:1/737: write d1/d6/f32 [2007625,102063] 0 2023-12-08T20:28:25.941 INFO:tasks.workunit.client.0.smithi043.stdout:7/758: dwrite d0/f3d [0,4194304] 0 2023-12-08T20:28:25.942 INFO:tasks.workunit.client.0.smithi043.stdout:6/668: truncate d0/d2/d14/d20/d3c/d6c/fb0 2872608 0 2023-12-08T20:28:25.942 INFO:tasks.workunit.client.0.smithi043.stdout:6/669: rename d0 to d0/dc3/de9 22 2023-12-08T20:28:25.943 INFO:tasks.workunit.client.0.smithi043.stdout:0/901: rmdir d2/d4 39 2023-12-08T20:28:25.943 INFO:tasks.workunit.client.0.smithi043.stdout:0/902: getdents d2/d3/d18/d1e/d53 0 2023-12-08T20:28:25.944 INFO:tasks.workunit.client.0.smithi043.stdout:3/703: dread d1/d9/d2d/d66/f98 [4194304,4194304] 0 2023-12-08T20:28:25.944 INFO:tasks.workunit.client.0.smithi043.stdout:3/704: chown d1/d9/d2d/d66/dca/fcb 449074 1 2023-12-08T20:28:25.946 INFO:tasks.workunit.client.0.smithi043.stdout:8/853: mknod d2/d20/d7d/d29/d30/c119 0 2023-12-08T20:28:25.948 INFO:tasks.workunit.client.0.smithi043.stdout:7/759: truncate d0/d2/d12/d19/f40 1352089 0 2023-12-08T20:28:25.951 INFO:tasks.workunit.client.0.smithi043.stdout:3/705: rmdir d1/d9/d2d/d91 39 2023-12-08T20:28:25.951 INFO:tasks.workunit.client.0.smithi043.stdout:3/706: stat d1/d25/d2a/dd0/lb2 0 2023-12-08T20:28:25.953 INFO:tasks.workunit.client.0.smithi043.stdout:8/854: mknod d2/d20/d7d/d29/d59/d9f/c11a 0 2023-12-08T20:28:25.953 INFO:tasks.workunit.client.0.smithi043.stdout:0/903: dread d2/d3/d18/d1e/d53/d7d/f93 [0,4194304] 0 2023-12-08T20:28:25.955 INFO:tasks.workunit.client.0.smithi043.stdout:8/855: mknod d2/d27/d105/c11b 0 2023-12-08T20:28:25.962 INFO:tasks.workunit.client.0.smithi043.stdout:3/707: dread d1/d9/f4e [0,4194304] 0 2023-12-08T20:28:25.962 INFO:tasks.workunit.client.0.smithi043.stdout:0/904: dread d2/d4/fd0 [0,4194304] 0 2023-12-08T20:28:25.962 INFO:tasks.workunit.client.0.smithi043.stdout:2/948: mkdir d0/d81/d130 0 2023-12-08T20:28:25.963 INFO:tasks.workunit.client.0.smithi043.stdout:2/949: fsync d0/dd4/ff6 0 2023-12-08T20:28:25.963 INFO:tasks.workunit.client.0.smithi043.stdout:2/950: chown d0/cc 229023 1 2023-12-08T20:28:25.963 INFO:tasks.workunit.client.0.smithi043.stdout:2/951: chown d0/d26/d53/f75 319 1 2023-12-08T20:28:25.963 INFO:tasks.workunit.client.0.smithi043.stdout:2/952: chown d0/db/d18/d66/c82 17419879 1 2023-12-08T20:28:25.963 INFO:tasks.workunit.client.0.smithi043.stdout:1/738: symlink d1/d16/d1c/d71/dda/l104 0 2023-12-08T20:28:25.963 INFO:tasks.workunit.client.0.smithi043.stdout:0/905: dread d2/d3/d18/d2b/fd9 [0,4194304] 0 2023-12-08T20:28:25.964 INFO:tasks.workunit.client.0.smithi043.stdout:3/708: write d1/d25/f36 [1096063,59934] 0 2023-12-08T20:28:25.965 INFO:tasks.workunit.client.0.smithi043.stdout:3/709: chown d1/d25/d2a/dd0/f96 16308482 1 2023-12-08T20:28:25.966 INFO:tasks.workunit.client.0.smithi043.stdout:3/710: creat d1/d9/d38/d4f/d8f/fe7 x:0 0 0 2023-12-08T20:28:25.972 INFO:tasks.workunit.client.0.smithi043.stdout:3/711: write d1/f18 [7521801,110117] 0 2023-12-08T20:28:25.973 INFO:tasks.workunit.client.0.smithi043.stdout:3/712: creat d1/d9/d38/d4f/d8f/ddf/fe8 x:0 0 0 2023-12-08T20:28:25.973 INFO:tasks.workunit.client.0.smithi043.stdout:3/713: truncate d1/d9/d2d/d66/dca/fcc 596858 0 2023-12-08T20:28:25.973 INFO:tasks.workunit.client.0.smithi043.stdout:3/714: fsync d1/d9/d2d/d42/f95 0 2023-12-08T20:28:25.983 INFO:tasks.workunit.client.0.smithi043.stdout:9/709: dwrite d0/d3d/d8a/d9a/ddd/d6b/d76/f68 [0,4194304] 0 2023-12-08T20:28:25.983 INFO:tasks.workunit.client.0.smithi043.stdout:9/710: truncate d0/d5e/f40 2557976 0 2023-12-08T20:28:25.983 INFO:tasks.workunit.client.0.smithi043.stdout:7/760: dwrite d0/d6/f18 [4194304,4194304] 0 2023-12-08T20:28:25.983 INFO:tasks.workunit.client.0.smithi043.stdout:2/953: dwrite d0/db/faf [0,4194304] 0 2023-12-08T20:28:25.983 INFO:tasks.workunit.client.0.smithi043.stdout:7/761: write d0/d2/d65/d99/d47/f77 [884458,108990] 0 2023-12-08T20:28:25.987 INFO:tasks.workunit.client.0.smithi043.stdout:2/954: write d0/db/d18/d66/f9b [94456,117251] 0 2023-12-08T20:28:25.990 INFO:tasks.workunit.client.0.smithi043.stdout:2/955: fsync d0/db/d18/d66/f9b 0 2023-12-08T20:28:25.991 INFO:tasks.workunit.client.0.smithi043.stdout:9/711: rename d0/d3d/d8c/fbf to d0/d3d/d8a/d9a/fe6 0 2023-12-08T20:28:25.997 INFO:tasks.workunit.client.0.smithi043.stdout:7/762: dwrite d0/d2/d65/fb5 [0,4194304] 0 2023-12-08T20:28:26.001 INFO:tasks.workunit.client.0.smithi043.stdout:9/712: mknod d0/d3d/d4b/d65/ce7 0 2023-12-08T20:28:26.002 INFO:tasks.workunit.client.0.smithi043.stdout:3/715: dread d1/f18 [0,4194304] 0 2023-12-08T20:28:26.002 INFO:tasks.workunit.client.0.smithi043.stdout:3/716: fsync d1/d9/d38/d4f/d8f/ddf/fe4 0 2023-12-08T20:28:26.002 INFO:tasks.workunit.client.0.smithi043.stdout:3/717: fsync d1/d25/d2a/f6a 0 2023-12-08T20:28:26.004 INFO:tasks.workunit.client.0.smithi043.stdout:7/763: dread d0/d5b/f63 [0,4194304] 0 2023-12-08T20:28:26.004 INFO:tasks.workunit.client.0.smithi043.stdout:7/764: chown d0/d2/d65/d99/de7/cf4 66052 1 2023-12-08T20:28:26.004 INFO:tasks.workunit.client.0.smithi043.stdout:3/718: truncate d1/d9/fd 257008 0 2023-12-08T20:28:26.012 INFO:tasks.workunit.client.0.smithi043.stdout:3/719: dread d1/d9/d38/d4f/f8c [4194304,4194304] 0 2023-12-08T20:28:26.015 INFO:tasks.workunit.client.0.smithi043.stdout:3/720: symlink d1/d25/d2a/d85/da6/dc3/le9 0 2023-12-08T20:28:26.024 INFO:tasks.workunit.client.0.smithi043.stdout:3/721: dread d1/f6d [0,4194304] 0 2023-12-08T20:28:26.024 INFO:tasks.workunit.client.0.smithi043.stdout:3/722: fsync d1/d1c/d29/fa5 0 2023-12-08T20:28:26.025 INFO:tasks.workunit.client.0.smithi043.stdout:3/723: truncate d1/d9/f4e 4214016 0 2023-12-08T20:28:26.030 INFO:tasks.workunit.client.0.smithi043.stdout:9/713: dwrite d0/d21/d80/d97/fa3 [0,4194304] 0 2023-12-08T20:28:26.030 INFO:tasks.workunit.client.0.smithi043.stdout:9/714: dread - d0/d3d/d4b/d5c/fd5 zero size 2023-12-08T20:28:26.035 INFO:tasks.workunit.client.0.smithi043.stdout:9/715: rename d0/d3d/f4c to d0/d21/d80/d97/fe8 0 2023-12-08T20:28:26.035 INFO:tasks.workunit.client.0.smithi043.stdout:7/765: dwrite d0/d2/d65/d99/f10 [4194304,4194304] 0 2023-12-08T20:28:26.037 INFO:tasks.workunit.client.0.smithi043.stdout:9/716: symlink d0/d21/le9 0 2023-12-08T20:28:26.040 INFO:tasks.workunit.client.0.smithi043.stdout:9/717: link d0/f27 d0/d3d/d8a/d9a/ddd/d6b/d76/d53/fea 0 2023-12-08T20:28:26.040 INFO:tasks.workunit.client.0.smithi043.stdout:9/718: dread - d0/fa5 zero size 2023-12-08T20:28:26.043 INFO:tasks.workunit.client.0.smithi043.stdout:3/724: dwrite d1/d1c/d29/f7e [0,4194304] 0 2023-12-08T20:28:26.043 INFO:tasks.workunit.client.0.smithi043.stdout:3/725: getdents d1/d9/df/ddb 0 2023-12-08T20:28:26.046 INFO:tasks.workunit.client.0.smithi043.stdout:3/726: unlink d1/d25/c93 0 2023-12-08T20:28:26.046 INFO:tasks.workunit.client.0.smithi043.stdout:6/670: creat d0/d2/de/d4a/de2/fea x:0 0 0 2023-12-08T20:28:26.046 INFO:tasks.workunit.client.0.smithi043.stdout:6/671: stat d0/d2/l38 0 2023-12-08T20:28:26.046 INFO:tasks.workunit.client.0.smithi043.stdout:6/672: write d0/d2/d14/d2c/d66/f9d [818208,71722] 0 2023-12-08T20:28:26.047 INFO:tasks.workunit.client.0.smithi043.stdout:9/719: rename d0/d21/d80/d97 to d0/d5e/d73/deb 0 2023-12-08T20:28:26.049 INFO:tasks.workunit.client.0.smithi043.stdout:1/739: unlink d1/d16/d21/l67 0 2023-12-08T20:28:26.049 INFO:tasks.workunit.client.0.smithi043.stdout:3/727: symlink d1/d25/d2a/d45/lea 0 2023-12-08T20:28:26.050 INFO:tasks.workunit.client.0.smithi043.stdout:3/728: write d1/d9/d2d/d42/fe5 [4903773,117531] 0 2023-12-08T20:28:26.051 INFO:tasks.workunit.client.0.smithi043.stdout:9/720: mknod d0/d3d/d4b/d65/cec 0 2023-12-08T20:28:26.054 INFO:tasks.workunit.client.0.smithi043.stdout:9/721: creat d0/d3d/d8a/d9a/ddd/d6b/d6c/fed x:0 0 0 2023-12-08T20:28:26.056 INFO:tasks.workunit.client.0.smithi043.stdout:9/722: mkdir d0/d3d/dd4/dee 0 2023-12-08T20:28:26.056 INFO:tasks.workunit.client.0.smithi043.stdout:7/766: dwrite d0/f3d [4194304,4194304] 0 2023-12-08T20:28:26.056 INFO:tasks.workunit.client.0.smithi043.stdout:3/729: dread d1/f9e [0,4194304] 0 2023-12-08T20:28:26.059 INFO:tasks.workunit.client.0.smithi043.stdout:7/767: getdents d0/d6/d17/dab 0 2023-12-08T20:28:26.061 INFO:tasks.workunit.client.0.smithi043.stdout:7/768: creat d0/d2/d65/d99/ff6 x:0 0 0 2023-12-08T20:28:26.061 INFO:tasks.workunit.client.0.smithi043.stdout:7/769: chown d0/d2/d12/f51 2583 1 2023-12-08T20:28:26.062 INFO:tasks.workunit.client.0.smithi043.stdout:7/770: creat d0/d2/d12/d19/ff7 x:0 0 0 2023-12-08T20:28:26.062 INFO:tasks.workunit.client.0.smithi043.stdout:0/906: symlink d2/d61/dc0/l127 0 2023-12-08T20:28:26.063 INFO:tasks.workunit.client.0.smithi043.stdout:0/907: write d2/d61/d67/d9e/fed [923406,98993] 0 2023-12-08T20:28:26.065 INFO:tasks.workunit.client.0.smithi043.stdout:7/771: rename d0/d2/d12/l67 to d0/d69/lf8 0 2023-12-08T20:28:26.065 INFO:tasks.workunit.client.0.smithi043.stdout:1/740: rmdir d1/d16/d21/d25/d3e/d72 39 2023-12-08T20:28:26.066 INFO:tasks.workunit.client.0.smithi043.stdout:7/772: mkdir d0/d6/d17/d52/dac/df9 0 2023-12-08T20:28:26.068 INFO:tasks.workunit.client.0.smithi043.stdout:1/741: creat d1/d16/f105 x:0 0 0 2023-12-08T20:28:26.068 INFO:tasks.workunit.client.0.smithi043.stdout:9/723: dread d0/d3d/d4b/f91 [0,4194304] 0 2023-12-08T20:28:26.068 INFO:tasks.workunit.client.0.smithi043.stdout:9/724: chown d0/d3d/d8a/d9a/ddd/d6b/d6c/cd7 505445939 1 2023-12-08T20:28:26.071 INFO:tasks.workunit.client.0.smithi043.stdout:6/673: dwrite d0/d2/d14/d2c/d22/d3f/d45/f6d [0,4194304] 0 2023-12-08T20:28:26.071 INFO:tasks.workunit.client.0.smithi043.stdout:1/742: mkdir d1/d16/d21/d25/d3e/d77/d106 0 2023-12-08T20:28:26.072 INFO:tasks.workunit.client.0.smithi043.stdout:9/725: mknod d0/d3d/d8a/d9a/ddd/d6b/d6c/cef 0 2023-12-08T20:28:26.073 INFO:tasks.workunit.client.0.smithi043.stdout:6/674: link d0/d2/de/f40 d0/d2/d92/feb 0 2023-12-08T20:28:26.075 INFO:tasks.workunit.client.0.smithi043.stdout:9/726: creat d0/d3d/d4b/da2/dbc/ff0 x:0 0 0 2023-12-08T20:28:26.077 INFO:tasks.workunit.client.0.smithi043.stdout:1/743: creat d1/d6/f107 x:0 0 0 2023-12-08T20:28:26.077 INFO:tasks.workunit.client.0.smithi043.stdout:6/675: truncate d0/f7f 2087900 0 2023-12-08T20:28:26.077 INFO:tasks.workunit.client.0.smithi043.stdout:6/676: chown d0/d2/de/d4a/lb5 255445 1 2023-12-08T20:28:26.080 INFO:tasks.workunit.client.0.smithi043.stdout:1/744: rename d1/f2a to d1/d16/d21/d25/d3e/d77/d9f/dc3/f108 0 2023-12-08T20:28:26.081 INFO:tasks.workunit.client.0.smithi043.stdout:9/727: creat d0/d3d/d8a/d9a/ddd/d6b/d76/d53/ff1 x:0 0 0 2023-12-08T20:28:26.081 INFO:tasks.workunit.client.0.smithi043.stdout:9/728: chown d0/d21/dc1 11441 1 2023-12-08T20:28:26.081 INFO:tasks.workunit.client.0.smithi043.stdout:6/677: mkdir d0/d2/d14/d2c/d22/d2a/db2/dba/dec 0 2023-12-08T20:28:26.081 INFO:tasks.workunit.client.0.smithi043.stdout:6/678: getdents d0/d2/d14/d2c/d22/d3f/d45/d6b 0 2023-12-08T20:28:26.087 INFO:tasks.workunit.client.0.smithi043.stdout:6/679: creat d0/d2/d14/db3/fed x:0 0 0 2023-12-08T20:28:26.093 INFO:tasks.workunit.client.0.smithi043.stdout:0/908: dwrite d2/d3/d18/d2b/f36 [0,4194304] 0 2023-12-08T20:28:26.097 INFO:tasks.workunit.client.0.smithi043.stdout:6/680: rmdir d0/d2/d14/d2c/d22/d3f/d45 39 2023-12-08T20:28:26.102 INFO:tasks.workunit.client.0.smithi043.stdout:3/730: dwrite d1/d9/d2d/d42/f95 [0,4194304] 0 2023-12-08T20:28:26.103 INFO:tasks.workunit.client.0.smithi043.stdout:6/681: write d0/d2/d14/d20/d53/f5e [680310,58786] 0 2023-12-08T20:28:26.106 INFO:tasks.workunit.client.0.smithi043.stdout:3/731: rmdir d1/d9/df/d6e/d7d 39 2023-12-08T20:28:26.108 INFO:tasks.workunit.client.0.smithi043.stdout:1/745: dwrite d1/d6/d63/fe4 [0,4194304] 0 2023-12-08T20:28:26.108 INFO:tasks.workunit.client.0.smithi043.stdout:0/909: creat d2/d3/d18/d1e/d53/d10b/d39/d83/f128 x:0 0 0 2023-12-08T20:28:26.108 INFO:tasks.workunit.client.0.smithi043.stdout:0/910: chown d2/d3/d18/d2b/da5/da3 379 1 2023-12-08T20:28:26.108 INFO:tasks.workunit.client.0.smithi043.stdout:0/911: fsync d2/d61/fce 0 2023-12-08T20:28:26.109 INFO:tasks.workunit.client.0.smithi043.stdout:9/729: dwrite d0/d5e/d73/deb/fa3 [0,4194304] 0 2023-12-08T20:28:26.110 INFO:tasks.workunit.client.0.smithi043.stdout:9/730: mkdir d0/d3d/dd4/df2 0 2023-12-08T20:28:26.110 INFO:tasks.workunit.client.0.smithi043.stdout:9/731: read - d0/fa5 zero size 2023-12-08T20:28:26.110 INFO:tasks.workunit.client.0.smithi043.stdout:9/732: write d0/d21/d80/d8e/fb8 [816348,104709] 0 2023-12-08T20:28:26.112 INFO:tasks.workunit.client.0.smithi043.stdout:9/733: dread d0/d21/f56 [0,4194304] 0 2023-12-08T20:28:26.112 INFO:tasks.workunit.client.0.smithi043.stdout:9/734: write d0/f27 [5073520,93232] 0 2023-12-08T20:28:26.112 INFO:tasks.workunit.client.0.smithi043.stdout:9/735: stat d0/d21/d80/fda 0 2023-12-08T20:28:26.112 INFO:tasks.workunit.client.0.smithi043.stdout:9/736: chown d0/d3d/d4b/d5c/l8d 11041020 1 2023-12-08T20:28:26.114 INFO:tasks.workunit.client.0.smithi043.stdout:0/912: write d2/d3/d18/d2b/da5/d5f/df0/f10c [1010688,7212] 0 2023-12-08T20:28:26.114 INFO:tasks.workunit.client.0.smithi043.stdout:0/913: write d2/d61/d67/d9e/fed [1981718,53856] 0 2023-12-08T20:28:26.114 INFO:tasks.workunit.client.0.smithi043.stdout:6/682: mkdir d0/d2/de/d4a/d56/dc2/dee 0 2023-12-08T20:28:26.115 INFO:tasks.workunit.client.0.smithi043.stdout:9/737: rename d0/d3d/f72 to d0/d21/d80/d8e/ff3 0 2023-12-08T20:28:26.115 INFO:tasks.workunit.client.0.smithi043.stdout:9/738: write d0/d5e/d73/deb/fe8 [1343096,89191] 0 2023-12-08T20:28:26.115 INFO:tasks.workunit.client.0.smithi043.stdout:9/739: write d0/d21/d80/fda [816029,1403] 0 2023-12-08T20:28:26.115 INFO:tasks.workunit.client.0.smithi043.stdout:9/740: fdatasync d0/f14 0 2023-12-08T20:28:26.116 INFO:tasks.workunit.client.0.smithi043.stdout:6/683: write d0/d2/d14/d2c/d22/d3f/d45/f6d [2553,85377] 0 2023-12-08T20:28:26.116 INFO:tasks.workunit.client.0.smithi043.stdout:6/684: chown d0/d2/d14/d20/d49/fe8 1466 1 2023-12-08T20:28:26.116 INFO:tasks.workunit.client.0.smithi043.stdout:6/685: truncate d0/d2/d29/f52 1168836 0 2023-12-08T20:28:26.116 INFO:tasks.workunit.client.0.smithi043.stdout:6/686: chown d0/d2/d14/d2c/d22/c6a 415731 1 2023-12-08T20:28:26.119 INFO:tasks.workunit.client.0.smithi043.stdout:9/741: creat d0/d21/ff4 x:0 0 0 2023-12-08T20:28:26.119 INFO:tasks.workunit.client.0.smithi043.stdout:9/742: stat d0/d3d/d4b/d61/f62 0 2023-12-08T20:28:26.120 INFO:tasks.workunit.client.0.smithi043.stdout:9/743: chown d0/f14 0 1 2023-12-08T20:28:26.120 INFO:tasks.workunit.client.0.smithi043.stdout:9/744: fdatasync d0/d3d/d8a/d9a/ddd/d6b/f7e 0 2023-12-08T20:28:26.120 INFO:tasks.workunit.client.0.smithi043.stdout:9/745: fsync d0/d3d/d8c/fc6 0 2023-12-08T20:28:26.120 INFO:tasks.workunit.client.0.smithi043.stdout:9/746: truncate d0/d21/f3e 1131653 0 2023-12-08T20:28:26.123 INFO:tasks.workunit.client.0.smithi043.stdout:3/732: dread d1/d9/d38/d33/f68 [0,4194304] 0 2023-12-08T20:28:26.124 INFO:tasks.workunit.client.0.smithi043.stdout:1/746: symlink d1/d16/d1c/d71/l109 0 2023-12-08T20:28:26.127 INFO:tasks.workunit.client.0.smithi043.stdout:3/733: symlink d1/leb 0 2023-12-08T20:28:26.128 INFO:tasks.workunit.client.0.smithi043.stdout:3/734: write d1/d9/d38/fab [649701,120962] 0 2023-12-08T20:28:26.128 INFO:tasks.workunit.client.0.smithi043.stdout:3/735: fsync d1/d9/d2d/f70 0 2023-12-08T20:28:26.128 INFO:tasks.workunit.client.0.smithi043.stdout:1/747: rename d1/d16/d1c/d71/dda to d1/d16/d7e/d10a 0 2023-12-08T20:28:26.130 INFO:tasks.workunit.client.0.smithi043.stdout:9/747: dread d0/d3d/d8a/d9a/ddd/d6b/d76/dd3/fdf [0,4194304] 0 2023-12-08T20:28:26.130 INFO:tasks.workunit.client.0.smithi043.stdout:9/748: chown d0 1175 1 2023-12-08T20:28:26.131 INFO:tasks.workunit.client.0.smithi043.stdout:3/736: link d1/d1c/d2c/d5f/fb5 d1/d25/d2a/dd0/fec 0 2023-12-08T20:28:26.131 INFO:tasks.workunit.client.0.smithi043.stdout:3/737: truncate d1/d9/d38/fab 1768027 0 2023-12-08T20:28:26.131 INFO:tasks.workunit.client.0.smithi043.stdout:3/738: write d1/d9/d38/d33/f5d [215265,65092] 0 2023-12-08T20:28:26.131 INFO:tasks.workunit.client.0.smithi043.stdout:3/739: mknod d1/d9/d2d/d91/dda/ced 0 2023-12-08T20:28:26.136 INFO:tasks.workunit.client.0.smithi043.stdout:3/740: link d1/d9/df/d6e/c82 d1/d9/d2d/d91/da7/cee 0 2023-12-08T20:28:26.136 INFO:tasks.workunit.client.0.smithi043.stdout:1/748: symlink d1/d16/d30/d6e/d83/l10b 0 2023-12-08T20:28:26.137 INFO:tasks.workunit.client.0.smithi043.stdout:1/749: symlink d1/d16/d21/d25/d3e/d77/d9f/dc3/l10c 0 2023-12-08T20:28:26.139 INFO:tasks.workunit.client.0.smithi043.stdout:0/914: dwrite d2/d4/f9f [0,4194304] 0 2023-12-08T20:28:26.139 INFO:tasks.workunit.client.0.smithi043.stdout:0/915: truncate d2/d3/d18/f121 292003 0 2023-12-08T20:28:26.139 INFO:tasks.workunit.client.0.smithi043.stdout:1/750: creat d1/d16/f10d x:0 0 0 2023-12-08T20:28:26.141 INFO:tasks.workunit.client.0.smithi043.stdout:0/916: write d2/d3/d18/d1e/d53/d10b/d39/d83/fb5 [3382599,124156] 0 2023-12-08T20:28:26.141 INFO:tasks.workunit.client.0.smithi043.stdout:0/917: chown d2/d3/d18/lc8 2430 1 2023-12-08T20:28:26.142 INFO:tasks.workunit.client.0.smithi043.stdout:0/918: getdents d2/d3/d18/d1e/d53/d10b/d39/d63/da6/dae/d109 0 2023-12-08T20:28:26.142 INFO:tasks.workunit.client.0.smithi043.stdout:0/919: dread - d2/d61/d8a/fb7 zero size 2023-12-08T20:28:26.142 INFO:tasks.workunit.client.0.smithi043.stdout:0/920: stat d2/d61/d8a/ff7 0 2023-12-08T20:28:26.149 INFO:tasks.workunit.client.0.smithi043.stdout:1/751: symlink d1/d16/d1c/d71/l10e 0 2023-12-08T20:28:26.149 INFO:tasks.workunit.client.0.smithi043.stdout:9/749: dwrite d0/d5e/f89 [0,4194304] 0 2023-12-08T20:28:26.151 INFO:tasks.workunit.client.0.smithi043.stdout:9/750: link d0/d3d/d8a/d9a/ddd/d6b/d76/d53/l8f d0/d3d/d4b/d61/lf5 0 2023-12-08T20:28:26.151 INFO:tasks.workunit.client.0.smithi043.stdout:0/921: rename d2/c3e to d2/d3/d18/d1e/d53/d10b/d39/d63/da6/c129 0 2023-12-08T20:28:26.151 INFO:tasks.workunit.client.0.smithi043.stdout:0/922: write d2/d4/f9f [4490692,70368] 0 2023-12-08T20:28:26.152 INFO:tasks.workunit.client.0.smithi043.stdout:9/751: write d0/d3d/d4b/d5c/fb7 [3433957,114088] 0 2023-12-08T20:28:26.153 INFO:tasks.workunit.client.0.smithi043.stdout:9/752: fdatasync d0/d3d/d8a/d9a/ddd/d6b/d76/d53/fcd 0 2023-12-08T20:28:26.153 INFO:tasks.workunit.client.0.smithi043.stdout:0/923: write d2/d4/fe [162876,39763] 0 2023-12-08T20:28:26.153 INFO:tasks.workunit.client.0.smithi043.stdout:3/741: dwrite d1/d9/df/f47 [0,4194304] 0 2023-12-08T20:28:26.153 INFO:tasks.workunit.client.0.smithi043.stdout:1/752: rename d1/d16/d30/c57 to d1/d16/d1c/d4e/dcd/dad/d102/c10f 0 2023-12-08T20:28:26.154 INFO:tasks.workunit.client.0.smithi043.stdout:0/924: link d2/d3/d18/d1e/c4d d2/d3/d18/d1e/d53/d7d/c12a 0 2023-12-08T20:28:26.159 INFO:tasks.workunit.client.0.smithi043.stdout:4/697: sync 2023-12-08T20:28:26.159 INFO:tasks.workunit.client.0.smithi043.stdout:5/666: sync 2023-12-08T20:28:26.159 INFO:tasks.workunit.client.0.smithi043.stdout:4/698: write d1/fd3 [107049,113421] 0 2023-12-08T20:28:26.161 INFO:tasks.workunit.client.0.smithi043.stdout:9/753: rename d0/d67 to d0/d21/d80/d8e/df6 0 2023-12-08T20:28:26.165 INFO:tasks.workunit.client.0.smithi043.stdout:9/754: link d0/d5e/d73/deb/fe8 d0/d3d/dd4/ff7 0 2023-12-08T20:28:26.176 INFO:tasks.workunit.client.0.smithi043.stdout:3/742: dwrite d1/d25/f24 [0,4194304] 0 2023-12-08T20:28:26.178 INFO:tasks.workunit.client.0.smithi043.stdout:3/743: creat d1/d1c/d8b/fef x:0 0 0 2023-12-08T20:28:26.179 INFO:tasks.workunit.client.0.smithi043.stdout:3/744: truncate d1/d9/d38/d4f/f8c 4322524 0 2023-12-08T20:28:26.179 INFO:tasks.workunit.client.0.smithi043.stdout:3/745: chown d1/d9/d2d/fa9 2145 1 2023-12-08T20:28:26.179 INFO:tasks.workunit.client.0.smithi043.stdout:3/746: fsync d1/d1c/f53 0 2023-12-08T20:28:26.179 INFO:tasks.workunit.client.0.smithi043.stdout:3/747: fsync d1/d25/fe6 0 2023-12-08T20:28:26.180 INFO:tasks.workunit.client.0.smithi043.stdout:3/748: mkdir d1/d9/d38/d4a/df0 0 2023-12-08T20:28:26.181 INFO:tasks.workunit.client.0.smithi043.stdout:3/749: symlink d1/d25/d84/d9a/lf1 0 2023-12-08T20:28:26.181 INFO:tasks.workunit.client.0.smithi043.stdout:3/750: readlink d1/d1c/d29/la2 0 2023-12-08T20:28:26.181 INFO:tasks.workunit.client.0.smithi043.stdout:3/751: stat d1/d9/f48 0 2023-12-08T20:28:26.181 INFO:tasks.workunit.client.0.smithi043.stdout:3/752: stat d1/d9/d2d/d91/dda/ced 0 2023-12-08T20:28:26.182 INFO:tasks.workunit.client.0.smithi043.stdout:3/753: mknod d1/d9/d38/d33/cf2 0 2023-12-08T20:28:26.183 INFO:tasks.workunit.client.0.smithi043.stdout:3/754: getdents d1/d9/d2d/d66/dca/dd4 0 2023-12-08T20:28:26.187 INFO:tasks.workunit.client.0.smithi043.stdout:5/667: dwrite d3/d7/d19/d3f/f86 [4194304,4194304] 0 2023-12-08T20:28:26.188 INFO:tasks.workunit.client.0.smithi043.stdout:5/668: dread - d3/d7/d21/fa3 zero size 2023-12-08T20:28:26.189 INFO:tasks.workunit.client.0.smithi043.stdout:3/755: write d1/d9/d2d/d42/fe5 [3086532,114049] 0 2023-12-08T20:28:26.189 INFO:tasks.workunit.client.0.smithi043.stdout:5/669: truncate d3/d7/f13 2650967 0 2023-12-08T20:28:26.189 INFO:tasks.workunit.client.0.smithi043.stdout:5/670: chown d3/d7/de/c64 36161480 1 2023-12-08T20:28:26.190 INFO:tasks.workunit.client.0.smithi043.stdout:5/671: read d3/d7/d21/d51/d5c/f74 [1274076,65964] 0 2023-12-08T20:28:26.190 INFO:tasks.workunit.client.0.smithi043.stdout:0/925: dwrite d2/d61/dc0/f11b [0,4194304] 0 2023-12-08T20:28:26.191 INFO:tasks.workunit.client.0.smithi043.stdout:0/926: write d2/fca [4741736,10031] 0 2023-12-08T20:28:26.191 INFO:tasks.workunit.client.0.smithi043.stdout:0/927: chown d2/d3/d18/d1e/c4d 127 1 2023-12-08T20:28:26.191 INFO:tasks.workunit.client.0.smithi043.stdout:5/672: write f1 [3149696,46950] 0 2023-12-08T20:28:26.195 INFO:tasks.workunit.client.0.smithi043.stdout:5/673: unlink d3/d73/d83/d99/fa5 0 2023-12-08T20:28:26.195 INFO:tasks.workunit.client.0.smithi043.stdout:5/674: chown d3/d7/de/d17 114505 1 2023-12-08T20:28:26.196 INFO:tasks.workunit.client.0.smithi043.stdout:3/756: symlink d1/d25/d84/d9a/lf3 0 2023-12-08T20:28:26.198 INFO:tasks.workunit.client.0.smithi043.stdout:5/675: mkdir d3/d7/d19/dcd 0 2023-12-08T20:28:26.198 INFO:tasks.workunit.client.0.smithi043.stdout:0/928: unlink d2/d61/d67/f95 0 2023-12-08T20:28:26.200 INFO:tasks.workunit.client.0.smithi043.stdout:1/753: rename d1/d16/d1c/d4e/dcd to d1/d16/d21/d25/d3e/d77/d9f/dc3/d110 0 2023-12-08T20:28:26.204 INFO:tasks.workunit.client.0.smithi043.stdout:0/929: mkdir d2/d3/d18/d1e/d53/d12b 0 2023-12-08T20:28:26.209 INFO:tasks.workunit.client.0.smithi043.stdout:0/930: mkdir d2/d61/dc1/d126/d12c 0 2023-12-08T20:28:26.209 INFO:tasks.workunit.client.0.smithi043.stdout:0/931: chown d2/d3/d18/d2b/da5/d3f/cac 5341703 1 2023-12-08T20:28:26.210 INFO:tasks.workunit.client.0.smithi043.stdout:4/699: rename d1/c46 to d1/d14/d25/d39/d3d/d40/cf1 0 2023-12-08T20:28:26.211 INFO:tasks.workunit.client.0.smithi043.stdout:0/932: creat d2/d3/d18/d1e/f12d x:0 0 0 2023-12-08T20:28:26.213 INFO:tasks.workunit.client.0.smithi043.stdout:0/933: truncate d2/d3/d18/d1e/d53/d7d/fbb 1272997 0 2023-12-08T20:28:26.216 INFO:tasks.workunit.client.0.smithi043.stdout:0/934: mkdir d2/d3/d18/d1e/d53/d10b/d39/d63/da6/dae/d105/d12e 0 2023-12-08T20:28:26.216 INFO:tasks.workunit.client.0.smithi043.stdout:0/935: write d2/d61/dc1/fe3 [186689,71730] 0 2023-12-08T20:28:26.218 INFO:tasks.workunit.client.0.smithi043.stdout:5/676: rename d3/d7/f13 to d3/d7/d19/d3f/d52/fce 0 2023-12-08T20:28:26.218 INFO:tasks.workunit.client.0.smithi043.stdout:5/677: readlink d3/d7/d19/d3f/l8f 0 2023-12-08T20:28:26.219 INFO:tasks.workunit.client.0.smithi043.stdout:5/678: mkdir d3/d7/d21/d51/d5c/da7/dcf 0 2023-12-08T20:28:26.219 INFO:tasks.workunit.client.0.smithi043.stdout:0/936: mknod d2/d3/d18/d1e/d53/d10b/d39/d63/da6/c12f 0 2023-12-08T20:28:26.219 INFO:tasks.workunit.client.0.smithi043.stdout:0/937: fdatasync d2/d61/ffa 0 2023-12-08T20:28:26.219 INFO:tasks.workunit.client.0.smithi043.stdout:1/754: dwrite d1/d16/d30/d4f/fd8 [0,4194304] 0 2023-12-08T20:28:26.219 INFO:tasks.workunit.client.0.smithi043.stdout:0/938: chown d2/d3/d18/d2b/da5/da3/fe9 178 1 2023-12-08T20:28:26.220 INFO:tasks.workunit.client.0.smithi043.stdout:4/700: dread d1/d14/d25/d39/d3f/d3c/d41/db6/fb9 [0,4194304] 0 2023-12-08T20:28:26.222 INFO:tasks.workunit.client.0.smithi043.stdout:0/939: mknod d2/d61/d67/c130 0 2023-12-08T20:28:26.223 INFO:tasks.workunit.client.0.smithi043.stdout:4/701: write d1/d14/d25/d39/d3d/d40/d67/fa2 [227617,96218] 0 2023-12-08T20:28:26.224 INFO:tasks.workunit.client.0.smithi043.stdout:1/755: symlink d1/d16/d30/l111 0 2023-12-08T20:28:26.229 INFO:tasks.workunit.client.0.smithi043.stdout:0/940: rmdir d2/d3/d18/d1e/d53/d10b/d39/d83/d9d 39 2023-12-08T20:28:26.231 INFO:tasks.workunit.client.0.smithi043.stdout:4/702: dread d1/d14/d1d/d58/f62 [0,4194304] 0 2023-12-08T20:28:26.235 INFO:tasks.workunit.client.0.smithi043.stdout:1/756: mkdir d1/d16/d30/d6e/d83/d112 0 2023-12-08T20:28:26.235 INFO:tasks.workunit.client.0.smithi043.stdout:1/757: write d1/d6/f29 [1800470,33071] 0 2023-12-08T20:28:26.236 INFO:tasks.workunit.client.0.smithi043.stdout:0/941: truncate d2/d4/f66 4243831 0 2023-12-08T20:28:26.243 INFO:tasks.workunit.client.0.smithi043.stdout:1/758: dread d1/d16/d21/d25/d35/f62 [0,4194304] 0 2023-12-08T20:28:26.247 INFO:tasks.workunit.client.0.smithi043.stdout:5/679: dwrite d3/d32/f47 [0,4194304] 0 2023-12-08T20:28:26.253 INFO:tasks.workunit.client.0.smithi043.stdout:5/680: rename d3/d7/d19/c76 to d3/d7/de/d43/cd0 0 2023-12-08T20:28:26.253 INFO:tasks.workunit.client.0.smithi043.stdout:5/681: chown d3/d7/d21/d51/la2 0 1 2023-12-08T20:28:26.253 INFO:tasks.workunit.client.0.smithi043.stdout:5/682: read - d3/d7/d29/f77 zero size 2023-12-08T20:28:26.255 INFO:tasks.workunit.client.0.smithi043.stdout:5/683: creat d3/d7/d21/d72/fd1 x:0 0 0 2023-12-08T20:28:26.257 INFO:tasks.workunit.client.0.smithi043.stdout:4/703: dwrite d1/d14/d1d/f4b [4194304,4194304] 0 2023-12-08T20:28:26.258 INFO:tasks.workunit.client.0.smithi043.stdout:5/684: creat d3/d7/d21/fd2 x:0 0 0 2023-12-08T20:28:26.258 INFO:tasks.workunit.client.0.smithi043.stdout:5/685: truncate d3/d7/d21/d51/fc9 876350 0 2023-12-08T20:28:26.261 INFO:tasks.workunit.client.0.smithi043.stdout:4/704: rename d1/d14/d25/d39/db1/cb2 to d1/d14/d25/d77/da4/dc0/def/cf2 0 2023-12-08T20:28:26.261 INFO:tasks.workunit.client.0.smithi043.stdout:4/705: readlink d1/d14/d25/d39/d3f/d3c/d41/dab/lba 0 2023-12-08T20:28:26.264 INFO:tasks.workunit.client.0.smithi043.stdout:0/942: dwrite d2/d3/d18/d1e/d53/d10b/d39/d83/f128 [0,4194304] 0 2023-12-08T20:28:26.269 INFO:tasks.workunit.client.0.smithi043.stdout:5/686: mknod d3/d78/cd3 0 2023-12-08T20:28:26.269 INFO:tasks.workunit.client.0.smithi043.stdout:5/687: readlink d3/d7/d21/l6b 0 2023-12-08T20:28:26.269 INFO:tasks.workunit.client.0.smithi043.stdout:0/943: symlink d2/d3/d18/d1e/d53/d10b/d39/d83/l131 0 2023-12-08T20:28:26.269 INFO:tasks.workunit.client.0.smithi043.stdout:0/944: dread - d2/d3/d18/d1e/d53/d10b/d39/d83/f10f zero size 2023-12-08T20:28:26.274 INFO:tasks.workunit.client.0.smithi043.stdout:1/759: dwrite d1/d16/d21/f51 [0,4194304] 0 2023-12-08T20:28:26.274 INFO:tasks.workunit.client.0.smithi043.stdout:5/688: mkdir d3/d7/dd4 0 2023-12-08T20:28:26.274 INFO:tasks.workunit.client.0.smithi043.stdout:5/689: chown d3/d7/de/d82/d8b/f93 52953 1 2023-12-08T20:28:26.274 INFO:tasks.workunit.client.0.smithi043.stdout:5/690: stat d3/d32 0 2023-12-08T20:28:26.274 INFO:tasks.workunit.client.0.smithi043.stdout:5/691: mknod d3/d7/de/cd5 0 2023-12-08T20:28:26.274 INFO:tasks.workunit.client.0.smithi043.stdout:5/692: readlink d3/l85 0 2023-12-08T20:28:26.278 INFO:tasks.workunit.client.0.smithi043.stdout:4/706: dwrite d1/d14/d25/d39/dd6/fe6 [4194304,4194304] 0 2023-12-08T20:28:26.280 INFO:tasks.workunit.client.0.smithi043.stdout:4/707: rmdir d1/d14/d25/d39/da3/dae 39 2023-12-08T20:28:26.284 INFO:tasks.workunit.client.0.smithi043.stdout:4/708: dread d1/d14/d25/d39/fd4 [0,4194304] 0 2023-12-08T20:28:26.285 INFO:tasks.workunit.client.0.smithi043.stdout:4/709: fsync d1/d14/d1d/d58/f62 0 2023-12-08T20:28:26.286 INFO:tasks.workunit.client.0.smithi043.stdout:4/710: read d1/d14/d1d/d58/fc4 [634485,28023] 0 2023-12-08T20:28:26.287 INFO:tasks.workunit.client.0.smithi043.stdout:4/711: creat d1/d14/d25/d39/d3d/d40/d67/d7f/ff3 x:0 0 0 2023-12-08T20:28:26.288 INFO:tasks.workunit.client.0.smithi043.stdout:4/712: rmdir d1/d14/d25/d39/d3f/d3c/d41 39 2023-12-08T20:28:26.292 INFO:tasks.workunit.client.0.smithi043.stdout:4/713: rename d1/c7 to d1/d14/d25/d39/d3f/d3c/d41/db6/cf4 0 2023-12-08T20:28:26.316 INFO:tasks.workunit.client.0.smithi043.stdout:1/760: dwrite d1/d6/d63/fe4 [0,4194304] 0 2023-12-08T20:28:26.317 INFO:tasks.workunit.client.0.smithi043.stdout:5/693: dwrite d3/d7/d21/d72/fd1 [0,4194304] 0 2023-12-08T20:28:26.317 INFO:tasks.workunit.client.0.smithi043.stdout:5/694: chown d3/d7/d19/d3f/ccb 4 1 2023-12-08T20:28:26.317 INFO:tasks.workunit.client.0.smithi043.stdout:0/945: dwrite d2/d3/d18/d1e/d53/d10b/d39/d83/d9d/faf [0,4194304] 0 2023-12-08T20:28:26.317 INFO:tasks.workunit.client.0.smithi043.stdout:4/714: dwrite d1/f5f [0,4194304] 0 2023-12-08T20:28:26.318 INFO:tasks.workunit.client.0.smithi043.stdout:1/761: symlink d1/d16/d21/d25/d3e/d77/d106/l113 0 2023-12-08T20:28:26.320 INFO:tasks.workunit.client.0.smithi043.stdout:4/715: symlink d1/d14/d25/d39/d3d/d40/d67/d7f/lf5 0 2023-12-08T20:28:26.322 INFO:tasks.workunit.client.0.smithi043.stdout:4/716: link d1/d14/d25/d39/f71 d1/d14/d25/d39/d3d/d40/ff6 0 2023-12-08T20:28:26.324 INFO:tasks.workunit.client.0.smithi043.stdout:0/946: rename d2/d61/dc0/fd3 to d2/d3/d18/d2b/da5/d5f/df0/f132 0 2023-12-08T20:28:26.324 INFO:tasks.workunit.client.0.smithi043.stdout:0/947: fdatasync d2/d3/d18/d1e/d53/d7d/f93 0 2023-12-08T20:28:26.324 INFO:tasks.workunit.client.0.smithi043.stdout:4/717: creat d1/d14/d25/d77/ff7 x:0 0 0 2023-12-08T20:28:26.324 INFO:tasks.workunit.client.0.smithi043.stdout:4/718: dread - d1/d14/d25/d77/ff7 zero size 2023-12-08T20:28:26.324 INFO:tasks.workunit.client.0.smithi043.stdout:4/719: fsync d1/d14/d25/f2c 0 2023-12-08T20:28:26.326 INFO:tasks.workunit.client.0.smithi043.stdout:4/720: creat d1/d14/d25/d39/da3/ff8 x:0 0 0 2023-12-08T20:28:26.329 INFO:tasks.workunit.client.0.smithi043.stdout:1/762: link d1/d16/d30/ccf d1/d16/d21/d25/d3e/d77/d106/c114 0 2023-12-08T20:28:26.329 INFO:tasks.workunit.client.0.smithi043.stdout:1/763: write d1/d16/d1c/d71/fc7 [1180353,16466] 0 2023-12-08T20:28:26.334 INFO:tasks.workunit.client.0.smithi043.stdout:1/764: dread d1/d16/d21/d25/d35/f9d [0,4194304] 0 2023-12-08T20:28:26.334 INFO:tasks.workunit.client.0.smithi043.stdout:1/765: truncate d1/d6/d63/fea 424993 0 2023-12-08T20:28:26.334 INFO:tasks.workunit.client.0.smithi043.stdout:0/948: symlink d2/d3/d18/d1e/d53/d10b/d39/d83/l133 0 2023-12-08T20:28:26.335 INFO:tasks.workunit.client.0.smithi043.stdout:0/949: chown d2/d3/d18/d1e/d53/d10b/d39/d63/cc6 1385577391 1 2023-12-08T20:28:26.335 INFO:tasks.workunit.client.0.smithi043.stdout:0/950: write d2/d3/d18/d1e/d88/f104 [977258,28703] 0 2023-12-08T20:28:26.338 INFO:tasks.workunit.client.0.smithi043.stdout:1/766: mknod d1/db1/c115 0 2023-12-08T20:28:26.339 INFO:tasks.workunit.client.0.smithi043.stdout:0/951: link d2/d61/fce d2/d61/d67/f134 0 2023-12-08T20:28:26.339 INFO:tasks.workunit.client.0.smithi043.stdout:0/952: stat d2/d3/d18/d2b/da5/f69 0 2023-12-08T20:28:26.359 INFO:tasks.workunit.client.0.smithi043.stdout:5/695: dwrite d3/d7/de/f24 [0,4194304] 0 2023-12-08T20:28:26.359 INFO:tasks.workunit.client.0.smithi043.stdout:5/696: readlink d3/l85 0 2023-12-08T20:28:26.359 INFO:tasks.workunit.client.0.smithi043.stdout:5/697: stat d3/d7/d19/d3f/ccb 0 2023-12-08T20:28:26.361 INFO:tasks.workunit.client.0.smithi043.stdout:5/698: mkdir d3/d73/d83/dd6 0 2023-12-08T20:28:26.362 INFO:tasks.workunit.client.0.smithi043.stdout:1/767: mkdir d1/d16/d21/d6f/d116 0 2023-12-08T20:28:26.366 INFO:tasks.workunit.client.0.smithi043.stdout:5/699: dread d3/d7/de/f18 [8388608,4194304] 0 2023-12-08T20:28:26.368 INFO:tasks.workunit.client.0.smithi043.stdout:5/700: truncate d3/d7/d21/f4d 513453 0 2023-12-08T20:28:26.369 INFO:tasks.workunit.client.0.smithi043.stdout:5/701: write d3/f6e [441082,40157] 0 2023-12-08T20:28:26.373 INFO:tasks.workunit.client.0.smithi043.stdout:1/768: mknod d1/d16/d86/c117 0 2023-12-08T20:28:26.395 INFO:tasks.workunit.client.0.smithi043.stdout:5/702: dwrite d3/d7/de/f18 [4194304,4194304] 0 2023-12-08T20:28:26.398 INFO:tasks.workunit.client.0.smithi043.stdout:1/769: dwrite d1/d16/d21/d25/d3e/d77/d9f/dc3/d110/dad/fae [0,4194304] 0 2023-12-08T20:28:26.398 INFO:tasks.workunit.client.0.smithi043.stdout:1/770: write d1/d16/f105 [793101,43964] 0 2023-12-08T20:28:26.405 INFO:tasks.workunit.client.0.smithi043.stdout:1/771: creat d1/d16/d21/d6f/daa/f118 x:0 0 0 2023-12-08T20:28:26.408 INFO:tasks.workunit.client.0.smithi043.stdout:1/772: mkdir d1/d16/d30/d6e/d83/d112/d119 0 2023-12-08T20:28:26.408 INFO:tasks.workunit.client.0.smithi043.stdout:1/773: chown d1/d16/d21/c4b 165 1 2023-12-08T20:28:26.418 INFO:tasks.workunit.client.0.smithi043.stdout:1/774: dread d1/d16/d48/f4a [0,4194304] 0 2023-12-08T20:28:26.421 INFO:tasks.workunit.client.0.smithi043.stdout:1/775: symlink d1/d16/d7e/l11a 0 2023-12-08T20:28:26.423 INFO:tasks.workunit.client.0.smithi043.stdout:8/856: sync 2023-12-08T20:28:26.425 INFO:tasks.workunit.client.0.smithi043.stdout:1/776: link d1/d16/d48/l5d d1/d16/d21/d25/d3e/df8/l11b 0 2023-12-08T20:28:26.426 INFO:tasks.workunit.client.0.smithi043.stdout:8/857: unlink d2/d20/d7d/c43 0 2023-12-08T20:28:26.427 INFO:tasks.workunit.client.0.smithi043.stdout:8/858: write d2/d20/d7d/d37/d5a/f63 [886911,82454] 0 2023-12-08T20:28:26.427 INFO:tasks.workunit.client.0.smithi043.stdout:8/859: stat d2/d20/d7d/d29/d30/d7c/daa 0 2023-12-08T20:28:26.428 INFO:tasks.workunit.client.0.smithi043.stdout:1/777: symlink d1/d16/d1c/d71/l11c 0 2023-12-08T20:28:26.428 INFO:tasks.workunit.client.0.smithi043.stdout:1/778: stat d1/d16/d21/d25 0 2023-12-08T20:28:26.431 INFO:tasks.workunit.client.0.smithi043.stdout:1/779: creat d1/d16/d86/f11d x:0 0 0 2023-12-08T20:28:26.436 INFO:tasks.workunit.client.0.smithi043.stdout:8/860: dread d2/d6f/f82 [0,4194304] 0 2023-12-08T20:28:26.436 INFO:tasks.workunit.client.0.smithi043.stdout:8/861: readlink d2/d20/d7d/d37/lfd 0 2023-12-08T20:28:26.438 INFO:tasks.workunit.client.0.smithi043.stdout:8/862: mkdir d2/d27/d2d/d31/d74/d11c 0 2023-12-08T20:28:26.439 INFO:tasks.workunit.client.0.smithi043.stdout:1/780: rename d1/d16/d30/d4f/l9b to d1/d16/d21/d25/d3e/d77/d9f/l11e 0 2023-12-08T20:28:26.440 INFO:tasks.workunit.client.0.smithi043.stdout:8/863: truncate d2/d20/d7d/d29/d30/f41 5573444 0 2023-12-08T20:28:26.456 INFO:tasks.workunit.client.0.smithi043.stdout:8/864: dwrite d2/d27/dab/fda [0,4194304] 0 2023-12-08T20:28:26.471 INFO:tasks.workunit.client.0.smithi043.stdout:8/865: dwrite d2/f101 [0,4194304] 0 2023-12-08T20:28:26.471 INFO:tasks.workunit.client.0.smithi043.stdout:8/866: write d2/d27/d2d/ff0 [1022185,31497] 0 2023-12-08T20:28:26.471 INFO:tasks.workunit.client.0.smithi043.stdout:8/867: fsync d2/d20/f2c 0 2023-12-08T20:28:26.488 INFO:tasks.workunit.client.0.smithi043.stdout:2/956: sync 2023-12-08T20:28:26.496 INFO:tasks.workunit.client.0.smithi043.stdout:2/957: dread d0/d26/f45 [0,4194304] 0 2023-12-08T20:28:26.498 INFO:tasks.workunit.client.0.smithi043.stdout:2/958: mknod d0/d26/c131 0 2023-12-08T20:28:26.498 INFO:tasks.workunit.client.0.smithi043.stdout:2/959: chown d0/db/d18/d3d/f50 1356 1 2023-12-08T20:28:26.498 INFO:tasks.workunit.client.0.smithi043.stdout:2/960: stat d0/d26/f98 0 2023-12-08T20:28:26.498 INFO:tasks.workunit.client.0.smithi043.stdout:3/757: sync 2023-12-08T20:28:26.498 INFO:tasks.workunit.client.0.smithi043.stdout:7/773: sync 2023-12-08T20:28:26.498 INFO:tasks.workunit.client.0.smithi043.stdout:9/755: sync 2023-12-08T20:28:26.498 INFO:tasks.workunit.client.0.smithi043.stdout:6/687: sync 2023-12-08T20:28:26.498 INFO:tasks.workunit.client.0.smithi043.stdout:3/758: chown d1/d9 0 1 2023-12-08T20:28:26.498 INFO:tasks.workunit.client.0.smithi043.stdout:7/774: write d0/d2/d65/d99/d47/f6c [1644357,24442] 0 2023-12-08T20:28:26.499 INFO:tasks.workunit.client.0.smithi043.stdout:9/756: write d0/d3d/d4b/d5c/fd5 [816376,114993] 0 2023-12-08T20:28:26.499 INFO:tasks.workunit.client.0.smithi043.stdout:2/961: read d0/d26/f34 [7830542,12622] 0 2023-12-08T20:28:26.499 INFO:tasks.workunit.client.0.smithi043.stdout:3/759: getdents d1/d9/d38/d4f 0 2023-12-08T20:28:26.500 INFO:tasks.workunit.client.0.smithi043.stdout:6/688: creat d0/ddc/fef x:0 0 0 2023-12-08T20:28:26.500 INFO:tasks.workunit.client.0.smithi043.stdout:6/689: truncate d0/d2/d14/d2c/d66/f9d 919961 0 2023-12-08T20:28:26.500 INFO:tasks.workunit.client.0.smithi043.stdout:7/775: rename d0/d2/f8e to d0/d69/d6d/ffa 0 2023-12-08T20:28:26.501 INFO:tasks.workunit.client.0.smithi043.stdout:2/962: truncate d0/f24 1278924 0 2023-12-08T20:28:26.501 INFO:tasks.workunit.client.0.smithi043.stdout:2/963: fdatasync d0/db/fa5 0 2023-12-08T20:28:26.501 INFO:tasks.workunit.client.0.smithi043.stdout:9/757: mkdir d0/d3d/d8c/df8 0 2023-12-08T20:28:26.502 INFO:tasks.workunit.client.0.smithi043.stdout:3/760: mkdir d1/d9/d2d/d66/dca/dd4/df4 0 2023-12-08T20:28:26.503 INFO:tasks.workunit.client.0.smithi043.stdout:7/776: getdents d0/d5b 0 2023-12-08T20:28:26.504 INFO:tasks.workunit.client.0.smithi043.stdout:9/758: creat d0/d21/dc1/ff9 x:0 0 0 2023-12-08T20:28:26.504 INFO:tasks.workunit.client.0.smithi043.stdout:3/761: write d1/d9/d2d/fa9 [2049565,67982] 0 2023-12-08T20:28:26.504 INFO:tasks.workunit.client.0.smithi043.stdout:7/777: symlink d0/lfb 0 2023-12-08T20:28:26.506 INFO:tasks.workunit.client.0.smithi043.stdout:3/762: mkdir d1/d9/df5 0 2023-12-08T20:28:26.507 INFO:tasks.workunit.client.0.smithi043.stdout:7/778: rename d0/fbb to d0/d2/d65/d99/d47/dd6/ffc 0 2023-12-08T20:28:26.508 INFO:tasks.workunit.client.0.smithi043.stdout:6/690: rmdir d0/d2/d14 39 2023-12-08T20:28:26.509 INFO:tasks.workunit.client.0.smithi043.stdout:7/779: mkdir d0/d69/d6d/dfd 0 2023-12-08T20:28:26.512 INFO:tasks.workunit.client.0.smithi043.stdout:6/691: rename d0/d2/d14/d20/d49/c76 to d0/d2/d14/d2c/d22/d2a/db2/dba/dde/cf0 0 2023-12-08T20:28:26.513 INFO:tasks.workunit.client.0.smithi043.stdout:6/692: write d0/d2/d14/d2c/d22/d2a/db2/dba/fe0 [19397,92162] 0 2023-12-08T20:28:26.516 INFO:tasks.workunit.client.0.smithi043.stdout:3/763: dread d1/d9/d2d/d66/f98 [0,4194304] 0 2023-12-08T20:28:26.518 INFO:tasks.workunit.client.0.smithi043.stdout:3/764: write d1/d9/f4e [1880447,58911] 0 2023-12-08T20:28:26.520 INFO:tasks.workunit.client.0.smithi043.stdout:6/693: getdents d0/d2/d14/d2c/d22/d3f/d45/d69 0 2023-12-08T20:28:26.521 INFO:tasks.workunit.client.0.smithi043.stdout:9/759: dread d0/d5e/f3c [0,4194304] 0 2023-12-08T20:28:26.521 INFO:tasks.workunit.client.0.smithi043.stdout:9/760: chown d0/d21/f26 3791 1 2023-12-08T20:28:26.521 INFO:tasks.workunit.client.0.smithi043.stdout:3/765: getdents d1/d1c/d2c 0 2023-12-08T20:28:26.524 INFO:tasks.workunit.client.0.smithi043.stdout:6/694: write d0/d2/d92/feb [2135555,97785] 0 2023-12-08T20:28:26.526 INFO:tasks.workunit.client.0.smithi043.stdout:7/780: dwrite d0/d2/d65/fe5 [0,4194304] 0 2023-12-08T20:28:26.526 INFO:tasks.workunit.client.0.smithi043.stdout:7/781: read d0/d2/d12/fcd [536849,73655] 0 2023-12-08T20:28:26.527 INFO:tasks.workunit.client.0.smithi043.stdout:7/782: dread - d0/d5b/fa6 zero size 2023-12-08T20:28:26.527 INFO:tasks.workunit.client.0.smithi043.stdout:3/766: mkdir d1/d25/d2a/df6 0 2023-12-08T20:28:26.527 INFO:tasks.workunit.client.0.smithi043.stdout:3/767: fdatasync d1/d1c/d2c/fd3 0 2023-12-08T20:28:26.527 INFO:tasks.workunit.client.0.smithi043.stdout:3/768: chown d1/d1c/d29/fa5 84182300 1 2023-12-08T20:28:26.528 INFO:tasks.workunit.client.0.smithi043.stdout:2/964: dwrite d0/db/d18/d3d/fb3 [0,4194304] 0 2023-12-08T20:28:26.530 INFO:tasks.workunit.client.0.smithi043.stdout:3/769: mknod d1/d9/d38/d4a/dbd/cf7 0 2023-12-08T20:28:26.536 INFO:tasks.workunit.client.0.smithi043.stdout:7/783: unlink d0/d2/d65/d99/d47/dd6/ffc 0 2023-12-08T20:28:26.538 INFO:tasks.workunit.client.0.smithi043.stdout:7/784: link d0/d6/d17/fe0 d0/d2/d65/d83/ffe 0 2023-12-08T20:28:26.546 INFO:tasks.workunit.client.0.smithi043.stdout:6/695: rename d0/d2/d14/d2c to d0/d2/d14/db3/df1 0 2023-12-08T20:28:26.547 INFO:tasks.workunit.client.0.smithi043.stdout:2/965: dwrite d0/db/d18/d8b/fb0 [0,4194304] 0 2023-12-08T20:28:26.548 INFO:tasks.workunit.client.0.smithi043.stdout:2/966: write d0/db/d18/f4b [4261896,102732] 0 2023-12-08T20:28:26.548 INFO:tasks.workunit.client.0.smithi043.stdout:7/785: rename d0/d5b/c66 to d0/d2/d65/cff 0 2023-12-08T20:28:26.548 INFO:tasks.workunit.client.0.smithi043.stdout:7/786: chown d0/d6/d17/d54/c68 0 1 2023-12-08T20:28:26.549 INFO:tasks.workunit.client.0.smithi043.stdout:3/770: dwrite d1/d9/df/f62 [0,4194304] 0 2023-12-08T20:28:26.550 INFO:tasks.workunit.client.0.smithi043.stdout:6/696: creat d0/d2/d14/db3/df1/d22/d3f/ff2 x:0 0 0 2023-12-08T20:28:26.551 INFO:tasks.workunit.client.0.smithi043.stdout:6/697: write d0/d2/d14/db3/df1/d22/d3f/d45/d69/fb6 [859508,28345] 0 2023-12-08T20:28:26.551 INFO:tasks.workunit.client.0.smithi043.stdout:3/771: getdents d1/d9/d2d/d42 0 2023-12-08T20:28:26.553 INFO:tasks.workunit.client.0.smithi043.stdout:3/772: write d1/d1c/d29/f57 [3183647,26876] 0 2023-12-08T20:28:26.553 INFO:tasks.workunit.client.0.smithi043.stdout:3/773: fdatasync d1/d1c/d29/f7e 0 2023-12-08T20:28:26.555 INFO:tasks.workunit.client.0.smithi043.stdout:2/967: getdents d0/db/d18/d8b/da2/d12e 0 2023-12-08T20:28:26.555 INFO:tasks.workunit.client.0.smithi043.stdout:3/774: rename d1/d25/dc1/cc5 to d1/d9/d2d/d66/dca/dd4/df4/cf8 0 2023-12-08T20:28:26.556 INFO:tasks.workunit.client.0.smithi043.stdout:2/968: dread d0/d26/dbc/d38/dae/f127 [0,4194304] 0 2023-12-08T20:28:26.558 INFO:tasks.workunit.client.0.smithi043.stdout:3/775: mkdir d1/d9/d2d/d91/da7/df9 0 2023-12-08T20:28:26.559 INFO:tasks.workunit.client.0.smithi043.stdout:2/969: unlink d0/db/d18/d8b/da2/d12e/d117/dfd/dff/d11e/f122 0 2023-12-08T20:28:26.559 INFO:tasks.workunit.client.0.smithi043.stdout:2/970: truncate d0/d20/f32 4584868 0 2023-12-08T20:28:26.561 INFO:tasks.workunit.client.0.smithi043.stdout:7/787: getdents d0/d2/d65/d83 0 2023-12-08T20:28:26.561 INFO:tasks.workunit.client.0.smithi043.stdout:3/776: rmdir d1/d9/d38/d4a/df0 0 2023-12-08T20:28:26.565 INFO:tasks.workunit.client.0.smithi043.stdout:3/777: rename d1/d25/c1d to d1/d1c/d2c/cfa 0 2023-12-08T20:28:26.565 INFO:tasks.workunit.client.0.smithi043.stdout:3/778: chown d1/d9/d2d/d42/c51 2266 1 2023-12-08T20:28:26.566 INFO:tasks.workunit.client.0.smithi043.stdout:7/788: dread d0/d6/f1a [0,4194304] 0 2023-12-08T20:28:26.566 INFO:tasks.workunit.client.0.smithi043.stdout:7/789: truncate d0/d2/d12/da2/fd3 662543 0 2023-12-08T20:28:26.566 INFO:tasks.workunit.client.0.smithi043.stdout:7/790: chown d0/d2/d65/cff 63212194 1 2023-12-08T20:28:26.567 INFO:tasks.workunit.client.0.smithi043.stdout:7/791: mknod d0/d2/d65/d99/d47/dd6/c100 0 2023-12-08T20:28:26.567 INFO:tasks.workunit.client.0.smithi043.stdout:7/792: read - d0/d6/d17/d54/fc3 zero size 2023-12-08T20:28:26.568 INFO:tasks.workunit.client.0.smithi043.stdout:7/793: mkdir d0/d2/d65/d99/d47/dd6/d101 0 2023-12-08T20:28:26.568 INFO:tasks.workunit.client.0.smithi043.stdout:7/794: mkdir d0/d2/d65/d99/d47/dd6/dd8/d102 0 2023-12-08T20:28:26.569 INFO:tasks.workunit.client.0.smithi043.stdout:7/795: creat d0/d2/f103 x:0 0 0 2023-12-08T20:28:26.569 INFO:tasks.workunit.client.0.smithi043.stdout:7/796: dread - d0/d2/f103 zero size 2023-12-08T20:28:26.569 INFO:tasks.workunit.client.0.smithi043.stdout:3/779: mkdir d1/d1c/d2c/d5f/dfb 0 2023-12-08T20:28:26.573 INFO:tasks.workunit.client.0.smithi043.stdout:3/780: read d1/d9/d2d/d42/fe5 [1771860,125478] 0 2023-12-08T20:28:26.573 INFO:tasks.workunit.client.0.smithi043.stdout:3/781: truncate d1/d1c/d29/f57 2503193 0 2023-12-08T20:28:26.578 INFO:tasks.workunit.client.0.smithi043.stdout:3/782: link d1/d1c/d8b/lb0 d1/d9/d2d/d91/lfc 0 2023-12-08T20:28:26.578 INFO:tasks.workunit.client.0.smithi043.stdout:6/698: dwrite d0/d2/d14/d8/d47/f80 [0,4194304] 0 2023-12-08T20:28:26.583 INFO:tasks.workunit.client.0.smithi043.stdout:3/783: dread d1/d9/f48 [0,4194304] 0 2023-12-08T20:28:26.584 INFO:tasks.workunit.client.0.smithi043.stdout:2/971: dwrite d0/db/d18/d66/f77 [0,4194304] 0 2023-12-08T20:28:26.584 INFO:tasks.workunit.client.0.smithi043.stdout:7/797: dread d0/d2/d65/d99/d47/f77 [0,4194304] 0 2023-12-08T20:28:26.590 INFO:tasks.workunit.client.0.smithi043.stdout:6/699: dwrite d0/d2/d14/db3/df1/d22/d3f/d45/d6b/f8a [0,4194304] 0 2023-12-08T20:28:26.593 INFO:tasks.workunit.client.0.smithi043.stdout:3/784: dread d1/d9/d38/d4f/f79 [0,4194304] 0 2023-12-08T20:28:26.594 INFO:tasks.workunit.client.0.smithi043.stdout:3/785: creat d1/d1c/d2c/ffd x:0 0 0 2023-12-08T20:28:26.596 INFO:tasks.workunit.client.0.smithi043.stdout:6/700: unlink d0/d2/d14/d20/la0 0 2023-12-08T20:28:26.598 INFO:tasks.workunit.client.0.smithi043.stdout:3/786: write d1/d9/d38/d33/f68 [1035625,57028] 0 2023-12-08T20:28:26.598 INFO:tasks.workunit.client.0.smithi043.stdout:3/787: dread - d1/d9/d2d/d91/fc8 zero size 2023-12-08T20:28:26.599 INFO:tasks.workunit.client.0.smithi043.stdout:6/701: unlink d0/d2/d14/db3/df1/d22/d3f/c41 0 2023-12-08T20:28:26.600 INFO:tasks.workunit.client.0.smithi043.stdout:2/972: dwrite d0/db/d18/d8b/db4/fb5 [0,4194304] 0 2023-12-08T20:28:26.603 INFO:tasks.workunit.client.0.smithi043.stdout:6/702: write d0/d2/d14/d20/d3c/d6c/fb0 [2672512,122094] 0 2023-12-08T20:28:26.606 INFO:tasks.workunit.client.0.smithi043.stdout:2/973: mknod d0/d20/c132 0 2023-12-08T20:28:26.606 INFO:tasks.workunit.client.0.smithi043.stdout:2/974: fsync d0/db/d18/f4b 0 2023-12-08T20:28:26.606 INFO:tasks.workunit.client.0.smithi043.stdout:2/975: write d0/db/d18/d8b/fe4 [5447,372] 0 2023-12-08T20:28:26.607 INFO:tasks.workunit.client.0.smithi043.stdout:2/976: chown d0/d20/d42/d49/ce1 24496021 1 2023-12-08T20:28:26.610 INFO:tasks.workunit.client.0.smithi043.stdout:6/703: rename d0/d2/de/d4a/d56/l95 to d0/d2/d14/d20/d3c/lf3 0 2023-12-08T20:28:26.611 INFO:tasks.workunit.client.0.smithi043.stdout:3/788: dwrite d1/d9/d38/d4f/f79 [0,4194304] 0 2023-12-08T20:28:26.612 INFO:tasks.workunit.client.0.smithi043.stdout:3/789: rmdir d1/d25/d2a/d45 39 2023-12-08T20:28:26.613 INFO:tasks.workunit.client.0.smithi043.stdout:2/977: rename d0/fce to d0/d26/da7/f133 0 2023-12-08T20:28:26.615 INFO:tasks.workunit.client.0.smithi043.stdout:6/704: getdents d0 0 2023-12-08T20:28:26.617 INFO:tasks.workunit.client.0.smithi043.stdout:3/790: write d1/d9/d2d/fa9 [361616,20992] 0 2023-12-08T20:28:26.617 INFO:tasks.workunit.client.0.smithi043.stdout:3/791: chown d1/d9/d2d/d42/f95 1236953264 1 2023-12-08T20:28:26.617 INFO:tasks.workunit.client.0.smithi043.stdout:6/705: creat d0/d2/de/ff4 x:0 0 0 2023-12-08T20:28:26.618 INFO:tasks.workunit.client.0.smithi043.stdout:6/706: symlink d0/d2/d14/d20/d3c/d6c/lf5 0 2023-12-08T20:28:26.618 INFO:tasks.workunit.client.0.smithi043.stdout:3/792: rename d1/d9/d2d/d66/dca/dd4/fe0 to d1/d25/d2a/df6/ffe 0 2023-12-08T20:28:26.619 INFO:tasks.workunit.client.0.smithi043.stdout:6/707: mknod d0/d2/d14/d20/dc0/cf6 0 2023-12-08T20:28:26.619 INFO:tasks.workunit.client.0.smithi043.stdout:6/708: write d0/d2/d14/d20/d3c/d6c/fb0 [3442476,111387] 0 2023-12-08T20:28:26.619 INFO:tasks.workunit.client.0.smithi043.stdout:6/709: read d0/d2/fa6 [747190,48782] 0 2023-12-08T20:28:26.620 INFO:tasks.workunit.client.0.smithi043.stdout:6/710: getdents d0/d2/d14/d8/d47 0 2023-12-08T20:28:26.623 INFO:tasks.workunit.client.0.smithi043.stdout:2/978: dread d0/d26/dbc/ff0 [0,4194304] 0 2023-12-08T20:28:26.623 INFO:tasks.workunit.client.0.smithi043.stdout:2/979: readlink d0/d26/l30 0 2023-12-08T20:28:26.623 INFO:tasks.workunit.client.0.smithi043.stdout:6/711: rename d0/d2/d14/db3/df1/d22/d3f/d45/d6b to d0/d2/d14/d20/d3c/df7 0 2023-12-08T20:28:26.624 INFO:tasks.workunit.client.0.smithi043.stdout:2/980: symlink d0/d81/l134 0 2023-12-08T20:28:26.626 INFO:tasks.workunit.client.0.smithi043.stdout:3/793: dread d1/f50 [0,4194304] 0 2023-12-08T20:28:26.626 INFO:tasks.workunit.client.0.smithi043.stdout:6/712: symlink d0/ddc/lf8 0 2023-12-08T20:28:26.627 INFO:tasks.workunit.client.0.smithi043.stdout:6/713: dread - d0/d2/d14/d20/d3c/d6c/f9e zero size 2023-12-08T20:28:26.627 INFO:tasks.workunit.client.0.smithi043.stdout:6/714: read d0/d2/de/d4a/f58 [138346,32112] 0 2023-12-08T20:28:26.628 INFO:tasks.workunit.client.0.smithi043.stdout:2/981: creat d0/db/d18/da3/f135 x:0 0 0 2023-12-08T20:28:26.629 INFO:tasks.workunit.client.0.smithi043.stdout:6/715: getdents d0/d2/d14/db3/df1/d22/d2a/db2/dba/dde 0 2023-12-08T20:28:26.630 INFO:tasks.workunit.client.0.smithi043.stdout:6/716: chown d0/d2/d14/lc 1167640075 1 2023-12-08T20:28:26.630 INFO:tasks.workunit.client.0.smithi043.stdout:6/717: write d0/dc3/fca [4623467,170] 0 2023-12-08T20:28:26.630 INFO:tasks.workunit.client.0.smithi043.stdout:6/718: chown d0/d2/d29/c89 799 1 2023-12-08T20:28:26.632 INFO:tasks.workunit.client.0.smithi043.stdout:3/794: truncate d1/d1c/d29/f5c 27501 0 2023-12-08T20:28:26.633 INFO:tasks.workunit.client.0.smithi043.stdout:6/719: symlink d0/d2/d14/db3/df1/d22/d2a/lf9 0 2023-12-08T20:28:26.633 INFO:tasks.workunit.client.0.smithi043.stdout:2/982: dread d0/d81/f8e [0,4194304] 0 2023-12-08T20:28:26.636 INFO:tasks.workunit.client.0.smithi043.stdout:3/795: rename d1/d9/d2d/d66/f98 to d1/d9/d38/d4f/d5a/fff 0 2023-12-08T20:28:26.636 INFO:tasks.workunit.client.0.smithi043.stdout:3/796: write d1/d9/df/d6e/fd2 [481999,45778] 0 2023-12-08T20:28:26.641 INFO:tasks.workunit.client.0.smithi043.stdout:6/720: creat d0/d2/d14/db3/df1/d22/d2a/db2/dba/dec/ffa x:0 0 0 2023-12-08T20:28:26.644 INFO:tasks.workunit.client.0.smithi043.stdout:6/721: creat d0/d2/de/d4a/d56/dc2/ffb x:0 0 0 2023-12-08T20:28:26.644 INFO:tasks.workunit.client.0.smithi043.stdout:6/722: chown d0/d2/d14/db3/df1/d22/fd2 124615 1 2023-12-08T20:28:26.649 INFO:tasks.workunit.client.0.smithi043.stdout:6/723: write d0/d2/d14/db3/df1/d22/d2a/f5a [707469,95109] 0 2023-12-08T20:28:26.650 INFO:tasks.workunit.client.0.smithi043.stdout:6/724: write d0/d2/d14/d8/f43 [3870271,108947] 0 2023-12-08T20:28:26.653 INFO:tasks.workunit.client.0.smithi043.stdout:6/725: getdents d0/d2/d14/d20/dc0 0 2023-12-08T20:28:26.653 INFO:tasks.workunit.client.0.smithi043.stdout:6/726: fdatasync d0/d2/d14/d8/d47/d60/f88 0 2023-12-08T20:28:26.653 INFO:tasks.workunit.client.0.smithi043.stdout:6/727: stat d0/d2/d14/db3/df1/d22 0 2023-12-08T20:28:26.656 INFO:tasks.workunit.client.0.smithi043.stdout:6/728: unlink d0/d2/d14/d20/d49/f62 0 2023-12-08T20:28:26.664 INFO:tasks.workunit.client.0.smithi043.stdout:2/983: dwrite d0/db/d18/d3d/f40 [0,4194304] 0 2023-12-08T20:28:26.665 INFO:tasks.workunit.client.0.smithi043.stdout:2/984: getdents d0/db/d18/d66/d71 0 2023-12-08T20:28:26.665 INFO:tasks.workunit.client.0.smithi043.stdout:2/985: chown d0/d26/d53/l70 279338 1 2023-12-08T20:28:26.666 INFO:tasks.workunit.client.0.smithi043.stdout:3/797: dwrite d1/d9/d38/d33/f5d [0,4194304] 0 2023-12-08T20:28:26.669 INFO:tasks.workunit.client.0.smithi043.stdout:3/798: creat d1/d9/df/ddb/f100 x:0 0 0 2023-12-08T20:28:26.670 INFO:tasks.workunit.client.0.smithi043.stdout:3/799: mkdir d1/d9/d2d/d66/dca/dd4/df4/d101 0 2023-12-08T20:28:26.676 INFO:tasks.workunit.client.0.smithi043.stdout:2/986: dread d0/f4 [0,4194304] 0 2023-12-08T20:28:26.683 INFO:tasks.workunit.client.0.smithi043.stdout:2/987: dread d0/db/fea [0,4194304] 0 2023-12-08T20:28:26.685 INFO:tasks.workunit.client.0.smithi043.stdout:2/988: symlink d0/dd4/df9/l136 0 2023-12-08T20:28:26.685 INFO:tasks.workunit.client.0.smithi043.stdout:2/989: read - d0/d81/fd8 zero size 2023-12-08T20:28:26.687 INFO:tasks.workunit.client.0.smithi043.stdout:2/990: rename d0/d26/dbc/ff0 to d0/d81/f137 0 2023-12-08T20:28:26.690 INFO:tasks.workunit.client.0.smithi043.stdout:2/991: dread d0/d20/f105 [0,4194304] 0 2023-12-08T20:28:26.690 INFO:tasks.workunit.client.0.smithi043.stdout:2/992: chown d0/db/f31 254 1 2023-12-08T20:28:26.690 INFO:tasks.workunit.client.0.smithi043.stdout:2/993: readlink d0/d20/l113 0 2023-12-08T20:28:26.692 INFO:tasks.workunit.client.0.smithi043.stdout:6/729: dwrite d0/d2/d14/db3/df1/d22/d3f/d45/d69/fb6 [4194304,4194304] 0 2023-12-08T20:28:26.692 INFO:tasks.workunit.client.0.smithi043.stdout:6/730: chown d0/d2/d14/db3/df1/d22 49895409 1 2023-12-08T20:28:26.692 INFO:tasks.workunit.client.0.smithi043.stdout:3/800: dwrite d1/d9/df/f62 [0,4194304] 0 2023-12-08T20:28:26.692 INFO:tasks.workunit.client.0.smithi043.stdout:2/994: creat d0/d2b/d4e/d93/da9/f138 x:0 0 0 2023-12-08T20:28:26.693 INFO:tasks.workunit.client.0.smithi043.stdout:3/801: symlink d1/d25/l102 0 2023-12-08T20:28:26.695 INFO:tasks.workunit.client.0.smithi043.stdout:3/802: truncate d1/d1c/d2c/d5f/fb5 1974210 0 2023-12-08T20:28:26.700 INFO:tasks.workunit.client.0.smithi043.stdout:3/803: symlink d1/d9/d2d/d66/dca/dd4/l103 0 2023-12-08T20:28:26.700 INFO:tasks.workunit.client.0.smithi043.stdout:6/731: dread d0/d2/d14/d8/d47/d60/f8d [0,4194304] 0 2023-12-08T20:28:26.701 INFO:tasks.workunit.client.0.smithi043.stdout:3/804: rename d1/d25/c16 to d1/d1c/d2c/c104 0 2023-12-08T20:28:26.702 INFO:tasks.workunit.client.0.smithi043.stdout:6/732: unlink d0/d2/d14/d8/d47/d60/f88 0 2023-12-08T20:28:26.705 INFO:tasks.workunit.client.0.smithi043.stdout:6/733: write d0/d2/d14/d20/d53/f5e [1172778,23003] 0 2023-12-08T20:28:26.705 INFO:tasks.workunit.client.0.smithi043.stdout:6/734: truncate d0/d2/d14/db3/df1/d22/d2a/db2/dba/fe0 466145 0 2023-12-08T20:28:26.705 INFO:tasks.workunit.client.0.smithi043.stdout:6/735: fdatasync d0/d2/d14/db3/df1/d22/d2a/db2/dba/fbb 0 2023-12-08T20:28:26.705 INFO:tasks.workunit.client.0.smithi043.stdout:6/736: readlink d0/d2/de/d4a/lbd 0 2023-12-08T20:28:26.705 INFO:tasks.workunit.client.0.smithi043.stdout:6/737: getdents d0 0 2023-12-08T20:28:26.705 INFO:tasks.workunit.client.0.smithi043.stdout:6/738: write d0/d2/de/d4a/de2/fea [887412,107868] 0 2023-12-08T20:28:26.707 INFO:tasks.workunit.client.0.smithi043.stdout:6/739: creat d0/d2/d14/db3/df1/d22/d3f/d45/ffc x:0 0 0 2023-12-08T20:28:26.707 INFO:tasks.workunit.client.0.smithi043.stdout:6/740: dread - d0/d2/d14/db3/df1/d22/d3f/fd4 zero size 2023-12-08T20:28:26.709 INFO:tasks.workunit.client.0.smithi043.stdout:2/995: dwrite d0/db/d18/d8b/da2/d12e/d117/f7c [0,4194304] 0 2023-12-08T20:28:26.710 INFO:tasks.workunit.client.0.smithi043.stdout:2/996: mkdir d0/db/d18/d8b/d9d/d139 0 2023-12-08T20:28:26.718 INFO:tasks.workunit.client.0.smithi043.stdout:2/997: read d0/d20/d42/d49/fda [671474,71681] 0 2023-12-08T20:28:26.718 INFO:tasks.workunit.client.0.smithi043.stdout:6/741: dread d0/d2/de/f40 [0,4194304] 0 2023-12-08T20:28:26.719 INFO:tasks.workunit.client.0.smithi043.stdout:6/742: creat d0/d2/de/d4a/d56/dc2/ffd x:0 0 0 2023-12-08T20:28:26.719 INFO:tasks.workunit.client.0.smithi043.stdout:2/998: write d0/d26/dbc/d38/f4f [2500729,38082] 0 2023-12-08T20:28:26.721 INFO:tasks.workunit.client.0.smithi043.stdout:6/743: creat d0/d2/d14/db3/df1/d22/ffe x:0 0 0 2023-12-08T20:28:26.721 INFO:tasks.workunit.client.0.smithi043.stdout:6/744: write d0/d2/d14/db3/df1/d22/d2a/db2/dba/dec/ffa [251290,105170] 0 2023-12-08T20:28:26.741 INFO:tasks.workunit.client.0.smithi043.stdout:2/999: dwrite d0/dd4/ff6 [0,4194304] 0 2023-12-08T20:28:26.762 INFO:tasks.workunit.client.0.smithi043.stdout:4/721: sync 2023-12-08T20:28:26.762 INFO:tasks.workunit.client.0.smithi043.stdout:4/722: chown d1/d14/ca9 1794 1 2023-12-08T20:28:26.763 INFO:tasks.workunit.client.0.smithi043.stdout:4/723: creat d1/d14/d25/d39/d3f/d59/ddc/ff9 x:0 0 0 2023-12-08T20:28:26.785 INFO:tasks.workunit.client.0.smithi043.stdout:4/724: dwrite d1/d14/d25/d39/d3f/d3c/d41/d65/f8e [0,4194304] 0 2023-12-08T20:28:26.785 INFO:tasks.workunit.client.0.smithi043.stdout:4/725: fdatasync d1/d14/d25/d77/fe9 0 2023-12-08T20:28:26.858 INFO:tasks.workunit.client.0.smithi043.stdout:5/703: sync 2023-12-08T20:28:26.858 INFO:tasks.workunit.client.0.smithi043.stdout:0/953: sync 2023-12-08T20:28:26.858 INFO:tasks.workunit.client.0.smithi043.stdout:1/781: sync 2023-12-08T20:28:26.858 INFO:tasks.workunit.client.0.smithi043.stdout:0/954: chown d2/d61/ff1 8 1 2023-12-08T20:28:26.858 INFO:tasks.workunit.client.0.smithi043.stdout:5/704: write d3/d7/d29/fc2 [882356,19853] 0 2023-12-08T20:28:26.858 INFO:tasks.workunit.client.0.smithi043.stdout:5/705: readlink d3/d7/d21/d51/la2 0 2023-12-08T20:28:26.859 INFO:tasks.workunit.client.0.smithi043.stdout:1/782: getdents d1/d16/d21/d25/d3e/d77/d9f/dc3/d110/dad 0 2023-12-08T20:28:26.859 INFO:tasks.workunit.client.0.smithi043.stdout:5/706: symlink d3/d7/d29/ld7 0 2023-12-08T20:28:26.859 INFO:tasks.workunit.client.0.smithi043.stdout:0/955: getdents d2/d3/d18/d2b/da5/d3f 0 2023-12-08T20:28:26.861 INFO:tasks.workunit.client.0.smithi043.stdout:1/783: unlink d1/d16/d21/f6c 0 2023-12-08T20:28:26.861 INFO:tasks.workunit.client.0.smithi043.stdout:5/707: rmdir d3/d7/de/d6a/db2 0 2023-12-08T20:28:26.862 INFO:tasks.workunit.client.0.smithi043.stdout:5/708: creat d3/d7/d21/d51/fd8 x:0 0 0 2023-12-08T20:28:26.862 INFO:tasks.workunit.client.0.smithi043.stdout:0/956: stat d2/d61/dc1/cee 0 2023-12-08T20:28:26.862 INFO:tasks.workunit.client.0.smithi043.stdout:0/957: write d2/d3/d18/d1e/d53/d10b/d39/d83/fb5 [5182264,71167] 0 2023-12-08T20:28:26.864 INFO:tasks.workunit.client.0.smithi043.stdout:1/784: rename d1/d16/d21/d25/d3e/l61 to d1/d16/d21/d25/d3e/d77/d9f/dc3/d110/dad/d102/l11f 0 2023-12-08T20:28:26.868 INFO:tasks.workunit.client.0.smithi043.stdout:1/785: mkdir d1/d16/d86/d120 0 2023-12-08T20:28:26.870 INFO:tasks.workunit.client.0.smithi043.stdout:1/786: getdents d1/d16/d1c/d71/dc5 0 2023-12-08T20:28:26.870 INFO:tasks.workunit.client.0.smithi043.stdout:1/787: write d1/d6/f107 [529308,107507] 0 2023-12-08T20:28:26.870 INFO:tasks.workunit.client.0.smithi043.stdout:1/788: truncate d1/d16/d21/d25/d35/f62 5209253 0 2023-12-08T20:28:26.895 INFO:tasks.workunit.client.0.smithi043.stdout:5/709: dwrite d3/d7/d19/f59 [0,4194304] 0 2023-12-08T20:28:26.895 INFO:tasks.workunit.client.0.smithi043.stdout:5/710: fdatasync d3/d7/de/f8d 0 2023-12-08T20:28:26.895 INFO:tasks.workunit.client.0.smithi043.stdout:0/958: dwrite d2/d3/d18/d2b/f41 [0,4194304] 0 2023-12-08T20:28:26.897 INFO:tasks.workunit.client.0.smithi043.stdout:5/711: rename d3/d7/d21/d51/fd8 to d3/d73/d83/d99/fd9 0 2023-12-08T20:28:26.897 INFO:tasks.workunit.client.0.smithi043.stdout:5/712: chown d3/l5b 219 1 2023-12-08T20:28:26.897 INFO:tasks.workunit.client.0.smithi043.stdout:1/789: dwrite d1/d16/d21/d25/d35/f9e [0,4194304] 0 2023-12-08T20:28:26.897 INFO:tasks.workunit.client.0.smithi043.stdout:1/790: stat d1/d16/d30/d6e/f80 0 2023-12-08T20:28:26.897 INFO:tasks.workunit.client.0.smithi043.stdout:5/713: mknod d3/d7/d19/cda 0 2023-12-08T20:28:26.898 INFO:tasks.workunit.client.0.smithi043.stdout:5/714: creat d3/d7/de/fdb x:0 0 0 2023-12-08T20:28:26.898 INFO:tasks.workunit.client.0.smithi043.stdout:0/959: rename d2/d61/dc1/d126 to d2/d3/d18/d1e/d53/d10b/d123/d135 0 2023-12-08T20:28:26.900 INFO:tasks.workunit.client.0.smithi043.stdout:1/791: symlink d1/d16/d21/l121 0 2023-12-08T20:28:26.901 INFO:tasks.workunit.client.0.smithi043.stdout:0/960: rmdir d2/d3/d18/d2b/da5/d5f/df0/d11e 39 2023-12-08T20:28:26.901 INFO:tasks.workunit.client.0.smithi043.stdout:0/961: write d2/d3/d18/d1e/d88/fa4 [775372,121945] 0 2023-12-08T20:28:26.902 INFO:tasks.workunit.client.0.smithi043.stdout:1/792: creat d1/d16/d1c/d71/dc5/f122 x:0 0 0 2023-12-08T20:28:26.902 INFO:tasks.workunit.client.0.smithi043.stdout:1/793: truncate d1/d16/f49 1588830 0 2023-12-08T20:28:26.902 INFO:tasks.workunit.client.0.smithi043.stdout:1/794: write d1/d16/d21/d25/d35/fac [180997,67335] 0 2023-12-08T20:28:26.905 INFO:tasks.workunit.client.0.smithi043.stdout:0/962: link d2/d3/f1a d2/d3/d18/d1e/d53/d10b/d39/dd8/de6/f136 0 2023-12-08T20:28:26.914 INFO:tasks.workunit.client.0.smithi043.stdout:0/963: dread d2/d3/d18/d2b/da5/da3/fe9 [0,4194304] 0 2023-12-08T20:28:26.914 INFO:tasks.workunit.client.0.smithi043.stdout:0/964: chown d2/d3/d18/d1e/l71 479975 1 2023-12-08T20:28:26.915 INFO:tasks.workunit.client.0.smithi043.stdout:0/965: symlink d2/d3/d18/d2b/da5/da3/l137 0 2023-12-08T20:28:26.917 INFO:tasks.workunit.client.0.smithi043.stdout:0/966: symlink d2/d3/d18/d1e/d53/d10b/d123/l138 0 2023-12-08T20:28:26.917 INFO:tasks.workunit.client.0.smithi043.stdout:0/967: stat d2/d4/f9f 0 2023-12-08T20:28:26.930 INFO:tasks.workunit.client.0.smithi043.stdout:0/968: dread d2/d3/d18/d1e/d53/d10b/d39/d63/f89 [0,4194304] 0 2023-12-08T20:28:26.930 INFO:tasks.workunit.client.0.smithi043.stdout:5/715: dwrite d3/d7/de/f1e [0,4194304] 0 2023-12-08T20:28:26.931 INFO:tasks.workunit.client.0.smithi043.stdout:1/795: dwrite d1/d16/d1c/d71/d98/fd6 [0,4194304] 0 2023-12-08T20:28:26.932 INFO:tasks.workunit.client.0.smithi043.stdout:5/716: creat d3/d78/fdc x:0 0 0 2023-12-08T20:28:26.932 INFO:tasks.workunit.client.0.smithi043.stdout:5/717: write d3/f37 [1212006,97915] 0 2023-12-08T20:28:26.932 INFO:tasks.workunit.client.0.smithi043.stdout:5/718: fsync d3/d7/d21/f28 0 2023-12-08T20:28:26.936 INFO:tasks.workunit.client.0.smithi043.stdout:5/719: rename d3/d7/de/d17 to d3/d7/d21/d51/ddd 0 2023-12-08T20:28:26.936 INFO:tasks.workunit.client.0.smithi043.stdout:5/720: dread - d3/d78/fdc zero size 2023-12-08T20:28:26.944 INFO:tasks.workunit.client.0.smithi043.stdout:5/721: dread d3/fc [0,4194304] 0 2023-12-08T20:28:26.945 INFO:tasks.workunit.client.0.smithi043.stdout:0/969: dwrite d2/d3/d18/fc7 [0,4194304] 0 2023-12-08T20:28:26.964 INFO:tasks.workunit.client.0.smithi043.stdout:5/722: dwrite d3/d7/d19/f59 [0,4194304] 0 2023-12-08T20:28:26.964 INFO:tasks.workunit.client.0.smithi043.stdout:5/723: readlink d3/l85 0 2023-12-08T20:28:26.966 INFO:tasks.workunit.client.0.smithi043.stdout:5/724: creat d3/d7/d19/fde x:0 0 0 2023-12-08T20:28:26.966 INFO:tasks.workunit.client.0.smithi043.stdout:5/725: write d3/d7/d21/d51/d5c/fbb [348516,15550] 0 2023-12-08T20:28:26.966 INFO:tasks.workunit.client.0.smithi043.stdout:5/726: stat d3/d7/de/f24 0 2023-12-08T20:28:26.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:26 smithi111 ceph-mon[121341]: pgmap v34: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 104 MiB/s rd, 214 MiB/s wr, 471 op/s 2023-12-08T20:28:26.971 INFO:tasks.workunit.client.0.smithi043.stdout:0/970: dwrite d2/d4/ffd [0,4194304] 0 2023-12-08T20:28:26.986 INFO:tasks.workunit.client.0.smithi043.stdout:5/727: dwrite d3/d7/de/f1e [0,4194304] 0 2023-12-08T20:28:26.987 INFO:tasks.workunit.client.0.smithi043.stdout:0/971: dwrite d2/d3/d18/d1e/dcc/f114 [0,4194304] 0 2023-12-08T20:28:26.987 INFO:tasks.workunit.client.0.smithi043.stdout:0/972: readlink d2/d3/d18/d2b/l7c 0 2023-12-08T20:28:26.987 INFO:tasks.workunit.client.0.smithi043.stdout:5/728: mkdir d3/d7/d21/d51/d7d/ddf 0 2023-12-08T20:28:26.990 INFO:tasks.workunit.client.0.smithi043.stdout:5/729: symlink d3/d7/dd4/le0 0 2023-12-08T20:28:26.990 INFO:tasks.workunit.client.0.smithi043.stdout:5/730: stat d3/d7/de/d82/cbe 0 2023-12-08T20:28:26.990 INFO:tasks.workunit.client.0.smithi043.stdout:5/731: fsync d3/f37 0 2023-12-08T20:28:26.990 INFO:tasks.workunit.client.0.smithi043.stdout:5/732: truncate d3/f37 407887 0 2023-12-08T20:28:26.990 INFO:tasks.workunit.client.0.smithi043.stdout:5/733: chown d3/d7/d19/lc6 501234 1 2023-12-08T20:28:26.990 INFO:tasks.workunit.client.0.smithi043.stdout:0/973: mknod d2/d61/d67/d113/c139 0 2023-12-08T20:28:26.990 INFO:tasks.workunit.client.0.smithi043.stdout:5/734: symlink d3/d7/d21/d51/d5c/d81/d98/le1 0 2023-12-08T20:28:26.992 INFO:tasks.workunit.client.0.smithi043.stdout:0/974: mkdir d2/d3/d18/d2b/da5/d5f/d13a 0 2023-12-08T20:28:26.992 INFO:tasks.workunit.client.0.smithi043.stdout:0/975: truncate d2/d61/ffa 822517 0 2023-12-08T20:28:26.992 INFO:tasks.workunit.client.0.smithi043.stdout:5/735: fsync d3/d7/d19/fde 0 2023-12-08T20:28:26.993 INFO:tasks.workunit.client.0.smithi043.stdout:5/736: creat d3/d7/de/d82/d95/fe2 x:0 0 0 2023-12-08T20:28:27.004 INFO:tasks.workunit.client.0.smithi043.stdout:5/737: dread d3/d7/de/f1d [0,4194304] 0 2023-12-08T20:28:27.005 INFO:tasks.workunit.client.0.smithi043.stdout:5/738: mknod d3/d7/d21/d51/d7d/ddf/ce3 0 2023-12-08T20:28:27.007 INFO:tasks.workunit.client.0.smithi043.stdout:5/739: unlink d3/d7/d19/cda 0 2023-12-08T20:28:27.008 INFO:tasks.workunit.client.0.smithi043.stdout:5/740: creat d3/d7/fe4 x:0 0 0 2023-12-08T20:28:27.009 INFO:tasks.workunit.client.0.smithi043.stdout:5/741: rename d3/d7/d21/d51/ddd/c9d to d3/d7/d90/ce5 0 2023-12-08T20:28:27.010 INFO:tasks.workunit.client.0.smithi043.stdout:5/742: symlink d3/d7/d21/d51/ddd/d84/le6 0 2023-12-08T20:28:27.010 INFO:tasks.workunit.client.0.smithi043.stdout:5/743: dread - d3/d7/d19/fde zero size 2023-12-08T20:28:27.010 INFO:tasks.workunit.client.0.smithi043.stdout:5/744: creat d3/d7/d19/d3f/d52/fe7 x:0 0 0 2023-12-08T20:28:27.010 INFO:tasks.workunit.client.0.smithi043.stdout:5/745: truncate d3/d7/d21/d72/fa6 1510747 0 2023-12-08T20:28:27.011 INFO:tasks.workunit.client.0.smithi043.stdout:5/746: chown d3/d73/c7a 865 1 2023-12-08T20:28:27.011 INFO:tasks.workunit.client.0.smithi043.stdout:5/747: mknod d3/d7/d21/d51/d7d/ddf/ce8 0 2023-12-08T20:28:27.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:26 smithi043 ceph-mon[111966]: pgmap v34: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 104 MiB/s rd, 214 MiB/s wr, 471 op/s 2023-12-08T20:28:27.013 INFO:tasks.workunit.client.0.smithi043.stdout:5/748: dread d3/d7/d21/d51/f54 [0,4194304] 0 2023-12-08T20:28:27.014 INFO:tasks.workunit.client.0.smithi043.stdout:0/976: dwrite d2/d3/f70 [0,4194304] 0 2023-12-08T20:28:27.022 INFO:tasks.workunit.client.0.smithi043.stdout:5/749: getdents d3/d7/d90 0 2023-12-08T20:28:27.023 INFO:tasks.workunit.client.0.smithi043.stdout:0/977: dread d2/d3/d18/d1e/d53/d10b/d39/d83/d9d/faf [0,4194304] 0 2023-12-08T20:28:27.023 INFO:tasks.workunit.client.0.smithi043.stdout:5/750: stat d3/f6e 0 2023-12-08T20:28:27.023 INFO:tasks.workunit.client.0.smithi043.stdout:0/978: read d2/d4/fd0 [274980,83552] 0 2023-12-08T20:28:27.024 INFO:tasks.workunit.client.0.smithi043.stdout:5/751: symlink d3/d7/d21/d51/d7d/ddf/le9 0 2023-12-08T20:28:27.039 INFO:tasks.workunit.client.0.smithi043.stdout:5/752: dwrite d3/d7/de/f1d [4194304,4194304] 0 2023-12-08T20:28:27.041 INFO:tasks.workunit.client.0.smithi043.stdout:5/753: unlink d3/d7/d21/d51/d5c/da7/ccc 0 2023-12-08T20:28:27.042 INFO:tasks.workunit.client.0.smithi043.stdout:5/754: getdents d3/d7/d21/d51/d7d 0 2023-12-08T20:28:27.042 INFO:tasks.workunit.client.0.smithi043.stdout:5/755: write d3/d7/d21/d51/ddd/d84/fba [5023589,42742] 0 2023-12-08T20:28:27.062 INFO:tasks.workunit.client.0.smithi043.stdout:5/756: dwrite d3/d7/f69 [0,4194304] 0 2023-12-08T20:28:27.062 INFO:tasks.workunit.client.0.smithi043.stdout:5/757: chown d3/d73/c7a 1 1 2023-12-08T20:28:27.062 INFO:tasks.workunit.client.0.smithi043.stdout:5/758: creat d3/d7/de/d43/d68/fea x:0 0 0 2023-12-08T20:28:27.062 INFO:tasks.workunit.client.0.smithi043.stdout:5/759: chown d3/d7/f69 0 1 2023-12-08T20:28:27.078 INFO:tasks.workunit.client.0.smithi043.stdout:5/760: dwrite d3/d7/d19/d3f/d52/f70 [0,4194304] 0 2023-12-08T20:28:27.079 INFO:tasks.workunit.client.0.smithi043.stdout:5/761: symlink d3/d73/d83/leb 0 2023-12-08T20:28:27.081 INFO:tasks.workunit.client.0.smithi043.stdout:5/762: read f2 [1775306,100715] 0 2023-12-08T20:28:27.082 INFO:tasks.workunit.client.0.smithi043.stdout:5/763: rename d3/d7/d21/d72/f9a to d3/d7/de/d6a/fec 0 2023-12-08T20:28:27.084 INFO:tasks.workunit.client.0.smithi043.stdout:5/764: rename d3/d7/dd4 to d3/d7/d21/d72/ded 0 2023-12-08T20:28:27.084 INFO:tasks.workunit.client.0.smithi043.stdout:5/765: dread - d3/d7/d90/fad zero size 2023-12-08T20:28:27.098 INFO:tasks.workunit.client.0.smithi043.stdout:5/766: dwrite d3/d7/d21/d72/fa6 [0,4194304] 0 2023-12-08T20:28:27.098 INFO:tasks.workunit.client.0.smithi043.stdout:5/767: chown d3/d7/f69 559117 1 2023-12-08T20:28:27.099 INFO:tasks.workunit.client.0.smithi043.stdout:5/768: write f2 [6801049,82114] 0 2023-12-08T20:28:27.101 INFO:tasks.workunit.client.0.smithi043.stdout:5/769: mkdir d3/d7/de/dee 0 2023-12-08T20:28:27.101 INFO:tasks.workunit.client.0.smithi043.stdout:5/770: fsync d3/d7/d21/d51/ddd/d84/f87 0 2023-12-08T20:28:27.101 INFO:tasks.workunit.client.0.smithi043.stdout:5/771: write d3/d73/f7e [681596,14114] 0 2023-12-08T20:28:27.101 INFO:tasks.workunit.client.0.smithi043.stdout:5/772: chown d3/d73/d83 33580929 1 2023-12-08T20:28:27.102 INFO:tasks.workunit.client.0.smithi043.stdout:5/773: rmdir d3/d7/de/d82/d8b 39 2023-12-08T20:28:27.102 INFO:tasks.workunit.client.0.smithi043.stdout:5/774: read d3/d7/d21/d72/fa6 [2152047,58057] 0 2023-12-08T20:28:27.102 INFO:tasks.workunit.client.0.smithi043.stdout:5/775: chown d3/d7/de/f1d 185867084 1 2023-12-08T20:28:27.104 INFO:tasks.workunit.client.0.smithi043.stdout:5/776: mknod d3/d7/d21/d72/cef 0 2023-12-08T20:28:27.105 INFO:tasks.workunit.client.0.smithi043.stdout:5/777: dread d3/d7/d21/d51/f54 [0,4194304] 0 2023-12-08T20:28:27.108 INFO:tasks.workunit.client.0.smithi043.stdout:5/778: creat d3/d73/d83/dd6/ff0 x:0 0 0 2023-12-08T20:28:27.108 INFO:tasks.workunit.client.0.smithi043.stdout:5/779: chown d3/d7/d19/f6d 4136467 1 2023-12-08T20:28:27.108 INFO:tasks.workunit.client.0.smithi043.stdout:5/780: read - d3/d7/d21/d51/d7d/f96 zero size 2023-12-08T20:28:27.108 INFO:tasks.workunit.client.0.smithi043.stdout:5/781: read d3/d7/d19/f59 [3861498,84769] 0 2023-12-08T20:28:27.109 INFO:tasks.workunit.client.0.smithi043.stdout:5/782: fsync d3/d7/d21/f4d 0 2023-12-08T20:28:27.126 INFO:tasks.workunit.client.0.smithi043.stdout:5/783: dwrite d3/d7/de/f1e [0,4194304] 0 2023-12-08T20:28:27.127 INFO:tasks.workunit.client.0.smithi043.stdout:5/784: rename d3/d7/de/d6a/fec to d3/d7/de/d43/ff1 0 2023-12-08T20:28:27.128 INFO:tasks.workunit.client.0.smithi043.stdout:5/785: unlink d3/d7/d21/d51/ddd/d84/le6 0 2023-12-08T20:28:27.136 INFO:tasks.workunit.client.0.smithi043.stdout:9/761: sync 2023-12-08T20:28:27.136 INFO:tasks.workunit.client.0.smithi043.stdout:9/762: stat d0/d3d/d8a/d9a/ddd/d6b/d76/d53/fcd 0 2023-12-08T20:28:27.137 INFO:tasks.workunit.client.0.smithi043.stdout:9/763: creat d0/d3d/d4b/d61/ffa x:0 0 0 2023-12-08T20:28:27.137 INFO:tasks.workunit.client.0.smithi043.stdout:9/764: fsync d0/d5e/f63 0 2023-12-08T20:28:27.138 INFO:tasks.workunit.client.0.smithi043.stdout:9/765: mknod d0/d5e/d73/cfb 0 2023-12-08T20:28:27.149 INFO:tasks.workunit.client.0.smithi043.stdout:5/786: dwrite d3/d73/d83/dd6/ff0 [0,4194304] 0 2023-12-08T20:28:27.149 INFO:tasks.workunit.client.0.smithi043.stdout:5/787: write d3/d7/de/f7b [1623655,104393] 0 2023-12-08T20:28:27.149 INFO:tasks.workunit.client.0.smithi043.stdout:5/788: readlink d3/d7/d19/d3f/l8f 0 2023-12-08T20:28:27.149 INFO:tasks.workunit.client.0.smithi043.stdout:5/789: chown d3/d7/d21/f2d 108 1 2023-12-08T20:28:27.149 INFO:tasks.workunit.client.0.smithi043.stdout:5/790: write d3/d7/d21/d51/ddd/d84/f87 [2464065,67650] 0 2023-12-08T20:28:27.150 INFO:tasks.workunit.client.0.smithi043.stdout:5/791: write d3/d7/d19/f6d [30388,77708] 0 2023-12-08T20:28:27.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.153+0000 7f2f86d38700 1 -- 172.21.15.43:0/3468292703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f800ffdd0 msgr2=0x7f2f801021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:27.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.153+0000 7f2f86d38700 1 --2- 172.21.15.43:0/3468292703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f800ffdd0 0x7f2f801021d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c004940 tx=0x7f2f6c009e30 comp rx=0 tx=0).stop 2023-12-08T20:28:27.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.153+0000 7f2f86d38700 1 -- 172.21.15.43:0/3468292703 shutdown_connections 2023-12-08T20:28:27.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.153+0000 7f2f86d38700 1 --2- 172.21.15.43:0/3468292703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f800ffdd0 0x7f2f801021d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:27.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.153+0000 7f2f86d38700 1 --2- 172.21.15.43:0/3468292703 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f80066030 0x7f2f800ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:27.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.153+0000 7f2f86d38700 1 -- 172.21.15.43:0/3468292703 >> 172.21.15.43:0/3468292703 conn(0x7f2f800f7190 msgr2=0x7f2f800f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:28:27.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.154+0000 7f2f86d38700 1 -- 172.21.15.43:0/3468292703 shutdown_connections 2023-12-08T20:28:27.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.154+0000 7f2f86d38700 1 -- 172.21.15.43:0/3468292703 wait complete. 2023-12-08T20:28:27.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.154+0000 7f2f86d38700 1 Processor -- start 2023-12-08T20:28:27.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.154+0000 7f2f86d38700 1 -- start start 2023-12-08T20:28:27.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.155+0000 7f2f86d38700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f80066030 0x7f2f8010d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:28:27.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.155+0000 7f2f86d38700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f800ffdd0 0x7f2f8010da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:28:27.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.155+0000 7f2f86d38700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8010e080 con 0x7f2f80066030 2023-12-08T20:28:27.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.155+0000 7f2f86d38700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8010e920 con 0x7f2f800ffdd0 2023-12-08T20:28:27.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.155+0000 7f2f84ad4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f80066030 0x7f2f8010d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:28:27.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.155+0000 7f2f84ad4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f80066030 0x7f2f8010d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38406/0 (socket says 172.21.15.43:38406) 2023-12-08T20:28:27.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.155+0000 7f2f84ad4700 1 -- 172.21.15.43:0/2635633593 learned_addr learned my addr 172.21.15.43:0/2635633593 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:28:27.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.155+0000 7f2f84ad4700 1 -- 172.21.15.43:0/2635633593 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f800ffdd0 msgr2=0x7f2f8010da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:27.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.155+0000 7f2f84ad4700 1 --2- 172.21.15.43:0/2635633593 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f800ffdd0 0x7f2f8010da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:27.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.155+0000 7f2f84ad4700 1 -- 172.21.15.43:0/2635633593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c005040 con 0x7f2f80066030 2023-12-08T20:28:27.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.155+0000 7f2f84ad4700 1 --2- 172.21.15.43:0/2635633593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f80066030 0x7f2f8010d540 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2f74002a50 tx=0x7f2f740046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:28:27.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.156+0000 7f2f7d7fa700 1 -- 172.21.15.43:0/2635633593 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f74007cc0 con 0x7f2f80066030 2023-12-08T20:28:27.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.156+0000 7f2f7d7fa700 1 -- 172.21.15.43:0/2635633593 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f7400f040 con 0x7f2f80066030 2023-12-08T20:28:27.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.156+0000 7f2f7d7fa700 1 -- 172.21.15.43:0/2635633593 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f7400da70 con 0x7f2f80066030 2023-12-08T20:28:27.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.156+0000 7f2f86d38700 1 -- 172.21.15.43:0/2635633593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8010ec00 con 0x7f2f80066030 2023-12-08T20:28:27.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.156+0000 7f2f86d38700 1 -- 172.21.15.43:0/2635633593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8010f140 con 0x7f2f80066030 2023-12-08T20:28:27.159 INFO:tasks.workunit.client.0.smithi043.stdout:9/766: dwrite d0/d5e/fd1 [0,4194304] 0 2023-12-08T20:28:27.159 INFO:tasks.workunit.client.0.smithi043.stdout:9/767: dread - d0/fca zero size 2023-12-08T20:28:27.159 INFO:tasks.workunit.client.0.smithi043.stdout:9/768: truncate d0/d3d/dd4/fde 363698 0 2023-12-08T20:28:27.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.157+0000 7f2f86d38700 1 -- 172.21.15.43:0/2635633593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f801075e0 con 0x7f2f80066030 2023-12-08T20:28:27.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.158+0000 7f2f7d7fa700 1 -- 172.21.15.43:0/2635633593 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f2f7400dc10 con 0x7f2f80066030 2023-12-08T20:28:27.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.158+0000 7f2f7d7fa700 1 --2- 172.21.15.43:0/2635633593 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f2f7006ae40 0x7f2f7006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:28:27.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.159+0000 7f2f7d7fa700 1 -- 172.21.15.43:0/2635633593 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f2f74088f40 con 0x7f2f80066030 2023-12-08T20:28:27.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.159+0000 7f2f7ffff700 1 --2- 172.21.15.43:0/2635633593 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f2f7006ae40 0x7f2f7006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:28:27.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.159+0000 7f2f7ffff700 1 --2- 172.21.15.43:0/2635633593 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f2f7006ae40 0x7f2f7006d2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c00b3b0 tx=0x7f2f6c009e30 comp rx=0 tx=0).ready entity=mgr.24407 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:28:27.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.165+0000 7f2f7d7fa700 1 -- 172.21.15.43:0/2635633593 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f2f74056cc0 con 0x7f2f80066030 2023-12-08T20:28:27.210 INFO:tasks.workunit.client.0.smithi043.stdout:3/805: sync 2023-12-08T20:28:27.210 INFO:tasks.workunit.client.0.smithi043.stdout:3/806: readlink d1/leb 0 2023-12-08T20:28:27.210 INFO:tasks.workunit.client.0.smithi043.stdout:7/798: sync 2023-12-08T20:28:27.210 INFO:tasks.workunit.client.0.smithi043.stdout:8/868: sync 2023-12-08T20:28:27.210 INFO:tasks.workunit.client.0.smithi043.stdout:6/745: sync 2023-12-08T20:28:27.221 INFO:tasks.workunit.client.0.smithi043.stdout:9/769: dwrite d0/d21/d80/d8e/fb8 [0,4194304] 0 2023-12-08T20:28:27.222 INFO:tasks.workunit.client.0.smithi043.stdout:7/799: symlink d0/d69/d6d/dfd/l104 0 2023-12-08T20:28:27.222 INFO:tasks.workunit.client.0.smithi043.stdout:7/800: write d0/d2/d65/d99/f15 [3665952,34450] 0 2023-12-08T20:28:27.222 INFO:tasks.workunit.client.0.smithi043.stdout:8/869: rename d2/d20/d7d/d29/d59/f10e to d2/d27/dab/f11d 0 2023-12-08T20:28:27.222 INFO:tasks.workunit.client.0.smithi043.stdout:8/870: readlink d2/d20/d7d/d29/l50 0 2023-12-08T20:28:27.222 INFO:tasks.workunit.client.0.smithi043.stdout:8/871: fsync d2/d20/d7d/d29/f66 0 2023-12-08T20:28:27.224 INFO:tasks.workunit.client.0.smithi043.stdout:5/792: dwrite d3/d7/d19/f59 [0,4194304] 0 2023-12-08T20:28:27.224 INFO:tasks.workunit.client.0.smithi043.stdout:5/793: chown d3/d7/d21/fd2 135646 1 2023-12-08T20:28:27.227 INFO:tasks.workunit.client.0.smithi043.stdout:7/801: symlink d0/d6/d17/d54/l105 0 2023-12-08T20:28:27.228 INFO:tasks.workunit.client.0.smithi043.stdout:7/802: truncate d0/d2/d12/fcd 722583 0 2023-12-08T20:28:27.228 INFO:tasks.workunit.client.0.smithi043.stdout:7/803: write d0/d2/d65/d99/d47/ff2 [506209,91025] 0 2023-12-08T20:28:27.228 INFO:tasks.workunit.client.0.smithi043.stdout:7/804: truncate d0/d6/f24 8474219 0 2023-12-08T20:28:27.230 INFO:tasks.workunit.client.0.smithi043.stdout:8/872: creat d2/d20/d7d/d29/d30/d7c/f11e x:0 0 0 2023-12-08T20:28:27.230 INFO:tasks.workunit.client.0.smithi043.stdout:8/873: readlink d2/d27/dab/lb8 0 2023-12-08T20:28:27.230 INFO:tasks.workunit.client.0.smithi043.stdout:8/874: write d2/d27/d2d/d31/d7f/db2/fb5 [1046526,18697] 0 2023-12-08T20:28:27.230 INFO:tasks.workunit.client.0.smithi043.stdout:5/794: chown d3/d7/c12 3542 1 2023-12-08T20:28:27.230 INFO:tasks.workunit.client.0.smithi043.stdout:5/795: stat d3/d7/de/d82/d8b 0 2023-12-08T20:28:27.231 INFO:tasks.workunit.client.0.smithi043.stdout:7/805: mkdir d0/d6/dc7/d106 0 2023-12-08T20:28:27.232 INFO:tasks.workunit.client.0.smithi043.stdout:5/796: mkdir d3/d7/d21/d51/d7d/ddf/df2 0 2023-12-08T20:28:27.233 INFO:tasks.workunit.client.0.smithi043.stdout:5/797: write d3/d7/d21/d51/f54 [1461812,41920] 0 2023-12-08T20:28:27.233 INFO:tasks.workunit.client.0.smithi043.stdout:5/798: write d3/d7/d21/fa3 [251777,44006] 0 2023-12-08T20:28:27.234 INFO:tasks.workunit.client.0.smithi043.stdout:7/806: creat d0/d2/d65/d99/de3/f107 x:0 0 0 2023-12-08T20:28:27.235 INFO:tasks.workunit.client.0.smithi043.stdout:3/807: dwrite d1/d9/fd [0,4194304] 0 2023-12-08T20:28:27.236 INFO:tasks.workunit.client.0.smithi043.stdout:5/799: rename d3/d7/d21/d51/ddd/d84/f87 to d3/d78/ff3 0 2023-12-08T20:28:27.238 INFO:tasks.workunit.client.0.smithi043.stdout:7/807: mknod d0/d6/d17/d52/dac/c108 0 2023-12-08T20:28:27.238 INFO:tasks.workunit.client.0.smithi043.stdout:7/808: fdatasync d0/f1b 0 2023-12-08T20:28:27.238 INFO:tasks.workunit.client.0.smithi043.stdout:5/800: creat d3/d7/d29/ff4 x:0 0 0 2023-12-08T20:28:27.240 INFO:tasks.workunit.client.0.smithi043.stdout:5/801: symlink d3/d7/d29/lf5 0 2023-12-08T20:28:27.243 INFO:tasks.workunit.client.0.smithi043.stdout:5/802: mknod d3/d7/d21/cf6 0 2023-12-08T20:28:27.252 INFO:tasks.workunit.client.0.smithi043.stdout:9/770: dwrite d0/d21/d80/fb3 [0,4194304] 0 2023-12-08T20:28:27.253 INFO:tasks.workunit.client.0.smithi043.stdout:9/771: creat d0/d3d/ffc x:0 0 0 2023-12-08T20:28:27.254 INFO:tasks.workunit.client.0.smithi043.stdout:7/809: dread d0/f9e [0,4194304] 0 2023-12-08T20:28:27.255 INFO:tasks.workunit.client.0.smithi043.stdout:9/772: creat d0/d3d/d8a/d9a/ffd x:0 0 0 2023-12-08T20:28:27.257 INFO:tasks.workunit.client.0.smithi043.stdout:9/773: link d0/d3d/d4b/d61/ffa d0/d3d/d8a/d9a/ddd/d6b/d94/ffe 0 2023-12-08T20:28:27.258 INFO:tasks.workunit.client.0.smithi043.stdout:8/875: dwrite d2/d20/d7d/d37/d5a/ffc [0,4194304] 0 2023-12-08T20:28:27.259 INFO:tasks.workunit.client.0.smithi043.stdout:9/774: rmdir d0/d3d/d8c/df8 0 2023-12-08T20:28:27.259 INFO:tasks.workunit.client.0.smithi043.stdout:9/775: fsync d0/d3d/f83 0 2023-12-08T20:28:27.261 INFO:tasks.workunit.client.0.smithi043.stdout:8/876: getdents d2/d27/d2d/de7 0 2023-12-08T20:28:27.263 INFO:tasks.workunit.client.0.smithi043.stdout:9/776: creat d0/d3d/d8a/d9a/ddd/d6b/d94/fff x:0 0 0 2023-12-08T20:28:27.263 INFO:tasks.workunit.client.0.smithi043.stdout:9/777: chown d0/d21/f74 67 1 2023-12-08T20:28:27.263 INFO:tasks.workunit.client.0.smithi043.stdout:3/808: dwrite d1/d9/d38/d4f/d8f/ddf/fe8 [0,4194304] 0 2023-12-08T20:28:27.266 INFO:tasks.workunit.client.0.smithi043.stdout:5/803: dwrite d3/d7/de/d82/d8b/f93 [0,4194304] 0 2023-12-08T20:28:27.274 INFO:tasks.workunit.client.0.smithi043.stdout:5/804: rmdir d3/d7/d19 39 2023-12-08T20:28:27.276 INFO:tasks.workunit.client.0.smithi043.stdout:8/877: dread d2/f3e [0,4194304] 0 2023-12-08T20:28:27.276 INFO:tasks.workunit.client.0.smithi043.stdout:8/878: chown d2/d6f/f108 68762 1 2023-12-08T20:28:27.276 INFO:tasks.workunit.client.0.smithi043.stdout:8/879: readlink d2/d20/d7d/d29/d30/d60/le3 0 2023-12-08T20:28:27.277 INFO:tasks.workunit.client.0.smithi043.stdout:7/810: dwrite d0/d2/d65/d99/de3/f107 [0,4194304] 0 2023-12-08T20:28:27.277 INFO:tasks.workunit.client.0.smithi043.stdout:7/811: chown d0/d69/fb8 1109322 1 2023-12-08T20:28:27.278 INFO:tasks.workunit.client.0.smithi043.stdout:9/778: dread d0/d3d/d4b/f71 [0,4194304] 0 2023-12-08T20:28:27.278 INFO:tasks.workunit.client.0.smithi043.stdout:7/812: write d0/f9b [530545,70402] 0 2023-12-08T20:28:27.278 INFO:tasks.workunit.client.0.smithi043.stdout:7/813: chown d0/d2/d65/d99/de3/f107 2880774 1 2023-12-08T20:28:27.279 INFO:tasks.workunit.client.0.smithi043.stdout:5/805: creat d3/d7/d21/ff7 x:0 0 0 2023-12-08T20:28:27.279 INFO:tasks.workunit.client.0.smithi043.stdout:5/806: dread - d3/d73/d83/d99/fd9 zero size 2023-12-08T20:28:27.279 INFO:tasks.workunit.client.0.smithi043.stdout:8/880: stat d2/d20/d7d/d29/d30/d7c/c97 0 2023-12-08T20:28:27.283 INFO:tasks.workunit.client.0.smithi043.stdout:9/779: mknod d0/d3d/d8a/d9a/ddd/d6b/c100 0 2023-12-08T20:28:27.285 INFO:tasks.workunit.client.0.smithi043.stdout:7/814: rename d0/d6/l8d to d0/d2/d65/l109 0 2023-12-08T20:28:27.286 INFO:tasks.workunit.client.0.smithi043.stdout:3/809: dwrite d1/d9/d38/d33/f69 [0,4194304] 0 2023-12-08T20:28:27.290 INFO:tasks.workunit.client.0.smithi043.stdout:8/881: creat d2/d20/d7d/d29/d30/d60/d9b/dee/f11f x:0 0 0 2023-12-08T20:28:27.297 INFO:tasks.workunit.client.0.smithi043.stdout:5/807: dread d3/d32/f47 [0,4194304] 0 2023-12-08T20:28:27.297 INFO:tasks.workunit.client.0.smithi043.stdout:5/808: dread - d3/d7/de/d82/d95/fe2 zero size 2023-12-08T20:28:27.297 INFO:tasks.workunit.client.0.smithi043.stdout:5/809: dread - d3/d7/d21/f50 zero size 2023-12-08T20:28:27.299 INFO:tasks.workunit.client.0.smithi043.stdout:3/810: symlink d1/d1c/d2c/d5f/dfb/l105 0 2023-12-08T20:28:27.301 INFO:tasks.workunit.client.0.smithi043.stdout:8/882: rename d2/d6f/f39 to d2/d27/d2d/d31/d74/f120 0 2023-12-08T20:28:27.302 INFO:tasks.workunit.client.0.smithi043.stdout:3/811: truncate d1/d25/f31 643898 0 2023-12-08T20:28:27.306 INFO:tasks.workunit.client.0.smithi043.stdout:8/883: mkdir d2/d20/d7d/d29/d30/d7c/d121 0 2023-12-08T20:28:27.306 INFO:tasks.workunit.client.0.smithi043.stdout:8/884: write d2/d27/d2d/d31/de8/f102 [1401480,126786] 0 2023-12-08T20:28:27.306 INFO:tasks.workunit.client.0.smithi043.stdout:8/885: fdatasync d2/d20/d7d/d29/d30/d60/d9b/dee/f107 0 2023-12-08T20:28:27.306 INFO:tasks.workunit.client.0.smithi043.stdout:3/812: mknod d1/d9/d2d/d91/c106 0 2023-12-08T20:28:27.306 INFO:tasks.workunit.client.0.smithi043.stdout:3/813: chown d1/d9/df/ddb/f100 842829527 1 2023-12-08T20:28:27.306 INFO:tasks.workunit.client.0.smithi043.stdout:3/814: write d1/d9/d2d/f70 [108351,74905] 0 2023-12-08T20:28:27.306 INFO:tasks.workunit.client.0.smithi043.stdout:3/815: truncate d1/d1c/d29/fa5 691806 0 2023-12-08T20:28:27.306 INFO:tasks.workunit.client.0.smithi043.stdout:3/816: truncate d1/d9/f32 340882 0 2023-12-08T20:28:27.306 INFO:tasks.workunit.client.0.smithi043.stdout:3/817: stat d1/d9/f1a 0 2023-12-08T20:28:27.317 INFO:tasks.workunit.client.0.smithi043.stdout:3/818: write d1/d9/df/d26/fd8 [1192213,33444] 0 2023-12-08T20:28:27.320 INFO:tasks.workunit.client.0.smithi043.stdout:3/819: rename d1/d9/d38/d4f/d8f/ddf/fe4 to d1/d9/f107 0 2023-12-08T20:28:27.320 INFO:tasks.workunit.client.0.smithi043.stdout:3/820: truncate d1/d25/d2a/dd0/f96 827143 0 2023-12-08T20:28:27.321 INFO:tasks.workunit.client.0.smithi043.stdout:7/815: dwrite d0/d2/d12/d19/d38/f55 [0,4194304] 0 2023-12-08T20:28:27.321 INFO:tasks.workunit.client.0.smithi043.stdout:9/780: dwrite d0/d3d/f48 [0,4194304] 0 2023-12-08T20:28:27.323 INFO:tasks.workunit.client.0.smithi043.stdout:9/781: truncate d0/d21/d80/d8e/ff3 831115 0 2023-12-08T20:28:27.323 INFO:tasks.workunit.client.0.smithi043.stdout:9/782: fsync d0/d3d/d4b/d61/fb5 0 2023-12-08T20:28:27.325 INFO:tasks.workunit.client.0.smithi043.stdout:9/783: rename d0/d3d/d4b/d61/cae to d0/d5e/d73/deb/c101 0 2023-12-08T20:28:27.327 INFO:tasks.workunit.client.0.smithi043.stdout:5/810: dwrite d3/d7/d19/d3f/f62 [0,4194304] 0 2023-12-08T20:28:27.330 INFO:tasks.workunit.client.0.smithi043.stdout:8/886: dwrite d2/d20/d7d/d29/d30/d7c/ff3 [0,4194304] 0 2023-12-08T20:28:27.339 INFO:tasks.workunit.client.0.smithi043.stdout:5/811: mknod d3/d73/da4/db0/cf8 0 2023-12-08T20:28:27.344 INFO:tasks.workunit.client.0.smithi043.stdout:3/821: dwrite d1/d25/d2a/dd0/f96 [0,4194304] 0 2023-12-08T20:28:27.348 INFO:tasks.workunit.client.0.smithi043.stdout:3/822: read d1/d25/f31 [280639,104507] 0 2023-12-08T20:28:27.349 INFO:tasks.workunit.client.0.smithi043.stdout:3/823: write d1/d1c/f22 [7601772,128242] 0 2023-12-08T20:28:27.349 INFO:tasks.workunit.client.0.smithi043.stdout:5/812: mknod d3/d7/d21/d51/d5c/d81/d98/cf9 0 2023-12-08T20:28:27.350 INFO:tasks.workunit.client.0.smithi043.stdout:5/813: write d3/d7/d21/d51/d5c/d81/fc0 [925560,63325] 0 2023-12-08T20:28:27.351 INFO:tasks.workunit.client.0.smithi043.stdout:3/824: creat d1/d9/d38/d4a/dbd/f108 x:0 0 0 2023-12-08T20:28:27.351 INFO:tasks.workunit.client.0.smithi043.stdout:3/825: read - d1/d9/d38/d30/d56/f89 zero size 2023-12-08T20:28:27.354 INFO:tasks.workunit.client.0.smithi043.stdout:5/814: creat d3/d7/d90/ffa x:0 0 0 2023-12-08T20:28:27.355 INFO:tasks.workunit.client.0.smithi043.stdout:1/796: sync 2023-12-08T20:28:27.355 INFO:tasks.workunit.client.0.smithi043.stdout:4/726: sync 2023-12-08T20:28:27.360 INFO:tasks.workunit.client.0.smithi043.stdout:9/784: dwrite d0/d21/d80/d8e/ff3 [0,4194304] 0 2023-12-08T20:28:27.362 INFO:tasks.workunit.client.0.smithi043.stdout:4/727: write d1/d14/d50/f9a [3912774,71926] 0 2023-12-08T20:28:27.365 INFO:tasks.workunit.client.0.smithi043.stdout:9/785: mkdir d0/d3d/d8a/de3/d102 0 2023-12-08T20:28:27.367 INFO:tasks.workunit.client.0.smithi043.stdout:9/786: mknod d0/c103 0 2023-12-08T20:28:27.368 INFO:tasks.workunit.client.0.smithi043.stdout:9/787: creat d0/d5e/f104 x:0 0 0 2023-12-08T20:28:27.369 INFO:tasks.workunit.client.0.smithi043.stdout:9/788: write d0/d3d/d8c/fc6 [4677225,30494] 0 2023-12-08T20:28:27.370 INFO:tasks.workunit.client.0.smithi043.stdout:4/728: dread d1/d14/d25/d39/da3/dae/fb4 [0,4194304] 0 2023-12-08T20:28:27.371 INFO:tasks.workunit.client.0.smithi043.stdout:9/789: mknod d0/d3d/dd4/df2/c105 0 2023-12-08T20:28:27.373 INFO:tasks.workunit.client.0.smithi043.stdout:4/729: link d1/d14/d25/d39/d3f/d59/cd2 d1/d14/d25/d77/da4/dc0/def/cfa 0 2023-12-08T20:28:27.375 INFO:tasks.workunit.client.0.smithi043.stdout:9/790: symlink d0/d3d/d8c/l106 0 2023-12-08T20:28:27.375 INFO:tasks.workunit.client.0.smithi043.stdout:3/826: dwrite d1/d1c/d2c/d5f/fb5 [0,4194304] 0 2023-12-08T20:28:27.375 INFO:tasks.workunit.client.0.smithi043.stdout:3/827: chown d1/d25/d2a/l78 2 1 2023-12-08T20:28:27.375 INFO:tasks.workunit.client.0.smithi043.stdout:4/730: mkdir d1/d14/d25/d39/dfb 0 2023-12-08T20:28:27.377 INFO:tasks.workunit.client.0.smithi043.stdout:1/797: dwrite d1/d16/d21/d25/d35/f9e [0,4194304] 0 2023-12-08T20:28:27.378 INFO:tasks.workunit.client.0.smithi043.stdout:3/828: creat d1/d25/d2a/d85/da6/dad/f109 x:0 0 0 2023-12-08T20:28:27.378 INFO:tasks.workunit.client.0.smithi043.stdout:4/731: rename d1/d14/d25/d39/feb to d1/d14/d25/d77/da4/dc0/def/ffc 0 2023-12-08T20:28:27.378 INFO:tasks.workunit.client.0.smithi043.stdout:4/732: chown d1/d14/ca9 3169519 1 2023-12-08T20:28:27.381 INFO:tasks.workunit.client.0.smithi043.stdout:1/798: rename d1/d16/d21/d25/d3e/d77/d9f/l11e to d1/d16/d21/d25/l123 0 2023-12-08T20:28:27.392 INFO:tasks.workunit.client.0.smithi043.stdout:3/829: symlink d1/d9/d38/d4a/dbd/l10a 0 2023-12-08T20:28:27.392 INFO:tasks.workunit.client.0.smithi043.stdout:4/733: mkdir d1/d14/d25/d39/dfb/dfd 0 2023-12-08T20:28:27.392 INFO:tasks.workunit.client.0.smithi043.stdout:4/734: chown d1/d14/d25/d39/d3f 965046 1 2023-12-08T20:28:27.397 INFO:tasks.workunit.client.0.smithi043.stdout:9/791: dwrite d0/d5e/f104 [0,4194304] 0 2023-12-08T20:28:27.397 INFO:tasks.workunit.client.0.smithi043.stdout:9/792: chown d0/d3d/d8a/d9a/ddd/le1 1970312 1 2023-12-08T20:28:27.400 INFO:tasks.workunit.client.0.smithi043.stdout:1/799: dwrite d1/d16/d1c/fa8 [0,4194304] 0 2023-12-08T20:28:27.403 INFO:tasks.workunit.client.0.smithi043.stdout:3/830: mkdir d1/d25/d2a/dd0/dbe/d10b 0 2023-12-08T20:28:27.403 INFO:tasks.workunit.client.0.smithi043.stdout:3/831: write d1/d9/d2d/d66/dca/fcb [4827605,61362] 0 2023-12-08T20:28:27.403 INFO:tasks.workunit.client.0.smithi043.stdout:3/832: dread - d1/d25/fe6 zero size 2023-12-08T20:28:27.403 INFO:tasks.workunit.client.0.smithi043.stdout:4/735: truncate d1/f10 2442296 0 2023-12-08T20:28:27.403 INFO:tasks.workunit.client.0.smithi043.stdout:4/736: dread - d1/d14/d25/d39/fbc zero size 2023-12-08T20:28:27.405 INFO:tasks.workunit.client.0.smithi043.stdout:1/800: link d1/d16/f28 d1/d16/d7e/f124 0 2023-12-08T20:28:27.406 INFO:tasks.workunit.client.0.smithi043.stdout:9/793: creat d0/d5e/d73/f107 x:0 0 0 2023-12-08T20:28:27.406 INFO:tasks.workunit.client.0.smithi043.stdout:9/794: chown d0/c19 30952 1 2023-12-08T20:28:27.406 INFO:tasks.workunit.client.0.smithi043.stdout:1/801: dread d1/db1/dc9/fdc [0,4194304] 0 2023-12-08T20:28:27.406 INFO:tasks.workunit.client.0.smithi043.stdout:1/802: write d1/d16/d7e/f124 [6305143,50147] 0 2023-12-08T20:28:27.409 INFO:tasks.workunit.client.0.smithi043.stdout:3/833: rename d1/d9/d2d/d66 to d1/d9/df/ddb/d10c 0 2023-12-08T20:28:27.413 INFO:tasks.workunit.client.0.smithi043.stdout:4/737: truncate d1/d14/d25/d39/d3d/d40/d67/f68 274301 0 2023-12-08T20:28:27.413 INFO:tasks.workunit.client.0.smithi043.stdout:1/803: getdents d1/d16/d21 0 2023-12-08T20:28:27.413 INFO:tasks.workunit.client.0.smithi043.stdout:1/804: chown d1/d16/d30/d6e/d83/fdf 41 1 2023-12-08T20:28:27.414 INFO:tasks.workunit.client.0.smithi043.stdout:9/795: truncate d0/d5e/f57 1590041 0 2023-12-08T20:28:27.415 INFO:tasks.workunit.client.0.smithi043.stdout:1/805: mknod d1/d16/d21/d6f/daa/c125 0 2023-12-08T20:28:27.415 INFO:tasks.workunit.client.0.smithi043.stdout:3/834: mkdir d1/d9/d38/d30/d56/d10d 0 2023-12-08T20:28:27.415 INFO:tasks.workunit.client.0.smithi043.stdout:1/806: stat d1/c36 0 2023-12-08T20:28:27.418 INFO:tasks.workunit.client.0.smithi043.stdout:4/738: truncate d1/d14/d25/d39/d3f/d3c/d41/fb8 1042222 0 2023-12-08T20:28:27.427 INFO:tasks.workunit.client.0.smithi043.stdout:9/796: dread d0/d21/d80/d8e/df6/fc5 [0,4194304] 0 2023-12-08T20:28:27.430 INFO:tasks.workunit.client.0.smithi043.stdout:9/797: creat d0/d3d/d8a/de3/f108 x:0 0 0 2023-12-08T20:28:27.430 INFO:tasks.workunit.client.0.smithi043.stdout:9/798: write d0/d3d/d8a/d9a/ddd/d6b/d76/d53/ff1 [661362,121294] 0 2023-12-08T20:28:27.434 INFO:tasks.workunit.client.0.smithi043.stdout:9/799: rename d0/d3d/d8a/d9a to d0/d3d/d4b/da2/dbc/d109 0 2023-12-08T20:28:27.436 INFO:tasks.workunit.client.0.smithi043.stdout:9/800: link d0/d5e/f63 d0/d5e/f10a 0 2023-12-08T20:28:27.437 INFO:tasks.workunit.client.0.smithi043.stdout:9/801: symlink d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d94/l10b 0 2023-12-08T20:28:27.437 INFO:tasks.workunit.client.0.smithi043.stdout:9/802: read d0/d21/f74 [351592,119105] 0 2023-12-08T20:28:27.438 INFO:tasks.workunit.client.0.smithi043.stdout:9/803: stat d0/d21/le0 0 2023-12-08T20:28:27.443 INFO:tasks.workunit.client.0.smithi043.stdout:4/739: dwrite d1/d14/d25/d39/d3f/d59/f96 [0,4194304] 0 2023-12-08T20:28:27.443 INFO:tasks.workunit.client.0.smithi043.stdout:1/807: dwrite d1/d16/d48/fff [0,4194304] 0 2023-12-08T20:28:27.445 INFO:tasks.workunit.client.0.smithi043.stdout:4/740: symlink d1/d14/d1d/d58/dd9/lfe 0 2023-12-08T20:28:27.445 INFO:tasks.workunit.client.0.smithi043.stdout:4/741: write d1/d14/f87 [173094,56660] 0 2023-12-08T20:28:27.448 INFO:tasks.workunit.client.0.smithi043.stdout:4/742: getdents d1/d14/d25/d28 0 2023-12-08T20:28:27.449 INFO:tasks.workunit.client.0.smithi043.stdout:4/743: creat d1/d14/d25/d39/d3d/d40/d67/fff x:0 0 0 2023-12-08T20:28:27.449 INFO:tasks.workunit.client.0.smithi043.stdout:4/744: chown d1/d14/d25/d39/d3f/d3c/cec 769718729 1 2023-12-08T20:28:27.450 INFO:tasks.workunit.client.0.smithi043.stdout:4/745: mkdir d1/d14/d100 0 2023-12-08T20:28:27.450 INFO:tasks.workunit.client.0.smithi043.stdout:4/746: chown d1/d14/d25/d39/d3d/d40/fb5 9632 1 2023-12-08T20:28:27.450 INFO:tasks.workunit.client.0.smithi043.stdout:4/747: truncate d1/d14/d25/f2c 1214792 0 2023-12-08T20:28:27.451 INFO:tasks.workunit.client.0.smithi043.stdout:1/808: write d1/d16/d21/d42/f5c [3923556,29140] 0 2023-12-08T20:28:27.451 INFO:tasks.workunit.client.0.smithi043.stdout:4/748: truncate d1/d14/f18 6817439 0 2023-12-08T20:28:27.452 INFO:tasks.workunit.client.0.smithi043.stdout:4/749: creat d1/d14/d50/f101 x:0 0 0 2023-12-08T20:28:27.452 INFO:tasks.workunit.client.0.smithi043.stdout:4/750: stat d1/d14/d25/d39/d3d/d40/d67/fff 0 2023-12-08T20:28:27.455 INFO:tasks.workunit.client.0.smithi043.stdout:4/751: creat d1/d14/d25/d77/da4/dc0/def/f102 x:0 0 0 2023-12-08T20:28:27.455 INFO:tasks.workunit.client.0.smithi043.stdout:4/752: dread - d1/d14/d25/d39/d3d/d40/d67/d7f/ff3 zero size 2023-12-08T20:28:27.456 INFO:tasks.workunit.client.0.smithi043.stdout:9/804: dwrite d0/fa5 [0,4194304] 0 2023-12-08T20:28:27.466 INFO:tasks.workunit.client.0.smithi043.stdout:9/805: dread d0/d5e/f10a [0,4194304] 0 2023-12-08T20:28:27.468 INFO:tasks.workunit.client.0.smithi043.stdout:9/806: creat d0/d21/d80/d8e/f10c x:0 0 0 2023-12-08T20:28:27.469 INFO:tasks.workunit.client.0.smithi043.stdout:9/807: write d0/d3d/d4b/f91 [4106037,747] 0 2023-12-08T20:28:27.470 INFO:tasks.workunit.client.0.smithi043.stdout:4/753: dwrite d1/d14/d25/f29 [0,4194304] 0 2023-12-08T20:28:27.470 INFO:tasks.workunit.client.0.smithi043.stdout:4/754: write d1/d14/d25/d28/d8a/f9b [847975,39188] 0 2023-12-08T20:28:27.470 INFO:tasks.workunit.client.0.smithi043.stdout:9/808: link d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d94/lb6 d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d94/l10d 0 2023-12-08T20:28:27.473 INFO:tasks.workunit.client.0.smithi043.stdout:9/809: symlink d0/d21/d80/d8e/df6/l10e 0 2023-12-08T20:28:27.475 INFO:tasks.workunit.client.0.smithi043.stdout:9/810: symlink d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d6c/l10f 0 2023-12-08T20:28:27.484 INFO:tasks.workunit.client.0.smithi043.stdout:9/811: dread d0/d5e/f59 [0,4194304] 0 2023-12-08T20:28:27.492 INFO:tasks.workunit.client.0.smithi043.stdout:9/812: dread d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d6c/faa [0,4194304] 0 2023-12-08T20:28:27.506 INFO:tasks.workunit.client.0.smithi043.stdout:9/813: dwrite d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d6c/f7b [0,4194304] 0 2023-12-08T20:28:27.562 INFO:tasks.workunit.client.0.smithi043.stdout:0/979: sync 2023-12-08T20:28:27.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.538+0000 7f2f86d38700 1 -- 172.21.15.43:0/2635633593 --> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f8010f470 con 0x7f2f7006ae40 2023-12-08T20:28:27.563 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:28:27.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.540+0000 7f2f7d7fa700 1 -- 172.21.15.43:0/2635633593 <== mgr.24407 v2:172.21.15.111:6828/940639390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f2f8010f470 con 0x7f2f7006ae40 2023-12-08T20:28:27.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.542+0000 7f2f86d38700 1 -- 172.21.15.43:0/2635633593 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f2f7006ae40 msgr2=0x7f2f7006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:27.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.542+0000 7f2f86d38700 1 --2- 172.21.15.43:0/2635633593 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f2f7006ae40 0x7f2f7006d2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c00b3b0 tx=0x7f2f6c009e30 comp rx=0 tx=0).stop 2023-12-08T20:28:27.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.542+0000 7f2f86d38700 1 -- 172.21.15.43:0/2635633593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f80066030 msgr2=0x7f2f8010d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:27.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.542+0000 7f2f86d38700 1 --2- 172.21.15.43:0/2635633593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f80066030 0x7f2f8010d540 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2f74002a50 tx=0x7f2f740046b0 comp rx=0 tx=0).stop 2023-12-08T20:28:27.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.542+0000 7f2f86d38700 1 -- 172.21.15.43:0/2635633593 shutdown_connections 2023-12-08T20:28:27.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.542+0000 7f2f86d38700 1 --2- 172.21.15.43:0/2635633593 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f2f7006ae40 0x7f2f7006d2f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:27.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.542+0000 7f2f86d38700 1 --2- 172.21.15.43:0/2635633593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f80066030 0x7f2f8010d540 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:27.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.542+0000 7f2f86d38700 1 --2- 172.21.15.43:0/2635633593 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f800ffdd0 0x7f2f8010da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:27.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.542+0000 7f2f86d38700 1 -- 172.21.15.43:0/2635633593 >> 172.21.15.43:0/2635633593 conn(0x7f2f800f7190 msgr2=0x7f2f800f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:28:27.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.542+0000 7f2f86d38700 1 -- 172.21.15.43:0/2635633593 shutdown_connections 2023-12-08T20:28:27.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.542+0000 7f2f86d38700 1 -- 172.21.15.43:0/2635633593 wait complete. 2023-12-08T20:28:27.564 INFO:tasks.workunit.client.0.smithi043.stdout:0/980: creat d2/d61/d67/d113/f13b x:0 0 0 2023-12-08T20:28:27.564 INFO:tasks.workunit.client.0.smithi043.stdout:0/981: rmdir d2/d3/d18/d1e/d53/d10b/d39/d63/da6/dae/d105 39 2023-12-08T20:28:27.566 INFO:tasks.workunit.client.0.smithi043.stdout:0/982: symlink d2/d3/d18/d1e/d53/d7d/l13c 0 2023-12-08T20:28:27.566 INFO:tasks.workunit.client.0.smithi043.stdout:0/983: read d2/d3/d18/d1e/d88/f8b [2689652,63242] 0 2023-12-08T20:28:27.580 INFO:tasks.workunit.client.0.smithi043.stdout:0/984: dwrite d2/d3/d18/d1e/d53/d10b/d39/d83/fe7 [0,4194304] 0 2023-12-08T20:28:27.580 INFO:tasks.workunit.client.0.smithi043.stdout:0/985: truncate d2/d3/d18/d2b/da5/d3f/f7f 1641930 0 2023-12-08T20:28:27.637 INFO:tasks.workunit.client.0.smithi043.stdout:0/986: mknod d2/c13d 0 2023-12-08T20:28:27.637 INFO:tasks.workunit.client.0.smithi043.stdout:0/987: readlink d2/d4/l32 0 2023-12-08T20:28:27.639 INFO:tasks.workunit.client.0.smithi043.stdout:0/988: creat d2/d3/d18/d2b/da5/d5f/d13a/f13e x:0 0 0 2023-12-08T20:28:27.643 INFO:tasks.workunit.client.0.smithi043.stdout:0/989: mkdir d2/d3/d18/d1e/d53/d10b/d39/d83/d9d/d13f 0 2023-12-08T20:28:27.644 INFO:tasks.workunit.client.0.smithi043.stdout:0/990: write d2/d3/d18/d2b/da5/d5f/df0/ffb [2716727,52318] 0 2023-12-08T20:28:27.669 INFO:tasks.workunit.client.0.smithi043.stdout:0/991: dwrite d2/d61/d67/f134 [0,4194304] 0 2023-12-08T20:28:27.669 INFO:tasks.workunit.client.0.smithi043.stdout:0/992: chown d2/d3/d18/d2b/da5/d3f/ff8 7147303 1 2023-12-08T20:28:27.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.670+0000 7ffaa577a700 1 -- 172.21.15.43:0/284776432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffaa00fcbf0 msgr2=0x7ffaa00fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:27.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.670+0000 7ffaa577a700 1 --2- 172.21.15.43:0/284776432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffaa00fcbf0 0x7ffaa00fd000 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ffa90004940 tx=0x7ffa90009e30 comp rx=0 tx=0).stop 2023-12-08T20:28:27.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.670+0000 7ffaa577a700 1 -- 172.21.15.43:0/284776432 shutdown_connections 2023-12-08T20:28:27.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.670+0000 7ffaa577a700 1 --2- 172.21.15.43:0/284776432 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa00fde00 0x7ffaa00fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:27.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.670+0000 7ffaa577a700 1 --2- 172.21.15.43:0/284776432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffaa00fcbf0 0x7ffaa00fd000 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:27.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.670+0000 7ffaa577a700 1 -- 172.21.15.43:0/284776432 >> 172.21.15.43:0/284776432 conn(0x7ffaa00f82d0 msgr2=0x7ffaa00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:28:27.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.671+0000 7ffaa577a700 1 -- 172.21.15.43:0/284776432 shutdown_connections 2023-12-08T20:28:27.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.671+0000 7ffaa577a700 1 -- 172.21.15.43:0/284776432 wait complete. 2023-12-08T20:28:27.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.671+0000 7ffaa577a700 1 Processor -- start 2023-12-08T20:28:27.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.671+0000 7ffaa577a700 1 -- start start 2023-12-08T20:28:27.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.672+0000 7ffaa577a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa00fcbf0 0x7ffaa0071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:28:27.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.672+0000 7ffaa577a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffaa00fde00 0x7ffaa006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:28:27.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.672+0000 7ffaa577a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa0070590 con 0x7ffaa00fde00 2023-12-08T20:28:27.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.672+0000 7ffaa577a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa0070700 con 0x7ffaa00fcbf0 2023-12-08T20:28:27.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.672+0000 7ffa9effd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa00fcbf0 0x7ffaa0071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:28:27.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.672+0000 7ffa9effd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa00fcbf0 0x7ffaa0071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.43:36842/0 (socket says 172.21.15.43:36842) 2023-12-08T20:28:27.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.672+0000 7ffa9effd700 1 -- 172.21.15.43:0/3779852640 learned_addr learned my addr 172.21.15.43:0/3779852640 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:28:27.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.672+0000 7ffa9effd700 1 -- 172.21.15.43:0/3779852640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffaa00fde00 msgr2=0x7ffaa006ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:27.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.672+0000 7ffa9effd700 1 --2- 172.21.15.43:0/3779852640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffaa00fde00 0x7ffaa006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:27.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.672+0000 7ffa9effd700 1 -- 172.21.15.43:0/3779852640 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa90005040 con 0x7ffaa00fcbf0 2023-12-08T20:28:27.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.673+0000 7ffa9effd700 1 --2- 172.21.15.43:0/3779852640 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa00fcbf0 0x7ffaa0071b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffa90000c00 tx=0x7ffa90009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:28:27.675 INFO:tasks.workunit.client.0.smithi043.stdout:0/993: rmdir d2/d61/d8a/d100 0 2023-12-08T20:28:27.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.673+0000 7ffa877fe700 1 -- 172.21.15.43:0/3779852640 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa9000e040 con 0x7ffaa00fcbf0 2023-12-08T20:28:27.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.673+0000 7ffa877fe700 1 -- 172.21.15.43:0/3779852640 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffa90009af0 con 0x7ffaa00fcbf0 2023-12-08T20:28:27.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.673+0000 7ffa877fe700 1 -- 172.21.15.43:0/3779852640 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa9001c630 con 0x7ffaa00fcbf0 2023-12-08T20:28:27.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.673+0000 7ffaa577a700 1 -- 172.21.15.43:0/3779852640 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa0070980 con 0x7ffaa00fcbf0 2023-12-08T20:28:27.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.673+0000 7ffaa577a700 1 -- 172.21.15.43:0/3779852640 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa0115500 con 0x7ffaa00fcbf0 2023-12-08T20:28:27.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.676+0000 7ffa877fe700 1 -- 172.21.15.43:0/3779852640 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7ffa9000bcd0 con 0x7ffaa00fcbf0 2023-12-08T20:28:27.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.676+0000 7ffaa577a700 1 -- 172.21.15.43:0/3779852640 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa004bb80 con 0x7ffaa00fcbf0 2023-12-08T20:28:27.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.676+0000 7ffa877fe700 1 --2- 172.21.15.43:0/3779852640 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7ffa8806ae90 0x7ffa8806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:28:27.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.676+0000 7ffa877fe700 1 -- 172.21.15.43:0/3779852640 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7ffa9008a600 con 0x7ffaa00fcbf0 2023-12-08T20:28:27.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.677+0000 7ffa9e7fc700 1 --2- 172.21.15.43:0/3779852640 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7ffa8806ae90 0x7ffa8806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:28:27.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.677+0000 7ffa9e7fc700 1 --2- 172.21.15.43:0/3779852640 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7ffa8806ae90 0x7ffa8806d340 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009b80 tx=0x7ffa94009d60 comp rx=0 tx=0).ready entity=mgr.24407 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:28:27.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.683+0000 7ffa877fe700 1 -- 172.21.15.43:0/3779852640 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7ffa90058360 con 0x7ffaa00fcbf0 2023-12-08T20:28:27.694 INFO:tasks.workunit.client.0.smithi043.stdout:0/994: dwrite d2/d3/d18/d1e/d53/d10b/d39/d83/fb5 [0,4194304] 0 2023-12-08T20:28:27.773 INFO:tasks.workunit.client.0.smithi043.stdout:7/816: sync 2023-12-08T20:28:27.773 INFO:tasks.workunit.client.0.smithi043.stdout:6/746: sync 2023-12-08T20:28:27.775 INFO:tasks.workunit.client.0.smithi043.stdout:7/817: getdents d0/d2/d65/d99/d47/dd6 0 2023-12-08T20:28:27.775 INFO:tasks.workunit.client.0.smithi043.stdout:7/818: write d0/d2/d65/d83/fb9 [2520673,68494] 0 2023-12-08T20:28:27.777 INFO:tasks.workunit.client.0.smithi043.stdout:6/747: creat d0/d2/d14/db3/df1/d22/fff x:0 0 0 2023-12-08T20:28:27.784 INFO:tasks.workunit.client.0.smithi043.stdout:7/819: dread d0/d6/d17/d54/f80 [0,4194304] 0 2023-12-08T20:28:27.806 INFO:tasks.workunit.client.0.smithi043.stdout:7/820: dwrite d0/d6/d17/d54/f82 [0,4194304] 0 2023-12-08T20:28:27.806 INFO:tasks.workunit.client.0.smithi043.stdout:7/821: mknod d0/d2/d12/c10a 0 2023-12-08T20:28:27.807 INFO:tasks.workunit.client.0.smithi043.stdout:7/822: chown d0/d6/d17/d52/dac 62 1 2023-12-08T20:28:27.807 INFO:tasks.workunit.client.0.smithi043.stdout:7/823: chown d0/d6/d17/d52/caa 0 1 2023-12-08T20:28:27.877 INFO:tasks.workunit.client.0.smithi043.stdout:8/887: sync 2023-12-08T20:28:27.878 INFO:tasks.workunit.client.0.smithi043.stdout:5/815: sync 2023-12-08T20:28:27.878 INFO:tasks.workunit.client.0.smithi043.stdout:3/835: sync 2023-12-08T20:28:27.878 INFO:tasks.workunit.client.0.smithi043.stdout:5/816: chown d3/d7/d90 1907628 1 2023-12-08T20:28:27.878 INFO:tasks.workunit.client.0.smithi043.stdout:8/888: dread - d2/f9d zero size 2023-12-08T20:28:27.878 INFO:tasks.workunit.client.0.smithi043.stdout:3/836: truncate d1/d9/d2d/f70 431131 0 2023-12-08T20:28:27.878 INFO:tasks.workunit.client.0.smithi043.stdout:5/817: chown d3/d7/de/d43/d68/fc8 5715348 1 2023-12-08T20:28:27.878 INFO:tasks.workunit.client.0.smithi043.stdout:5/818: truncate d3/d7/de/d82/d8b/f93 4576882 0 2023-12-08T20:28:27.880 INFO:tasks.workunit.client.0.smithi043.stdout:8/889: rename d2/d20/d7d/d29/d59/d9f/c11a to d2/d27/d2d/de2/c122 0 2023-12-08T20:28:27.881 INFO:tasks.workunit.client.0.smithi043.stdout:3/837: mknod d1/d25/d2a/dd0/c10e 0 2023-12-08T20:28:27.883 INFO:tasks.workunit.client.0.smithi043.stdout:5/819: rename d3/d73/d83/d99/c9f to d3/d7/d21/cfb 0 2023-12-08T20:28:27.884 INFO:tasks.workunit.client.0.smithi043.stdout:8/890: symlink d2/d20/d7d/d29/d59/d86/l123 0 2023-12-08T20:28:27.886 INFO:tasks.workunit.client.0.smithi043.stdout:3/838: unlink d1/d9/df/d6e/c82 0 2023-12-08T20:28:27.886 INFO:tasks.workunit.client.0.smithi043.stdout:5/820: creat d3/d78/dc4/ffc x:0 0 0 2023-12-08T20:28:27.889 INFO:tasks.workunit.client.0.smithi043.stdout:8/891: link d2/d20/d7d/d29/d30/d7c/c97 d2/d20/d7d/d29/d30/d60/d9b/dee/c124 0 2023-12-08T20:28:27.889 INFO:tasks.workunit.client.0.smithi043.stdout:8/892: chown d2/f3e 31970 1 2023-12-08T20:28:27.891 INFO:tasks.workunit.client.0.smithi043.stdout:5/821: link d3/d7/d29/f3c d3/d7/d21/d72/ffd 0 2023-12-08T20:28:27.891 INFO:tasks.workunit.client.0.smithi043.stdout:5/822: chown d3/d7/d21/d72/ded 179 1 2023-12-08T20:28:27.892 INFO:tasks.workunit.client.0.smithi043.stdout:3/839: symlink d1/d1c/d29/l10f 0 2023-12-08T20:28:27.901 INFO:tasks.workunit.client.0.smithi043.stdout:5/823: dread d3/d7/d21/d72/fd1 [0,4194304] 0 2023-12-08T20:28:27.902 INFO:tasks.workunit.client.0.smithi043.stdout:5/824: symlink d3/d78/dc4/lfe 0 2023-12-08T20:28:27.903 INFO:tasks.workunit.client.0.smithi043.stdout:5/825: mknod d3/d7/de/d6a/cff 0 2023-12-08T20:28:27.903 INFO:tasks.workunit.client.0.smithi043.stdout:5/826: write d3/d7/de/d82/d95/fe2 [471167,68816] 0 2023-12-08T20:28:27.904 INFO:tasks.workunit.client.0.smithi043.stdout:5/827: creat d3/d73/f100 x:0 0 0 2023-12-08T20:28:27.905 INFO:tasks.workunit.client.0.smithi043.stdout:3/840: dwrite d1/d9/df/ddb/f100 [0,4194304] 0 2023-12-08T20:28:27.906 INFO:tasks.workunit.client.0.smithi043.stdout:5/828: rename d3/d7/d19/fde to d3/f101 0 2023-12-08T20:28:27.908 INFO:tasks.workunit.client.0.smithi043.stdout:3/841: mkdir d1/d9/d38/d4f/d5a/d110 0 2023-12-08T20:28:27.912 INFO:tasks.workunit.client.0.smithi043.stdout:5/829: rename d3/d7/d19/d3f/l6c to d3/d7/de/d43/l102 0 2023-12-08T20:28:27.914 INFO:tasks.workunit.client.0.smithi043.stdout:5/830: mknod d3/d7/d19/d3f/d52/c103 0 2023-12-08T20:28:27.923 INFO:tasks.workunit.client.0.smithi043.stdout:3/842: dwrite d1/d25/d2a/df6/ffe [0,4194304] 0 2023-12-08T20:28:27.923 INFO:tasks.workunit.client.0.smithi043.stdout:3/843: truncate d1/d1c/d8b/fef 794063 0 2023-12-08T20:28:27.927 INFO:tasks.workunit.client.0.smithi043.stdout:3/844: rename d1/d9/d38/d30/d56/d10d to d1/d9/d2d/d42/d111 0 2023-12-08T20:28:27.929 INFO:tasks.workunit.client.0.smithi043.stdout:3/845: mkdir d1/d9/d38/d112 0 2023-12-08T20:28:27.929 INFO:tasks.workunit.client.0.smithi043.stdout:3/846: read d1/d25/f31 [370308,118117] 0 2023-12-08T20:28:27.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.944+0000 7ffaa577a700 1 -- 172.21.15.43:0/3779852640 --> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffaa0102750 con 0x7ffa8806ae90 2023-12-08T20:28:27.946 INFO:tasks.workunit.client.0.smithi043.stdout:3/847: dwrite d1/d1c/fdc [0,4194304] 0 2023-12-08T20:28:27.946 INFO:tasks.workunit.client.0.smithi043.stdout:3/848: stat d1/d9/d38/d4f/f8c 0 2023-12-08T20:28:27.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.946+0000 7ffa877fe700 1 -- 172.21.15.43:0/3779852640 <== mgr.24407 v2:172.21.15.111:6828/940639390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7ffaa0102750 con 0x7ffa8806ae90 2023-12-08T20:28:27.948 INFO:tasks.workunit.client.0.smithi043.stdout:4/755: sync 2023-12-08T20:28:27.948 INFO:tasks.workunit.client.0.smithi043.stdout:1/809: sync 2023-12-08T20:28:27.948 INFO:tasks.workunit.client.0.smithi043.stdout:9/814: sync 2023-12-08T20:28:27.948 INFO:tasks.workunit.client.0.smithi043.stdout:1/810: dread - d1/d16/d21/d25/d3e/dbc/db8/fd5 zero size 2023-12-08T20:28:27.950 INFO:tasks.workunit.client.0.smithi043.stdout:3/849: mkdir d1/d9/d38/d4f/d8f/d113 0 2023-12-08T20:28:27.950 INFO:tasks.workunit.client.0.smithi043.stdout:3/850: write d1/d9/d38/d4f/f79 [5066546,57553] 0 2023-12-08T20:28:27.950 INFO:tasks.workunit.client.0.smithi043.stdout:3/851: chown d1/d9/d38/d33/f63 16 1 2023-12-08T20:28:27.950 INFO:tasks.workunit.client.0.smithi043.stdout:3/852: stat d1/d25/dc1/ce2 0 2023-12-08T20:28:27.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.949+0000 7ffaa577a700 1 -- 172.21.15.43:0/3779852640 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7ffa8806ae90 msgr2=0x7ffa8806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:27.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.949+0000 7ffaa577a700 1 --2- 172.21.15.43:0/3779852640 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7ffa8806ae90 0x7ffa8806d340 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009b80 tx=0x7ffa94009d60 comp rx=0 tx=0).stop 2023-12-08T20:28:27.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.949+0000 7ffaa577a700 1 -- 172.21.15.43:0/3779852640 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa00fcbf0 msgr2=0x7ffaa0071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:27.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.949+0000 7ffaa577a700 1 --2- 172.21.15.43:0/3779852640 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa00fcbf0 0x7ffaa0071b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffa90000c00 tx=0x7ffa90009e30 comp rx=0 tx=0).stop 2023-12-08T20:28:27.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.949+0000 7ffaa577a700 1 -- 172.21.15.43:0/3779852640 shutdown_connections 2023-12-08T20:28:27.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.949+0000 7ffaa577a700 1 --2- 172.21.15.43:0/3779852640 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7ffa8806ae90 0x7ffa8806d340 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:27.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.949+0000 7ffaa577a700 1 --2- 172.21.15.43:0/3779852640 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa00fcbf0 0x7ffaa0071b10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:27.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.949+0000 7ffaa577a700 1 --2- 172.21.15.43:0/3779852640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffaa00fde00 0x7ffaa006ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:27.951 INFO:tasks.workunit.client.0.smithi043.stdout:1/811: mknod d1/d16/d21/d25/d3e/d72/c126 0 2023-12-08T20:28:27.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.949+0000 7ffaa577a700 1 -- 172.21.15.43:0/3779852640 >> 172.21.15.43:0/3779852640 conn(0x7ffaa00f82d0 msgr2=0x7ffaa0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:28:27.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.949+0000 7ffaa577a700 1 -- 172.21.15.43:0/3779852640 shutdown_connections 2023-12-08T20:28:27.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:27.949+0000 7ffaa577a700 1 -- 172.21.15.43:0/3779852640 wait complete. 2023-12-08T20:28:27.952 INFO:tasks.workunit.client.0.smithi043.stdout:3/853: read d1/d1c/d2c/d5f/fb5 [319150,39169] 0 2023-12-08T20:28:27.952 INFO:tasks.workunit.client.0.smithi043.stdout:9/815: rename d0/d21/dc1 to d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d110 0 2023-12-08T20:28:27.952 INFO:tasks.workunit.client.0.smithi043.stdout:9/816: dread - d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d94/fff zero size 2023-12-08T20:28:27.952 INFO:tasks.workunit.client.0.smithi043.stdout:4/756: dread d1/d14/d50/f53 [0,4194304] 0 2023-12-08T20:28:27.953 INFO:tasks.workunit.client.0.smithi043.stdout:1/812: truncate d1/d16/d48/fff 1743492 0 2023-12-08T20:28:27.953 INFO:tasks.workunit.client.0.smithi043.stdout:3/854: creat d1/d25/d2a/d45/f114 x:0 0 0 2023-12-08T20:28:27.954 INFO:tasks.workunit.client.0.smithi043.stdout:1/813: creat d1/d16/d21/d25/d3e/df8/f127 x:0 0 0 2023-12-08T20:28:27.954 INFO:tasks.workunit.client.0.smithi043.stdout:9/817: symlink d0/d3d/l111 0 2023-12-08T20:28:27.955 INFO:tasks.workunit.client.0.smithi043.stdout:4/757: creat d1/d14/d25/d77/da4/dc0/def/f103 x:0 0 0 2023-12-08T20:28:27.956 INFO:tasks.workunit.client.0.smithi043.stdout:9/818: mknod d0/d3d/d4b/da2/c112 0 2023-12-08T20:28:27.964 INFO:tasks.workunit.client.0.smithi043.stdout:3/855: dread d1/d9/f19 [0,4194304] 0 2023-12-08T20:28:27.966 INFO:tasks.workunit.client.0.smithi043.stdout:3/856: dread d1/d1c/d8b/fef [0,4194304] 0 2023-12-08T20:28:27.966 INFO:tasks.workunit.client.0.smithi043.stdout:1/814: write d1/d16/d30/d6e/d83/fdf [1031412,56669] 0 2023-12-08T20:28:27.967 INFO:tasks.workunit.client.0.smithi043.stdout:3/857: symlink d1/d1c/l115 0 2023-12-08T20:28:27.968 INFO:tasks.workunit.client.0.smithi043.stdout:3/858: getdents d1/d25/d84 0 2023-12-08T20:28:27.968 INFO:tasks.workunit.client.0.smithi043.stdout:3/859: write d1/d1c/d29/fa5 [1624042,92586] 0 2023-12-08T20:28:27.968 INFO:tasks.workunit.client.0.smithi043.stdout:3/860: chown d1/d9/f48 13799 1 2023-12-08T20:28:27.968 INFO:tasks.workunit.client.0.smithi043.stdout:3/861: write d1/d25/d2a/d45/f114 [14319,96874] 0 2023-12-08T20:28:27.969 INFO:tasks.workunit.client.0.smithi043.stdout:1/815: rename d1/d6/f68 to d1/d16/d7e/f128 0 2023-12-08T20:28:27.969 INFO:tasks.workunit.client.0.smithi043.stdout:1/816: read - d1/d16/d1c/d4e/fef zero size 2023-12-08T20:28:27.969 INFO:tasks.workunit.client.0.smithi043.stdout:3/862: write d1/d9/f19 [3452550,28109] 0 2023-12-08T20:28:27.971 INFO:tasks.workunit.client.0.smithi043.stdout:1/817: creat d1/d16/d30/d4f/f129 x:0 0 0 2023-12-08T20:28:27.972 INFO:tasks.workunit.client.0.smithi043.stdout:1/818: mknod d1/d16/d21/d25/d3e/c12a 0 2023-12-08T20:28:27.973 INFO:tasks.workunit.client.0.smithi043.stdout:3/863: mkdir d1/d9/df/ddb/d10c/d116 0 2023-12-08T20:28:27.974 INFO:tasks.workunit.client.0.smithi043.stdout:1/819: link d1/d16/d21/d25/d35/f9d d1/d16/d7e/f12b 0 2023-12-08T20:28:27.976 INFO:tasks.workunit.client.0.smithi043.stdout:4/758: dwrite d1/d14/d25/d39/fd4 [0,4194304] 0 2023-12-08T20:28:27.978 INFO:tasks.workunit.client.0.smithi043.stdout:9/819: dwrite d0/d3d/dd4/ff7 [0,4194304] 0 2023-12-08T20:28:27.985 INFO:tasks.workunit.client.0.smithi043.stdout:3/864: rename d1/d9/df/d6e/fd2 to d1/d25/dc1/f117 0 2023-12-08T20:28:27.991 INFO:tasks.workunit.client.0.smithi043.stdout:4/759: dread d1/d14/f24 [0,4194304] 0 2023-12-08T20:28:27.993 INFO:tasks.workunit.client.0.smithi043.stdout:3/865: creat d1/d25/dc1/f118 x:0 0 0 2023-12-08T20:28:27.994 INFO:tasks.workunit.client.0.smithi043.stdout:4/760: mknod d1/d14/d25/d39/d3f/c104 0 2023-12-08T20:28:27.994 INFO:tasks.workunit.client.0.smithi043.stdout:4/761: chown d1/d14/d25/d39/d3d/d40/d67/d88/lad 1050 1 2023-12-08T20:28:27.994 INFO:tasks.workunit.client.0.smithi043.stdout:1/820: dwrite d1/d16/d30/d4f/fd8 [4194304,4194304] 0 2023-12-08T20:28:27.994 INFO:tasks.workunit.client.0.smithi043.stdout:4/762: dread - d1/d14/d50/f101 zero size 2023-12-08T20:28:27.995 INFO:tasks.workunit.client.0.smithi043.stdout:3/866: link d1/d9/d2d/d91/dda/l8e d1/d9/d38/d4a/dbd/l119 0 2023-12-08T20:28:27.995 INFO:tasks.workunit.client.0.smithi043.stdout:4/763: mknod d1/d14/d25/d39/da3/c105 0 2023-12-08T20:28:27.996 INFO:tasks.workunit.client.0.smithi043.stdout:3/867: write d1/d25/d84/d9a/f7a [1789031,102110] 0 2023-12-08T20:28:27.996 INFO:tasks.workunit.client.0.smithi043.stdout:3/868: readlink d1/d1c/d29/la3 0 2023-12-08T20:28:27.996 INFO:tasks.workunit.client.0.smithi043.stdout:4/764: mkdir d1/d14/d106 0 2023-12-08T20:28:27.996 INFO:tasks.workunit.client.0.smithi043.stdout:4/765: fdatasync d1/d14/d25/d39/d3d/d40/d67/fff 0 2023-12-08T20:28:27.997 INFO:tasks.workunit.client.0.smithi043.stdout:4/766: rmdir d1/d14/d25/d77/d8d 39 2023-12-08T20:28:27.998 INFO:tasks.workunit.client.0.smithi043.stdout:4/767: creat d1/d14/d25/d28/f107 x:0 0 0 2023-12-08T20:28:27.999 INFO:tasks.workunit.client.0.smithi043.stdout:9/820: dwrite d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d6c/f7b [0,4194304] 0 2023-12-08T20:28:28.000 INFO:tasks.workunit.client.0.smithi043.stdout:1/821: creat d1/d16/d30/d6e/d83/d112/d119/f12c x:0 0 0 2023-12-08T20:28:28.000 INFO:tasks.workunit.client.0.smithi043.stdout:1/822: chown d1/d16/d21/d60/c96 22257 1 2023-12-08T20:28:28.000 INFO:tasks.workunit.client.0.smithi043.stdout:4/768: rename d1/d14/d50/f53 to d1/d14/d25/f108 0 2023-12-08T20:28:28.000 INFO:tasks.workunit.client.0.smithi043.stdout:4/769: write d1/d14/f26 [9562725,79841] 0 2023-12-08T20:28:28.001 INFO:tasks.workunit.client.0.smithi043.stdout:3/869: write d1/d9/df/d26/fd8 [270305,112596] 0 2023-12-08T20:28:28.002 INFO:tasks.workunit.client.0.smithi043.stdout:1/823: dread d1/d16/d21/d25/d35/fac [0,4194304] 0 2023-12-08T20:28:28.002 INFO:tasks.workunit.client.0.smithi043.stdout:9/821: mkdir d0/d3d/dd4/df2/d113 0 2023-12-08T20:28:28.002 INFO:tasks.workunit.client.0.smithi043.stdout:1/824: chown d1/d16/d21/d25/d3e/d77/d106 62139144 1 2023-12-08T20:28:28.003 INFO:tasks.workunit.client.0.smithi043.stdout:1/825: dread d1/d16/d48/f65 [0,4194304] 0 2023-12-08T20:28:28.004 INFO:tasks.workunit.client.0.smithi043.stdout:9/822: dread d0/d21/f74 [0,4194304] 0 2023-12-08T20:28:28.004 INFO:tasks.workunit.client.0.smithi043.stdout:4/770: mkdir d1/d14/d25/d28/d94/dd0/d109 0 2023-12-08T20:28:28.004 INFO:tasks.workunit.client.0.smithi043.stdout:4/771: fdatasync d1/d14/d25/d39/d3d/d40/d67/f83 0 2023-12-08T20:28:28.004 INFO:tasks.workunit.client.0.smithi043.stdout:9/823: read d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d76/dd3/fdc [16340,99313] 0 2023-12-08T20:28:28.005 INFO:tasks.workunit.client.0.smithi043.stdout:3/870: getdents d1/d9/df 0 2023-12-08T20:28:28.007 INFO:tasks.workunit.client.0.smithi043.stdout:9/824: symlink d0/d5e/d73/deb/l114 0 2023-12-08T20:28:28.008 INFO:tasks.workunit.client.0.smithi043.stdout:1/826: mkdir d1/d16/d1c/d4e/d12d 0 2023-12-08T20:28:28.011 INFO:tasks.workunit.client.0.smithi043.stdout:9/825: truncate d0/d3d/f83 3808819 0 2023-12-08T20:28:28.038 INFO:tasks.workunit.client.0.smithi043.stdout:4/772: dwrite d1/d14/d25/d77/da4/dc0/def/f102 [0,4194304] 0 2023-12-08T20:28:28.041 INFO:tasks.workunit.client.0.smithi043.stdout:3/871: dwrite d1/d9/df/ddb/d10c/dca/fcb [0,4194304] 0 2023-12-08T20:28:28.042 INFO:tasks.workunit.client.0.smithi043.stdout:1/827: dwrite d1/d6/f29 [0,4194304] 0 2023-12-08T20:28:28.042 INFO:tasks.workunit.client.0.smithi043.stdout:4/773: dread d1/d14/f31 [0,4194304] 0 2023-12-08T20:28:28.042 INFO:tasks.workunit.client.0.smithi043.stdout:9/826: dwrite d0/d21/ff4 [0,4194304] 0 2023-12-08T20:28:28.043 INFO:tasks.workunit.client.0.smithi043.stdout:4/774: creat d1/d14/d25/d39/da3/dae/f10a x:0 0 0 2023-12-08T20:28:28.043 INFO:tasks.workunit.client.0.smithi043.stdout:3/872: dread d1/d1c/d29/f5c [0,4194304] 0 2023-12-08T20:28:28.045 INFO:tasks.workunit.client.0.smithi043.stdout:9/827: unlink d0/d3d/d4b/da2/c112 0 2023-12-08T20:28:28.046 INFO:tasks.workunit.client.0.smithi043.stdout:4/775: creat d1/d14/d25/d39/d3f/d59/f10b x:0 0 0 2023-12-08T20:28:28.046 INFO:tasks.workunit.client.0.smithi043.stdout:1/828: getdents d1/d16/d21/d25/d3e/d72 0 2023-12-08T20:28:28.046 INFO:tasks.workunit.client.0.smithi043.stdout:1/829: chown d1/d16/l93 2106 1 2023-12-08T20:28:28.047 INFO:tasks.workunit.client.0.smithi043.stdout:3/873: unlink d1/d1c/d2c/c104 0 2023-12-08T20:28:28.048 INFO:tasks.workunit.client.0.smithi043.stdout:9/828: write d0/d21/ff4 [2542730,24716] 0 2023-12-08T20:28:28.048 INFO:tasks.workunit.client.0.smithi043.stdout:4/776: mknod d1/d14/d25/d39/d3d/d40/c10c 0 2023-12-08T20:28:28.050 INFO:tasks.workunit.client.0.smithi043.stdout:9/829: rmdir d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d6c 39 2023-12-08T20:28:28.051 INFO:tasks.workunit.client.0.smithi043.stdout:4/777: rename d1/d14/d1d/d58/fc4 to d1/d14/d25/d77/da4/f10d 0 2023-12-08T20:28:28.056 INFO:tasks.workunit.client.0.smithi043.stdout:9/830: rename d0/d21/d80/d8e/fb8 to d0/d3d/d4b/da2/f115 0 2023-12-08T20:28:28.058 INFO:tasks.workunit.client.0.smithi043.stdout:1/830: dread d1/d16/d1c/f44 [0,4194304] 0 2023-12-08T20:28:28.062 INFO:tasks.workunit.client.0.smithi043.stdout:1/831: creat d1/d16/d86/f12e x:0 0 0 2023-12-08T20:28:28.062 INFO:tasks.workunit.client.0.smithi043.stdout:1/832: readlink d1/d16/d7e/d10a/l104 0 2023-12-08T20:28:28.064 INFO:tasks.workunit.client.0.smithi043.stdout:1/833: mknod d1/d16/d21/d25/d3e/dbc/c12f 0 2023-12-08T20:28:28.064 INFO:tasks.workunit.client.0.smithi043.stdout:1/834: write d1/d16/d30/d6e/d83/ff7 [4395985,60089] 0 2023-12-08T20:28:28.065 INFO:tasks.workunit.client.0.smithi043.stdout:1/835: stat d1/d16/d30/d4f/d54 0 2023-12-08T20:28:28.066 INFO:tasks.workunit.client.0.smithi043.stdout:3/874: dwrite d1/d9/df/ddb/d10c/dca/dd4/fde [0,4194304] 0 2023-12-08T20:28:28.068 INFO:tasks.workunit.client.0.smithi043.stdout:1/836: creat d1/d16/d30/d6e/d83/d112/d119/f130 x:0 0 0 2023-12-08T20:28:28.068 INFO:tasks.workunit.client.0.smithi043.stdout:1/837: fsync d1/d16/f105 0 2023-12-08T20:28:28.073 INFO:tasks.workunit.client.0.smithi043.stdout:4/778: dwrite d1/d14/d25/d39/da3/ff8 [0,4194304] 0 2023-12-08T20:28:28.073 INFO:tasks.workunit.client.0.smithi043.stdout:4/779: fdatasync d1/d14/d25/d39/d3d/d40/f6c 0 2023-12-08T20:28:28.077 INFO:tasks.workunit.client.0.smithi043.stdout:1/838: symlink d1/d16/d21/dc8/l131 0 2023-12-08T20:28:28.079 INFO:tasks.workunit.client.0.smithi043.stdout:1/839: write d1/d16/d21/d25/d35/fb0 [1665064,89170] 0 2023-12-08T20:28:28.083 INFO:tasks.workunit.client.0.smithi043.stdout:1/840: unlink d1/d16/d1c/fa8 0 2023-12-08T20:28:28.087 INFO:tasks.workunit.client.0.smithi043.stdout:1/841: symlink d1/d16/d21/d6f/daa/l132 0 2023-12-08T20:28:28.091 INFO:tasks.workunit.client.0.smithi043.stdout:1/842: dread d1/d16/d1c/d4e/f7b [0,4194304] 0 2023-12-08T20:28:28.093 INFO:tasks.workunit.client.0.smithi043.stdout:4/780: dwrite d1/f73 [0,4194304] 0 2023-12-08T20:28:28.093 INFO:tasks.workunit.client.0.smithi043.stdout:3/875: dwrite d1/d9/d38/d33/f68 [0,4194304] 0 2023-12-08T20:28:28.093 INFO:tasks.workunit.client.0.smithi043.stdout:4/781: dread - d1/d14/d25/d39/d3d/d40/d67/fff zero size 2023-12-08T20:28:28.093 INFO:tasks.workunit.client.0.smithi043.stdout:4/782: getdents d1/d14/d25/d39/dd6/de0 0 2023-12-08T20:28:28.093 INFO:tasks.workunit.client.0.smithi043.stdout:1/843: link d1/db1/c115 d1/d16/d30/d4f/d54/c133 0 2023-12-08T20:28:28.094 INFO:tasks.workunit.client.0.smithi043.stdout:3/876: truncate d1/d9/d38/d4f/f8c 2552741 0 2023-12-08T20:28:28.095 INFO:tasks.workunit.client.0.smithi043.stdout:1/844: creat d1/d16/d21/d25/d35/f134 x:0 0 0 2023-12-08T20:28:28.095 INFO:tasks.workunit.client.0.smithi043.stdout:4/783: truncate d1/d14/d1d/f9d 1296717 0 2023-12-08T20:28:28.098 INFO:tasks.workunit.client.0.smithi043.stdout:4/784: creat d1/d14/d25/d39/d3f/d3c/d41/dab/f10e x:0 0 0 2023-12-08T20:28:28.099 INFO:tasks.workunit.client.0.smithi043.stdout:1/845: link d1/d16/d21/d25/d3e/cab d1/d16/d21/d25/c135 0 2023-12-08T20:28:28.099 INFO:tasks.workunit.client.0.smithi043.stdout:1/846: truncate d1/d16/d21/d25/d3e/dbc/db8/fd5 736534 0 2023-12-08T20:28:28.104 INFO:tasks.workunit.client.0.smithi043.stdout:1/847: creat d1/d16/d1c/d4e/f136 x:0 0 0 2023-12-08T20:28:28.106 INFO:tasks.workunit.client.0.smithi043.stdout:4/785: dread d1/d14/f45 [0,4194304] 0 2023-12-08T20:28:28.109 INFO:tasks.workunit.client.0.smithi043.stdout:4/786: rename d1/d14/d25/d77/da4/dc0/def/f102 to d1/d14/d25/d39/d3f/d59/ddc/f10f 0 2023-12-08T20:28:28.109 INFO:tasks.workunit.client.0.smithi043.stdout:3/877: write d1/d25/d84/d9a/f7a [3095633,75893] 0 2023-12-08T20:28:28.112 INFO:tasks.workunit.client.0.smithi043.stdout:3/878: unlink d1/d9/d38/d33/f63 0 2023-12-08T20:28:28.116 INFO:tasks.workunit.client.0.smithi043.stdout:3/879: rename d1/d9/df/ddb/d10c/dca/fcb to d1/d25/d2a/dd0/dbe/f11a 0 2023-12-08T20:28:28.118 INFO:tasks.workunit.client.0.smithi043.stdout:3/880: unlink d1/d25/d2a/dd0/fec 0 2023-12-08T20:28:28.118 INFO:tasks.workunit.client.0.smithi043.stdout:3/881: stat d1/d9/d38/d4f/cc6 0 2023-12-08T20:28:28.119 INFO:tasks.workunit.client.0.smithi043.stdout:3/882: mknod d1/d1c/d8b/c11b 0 2023-12-08T20:28:28.120 INFO:tasks.workunit.client.0.smithi043.stdout:1/848: dwrite d1/d16/d48/f53 [0,4194304] 0 2023-12-08T20:28:28.121 INFO:tasks.workunit.client.0.smithi043.stdout:3/883: symlink d1/d25/d2a/d85/l11c 0 2023-12-08T20:28:28.122 INFO:tasks.workunit.client.0.smithi043.stdout:3/884: dread d1/d9/d38/d4a/fb3 [0,4194304] 0 2023-12-08T20:28:28.126 INFO:tasks.workunit.client.0.smithi043.stdout:1/849: rename d1/d16/d21/l121 to d1/d16/d7e/d10a/l137 0 2023-12-08T20:28:28.126 INFO:tasks.workunit.client.0.smithi043.stdout:1/850: read - d1/d16/d1c/d4e/fef zero size 2023-12-08T20:28:28.128 INFO:tasks.workunit.client.0.smithi043.stdout:1/851: mkdir d1/d16/d1c/d138 0 2023-12-08T20:28:28.130 INFO:tasks.workunit.client.0.smithi043.stdout:4/787: dwrite d1/d14/d25/f2c [0,4194304] 0 2023-12-08T20:28:28.131 INFO:tasks.workunit.client.0.smithi043.stdout:1/852: creat d1/d16/d48/dd4/f139 x:0 0 0 2023-12-08T20:28:28.132 INFO:tasks.workunit.client.0.smithi043.stdout:4/788: mknod d1/d14/d25/d28/d94/dd0/c110 0 2023-12-08T20:28:28.133 INFO:tasks.workunit.client.0.smithi043.stdout:4/789: getdents d1/d14/d25/d28/d8a 0 2023-12-08T20:28:28.135 INFO:tasks.workunit.client.0.smithi043.stdout:1/853: truncate d1/d6/f9a 448882 0 2023-12-08T20:28:28.138 INFO:tasks.workunit.client.0.smithi043.stdout:1/854: creat d1/d16/d21/d25/d3e/df8/f13a x:0 0 0 2023-12-08T20:28:28.138 INFO:tasks.workunit.client.0.smithi043.stdout:4/790: dread d1/d14/d25/d39/d3f/f78 [0,4194304] 0 2023-12-08T20:28:28.139 INFO:tasks.workunit.client.0.smithi043.stdout:3/885: dwrite d1/d9/d2d/fa9 [0,4194304] 0 2023-12-08T20:28:28.141 INFO:tasks.workunit.client.0.smithi043.stdout:3/886: getdents d1/d9/d38/d4a 0 2023-12-08T20:28:28.145 INFO:tasks.workunit.client.0.smithi043.stdout:1/855: truncate d1/d16/d21/d25/d35/f62 4134003 0 2023-12-08T20:28:28.148 INFO:tasks.workunit.client.0.smithi043.stdout:1/856: creat d1/d16/d48/f13b x:0 0 0 2023-12-08T20:28:28.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.148+0000 7f114d1a1700 1 -- 172.21.15.43:0/710049517 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f114806eb60 msgr2=0x7f1148108c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.148+0000 7f114d1a1700 1 --2- 172.21.15.43:0/710049517 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f114806eb60 0x7f1148108c60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1138004940 tx=0x7f1138009e30 comp rx=0 tx=0).stop 2023-12-08T20:28:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.148+0000 7f114d1a1700 1 -- 172.21.15.43:0/710049517 shutdown_connections 2023-12-08T20:28:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.148+0000 7f114d1a1700 1 --2- 172.21.15.43:0/710049517 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f114806eb60 0x7f1148108c60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.148+0000 7f114d1a1700 1 --2- 172.21.15.43:0/710049517 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f114806e210 0x7f114806e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.148+0000 7f114d1a1700 1 -- 172.21.15.43:0/710049517 >> 172.21.15.43:0/710049517 conn(0x7f1148069b20 msgr2=0x7f114806bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:28:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.150+0000 7f114d1a1700 1 -- 172.21.15.43:0/710049517 shutdown_connections 2023-12-08T20:28:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.150+0000 7f114d1a1700 1 -- 172.21.15.43:0/710049517 wait complete. 2023-12-08T20:28:28.152 INFO:tasks.workunit.client.0.smithi043.stdout:1/857: symlink d1/d16/d21/d25/d3e/d72/l13c 0 2023-12-08T20:28:28.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.151+0000 7f114d1a1700 1 Processor -- start 2023-12-08T20:28:28.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.151+0000 7f114d1a1700 1 -- start start 2023-12-08T20:28:28.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.151+0000 7f114d1a1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f114806e210 0x7f114811c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:28:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.151+0000 7f114d1a1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f114806eb60 0x7f114811c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:28:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.151+0000 7f114d1a1700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114811cf70 con 0x7f114806e210 2023-12-08T20:28:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.151+0000 7f114d1a1700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114811d7b0 con 0x7f114806eb60 2023-12-08T20:28:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.151+0000 7f1146d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f114806e210 0x7f114811c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:28:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.152+0000 7f1146d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f114806e210 0x7f114811c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38452/0 (socket says 172.21.15.43:38452) 2023-12-08T20:28:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.152+0000 7f1146d9d700 1 -- 172.21.15.43:0/580384765 learned_addr learned my addr 172.21.15.43:0/580384765 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:28:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.152+0000 7f1146d9d700 1 -- 172.21.15.43:0/580384765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f114806eb60 msgr2=0x7f114811c8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-08T20:28:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.152+0000 7f1146d9d700 1 --2- 172.21.15.43:0/580384765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f114806eb60 0x7f114811c8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.152+0000 7f1146d9d700 1 -- 172.21.15.43:0/580384765 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1138005040 con 0x7f114806e210 2023-12-08T20:28:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.152+0000 7f1146d9d700 1 --2- 172.21.15.43:0/580384765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f114806e210 0x7f114811c3a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f113c00b790 tx=0x7f113c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:28:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.153+0000 7f112f7fe700 1 -- 172.21.15.43:0/580384765 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f113c00f6f0 con 0x7f114806e210 2023-12-08T20:28:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.153+0000 7f114d1a1700 1 -- 172.21.15.43:0/580384765 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114811da90 con 0x7f114806e210 2023-12-08T20:28:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.153+0000 7f112f7fe700 1 -- 172.21.15.43:0/580384765 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f113c00fd00 con 0x7f114806e210 2023-12-08T20:28:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.153+0000 7f112f7fe700 1 -- 172.21.15.43:0/580384765 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f113c011e90 con 0x7f114806e210 2023-12-08T20:28:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.153+0000 7f114d1a1700 1 -- 172.21.15.43:0/580384765 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114811dfd0 con 0x7f114806e210 2023-12-08T20:28:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.154+0000 7f114d1a1700 1 -- 172.21.15.43:0/580384765 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11340052e0 con 0x7f114806e210 2023-12-08T20:28:28.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.156+0000 7f112f7fe700 1 -- 172.21.15.43:0/580384765 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f113c00f850 con 0x7f114806e210 2023-12-08T20:28:28.157 INFO:tasks.workunit.client.0.smithi043.stdout:1/858: mknod d1/d16/d21/d25/d3e/d77/d9f/dc3/d110/dad/d102/c13d 0 2023-12-08T20:28:28.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.156+0000 7f112f7fe700 1 --2- 172.21.15.43:0/580384765 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f113006ae40 0x7f113006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:28:28.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.156+0000 7f112f7fe700 1 -- 172.21.15.43:0/580384765 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f113c0894f0 con 0x7f114806e210 2023-12-08T20:28:28.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.157+0000 7f114659c700 1 --2- 172.21.15.43:0/580384765 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f113006ae40 0x7f113006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:28:28.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.157+0000 7f114659c700 1 --2- 172.21.15.43:0/580384765 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f113006ae40 0x7f113006d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1138000c00 tx=0x7f1138009e30 comp rx=0 tx=0).ready entity=mgr.24407 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:28:28.159 INFO:tasks.workunit.client.0.smithi043.stdout:1/859: unlink d1/d16/d21/d25/d35/l3c 0 2023-12-08T20:28:28.160 INFO:tasks.workunit.client.0.smithi043.stdout:3/887: dwrite d1/d9/d38/d30/d56/f89 [0,4194304] 0 2023-12-08T20:28:28.162 INFO:tasks.workunit.client.0.smithi043.stdout:4/791: dwrite d1/d14/d1d/f4b [0,4194304] 0 2023-12-08T20:28:28.162 INFO:tasks.workunit.client.0.smithi043.stdout:4/792: chown d1/d14/d25/d39/d3d/d40/d67/d7f 6992 1 2023-12-08T20:28:28.164 INFO:tasks.workunit.client.0.smithi043.stdout:3/888: mkdir d1/d25/d2a/df6/d11d 0 2023-12-08T20:28:28.164 INFO:tasks.workunit.client.0.smithi043.stdout:3/889: fsync d1/d25/d2a/dd0/dbe/f11a 0 2023-12-08T20:28:28.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.163+0000 7f112f7fe700 1 -- 172.21.15.43:0/580384765 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f113c057360 con 0x7f114806e210 2023-12-08T20:28:28.166 INFO:tasks.workunit.client.0.smithi043.stdout:4/793: dread d1/d14/d50/f7a [0,4194304] 0 2023-12-08T20:28:28.166 INFO:tasks.workunit.client.0.smithi043.stdout:4/794: readlink d1/d14/d25/d39/d3d/d40/l57 0 2023-12-08T20:28:28.170 INFO:tasks.workunit.client.0.smithi043.stdout:4/795: rename d1/d14/d100 to d1/d14/d25/d39/dd6/d111 0 2023-12-08T20:28:28.170 INFO:tasks.workunit.client.0.smithi043.stdout:4/796: readlink d1/d14/d1d/d58/dd9/lfe 0 2023-12-08T20:28:28.170 INFO:tasks.workunit.client.0.smithi043.stdout:4/797: truncate d1/d14/d25/d39/d3f/d59/fac 5166575 0 2023-12-08T20:28:28.171 INFO:tasks.workunit.client.0.smithi043.stdout:3/890: write d1/d9/d38/d33/f68 [826412,3629] 0 2023-12-08T20:28:28.173 INFO:tasks.workunit.client.0.smithi043.stdout:4/798: mkdir d1/d14/d25/d39/d3f/d59/d112 0 2023-12-08T20:28:28.174 INFO:tasks.workunit.client.0.smithi043.stdout:3/891: symlink d1/d9/df/ddb/d10c/dca/dd4/l11e 0 2023-12-08T20:28:28.174 INFO:tasks.workunit.client.0.smithi043.stdout:3/892: fsync d1/d25/d84/d9a/f7a 0 2023-12-08T20:28:28.180 INFO:tasks.workunit.client.0.smithi043.stdout:1/860: dwrite d1/d16/d21/f51 [0,4194304] 0 2023-12-08T20:28:28.182 INFO:tasks.workunit.client.0.smithi043.stdout:1/861: dread d1/d6/d63/fea [0,4194304] 0 2023-12-08T20:28:28.183 INFO:tasks.workunit.client.0.smithi043.stdout:1/862: write d1/d16/d21/d25/d3e/dbc/db8/fd5 [120368,105859] 0 2023-12-08T20:28:28.190 INFO:tasks.workunit.client.0.smithi043.stdout:1/863: link d1/d16/d21/d25/d3e/d72/c126 d1/d16/d86/c13e 0 2023-12-08T20:28:28.195 INFO:tasks.workunit.client.0.smithi043.stdout:4/799: dwrite d1/d14/d25/d77/d93/fca [0,4194304] 0 2023-12-08T20:28:28.218 INFO:tasks.workunit.client.0.smithi043.stdout:4/800: write d1/d14/d25/d39/d3f/f3a [449021,101837] 0 2023-12-08T20:28:28.218 INFO:tasks.workunit.client.0.smithi043.stdout:4/801: fdatasync d1/d14/d25/d39/d3d/d40/d67/d7f/fa7 0 2023-12-08T20:28:28.218 INFO:tasks.workunit.client.0.smithi043.stdout:4/802: chown d1/d14/d1d/d58/f62 30280 1 2023-12-08T20:28:28.220 INFO:tasks.workunit.client.0.smithi043.stdout:4/803: rename d1/d14/d25/d28/d94/dd0/d109 to d1/d14/d25/d39/d3f/d3c/d41/d113 0 2023-12-08T20:28:28.221 INFO:tasks.workunit.client.0.smithi043.stdout:4/804: rename d1/d14/d25/d39/d3f/d59/l5c to d1/d14/d25/l114 0 2023-12-08T20:28:28.224 INFO:tasks.workunit.client.0.smithi043.stdout:4/805: mknod d1/d14/d25/d77/da4/c115 0 2023-12-08T20:28:28.224 INFO:tasks.workunit.client.0.smithi043.stdout:4/806: write d1/d14/d25/f2c [4220769,121610] 0 2023-12-08T20:28:28.224 INFO:tasks.workunit.client.0.smithi043.stdout:4/807: chown d1/d14/d25/d39/d3d/d40/d67/d88 35300287 1 2023-12-08T20:28:28.224 INFO:tasks.workunit.client.0.smithi043.stdout:4/808: truncate d1/d14/d25/f108 1938422 0 2023-12-08T20:28:28.226 INFO:tasks.workunit.client.0.smithi043.stdout:4/809: creat d1/d14/d25/d39/d3f/d3c/d41/d65/f116 x:0 0 0 2023-12-08T20:28:28.227 INFO:tasks.workunit.client.0.smithi043.stdout:4/810: write d1/d14/d25/d39/da3/dae/fb4 [4247533,107358] 0 2023-12-08T20:28:28.227 INFO:tasks.workunit.client.0.smithi043.stdout:4/811: write d1/d14/d50/f98 [4118904,77468] 0 2023-12-08T20:28:28.229 INFO:tasks.workunit.client.0.smithi043.stdout:1/864: dwrite d1/d16/d30/d6e/d83/ff7 [0,4194304] 0 2023-12-08T20:28:28.230 INFO:tasks.workunit.client.0.smithi043.stdout:4/812: read d1/d14/d25/d39/d3f/d3c/d41/fb8 [251895,33859] 0 2023-12-08T20:28:28.230 INFO:tasks.workunit.client.0.smithi043.stdout:4/813: write d1/d14/d25/d39/d3f/f78 [1287292,49802] 0 2023-12-08T20:28:28.230 INFO:tasks.workunit.client.0.smithi043.stdout:4/814: truncate d1/d14/d25/d39/d3f/d3c/d41/d65/f116 788517 0 2023-12-08T20:28:28.233 INFO:tasks.workunit.client.0.smithi043.stdout:1/865: unlink d1/d16/d21/d25/d3e/l52 0 2023-12-08T20:28:28.236 INFO:tasks.workunit.client.0.smithi043.stdout:1/866: write d1/d16/f46 [249816,41835] 0 2023-12-08T20:28:28.241 INFO:tasks.workunit.client.0.smithi043.stdout:1/867: mkdir d1/d16/d21/d25/d3e/d77/d106/d13f 0 2023-12-08T20:28:28.246 INFO:tasks.workunit.client.0.smithi043.stdout:1/868: getdents d1/d16/d30/d4f 0 2023-12-08T20:28:28.247 INFO:tasks.workunit.client.0.smithi043.stdout:4/815: dwrite d1/d14/d25/d39/d3f/d3c/d41/dab/f10e [0,4194304] 0 2023-12-08T20:28:28.249 INFO:tasks.workunit.client.0.smithi043.stdout:1/869: mkdir d1/d16/d21/d25/d35/d140 0 2023-12-08T20:28:28.250 INFO:tasks.workunit.client.0.smithi043.stdout:4/816: rename d1/d14/d25/d39/d3d/d40/l85 to d1/d14/d25/d39/d3d/l117 0 2023-12-08T20:28:28.250 INFO:tasks.workunit.client.0.smithi043.stdout:4/817: fdatasync d1/d14/d25/d39/d3f/f7e 0 2023-12-08T20:28:28.251 INFO:tasks.workunit.client.0.smithi043.stdout:4/818: truncate d1/d14/d25/d39/d3f/d3c/d80/f9f 2918889 0 2023-12-08T20:28:28.253 INFO:tasks.workunit.client.0.smithi043.stdout:4/819: creat d1/d14/d25/d28/d94/f118 x:0 0 0 2023-12-08T20:28:28.253 INFO:tasks.workunit.client.0.smithi043.stdout:4/820: chown d1/d14/d25/d39/d3f/d3c/d90/cb3 99 1 2023-12-08T20:28:28.254 INFO:tasks.workunit.client.0.smithi043.stdout:4/821: truncate d1/f73 2657724 0 2023-12-08T20:28:28.255 INFO:tasks.workunit.client.0.smithi043.stdout:4/822: creat d1/d14/d1d/d58/dd9/f119 x:0 0 0 2023-12-08T20:28:28.256 INFO:tasks.workunit.client.0.smithi043.stdout:4/823: mknod d1/d14/d25/d28/d94/dd0/c11a 0 2023-12-08T20:28:28.257 INFO:tasks.workunit.client.0.smithi043.stdout:4/824: write d1/d14/f48 [2064595,1253] 0 2023-12-08T20:28:28.259 INFO:tasks.workunit.client.0.smithi043.stdout:4/825: mkdir d1/d14/d25/d39/d3f/d11b 0 2023-12-08T20:28:28.261 INFO:tasks.workunit.client.0.smithi043.stdout:4/826: unlink d1/d14/d25/d39/d3d/d40/d67/d7f/ff3 0 2023-12-08T20:28:28.266 INFO:tasks.workunit.client.0.smithi043.stdout:4/827: dread d1/f10 [0,4194304] 0 2023-12-08T20:28:28.266 INFO:tasks.workunit.client.0.smithi043.stdout:4/828: write d1/d14/d25/d39/da3/dae/f10a [556406,45284] 0 2023-12-08T20:28:28.267 INFO:tasks.workunit.client.0.smithi043.stdout:4/829: chown d1/d14/d25/d28/d8a/f9b 6 1 2023-12-08T20:28:28.267 INFO:tasks.workunit.client.0.smithi043.stdout:4/830: chown d1/d14/d25/d39/fc7 757844202 1 2023-12-08T20:28:28.267 INFO:tasks.workunit.client.0.smithi043.stdout:4/831: creat d1/d14/d25/d77/da4/dc0/def/f11c x:0 0 0 2023-12-08T20:28:28.268 INFO:tasks.workunit.client.0.smithi043.stdout:4/832: symlink d1/d14/d1d/d58/dd9/l11d 0 2023-12-08T20:28:28.269 INFO:tasks.workunit.client.0.smithi043.stdout:4/833: rmdir d1/d14/d1d/d75 39 2023-12-08T20:28:28.270 INFO:tasks.workunit.client.0.smithi043.stdout:4/834: mknod d1/d14/d25/d39/d3d/d40/d67/d7f/c11e 0 2023-12-08T20:28:28.271 INFO:tasks.workunit.client.0.smithi043.stdout:4/835: rename d1/d14/d25/d39/d3d/l64 to d1/d14/d25/d77/l11f 0 2023-12-08T20:28:28.280 INFO:tasks.workunit.client.0.smithi043.stdout:4/836: dread d1/d14/d25/d28/f2e [0,4194304] 0 2023-12-08T20:28:28.282 INFO:tasks.workunit.client.0.smithi043.stdout:4/837: creat d1/d14/d25/d28/f120 x:0 0 0 2023-12-08T20:28:28.283 INFO:tasks.workunit.client.0.smithi043.stdout:4/838: mkdir d1/d14/d121 0 2023-12-08T20:28:28.283 INFO:tasks.workunit.client.0.smithi043.stdout:4/839: write d1/d14/d25/d39/d3f/d3c/d41/db6/fc9 [1361792,30116] 0 2023-12-08T20:28:28.284 INFO:tasks.workunit.client.0.smithi043.stdout:4/840: unlink d1/d14/d25/d39/d3f/d59/fc3 0 2023-12-08T20:28:28.285 INFO:tasks.workunit.client.0.smithi043.stdout:4/841: creat d1/d14/d25/d39/d3d/db0/f122 x:0 0 0 2023-12-08T20:28:28.288 INFO:tasks.workunit.client.0.smithi043.stdout:4/842: creat d1/d14/d25/d39/d3d/d40/d67/f123 x:0 0 0 2023-12-08T20:28:28.289 INFO:tasks.workunit.client.0.smithi043.stdout:4/843: creat d1/d14/d25/d39/d3f/d3c/d41/f124 x:0 0 0 2023-12-08T20:28:28.299 INFO:tasks.workunit.client.0.smithi043.stdout:4/844: rmdir d1/d14 39 2023-12-08T20:28:28.300 INFO:tasks.workunit.client.0.smithi043.stdout:6/748: sync 2023-12-08T20:28:28.300 INFO:tasks.workunit.client.0.smithi043.stdout:0/995: sync 2023-12-08T20:28:28.301 INFO:tasks.workunit.client.0.smithi043.stdout:0/996: write d2/d3/d18/d1e/d53/d10b/f44 [2753850,105027] 0 2023-12-08T20:28:28.302 INFO:tasks.workunit.client.0.smithi043.stdout:0/997: fsync d2/fca 0 2023-12-08T20:28:28.302 INFO:tasks.workunit.client.0.smithi043.stdout:6/749: creat d0/d2/de/d4a/d56/dc2/dee/f100 x:0 0 0 2023-12-08T20:28:28.306 INFO:tasks.workunit.client.0.smithi043.stdout:0/998: rmdir d2/d3/d18/d1e/df5 39 2023-12-08T20:28:28.309 INFO:tasks.workunit.client.0.smithi043.stdout:6/750: unlink d0/d2/d14/db3/df1/d22/d3f/f7d 0 2023-12-08T20:28:28.309 INFO:tasks.workunit.client.0.smithi043.stdout:6/751: chown d0/d2/d14/d20/d49/f64 11753 1 2023-12-08T20:28:28.309 INFO:tasks.workunit.client.0.smithi043.stdout:6/752: fsync d0/d2/d14/db3/df1/d22/d2a/faa 0 2023-12-08T20:28:28.309 INFO:tasks.workunit.client.0.smithi043.stdout:6/753: fsync d0/d2/d14/db3/df1/d22/d2a/db2/fc1 0 2023-12-08T20:28:28.310 INFO:tasks.workunit.client.0.smithi043.stdout:0/999: creat d2/d61/d67/d9e/f140 x:0 0 0 2023-12-08T20:28:28.312 INFO:tasks.workunit.client.0.smithi043.stdout:6/754: dread d0/d2/d29/f52 [0,4194304] 0 2023-12-08T20:28:28.312 INFO:tasks.workunit.client.0.smithi043.stdout:6/755: readlink d0/d2/d14/db3/df1/d66/l6e 0 2023-12-08T20:28:28.314 INFO:tasks.workunit.client.0.smithi043.stdout:6/756: creat d0/d2/d14/db3/df1/d22/d2a/db2/dba/de3/f101 x:0 0 0 2023-12-08T20:28:28.314 INFO:tasks.workunit.client.0.smithi043.stdout:6/757: truncate d0/d2/d14/db3/df1/d22/fcd 963798 0 2023-12-08T20:28:28.314 INFO:tasks.workunit.client.0.smithi043.stdout:6/758: chown d0/d2/d14/db3/df1/d22/c6a 76027549 1 2023-12-08T20:28:28.316 INFO:tasks.workunit.client.0.smithi043.stdout:6/759: unlink d0/d2/d14/d20/d3c/d6c/fdb 0 2023-12-08T20:28:28.316 INFO:tasks.workunit.client.0.smithi043.stdout:6/760: fdatasync d0/d2/d14/d8/d47/d60/f8d 0 2023-12-08T20:28:28.316 INFO:tasks.workunit.client.0.smithi043.stdout:4/845: dwrite d1/d14/d25/d39/d3f/d3c/d41/d65/f116 [0,4194304] 0 2023-12-08T20:28:28.318 INFO:tasks.workunit.client.0.smithi043.stdout:6/761: creat d0/d2/d14/d20/d3c/f102 x:0 0 0 2023-12-08T20:28:28.319 INFO:tasks.workunit.client.0.smithi043.stdout:4/846: creat d1/d14/d25/d39/d3f/d3c/d41/db6/f125 x:0 0 0 2023-12-08T20:28:28.320 INFO:tasks.workunit.client.0.smithi043.stdout:6/762: symlink d0/d2/d14/d20/d3c/df7/l103 0 2023-12-08T20:28:28.320 INFO:tasks.workunit.client.0.smithi043.stdout:4/847: mkdir d1/d14/d25/d39/d3f/d3c/d126 0 2023-12-08T20:28:28.323 INFO:tasks.workunit.client.0.smithi043.stdout:6/763: rmdir d0/d2 39 2023-12-08T20:28:28.323 INFO:tasks.workunit.client.0.smithi043.stdout:6/764: fsync d0/d2/d14/d8/d47/d60/f8d 0 2023-12-08T20:28:28.323 INFO:tasks.workunit.client.0.smithi043.stdout:6/765: fdatasync d0/d2/d14/db3/df1/d22/d2a/db2/fcf 0 2023-12-08T20:28:28.331 INFO:tasks.workunit.client.0.smithi043.stdout:4/848: dread d1/d14/d25/d39/d3f/d3c/d41/d65/f8e [0,4194304] 0 2023-12-08T20:28:28.331 INFO:tasks.workunit.client.0.smithi043.stdout:4/849: stat d1/d14/d25/d28/ccd 0 2023-12-08T20:28:28.341 INFO:tasks.workunit.client.0.smithi043.stdout:6/766: dwrite d0/d2/d29/f83 [0,4194304] 0 2023-12-08T20:28:28.341 INFO:tasks.workunit.client.0.smithi043.stdout:6/767: chown d0/d2/d14/d20/d3c/d50/f77 0 1 2023-12-08T20:28:28.346 INFO:tasks.workunit.client.0.smithi043.stdout:6/768: symlink d0/d2/d14/l104 0 2023-12-08T20:28:28.348 INFO:tasks.workunit.client.0.smithi043.stdout:6/769: mkdir d0/d2/d14/d20/d49/d105 0 2023-12-08T20:28:28.348 INFO:tasks.workunit.client.0.smithi043.stdout:6/770: chown d0/d2/f36 129831900 1 2023-12-08T20:28:28.354 INFO:tasks.workunit.client.0.smithi043.stdout:4/850: dwrite d1/d14/d25/d39/d3d/d40/d67/f9c [4194304,4194304] 0 2023-12-08T20:28:28.378 INFO:tasks.workunit.client.0.smithi043.stdout:4/851: dwrite d1/d14/d25/d28/d8a/f9b [0,4194304] 0 2023-12-08T20:28:28.378 INFO:tasks.workunit.client.0.smithi043.stdout:4/852: chown d1/d14/d1d/d58/f62 10363 1 2023-12-08T20:28:28.380 INFO:tasks.workunit.client.0.smithi043.stdout:4/853: rename d1/d14/d25/d39/d3f/d59/ddc to d1/d14/d127 0 2023-12-08T20:28:28.381 INFO:tasks.workunit.client.0.smithi043.stdout:4/854: rmdir d1/d14 39 2023-12-08T20:28:28.382 INFO:tasks.workunit.client.0.smithi043.stdout:4/855: mkdir d1/d14/d128 0 2023-12-08T20:28:28.383 INFO:tasks.workunit.client.0.smithi043.stdout:4/856: mkdir d1/d14/d25/d77/da4/d129 0 2023-12-08T20:28:28.384 INFO:tasks.workunit.client.0.smithi043.stdout:4/857: mkdir d1/d14/d1d/d12a 0 2023-12-08T20:28:28.385 INFO:tasks.workunit.client.0.smithi043.stdout:4/858: link d1/d14/d25/d39/d3f/c104 d1/d14/d25/d39/d3f/d3c/d80/c12b 0 2023-12-08T20:28:28.386 INFO:tasks.workunit.client.0.smithi043.stdout:4/859: unlink d1/d14/d25/d77/c8b 0 2023-12-08T20:28:28.388 INFO:tasks.workunit.client.0.smithi043.stdout:4/860: link d1/d14/f18 d1/d14/d25/d39/d3f/d3c/d41/dab/f12c 0 2023-12-08T20:28:28.395 INFO:tasks.workunit.client.0.smithi043.stdout:4/861: write d1/d14/d25/d39/d3f/d59/fac [4627443,98150] 0 2023-12-08T20:28:28.395 INFO:tasks.workunit.client.0.smithi043.stdout:4/862: read d1/d14/f87 [221656,101834] 0 2023-12-08T20:28:28.395 INFO:tasks.workunit.client.0.smithi043.stdout:4/863: symlink d1/d14/d25/d77/d8d/l12d 0 2023-12-08T20:28:28.402 INFO:tasks.workunit.client.0.smithi043.stdout:4/864: rmdir d1/d14/d25/d39/d3d/d40/d67 39 2023-12-08T20:28:28.402 INFO:tasks.workunit.client.0.smithi043.stdout:4/865: dread - d1/d14/d25/d39/d3f/d59/f10b zero size 2023-12-08T20:28:28.404 INFO:tasks.workunit.client.0.smithi043.stdout:4/866: mknod d1/c12e 0 2023-12-08T20:28:28.405 INFO:tasks.workunit.client.0.smithi043.stdout:4/867: link d1/f5 d1/d14/d25/d39/d3f/d3c/d41/db6/f12f 0 2023-12-08T20:28:28.406 INFO:tasks.workunit.client.0.smithi043.stdout:4/868: write d1/d14/d1d/d75/fcf [3203258,89042] 0 2023-12-08T20:28:28.406 INFO:tasks.workunit.client.0.smithi043.stdout:4/869: chown d1/d14/faf 13902738 1 2023-12-08T20:28:28.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.476+0000 7f114d1a1700 1 -- 172.21.15.43:0/580384765 --> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1134000bf0 con 0x7f113006ae40 2023-12-08T20:28:28.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.486+0000 7f112f7fe700 1 -- 172.21.15.43:0/580384765 <== mgr.24407 v2:172.21.15.111:6828/940639390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f1134000bf0 con 0x7f113006ae40 2023-12-08T20:28:28.487 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-08T20:28:28.488 INFO:teuthology.orchestra.run.smithi043.stdout:alertmanager.smithi043 smithi043 *:9093,9094 starting - - - - 2023-12-08T20:28:28.488 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi043 smithi043 running (6m) 55s ago 6m 7432k - 17.2.7-119-ge2143d99 f761b6e42225 f84d492b732c 2023-12-08T20:28:28.488 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi111 smithi111 running (6m) 51s ago 6m 7428k - 17.2.7-119-ge2143d99 f761b6e42225 88b53685ae54 2023-12-08T20:28:28.488 INFO:teuthology.orchestra.run.smithi043.stdout:grafana.smithi043 smithi043 *:3000 starting - - - - 2023-12-08T20:28:28.488 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.akrjef smithi043 running (2m) 55s ago 2m 16.4M - 17.2.7-119-ge2143d99 f761b6e42225 1c0cb8d34ef8 2023-12-08T20:28:28.488 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.pjmszb smithi043 running (2m) 55s ago 2m 1215M - 17.2.7-119-ge2143d99 f761b6e42225 d7eee0c78093 2023-12-08T20:28:28.488 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.svpasm smithi111 running (2m) 51s ago 2m 14.0M - 17.2.7-119-ge2143d99 f761b6e42225 657d4d1cf4b2 2023-12-08T20:28:28.488 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.veeegc smithi111 running (2m) 51s ago 2m 111M - 17.2.7-119-ge2143d99 f761b6e42225 31f794a388ab 2023-12-08T20:28:28.488 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi043.hqcdcm smithi043 *:9283 running (7m) 55s ago 7m 407M - 17.2.7-119-ge2143d99 f761b6e42225 58b656e8e333 2023-12-08T20:28:28.488 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi111.mtcffu smithi111 *:8443,9283 running (72s) 51s ago 5m 492M - 19.0.0-44-g9dcc13bb f28f2b94f153 d2b826bdf0bf 2023-12-08T20:28:28.488 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi043 smithi043 running (7m) 55s ago 7m 82.3M 2048M 17.2.7-119-ge2143d99 f761b6e42225 fe2a56effef3 2023-12-08T20:28:28.488 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi111 smithi111 running (5m) 51s ago 5m 54.5M 2048M 17.2.7-119-ge2143d99 f761b6e42225 2ae21cf3fa1e 2023-12-08T20:28:28.488 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi043 smithi043 *:9100 starting - - - - 2023-12-08T20:28:28.488 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi111 smithi111 *:9100 starting - - - - 2023-12-08T20:28:28.488 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (5m) 55s ago 5m 124M 1570M 17.2.7-119-ge2143d99 f761b6e42225 462eeaf62b2c 2023-12-08T20:28:28.489 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi043 running (5m) 55s ago 5m 133M 1570M 17.2.7-119-ge2143d99 f761b6e42225 dde419c88a89 2023-12-08T20:28:28.489 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi043 running (4m) 55s ago 4m 100M 1570M 17.2.7-119-ge2143d99 f761b6e42225 f7e812026ef5 2023-12-08T20:28:28.489 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi111 running (4m) 51s ago 4m 122M 2592M 17.2.7-119-ge2143d99 f761b6e42225 2a738d30441c 2023-12-08T20:28:28.489 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi111 running (4m) 51s ago 4m 108M 2592M 17.2.7-119-ge2143d99 f761b6e42225 38cdb6a88694 2023-12-08T20:28:28.489 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi111 running (3m) 51s ago 3m 108M 2592M 17.2.7-119-ge2143d99 f761b6e42225 59a9ce8c1141 2023-12-08T20:28:28.489 INFO:teuthology.orchestra.run.smithi043.stdout:prometheus.smithi043 smithi043 *:9095 starting - - - - 2023-12-08T20:28:28.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.489+0000 7f114d1a1700 1 -- 172.21.15.43:0/580384765 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f113006ae40 msgr2=0x7f113006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:28.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.489+0000 7f114d1a1700 1 --2- 172.21.15.43:0/580384765 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f113006ae40 0x7f113006d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1138000c00 tx=0x7f1138009e30 comp rx=0 tx=0).stop 2023-12-08T20:28:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.489+0000 7f114d1a1700 1 -- 172.21.15.43:0/580384765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f114806e210 msgr2=0x7f114811c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.489+0000 7f114d1a1700 1 --2- 172.21.15.43:0/580384765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f114806e210 0x7f114811c3a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f113c00b790 tx=0x7f113c009220 comp rx=0 tx=0).stop 2023-12-08T20:28:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.489+0000 7f114d1a1700 1 -- 172.21.15.43:0/580384765 shutdown_connections 2023-12-08T20:28:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.489+0000 7f114d1a1700 1 --2- 172.21.15.43:0/580384765 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f113006ae40 0x7f113006d2f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.489+0000 7f114d1a1700 1 --2- 172.21.15.43:0/580384765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f114806e210 0x7f114811c3a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.489+0000 7f114d1a1700 1 --2- 172.21.15.43:0/580384765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f114806eb60 0x7f114811c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.489+0000 7f114d1a1700 1 -- 172.21.15.43:0/580384765 >> 172.21.15.43:0/580384765 conn(0x7f1148069b20 msgr2=0x7f11481074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:28:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.489+0000 7f114d1a1700 1 -- 172.21.15.43:0/580384765 shutdown_connections 2023-12-08T20:28:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.489+0000 7f114d1a1700 1 -- 172.21.15.43:0/580384765 wait complete. 2023-12-08T20:28:28.525 INFO:tasks.workunit.client.0.smithi043.stdout:8/893: sync 2023-12-08T20:28:28.525 INFO:tasks.workunit.client.0.smithi043.stdout:5/831: sync 2023-12-08T20:28:28.525 INFO:tasks.workunit.client.0.smithi043.stdout:7/824: sync 2023-12-08T20:28:28.525 INFO:tasks.workunit.client.0.smithi043.stdout:8/894: truncate d2/d27/fe0 607855 0 2023-12-08T20:28:28.525 INFO:tasks.workunit.client.0.smithi043.stdout:9/831: sync 2023-12-08T20:28:28.526 INFO:tasks.workunit.client.0.smithi043.stdout:5/832: unlink d3/d7/d19/l1f 0 2023-12-08T20:28:28.527 INFO:tasks.workunit.client.0.smithi043.stdout:7/825: creat d0/d6/d17/dab/f10b x:0 0 0 2023-12-08T20:28:28.530 INFO:tasks.workunit.client.0.smithi043.stdout:8/895: mknod d2/d27/d2d/d31/c125 0 2023-12-08T20:28:28.530 INFO:tasks.workunit.client.0.smithi043.stdout:8/896: chown d2/d20/d7d/d29/d30/d60/d9b/dbb/fc7 0 1 2023-12-08T20:28:28.530 INFO:tasks.workunit.client.0.smithi043.stdout:5/833: dread d3/f65 [0,4194304] 0 2023-12-08T20:28:28.532 INFO:tasks.workunit.client.0.smithi043.stdout:5/834: unlink d3/d7/de/d6a/cb7 0 2023-12-08T20:28:28.533 INFO:tasks.workunit.client.0.smithi043.stdout:7/826: dread d0/d2/f46 [0,4194304] 0 2023-12-08T20:28:28.533 INFO:tasks.workunit.client.0.smithi043.stdout:7/827: write d0/d2/d12/d19/f4f [993601,105196] 0 2023-12-08T20:28:28.533 INFO:tasks.workunit.client.0.smithi043.stdout:7/828: truncate d0/d6/fe9 191081 0 2023-12-08T20:28:28.534 INFO:tasks.workunit.client.0.smithi043.stdout:5/835: creat d3/d73/f104 x:0 0 0 2023-12-08T20:28:28.534 INFO:tasks.workunit.client.0.smithi043.stdout:9/832: dread d0/d5e/f81 [0,4194304] 0 2023-12-08T20:28:28.536 INFO:tasks.workunit.client.0.smithi043.stdout:7/829: mkdir d0/d2/d65/d99/d47/dd6/dd8/d102/d10c 0 2023-12-08T20:28:28.536 INFO:tasks.workunit.client.0.smithi043.stdout:7/830: write d0/d2/d12/da2/fd3 [1618804,90899] 0 2023-12-08T20:28:28.537 INFO:tasks.workunit.client.0.smithi043.stdout:9/833: symlink d0/d3d/d4b/d65/l116 0 2023-12-08T20:28:28.544 INFO:tasks.workunit.client.0.smithi043.stdout:7/831: link d0/fa1 d0/d2/d65/d99/d47/dd6/d101/f10d 0 2023-12-08T20:28:28.545 INFO:tasks.workunit.client.0.smithi043.stdout:8/897: dwrite d2/d20/d7d/f61 [0,4194304] 0 2023-12-08T20:28:28.545 INFO:tasks.workunit.client.0.smithi043.stdout:8/898: chown d2/d20/d7d/d37/lc1 280058890 1 2023-12-08T20:28:28.547 INFO:tasks.workunit.client.0.smithi043.stdout:7/832: mkdir d0/d2/d65/d99/d47/dda/d10e 0 2023-12-08T20:28:28.547 INFO:tasks.workunit.client.0.smithi043.stdout:7/833: chown d0/d6/d17/d52 1012 1 2023-12-08T20:28:28.550 INFO:tasks.workunit.client.0.smithi043.stdout:8/899: creat d2/d27/d2d/d31/d74/f126 x:0 0 0 2023-12-08T20:28:28.555 INFO:tasks.workunit.client.0.smithi043.stdout:5/836: dwrite d3/d7/de/fdb [0,4194304] 0 2023-12-08T20:28:28.562 INFO:tasks.workunit.client.0.smithi043.stdout:9/834: dwrite d0/d21/ff4 [0,4194304] 0 2023-12-08T20:28:28.562 INFO:tasks.workunit.client.0.smithi043.stdout:9/835: dread - d0/d3d/d4b/da2/dbc/d109/ddd/d6b/fbb zero size 2023-12-08T20:28:28.564 INFO:tasks.workunit.client.0.smithi043.stdout:5/837: symlink d3/d78/dc4/l105 0 2023-12-08T20:28:28.565 INFO:tasks.workunit.client.0.smithi043.stdout:9/836: truncate d0/d21/d80/fb3 1462767 0 2023-12-08T20:28:28.568 INFO:tasks.workunit.client.0.smithi043.stdout:9/837: truncate d0/d21/f3e 566739 0 2023-12-08T20:28:28.568 INFO:tasks.workunit.client.0.smithi043.stdout:9/838: fdatasync d0/d5e/d73/deb/fa3 0 2023-12-08T20:28:28.568 INFO:tasks.workunit.client.0.smithi043.stdout:5/838: unlink d3/d7/d21/d72/fa6 0 2023-12-08T20:28:28.569 INFO:tasks.workunit.client.0.smithi043.stdout:9/839: truncate d0/d5e/d73/deb/fe8 4079533 0 2023-12-08T20:28:28.569 INFO:tasks.workunit.client.0.smithi043.stdout:9/840: read - d0/d3d/d4b/d61/fb5 zero size 2023-12-08T20:28:28.572 INFO:tasks.workunit.client.0.smithi043.stdout:5/839: creat d3/d7/d90/f106 x:0 0 0 2023-12-08T20:28:28.576 INFO:tasks.workunit.client.0.smithi043.stdout:5/840: mknod d3/d7/de/d82/d95/c107 0 2023-12-08T20:28:28.592 INFO:tasks.workunit.client.0.smithi043.stdout:8/900: dwrite d2/d27/d2d/d31/d7f/db7/fd0 [0,4194304] 0 2023-12-08T20:28:28.592 INFO:tasks.workunit.client.0.smithi043.stdout:8/901: read - d2/d27/d2d/d31/d7f/f93 zero size 2023-12-08T20:28:28.592 INFO:tasks.workunit.client.0.smithi043.stdout:8/902: dread - d2/d20/d7d/d29/d59/d86/fad zero size 2023-12-08T20:28:28.593 INFO:tasks.workunit.client.0.smithi043.stdout:8/903: read d2/d20/fb1 [25874,54076] 0 2023-12-08T20:28:28.594 INFO:tasks.workunit.client.0.smithi043.stdout:9/841: dwrite d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d94/fff [0,4194304] 0 2023-12-08T20:28:28.595 INFO:tasks.workunit.client.0.smithi043.stdout:8/904: creat d2/d27/dab/d112/f127 x:0 0 0 2023-12-08T20:28:28.598 INFO:tasks.workunit.client.0.smithi043.stdout:8/905: getdents d2/d20 0 2023-12-08T20:28:28.598 INFO:tasks.workunit.client.0.smithi043.stdout:8/906: chown d2/d20/d7d/d29/d59/d9f/ddf/dfa/f116 210142 1 2023-12-08T20:28:28.599 INFO:tasks.workunit.client.0.smithi043.stdout:7/834: dwrite d0/f42 [4194304,4194304] 0 2023-12-08T20:28:28.599 INFO:tasks.workunit.client.0.smithi043.stdout:5/841: dread d3/fc [4194304,4194304] 0 2023-12-08T20:28:28.602 INFO:tasks.workunit.client.0.smithi043.stdout:8/907: mknod d2/d27/d2d/d31/c128 0 2023-12-08T20:28:28.602 INFO:tasks.workunit.client.0.smithi043.stdout:7/835: mkdir d0/d6/d17/d52/dac/d10f 0 2023-12-08T20:28:28.602 INFO:tasks.workunit.client.0.smithi043.stdout:5/842: creat d3/d7/de/f108 x:0 0 0 2023-12-08T20:28:28.603 INFO:tasks.workunit.client.0.smithi043.stdout:7/836: write d0/d2/d12/d19/f41 [28280,78825] 0 2023-12-08T20:28:28.603 INFO:tasks.workunit.client.0.smithi043.stdout:7/837: fsync d0/d6/dc7/fd9 0 2023-12-08T20:28:28.607 INFO:tasks.workunit.client.0.smithi043.stdout:8/908: symlink d2/d20/d7d/d29/d59/l129 0 2023-12-08T20:28:28.607 INFO:tasks.workunit.client.0.smithi043.stdout:9/842: dread d0/d3d/d4b/f71 [0,4194304] 0 2023-12-08T20:28:28.607 INFO:tasks.workunit.client.0.smithi043.stdout:9/843: chown d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d110/fe5 297 1 2023-12-08T20:28:28.607 INFO:tasks.workunit.client.0.smithi043.stdout:5/843: getdents d3/d7/d21/d51/ddd 0 2023-12-08T20:28:28.608 INFO:tasks.workunit.client.0.smithi043.stdout:7/838: creat d0/d2/d65/d99/d47/dd6/f110 x:0 0 0 2023-12-08T20:28:28.610 INFO:tasks.workunit.client.0.smithi043.stdout:8/909: link d2/d20/d7d/d29/d59/d9f/ddf/c10c d2/d20/d7d/d29/d30/d60/d9b/d117/c12a 0 2023-12-08T20:28:28.611 INFO:tasks.workunit.client.0.smithi043.stdout:5/844: creat d3/d7/d21/d72/f109 x:0 0 0 2023-12-08T20:28:28.614 INFO:tasks.workunit.client.0.smithi043.stdout:7/839: rmdir d0/d2/d65/d99/d47/dd6/dd8/d102/d10c 0 2023-12-08T20:28:28.617 INFO:tasks.workunit.client.0.smithi043.stdout:8/910: unlink d2/d27/d2d/d31/d4f/f10b 0 2023-12-08T20:28:28.618 INFO:tasks.workunit.client.0.smithi043.stdout:5/845: mknod d3/d7/de/d82/d95/c10a 0 2023-12-08T20:28:28.619 INFO:tasks.workunit.client.0.smithi043.stdout:7/840: rmdir d0/d6/d17/d52 39 2023-12-08T20:28:28.620 INFO:tasks.workunit.client.0.smithi043.stdout:5/846: creat d3/d7/de/d82/f10b x:0 0 0 2023-12-08T20:28:28.620 INFO:tasks.workunit.client.0.smithi043.stdout:5/847: fdatasync d3/d7/d21/d51/fac 0 2023-12-08T20:28:28.621 INFO:tasks.workunit.client.0.smithi043.stdout:7/841: symlink d0/d6/d17/d54/l111 0 2023-12-08T20:28:28.621 INFO:tasks.workunit.client.0.smithi043.stdout:5/848: creat d3/d7/d29/f10c x:0 0 0 2023-12-08T20:28:28.622 INFO:tasks.workunit.client.0.smithi043.stdout:5/849: truncate d3/d7/d29/ff4 568544 0 2023-12-08T20:28:28.630 INFO:tasks.workunit.client.0.smithi043.stdout:5/850: symlink d3/d32/l10d 0 2023-12-08T20:28:28.631 INFO:tasks.workunit.client.0.smithi043.stdout:5/851: fdatasync d3/f37 0 2023-12-08T20:28:28.631 INFO:tasks.workunit.client.0.smithi043.stdout:5/852: write d3/d7/d19/f6d [406687,118790] 0 2023-12-08T20:28:28.631 INFO:tasks.workunit.client.0.smithi043.stdout:5/853: chown d3/d7/d19/f59 2271546 1 2023-12-08T20:28:28.632 INFO:tasks.workunit.client.0.smithi043.stdout:5/854: unlink d3/d7/d21/f28 0 2023-12-08T20:28:28.634 INFO:tasks.workunit.client.0.smithi043.stdout:5/855: creat d3/d7/f10e x:0 0 0 2023-12-08T20:28:28.638 INFO:tasks.workunit.client.0.smithi043.stdout:5/856: rename d3/f6e to d3/d7/d21/d51/d5c/d81/f10f 0 2023-12-08T20:28:28.640 INFO:tasks.workunit.client.0.smithi043.stdout:5/857: mknod d3/d7/d19/d3f/c110 0 2023-12-08T20:28:28.640 INFO:tasks.workunit.client.0.smithi043.stdout:5/858: readlink d3/d7/d21/d51/la2 0 2023-12-08T20:28:28.644 INFO:tasks.workunit.client.0.smithi043.stdout:5/859: getdents d3/d32 0 2023-12-08T20:28:28.646 INFO:tasks.workunit.client.0.smithi043.stdout:5/860: rename d3/d7/d29/lae to d3/d73/da4/db0/l111 0 2023-12-08T20:28:28.654 INFO:tasks.workunit.client.0.smithi043.stdout:5/861: dread d3/d7/d21/fa1 [0,4194304] 0 2023-12-08T20:28:28.655 INFO:tasks.workunit.client.0.smithi043.stdout:5/862: getdents d3/d7/de/d43 0 2023-12-08T20:28:28.656 INFO:tasks.workunit.client.0.smithi043.stdout:5/863: unlink d3/d7/de/f108 0 2023-12-08T20:28:28.673 INFO:tasks.workunit.client.0.smithi043.stdout:5/864: dwrite d3/d73/f100 [0,4194304] 0 2023-12-08T20:28:28.673 INFO:tasks.workunit.client.0.smithi043.stdout:5/865: fsync f1 0 2023-12-08T20:28:28.673 INFO:tasks.workunit.client.0.smithi043.stdout:5/866: read - d3/d73/f104 zero size 2023-12-08T20:28:28.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.678+0000 7f346aef5700 1 -- 172.21.15.43:0/1282530305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3464066090 msgr2=0x7f34640ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:28.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.678+0000 7f346aef5700 1 --2- 172.21.15.43:0/1282530305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3464066090 0x7f34640ff7a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3458004940 tx=0x7f3458009e30 comp rx=0 tx=0).stop 2023-12-08T20:28:28.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.678+0000 7f346aef5700 1 -- 172.21.15.43:0/1282530305 shutdown_connections 2023-12-08T20:28:28.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.678+0000 7f346aef5700 1 --2- 172.21.15.43:0/1282530305 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34640ffd70 0x7f34641021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:28.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.678+0000 7f346aef5700 1 --2- 172.21.15.43:0/1282530305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3464066090 0x7f34640ff7a0 secure :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3458004940 tx=0x7f3458009e30 comp rx=0 tx=0).stop 2023-12-08T20:28:28.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.678+0000 7f346aef5700 1 -- 172.21.15.43:0/1282530305 >> 172.21.15.43:0/1282530305 conn(0x7f34640f7190 msgr2=0x7f34640f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:28:28.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.678+0000 7f346aef5700 1 -- 172.21.15.43:0/1282530305 shutdown_connections 2023-12-08T20:28:28.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.678+0000 7f346aef5700 1 -- 172.21.15.43:0/1282530305 wait complete. 2023-12-08T20:28:28.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.679+0000 7f346aef5700 1 Processor -- start 2023-12-08T20:28:28.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.679+0000 7f346aef5700 1 -- start start 2023-12-08T20:28:28.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.679+0000 7f346aef5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34640ffd70 0x7f346410d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:28:28.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.679+0000 7f346aef5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f346410dbb0 0x7f346410ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:28:28.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.679+0000 7f346aef5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346410e070 con 0x7f34640ffd70 2023-12-08T20:28:28.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.679+0000 7f346aef5700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346410e1b0 con 0x7f346410dbb0 2023-12-08T20:28:28.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.680+0000 7f3468c91700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34640ffd70 0x7f346410d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:28:28.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.680+0000 7f3468c91700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34640ffd70 0x7f346410d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38472/0 (socket says 172.21.15.43:38472) 2023-12-08T20:28:28.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.680+0000 7f3468c91700 1 -- 172.21.15.43:0/3246029017 learned_addr learned my addr 172.21.15.43:0/3246029017 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:28:28.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.680+0000 7f3463fff700 1 --2- 172.21.15.43:0/3246029017 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f346410dbb0 0x7f346410ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:28:28.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.680+0000 7f3463fff700 1 -- 172.21.15.43:0/3246029017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34640ffd70 msgr2=0x7f346410d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:28.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.680+0000 7f3463fff700 1 --2- 172.21.15.43:0/3246029017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34640ffd70 0x7f346410d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:28.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.680+0000 7f3463fff700 1 -- 172.21.15.43:0/3246029017 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3458005040 con 0x7f346410dbb0 2023-12-08T20:28:28.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.680+0000 7f3468c91700 1 --2- 172.21.15.43:0/3246029017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34640ffd70 0x7f346410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T20:28:28.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.680+0000 7f3463fff700 1 --2- 172.21.15.43:0/3246029017 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f346410dbb0 0x7f346410ea50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3464065dd0 tx=0x7f345000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:28:28.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.681+0000 7f34617fa700 1 -- 172.21.15.43:0/3246029017 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3450004e90 con 0x7f346410dbb0 2023-12-08T20:28:28.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.681+0000 7f34617fa700 1 -- 172.21.15.43:0/3246029017 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f345000f040 con 0x7f346410dbb0 2023-12-08T20:28:28.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.681+0000 7f346aef5700 1 -- 172.21.15.43:0/3246029017 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346410f050 con 0x7f346410dbb0 2023-12-08T20:28:28.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.681+0000 7f34617fa700 1 -- 172.21.15.43:0/3246029017 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f345000c980 con 0x7f346410dbb0 2023-12-08T20:28:28.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.681+0000 7f346aef5700 1 -- 172.21.15.43:0/3246029017 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346410f560 con 0x7f346410dbb0 2023-12-08T20:28:28.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.682+0000 7f346aef5700 1 -- 172.21.15.43:0/3246029017 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34641075e0 con 0x7f346410dbb0 2023-12-08T20:28:28.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.683+0000 7f34617fa700 1 -- 172.21.15.43:0/3246029017 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f3450007cc0 con 0x7f346410dbb0 2023-12-08T20:28:28.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.683+0000 7f34617fa700 1 --2- 172.21.15.43:0/3246029017 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f345406ae40 0x7f345406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:28:28.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.683+0000 7f34617fa700 1 -- 172.21.15.43:0/3246029017 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f3450089450 con 0x7f346410dbb0 2023-12-08T20:28:28.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.683+0000 7f3468c91700 1 --2- 172.21.15.43:0/3246029017 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f345406ae40 0x7f345406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:28:28.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.684+0000 7f3468c91700 1 --2- 172.21.15.43:0/3246029017 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f345406ae40 0x7f345406d2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f345800b0d0 tx=0x7f3458009e30 comp rx=0 tx=0).ready entity=mgr.24407 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:28:28.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:28.687+0000 7f34617fa700 1 -- 172.21.15.43:0/3246029017 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f34500573a0 con 0x7f346410dbb0 2023-12-08T20:28:28.691 INFO:tasks.workunit.client.0.smithi043.stdout:3/893: sync 2023-12-08T20:28:28.700 INFO:tasks.workunit.client.0.smithi043.stdout:3/894: dread d1/d9/f4e [0,4194304] 0 2023-12-08T20:28:28.701 INFO:tasks.workunit.client.0.smithi043.stdout:8/911: dwrite d2/d20/d7d/f2a [0,4194304] 0 2023-12-08T20:28:28.702 INFO:tasks.workunit.client.0.smithi043.stdout:3/895: mkdir d1/d25/d2a/d45/d11f 0 2023-12-08T20:28:28.712 INFO:tasks.workunit.client.0.smithi043.stdout:3/896: rename d1/d25/d84/la8 to d1/d9/df5/l120 0 2023-12-08T20:28:28.714 INFO:tasks.workunit.client.0.smithi043.stdout:3/897: rename d1/d1c/d2c/ffd to d1/d9/df/d6e/f121 0 2023-12-08T20:28:28.717 INFO:tasks.workunit.client.0.smithi043.stdout:3/898: unlink d1/d9/d38/f3d 0 2023-12-08T20:28:28.746 INFO:tasks.workunit.client.0.smithi043.stdout:7/842: dwrite d0/d6/f7b [0,4194304] 0 2023-12-08T20:28:28.747 INFO:tasks.workunit.client.0.smithi043.stdout:7/843: write d0/d2/d12/d19/d38/f55 [735136,116590] 0 2023-12-08T20:28:28.751 INFO:tasks.workunit.client.0.smithi043.stdout:8/912: dwrite d2/d20/d7d/d29/d59/d9f/fc3 [0,4194304] 0 2023-12-08T20:28:28.752 INFO:tasks.workunit.client.0.smithi043.stdout:7/844: fdatasync d0/d2/d12/d19/d38/f55 0 2023-12-08T20:28:28.752 INFO:tasks.workunit.client.0.smithi043.stdout:7/845: truncate d0/d2/d65/d99/fa3 4579565 0 2023-12-08T20:28:28.752 INFO:tasks.workunit.client.0.smithi043.stdout:7/846: dread - d0/d2/d12/d19/d38/fc9 zero size 2023-12-08T20:28:28.752 INFO:tasks.workunit.client.0.smithi043.stdout:7/847: stat d0/d2/d12/d19/d38/c79 0 2023-12-08T20:28:28.752 INFO:tasks.workunit.client.0.smithi043.stdout:7/848: chown d0/d2/d12/d19/d38/f9d 42827319 1 2023-12-08T20:28:28.755 INFO:tasks.workunit.client.0.smithi043.stdout:8/913: creat d2/d20/d7d/d29/d30/d60/f12b x:0 0 0 2023-12-08T20:28:28.755 INFO:tasks.workunit.client.0.smithi043.stdout:3/899: dwrite d1/d9/df/d41/f5b [0,4194304] 0 2023-12-08T20:28:28.755 INFO:tasks.workunit.client.0.smithi043.stdout:3/900: truncate d1/d9/f107 396977 0 2023-12-08T20:28:28.755 INFO:tasks.workunit.client.0.smithi043.stdout:3/901: read d1/f50 [2263119,94136] 0 2023-12-08T20:28:28.758 INFO:tasks.workunit.client.0.smithi043.stdout:7/849: getdents d0/d2 0 2023-12-08T20:28:28.765 INFO:tasks.workunit.client.0.smithi043.stdout:8/914: read d2/d20/d7d/f46 [210851,9123] 0 2023-12-08T20:28:28.765 INFO:tasks.workunit.client.0.smithi043.stdout:8/915: write d2/d27/d2d/de7/f115 [24156,2840] 0 2023-12-08T20:28:28.780 INFO:tasks.workunit.client.0.smithi043.stdout:6/771: sync 2023-12-08T20:28:28.780 INFO:tasks.workunit.client.0.smithi043.stdout:1/870: sync 2023-12-08T20:28:28.781 INFO:tasks.workunit.client.0.smithi043.stdout:6/772: creat d0/d2/d14/d20/d3c/df7/f106 x:0 0 0 2023-12-08T20:28:28.784 INFO:tasks.workunit.client.0.smithi043.stdout:1/871: truncate d1/d16/f18 506984 0 2023-12-08T20:28:28.784 INFO:tasks.workunit.client.0.smithi043.stdout:1/872: chown d1/d16/d21/d25/d3e/dbc/db8/fc2 632 1 2023-12-08T20:28:28.784 INFO:tasks.workunit.client.0.smithi043.stdout:6/773: rmdir d0/d2/d14/db3/df1/d22/d2a/db2/dba/dec 39 2023-12-08T20:28:28.785 INFO:tasks.workunit.client.0.smithi043.stdout:6/774: chown d0/d2/de/d4a/de2/fea 15840957 1 2023-12-08T20:28:28.787 INFO:tasks.workunit.client.0.smithi043.stdout:6/775: dread d0/d2/d14/db3/f9a [0,4194304] 0 2023-12-08T20:28:28.788 INFO:tasks.workunit.client.0.smithi043.stdout:7/850: dwrite d0/f9e [0,4194304] 0 2023-12-08T20:28:28.790 INFO:tasks.workunit.client.0.smithi043.stdout:7/851: creat d0/d2/d12/da2/f112 x:0 0 0 2023-12-08T20:28:28.790 INFO:tasks.workunit.client.0.smithi043.stdout:1/873: unlink d1/db1/lde 0 2023-12-08T20:28:28.790 INFO:tasks.workunit.client.0.smithi043.stdout:1/874: fsync d1/d16/d21/d25/d35/f9e 0 2023-12-08T20:28:28.791 INFO:tasks.workunit.client.0.smithi043.stdout:8/916: dwrite d2/d27/d2d/d31/de8/ff8 [0,4194304] 0 2023-12-08T20:28:28.792 INFO:tasks.workunit.client.0.smithi043.stdout:8/917: truncate d2/d20/d7d/d29/d59/f65 3041980 0 2023-12-08T20:28:28.793 INFO:tasks.workunit.client.0.smithi043.stdout:6/776: mknod d0/d2/d14/d8/d47/c107 0 2023-12-08T20:28:28.800 INFO:tasks.workunit.client.0.smithi043.stdout:6/777: getdents d0/ddc 0 2023-12-08T20:28:28.822 INFO:tasks.workunit.client.0.smithi043.stdout:8/918: dread d2/d20/d7d/d29/d30/d71/f96 [0,4194304] 0 2023-12-08T20:28:28.823 INFO:tasks.workunit.client.0.smithi043.stdout:1/875: dwrite d1/d16/d21/d25/d35/f9e [0,4194304] 0 2023-12-08T20:28:28.823 INFO:tasks.workunit.client.0.smithi043.stdout:7/852: dwrite d0/d6/d17/dab/fb4 [0,4194304] 0 2023-12-08T20:28:28.824 INFO:tasks.workunit.client.0.smithi043.stdout:7/853: write d0/d6/d17/d54/f80 [2630875,27966] 0 2023-12-08T20:28:28.824 INFO:tasks.workunit.client.0.smithi043.stdout:7/854: chown d0/d2/d65/d99/le 0 1 2023-12-08T20:28:28.824 INFO:tasks.workunit.client.0.smithi043.stdout:7/855: write d0/d2/f5 [7224636,47552] 0 2023-12-08T20:28:28.824 INFO:tasks.workunit.client.0.smithi043.stdout:8/919: mkdir d2/d20/d7d/d29/d59/d9f/ddf/dfa/d12c 0 2023-12-08T20:28:28.824 INFO:tasks.workunit.client.0.smithi043.stdout:1/876: mkdir d1/d16/d21/d25/d35/d103/d141 0 2023-12-08T20:28:28.824 INFO:tasks.workunit.client.0.smithi043.stdout:1/877: fsync d1/d16/d21/d25/d35/ff5 0 2023-12-08T20:28:28.825 INFO:tasks.workunit.client.0.smithi043.stdout:1/878: stat d1/d16/d21 0 2023-12-08T20:28:28.825 INFO:tasks.workunit.client.0.smithi043.stdout:7/856: getdents d0/d2/d65/d99/d47/dda 0 2023-12-08T20:28:28.827 INFO:tasks.workunit.client.0.smithi043.stdout:8/920: mknod d2/d27/d2d/d31/d7f/db2/c12d 0 2023-12-08T20:28:28.827 INFO:tasks.workunit.client.0.smithi043.stdout:8/921: write d2/d27/d2d/de7/f115 [348592,62738] 0 2023-12-08T20:28:28.827 INFO:tasks.workunit.client.0.smithi043.stdout:7/857: mknod d0/d2/d65/d99/d47/dd6/dd8/c113 0 2023-12-08T20:28:28.829 INFO:tasks.workunit.client.0.smithi043.stdout:8/922: mknod d2/d27/d114/c12e 0 2023-12-08T20:28:28.829 INFO:tasks.workunit.client.0.smithi043.stdout:6/778: dwrite d0/d2/d14/d20/d3c/d6c/fb0 [0,4194304] 0 2023-12-08T20:28:28.830 INFO:tasks.workunit.client.0.smithi043.stdout:8/923: mknod d2/d20/d7d/d29/d30/d7c/c12f 0 2023-12-08T20:28:28.830 INFO:tasks.workunit.client.0.smithi043.stdout:8/924: chown d2/d27/d2d/d31/d99/l106 498 1 2023-12-08T20:28:28.834 INFO:tasks.workunit.client.0.smithi043.stdout:7/858: dread d0/d5b/f8b [0,4194304] 0 2023-12-08T20:28:28.834 INFO:tasks.workunit.client.0.smithi043.stdout:7/859: creat d0/d6/d17/f114 x:0 0 0 2023-12-08T20:28:28.835 INFO:tasks.workunit.client.0.smithi043.stdout:7/860: creat d0/d2/db0/f115 x:0 0 0 2023-12-08T20:28:28.843 INFO:tasks.workunit.client.0.smithi043.stdout:8/925: dread d2/d20/d7d/f13 [0,4194304] 0 2023-12-08T20:28:28.844 INFO:tasks.workunit.client.0.smithi043.stdout:7/861: dread d0/d2/d65/d83/fb9 [0,4194304] 0 2023-12-08T20:28:28.844 INFO:tasks.workunit.client.0.smithi043.stdout:8/926: symlink d2/d27/d2d/d31/d91/l130 0 2023-12-08T20:28:28.844 INFO:tasks.workunit.client.0.smithi043.stdout:8/927: fsync d2/d20/d7d/f61 0 2023-12-08T20:28:28.844 INFO:tasks.workunit.client.0.smithi043.stdout:8/928: fsync d2/d27/d2d/d31/d7f/fb3 0 2023-12-08T20:28:28.844 INFO:tasks.workunit.client.0.smithi043.stdout:8/929: fdatasync d2/d27/d2d/f3c 0 2023-12-08T20:28:28.844 INFO:tasks.workunit.client.0.smithi043.stdout:8/930: truncate d2/d20/d7d/d29/d30/d71/ff6 450540 0 2023-12-08T20:28:28.845 INFO:tasks.workunit.client.0.smithi043.stdout:1/879: dwrite d1/d16/f28 [0,4194304] 0 2023-12-08T20:28:28.846 INFO:tasks.workunit.client.0.smithi043.stdout:7/862: creat d0/d2/d12/d19/d38/d9c/f116 x:0 0 0 2023-12-08T20:28:28.848 INFO:tasks.workunit.client.0.smithi043.stdout:1/880: unlink d1/d16/d30/f5a 0 2023-12-08T20:28:28.848 INFO:tasks.workunit.client.0.smithi043.stdout:7/863: rename d0/d2/d12/d19/d38/d9c/f116 to d0/d6/d17/dab/f117 0 2023-12-08T20:28:28.849 INFO:tasks.workunit.client.0.smithi043.stdout:1/881: mknod d1/d16/d21/d25/d3e/d77/d9f/c142 0 2023-12-08T20:28:28.852 INFO:tasks.workunit.client.0.smithi043.stdout:6/779: dwrite d0/d2/d14/d20/d3c/d6c/f9b [0,4194304] 0 2023-12-08T20:28:28.865 INFO:tasks.workunit.client.0.smithi043.stdout:7/864: dwrite d0/d6/d17/dab/f10b [0,4194304] 0 2023-12-08T20:28:28.865 INFO:tasks.workunit.client.0.smithi043.stdout:7/865: dread d0/d2/d12/f32 [8388608,4194304] 0 2023-12-08T20:28:28.870 INFO:tasks.workunit.client.0.smithi043.stdout:7/866: stat d0/d6/c23 0 2023-12-08T20:28:28.873 INFO:tasks.workunit.client.0.smithi043.stdout:1/882: rename d1/d16/d21/d25/d3e/df8/ffa to d1/d16/d21/d42/f143 0 2023-12-08T20:28:28.873 INFO:tasks.workunit.client.0.smithi043.stdout:1/883: fsync d1/d16/d1c/d71/dc5/f100 0 2023-12-08T20:28:28.873 INFO:tasks.workunit.client.0.smithi043.stdout:1/884: chown d1/d16/l93 0 1 2023-12-08T20:28:28.873 INFO:tasks.workunit.client.0.smithi043.stdout:1/885: chown d1/d16/d1c/l20 32956184 1 2023-12-08T20:28:28.873 INFO:tasks.workunit.client.0.smithi043.stdout:1/886: read d1/d16/d21/d25/d35/f9e [678979,71498] 0 2023-12-08T20:28:28.874 INFO:tasks.workunit.client.0.smithi043.stdout:1/887: dread - d1/d16/d1c/d71/fc6 zero size 2023-12-08T20:28:28.874 INFO:tasks.workunit.client.0.smithi043.stdout:1/888: fsync d1/d16/d21/d25/d35/f64 0 2023-12-08T20:28:28.874 INFO:tasks.workunit.client.0.smithi043.stdout:6/780: symlink d0/d2/de/d4a/de2/l108 0 2023-12-08T20:28:28.881 INFO:tasks.workunit.client.0.smithi043.stdout:1/889: rename d1/d16/d21/dc8/l131 to d1/d16/d1c/d138/l144 0 2023-12-08T20:28:28.883 INFO:tasks.workunit.client.0.smithi043.stdout:6/781: getdents d0/d2/de 0 2023-12-08T20:28:28.887 INFO:tasks.workunit.client.0.smithi043.stdout:6/782: unlink d0/d2/d14/d8/f9f 0 2023-12-08T20:28:28.887 INFO:tasks.workunit.client.0.smithi043.stdout:6/783: truncate d0/d2/d14/db3/df1/d22/d2a/faa 539838 0 2023-12-08T20:28:28.894 INFO:tasks.workunit.client.0.smithi043.stdout:1/890: dwrite d1/d16/d21/d25/d3e/df8/f13a [0,4194304] 0 2023-12-08T20:28:28.894 INFO:tasks.workunit.client.0.smithi043.stdout:1/891: write d1/d16/d30/fb3 [1143700,95243] 0 2023-12-08T20:28:28.894 INFO:tasks.workunit.client.0.smithi043.stdout:1/892: chown d1/d16/d1c/d71 18 1 2023-12-08T20:28:28.894 INFO:tasks.workunit.client.0.smithi043.stdout:1/893: read d1/d6/d63/fea [297791,111673] 0 2023-12-08T20:28:28.898 INFO:tasks.workunit.client.0.smithi043.stdout:1/894: rename d1/d16/d48/f56 to d1/d16/d21/d25/d3e/d77/d106/d13f/f145 0 2023-12-08T20:28:28.902 INFO:tasks.workunit.client.0.smithi043.stdout:1/895: link d1/d16/d21/d25/d35/f9e d1/d16/d21/d25/d35/f146 0 2023-12-08T20:28:28.938 INFO:tasks.workunit.client.0.smithi043.stdout:4/870: sync 2023-12-08T20:28:28.939 INFO:tasks.workunit.client.0.smithi043.stdout:4/871: mknod d1/d14/d25/d39/d3d/d40/c130 0 2023-12-08T20:28:28.940 INFO:tasks.workunit.client.0.smithi043.stdout:4/872: dread - d1/d14/d25/d39/d3d/d40/d67/fff zero size 2023-12-08T20:28:28.940 INFO:tasks.workunit.client.0.smithi043.stdout:4/873: mkdir d1/d14/d25/d77/da4/dc0/d131 0 2023-12-08T20:28:28.949 INFO:tasks.workunit.client.0.smithi043.stdout:4/874: dread d1/d14/d25/d28/d8a/f9b [0,4194304] 0 2023-12-08T20:28:28.950 INFO:tasks.workunit.client.0.smithi043.stdout:4/875: mkdir d1/d14/d25/d39/d3f/d3c/d41/dab/d132 0 2023-12-08T20:28:28.951 INFO:tasks.workunit.client.0.smithi043.stdout:4/876: mkdir d1/d14/d25/d39/dd6/d133 0 2023-12-08T20:28:28.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:28 smithi111 ceph-mon[121341]: pgmap v35: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 86 MiB/s rd, 178 MiB/s wr, 371 op/s 2023-12-08T20:28:28.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:28 smithi111 ceph-mon[121341]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:28:28.967 INFO:tasks.workunit.client.0.smithi043.stdout:4/877: dwrite d1/d14/d25/d77/da4/dc0/fde [0,4194304] 0 2023-12-08T20:28:28.969 INFO:tasks.workunit.client.0.smithi043.stdout:4/878: mkdir d1/d14/d25/d39/da3/d134 0 2023-12-08T20:28:28.969 INFO:tasks.workunit.client.0.smithi043.stdout:4/879: fsync d1/d14/d25/d39/da3/dae/fc5 0 2023-12-08T20:28:28.970 INFO:tasks.workunit.client.0.smithi043.stdout:4/880: link d1/d14/d1d/d75/ca0 d1/d14/d25/d39/dfb/dfd/c135 0 2023-12-08T20:28:28.971 INFO:tasks.workunit.client.0.smithi043.stdout:4/881: symlink d1/d14/d128/l136 0 2023-12-08T20:28:28.975 INFO:tasks.workunit.client.0.smithi043.stdout:4/882: dread d1/d14/d25/d28/f2b [0,4194304] 0 2023-12-08T20:28:28.992 INFO:tasks.workunit.client.0.smithi043.stdout:4/883: dwrite d1/d14/d25/d39/da3/dae/fb4 [4194304,4194304] 0 2023-12-08T20:28:28.993 INFO:tasks.workunit.client.0.smithi043.stdout:4/884: creat d1/d14/d25/d28/d94/dd0/f137 x:0 0 0 2023-12-08T20:28:28.994 INFO:tasks.workunit.client.0.smithi043.stdout:4/885: link d1/d14/d25/d39/f71 d1/d14/d25/d39/d3f/d3c/d41/d65/f138 0 2023-12-08T20:28:28.995 INFO:tasks.workunit.client.0.smithi043.stdout:4/886: unlink d1/d14/d1d/c3e 0 2023-12-08T20:28:28.995 INFO:tasks.workunit.client.0.smithi043.stdout:4/887: fsync d1/d14/d25/d77/da4/dc0/fcb 0 2023-12-08T20:28:28.995 INFO:tasks.workunit.client.0.smithi043.stdout:4/888: fsync d1/d14/f18 0 2023-12-08T20:28:28.996 INFO:tasks.workunit.client.0.smithi043.stdout:4/889: stat d1/d14/d25/d39/db1/fbe 0 2023-12-08T20:28:29.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:28 smithi043 ceph-mon[111966]: pgmap v35: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 86 MiB/s rd, 178 MiB/s wr, 371 op/s 2023-12-08T20:28:29.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:28 smithi043 ceph-mon[111966]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:28:29.014 INFO:tasks.workunit.client.0.smithi043.stdout:4/890: dwrite d1/d14/f48 [0,4194304] 0 2023-12-08T20:28:29.015 INFO:tasks.workunit.client.0.smithi043.stdout:4/891: mkdir d1/d139 0 2023-12-08T20:28:29.015 INFO:tasks.workunit.client.0.smithi043.stdout:4/892: dread - d1/d14/d25/d28/d94/dd0/f137 zero size 2023-12-08T20:28:29.015 INFO:tasks.workunit.client.0.smithi043.stdout:4/893: truncate d1/d14/d25/d28/f107 56010 0 2023-12-08T20:28:29.015 INFO:tasks.workunit.client.0.smithi043.stdout:4/894: fsync d1/d14/d1d/f1e 0 2023-12-08T20:28:29.015 INFO:tasks.workunit.client.0.smithi043.stdout:4/895: readlink d1/d14/d25/d39/d3f/d3c/d41/ldf 0 2023-12-08T20:28:29.015 INFO:tasks.workunit.client.0.smithi043.stdout:4/896: creat d1/d14/d50/f13a x:0 0 0 2023-12-08T20:28:29.016 INFO:tasks.workunit.client.0.smithi043.stdout:4/897: unlink d1/d14/d25/d77/da4/fe1 0 2023-12-08T20:28:29.038 INFO:tasks.workunit.client.0.smithi043.stdout:4/898: dwrite d1/d14/d25/d39/d3d/d40/d67/f9c [4194304,4194304] 0 2023-12-08T20:28:29.046 INFO:tasks.workunit.client.0.smithi043.stdout:9/844: sync 2023-12-08T20:28:29.047 INFO:tasks.workunit.client.0.smithi043.stdout:5/867: sync 2023-12-08T20:28:29.047 INFO:tasks.workunit.client.0.smithi043.stdout:5/868: chown d3/d7/d90/ce5 39193 1 2023-12-08T20:28:29.056 INFO:tasks.workunit.client.0.smithi043.stdout:4/899: dwrite d1/fd5 [0,4194304] 0 2023-12-08T20:28:29.059 INFO:tasks.workunit.client.0.smithi043.stdout:4/900: mknod d1/d14/d25/d39/d3f/d3c/d126/c13b 0 2023-12-08T20:28:29.062 INFO:tasks.workunit.client.0.smithi043.stdout:5/869: dwrite d3/d7/d19/d3f/d52/f70 [4194304,4194304] 0 2023-12-08T20:28:29.064 INFO:tasks.workunit.client.0.smithi043.stdout:4/901: write d1/d14/d1d/f1e [2068649,45084] 0 2023-12-08T20:28:29.064 INFO:tasks.workunit.client.0.smithi043.stdout:4/902: readlink d1/d14/d25/d39/d3f/l6b 0 2023-12-08T20:28:29.064 INFO:tasks.workunit.client.0.smithi043.stdout:4/903: fdatasync d1/d14/d25/d39/dd6/fe6 0 2023-12-08T20:28:29.064 INFO:tasks.workunit.client.0.smithi043.stdout:5/870: link d3/d7/de/d82/d95/c107 d3/d7/d21/c112 0 2023-12-08T20:28:29.065 INFO:tasks.workunit.client.0.smithi043.stdout:4/904: mknod d1/d14/d25/d39/d3d/c13c 0 2023-12-08T20:28:29.067 INFO:tasks.workunit.client.0.smithi043.stdout:5/871: dread d3/d7/d21/d51/d5c/fbb [0,4194304] 0 2023-12-08T20:28:29.067 INFO:tasks.workunit.client.0.smithi043.stdout:5/872: chown d3/d7/d21/d51/d7d/ddf/le9 7305213 1 2023-12-08T20:28:29.067 INFO:tasks.workunit.client.0.smithi043.stdout:5/873: chown d3/d7/de/d43/l102 12946393 1 2023-12-08T20:28:29.067 INFO:tasks.workunit.client.0.smithi043.stdout:5/874: stat d3/d7/d21/d51/f54 0 2023-12-08T20:28:29.067 INFO:tasks.workunit.client.0.smithi043.stdout:4/905: creat d1/d14/d1d/d12a/f13d x:0 0 0 2023-12-08T20:28:29.068 INFO:tasks.workunit.client.0.smithi043.stdout:4/906: dread d1/d14/d25/d39/d3f/f7e [0,4194304] 0 2023-12-08T20:28:29.068 INFO:tasks.workunit.client.0.smithi043.stdout:5/875: unlink d3/d7/de/d82/d8b/f93 0 2023-12-08T20:28:29.069 INFO:tasks.workunit.client.0.smithi043.stdout:5/876: mknod d3/d7/de/d82/c113 0 2023-12-08T20:28:29.071 INFO:tasks.workunit.client.0.smithi043.stdout:5/877: symlink d3/d7/de/d82/l114 0 2023-12-08T20:28:29.071 INFO:tasks.workunit.client.0.smithi043.stdout:5/878: chown d3/d7/d29/f60 186664 1 2023-12-08T20:28:29.073 INFO:tasks.workunit.client.0.smithi043.stdout:4/907: getdents d1/d14/d1d/d12a 0 2023-12-08T20:28:29.083 INFO:tasks.workunit.client.0.smithi043.stdout:5/879: dread d3/d7/d21/d51/ddd/f27 [4194304,4194304] 0 2023-12-08T20:28:29.084 INFO:tasks.workunit.client.0.smithi043.stdout:5/880: rename d3/d7/d21/d51/ddd/l40 to d3/d7/de/l115 0 2023-12-08T20:28:29.084 INFO:tasks.workunit.client.0.smithi043.stdout:5/881: truncate d3/d7/de/d82/d95/fe2 995008 0 2023-12-08T20:28:29.087 INFO:tasks.workunit.client.0.smithi043.stdout:5/882: mkdir d3/d7/d90/d116 0 2023-12-08T20:28:29.088 INFO:tasks.workunit.client.0.smithi043.stdout:5/883: rename d3/d7/d21/d51/d5c/cbd to d3/d7/d19/d3f/d52/c117 0 2023-12-08T20:28:29.090 INFO:tasks.workunit.client.0.smithi043.stdout:4/908: dwrite d1/d14/d25/f2c [0,4194304] 0 2023-12-08T20:28:29.092 INFO:tasks.workunit.client.0.smithi043.stdout:4/909: rmdir d1/d14/d25/d39/da3 39 2023-12-08T20:28:29.093 INFO:tasks.workunit.client.0.smithi043.stdout:4/910: rmdir d1/d14/d25/d28/d8a/de8 0 2023-12-08T20:28:29.095 INFO:tasks.workunit.client.0.smithi043.stdout:5/884: rename d3/d7/d19/d3f/d52 to d3/d7/de/dee/d118 0 2023-12-08T20:28:29.096 INFO:tasks.workunit.client.0.smithi043.stdout:5/885: mknod d3/d7/de/d43/d68/c119 0 2023-12-08T20:28:29.097 INFO:tasks.workunit.client.0.smithi043.stdout:4/911: rename d1/d14/ce2 to d1/d14/d25/d39/dd6/de0/c13e 0 2023-12-08T20:28:29.098 INFO:tasks.workunit.client.0.smithi043.stdout:4/912: getdents d1/d14/d25/d77/d93 0 2023-12-08T20:28:29.099 INFO:tasks.workunit.client.0.smithi043.stdout:4/913: link d1/d14/d25/d39/d3f/d59/f96 d1/d14/d25/d39/d3d/d40/f13f 0 2023-12-08T20:28:29.100 INFO:tasks.workunit.client.0.smithi043.stdout:4/914: creat d1/d14/d25/d39/d3d/db0/f140 x:0 0 0 2023-12-08T20:28:29.101 INFO:tasks.workunit.client.0.smithi043.stdout:4/915: mkdir d1/d14/d25/d39/d3f/d3c/d126/d141 0 2023-12-08T20:28:29.115 INFO:tasks.workunit.client.0.smithi043.stdout:4/916: dwrite d1/d14/d25/d39/d3f/d3c/d41/f124 [0,4194304] 0 2023-12-08T20:28:29.117 INFO:tasks.workunit.client.0.smithi043.stdout:4/917: rmdir d1/d14/d25/d77/da4 39 2023-12-08T20:28:29.118 INFO:tasks.workunit.client.0.smithi043.stdout:4/918: mkdir d1/d14/d25/d39/d3f/d3c/d41/d65/d142 0 2023-12-08T20:28:29.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.119+0000 7f346aef5700 1 -- 172.21.15.43:0/3246029017 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3464105730 con 0x7f346410dbb0 2023-12-08T20:28:29.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.120+0000 7f34617fa700 1 -- 172.21.15.43:0/3246029017 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7f3464105730 con 0x7f346410dbb0 2023-12-08T20:28:29.122 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:28:29.122 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": { 2023-12-08T20:28:29.122 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2 2023-12-08T20:28:29.122 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:28:29.122 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": { 2023-12-08T20:28:29.122 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 1, 2023-12-08T20:28:29.122 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 1 2023-12-08T20:28:29.122 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:28:29.122 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": { 2023-12-08T20:28:29.123 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 6 2023-12-08T20:28:29.123 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:28:29.123 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2023-12-08T20:28:29.123 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-08T20:28:29.123 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:28:29.123 INFO:teuthology.orchestra.run.smithi043.stdout: "overall": { 2023-12-08T20:28:29.123 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 13, 2023-12-08T20:28:29.123 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 1 2023-12-08T20:28:29.123 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-12-08T20:28:29.123 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:28:29.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.122+0000 7f346aef5700 1 -- 172.21.15.43:0/3246029017 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f345406ae40 msgr2=0x7f345406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:29.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.122+0000 7f346aef5700 1 --2- 172.21.15.43:0/3246029017 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f345406ae40 0x7f345406d2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f345800b0d0 tx=0x7f3458009e30 comp rx=0 tx=0).stop 2023-12-08T20:28:29.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.122+0000 7f346aef5700 1 -- 172.21.15.43:0/3246029017 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f346410dbb0 msgr2=0x7f346410ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:29.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.122+0000 7f346aef5700 1 --2- 172.21.15.43:0/3246029017 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f346410dbb0 0x7f346410ea50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3464065dd0 tx=0x7f345000b040 comp rx=0 tx=0).stop 2023-12-08T20:28:29.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.123+0000 7f346aef5700 1 -- 172.21.15.43:0/3246029017 shutdown_connections 2023-12-08T20:28:29.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.123+0000 7f346aef5700 1 --2- 172.21.15.43:0/3246029017 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7f345406ae40 0x7f345406d2f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:29.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.123+0000 7f346aef5700 1 --2- 172.21.15.43:0/3246029017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34640ffd70 0x7f346410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:29.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.123+0000 7f346aef5700 1 --2- 172.21.15.43:0/3246029017 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f346410dbb0 0x7f346410ea50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:29.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.123+0000 7f346aef5700 1 -- 172.21.15.43:0/3246029017 >> 172.21.15.43:0/3246029017 conn(0x7f34640f7190 msgr2=0x7f34640f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:28:29.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.123+0000 7f346aef5700 1 -- 172.21.15.43:0/3246029017 shutdown_connections 2023-12-08T20:28:29.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.123+0000 7f346aef5700 1 -- 172.21.15.43:0/3246029017 wait complete. 2023-12-08T20:28:29.262 INFO:tasks.workunit.client.0.smithi043.stdout:3/902: sync 2023-12-08T20:28:29.263 INFO:tasks.workunit.client.0.smithi043.stdout:8/931: sync 2023-12-08T20:28:29.272 INFO:tasks.workunit.client.0.smithi043.stdout:3/903: dread d1/d9/df/f47 [0,4194304] 0 2023-12-08T20:28:29.273 INFO:tasks.workunit.client.0.smithi043.stdout:3/904: truncate d1/d9/df/d6e/f121 212558 0 2023-12-08T20:28:29.283 INFO:tasks.workunit.client.0.smithi043.stdout:8/932: dwrite d2/d27/d2d/d31/de8/ff8 [0,4194304] 0 2023-12-08T20:28:29.286 INFO:tasks.workunit.client.0.smithi043.stdout:8/933: rename d2/d20/d7d/d29/f66 to d2/d27/d2d/d31/d7f/db2/f131 0 2023-12-08T20:28:29.286 INFO:tasks.workunit.client.0.smithi043.stdout:8/934: mknod d2/d27/d105/c132 0 2023-12-08T20:28:29.286 INFO:tasks.workunit.client.0.smithi043.stdout:8/935: readlink d2/d20/d7d/d29/d30/l54 0 2023-12-08T20:28:29.289 INFO:tasks.workunit.client.0.smithi043.stdout:8/936: dread d2/d20/d7d/f46 [0,4194304] 0 2023-12-08T20:28:29.290 INFO:tasks.workunit.client.0.smithi043.stdout:8/937: read d2/d20/d7d/f26 [204903,51368] 0 2023-12-08T20:28:29.290 INFO:tasks.workunit.client.0.smithi043.stdout:8/938: creat d2/d27/d2d/d31/d99/f133 x:0 0 0 2023-12-08T20:28:29.291 INFO:tasks.workunit.client.0.smithi043.stdout:8/939: creat d2/d20/d7d/d29/d30/d60/d9b/f134 x:0 0 0 2023-12-08T20:28:29.292 INFO:tasks.workunit.client.0.smithi043.stdout:8/940: dread - d2/d20/d7d/d29/d59/d9f/fcc zero size 2023-12-08T20:28:29.292 INFO:tasks.workunit.client.0.smithi043.stdout:8/941: mknod d2/d27/d2d/d31/d74/c135 0 2023-12-08T20:28:29.292 INFO:tasks.workunit.client.0.smithi043.stdout:8/942: chown d2/d27/d2d/d31/d74/l10f 88736228 1 2023-12-08T20:28:29.295 INFO:tasks.workunit.client.0.smithi043.stdout:8/943: mknod d2/d20/d7d/d29/d59/d9f/ddf/dfa/d12c/c136 0 2023-12-08T20:28:29.295 INFO:tasks.workunit.client.0.smithi043.stdout:8/944: stat d2/d20/d7d/d37/d5a/f5d 0 2023-12-08T20:28:29.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.296+0000 7fd7defae700 1 -- 172.21.15.43:0/667153580 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7d80fde00 msgr2=0x7fd7d80fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:29.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.296+0000 7fd7defae700 1 --2- 172.21.15.43:0/667153580 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7d80fde00 0x7fd7d80fe250 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4004940 tx=0x7fd7c4009e30 comp rx=0 tx=0).stop 2023-12-08T20:28:29.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.297+0000 7fd7defae700 1 -- 172.21.15.43:0/667153580 shutdown_connections 2023-12-08T20:28:29.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.297+0000 7fd7defae700 1 --2- 172.21.15.43:0/667153580 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7d80fde00 0x7fd7d80fe250 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:29.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.297+0000 7fd7defae700 1 --2- 172.21.15.43:0/667153580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7d80fcbf0 0x7fd7d80fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:29.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.297+0000 7fd7defae700 1 -- 172.21.15.43:0/667153580 >> 172.21.15.43:0/667153580 conn(0x7fd7d80f82d0 msgr2=0x7fd7d80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:28:29.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.297+0000 7fd7defae700 1 -- 172.21.15.43:0/667153580 shutdown_connections 2023-12-08T20:28:29.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.297+0000 7fd7defae700 1 -- 172.21.15.43:0/667153580 wait complete. 2023-12-08T20:28:29.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.297+0000 7fd7defae700 1 Processor -- start 2023-12-08T20:28:29.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.297+0000 7fd7defae700 1 -- start start 2023-12-08T20:28:29.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.298+0000 7fd7defae700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7d80fcbf0 0x7fd7d80715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:28:29.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.298+0000 7fd7defae700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7d80fde00 0x7fd7d8071b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:28:29.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.298+0000 7fd7defae700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d8070230 con 0x7fd7d80fde00 2023-12-08T20:28:29.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.298+0000 7fd7defae700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d8070370 con 0x7fd7d80fcbf0 2023-12-08T20:28:29.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.298+0000 7fd7dcd4a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7d80fcbf0 0x7fd7d80715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:28:29.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.298+0000 7fd7dcd4a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7d80fcbf0 0x7fd7d80715f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.43:36892/0 (socket says 172.21.15.43:36892) 2023-12-08T20:28:29.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.298+0000 7fd7dcd4a700 1 -- 172.21.15.43:0/506458138 learned_addr learned my addr 172.21.15.43:0/506458138 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:28:29.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.299+0000 7fd7d7fff700 1 --2- 172.21.15.43:0/506458138 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7d80fde00 0x7fd7d8071b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:28:29.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.299+0000 7fd7d7fff700 1 -- 172.21.15.43:0/506458138 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7d80fcbf0 msgr2=0x7fd7d80715f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:29.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.299+0000 7fd7d7fff700 1 --2- 172.21.15.43:0/506458138 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7d80fcbf0 0x7fd7d80715f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:29.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.299+0000 7fd7d7fff700 1 -- 172.21.15.43:0/506458138 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c4005040 con 0x7fd7d80fde00 2023-12-08T20:28:29.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.299+0000 7fd7d7fff700 1 --2- 172.21.15.43:0/506458138 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7d80fde00 0x7fd7d8071b30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400b0d0 tx=0x7fd7c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:28:29.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.299+0000 7fd7d57fa700 1 -- 172.21.15.43:0/506458138 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7c400e070 con 0x7fd7d80fde00 2023-12-08T20:28:29.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.300+0000 7fd7defae700 1 -- 172.21.15.43:0/506458138 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d80705f0 con 0x7fd7d80fde00 2023-12-08T20:28:29.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.300+0000 7fd7d57fa700 1 -- 172.21.15.43:0/506458138 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd7c4013d00 con 0x7fd7d80fde00 2023-12-08T20:28:29.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.300+0000 7fd7d57fa700 1 -- 172.21.15.43:0/506458138 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7c400b9c0 con 0x7fd7d80fde00 2023-12-08T20:28:29.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.300+0000 7fd7defae700 1 -- 172.21.15.43:0/506458138 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d8070ad0 con 0x7fd7d80fde00 2023-12-08T20:28:29.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.301+0000 7fd7defae700 1 -- 172.21.15.43:0/506458138 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d804bb80 con 0x7fd7d80fde00 2023-12-08T20:28:29.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.302+0000 7fd7d57fa700 1 -- 172.21.15.43:0/506458138 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7fd7c4013850 con 0x7fd7d80fde00 2023-12-08T20:28:29.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.303+0000 7fd7d57fa700 1 --2- 172.21.15.43:0/506458138 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7fd7c806ae40 0x7fd7c806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:28:29.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.303+0000 7fd7d57fa700 1 -- 172.21.15.43:0/506458138 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fd7c40931a0 con 0x7fd7d80fde00 2023-12-08T20:28:29.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.303+0000 7fd7dcd4a700 1 --2- 172.21.15.43:0/506458138 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7fd7c806ae40 0x7fd7c806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:28:29.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.304+0000 7fd7dcd4a700 1 --2- 172.21.15.43:0/506458138 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7fd7c806ae40 0x7fd7c806d2f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8071380 tx=0x7fd7cc00b040 comp rx=0 tx=0).ready entity=mgr.24407 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:28:29.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.309+0000 7fd7d57fa700 1 -- 172.21.15.43:0/506458138 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fd7c405d780 con 0x7fd7d80fde00 2023-12-08T20:28:29.311 INFO:tasks.workunit.client.0.smithi043.stdout:8/945: dwrite d2/d27/dab/f11d [0,4194304] 0 2023-12-08T20:28:29.311 INFO:tasks.workunit.client.0.smithi043.stdout:8/946: chown d2/d20/d7d/d29/d30/d60/d9b/cac 3745979 1 2023-12-08T20:28:29.313 INFO:tasks.workunit.client.0.smithi043.stdout:8/947: mkdir d2/d20/d7d/d29/d30/d71/d137 0 2023-12-08T20:28:29.332 INFO:tasks.workunit.client.0.smithi043.stdout:8/948: dwrite d2/d27/d2d/d31/d91/fa3 [0,4194304] 0 2023-12-08T20:28:29.332 INFO:tasks.workunit.client.0.smithi043.stdout:8/949: fsync d2/d20/d7d/f61 0 2023-12-08T20:28:29.333 INFO:tasks.workunit.client.0.smithi043.stdout:8/950: write d2/d27/d2d/d31/d74/fa5 [1320419,26701] 0 2023-12-08T20:28:29.334 INFO:tasks.workunit.client.0.smithi043.stdout:8/951: mknod d2/d20/d7d/d29/d30/d60/d9b/dbb/dd6/c138 0 2023-12-08T20:28:29.335 INFO:tasks.workunit.client.0.smithi043.stdout:8/952: stat d2/d27/c28 0 2023-12-08T20:28:29.336 INFO:tasks.workunit.client.0.smithi043.stdout:8/953: link d2/d20/d7d/d29/d30/d60/d9b/dbb/cc2 d2/d20/d7d/d29/d30/c139 0 2023-12-08T20:28:29.336 INFO:tasks.workunit.client.0.smithi043.stdout:8/954: dread - d2/d20/d7d/d29/d30/fd1 zero size 2023-12-08T20:28:29.351 INFO:tasks.workunit.client.0.smithi043.stdout:8/955: dwrite d2/d20/d7d/d29/d30/d71/fd2 [0,4194304] 0 2023-12-08T20:28:29.365 INFO:tasks.workunit.client.0.smithi043.stdout:8/956: dwrite d2/d27/d2d/d31/d7f/f93 [0,4194304] 0 2023-12-08T20:28:29.384 INFO:tasks.workunit.client.0.smithi043.stdout:8/957: dwrite d2/d27/d2d/d31/d99/f133 [0,4194304] 0 2023-12-08T20:28:29.384 INFO:tasks.workunit.client.0.smithi043.stdout:8/958: chown d2/d27/d2d/d31/d91 1 1 2023-12-08T20:28:29.387 INFO:tasks.workunit.client.0.smithi043.stdout:8/959: creat d2/d27/dab/f13a x:0 0 0 2023-12-08T20:28:29.388 INFO:tasks.workunit.client.0.smithi043.stdout:8/960: read d2/d20/fdb [667945,1138] 0 2023-12-08T20:28:29.391 INFO:tasks.workunit.client.0.smithi043.stdout:8/961: unlink d2/l9c 0 2023-12-08T20:28:29.394 INFO:tasks.workunit.client.0.smithi043.stdout:8/962: truncate d2/d20/d7d/d29/d30/f49 279384 0 2023-12-08T20:28:29.394 INFO:tasks.workunit.client.0.smithi043.stdout:8/963: stat d2/d27/d2d/d31/d74/f120 0 2023-12-08T20:28:29.394 INFO:tasks.workunit.client.0.smithi043.stdout:8/964: fsync d2/d20/fb1 0 2023-12-08T20:28:29.394 INFO:tasks.workunit.client.0.smithi043.stdout:8/965: readlink d2/d27/d2d/d31/d74/la2 0 2023-12-08T20:28:29.397 INFO:tasks.workunit.client.0.smithi043.stdout:8/966: mknod d2/d20/d7d/d37/d5a/c13b 0 2023-12-08T20:28:29.399 INFO:tasks.workunit.client.0.smithi043.stdout:8/967: mknod d2/d20/d7d/d29/d30/d60/d9b/dee/c13c 0 2023-12-08T20:28:29.403 INFO:tasks.workunit.client.0.smithi043.stdout:8/968: rename d2/d27/d2d/d31/d74/cbd to d2/d27/d105/c13d 0 2023-12-08T20:28:29.414 INFO:tasks.workunit.client.0.smithi043.stdout:8/969: dread d2/d20/d7d/d29/d30/d7c/ff3 [0,4194304] 0 2023-12-08T20:28:29.415 INFO:tasks.workunit.client.0.smithi043.stdout:8/970: rmdir d2/d20/d7d/d29/d30/d60/d9b/d117 39 2023-12-08T20:28:29.415 INFO:tasks.workunit.client.0.smithi043.stdout:8/971: chown d2/d27/d2d 7 1 2023-12-08T20:28:29.415 INFO:tasks.workunit.client.0.smithi043.stdout:8/972: read d2/d27/fe0 [493297,18730] 0 2023-12-08T20:28:29.417 INFO:tasks.workunit.client.0.smithi043.stdout:8/973: mkdir d2/d27/d13e 0 2023-12-08T20:28:29.419 INFO:tasks.workunit.client.0.smithi043.stdout:8/974: creat d2/d20/d7d/d37/d5a/f13f x:0 0 0 2023-12-08T20:28:29.481 INFO:tasks.workunit.client.0.smithi043.stdout:7/867: sync 2023-12-08T20:28:29.481 INFO:tasks.workunit.client.0.smithi043.stdout:7/868: write d0/d6/d17/d54/f81 [835199,16567] 0 2023-12-08T20:28:29.505 INFO:tasks.workunit.client.0.smithi043.stdout:7/869: dwrite d0/d6/f7b [0,4194304] 0 2023-12-08T20:28:29.505 INFO:tasks.workunit.client.0.smithi043.stdout:7/870: write d0/fb [3406616,37954] 0 2023-12-08T20:28:29.506 INFO:tasks.workunit.client.0.smithi043.stdout:7/871: symlink d0/l118 0 2023-12-08T20:28:29.506 INFO:tasks.workunit.client.0.smithi043.stdout:7/872: truncate d0/d2/f7c 985766 0 2023-12-08T20:28:29.507 INFO:tasks.workunit.client.0.smithi043.stdout:7/873: mkdir d0/d2/d65/d99/d47/d119 0 2023-12-08T20:28:29.507 INFO:tasks.workunit.client.0.smithi043.stdout:7/874: chown d0/d6/d17/d54/ca7 7 1 2023-12-08T20:28:29.508 INFO:tasks.workunit.client.0.smithi043.stdout:7/875: creat d0/d5b/f11a x:0 0 0 2023-12-08T20:28:29.580 INFO:tasks.workunit.client.0.smithi043.stdout:6/784: sync 2023-12-08T20:28:29.580 INFO:tasks.workunit.client.0.smithi043.stdout:1/896: sync 2023-12-08T20:28:29.581 INFO:tasks.workunit.client.0.smithi043.stdout:1/897: mknod d1/d16/d1c/d4e/d12d/c147 0 2023-12-08T20:28:29.584 INFO:tasks.workunit.client.0.smithi043.stdout:1/898: getdents d1/d16/d21/d25 0 2023-12-08T20:28:29.586 INFO:tasks.workunit.client.0.smithi043.stdout:1/899: mknod d1/d16/d21/d25/d3e/d77/d106/c148 0 2023-12-08T20:28:29.586 INFO:tasks.workunit.client.0.smithi043.stdout:6/785: dread d0/d2/d14/d20/d3c/d50/f77 [0,4194304] 0 2023-12-08T20:28:29.587 INFO:tasks.workunit.client.0.smithi043.stdout:1/900: write d1/d16/d1c/d71/fc7 [79005,86159] 0 2023-12-08T20:28:29.587 INFO:tasks.workunit.client.0.smithi043.stdout:1/901: chown d1/d16/d30/f75 152 1 2023-12-08T20:28:29.590 INFO:tasks.workunit.client.0.smithi043.stdout:6/786: mknod d0/d2/de/d4a/c109 0 2023-12-08T20:28:29.590 INFO:tasks.workunit.client.0.smithi043.stdout:6/787: write d0/d2/d14/db3/df1/d22/d2a/db2/fcf [801494,77334] 0 2023-12-08T20:28:29.593 INFO:tasks.workunit.client.0.smithi043.stdout:1/902: symlink d1/d16/d1c/d71/dc5/l149 0 2023-12-08T20:28:29.597 INFO:tasks.workunit.client.0.smithi043.stdout:1/903: creat d1/d16/d30/d6e/d83/f14a x:0 0 0 2023-12-08T20:28:29.597 INFO:tasks.workunit.client.0.smithi043.stdout:1/904: chown d1/d16/d1c/fd7 65344 1 2023-12-08T20:28:29.597 INFO:tasks.workunit.client.0.smithi043.stdout:1/905: chown d1/d16/d21/d25/c2b 185884 1 2023-12-08T20:28:29.600 INFO:tasks.workunit.client.0.smithi043.stdout:1/906: mknod d1/d16/d30/d6e/c14b 0 2023-12-08T20:28:29.602 INFO:tasks.workunit.client.0.smithi043.stdout:1/907: creat d1/d16/d30/f14c x:0 0 0 2023-12-08T20:28:29.618 INFO:tasks.workunit.client.0.smithi043.stdout:1/908: dwrite d1/d16/d1c/fd7 [0,4194304] 0 2023-12-08T20:28:29.619 INFO:tasks.workunit.client.0.smithi043.stdout:1/909: chown d1/d16/d30/d4f/ld2 52 1 2023-12-08T20:28:29.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.623+0000 7fd7defae700 1 -- 172.21.15.43:0/506458138 --> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7d8102750 con 0x7fd7c806ae40 2023-12-08T20:28:29.625 INFO:tasks.workunit.client.0.smithi043.stdout:1/910: dread d1/d16/d21/d25/d35/fb0 [0,4194304] 0 2023-12-08T20:28:29.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.625+0000 7fd7d57fa700 1 -- 172.21.15.43:0/506458138 <== mgr.24407 v2:172.21.15.111:6828/940639390 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fd7d8102750 con 0x7fd7c806ae40 2023-12-08T20:28:29.626 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:28:29.626 INFO:teuthology.orchestra.run.smithi043.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-08T20:28:29.626 INFO:teuthology.orchestra.run.smithi043.stdout: "in_progress": true, 2023-12-08T20:28:29.626 INFO:teuthology.orchestra.run.smithi043.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-08T20:28:29.626 INFO:teuthology.orchestra.run.smithi043.stdout: "services_complete": [], 2023-12-08T20:28:29.626 INFO:teuthology.orchestra.run.smithi043.stdout: "progress": "1/2 daemons upgraded", 2023-12-08T20:28:29.626 INFO:teuthology.orchestra.run.smithi043.stdout: "message": "Currently upgrading mgr daemons", 2023-12-08T20:28:29.626 INFO:teuthology.orchestra.run.smithi043.stdout: "is_paused": false 2023-12-08T20:28:29.627 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:28:29.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.628+0000 7fd7defae700 1 -- 172.21.15.43:0/506458138 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7fd7c806ae40 msgr2=0x7fd7c806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:29.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.628+0000 7fd7defae700 1 --2- 172.21.15.43:0/506458138 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7fd7c806ae40 0x7fd7c806d2f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8071380 tx=0x7fd7cc00b040 comp rx=0 tx=0).stop 2023-12-08T20:28:29.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.628+0000 7fd7defae700 1 -- 172.21.15.43:0/506458138 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7d80fde00 msgr2=0x7fd7d8071b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:29.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.628+0000 7fd7defae700 1 --2- 172.21.15.43:0/506458138 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7d80fde00 0x7fd7d8071b30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400b0d0 tx=0x7fd7c4009e30 comp rx=0 tx=0).stop 2023-12-08T20:28:29.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.628+0000 7fd7defae700 1 -- 172.21.15.43:0/506458138 shutdown_connections 2023-12-08T20:28:29.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.628+0000 7fd7defae700 1 --2- 172.21.15.43:0/506458138 >> [v2:172.21.15.111:6828/940639390,v1:172.21.15.111:6829/940639390] conn(0x7fd7c806ae40 0x7fd7c806d2f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:29.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.628+0000 7fd7defae700 1 --2- 172.21.15.43:0/506458138 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7d80fcbf0 0x7fd7d80715f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:29.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.628+0000 7fd7defae700 1 --2- 172.21.15.43:0/506458138 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7d80fde00 0x7fd7d8071b30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:29.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.628+0000 7fd7defae700 1 -- 172.21.15.43:0/506458138 >> 172.21.15.43:0/506458138 conn(0x7fd7d80f82d0 msgr2=0x7fd7d8101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:28:29.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.628+0000 7fd7defae700 1 -- 172.21.15.43:0/506458138 shutdown_connections 2023-12-08T20:28:29.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:29.628+0000 7fd7defae700 1 -- 172.21.15.43:0/506458138 wait complete. 2023-12-08T20:28:29.640 INFO:tasks.workunit.client.0.smithi043.stdout:1/911: dwrite d1/d16/d48/f4a [4194304,4194304] 0 2023-12-08T20:28:29.657 INFO:tasks.workunit.client.0.smithi043.stdout:1/912: truncate d1/d6/d63/fea 293267 0 2023-12-08T20:28:29.661 INFO:tasks.workunit.client.0.smithi043.stdout:1/913: mknod d1/d16/d1c/d4e/d12d/c14d 0 2023-12-08T20:28:29.662 INFO:tasks.workunit.client.0.smithi043.stdout:1/914: truncate d1/d16/d1c/d71/d98/fd6 4086281 0 2023-12-08T20:28:29.662 INFO:tasks.workunit.client.0.smithi043.stdout:1/915: getdents d1/d16/d21/d25/d35/d103/d141 0 2023-12-08T20:28:29.662 INFO:tasks.workunit.client.0.smithi043.stdout:1/916: read d1/d16/d7e/f128 [281410,116183] 0 2023-12-08T20:28:29.662 INFO:tasks.workunit.client.0.smithi043.stdout:1/917: stat d1/d16/d48/f65 0 2023-12-08T20:28:29.664 INFO:tasks.workunit.client.0.smithi043.stdout:1/918: mkdir d1/d6/d63/d14e 0 2023-12-08T20:28:29.701 INFO:tasks.workunit.client.0.smithi043.stdout:1/919: dwrite d1/d16/d1c/d4e/f7b [0,4194304] 0 2023-12-08T20:28:29.706 INFO:tasks.workunit.client.0.smithi043.stdout:1/920: mknod d1/d16/d21/d25/d3e/d72/c14f 0 2023-12-08T20:28:29.709 INFO:tasks.workunit.client.0.smithi043.stdout:1/921: creat d1/d16/d1c/d4e/f150 x:0 0 0 2023-12-08T20:28:29.709 INFO:tasks.workunit.client.0.smithi043.stdout:1/922: stat d1/d16/d1c/d4e 0 2023-12-08T20:28:29.712 INFO:tasks.workunit.client.0.smithi043.stdout:1/923: dread d1/d16/d21/d25/d3e/dbc/fe5 [0,4194304] 0 2023-12-08T20:28:29.715 INFO:tasks.workunit.client.0.smithi043.stdout:1/924: symlink d1/d16/d7e/l151 0 2023-12-08T20:28:29.715 INFO:tasks.workunit.client.0.smithi043.stdout:1/925: chown d1/d16/d86/fa5 11945 1 2023-12-08T20:28:29.715 INFO:tasks.workunit.client.0.smithi043.stdout:1/926: write d1/d16/d30/fb3 [2128831,105949] 0 2023-12-08T20:28:29.717 INFO:tasks.workunit.client.0.smithi043.stdout:1/927: link d1/d16/d21/d25/c2b d1/d16/d21/d25/d35/c152 0 2023-12-08T20:28:29.718 INFO:tasks.workunit.client.0.smithi043.stdout:1/928: mknod d1/d16/d21/d25/d3e/d77/d106/c153 0 2023-12-08T20:28:29.720 INFO:tasks.workunit.client.0.smithi043.stdout:1/929: rmdir d1/d16/d86/d120 0 2023-12-08T20:28:29.721 INFO:tasks.workunit.client.0.smithi043.stdout:1/930: symlink d1/d16/d30/d6e/d83/l154 0 2023-12-08T20:28:29.722 INFO:tasks.workunit.client.0.smithi043.stdout:1/931: truncate d1/d16/d1c/f7c 1530104 0 2023-12-08T20:28:29.774 INFO:tasks.workunit.client.0.smithi043.stdout:4/919: sync 2023-12-08T20:28:29.775 INFO:tasks.workunit.client.0.smithi043.stdout:4/920: creat d1/d14/d25/d39/dd6/de0/f143 x:0 0 0 2023-12-08T20:28:29.776 INFO:tasks.workunit.client.0.smithi043.stdout:4/921: mkdir d1/d14/d25/d39/d144 0 2023-12-08T20:28:29.778 INFO:tasks.workunit.client.0.smithi043.stdout:4/922: truncate d1/f5 1179042 0 2023-12-08T20:28:29.778 INFO:tasks.workunit.client.0.smithi043.stdout:4/923: write d1/d14/d25/d39/d3d/d40/d67/fff [820587,28782] 0 2023-12-08T20:28:29.779 INFO:tasks.workunit.client.0.smithi043.stdout:4/924: rename d1/d14/d25/d39/d3d/d40/le4 to d1/d14/d25/d39/dd6/d133/l145 0 2023-12-08T20:28:29.780 INFO:tasks.workunit.client.0.smithi043.stdout:4/925: mkdir d1/d14/d50/d146 0 2023-12-08T20:28:29.781 INFO:tasks.workunit.client.0.smithi043.stdout:4/926: symlink d1/d14/d25/d39/dd6/de0/l147 0 2023-12-08T20:28:29.794 INFO:tasks.workunit.client.0.smithi043.stdout:4/927: dwrite d1/d14/d25/d39/fbc [0,4194304] 0 2023-12-08T20:28:29.794 INFO:tasks.workunit.client.0.smithi043.stdout:4/928: fsync d1/d14/d25/d39/d3f/d3c/d41/f95 0 2023-12-08T20:28:29.794 INFO:tasks.workunit.client.0.smithi043.stdout:4/929: fdatasync d1/d14/d25/d39/da3/ff8 0 2023-12-08T20:28:29.798 INFO:tasks.workunit.client.0.smithi043.stdout:4/930: dread d1/d14/f18 [4194304,4194304] 0 2023-12-08T20:28:29.800 INFO:tasks.workunit.client.0.smithi043.stdout:4/931: rename d1/d14/d25/d39/dfb/dfd to d1/d14/d25/d39/d3d/d40/d67/d7f/d148 0 2023-12-08T20:28:29.802 INFO:tasks.workunit.client.0.smithi043.stdout:4/932: truncate d1/d14/d1d/d58/f62 3065015 0 2023-12-08T20:28:29.803 INFO:tasks.workunit.client.0.smithi043.stdout:4/933: write d1/d14/d50/f9a [2500840,75732] 0 2023-12-08T20:28:29.804 INFO:tasks.workunit.client.0.smithi043.stdout:4/934: write d1/d14/d25/d39/d3d/d40/d67/f9c [3483587,59023] 0 2023-12-08T20:28:29.806 INFO:tasks.workunit.client.0.smithi043.stdout:4/935: mknod d1/d14/d25/d39/d3d/c149 0 2023-12-08T20:28:29.807 INFO:tasks.workunit.client.0.smithi043.stdout:4/936: symlink d1/d14/d25/d28/l14a 0 2023-12-08T20:28:29.808 INFO:tasks.workunit.client.0.smithi043.stdout:4/937: write d1/d14/d1d/f4b [87278,37262] 0 2023-12-08T20:28:29.809 INFO:tasks.workunit.client.0.smithi043.stdout:4/938: creat d1/d14/d25/d39/f14b x:0 0 0 2023-12-08T20:28:29.810 INFO:tasks.workunit.client.0.smithi043.stdout:4/939: dread - d1/d14/d25/d39/d3f/d3c/d41/db6/f125 zero size 2023-12-08T20:28:29.821 INFO:tasks.workunit.client.0.smithi043.stdout:4/940: dwrite d1/d14/d25/d39/f71 [0,4194304] 0 2023-12-08T20:28:29.822 INFO:tasks.workunit.client.0.smithi043.stdout:4/941: rmdir d1/d14/d25/d77/da4/d129 0 2023-12-08T20:28:29.823 INFO:tasks.workunit.client.0.smithi043.stdout:4/942: getdents d1/d14 0 2023-12-08T20:28:29.846 INFO:tasks.workunit.client.0.smithi043.stdout:4/943: dwrite d1/d14/f48 [0,4194304] 0 2023-12-08T20:28:29.846 INFO:tasks.workunit.client.0.smithi043.stdout:4/944: dread - d1/d14/d50/f101 zero size 2023-12-08T20:28:29.847 INFO:tasks.workunit.client.0.smithi043.stdout:4/945: fsync d1/d14/f24 0 2023-12-08T20:28:29.850 INFO:tasks.workunit.client.0.smithi043.stdout:4/946: mkdir d1/d14/d25/d77/d14c 0 2023-12-08T20:28:29.850 INFO:tasks.workunit.client.0.smithi043.stdout:4/947: getdents d1/d14/d25/d39/d3f/d3c/d80 0 2023-12-08T20:28:29.851 INFO:tasks.workunit.client.0.smithi043.stdout:4/948: mkdir d1/d14/d1d/d58/dd9/d14d 0 2023-12-08T20:28:29.852 INFO:tasks.workunit.client.0.smithi043.stdout:4/949: chown d1/d14/d25/d39/d3f/d11b 1981669 1 2023-12-08T20:28:29.852 INFO:tasks.workunit.client.0.smithi043.stdout:4/950: stat d1/d14/d25/d28/d94/dd0 0 2023-12-08T20:28:29.853 INFO:tasks.workunit.client.0.smithi043.stdout:4/951: getdents d1/d14/d25/d39/d3d/d40/d67/d88 0 2023-12-08T20:28:29.854 INFO:tasks.workunit.client.0.smithi043.stdout:4/952: symlink d1/d14/d25/d77/d93/l14e 0 2023-12-08T20:28:29.854 INFO:tasks.workunit.client.0.smithi043.stdout:4/953: dread - d1/d14/faf zero size 2023-12-08T20:28:29.854 INFO:tasks.workunit.client.0.smithi043.stdout:4/954: write d1/fc6 [224399,108640] 0 2023-12-08T20:28:29.856 INFO:tasks.workunit.client.0.smithi043.stdout:4/955: rename d1/d14/d25/d39/d3f/d3c/d41/db6 to d1/d14/d25/d39/d3d/d40/d67/d7f/d14f 0 2023-12-08T20:28:29.859 INFO:tasks.workunit.client.0.smithi043.stdout:4/956: rename d1/d14/d25/d77/d8d/ff0 to d1/d14/d25/d39/d3f/d3c/d41/d113/f150 0 2023-12-08T20:28:29.860 INFO:tasks.workunit.client.0.smithi043.stdout:8/975: sync 2023-12-08T20:28:29.860 INFO:tasks.workunit.client.0.smithi043.stdout:7/876: sync 2023-12-08T20:28:29.860 INFO:tasks.workunit.client.0.smithi043.stdout:5/886: sync 2023-12-08T20:28:29.860 INFO:tasks.workunit.client.0.smithi043.stdout:3/905: sync 2023-12-08T20:28:29.860 INFO:tasks.workunit.client.0.smithi043.stdout:6/788: sync 2023-12-08T20:28:29.860 INFO:tasks.workunit.client.0.smithi043.stdout:6/789: stat d0/d2/d14/d20/d3c/d50/c5b 0 2023-12-08T20:28:29.860 INFO:tasks.workunit.client.0.smithi043.stdout:6/790: read - d0/d2/d14/db3/df1/d22/fff zero size 2023-12-08T20:28:29.860 INFO:tasks.workunit.client.0.smithi043.stdout:9/845: sync 2023-12-08T20:28:29.861 INFO:tasks.workunit.client.0.smithi043.stdout:9/846: fdatasync d0/d3d/d4b/da2/dbc/d109/ddd/f54 0 2023-12-08T20:28:29.861 INFO:tasks.workunit.client.0.smithi043.stdout:6/791: write d0/d2/fa6 [562024,66757] 0 2023-12-08T20:28:29.861 INFO:tasks.workunit.client.0.smithi043.stdout:6/792: write d0/d2/d14/f90 [1374279,95287] 0 2023-12-08T20:28:29.861 INFO:tasks.workunit.client.0.smithi043.stdout:6/793: truncate d0/f7f 2646561 0 2023-12-08T20:28:29.862 INFO:tasks.workunit.client.0.smithi043.stdout:8/976: creat d2/d27/d2d/d31/de8/f140 x:0 0 0 2023-12-08T20:28:29.862 INFO:tasks.workunit.client.0.smithi043.stdout:8/977: chown d2/d20/d7d/d29/d30/d71/fd2 15925953 1 2023-12-08T20:28:29.862 INFO:tasks.workunit.client.0.smithi043.stdout:7/877: link d0/d6/d17/f114 d0/d2/d65/d99/d47/d119/f11b 0 2023-12-08T20:28:29.867 INFO:tasks.workunit.client.0.smithi043.stdout:5/887: symlink d3/d7/d21/d51/d5c/da7/l11a 0 2023-12-08T20:28:29.867 INFO:tasks.workunit.client.0.smithi043.stdout:3/906: truncate d1/f9e 78895 0 2023-12-08T20:28:29.867 INFO:tasks.workunit.client.0.smithi043.stdout:7/878: write d0/d2/d12/d19/f94 [3520990,28106] 0 2023-12-08T20:28:29.867 INFO:tasks.workunit.client.0.smithi043.stdout:3/907: write d1/d9/df/ddb/d10c/dca/dd4/fde [2516103,3746] 0 2023-12-08T20:28:29.867 INFO:tasks.workunit.client.0.smithi043.stdout:9/847: creat d0/d3d/d4b/d5c/f117 x:0 0 0 2023-12-08T20:28:29.867 INFO:tasks.workunit.client.0.smithi043.stdout:8/978: rmdir d2/d27/d2d/d31/d4f 39 2023-12-08T20:28:29.869 INFO:tasks.workunit.client.0.smithi043.stdout:4/957: dread d1/d14/d25/d39/d3d/d40/d67/f83 [0,4194304] 0 2023-12-08T20:28:29.869 INFO:tasks.workunit.client.0.smithi043.stdout:4/958: write d1/d14/d25/d39/d3f/d59/f10b [894283,2207] 0 2023-12-08T20:28:29.869 INFO:tasks.workunit.client.0.smithi043.stdout:6/794: dread d0/d2/d14/d20/d49/f64 [0,4194304] 0 2023-12-08T20:28:29.870 INFO:tasks.workunit.client.0.smithi043.stdout:5/888: mknod d3/d73/d83/dd6/c11b 0 2023-12-08T20:28:29.873 INFO:tasks.workunit.client.0.smithi043.stdout:7/879: rename d0/d2/d65/d99/lef to d0/d2/d65/d99/de7/l11c 0 2023-12-08T20:28:29.873 INFO:tasks.workunit.client.0.smithi043.stdout:7/880: readlink d0/d2/d65/l109 0 2023-12-08T20:28:29.873 INFO:tasks.workunit.client.0.smithi043.stdout:7/881: chown d0/d2/d65/d99/d47/dd6/dd8/le8 25 1 2023-12-08T20:28:29.874 INFO:tasks.workunit.client.0.smithi043.stdout:9/848: symlink d0/d5e/d73/deb/l118 0 2023-12-08T20:28:29.874 INFO:tasks.workunit.client.0.smithi043.stdout:9/849: read - d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d94/ffe zero size 2023-12-08T20:28:29.875 INFO:tasks.workunit.client.0.smithi043.stdout:8/979: mknod d2/d27/d2d/de2/c141 0 2023-12-08T20:28:29.880 INFO:tasks.workunit.client.0.smithi043.stdout:4/959: getdents d1/d14/d25/d77/da4 0 2023-12-08T20:28:29.880 INFO:tasks.workunit.client.0.smithi043.stdout:4/960: readlink d1/d14/d25/d39/da3/ld7 0 2023-12-08T20:28:29.881 INFO:tasks.workunit.client.0.smithi043.stdout:6/795: dread d0/d2/d14/db3/df1/d22/d3f/d45/f51 [0,4194304] 0 2023-12-08T20:28:29.881 INFO:tasks.workunit.client.0.smithi043.stdout:6/796: write d0/d2/d14/d20/d3c/f9c [232608,75077] 0 2023-12-08T20:28:29.881 INFO:tasks.workunit.client.0.smithi043.stdout:5/889: mknod d3/d73/da4/db0/c11c 0 2023-12-08T20:28:29.882 INFO:tasks.workunit.client.0.smithi043.stdout:3/908: rename d1/d9/d38/d4f/cc6 to d1/d25/d84/c122 0 2023-12-08T20:28:29.882 INFO:tasks.workunit.client.0.smithi043.stdout:3/909: chown d1/d1c/d29/la2 29514 1 2023-12-08T20:28:29.883 INFO:tasks.workunit.client.0.smithi043.stdout:6/797: rmdir d0/d2/de/d4a/d56/dc2 39 2023-12-08T20:28:29.885 INFO:tasks.workunit.client.0.smithi043.stdout:9/850: creat d0/d3d/d4b/da2/dbc/d109/ddd/d6b/f119 x:0 0 0 2023-12-08T20:28:29.885 INFO:tasks.workunit.client.0.smithi043.stdout:8/980: dread d2/d27/d2d/d31/d99/fe6 [0,4194304] 0 2023-12-08T20:28:29.885 INFO:tasks.workunit.client.0.smithi043.stdout:9/851: write d0/d3d/d8a/fd2 [136710,130124] 0 2023-12-08T20:28:29.885 INFO:tasks.workunit.client.0.smithi043.stdout:9/852: truncate d0/d21/ff4 4343241 0 2023-12-08T20:28:29.890 INFO:tasks.workunit.client.0.smithi043.stdout:6/798: symlink d0/d2/d14/db3/df1/d22/d2a/db2/dba/dec/l10a 0 2023-12-08T20:28:29.894 INFO:tasks.workunit.client.0.smithi043.stdout:4/961: truncate d1/d14/d127/f10f 1325293 0 2023-12-08T20:28:29.894 INFO:tasks.workunit.client.0.smithi043.stdout:5/890: rename d3/d7/d90/f106 to d3/d7/de/d43/d68/db1/f11d 0 2023-12-08T20:28:29.897 INFO:tasks.workunit.client.0.smithi043.stdout:4/962: creat d1/d14/d25/d39/d3d/d40/d67/f151 x:0 0 0 2023-12-08T20:28:29.898 INFO:tasks.workunit.client.0.smithi043.stdout:5/891: creat d3/d7/de/d43/f11e x:0 0 0 2023-12-08T20:28:29.898 INFO:tasks.workunit.client.0.smithi043.stdout:5/892: truncate d3/d7/de/d43/d68/fc8 412780 0 2023-12-08T20:28:29.898 INFO:tasks.workunit.client.0.smithi043.stdout:5/893: fdatasync d3/d7/d21/d51/fc9 0 2023-12-08T20:28:29.898 INFO:tasks.workunit.client.0.smithi043.stdout:5/894: chown d3/d7/d21/d51/d7d/ddf/ce3 202580 1 2023-12-08T20:28:29.898 INFO:tasks.workunit.client.0.smithi043.stdout:4/963: getdents d1/d14/d25/d39/d3d/d40 0 2023-12-08T20:28:29.901 INFO:tasks.workunit.client.0.smithi043.stdout:6/799: truncate d0/d2/d14/db3/df1/f3b 1065133 0 2023-12-08T20:28:29.901 INFO:tasks.workunit.client.0.smithi043.stdout:5/895: symlink d3/d7/d21/d51/d7d/ddf/df2/l11f 0 2023-12-08T20:28:29.902 INFO:tasks.workunit.client.0.smithi043.stdout:7/882: write d0/d2/f7c [333320,114684] 0 2023-12-08T20:28:29.902 INFO:tasks.workunit.client.0.smithi043.stdout:7/883: chown d0/d2/d12/d19/d38/f9d 134790328 1 2023-12-08T20:28:29.902 INFO:tasks.workunit.client.0.smithi043.stdout:4/964: symlink d1/d14/l152 0 2023-12-08T20:28:29.904 INFO:tasks.workunit.client.0.smithi043.stdout:5/896: symlink d3/d7/d21/d51/d7d/ddf/df2/l120 0 2023-12-08T20:28:29.905 INFO:tasks.workunit.client.0.smithi043.stdout:6/800: link d0/laf d0/d2/d14/db3/df1/d22/d2a/db2/dba/l10b 0 2023-12-08T20:28:29.905 INFO:tasks.workunit.client.0.smithi043.stdout:4/965: creat d1/d14/d25/f153 x:0 0 0 2023-12-08T20:28:29.906 INFO:tasks.workunit.client.0.smithi043.stdout:8/981: dwrite d2/d20/d7d/d29/d30/d71/f76 [0,4194304] 0 2023-12-08T20:28:29.906 INFO:tasks.workunit.client.0.smithi043.stdout:5/897: symlink d3/d73/l121 0 2023-12-08T20:28:29.908 INFO:tasks.workunit.client.0.smithi043.stdout:4/966: unlink d1/d14/d50/f13a 0 2023-12-08T20:28:29.909 INFO:tasks.workunit.client.0.smithi043.stdout:3/910: dwrite d1/d9/d38/d4f/d8f/fe7 [0,4194304] 0 2023-12-08T20:28:29.909 INFO:tasks.workunit.client.0.smithi043.stdout:3/911: fsync d1/d9/d38/d4f/f79 0 2023-12-08T20:28:29.909 INFO:tasks.workunit.client.0.smithi043.stdout:5/898: mknod d3/d7/d29/c122 0 2023-12-08T20:28:29.911 INFO:tasks.workunit.client.0.smithi043.stdout:5/899: unlink d3/d7/d21/f4d 0 2023-12-08T20:28:29.916 INFO:tasks.workunit.client.0.smithi043.stdout:8/982: dread d2/d20/f2c [0,4194304] 0 2023-12-08T20:28:29.917 INFO:tasks.workunit.client.0.smithi043.stdout:4/967: write d1/d14/f18 [2351648,107608] 0 2023-12-08T20:28:29.919 INFO:tasks.workunit.client.0.smithi043.stdout:8/983: creat d2/d20/d7d/d29/d59/d9f/ddf/f142 x:0 0 0 2023-12-08T20:28:29.919 INFO:tasks.workunit.client.0.smithi043.stdout:7/884: dread d0/d6/d17/f37 [0,4194304] 0 2023-12-08T20:28:29.920 INFO:tasks.workunit.client.0.smithi043.stdout:9/853: dwrite d0/d3d/d4b/da2/dbc/d109/ddd/d6b/f119 [0,4194304] 0 2023-12-08T20:28:29.920 INFO:tasks.workunit.client.0.smithi043.stdout:3/912: write d1/d25/d2a/df6/ffe [1887940,45591] 0 2023-12-08T20:28:29.921 INFO:tasks.workunit.client.0.smithi043.stdout:7/885: dread d0/d6/fe9 [0,4194304] 0 2023-12-08T20:28:29.921 INFO:tasks.workunit.client.0.smithi043.stdout:7/886: dread - d0/d2/d65/d99/de3/fea zero size 2023-12-08T20:28:29.924 INFO:tasks.workunit.client.0.smithi043.stdout:4/968: symlink d1/d14/d25/d39/dd6/d133/l154 0 2023-12-08T20:28:29.924 INFO:tasks.workunit.client.0.smithi043.stdout:9/854: write d0/d21/d80/d8e/df6/fc5 [1976178,60742] 0 2023-12-08T20:28:29.924 INFO:tasks.workunit.client.0.smithi043.stdout:9/855: chown d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d76/d53/l8f 33275867 1 2023-12-08T20:28:29.924 INFO:tasks.workunit.client.0.smithi043.stdout:8/984: unlink d2/d27/d2d/d31/d74/fa5 0 2023-12-08T20:28:29.925 INFO:tasks.workunit.client.0.smithi043.stdout:8/985: rename d2 to d2/d27/d105/d143 22 2023-12-08T20:28:29.925 INFO:tasks.workunit.client.0.smithi043.stdout:8/986: fdatasync d2/f9d 0 2023-12-08T20:28:29.925 INFO:tasks.workunit.client.0.smithi043.stdout:3/913: dread d1/d1c/d29/f57 [0,4194304] 0 2023-12-08T20:28:29.925 INFO:tasks.workunit.client.0.smithi043.stdout:3/914: write d1/d1c/d29/f57 [2690570,101433] 0 2023-12-08T20:28:29.928 INFO:tasks.workunit.client.0.smithi043.stdout:4/969: mkdir d1/d14/d25/d39/dd6/d133/d155 0 2023-12-08T20:28:29.933 INFO:tasks.workunit.client.0.smithi043.stdout:8/987: truncate d2/d27/d2d/d31/de8/ff8 289487 0 2023-12-08T20:28:29.938 INFO:tasks.workunit.client.0.smithi043.stdout:3/915: rmdir d1/d25/d2a/dc7 39 2023-12-08T20:28:29.938 INFO:tasks.workunit.client.0.smithi043.stdout:3/916: chown d1/d9/d2d/l55 65889 1 2023-12-08T20:28:29.938 INFO:tasks.workunit.client.0.smithi043.stdout:4/970: mknod d1/d14/d1d/d58/dd9/c156 0 2023-12-08T20:28:29.939 INFO:tasks.workunit.client.0.smithi043.stdout:5/900: dwrite d3/d7/de/f8d [0,4194304] 0 2023-12-08T20:28:29.939 INFO:tasks.workunit.client.0.smithi043.stdout:4/971: mkdir d1/d14/d25/d39/d3f/d3c/d126/d157 0 2023-12-08T20:28:29.942 INFO:tasks.workunit.client.0.smithi043.stdout:5/901: symlink d3/d7/de/d82/d95/l123 0 2023-12-08T20:28:29.943 INFO:tasks.workunit.client.0.smithi043.stdout:4/972: getdents d1/d14/d25/d28/d8a 0 2023-12-08T20:28:29.946 INFO:tasks.workunit.client.0.smithi043.stdout:7/887: dwrite d0/d2/d65/fb5 [0,4194304] 0 2023-12-08T20:28:29.946 INFO:tasks.workunit.client.0.smithi043.stdout:5/902: rename d3/d7/de/dee to d3/d7/de/d6a/d124 0 2023-12-08T20:28:29.947 INFO:tasks.workunit.client.0.smithi043.stdout:4/973: unlink d1/d14/d25/d39/d3d/d40/d67/fff 0 2023-12-08T20:28:29.947 INFO:tasks.workunit.client.0.smithi043.stdout:4/974: chown d1/d14/d25/d39/dd6/d111 369 1 2023-12-08T20:28:29.949 INFO:tasks.workunit.client.0.smithi043.stdout:5/903: creat d3/d7/d21/d51/d7d/f125 x:0 0 0 2023-12-08T20:28:29.949 INFO:tasks.workunit.client.0.smithi043.stdout:3/917: dread d1/d25/d2a/dd0/dbe/f11a [0,4194304] 0 2023-12-08T20:28:29.949 INFO:tasks.workunit.client.0.smithi043.stdout:3/918: chown d1/d9/df5/l120 322 1 2023-12-08T20:28:29.950 INFO:tasks.workunit.client.0.smithi043.stdout:3/919: fsync d1/d1c/d29/f5c 0 2023-12-08T20:28:29.951 INFO:tasks.workunit.client.0.smithi043.stdout:5/904: read d3/d7/d19/f6d [305967,60223] 0 2023-12-08T20:28:29.951 INFO:tasks.workunit.client.0.smithi043.stdout:4/975: mknod d1/d14/d25/d39/da3/dae/c158 0 2023-12-08T20:28:29.952 INFO:tasks.workunit.client.0.smithi043.stdout:9/856: dwrite d0/d3d/f48 [0,4194304] 0 2023-12-08T20:28:29.954 INFO:tasks.workunit.client.0.smithi043.stdout:3/920: unlink d1/d1c/c81 0 2023-12-08T20:28:29.956 INFO:tasks.workunit.client.0.smithi043.stdout:5/905: mkdir d3/d7/d21/d126 0 2023-12-08T20:28:29.956 INFO:tasks.workunit.client.0.smithi043.stdout:4/976: getdents d1/d14/d127 0 2023-12-08T20:28:29.957 INFO:tasks.workunit.client.0.smithi043.stdout:6/801: dwrite d0/d2/d29/fd9 [0,4194304] 0 2023-12-08T20:28:29.957 INFO:tasks.workunit.client.0.smithi043.stdout:6/802: fsync d0/d2/de/d4a/d56/dc2/ffd 0 2023-12-08T20:28:29.959 INFO:tasks.workunit.client.0.smithi043.stdout:3/921: mkdir d1/d1c/d2c/d5f/d123 0 2023-12-08T20:28:29.959 INFO:tasks.workunit.client.0.smithi043.stdout:8/988: dwrite d2/d20/d7d/d29/d30/d60/d9b/dee/f107 [0,4194304] 0 2023-12-08T20:28:29.959 INFO:tasks.workunit.client.0.smithi043.stdout:3/922: stat d1/d1c/d2c/fd3 0 2023-12-08T20:28:29.960 INFO:tasks.workunit.client.0.smithi043.stdout:3/923: chown d1/d1c/f53 2036 1 2023-12-08T20:28:29.960 INFO:tasks.workunit.client.0.smithi043.stdout:5/906: getdents d3/d7/d21/d51/d5c/d81/d98 0 2023-12-08T20:28:29.960 INFO:tasks.workunit.client.0.smithi043.stdout:3/924: fdatasync d1/d9/df/ddb/d10c/fbc 0 2023-12-08T20:28:29.960 INFO:tasks.workunit.client.0.smithi043.stdout:3/925: fsync d1/d9/d38/d33/f5d 0 2023-12-08T20:28:29.964 INFO:tasks.workunit.client.0.smithi043.stdout:3/926: truncate d1/d9/d38/d4f/d5a/fff 1878005 0 2023-12-08T20:28:29.964 INFO:tasks.workunit.client.0.smithi043.stdout:3/927: chown d1/d9/df/d26/c60 821963240 1 2023-12-08T20:28:29.964 INFO:tasks.workunit.client.0.smithi043.stdout:3/928: stat d1/d9/d38/d4a/fb3 0 2023-12-08T20:28:29.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:29 smithi111 ceph-mon[121341]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:28:29.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:29 smithi111 ceph-mon[121341]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:28:29.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:29 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/3246029017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:28:29.968 INFO:tasks.workunit.client.0.smithi043.stdout:7/888: dwrite d0/d6/d17/d54/fc3 [0,4194304] 0 2023-12-08T20:28:29.970 INFO:tasks.workunit.client.0.smithi043.stdout:3/929: getdents d1/d9/d2d/d42 0 2023-12-08T20:28:29.973 INFO:tasks.workunit.client.0.smithi043.stdout:3/930: write d1/d9/f4e [841489,103677] 0 2023-12-08T20:28:29.989 INFO:tasks.workunit.client.0.smithi043.stdout:3/931: dread d1/d9/df/ddb/d10c/dca/dd4/fde [0,4194304] 0 2023-12-08T20:28:29.989 INFO:tasks.workunit.client.0.smithi043.stdout:3/932: read - d1/d9/d38/fd7 zero size 2023-12-08T20:28:29.990 INFO:tasks.workunit.client.0.smithi043.stdout:4/977: dwrite d1/d14/d25/d39/da3/dae/f10a [0,4194304] 0 2023-12-08T20:28:29.991 INFO:tasks.workunit.client.0.smithi043.stdout:4/978: truncate d1/d14/d25/d39/d3d/d40/d67/fed 943759 0 2023-12-08T20:28:29.991 INFO:tasks.workunit.client.0.smithi043.stdout:4/979: write d1/d14/d25/d39/f79 [442067,105244] 0 2023-12-08T20:28:29.993 INFO:tasks.workunit.client.0.smithi043.stdout:4/980: creat d1/d14/d25/d39/d3d/d40/d67/f159 x:0 0 0 2023-12-08T20:28:29.994 INFO:tasks.workunit.client.0.smithi043.stdout:5/907: dwrite d3/d7/d21/d51/d5c/d81/f10f [0,4194304] 0 2023-12-08T20:28:29.994 INFO:tasks.workunit.client.0.smithi043.stdout:4/981: read d1/d14/d25/d39/f71 [295337,99807] 0 2023-12-08T20:28:30.005 INFO:tasks.workunit.client.0.smithi043.stdout:6/803: dwrite d0/d2/fa6 [0,4194304] 0 2023-12-08T20:28:30.005 INFO:tasks.workunit.client.0.smithi043.stdout:6/804: read d0/d2/d14/db3/df1/f65 [4114627,118936] 0 2023-12-08T20:28:30.005 INFO:tasks.workunit.client.0.smithi043.stdout:7/889: dwrite d0/d69/d6d/fc8 [0,4194304] 0 2023-12-08T20:28:30.005 INFO:tasks.workunit.client.0.smithi043.stdout:7/890: stat d0/d2/d65/cff 0 2023-12-08T20:28:30.006 INFO:tasks.workunit.client.0.smithi043.stdout:7/891: creat d0/d2/d65/d99/d47/dda/d10e/f11d x:0 0 0 2023-12-08T20:28:30.006 INFO:tasks.workunit.client.0.smithi043.stdout:8/989: dwrite d2/d27/d2d/de7/f115 [0,4194304] 0 2023-12-08T20:28:30.009 INFO:tasks.workunit.client.0.smithi043.stdout:7/892: truncate d0/d2/d12/da2/fd0 2948689 0 2023-12-08T20:28:30.009 INFO:tasks.workunit.client.0.smithi043.stdout:7/893: truncate d0/d2/d12/d19/faf 1062280 0 2023-12-08T20:28:30.013 INFO:tasks.workunit.client.0.smithi043.stdout:8/990: rmdir d2/d20 39 2023-12-08T20:28:30.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:29 smithi043 ceph-mon[111966]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:28:30.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:29 smithi043 ceph-mon[111966]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:28:30.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:29 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3246029017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:28:30.015 INFO:tasks.workunit.client.0.smithi043.stdout:7/894: creat d0/d6/d17/d52/f11e x:0 0 0 2023-12-08T20:28:30.015 INFO:tasks.workunit.client.0.smithi043.stdout:8/991: write d2/d20/d7d/d29/d30/d60/f12b [788601,123409] 0 2023-12-08T20:28:30.016 INFO:tasks.workunit.client.0.smithi043.stdout:8/992: link d2/d27/d2d/d31/d99/f133 d2/d27/d2d/d31/de8/f144 0 2023-12-08T20:28:30.016 INFO:tasks.workunit.client.0.smithi043.stdout:8/993: chown d2/d27/d2d/de7 74023 1 2023-12-08T20:28:30.023 INFO:tasks.workunit.client.0.smithi043.stdout:5/908: dwrite d3/d78/ff3 [0,4194304] 0 2023-12-08T20:28:30.026 INFO:tasks.workunit.client.0.smithi043.stdout:7/895: dread d0/d2/d12/d19/f94 [0,4194304] 0 2023-12-08T20:28:30.026 INFO:tasks.workunit.client.0.smithi043.stdout:7/896: readlink d0/d69/d6d/l7a 0 2023-12-08T20:28:30.026 INFO:tasks.workunit.client.0.smithi043.stdout:5/909: mkdir d3/d7/d21/d51/ddd/d127 0 2023-12-08T20:28:30.026 INFO:tasks.workunit.client.0.smithi043.stdout:3/933: dwrite d1/d9/d38/d4f/d8f/fe7 [0,4194304] 0 2023-12-08T20:28:30.026 INFO:tasks.workunit.client.0.smithi043.stdout:4/982: dwrite d1/d14/d50/f9a [0,4194304] 0 2023-12-08T20:28:30.026 INFO:tasks.workunit.client.0.smithi043.stdout:4/983: chown d1/d14/d25/d28/d8a/f9b 13 1 2023-12-08T20:28:30.026 INFO:tasks.workunit.client.0.smithi043.stdout:4/984: getdents d1/d14/d25/d28/d8a 0 2023-12-08T20:28:30.027 INFO:tasks.workunit.client.0.smithi043.stdout:7/897: link d0/d2/d65/d99/l13 d0/d2/d65/d99/de7/l11f 0 2023-12-08T20:28:30.027 INFO:tasks.workunit.client.0.smithi043.stdout:5/910: write d3/d73/f7e [363306,19505] 0 2023-12-08T20:28:30.027 INFO:tasks.workunit.client.0.smithi043.stdout:4/985: truncate d1/d14/d25/d39/da3/dae/f10a 541663 0 2023-12-08T20:28:30.028 INFO:tasks.workunit.client.0.smithi043.stdout:6/805: dwrite d0/d2/d14/d8/f43 [4194304,4194304] 0 2023-12-08T20:28:30.029 INFO:tasks.workunit.client.0.smithi043.stdout:8/994: write d2/d27/f35 [10583014,100364] 0 2023-12-08T20:28:30.030 INFO:tasks.workunit.client.0.smithi043.stdout:8/995: write d2/d20/d7d/d29/d30/d7c/f11e [190466,22075] 0 2023-12-08T20:28:30.030 INFO:tasks.workunit.client.0.smithi043.stdout:7/898: mkdir d0/d6/d17/d120 0 2023-12-08T20:28:30.031 INFO:tasks.workunit.client.0.smithi043.stdout:4/986: unlink d1/d14/d25/d28/d94/f118 0 2023-12-08T20:28:30.032 INFO:tasks.workunit.client.0.smithi043.stdout:4/987: write d1/d14/d25/d39/d3d/d40/d67/fa2 [765353,93783] 0 2023-12-08T20:28:30.032 INFO:tasks.workunit.client.0.smithi043.stdout:4/988: dread - d1/d14/d1d/d58/dd9/f119 zero size 2023-12-08T20:28:30.032 INFO:tasks.workunit.client.0.smithi043.stdout:4/989: write d1/d14/d25/d28/f120 [792807,22855] 0 2023-12-08T20:28:30.032 INFO:tasks.workunit.client.0.smithi043.stdout:6/806: creat d0/d2/d29/dd0/f10c x:0 0 0 2023-12-08T20:28:30.033 INFO:tasks.workunit.client.0.smithi043.stdout:5/911: dread d3/d7/d21/d51/d5c/d81/fc0 [0,4194304] 0 2023-12-08T20:28:30.033 INFO:tasks.workunit.client.0.smithi043.stdout:8/996: mknod d2/d27/d2d/d31/d4f/c145 0 2023-12-08T20:28:30.033 INFO:tasks.workunit.client.0.smithi043.stdout:8/997: chown d2/d20/d7d 46 1 2023-12-08T20:28:30.034 INFO:tasks.workunit.client.0.smithi043.stdout:7/899: creat d0/d2/d65/f121 x:0 0 0 2023-12-08T20:28:30.034 INFO:tasks.workunit.client.0.smithi043.stdout:7/900: readlink d0/d6/dc7/lb7 0 2023-12-08T20:28:30.037 INFO:tasks.workunit.client.0.smithi043.stdout:4/990: getdents d1/d14/d25/d39/d3d 0 2023-12-08T20:28:30.037 INFO:tasks.workunit.client.0.smithi043.stdout:4/991: read - d1/d14/d25/d77/da4/dc0/def/ffc zero size 2023-12-08T20:28:30.037 INFO:tasks.workunit.client.0.smithi043.stdout:4/992: write d1/d14/d50/f9a [4208561,94490] 0 2023-12-08T20:28:30.041 INFO:tasks.workunit.client.0.smithi043.stdout:8/998: rmdir d2/d20/d7d/d29/d30/d7c 39 2023-12-08T20:28:30.041 INFO:tasks.workunit.client.0.smithi043.stdout:5/912: getdents d3/d7/de/d6a/d124 0 2023-12-08T20:28:30.041 INFO:tasks.workunit.client.0.smithi043.stdout:5/913: stat d3/d7/de/c64 0 2023-12-08T20:28:30.043 INFO:tasks.workunit.client.0.smithi043.stdout:7/901: rename d0/ff5 to d0/d6/d17/dab/f122 0 2023-12-08T20:28:30.043 INFO:tasks.workunit.client.0.smithi043.stdout:3/934: dwrite d1/d9/df/d41/fe3 [0,4194304] 0 2023-12-08T20:28:30.045 INFO:tasks.workunit.client.0.smithi043.stdout:4/993: mknod d1/d14/d25/d77/d8d/c15a 0 2023-12-08T20:28:30.050 INFO:tasks.workunit.client.0.smithi043.stdout:8/999: mknod d2/c146 0 2023-12-08T20:28:30.052 INFO:tasks.workunit.client.0.smithi043.stdout:5/914: getdents d3/d7/d21 0 2023-12-08T20:28:30.053 INFO:tasks.workunit.client.0.smithi043.stdout:5/915: read d3/d7/d19/d3f/f86 [1899929,35103] 0 2023-12-08T20:28:30.053 INFO:tasks.workunit.client.0.smithi043.stdout:5/916: stat d3/d78/fdc 0 2023-12-08T20:28:30.053 INFO:tasks.workunit.client.0.smithi043.stdout:7/902: mknod d0/d6/d17/d54/c123 0 2023-12-08T20:28:30.056 INFO:tasks.workunit.client.0.smithi043.stdout:3/935: rename d1/d9/d38/d4f/d8f/f99 to d1/d9/df/d26/f124 0 2023-12-08T20:28:30.058 INFO:tasks.workunit.client.0.smithi043.stdout:4/994: creat d1/d139/f15b x:0 0 0 2023-12-08T20:28:30.058 INFO:tasks.workunit.client.0.smithi043.stdout:4/995: chown d1/d14/d25/d39/d3f/d11b 1733 1 2023-12-08T20:28:30.064 INFO:tasks.workunit.client.0.smithi043.stdout:7/903: mknod d0/d69/d6d/dfd/c124 0 2023-12-08T20:28:30.065 INFO:tasks.workunit.client.0.smithi043.stdout:3/936: dread d1/d9/df/ddb/d10c/fbc [0,4194304] 0 2023-12-08T20:28:30.065 INFO:tasks.workunit.client.0.smithi043.stdout:5/917: rename d3/d7/d19/d3f/c110 to d3/d7/d19/c128 0 2023-12-08T20:28:30.065 INFO:tasks.workunit.client.0.smithi043.stdout:5/918: chown d3/d7/d21/ff7 524719 1 2023-12-08T20:28:30.066 INFO:tasks.workunit.client.0.smithi043.stdout:4/996: creat d1/d14/d25/d77/da4/dc0/def/f15c x:0 0 0 2023-12-08T20:28:30.067 INFO:tasks.workunit.client.0.smithi043.stdout:3/937: getdents d1/d25/dc1 0 2023-12-08T20:28:30.073 INFO:tasks.workunit.client.0.smithi043.stdout:7/904: rename d0/d2/d12/d19/lce to d0/d6/dc7/l125 0 2023-12-08T20:28:30.074 INFO:tasks.workunit.client.0.smithi043.stdout:5/919: rmdir d3/d7/d21/d51/ddd/d84 39 2023-12-08T20:28:30.075 INFO:tasks.workunit.client.0.smithi043.stdout:7/905: unlink d0/d6/d17/d54/f81 0 2023-12-08T20:28:30.076 INFO:tasks.workunit.client.0.smithi043.stdout:5/920: rename d3/d7/de/c53 to d3/d7/de/d82/d95/c129 0 2023-12-08T20:28:30.076 INFO:tasks.workunit.client.0.smithi043.stdout:5/921: stat d3/d7/d21/d51/ddd/d84/fba 0 2023-12-08T20:28:30.077 INFO:tasks.workunit.client.0.smithi043.stdout:7/906: rmdir d0/d2/d12/d19/d38 39 2023-12-08T20:28:30.079 INFO:tasks.workunit.client.0.smithi043.stdout:7/907: rename d0/d6/fba to d0/d2/d65/d99/f126 0 2023-12-08T20:28:30.087 INFO:tasks.workunit.client.0.smithi043.stdout:3/938: dwrite d1/d25/d2a/dd0/f96 [0,4194304] 0 2023-12-08T20:28:30.088 INFO:tasks.workunit.client.0.smithi043.stdout:3/939: creat d1/d25/f125 x:0 0 0 2023-12-08T20:28:30.091 INFO:tasks.workunit.client.0.smithi043.stdout:3/940: dread d1/d25/dc1/f117 [0,4194304] 0 2023-12-08T20:28:30.096 INFO:tasks.workunit.client.0.smithi043.stdout:5/922: dwrite d3/d7/d29/f77 [0,4194304] 0 2023-12-08T20:28:30.100 INFO:tasks.workunit.client.0.smithi043.stdout:5/923: mknod d3/d73/d83/c12a 0 2023-12-08T20:28:30.101 INFO:tasks.workunit.client.0.smithi043.stdout:5/924: write d3/d7/d21/d51/d5c/f67 [489915,82332] 0 2023-12-08T20:28:30.101 INFO:tasks.workunit.client.0.smithi043.stdout:5/925: fsync d3/d73/d83/f92 0 2023-12-08T20:28:30.103 INFO:tasks.workunit.client.0.smithi043.stdout:3/941: dread d1/d9/d38/d4f/d5a/fff [0,4194304] 0 2023-12-08T20:28:30.103 INFO:tasks.workunit.client.0.smithi043.stdout:5/926: mkdir d3/d7/de/d43/d68/db1/d12b 0 2023-12-08T20:28:30.104 INFO:tasks.workunit.client.0.smithi043.stdout:3/942: creat d1/d25/d2a/f126 x:0 0 0 2023-12-08T20:28:30.105 INFO:tasks.workunit.client.0.smithi043.stdout:5/927: creat d3/d73/f12c x:0 0 0 2023-12-08T20:28:30.105 INFO:tasks.workunit.client.0.smithi043.stdout:5/928: readlink d3/d7/d21/l6b 0 2023-12-08T20:28:30.105 INFO:tasks.workunit.client.0.smithi043.stdout:5/929: dread - d3/d7/d19/fc3 zero size 2023-12-08T20:28:30.106 INFO:tasks.workunit.client.0.smithi043.stdout:5/930: mkdir d3/d7/d21/d51/d5c/da7/dcf/d12d 0 2023-12-08T20:28:30.106 INFO:tasks.workunit.client.0.smithi043.stdout:5/931: dread - d3/d7/d21/fd2 zero size 2023-12-08T20:28:30.108 INFO:tasks.workunit.client.0.smithi043.stdout:5/932: truncate d3/d7/de/f1e 345180 0 2023-12-08T20:28:30.108 INFO:tasks.workunit.client.0.smithi043.stdout:5/933: fsync d3/d32/f75 0 2023-12-08T20:28:30.108 INFO:tasks.workunit.client.0.smithi043.stdout:5/934: truncate d3/d7/de/d43/d68/db1/f11d 567068 0 2023-12-08T20:28:30.110 INFO:tasks.workunit.client.0.smithi043.stdout:5/935: creat d3/d7/d21/d51/d7d/ddf/df2/f12e x:0 0 0 2023-12-08T20:28:30.110 INFO:tasks.workunit.client.0.smithi043.stdout:5/936: mknod d3/d73/d83/c12f 0 2023-12-08T20:28:30.112 INFO:tasks.workunit.client.0.smithi043.stdout:7/908: dwrite d0/d5b/fa6 [0,4194304] 0 2023-12-08T20:28:30.113 INFO:tasks.workunit.client.0.smithi043.stdout:4/997: dwrite d1/d14/d25/d39/d3d/d40/d67/f68 [0,4194304] 0 2023-12-08T20:28:30.116 INFO:tasks.workunit.client.0.smithi043.stdout:7/909: creat d0/d2/d65/d99/d47/dd6/dd8/d102/f127 x:0 0 0 2023-12-08T20:28:30.116 INFO:tasks.workunit.client.0.smithi043.stdout:7/910: chown d0/d6/dc7/l125 11783 1 2023-12-08T20:28:30.116 INFO:tasks.workunit.client.0.smithi043.stdout:7/911: truncate d0/d2/d65/d99/d47/dda/d10e/f11d 45925 0 2023-12-08T20:28:30.119 INFO:tasks.workunit.client.0.smithi043.stdout:3/943: truncate d1/d25/d2a/dd0/f96 275866 0 2023-12-08T20:28:30.119 INFO:tasks.workunit.client.0.smithi043.stdout:4/998: mkdir d1/d14/d25/d77/d8d/d15d 0 2023-12-08T20:28:30.123 INFO:tasks.workunit.client.0.smithi043.stdout:4/999: rename d1/d14/d25/d77/d8d/l12d to d1/d14/d50/d146/l15e 0 2023-12-08T20:28:30.132 INFO:tasks.workunit.client.0.smithi043.stdout:7/912: dwrite d0/d2/d12/d19/d38/fb3 [0,4194304] 0 2023-12-08T20:28:30.140 INFO:tasks.workunit.client.0.smithi043.stdout:3/944: dwrite d1/d25/d2a/d85/da6/dad/f109 [0,4194304] 0 2023-12-08T20:28:30.143 INFO:tasks.workunit.client.0.smithi043.stdout:3/945: creat d1/d9/df/d26/f127 x:0 0 0 2023-12-08T20:28:30.144 INFO:tasks.workunit.client.0.smithi043.stdout:3/946: chown d1/d9/d38/d4f/d5a 3457 1 2023-12-08T20:28:30.158 INFO:tasks.workunit.client.0.smithi043.stdout:3/947: dread d1/d9/d2d/d42/fe5 [0,4194304] 0 2023-12-08T20:28:30.159 INFO:tasks.workunit.client.0.smithi043.stdout:7/913: dwrite d0/d6/d17/d54/f80 [0,4194304] 0 2023-12-08T20:28:30.167 INFO:tasks.workunit.client.0.smithi043.stdout:7/914: write d0/d2/d65/d99/fa3 [3699570,115870] 0 2023-12-08T20:28:30.171 INFO:tasks.workunit.client.0.smithi043.stdout:7/915: creat d0/d2/d12/d19/d38/d9c/f128 x:0 0 0 2023-12-08T20:28:30.180 INFO:tasks.workunit.client.0.smithi043.stdout:3/948: dwrite d1/d9/df/f62 [0,4194304] 0 2023-12-08T20:28:30.183 INFO:tasks.workunit.client.0.smithi043.stdout:3/949: mknod d1/d9/df/d6e/d7d/c128 0 2023-12-08T20:28:30.183 INFO:tasks.workunit.client.0.smithi043.stdout:3/950: chown d1/d1c/d29/fa5 1350 1 2023-12-08T20:28:30.185 INFO:tasks.workunit.client.0.smithi043.stdout:3/951: creat d1/d25/d2a/dd0/f129 x:0 0 0 2023-12-08T20:28:30.187 INFO:tasks.workunit.client.0.smithi043.stdout:3/952: symlink d1/d9/d38/d4a/l12a 0 2023-12-08T20:28:30.191 INFO:tasks.workunit.client.0.smithi043.stdout:7/916: dwrite d0/d6/d17/dab/fb4 [4194304,4194304] 0 2023-12-08T20:28:30.191 INFO:tasks.workunit.client.0.smithi043.stdout:3/953: rename d1/d25/d2a/d85/f92 to d1/d9/d38/d4f/f12b 0 2023-12-08T20:28:30.193 INFO:tasks.workunit.client.0.smithi043.stdout:3/954: write d1/d9/df/ddb/f100 [2350895,122300] 0 2023-12-08T20:28:30.208 INFO:tasks.workunit.client.0.smithi043.stdout:7/917: dwrite d0/d5b/f11a [0,4194304] 0 2023-12-08T20:28:30.208 INFO:tasks.workunit.client.0.smithi043.stdout:7/918: write d0/d2/d65/f71 [981635,74799] 0 2023-12-08T20:28:30.208 INFO:tasks.workunit.client.0.smithi043.stdout:7/919: fdatasync d0/d2/d65/fb5 0 2023-12-08T20:28:30.214 INFO:tasks.workunit.client.0.smithi043.stdout:7/920: dread d0/d2/f7c [0,4194304] 0 2023-12-08T20:28:30.227 INFO:tasks.workunit.client.0.smithi043.stdout:7/921: dread d0/d6/d17/fe0 [0,4194304] 0 2023-12-08T20:28:30.229 INFO:tasks.workunit.client.0.smithi043.stdout:7/922: rmdir d0/d6/dc7/d106 0 2023-12-08T20:28:30.232 INFO:tasks.workunit.client.0.smithi043.stdout:7/923: mknod d0/d6/d17/d54/c129 0 2023-12-08T20:28:30.258 INFO:tasks.workunit.client.0.smithi043.stdout:7/924: dwrite d0/d2/d65/d99/d47/ff2 [0,4194304] 0 2023-12-08T20:28:30.262 INFO:tasks.workunit.client.0.smithi043.stdout:7/925: rename d0/d69/d6d/ffa to d0/d2/d65/d99/d47/dda/d10e/f12a 0 2023-12-08T20:28:30.270 INFO:tasks.workunit.client.0.smithi043.stdout:1/932: sync 2023-12-08T20:28:30.274 INFO:tasks.workunit.client.0.smithi043.stdout:1/933: getdents d1/d16/d30/d6e/d83 0 2023-12-08T20:28:30.274 INFO:tasks.workunit.client.0.smithi043.stdout:1/934: write d1/d16/d48/f65 [1075147,70814] 0 2023-12-08T20:28:30.281 INFO:tasks.workunit.client.0.smithi043.stdout:7/926: dwrite d0/d6/d17/d54/fc3 [0,4194304] 0 2023-12-08T20:28:30.281 INFO:tasks.workunit.client.0.smithi043.stdout:1/935: rmdir d1/d16/d7e/d10a 39 2023-12-08T20:28:30.288 INFO:tasks.workunit.client.0.smithi043.stdout:1/936: creat d1/d16/d21/d25/d3e/d77/d9f/dc3/d110/dad/d102/f155 x:0 0 0 2023-12-08T20:28:30.292 INFO:tasks.workunit.client.0.smithi043.stdout:1/937: rename d1/d16/d21/d25/d35/ff5 to d1/db1/dc9/f156 0 2023-12-08T20:28:30.294 INFO:tasks.workunit.client.0.smithi043.stdout:1/938: stat d1/d16/d1c/l41 0 2023-12-08T20:28:30.294 INFO:tasks.workunit.client.0.smithi043.stdout:1/939: stat d1/d16/d86 0 2023-12-08T20:28:30.296 INFO:tasks.workunit.client.0.smithi043.stdout:1/940: creat d1/d16/d21/d25/d3e/d77/d9f/f157 x:0 0 0 2023-12-08T20:28:30.298 INFO:tasks.workunit.client.0.smithi043.stdout:7/927: dwrite d0/f42 [0,4194304] 0 2023-12-08T20:28:30.300 INFO:tasks.workunit.client.0.smithi043.stdout:7/928: creat d0/d5b/f12b x:0 0 0 2023-12-08T20:28:30.302 INFO:tasks.workunit.client.0.smithi043.stdout:7/929: symlink d0/d69/d6d/l12c 0 2023-12-08T20:28:30.303 INFO:tasks.workunit.client.0.smithi043.stdout:7/930: write d0/d5b/f11a [1918988,86954] 0 2023-12-08T20:28:30.304 INFO:tasks.workunit.client.0.smithi043.stdout:7/931: stat d0/d69/d6d/l12c 0 2023-12-08T20:28:30.304 INFO:tasks.workunit.client.0.smithi043.stdout:7/932: readlink d0/d2/d65/d99/lc0 0 2023-12-08T20:28:30.314 INFO:tasks.workunit.client.0.smithi043.stdout:1/941: dwrite d1/d16/d1c/d71/dc5/f100 [0,4194304] 0 2023-12-08T20:28:30.324 INFO:tasks.workunit.client.0.smithi043.stdout:1/942: symlink d1/d16/d21/d25/d3e/d77/l158 0 2023-12-08T20:28:30.324 INFO:tasks.workunit.client.0.smithi043.stdout:1/943: write d1/d16/d30/d4f/d54/f78 [948469,6349] 0 2023-12-08T20:28:30.326 INFO:tasks.workunit.client.0.smithi043.stdout:7/933: dwrite d0/d6/f7b [0,4194304] 0 2023-12-08T20:28:30.326 INFO:tasks.workunit.client.0.smithi043.stdout:7/934: write d0/d2/d12/d19/d38/f55 [4624042,13539] 0 2023-12-08T20:28:30.326 INFO:tasks.workunit.client.0.smithi043.stdout:1/944: link d1/d16/d1c/d4e/d12d/c147 d1/d16/d21/d25/d3e/d72/c159 0 2023-12-08T20:28:30.328 INFO:tasks.workunit.client.0.smithi043.stdout:7/935: rename d0/d6/d17/d120 to d0/d2/d65/d83/d12d 0 2023-12-08T20:28:30.328 INFO:tasks.workunit.client.0.smithi043.stdout:1/945: creat d1/f15a x:0 0 0 2023-12-08T20:28:30.328 INFO:tasks.workunit.client.0.smithi043.stdout:7/936: write d0/d2/db0/f115 [372277,105450] 0 2023-12-08T20:28:30.330 INFO:tasks.workunit.client.0.smithi043.stdout:7/937: rename d0/d6/d17/dab/fd2 to d0/d6/f12e 0 2023-12-08T20:28:30.331 INFO:tasks.workunit.client.0.smithi043.stdout:1/946: dread d1/d16/f49 [0,4194304] 0 2023-12-08T20:28:30.331 INFO:tasks.workunit.client.0.smithi043.stdout:1/947: truncate d1/d16/d21/f51 4493179 0 2023-12-08T20:28:30.331 INFO:tasks.workunit.client.0.smithi043.stdout:7/938: truncate d0/f3d 3964654 0 2023-12-08T20:28:30.331 INFO:tasks.workunit.client.0.smithi043.stdout:7/939: write d0/d69/fb8 [2612704,31882] 0 2023-12-08T20:28:30.332 INFO:tasks.workunit.client.0.smithi043.stdout:7/940: symlink d0/d6/d17/l12f 0 2023-12-08T20:28:30.335 INFO:tasks.workunit.client.0.smithi043.stdout:1/948: rename d1/db1/dc9/cfc to d1/d16/d1c/d4e/d12d/c15b 0 2023-12-08T20:28:30.337 INFO:tasks.workunit.client.0.smithi043.stdout:1/949: symlink d1/d16/d7e/d10a/l15c 0 2023-12-08T20:28:30.341 INFO:tasks.workunit.client.0.smithi043.stdout:1/950: rename d1/d16/d21/d25/d3e/d77/d9f/dc3/d110/dad to d1/d16/d1c/d71/dc5/d15d 0 2023-12-08T20:28:30.345 INFO:tasks.workunit.client.0.smithi043.stdout:1/951: creat d1/d16/d30/d6e/f15e x:0 0 0 2023-12-08T20:28:30.346 INFO:tasks.workunit.client.0.smithi043.stdout:1/952: stat d1/d16/d1c/d71/dc5/le3 0 2023-12-08T20:28:30.444 INFO:tasks.workunit.client.0.smithi043.stdout:9/857: sync 2023-12-08T20:28:30.474 INFO:tasks.workunit.client.0.smithi043.stdout:9/858: dwrite d0/d3d/f48 [0,4194304] 0 2023-12-08T20:28:30.476 INFO:tasks.workunit.client.0.smithi043.stdout:9/859: dread d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d76/d53/ff1 [0,4194304] 0 2023-12-08T20:28:30.479 INFO:tasks.workunit.client.0.smithi043.stdout:9/860: rename d0/c19 to d0/d3d/d8a/de3/d102/c11a 0 2023-12-08T20:28:30.479 INFO:tasks.workunit.client.0.smithi043.stdout:9/861: symlink d0/l11b 0 2023-12-08T20:28:30.480 INFO:tasks.workunit.client.0.smithi043.stdout:9/862: creat d0/d3d/d4b/f11c x:0 0 0 2023-12-08T20:28:30.480 INFO:tasks.workunit.client.0.smithi043.stdout:9/863: stat d0/d3d/d8c/fc6 0 2023-12-08T20:28:30.480 INFO:tasks.workunit.client.0.smithi043.stdout:9/864: chown d0/d3d/d4b/d61 0 1 2023-12-08T20:28:30.481 INFO:tasks.workunit.client.0.smithi043.stdout:9/865: mkdir d0/d5e/d11d 0 2023-12-08T20:28:30.483 INFO:tasks.workunit.client.0.smithi043.stdout:9/866: getdents d0/d3d/d4b/da2/dbc 0 2023-12-08T20:28:30.483 INFO:tasks.workunit.client.0.smithi043.stdout:9/867: chown d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d76/d53 46220 1 2023-12-08T20:28:30.483 INFO:tasks.workunit.client.0.smithi043.stdout:9/868: fdatasync d0/fa5 0 2023-12-08T20:28:30.500 INFO:tasks.workunit.client.0.smithi043.stdout:9/869: dwrite d0/d21/d80/d8e/fba [0,4194304] 0 2023-12-08T20:28:30.500 INFO:tasks.workunit.client.0.smithi043.stdout:9/870: stat d0/d3d/d4b/d5c/l8d 0 2023-12-08T20:28:30.505 INFO:tasks.workunit.client.0.smithi043.stdout:9/871: creat d0/d3d/dd4/f11e x:0 0 0 2023-12-08T20:28:30.506 INFO:tasks.workunit.client.0.smithi043.stdout:9/872: mkdir d0/d21/d80/d8e/df6/d11f 0 2023-12-08T20:28:30.506 INFO:tasks.workunit.client.0.smithi043.stdout:9/873: write d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d94/fff [5140886,73925] 0 2023-12-08T20:28:30.507 INFO:tasks.workunit.client.0.smithi043.stdout:9/874: write d0/d5e/f40 [2509058,56771] 0 2023-12-08T20:28:30.511 INFO:tasks.workunit.client.0.smithi043.stdout:9/875: getdents d0/d3d/dd4 0 2023-12-08T20:28:30.511 INFO:tasks.workunit.client.0.smithi043.stdout:9/876: dread - d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d110/ff9 zero size 2023-12-08T20:28:30.512 INFO:tasks.workunit.client.0.smithi043.stdout:9/877: getdents d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d6c 0 2023-12-08T20:28:30.513 INFO:tasks.workunit.client.0.smithi043.stdout:9/878: read d0/f1b [254128,40655] 0 2023-12-08T20:28:30.513 INFO:tasks.workunit.client.0.smithi043.stdout:9/879: chown d0/d3d/d4b/da2/dbc/d109/ddd/d6b/c9f 2 1 2023-12-08T20:28:30.514 INFO:tasks.workunit.client.0.smithi043.stdout:9/880: mkdir d0/d21/d80/d120 0 2023-12-08T20:28:30.514 INFO:tasks.workunit.client.0.smithi043.stdout:9/881: readlink d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d6c/l10f 0 2023-12-08T20:28:30.514 INFO:tasks.workunit.client.0.smithi043.stdout:9/882: write d0/d3d/d8a/de3/f108 [77408,99943] 0 2023-12-08T20:28:30.514 INFO:tasks.workunit.client.0.smithi043.stdout:9/883: fsync d0/d3d/d4b/da2/dbc/d109/ffd 0 2023-12-08T20:28:30.514 INFO:tasks.workunit.client.0.smithi043.stdout:9/884: truncate d0/d5e/f59 4278066 0 2023-12-08T20:28:30.530 INFO:tasks.workunit.client.0.smithi043.stdout:9/885: dwrite d0/d5e/d73/f107 [0,4194304] 0 2023-12-08T20:28:30.533 INFO:tasks.workunit.client.0.smithi043.stdout:9/886: link d0/d3d/d4b/d5c/cc9 d0/d21/c121 0 2023-12-08T20:28:30.533 INFO:tasks.workunit.client.0.smithi043.stdout:9/887: stat d0/d3d/d4b/f91 0 2023-12-08T20:28:30.545 INFO:tasks.workunit.client.0.smithi043.stdout:9/888: dwrite d0/d21/f87 [0,4194304] 0 2023-12-08T20:28:30.547 INFO:tasks.workunit.client.0.smithi043.stdout:9/889: truncate d0/d3d/d4b/f91 1082062 0 2023-12-08T20:28:30.550 INFO:tasks.workunit.client.0.smithi043.stdout:9/890: rmdir d0/d21/d80/d8e/df6/d11f 0 2023-12-08T20:28:30.551 INFO:tasks.workunit.client.0.smithi043.stdout:9/891: rmdir d0/d3d/d4b/d5c 39 2023-12-08T20:28:30.551 INFO:tasks.workunit.client.0.smithi043.stdout:9/892: chown d0/d3d/d4b/d5c/lab 165623307 1 2023-12-08T20:28:30.552 INFO:tasks.workunit.client.0.smithi043.stdout:9/893: getdents d0/d21 0 2023-12-08T20:28:30.561 INFO:tasks.workunit.client.0.smithi043.stdout:9/894: getdents d0/d3d/d8a/de3 0 2023-12-08T20:28:30.561 INFO:tasks.workunit.client.0.smithi043.stdout:9/895: chown d0/d3d/d4b/d65/ce7 154834253 1 2023-12-08T20:28:30.568 INFO:tasks.workunit.client.0.smithi043.stdout:9/896: getdents d0/d5e 0 2023-12-08T20:28:30.580 INFO:tasks.workunit.client.0.smithi043.stdout:9/897: rename d0/d21/l24 to d0/d3d/d4b/d65/l122 0 2023-12-08T20:28:30.610 INFO:tasks.workunit.client.0.smithi043.stdout:9/898: dwrite d0/d5e/f40 [0,4194304] 0 2023-12-08T20:28:30.611 INFO:tasks.workunit.client.0.smithi043.stdout:9/899: mknod d0/d21/d80/d8e/c123 0 2023-12-08T20:28:30.611 INFO:tasks.workunit.client.0.smithi043.stdout:9/900: getdents d0/d21/d80/d8e/df6 0 2023-12-08T20:28:30.613 INFO:tasks.workunit.client.0.smithi043.stdout:9/901: mkdir d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d76/dd3/d124 0 2023-12-08T20:28:30.614 INFO:tasks.workunit.client.0.smithi043.stdout:9/902: symlink d0/d5e/d73/deb/l125 0 2023-12-08T20:28:30.615 INFO:tasks.workunit.client.0.smithi043.stdout:9/903: mknod d0/d3d/d4b/da2/dbc/d109/ddd/c126 0 2023-12-08T20:28:30.617 INFO:tasks.workunit.client.0.smithi043.stdout:9/904: creat d0/f127 x:0 0 0 2023-12-08T20:28:30.626 INFO:tasks.workunit.client.0.smithi043.stdout:9/905: dread d0/d3d/d4b/da2/dbc/d109/ddd/d6b/f119 [0,4194304] 0 2023-12-08T20:28:30.626 INFO:tasks.workunit.client.0.smithi043.stdout:9/906: chown d0/d21/f9e 13853 1 2023-12-08T20:28:30.628 INFO:tasks.workunit.client.0.smithi043.stdout:3/955: sync 2023-12-08T20:28:30.628 INFO:tasks.workunit.client.0.smithi043.stdout:6/807: sync 2023-12-08T20:28:30.630 INFO:tasks.workunit.client.0.smithi043.stdout:9/907: read d0/d3d/d4b/d5c/fc7 [1077236,91406] 0 2023-12-08T20:28:30.630 INFO:tasks.workunit.client.0.smithi043.stdout:5/937: sync 2023-12-08T20:28:30.632 INFO:tasks.workunit.client.0.smithi043.stdout:5/938: dread d3/d7/d19/f6d [0,4194304] 0 2023-12-08T20:28:30.632 INFO:tasks.workunit.client.0.smithi043.stdout:5/939: write d3/d7/fe4 [651783,47162] 0 2023-12-08T20:28:30.632 INFO:tasks.workunit.client.0.smithi043.stdout:5/940: write d3/d7/fe4 [1110397,65281] 0 2023-12-08T20:28:30.633 INFO:tasks.workunit.client.0.smithi043.stdout:9/908: mknod d0/d3d/d4b/d5c/c128 0 2023-12-08T20:28:30.633 INFO:tasks.workunit.client.0.smithi043.stdout:6/808: dread d0/d2/f28 [0,4194304] 0 2023-12-08T20:28:30.635 INFO:tasks.workunit.client.0.smithi043.stdout:6/809: mkdir d0/ddc/d10d 0 2023-12-08T20:28:30.638 INFO:tasks.workunit.client.0.smithi043.stdout:5/941: link d3/d7/d21/d72/f109 d3/d73/d83/dd6/f130 0 2023-12-08T20:28:30.638 INFO:tasks.workunit.client.0.smithi043.stdout:7/941: sync 2023-12-08T20:28:30.638 INFO:tasks.workunit.client.0.smithi043.stdout:7/942: fsync d0/d2/f5 0 2023-12-08T20:28:30.639 INFO:tasks.workunit.client.0.smithi043.stdout:6/810: creat d0/d2/d14/db3/df1/d22/f10e x:0 0 0 2023-12-08T20:28:30.640 INFO:tasks.workunit.client.0.smithi043.stdout:5/942: symlink d3/d73/d83/dd6/l131 0 2023-12-08T20:28:30.641 INFO:tasks.workunit.client.0.smithi043.stdout:5/943: read d3/d7/d21/d51/fac [2629124,62487] 0 2023-12-08T20:28:30.644 INFO:tasks.workunit.client.0.smithi043.stdout:5/944: creat d3/d78/dc4/f132 x:0 0 0 2023-12-08T20:28:30.645 INFO:tasks.workunit.client.0.smithi043.stdout:5/945: dread d3/d73/f7e [0,4194304] 0 2023-12-08T20:28:30.647 INFO:tasks.workunit.client.0.smithi043.stdout:5/946: symlink d3/d7/de/d43/d68/db1/l133 0 2023-12-08T20:28:30.647 INFO:tasks.workunit.client.0.smithi043.stdout:5/947: fsync d3/d78/fdc 0 2023-12-08T20:28:30.653 INFO:tasks.workunit.client.0.smithi043.stdout:5/948: creat d3/d7/de/d43/d68/db1/d12b/f134 x:0 0 0 2023-12-08T20:28:30.653 INFO:tasks.workunit.client.0.smithi043.stdout:5/949: mkdir d3/d7/d21/d135 0 2023-12-08T20:28:30.654 INFO:tasks.workunit.client.0.smithi043.stdout:5/950: rename d3/d7/d21/d51/d7d/f125 to d3/d7/d21/d72/ded/f136 0 2023-12-08T20:28:30.656 INFO:tasks.workunit.client.0.smithi043.stdout:5/951: creat d3/d7/d21/d51/d5c/d81/f137 x:0 0 0 2023-12-08T20:28:30.657 INFO:tasks.workunit.client.0.smithi043.stdout:5/952: mknod d3/d7/d21/d72/c138 0 2023-12-08T20:28:30.676 INFO:tasks.workunit.client.0.smithi043.stdout:3/956: dwrite d1/d25/d2a/dd0/dbe/f11a [0,4194304] 0 2023-12-08T20:28:30.677 INFO:tasks.workunit.client.0.smithi043.stdout:3/957: write d1/d25/f36 [2295708,43612] 0 2023-12-08T20:28:30.677 INFO:tasks.workunit.client.0.smithi043.stdout:6/811: dwrite d0/d2/d14/db3/df1/d66/f9d [0,4194304] 0 2023-12-08T20:28:30.678 INFO:tasks.workunit.client.0.smithi043.stdout:3/958: creat d1/d9/d2d/d91/f12c x:0 0 0 2023-12-08T20:28:30.678 INFO:tasks.workunit.client.0.smithi043.stdout:3/959: fdatasync d1/d25/d2a/d45/f114 0 2023-12-08T20:28:30.681 INFO:tasks.workunit.client.0.smithi043.stdout:7/943: dwrite d0/d69/d6d/fc8 [0,4194304] 0 2023-12-08T20:28:30.681 INFO:tasks.workunit.client.0.smithi043.stdout:5/953: dwrite d3/d7/d29/f10c [0,4194304] 0 2023-12-08T20:28:30.683 INFO:tasks.workunit.client.0.smithi043.stdout:9/909: dwrite d0/d3d/d8a/fd9 [0,4194304] 0 2023-12-08T20:28:30.686 INFO:tasks.workunit.client.0.smithi043.stdout:5/954: link d3/d7/d29/f5d d3/d78/f139 0 2023-12-08T20:28:30.695 INFO:tasks.workunit.client.0.smithi043.stdout:3/960: dread d1/d9/d38/d33/f69 [0,4194304] 0 2023-12-08T20:28:30.703 INFO:tasks.workunit.client.0.smithi043.stdout:3/961: creat d1/d9/d38/d4f/f12d x:0 0 0 2023-12-08T20:28:30.709 INFO:tasks.workunit.client.0.smithi043.stdout:6/812: dwrite d0/d2/f36 [0,4194304] 0 2023-12-08T20:28:30.715 INFO:tasks.workunit.client.0.smithi043.stdout:7/944: dwrite d0/d2/d65/d99/f15 [0,4194304] 0 2023-12-08T20:28:30.715 INFO:tasks.workunit.client.0.smithi043.stdout:5/955: dwrite d3/d73/f100 [4194304,4194304] 0 2023-12-08T20:28:30.715 INFO:tasks.workunit.client.0.smithi043.stdout:7/945: chown d0/d2/d12/d19/cee 6751450 1 2023-12-08T20:28:30.715 INFO:tasks.workunit.client.0.smithi043.stdout:7/946: fsync d0/f3d 0 2023-12-08T20:28:30.718 INFO:tasks.workunit.client.0.smithi043.stdout:9/910: dwrite d0/d21/f74 [0,4194304] 0 2023-12-08T20:28:30.718 INFO:tasks.workunit.client.0.smithi043.stdout:7/947: write d0/d2/d65/f71 [652375,127105] 0 2023-12-08T20:28:30.719 INFO:tasks.workunit.client.0.smithi043.stdout:5/956: mkdir d3/d7/d21/d51/d5c/da7/dcf/d13a 0 2023-12-08T20:28:30.757 INFO:tasks.workunit.client.0.smithi043.stdout:5/957: write d3/d7/d21/d72/fd1 [3408053,29049] 0 2023-12-08T20:28:30.757 INFO:tasks.workunit.client.0.smithi043.stdout:3/962: dwrite d1/d9/f1a [0,4194304] 0 2023-12-08T20:28:30.770 INFO:tasks.workunit.client.0.smithi043.stdout:6/813: dwrite d0/d2/d14/d8/fda [0,4194304] 0 2023-12-08T20:28:30.770 INFO:tasks.workunit.client.0.smithi043.stdout:9/911: dwrite d0/d3d/dd4/fde [0,4194304] 0 2023-12-08T20:28:30.771 INFO:tasks.workunit.client.0.smithi043.stdout:6/814: write d0/d2/d14/d8/d47/d60/f8d [3051897,16875] 0 2023-12-08T20:28:30.771 INFO:tasks.workunit.client.0.smithi043.stdout:6/815: truncate d0/d2/d14/db3/df1/d22/f8c 60457 0 2023-12-08T20:28:30.774 INFO:tasks.workunit.client.0.smithi043.stdout:3/963: dwrite d1/d1c/d2c/fd3 [0,4194304] 0 2023-12-08T20:28:30.775 INFO:tasks.workunit.client.0.smithi043.stdout:6/816: write d0/d2/f1f [3607565,11047] 0 2023-12-08T20:28:30.776 INFO:tasks.workunit.client.0.smithi043.stdout:3/964: write d1/d25/f24 [312251,52852] 0 2023-12-08T20:28:30.793 INFO:tasks.workunit.client.0.smithi043.stdout:6/817: dwrite d0/d2/d14/db3/df1/d22/fff [0,4194304] 0 2023-12-08T20:28:30.797 INFO:tasks.workunit.client.0.smithi043.stdout:5/958: mknod d3/d7/d29/c13b 0 2023-12-08T20:28:30.797 INFO:tasks.workunit.client.0.smithi043.stdout:6/818: mkdir d0/d2/d14/d20/d3c/d50/d10f 0 2023-12-08T20:28:30.798 INFO:tasks.workunit.client.0.smithi043.stdout:6/819: getdents d0/d2/d14/d20/d53 0 2023-12-08T20:28:30.803 INFO:tasks.workunit.client.0.smithi043.stdout:6/820: rename d0/l3d to d0/d2/d14/d20/d3c/d50/l110 0 2023-12-08T20:28:30.803 INFO:tasks.workunit.client.0.smithi043.stdout:6/821: chown d0/d2/d14/d20/d3c/d6c/f9e 54 1 2023-12-08T20:28:30.803 INFO:tasks.workunit.client.0.smithi043.stdout:6/822: write d0/d2/d14/d20/d3c/f9c [444224,91646] 0 2023-12-08T20:28:30.803 INFO:tasks.workunit.client.0.smithi043.stdout:9/912: creat d0/d3d/d4b/da2/dbc/f129 x:0 0 0 2023-12-08T20:28:30.803 INFO:tasks.workunit.client.0.smithi043.stdout:9/913: truncate d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d6c/fed 732041 0 2023-12-08T20:28:30.807 INFO:tasks.workunit.client.0.smithi043.stdout:3/965: creat d1/d25/f12e x:0 0 0 2023-12-08T20:28:30.808 INFO:tasks.workunit.client.0.smithi043.stdout:5/959: mknod d3/d32/c13c 0 2023-12-08T20:28:30.809 INFO:tasks.workunit.client.0.smithi043.stdout:9/914: mkdir d0/d21/d12a 0 2023-12-08T20:28:30.809 INFO:tasks.workunit.client.0.smithi043.stdout:1/953: sync 2023-12-08T20:28:30.809 INFO:tasks.workunit.client.0.smithi043.stdout:9/915: chown d0/d3d/d4b/da2/dbc/d109/ddd/d6b/d110 3710 1 2023-12-08T20:28:30.810 INFO:tasks.workunit.client.0.smithi043.stdout:5/960: dread d3/d7/d21/d51/fc9 [0,4194304] 0 2023-12-08T20:28:30.810 INFO:tasks.workunit.client.0.smithi043.stdout:5/961: readlink d3/d7/d21/d51/d5c/da7/l11a 0 2023-12-08T20:28:30.810 INFO:tasks.workunit.client.0.smithi043.stdout:3/966: creat d1/d9/d38/d4f/d8f/ddf/f12f x:0 0 0 2023-12-08T20:28:30.810 INFO:tasks.workunit.client.0.smithi043.stdout:3/967: readlink d1/d1c/d2c/d5f/dfb/l105 0 2023-12-08T20:28:30.813 INFO:tasks.workunit.client.0.smithi043.stdout:1/954: dread d1/d6/f107 [0,4194304] 0 2023-12-08T20:28:30.814 INFO:tasks.workunit.client.0.smithi043.stdout:1/955: truncate d1/d6/fe8 167000 0 2023-12-08T20:28:30.816 INFO:tasks.workunit.client.0.smithi043.stdout:3/968: mkdir d1/d9/d2d/d91/da7/df9/d130 0 2023-12-08T20:28:30.823 INFO:tasks.workunit.client.0.smithi043.stdout:3/969: dread d1/d1c/d29/fa5 [0,4194304] 0 2023-12-08T20:28:30.823 INFO:tasks.workunit.client.0.smithi043.stdout:3/970: read - d1/d9/d2d/d91/fc8 zero size 2023-12-08T20:28:30.823 INFO:tasks.workunit.client.0.smithi043.stdout:7/948: mkdir d0/d2/d12/d19/d38/d130 0 2023-12-08T20:28:30.825 INFO:tasks.workunit.client.0.smithi043.stdout:7/949: creat d0/d6/d17/d52/dac/f131 x:0 0 0 2023-12-08T20:28:30.826 INFO:tasks.workunit.client.0.smithi043.stdout:7/950: creat d0/d6/d17/d54/f132 x:0 0 0 2023-12-08T20:28:30.828 INFO:tasks.workunit.client.0.smithi043.stdout:6/823: dwrite d0/d2/de/d4a/d56/dc2/dee/f100 [0,4194304] 0 2023-12-08T20:28:30.828 INFO:tasks.workunit.client.0.smithi043.stdout:6/824: read - d0/d2/d14/d20/d49/fe8 zero size 2023-12-08T20:28:30.834 INFO:tasks.workunit.client.0.smithi043.stdout:7/951: symlink d0/d2/d65/d99/d47/dda/l133 0 2023-12-08T20:28:30.837 INFO:tasks.workunit.client.0.smithi043.stdout:7/952: dread d0/d2/d12/d19/f41 [0,4194304] 0 2023-12-08T20:28:30.838 INFO:tasks.workunit.client.0.smithi043.stdout:3/971: dwrite d1/d25/d2a/f126 [0,4194304] 0 2023-12-08T20:28:30.849 INFO:tasks.workunit.client.0.smithi043.stdout:9/916: rename d0/d3d/d4b/da2/dbc to d0/d5e/d12b 0 2023-12-08T20:28:30.852 INFO:tasks.workunit.client.0.smithi043.stdout:9/917: creat d0/d5e/d12b/d109/ddd/d6b/d76/dd3/f12c x:0 0 0 2023-12-08T20:28:30.852 INFO:tasks.workunit.client.0.smithi043.stdout:9/918: write d0/d3d/dd4/f11e [952969,92265] 0 2023-12-08T20:28:30.859 INFO:tasks.workunit.client.0.smithi043.stdout:3/972: dwrite d1/d9/df/d26/f124 [4194304,4194304] 0 2023-12-08T20:28:30.860 INFO:tasks.workunit.client.0.smithi043.stdout:9/919: dread d0/d3d/dd4/fde [0,4194304] 0 2023-12-08T20:28:30.860 INFO:tasks.workunit.client.0.smithi043.stdout:5/962: rename d3/d32/l10d to d3/d7/de/l13d 0 2023-12-08T20:28:30.860 INFO:tasks.workunit.client.0.smithi043.stdout:3/973: write d1/d25/d2a/f126 [2470161,59709] 0 2023-12-08T20:28:30.863 INFO:tasks.workunit.client.0.smithi043.stdout:7/953: rename d0/d2/d65/d99/d47/dd6/dd8/le8 to d0/d2/d65/d99/de7/l134 0 2023-12-08T20:28:30.864 INFO:tasks.workunit.client.0.smithi043.stdout:9/920: rename d0/d3d/d4b/d5c/fb7 to d0/d5e/d12b/f12d 0 2023-12-08T20:28:30.865 INFO:tasks.workunit.client.0.smithi043.stdout:7/954: creat d0/d2/d65/d99/d47/dd6/dd8/d102/f135 x:0 0 0 2023-12-08T20:28:30.866 INFO:tasks.workunit.client.0.smithi043.stdout:7/955: fsync d0/d2/d65/d99/d47/dda/d10e/f12a 0 2023-12-08T20:28:30.867 INFO:tasks.workunit.client.0.smithi043.stdout:7/956: write d0/d2/d12/da2/fd0 [926808,84766] 0 2023-12-08T20:28:30.869 INFO:tasks.workunit.client.0.smithi043.stdout:9/921: rmdir d0/d5e/d12b/d109/ddd/d6b/d76/dd3/d124 0 2023-12-08T20:28:30.878 INFO:tasks.workunit.client.0.smithi043.stdout:9/922: link d0/d5e/l36 d0/d5e/d12b/d109/ddd/d6b/d76/dd3/l12e 0 2023-12-08T20:28:30.881 INFO:tasks.workunit.client.0.smithi043.stdout:7/957: dread d0/d2/d12/f51 [0,4194304] 0 2023-12-08T20:28:30.881 INFO:tasks.workunit.client.0.smithi043.stdout:5/963: dwrite d3/d7/de/d82/d8b/fb5 [0,4194304] 0 2023-12-08T20:28:30.881 INFO:tasks.workunit.client.0.smithi043.stdout:7/958: getdents d0/d2/d65/d99 0 2023-12-08T20:28:30.882 INFO:tasks.workunit.client.0.smithi043.stdout:5/964: write d3/d7/d21/d51/fc9 [369707,73091] 0 2023-12-08T20:28:30.882 INFO:tasks.workunit.client.0.smithi043.stdout:5/965: chown d3/d7/d21/cf6 63292 1 2023-12-08T20:28:30.884 INFO:tasks.workunit.client.0.smithi043.stdout:6/825: creat d0/d2/d14/db3/df1/d22/d2a/db2/dba/de3/f111 x:0 0 0 2023-12-08T20:28:30.892 INFO:tasks.workunit.client.0.smithi043.stdout:3/974: dwrite d1/d25/d84/d9a/fd6 [0,4194304] 0 2023-12-08T20:28:30.892 INFO:tasks.workunit.client.0.smithi043.stdout:3/975: stat d1/d25/d2a/d85/da6/dad/f109 0 2023-12-08T20:28:30.895 INFO:tasks.workunit.client.0.smithi043.stdout:3/976: write d1/d9/d38/d4f/f79 [4628049,105566] 0 2023-12-08T20:28:30.897 INFO:tasks.workunit.client.0.smithi043.stdout:5/966: write d3/d7/d21/d51/d5c/d81/fc0 [38148,70057] 0 2023-12-08T20:28:30.897 INFO:tasks.workunit.client.0.smithi043.stdout:5/967: stat d3/d7/de/d6a/d124/d118/f5e 0 2023-12-08T20:28:30.897 INFO:tasks.workunit.client.0.smithi043.stdout:5/968: fdatasync d3/d78/fdc 0 2023-12-08T20:28:30.897 INFO:tasks.workunit.client.0.smithi043.stdout:5/969: write d3/d73/f12c [379308,4932] 0 2023-12-08T20:28:30.897 INFO:tasks.workunit.client.0.smithi043.stdout:5/970: chown d3/d7/de/d82/d8b 629 1 2023-12-08T20:28:30.898 INFO:tasks.workunit.client.0.smithi043.stdout:6/826: write d0/d2/d29/f83 [3450602,29317] 0 2023-12-08T20:28:30.899 INFO:tasks.workunit.client.0.smithi043.stdout:5/971: link d3/d7/d29/ff4 d3/d7/d21/f13e 0 2023-12-08T20:28:30.905 INFO:tasks.workunit.client.0.smithi043.stdout:5/972: read d3/d7/de/d82/d8b/fb5 [3256337,109913] 0 2023-12-08T20:28:30.906 INFO:tasks.workunit.client.0.smithi043.stdout:6/827: truncate d0/d2/d14/db3/df1/d22/d2a/db2/fcf 618116 0 2023-12-08T20:28:30.908 INFO:tasks.workunit.client.0.smithi043.stdout:9/923: dwrite d0/d5e/f59 [0,4194304] 0 2023-12-08T20:28:30.911 INFO:tasks.workunit.client.0.smithi043.stdout:3/977: dwrite d1/d9/fd [0,4194304] 0 2023-12-08T20:28:30.911 INFO:tasks.workunit.client.0.smithi043.stdout:7/959: dwrite d0/d2/d65/f71 [0,4194304] 0 2023-12-08T20:28:30.919 INFO:tasks.workunit.client.0.smithi043.stdout:3/978: rename d1/d25/f36 to d1/d25/dc1/f131 0 2023-12-08T20:28:30.928 INFO:tasks.workunit.client.0.smithi043.stdout:5/973: dwrite d3/d7/f1a [0,4194304] 0 2023-12-08T20:28:30.928 INFO:tasks.workunit.client.0.smithi043.stdout:5/974: fsync d3/d32/f47 0 2023-12-08T20:28:30.928 INFO:tasks.workunit.client.0.smithi043.stdout:9/924: dread d0/d5e/d73/deb/fa3 [0,4194304] 0 2023-12-08T20:28:30.929 INFO:tasks.workunit.client.0.smithi043.stdout:9/925: chown d0/f1e 2353 1 2023-12-08T20:28:30.933 INFO:tasks.workunit.client.0.smithi043.stdout:5/975: mkdir d3/d7/d90/d116/d13f 0 2023-12-08T20:28:30.939 INFO:tasks.workunit.client.0.smithi043.stdout:9/926: write d0/d5e/f57 [181,80898] 0 2023-12-08T20:28:30.943 INFO:tasks.workunit.client.0.smithi043.stdout:9/927: creat d0/d3d/d4b/d65/f12f x:0 0 0 2023-12-08T20:28:30.943 INFO:tasks.workunit.client.0.smithi043.stdout:9/928: truncate d0/d3d/d4b/d5c/f117 302468 0 2023-12-08T20:28:30.944 INFO:tasks.workunit.client.0.smithi043.stdout:6/828: dwrite d0/d2/d14/db3/df1/d22/fcd [0,4194304] 0 2023-12-08T20:28:30.945 INFO:tasks.workunit.client.0.smithi043.stdout:9/929: mkdir d0/d21/d80/d8e/df6/d130 0 2023-12-08T20:28:30.946 INFO:tasks.workunit.client.0.smithi043.stdout:9/930: symlink d0/d5e/d12b/d109/ddd/l131 0 2023-12-08T20:28:30.946 INFO:tasks.workunit.client.0.smithi043.stdout:6/829: write d0/d2/d14/d20/d3c/f9c [186469,107249] 0 2023-12-08T20:28:30.948 INFO:tasks.workunit.client.0.smithi043.stdout:9/931: rmdir d0/d21/d12a 0 2023-12-08T20:28:30.948 INFO:tasks.workunit.client.0.smithi043.stdout:3/979: dwrite d1/d9/d38/d4f/d5a/fff [0,4194304] 0 2023-12-08T20:28:30.948 INFO:tasks.workunit.client.0.smithi043.stdout:3/980: stat d1/d9/df/d41/fe3 0 2023-12-08T20:28:30.948 INFO:tasks.workunit.client.0.smithi043.stdout:3/981: truncate d1/d9/d38/fd7 245608 0 2023-12-08T20:28:30.948 INFO:tasks.workunit.client.0.smithi043.stdout:5/976: dread d3/d7/de/d6a/d124/d118/f66 [0,4194304] 0 2023-12-08T20:28:30.948 INFO:tasks.workunit.client.0.smithi043.stdout:7/960: dwrite d0/f1b [0,4194304] 0 2023-12-08T20:28:30.951 INFO:tasks.workunit.client.0.smithi043.stdout:9/932: rename d0/d3d/d4b/d5c/lab to d0/d3d/d8c/l132 0 2023-12-08T20:28:30.951 INFO:tasks.workunit.client.0.smithi043.stdout:3/982: mkdir d1/d9/d132 0 2023-12-08T20:28:30.952 INFO:tasks.workunit.client.0.smithi043.stdout:7/961: mkdir d0/d2/d65/d99/d47/d136 0 2023-12-08T20:28:30.952 INFO:tasks.workunit.client.0.smithi043.stdout:5/977: symlink d3/d7/d19/d3f/l140 0 2023-12-08T20:28:30.952 INFO:tasks.workunit.client.0.smithi043.stdout:5/978: chown d3/d7/de/d43/d68/db1/d12b/f134 82 1 2023-12-08T20:28:30.955 INFO:tasks.workunit.client.0.smithi043.stdout:9/933: mkdir d0/d5e/d12b/d109/ddd/d133 0 2023-12-08T20:28:30.956 INFO:tasks.workunit.client.0.smithi043.stdout:3/983: mkdir d1/d25/dc1/d133 0 2023-12-08T20:28:30.956 INFO:tasks.workunit.client.0.smithi043.stdout:3/984: write d1/d25/d2a/d45/f114 [54521,121046] 0 2023-12-08T20:28:30.956 INFO:tasks.workunit.client.0.smithi043.stdout:6/830: rmdir d0/d2/d29 39 2023-12-08T20:28:30.956 INFO:tasks.workunit.client.0.smithi043.stdout:6/831: write d0/d2/d14/db3/df1/d22/d2a/db2/dba/dec/ffa [818638,28578] 0 2023-12-08T20:28:30.959 INFO:tasks.workunit.client.0.smithi043.stdout:5/979: creat d3/d73/da4/f141 x:0 0 0 2023-12-08T20:28:30.959 INFO:tasks.workunit.client.0.smithi043.stdout:7/962: rename d0/d2/d12/d19/d38/c48 to d0/d6/d17/d52/dac/c137 0 2023-12-08T20:28:30.959 INFO:tasks.workunit.client.0.smithi043.stdout:5/980: dread - d3/d78/fdc zero size 2023-12-08T20:28:30.959 INFO:tasks.workunit.client.0.smithi043.stdout:3/985: mkdir d1/d1c/d8b/d134 0 2023-12-08T20:28:30.960 INFO:tasks.workunit.client.0.smithi043.stdout:7/963: mknod d0/d2/d65/d99/d47/dd6/dd8/d102/c138 0 2023-12-08T20:28:30.961 INFO:tasks.workunit.client.0.smithi043.stdout:6/832: mknod d0/d2/d14/db3/df1/d22/d2a/c112 0 2023-12-08T20:28:30.966 INFO:tasks.workunit.client.0.smithi043.stdout:6/833: symlink d0/d2/d14/d8/l113 0 2023-12-08T20:28:30.970 INFO:tasks.workunit.client.0.smithi043.stdout:5/981: read d3/d7/d19/f6d [145673,92645] 0 2023-12-08T20:28:30.973 INFO:tasks.workunit.client.0.smithi043.stdout:5/982: truncate f2 3772161 0 2023-12-08T20:28:30.976 INFO:tasks.workunit.client.0.smithi043.stdout:5/983: mknod d3/d7/de/d43/d68/c142 0 2023-12-08T20:28:30.978 INFO:tasks.workunit.client.0.smithi043.stdout:5/984: symlink d3/d7/de/d43/d68/l143 0 2023-12-08T20:28:30.983 INFO:tasks.workunit.client.0.smithi043.stdout:9/934: dwrite d0/d21/f56 [0,4194304] 0 2023-12-08T20:28:30.988 INFO:tasks.workunit.client.0.smithi043.stdout:6/834: rename d0/d2/d14/d20 to d0/d2/d14/d8/d47/d114 0 2023-12-08T20:28:30.988 INFO:tasks.workunit.client.0.smithi043.stdout:6/835: fdatasync d0/d2/f1f 0 2023-12-08T20:28:30.988 INFO:tasks.workunit.client.0.smithi043.stdout:6/836: dread - d0/d2/d14/db3/df1/d22/d2a/db2/fc1 zero size 2023-12-08T20:28:30.991 INFO:tasks.workunit.client.0.smithi043.stdout:6/837: rename d0/d2/de/d4a/lbd to d0/l115 0 2023-12-08T20:28:30.994 INFO:tasks.workunit.client.0.smithi043.stdout:6/838: link d0/d2/de/c74 d0/d2/d14/db3/df1/d22/d3f/d45/d69/c116 0 2023-12-08T20:28:31.004 INFO:tasks.workunit.client.0.smithi043.stdout:5/985: dwrite d3/d7/de/d6a/d124/d118/fce [0,4194304] 0 2023-12-08T20:28:31.004 INFO:tasks.workunit.client.0.smithi043.stdout:5/986: truncate d3/d7/d21/d51/d5c/d81/f137 334916 0 2023-12-08T20:28:31.004 INFO:tasks.workunit.client.0.smithi043.stdout:5/987: write d3/d7/d21/d72/ded/f136 [601055,93115] 0 2023-12-08T20:28:31.005 INFO:tasks.workunit.client.0.smithi043.stdout:9/935: mkdir d0/d3d/d8a/d134 0 2023-12-08T20:28:31.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:30 smithi043 ceph-mon[111966]: pgmap v36: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 86 MiB/s rd, 178 MiB/s wr, 371 op/s 2023-12-08T20:28:31.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:30 smithi043 ceph-mon[111966]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:28:31.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:30 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:31.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:30 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:31.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:30 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:28:31.016 INFO:tasks.workunit.client.0.smithi043.stdout:6/839: dwrite d0/d2/d14/db3/df1/d22/d3f/d45/f6d [0,4194304] 0 2023-12-08T20:28:31.025 INFO:tasks.workunit.client.0.smithi043.stdout:6/840: rmdir d0/d2/d14/d8/d47/d114/dc0 39 2023-12-08T20:28:31.026 INFO:tasks.workunit.client.0.smithi043.stdout:9/936: rename d0/d3d/c7a to d0/d5e/c135 0 2023-12-08T20:28:31.029 INFO:tasks.workunit.client.0.smithi043.stdout:5/988: dwrite d3/d73/d83/d99/fd9 [0,4194304] 0 2023-12-08T20:28:31.030 INFO:tasks.workunit.client.0.smithi043.stdout:6/841: rename d0/d2/d14/db3/df1/d22/l4b to d0/d2/d29/l117 0 2023-12-08T20:28:31.031 INFO:tasks.workunit.client.0.smithi043.stdout:6/842: dread d0/d2/de/d4a/f58 [0,4194304] 0 2023-12-08T20:28:31.038 INFO:tasks.workunit.client.0.smithi043.stdout:9/937: mknod d0/d21/d80/d120/c136 0 2023-12-08T20:28:31.040 INFO:tasks.workunit.client.0.smithi043.stdout:6/843: truncate d0/d2/d92/fdf 2024404 0 2023-12-08T20:28:31.045 INFO:tasks.workunit.client.0.smithi043.stdout:9/938: creat d0/d21/d80/d8e/df6/d130/f137 x:0 0 0 2023-12-08T20:28:31.045 INFO:tasks.workunit.client.0.smithi043.stdout:5/989: write d3/f101 [579091,64177] 0 2023-12-08T20:28:31.047 INFO:tasks.workunit.client.0.smithi043.stdout:9/939: mkdir d0/d5e/d12b/d109/ddd/d6b/d76/d138 0 2023-12-08T20:28:31.047 INFO:tasks.workunit.client.0.smithi043.stdout:6/844: dread d0/d2/fa6 [0,4194304] 0 2023-12-08T20:28:31.051 INFO:tasks.workunit.client.0.smithi043.stdout:6/845: rename d0/f34 to d0/d2/d14/d8/f118 0 2023-12-08T20:28:31.054 INFO:tasks.workunit.client.0.smithi043.stdout:6/846: creat d0/d2/d14/db3/df1/d22/d3f/d45/f119 x:0 0 0 2023-12-08T20:28:31.055 INFO:tasks.workunit.client.0.smithi043.stdout:6/847: mknod d0/d2/d14/db3/df1/d22/d3f/d45/d69/c11a 0 2023-12-08T20:28:31.060 INFO:tasks.workunit.client.0.smithi043.stdout:5/990: dread d3/d7/d21/d51/d5c/f74 [0,4194304] 0 2023-12-08T20:28:31.061 INFO:tasks.workunit.client.0.smithi043.stdout:9/940: dwrite d0/d3d/f5d [0,4194304] 0 2023-12-08T20:28:31.062 INFO:tasks.workunit.client.0.smithi043.stdout:5/991: rmdir d3/d7/de/d43/d68/db1/d12b 39 2023-12-08T20:28:31.063 INFO:tasks.workunit.client.0.smithi043.stdout:9/941: write d0/d21/f87 [3861660,44130] 0 2023-12-08T20:28:31.066 INFO:tasks.workunit.client.0.smithi043.stdout:5/992: rename d3/d7/de/d43/d68/db1 to d3/d7/de/d6a/d124/d118/d144 0 2023-12-08T20:28:31.066 INFO:tasks.workunit.client.0.smithi043.stdout:5/993: write d3/d7/d21/ff7 [525195,23892] 0 2023-12-08T20:28:31.068 INFO:tasks.workunit.client.0.smithi043.stdout:5/994: creat d3/d78/f145 x:0 0 0 2023-12-08T20:28:31.068 INFO:tasks.workunit.client.0.smithi043.stdout:5/995: chown d3/d7/de/d82/d95/fe2 192 1 2023-12-08T20:28:31.068 INFO:tasks.workunit.client.0.smithi043.stdout:5/996: dread - d3/d7/d19/fc3 zero size 2023-12-08T20:28:31.070 INFO:tasks.workunit.client.0.smithi043.stdout:5/997: rmdir d3/d7/de/d82/d95 39 2023-12-08T20:28:31.070 INFO:tasks.workunit.client.0.smithi043.stdout:5/998: dread - d3/d7/de/d6a/d124/d118/d144/d12b/f134 zero size 2023-12-08T20:28:31.070 INFO:tasks.workunit.client.0.smithi043.stdout:5/999: truncate d3/d7/de/f7b 2708215 0 2023-12-08T20:28:31.079 INFO:tasks.workunit.client.0.smithi043.stdout:1/956: sync 2023-12-08T20:28:31.090 INFO:tasks.workunit.client.0.smithi043.stdout:9/942: dwrite d0/fa5 [0,4194304] 0 2023-12-08T20:28:31.092 INFO:tasks.workunit.client.0.smithi043.stdout:6/848: dwrite d0/d2/de/d4a/d56/dc2/ffd [0,4194304] 0 2023-12-08T20:28:31.092 INFO:tasks.workunit.client.0.smithi043.stdout:9/943: mknod d0/d3d/d4b/c139 0 2023-12-08T20:28:31.099 INFO:tasks.workunit.client.0.smithi043.stdout:6/849: creat d0/d2/de/d4a/f11b x:0 0 0 2023-12-08T20:28:31.099 INFO:tasks.workunit.client.0.smithi043.stdout:6/850: fdatasync d0/d2/de/d4a/d56/dc2/dee/f100 0 2023-12-08T20:28:31.099 INFO:tasks.workunit.client.0.smithi043.stdout:6/851: fdatasync d0/d2/d14/d8/d47/d114/d49/f64 0 2023-12-08T20:28:31.105 INFO:tasks.workunit.client.0.smithi043.stdout:6/852: symlink d0/d2/l11c 0 2023-12-08T20:28:31.106 INFO:tasks.workunit.client.0.smithi043.stdout:1/957: dwrite d1/d16/d7e/f12b [0,4194304] 0 2023-12-08T20:28:31.109 INFO:tasks.workunit.client.0.smithi043.stdout:6/853: symlink d0/d2/d14/db3/df1/d22/d2a/db2/dba/de3/l11d 0 2023-12-08T20:28:31.112 INFO:tasks.workunit.client.0.smithi043.stdout:1/958: unlink d1/d16/d21/d6f/daa/fe9 0 2023-12-08T20:28:31.112 INFO:tasks.workunit.client.0.smithi043.stdout:9/944: dwrite d0/d5e/d12b/d109/ddd/d6b/d76/dd3/f12c [0,4194304] 0 2023-12-08T20:28:31.113 INFO:tasks.workunit.client.0.smithi043.stdout:9/945: chown d0/d3d/d4b/d65/l78 2068286 1 2023-12-08T20:28:31.114 INFO:tasks.workunit.client.0.smithi043.stdout:6/854: symlink d0/d2/d14/db3/df1/d22/d2a/db2/l11e 0 2023-12-08T20:28:31.123 INFO:tasks.workunit.client.0.smithi043.stdout:6/855: mkdir d0/d2/d14/db3/df1/d22/d3f/d11f 0 2023-12-08T20:28:31.123 INFO:tasks.workunit.client.0.smithi043.stdout:6/856: stat d0/d2/d14/db3/df1/d22/f8c 0 2023-12-08T20:28:31.128 INFO:tasks.workunit.client.0.smithi043.stdout:7/964: sync 2023-12-08T20:28:31.129 INFO:tasks.workunit.client.0.smithi043.stdout:7/965: truncate d0/d6/f7b 4051898 0 2023-12-08T20:28:31.130 INFO:tasks.workunit.client.0.smithi043.stdout:3/986: sync 2023-12-08T20:28:31.131 INFO:tasks.workunit.client.0.smithi043.stdout:7/966: link d0/d2/d65/d99/de3/f107 d0/d6/d17/d52/dac/f139 0 2023-12-08T20:28:31.131 INFO:tasks.workunit.client.0.smithi043.stdout:7/967: fdatasync d0/f88 0 2023-12-08T20:28:31.131 INFO:tasks.workunit.client.0.smithi043.stdout:7/968: chown d0/d6/dc7/fd9 10495 1 2023-12-08T20:28:31.131 INFO:tasks.workunit.client.0.smithi043.stdout:7/969: chown d0 6563 1 2023-12-08T20:28:31.132 INFO:tasks.workunit.client.0.smithi043.stdout:1/959: dwrite d1/d16/d48/f13b [0,4194304] 0 2023-12-08T20:28:31.132 INFO:tasks.workunit.client.0.smithi043.stdout:6/857: symlink d0/d2/d14/d8/d47/d114/d53/l120 0 2023-12-08T20:28:31.132 INFO:tasks.workunit.client.0.smithi043.stdout:7/970: symlink d0/d2/d65/d99/de3/l13a 0 2023-12-08T20:28:31.133 INFO:tasks.workunit.client.0.smithi043.stdout:3/987: symlink d1/d1c/l135 0 2023-12-08T20:28:31.133 INFO:tasks.workunit.client.0.smithi043.stdout:3/988: truncate d1/d25/fe6 577950 0 2023-12-08T20:28:31.133 INFO:tasks.workunit.client.0.smithi043.stdout:3/989: getdents d1/d1c/d2c/d5f/d123 0 2023-12-08T20:28:31.138 INFO:tasks.workunit.client.0.smithi043.stdout:9/946: dwrite d0/d5e/f79 [0,4194304] 0 2023-12-08T20:28:31.138 INFO:tasks.workunit.client.0.smithi043.stdout:9/947: truncate d0/fca 1003345 0 2023-12-08T20:28:31.138 INFO:tasks.workunit.client.0.smithi043.stdout:9/948: fsync d0/d5e/f104 0 2023-12-08T20:28:31.141 INFO:tasks.workunit.client.0.smithi043.stdout:3/990: dread d1/d25/dc1/f117 [0,4194304] 0 2023-12-08T20:28:31.141 INFO:tasks.workunit.client.0.smithi043.stdout:9/949: dread d0/d5e/f57 [0,4194304] 0 2023-12-08T20:28:31.142 INFO:tasks.workunit.client.0.smithi043.stdout:3/991: creat d1/d9/d38/d4f/d8f/f136 x:0 0 0 2023-12-08T20:28:31.142 INFO:tasks.workunit.client.0.smithi043.stdout:3/992: write d1/f9e [91623,23078] 0 2023-12-08T20:28:31.142 INFO:tasks.workunit.client.0.smithi043.stdout:3/993: chown d1/d9/d38/d4f/d5a/fff 1 1 2023-12-08T20:28:31.143 INFO:tasks.workunit.client.0.smithi043.stdout:9/950: rmdir d0/d3d/dd4/df2 39 2023-12-08T20:28:31.143 INFO:tasks.workunit.client.0.smithi043.stdout:9/951: stat d0/d3d/d4b/d61 0 2023-12-08T20:28:31.143 INFO:tasks.workunit.client.0.smithi043.stdout:3/994: write d1/d9/df/f47 [49989,128897] 0 2023-12-08T20:28:31.144 INFO:tasks.workunit.client.0.smithi043.stdout:9/952: mkdir d0/d3d/d8c/d13a 0 2023-12-08T20:28:31.145 INFO:tasks.workunit.client.0.smithi043.stdout:9/953: read d0/d5e/f57 [86805,92366] 0 2023-12-08T20:28:31.148 INFO:tasks.workunit.client.0.smithi043.stdout:1/960: rmdir d1/d16/d21 39 2023-12-08T20:28:31.149 INFO:tasks.workunit.client.0.smithi043.stdout:3/995: mkdir d1/d9/d38/d4a/dbd/d137 0 2023-12-08T20:28:31.149 INFO:tasks.workunit.client.0.smithi043.stdout:9/954: link d0/d3d/d4b/d5c/l86 d0/d5e/l13b 0 2023-12-08T20:28:31.149 INFO:tasks.workunit.client.0.smithi043.stdout:3/996: dread - d1/d9/d38/d4f/d8f/f136 zero size 2023-12-08T20:28:31.149 INFO:tasks.workunit.client.0.smithi043.stdout:6/858: truncate d0/d2/d14/db3/df1/d22/d3f/d45/d69/fb6 2038726 0 2023-12-08T20:28:31.150 INFO:tasks.workunit.client.0.smithi043.stdout:6/859: chown d0/d2/d14/d8/d47/d114/d3c/d50/lb7 256238 1 2023-12-08T20:28:31.150 INFO:tasks.workunit.client.0.smithi043.stdout:6/860: write d0/d2/d14/d8/d47/d114/d3c/f9c [1323556,12888] 0 2023-12-08T20:28:31.150 INFO:tasks.workunit.client.0.smithi043.stdout:6/861: fdatasync d0/d2/d14/d8/d47/d114/d49/f64 0 2023-12-08T20:28:31.150 INFO:tasks.workunit.client.0.smithi043.stdout:9/955: mkdir d0/d21/d80/d13c 0 2023-12-08T20:28:31.150 INFO:tasks.workunit.client.0.smithi043.stdout:9/956: write d0/d5e/d12b/d109/ddd/d6b/d94/ffe [161946,79726] 0 2023-12-08T20:28:31.152 INFO:tasks.workunit.client.0.smithi043.stdout:9/957: rename d0/d5e/c75 to d0/d5e/d12b/d109/ddd/d6b/d76/d53/c13d 0 2023-12-08T20:28:31.153 INFO:tasks.workunit.client.0.smithi043.stdout:9/958: chown d0/d5e/d12b/d109/ddd/d6b/d76/dd3/f12c 382 1 2023-12-08T20:28:31.153 INFO:tasks.workunit.client.0.smithi043.stdout:9/959: chown d0/c103 501 1 2023-12-08T20:28:31.154 INFO:tasks.workunit.client.0.smithi043.stdout:9/960: creat d0/d3d/d4b/d61/f13e x:0 0 0 2023-12-08T20:28:31.154 INFO:tasks.workunit.client.0.smithi043.stdout:1/961: unlink d1/d16/d21/d25/c135 0 2023-12-08T20:28:31.155 INFO:tasks.workunit.client.0.smithi043.stdout:9/961: rmdir d0/d5e/d12b 39 2023-12-08T20:28:31.155 INFO:tasks.workunit.client.0.smithi043.stdout:6/862: mkdir d0/ddc/d121 0 2023-12-08T20:28:31.155 INFO:tasks.workunit.client.0.smithi043.stdout:6/863: readlink d0/d2/d14/d8/d47/d114/d3c/d50/lbf 0 2023-12-08T20:28:31.155 INFO:tasks.workunit.client.0.smithi043.stdout:9/962: mkdir d0/d5e/d12b/d109/ddd/d6b/d13f 0 2023-12-08T20:28:31.158 INFO:tasks.workunit.client.0.smithi043.stdout:1/962: mknod d1/d16/d21/d25/d35/d103/c15f 0 2023-12-08T20:28:31.158 INFO:tasks.workunit.client.0.smithi043.stdout:7/971: dwrite d0/fa1 [0,4194304] 0 2023-12-08T20:28:31.158 INFO:tasks.workunit.client.0.smithi043.stdout:7/972: dread - d0/d2/d12/da2/f112 zero size 2023-12-08T20:28:31.158 INFO:tasks.workunit.client.0.smithi043.stdout:7/973: chown d0/d6/d17/d52/dac/f131 6 1 2023-12-08T20:28:31.159 INFO:tasks.workunit.client.0.smithi043.stdout:1/963: write d1/d16/d30/fb3 [2506777,63946] 0 2023-12-08T20:28:31.160 INFO:tasks.workunit.client.0.smithi043.stdout:9/963: mkdir d0/d5e/d12b/d109/ddd/d6b/d76/d138/d140 0 2023-12-08T20:28:31.163 INFO:tasks.workunit.client.0.smithi043.stdout:3/997: dread d1/d9/f1a [0,4194304] 0 2023-12-08T20:28:31.166 INFO:tasks.workunit.client.0.smithi043.stdout:1/964: write d1/d6/f29 [241330,25558] 0 2023-12-08T20:28:31.166 INFO:tasks.workunit.client.0.smithi043.stdout:1/965: fsync d1/d16/d21/d25/d3e/dbc/fe5 0 2023-12-08T20:28:31.166 INFO:tasks.workunit.client.0.smithi043.stdout:6/864: rename d0/d2/le6 to d0/d2/de/d4a/d56/l122 0 2023-12-08T20:28:31.167 INFO:tasks.workunit.client.0.smithi043.stdout:7/974: rmdir d0/d6/d17/d52/dac/df9 0 2023-12-08T20:28:31.167 INFO:tasks.workunit.client.0.smithi043.stdout:7/975: getdents d0/d2/d65/d99/d47/d136 0 2023-12-08T20:28:31.170 INFO:tasks.workunit.client.0.smithi043.stdout:1/966: symlink d1/d16/d30/d6e/l160 0 2023-12-08T20:28:31.171 INFO:tasks.workunit.client.0.smithi043.stdout:1/967: write d1/d16/d30/d4f/d54/f78 [2255709,97161] 0 2023-12-08T20:28:31.171 INFO:tasks.workunit.client.0.smithi043.stdout:6/865: rmdir d0/d2/d14/db3/df1/d22/d3f/d11f 0 2023-12-08T20:28:31.176 INFO:tasks.workunit.client.0.smithi043.stdout:6/866: write d0/d2/d14/d8/d47/d114/d3c/d6c/f9b [3133709,77052] 0 2023-12-08T20:28:31.177 INFO:tasks.workunit.client.0.smithi043.stdout:3/998: creat d1/d9/d2d/d91/dda/f138 x:0 0 0 2023-12-08T20:28:31.180 INFO:tasks.workunit.client.0.smithi043.stdout:1/968: dread d1/d16/d48/f53 [0,4194304] 0 2023-12-08T20:28:31.180 INFO:tasks.workunit.client.0.smithi043.stdout:7/976: unlink d0/d2/d65/d99/d47/dd6/ldf 0 2023-12-08T20:28:31.181 INFO:tasks.workunit.client.0.smithi043.stdout:1/969: readlink d1/d16/d7e/l11a 0 2023-12-08T20:28:31.181 INFO:tasks.workunit.client.0.smithi043.stdout:3/999: symlink d1/d9/d2d/d42/d111/l139 0 2023-12-08T20:28:31.182 INFO:tasks.workunit.client.0.smithi043.stdout:6/867: mkdir d0/d2/de/d4a/d56/dc2/d123 0 2023-12-08T20:28:31.182 INFO:tasks.workunit.client.0.smithi043.stdout:6/868: chown d0/d2/d29/f83 345999 1 2023-12-08T20:28:31.182 INFO:tasks.workunit.client.0.smithi043.stdout:6/869: write d0/d2/d29/f83 [4268995,112469] 0 2023-12-08T20:28:31.185 INFO:tasks.workunit.client.0.smithi043.stdout:9/964: getdents d0/d5e/d12b/d109/ddd/d6b/d76/d138 0 2023-12-08T20:28:31.186 INFO:tasks.workunit.client.0.smithi043.stdout:1/970: unlink d1/d16/d21/d25/d3e/d77/d9f/dc3/f108 0 2023-12-08T20:28:31.186 INFO:tasks.workunit.client.0.smithi043.stdout:9/965: creat d0/d21/f141 x:0 0 0 2023-12-08T20:28:31.189 INFO:tasks.workunit.client.0.smithi043.stdout:9/966: creat d0/d21/d80/d13c/f142 x:0 0 0 2023-12-08T20:28:31.189 INFO:tasks.workunit.client.0.smithi043.stdout:6/870: unlink d0/d2/d14/db3/df1/d22/d2a/db2/dba/dde/cf0 0 2023-12-08T20:28:31.190 INFO:tasks.workunit.client.0.smithi043.stdout:1/971: symlink d1/d16/d48/l161 0 2023-12-08T20:28:31.191 INFO:tasks.workunit.client.0.smithi043.stdout:9/967: rename d0/d5e/f79 to d0/d3d/d4b/da2/f143 0 2023-12-08T20:28:31.191 INFO:tasks.workunit.client.0.smithi043.stdout:9/968: chown d0/c4 371128 1 2023-12-08T20:28:31.191 INFO:tasks.workunit.client.0.smithi043.stdout:9/969: chown d0/d3d/d8c/l132 74629 1 2023-12-08T20:28:31.191 INFO:tasks.workunit.client.0.smithi043.stdout:7/977: dread d0/d2/d65/f71 [0,4194304] 0 2023-12-08T20:28:31.191 INFO:tasks.workunit.client.0.smithi043.stdout:7/978: readlink d0/d2/d65/d99/de7/l11c 0 2023-12-08T20:28:31.191 INFO:tasks.workunit.client.0.smithi043.stdout:9/970: creat d0/d5e/d12b/d109/ddd/d6b/d6c/f144 x:0 0 0 2023-12-08T20:28:31.192 INFO:tasks.workunit.client.0.smithi043.stdout:7/979: mknod d0/d5b/c13b 0 2023-12-08T20:28:31.192 INFO:tasks.workunit.client.0.smithi043.stdout:6/871: write d0/d2/d14/d8/f43 [1045764,56301] 0 2023-12-08T20:28:31.193 INFO:tasks.workunit.client.0.smithi043.stdout:9/971: mknod d0/d21/d80/d8e/df6/c145 0 2023-12-08T20:28:31.193 INFO:tasks.workunit.client.0.smithi043.stdout:9/972: write d0/d5e/d73/f107 [5241718,16863] 0 2023-12-08T20:28:31.193 INFO:tasks.workunit.client.0.smithi043.stdout:9/973: dread - d0/d5e/d12b/d109/ddd/fb4 zero size 2023-12-08T20:28:31.194 INFO:tasks.workunit.client.0.smithi043.stdout:7/980: creat d0/d2/d65/d99/de3/f13c x:0 0 0 2023-12-08T20:28:31.196 INFO:tasks.workunit.client.0.smithi043.stdout:7/981: mknod d0/d2/d12/d19/d38/d9c/c13d 0 2023-12-08T20:28:31.196 INFO:tasks.workunit.client.0.smithi043.stdout:7/982: write d0/d6/d17/f37 [4950423,116255] 0 2023-12-08T20:28:31.197 INFO:tasks.workunit.client.0.smithi043.stdout:9/974: getdents d0 0 2023-12-08T20:28:31.198 INFO:tasks.workunit.client.0.smithi043.stdout:7/983: mknod d0/d2/d65/d99/d47/dd6/dd8/d102/c13e 0 2023-12-08T20:28:31.199 INFO:tasks.workunit.client.0.smithi043.stdout:1/972: dread d1/d16/d30/d4f/d54/f78 [0,4194304] 0 2023-12-08T20:28:31.201 INFO:tasks.workunit.client.0.smithi043.stdout:1/973: creat d1/d6/f162 x:0 0 0 2023-12-08T20:28:31.201 INFO:tasks.workunit.client.0.smithi043.stdout:1/974: write d1/d16/d1c/f7c [2101505,43281] 0 2023-12-08T20:28:31.201 INFO:tasks.workunit.client.0.smithi043.stdout:1/975: readlink d1/db1/lc1 0 2023-12-08T20:28:31.204 INFO:tasks.workunit.client.0.smithi043.stdout:7/984: creat d0/d2/d65/d83/f13f x:0 0 0 2023-12-08T20:28:31.205 INFO:tasks.workunit.client.0.smithi043.stdout:6/872: dread d0/d2/d14/db3/df1/f65 [0,4194304] 0 2023-12-08T20:28:31.208 INFO:tasks.workunit.client.0.smithi043.stdout:1/976: symlink d1/d16/d21/d25/d3e/d77/d9f/dc3/l163 0 2023-12-08T20:28:31.208 INFO:tasks.workunit.client.0.smithi043.stdout:1/977: readlink d1/d16/d48/l5e 0 2023-12-08T20:28:31.210 INFO:tasks.workunit.client.0.smithi043.stdout:9/975: dread d0/f1e [0,4194304] 0 2023-12-08T20:28:31.211 INFO:tasks.workunit.client.0.smithi043.stdout:1/978: creat d1/d16/d21/dc8/f164 x:0 0 0 2023-12-08T20:28:31.211 INFO:tasks.workunit.client.0.smithi043.stdout:1/979: chown d1/d16/d30/d6e/l70 465 1 2023-12-08T20:28:31.212 INFO:tasks.workunit.client.0.smithi043.stdout:1/980: fdatasync d1/d16/d1c/d4e/fe7 0 2023-12-08T20:28:31.212 INFO:tasks.workunit.client.0.smithi043.stdout:9/976: symlink d0/d5e/d12b/d109/ddd/d6b/d6c/l146 0 2023-12-08T20:28:31.213 INFO:tasks.workunit.client.0.smithi043.stdout:9/977: mkdir d0/d3d/d8a/d147 0 2023-12-08T20:28:31.213 INFO:tasks.workunit.client.0.smithi043.stdout:9/978: read - d0/d21/d80/d8e/f10c zero size 2023-12-08T20:28:31.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:30 smithi111 ceph-mon[121341]: pgmap v36: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 86 MiB/s rd, 178 MiB/s wr, 371 op/s 2023-12-08T20:28:31.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:30 smithi111 ceph-mon[121341]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:28:31.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:30 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:31.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:30 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:31.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:30 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:28:31.218 INFO:tasks.workunit.client.0.smithi043.stdout:1/981: creat d1/d16/d21/d25/d3e/dbc/f165 x:0 0 0 2023-12-08T20:28:31.222 INFO:tasks.workunit.client.0.smithi043.stdout:1/982: link d1/d16/d48/f53 d1/d16/d21/d25/d35/d103/d141/f166 0 2023-12-08T20:28:31.223 INFO:tasks.workunit.client.0.smithi043.stdout:9/979: dread d0/d5e/d73/deb/fbe [0,4194304] 0 2023-12-08T20:28:31.223 INFO:tasks.workunit.client.0.smithi043.stdout:9/980: readlink d0/d21/d80/l82 0 2023-12-08T20:28:31.224 INFO:tasks.workunit.client.0.smithi043.stdout:9/981: rename d0/d3d/dd4/f11e to d0/d5e/d11d/f148 0 2023-12-08T20:28:31.224 INFO:tasks.workunit.client.0.smithi043.stdout:9/982: readlink d0/d5e/d73/deb/l125 0 2023-12-08T20:28:31.225 INFO:tasks.workunit.client.0.smithi043.stdout:9/983: rmdir d0/d5e/d12b/d109 39 2023-12-08T20:28:31.225 INFO:tasks.workunit.client.0.smithi043.stdout:9/984: chown d0/cd 1 1 2023-12-08T20:28:31.227 INFO:tasks.workunit.client.0.smithi043.stdout:9/985: creat d0/d3d/dd4/dee/f149 x:0 0 0 2023-12-08T20:28:31.227 INFO:tasks.workunit.client.0.smithi043.stdout:9/986: fdatasync d0/d5e/f59 0 2023-12-08T20:28:31.228 INFO:tasks.workunit.client.0.smithi043.stdout:1/983: symlink d1/d16/d21/d25/d35/l167 0 2023-12-08T20:28:31.231 INFO:tasks.workunit.client.0.smithi043.stdout:9/987: dread d0/d21/f3e [0,4194304] 0 2023-12-08T20:28:31.231 INFO:tasks.workunit.client.0.smithi043.stdout:7/985: dwrite d0/d2/d12/d19/ff7 [0,4194304] 0 2023-12-08T20:28:31.234 INFO:tasks.workunit.client.0.smithi043.stdout:1/984: rmdir d1/d16/d1c/d71/dc5 39 2023-12-08T20:28:31.234 INFO:tasks.workunit.client.0.smithi043.stdout:9/988: mkdir d0/d3d/dd4/df2/d113/d14a 0 2023-12-08T20:28:31.239 INFO:tasks.workunit.client.0.smithi043.stdout:6/873: dwrite d0/d2/d14/d8/fda [0,4194304] 0 2023-12-08T20:28:31.243 INFO:tasks.workunit.client.0.smithi043.stdout:1/985: creat d1/d16/d21/d25/d3e/d77/d106/d13f/f168 x:0 0 0 2023-12-08T20:28:31.243 INFO:tasks.workunit.client.0.smithi043.stdout:9/989: dread d0/d5e/d12b/d109/ddd/d6b/d76/f68 [0,4194304] 0 2023-12-08T20:28:31.243 INFO:tasks.workunit.client.0.smithi043.stdout:6/874: rmdir d0/d2/d14/d8/d47/d114/d53 39 2023-12-08T20:28:31.245 INFO:tasks.workunit.client.0.smithi043.stdout:9/990: creat d0/d3d/d4b/d5c/f14b x:0 0 0 2023-12-08T20:28:31.246 INFO:tasks.workunit.client.0.smithi043.stdout:1/986: rmdir d1/d16/d1c/d4e 39 2023-12-08T20:28:31.248 INFO:tasks.workunit.client.0.smithi043.stdout:6/875: creat d0/d2/f124 x:0 0 0 2023-12-08T20:28:31.252 INFO:tasks.workunit.client.0.smithi043.stdout:7/986: dwrite d0/d2/d65/d99/f64 [0,4194304] 0 2023-12-08T20:28:31.252 INFO:tasks.workunit.client.0.smithi043.stdout:1/987: rename d1/d16/d1c/d71/d98/fd6 to d1/d16/d21/dc8/f169 0 2023-12-08T20:28:31.252 INFO:tasks.workunit.client.0.smithi043.stdout:7/987: creat d0/d6/d17/d52/dac/f140 x:0 0 0 2023-12-08T20:28:31.254 INFO:tasks.workunit.client.0.smithi043.stdout:7/988: rename d0/d6/d17/dab/f122 to d0/d6/d17/d52/dac/d10f/f141 0 2023-12-08T20:28:31.255 INFO:tasks.workunit.client.0.smithi043.stdout:7/989: symlink d0/d2/d65/d99/d47/dd6/d101/l142 0 2023-12-08T20:28:31.256 INFO:tasks.workunit.client.0.smithi043.stdout:7/990: truncate d0/fb 4499806 0 2023-12-08T20:28:31.256 INFO:tasks.workunit.client.0.smithi043.stdout:9/991: dread d0/f1e [0,4194304] 0 2023-12-08T20:28:31.258 INFO:tasks.workunit.client.0.smithi043.stdout:6/876: creat d0/d2/d14/d8/d47/d114/d3c/f125 x:0 0 0 2023-12-08T20:28:31.262 INFO:tasks.workunit.client.0.smithi043.stdout:6/877: creat d0/d2/d14/db3/df1/d22/d2a/db2/dba/f126 x:0 0 0 2023-12-08T20:28:31.265 INFO:tasks.workunit.client.0.smithi043.stdout:1/988: write d1/d16/d1c/d4e/fe7 [25290,122083] 0 2023-12-08T20:28:31.270 INFO:tasks.workunit.client.0.smithi043.stdout:1/989: read d1/d16/d1c/f7c [1153106,100054] 0 2023-12-08T20:28:31.271 INFO:tasks.workunit.client.0.smithi043.stdout:6/878: creat d0/d2/d14/db3/df1/d22/d2a/db2/f127 x:0 0 0 2023-12-08T20:28:31.272 INFO:tasks.workunit.client.0.smithi043.stdout:6/879: write d0/d2/d14/db3/f9a [998908,122233] 0 2023-12-08T20:28:31.272 INFO:tasks.workunit.client.0.smithi043.stdout:6/880: read - d0/d2/d14/db3/df1/d22/fc7 zero size 2023-12-08T20:28:31.272 INFO:tasks.workunit.client.0.smithi043.stdout:6/881: write d0/d2/d14/f90 [1784287,73028] 0 2023-12-08T20:28:31.272 INFO:tasks.workunit.client.0.smithi043.stdout:6/882: dread - d0/d2/d14/db3/df1/d22/d2a/db2/dba/de3/f101 zero size 2023-12-08T20:28:31.272 INFO:tasks.workunit.client.0.smithi043.stdout:6/883: read d0/d2/d14/db3/df1/d22/d2a/db2/dba/dec/ffa [588124,100838] 0 2023-12-08T20:28:31.275 INFO:tasks.workunit.client.0.smithi043.stdout:1/990: stat d1/d16/d21/d25/d3e/d72/c159 0 2023-12-08T20:28:31.278 INFO:tasks.workunit.client.0.smithi043.stdout:6/884: rename d0/d2/d14/d8/f43 to d0/d2/d29/f128 0 2023-12-08T20:28:31.279 INFO:tasks.workunit.client.0.smithi043.stdout:1/991: getdents d1/d16/d21/d25/d3e 0 2023-12-08T20:28:31.282 INFO:tasks.workunit.client.0.smithi043.stdout:7/991: dwrite d0/d2/f5 [4194304,4194304] 0 2023-12-08T20:28:31.282 INFO:tasks.workunit.client.0.smithi043.stdout:1/992: creat d1/d16/d21/d25/d35/d140/f16a x:0 0 0 2023-12-08T20:28:31.283 INFO:tasks.workunit.client.0.smithi043.stdout:1/993: chown d1/d16/d21/d6f/daa/c125 733200707 1 2023-12-08T20:28:31.283 INFO:tasks.workunit.client.0.smithi043.stdout:1/994: dread - d1/d16/d1c/f91 zero size 2023-12-08T20:28:31.285 INFO:tasks.workunit.client.0.smithi043.stdout:7/992: unlink d0/d2/d65/d99/d47/cde 0 2023-12-08T20:28:31.285 INFO:tasks.workunit.client.0.smithi043.stdout:7/993: dread - d0/d2/db0/ff0 zero size 2023-12-08T20:28:31.285 INFO:tasks.workunit.client.0.smithi043.stdout:7/994: creat d0/d2/d65/d99/d47/dda/d10e/f143 x:0 0 0 2023-12-08T20:28:31.286 INFO:tasks.workunit.client.0.smithi043.stdout:7/995: chown d0/d2/d65/d99 1746596978 1 2023-12-08T20:28:31.286 INFO:tasks.workunit.client.0.smithi043.stdout:1/995: mkdir d1/d16/d30/d4f/d16b 0 2023-12-08T20:28:31.286 INFO:tasks.workunit.client.0.smithi043.stdout:1/996: chown d1/db1/c115 162 1 2023-12-08T20:28:31.287 INFO:tasks.workunit.client.0.smithi043.stdout:1/997: mkdir d1/d16/d21/d42/d16c 0 2023-12-08T20:28:31.287 INFO:tasks.workunit.client.0.smithi043.stdout:7/996: rename d0/d2/d12/f32 to d0/d6/d17/dab/f144 0 2023-12-08T20:28:31.288 INFO:tasks.workunit.client.0.smithi043.stdout:7/997: creat d0/d2/d12/da2/f145 x:0 0 0 2023-12-08T20:28:31.288 INFO:tasks.workunit.client.0.smithi043.stdout:7/998: chown d0/d6/d17/d52/dac/f139 23402140 1 2023-12-08T20:28:31.288 INFO:tasks.workunit.client.0.smithi043.stdout:7/999: write d0/d2/d65/d99/ff6 [230243,46044] 0 2023-12-08T20:28:31.289 INFO:tasks.workunit.client.0.smithi043.stdout:1/998: rename d1/d6/d63/l99 to d1/db1/l16d 0 2023-12-08T20:28:31.291 INFO:tasks.workunit.client.0.smithi043.stdout:1/999: creat d1/d16/d7e/f16e x:0 0 0 2023-12-08T20:28:31.303 INFO:tasks.workunit.client.0.smithi043.stdout:6/885: dwrite d0/d2/d29/f61 [0,4194304] 0 2023-12-08T20:28:31.304 INFO:tasks.workunit.client.0.smithi043.stdout:6/886: truncate d0/d2/d29/f52 321742 0 2023-12-08T20:28:31.306 INFO:tasks.workunit.client.0.smithi043.stdout:6/887: creat d0/d2/d14/d8/f129 x:0 0 0 2023-12-08T20:28:31.306 INFO:tasks.workunit.client.0.smithi043.stdout:6/888: write d0/d2/fa6 [5168470,123243] 0 2023-12-08T20:28:31.307 INFO:tasks.workunit.client.0.smithi043.stdout:6/889: read d0/d2/d14/db3/df1/d22/d2a/faa [522971,116949] 0 2023-12-08T20:28:31.307 INFO:tasks.workunit.client.0.smithi043.stdout:6/890: write d0/d2/d14/db3/df1/d22/d2a/db2/f127 [421934,129698] 0 2023-12-08T20:28:31.309 INFO:tasks.workunit.client.0.smithi043.stdout:6/891: creat d0/d2/d14/d8/d47/d114/d53/d73/f12a x:0 0 0 2023-12-08T20:28:31.315 INFO:tasks.workunit.client.0.smithi043.stdout:6/892: truncate d0/d2/d14/db3/df1/d22/d3f/fc9 4333069 0 2023-12-08T20:28:31.321 INFO:tasks.workunit.client.0.smithi043.stdout:6/893: rename d0/d2/d14/d8/d47/d114/d49/fe8 to d0/d2/de/d4a/de2/f12b 0 2023-12-08T20:28:31.337 INFO:tasks.workunit.client.0.smithi043.stdout:6/894: write d0/d2/d14/db3/df1/d22/d3f/fc9 [1483219,99485] 0 2023-12-08T20:28:31.339 INFO:tasks.workunit.client.0.smithi043.stdout:6/895: mkdir d0/d2/d14/db3/df1/d22/d2a/db2/dba/dde/d12c 0 2023-12-08T20:28:31.341 INFO:tasks.workunit.client.0.smithi043.stdout:6/896: symlink d0/ddc/l12d 0 2023-12-08T20:28:31.341 INFO:tasks.workunit.client.0.smithi043.stdout:6/897: chown d0/d2/d14/db3/df1/d22/d2a 107 1 2023-12-08T20:28:31.344 INFO:tasks.workunit.client.0.smithi043.stdout:6/898: rename d0/d2/d14/db3/df1/d22/f8c to d0/ddc/d10d/f12e 0 2023-12-08T20:28:31.344 INFO:tasks.workunit.client.0.smithi043.stdout:6/899: read d0/d2/d14/db3/df1/d22/d2a/db2/fcf [97255,11166] 0 2023-12-08T20:28:31.344 INFO:tasks.workunit.client.0.smithi043.stdout:6/900: write d0/d2/d14/db3/df1/d22/f10e [751220,116880] 0 2023-12-08T20:28:31.347 INFO:tasks.workunit.client.0.smithi043.stdout:6/901: rename d0/d2/d14/db3/df1/d22/c6a to d0/d2/d29/dd0/c12f 0 2023-12-08T20:28:31.348 INFO:tasks.workunit.client.0.smithi043.stdout:6/902: write d0/d2/d14/db3/df1/d22/fc7 [525484,44300] 0 2023-12-08T20:28:31.349 INFO:tasks.workunit.client.0.smithi043.stdout:6/903: truncate d0/d2/d14/d8/d47/d114/d3c/d6c/f9b 1886377 0 2023-12-08T20:28:31.349 INFO:tasks.workunit.client.0.smithi043.stdout:6/904: chown d0/d2/d14/db3/df1/d22/d3f/d45/d69 33 1 2023-12-08T20:28:31.351 INFO:tasks.workunit.client.0.smithi043.stdout:6/905: link d0/d2/d14/lc d0/d2/d14/db3/df1/d22/d2a/l130 0 2023-12-08T20:28:31.444 INFO:tasks.workunit.client.0.smithi043.stdout:6/906: dwrite d0/f7f [0,4194304] 0 2023-12-08T20:28:31.446 INFO:tasks.workunit.client.0.smithi043.stdout:6/907: creat d0/d2/d14/d8/d47/d114/d53/d73/de1/f131 x:0 0 0 2023-12-08T20:28:31.451 INFO:tasks.workunit.client.0.smithi043.stdout:6/908: dread d0/d2/d14/d8/d47/d114/d49/f4f [0,4194304] 0 2023-12-08T20:28:31.451 INFO:tasks.workunit.client.0.smithi043.stdout:6/909: read - d0/d2/de/d4a/de2/f12b zero size 2023-12-08T20:28:31.451 INFO:tasks.workunit.client.0.smithi043.stdout:6/910: chown d0/d2/f12 2 1 2023-12-08T20:28:31.452 INFO:tasks.workunit.client.0.smithi043.stdout:6/911: mknod d0/d2/d14/d8/d47/d114/d53/d73/c132 0 2023-12-08T20:28:31.457 INFO:tasks.workunit.client.0.smithi043.stdout:6/912: dread d0/d2/d14/db3/df1/f65 [0,4194304] 0 2023-12-08T20:28:31.457 INFO:tasks.workunit.client.0.smithi043.stdout:6/913: dread - d0/d2/d14/db3/df1/d22/d3f/d45/ffc zero size 2023-12-08T20:28:31.457 INFO:tasks.workunit.client.0.smithi043.stdout:6/914: rename d0 to d0/d2/d14/d8/d47/d114/d53/d133 22 2023-12-08T20:28:31.458 INFO:tasks.workunit.client.0.smithi043.stdout:6/915: symlink d0/d2/d14/l134 0 2023-12-08T20:28:31.460 INFO:tasks.workunit.client.0.smithi043.stdout:6/916: link d0/d2/d14/d8/d47/d114/d53/d73/c132 d0/d2/d14/db3/df1/d66/da4/c135 0 2023-12-08T20:28:31.477 INFO:tasks.workunit.client.0.smithi043.stdout:6/917: dwrite d0/d2/d14/d8/f4e [0,4194304] 0 2023-12-08T20:28:31.478 INFO:tasks.workunit.client.0.smithi043.stdout:6/918: chown d0/d2/f36 13875 1 2023-12-08T20:28:31.478 INFO:tasks.workunit.client.0.smithi043.stdout:6/919: write d0/d2/d14/d8/d47/d60/f8d [4078559,102896] 0 2023-12-08T20:28:31.478 INFO:tasks.workunit.client.0.smithi043.stdout:6/920: mkdir d0/d2/d14/db3/df1/d22/d2a/db2/dba/dde/d136 0 2023-12-08T20:28:31.527 INFO:tasks.workunit.client.0.smithi043.stdout:9/992: sync 2023-12-08T20:28:31.687 INFO:tasks.workunit.client.0.smithi043.stdout:6/921: sync 2023-12-08T20:28:31.688 INFO:tasks.workunit.client.0.smithi043.stdout:6/922: creat d0/d2/d14/d8/d47/d114/d3c/d50/d10f/f137 x:0 0 0 2023-12-08T20:28:31.690 INFO:tasks.workunit.client.0.smithi043.stdout:6/923: creat d0/d2/d14/d8/d47/d114/d3c/f138 x:0 0 0 2023-12-08T20:28:31.690 INFO:tasks.workunit.client.0.smithi043.stdout:6/924: chown d0/d2/d14/db3/df1/d22/d3f/fc9 1384 1 2023-12-08T20:28:31.692 INFO:tasks.workunit.client.0.smithi043.stdout:6/925: mkdir d0/d2/d14/db3/df1/d22/d2a/db2/dba/dde/d12c/d139 0 2023-12-08T20:28:31.692 INFO:tasks.workunit.client.0.smithi043.stdout:6/926: write d0/d2/d14/d8/d47/d114/d49/f64 [4657026,129786] 0 2023-12-08T20:28:31.692 INFO:tasks.workunit.client.0.smithi043.stdout:6/927: chown d0/d2/de/l3a 104 1 2023-12-08T20:28:31.692 INFO:tasks.workunit.client.0.smithi043.stdout:6/928: chown d0/d2/d14/d8/d47/d114/d3c/d50/c5d 48103613 1 2023-12-08T20:28:31.692 INFO:tasks.workunit.client.0.smithi043.stdout:6/929: chown d0/d2/d14/d8/d47/cad 98 1 2023-12-08T20:28:31.762 INFO:tasks.workunit.client.0.smithi043.stdout:9/993: sync 2023-12-08T20:28:31.763 INFO:tasks.workunit.client.0.smithi043.stdout:9/994: mkdir d0/d21/d14c 0 2023-12-08T20:28:31.764 INFO:tasks.workunit.client.0.smithi043.stdout:9/995: fdatasync d0/d5e/d73/deb/fe8 0 2023-12-08T20:28:31.783 INFO:tasks.workunit.client.0.smithi043.stdout:9/996: dwrite d0/d3d/d4b/d5c/fc7 [0,4194304] 0 2023-12-08T20:28:31.784 INFO:tasks.workunit.client.0.smithi043.stdout:9/997: fsync d0/d5e/d12b/d109/ddd/d6b/d94/fff 0 2023-12-08T20:28:31.784 INFO:tasks.workunit.client.0.smithi043.stdout:9/998: write d0/d3d/d4b/da2/f115 [4509063,99431] 0 2023-12-08T20:28:31.793 INFO:tasks.workunit.client.0.smithi043.stdout:9/999: dread d0/d3d/d4b/d61/f62 [0,4194304] 0 2023-12-08T20:28:31.951 INFO:tasks.workunit.client.0.smithi043.stdout:6/930: sync 2023-12-08T20:28:31.951 INFO:tasks.workunit.client.0.smithi043.stdout:6/931: mknod d0/d2/de/d4a/d56/dc2/d123/c13a 0 2023-12-08T20:28:31.952 INFO:tasks.workunit.client.0.smithi043.stdout:6/932: readlink d0/d2/d14/db3/df1/d22/d2a/db2/l11e 0 2023-12-08T20:28:31.954 INFO:tasks.workunit.client.0.smithi043.stdout:6/933: rename d0/d2/d14/db3/df1/d22/d2a/db2/l11e to d0/d2/d92/l13b 0 2023-12-08T20:28:31.954 INFO:tasks.workunit.client.0.smithi043.stdout:6/934: dread - d0/d2/d14/db3/df1/d22/d2a/db2/dba/f126 zero size 2023-12-08T20:28:31.956 INFO:tasks.workunit.client.0.smithi043.stdout:6/935: dread d0/d2/d29/f52 [0,4194304] 0 2023-12-08T20:28:31.956 INFO:tasks.workunit.client.0.smithi043.stdout:6/936: fdatasync d0/d2/d14/d8/d47/f80 0 2023-12-08T20:28:31.957 INFO:tasks.workunit.client.0.smithi043.stdout:6/937: truncate d0/d2/f1f 340546 0 2023-12-08T20:28:31.959 INFO:tasks.workunit.client.0.smithi043.stdout:6/938: creat d0/d2/d14/db3/df1/d22/d3f/d45/f13c x:0 0 0 2023-12-08T20:28:31.959 INFO:tasks.workunit.client.0.smithi043.stdout:6/939: stat d0/d2/d14/db3/df1/d22/fc7 0 2023-12-08T20:28:31.975 INFO:tasks.workunit.client.0.smithi043.stdout:6/940: dwrite d0/d2/d14/d8/f118 [0,4194304] 0 2023-12-08T20:28:31.980 INFO:tasks.workunit.client.0.smithi043.stdout:6/941: link d0/d2/f36 d0/d2/d14/d8/d47/d114/d49/d105/f13d 0 2023-12-08T20:28:31.980 INFO:tasks.workunit.client.0.smithi043.stdout:6/942: write d0/d2/d14/d8/d47/d114/d3c/df7/f106 [869982,130940] 0 2023-12-08T20:28:31.983 INFO:tasks.workunit.client.0.smithi043.stdout:6/943: creat d0/d2/d14/db3/df1/f13e x:0 0 0 2023-12-08T20:28:32.218 INFO:tasks.workunit.client.0.smithi043.stdout:6/944: sync 2023-12-08T20:28:32.220 INFO:tasks.workunit.client.0.smithi043.stdout:6/945: link d0/d2/d14/d8/d47/ca8 d0/d2/d29/dd0/c13f 0 2023-12-08T20:28:32.238 INFO:tasks.workunit.client.0.smithi043.stdout:6/946: dwrite d0/d2/fae [0,4194304] 0 2023-12-08T20:28:32.274 INFO:tasks.workunit.client.0.smithi043.stdout:6/947: dwrite d0/d2/d14/db3/df1/d22/f7e [0,4194304] 0 2023-12-08T20:28:32.284 INFO:tasks.workunit.client.0.smithi043.stdout:6/948: dread d0/d2/d14/db3/df1/d22/d2a/db2/dba/fbb [0,4194304] 0 2023-12-08T20:28:32.284 INFO:tasks.workunit.client.0.smithi043.stdout:6/949: stat d0/d2/de/ce7 0 2023-12-08T20:28:32.287 INFO:tasks.workunit.client.0.smithi043.stdout:6/950: unlink d0/d2/d14/db3/df1/d22/d3f/fd4 0 2023-12-08T20:28:32.315 INFO:tasks.workunit.client.0.smithi043.stdout:6/951: dwrite d0/d2/fa6 [4194304,4194304] 0 2023-12-08T20:28:32.321 INFO:tasks.workunit.client.0.smithi043.stdout:6/952: creat d0/d2/d14/d8/d47/d114/d53/d73/de1/f140 x:0 0 0 2023-12-08T20:28:32.367 INFO:tasks.workunit.client.0.smithi043.stdout:6/953: dwrite d0/d2/d14/db3/df1/d22/fff [0,4194304] 0 2023-12-08T20:28:32.367 INFO:tasks.workunit.client.0.smithi043.stdout:6/954: chown d0/d2/d14/d8/d47/d114/d3c/d6c/f9b 0 1 2023-12-08T20:28:32.367 INFO:tasks.workunit.client.0.smithi043.stdout:6/955: fsync d0/d2/d14/db3/df1/d22/d3f/d45/d69/fb6 0 2023-12-08T20:28:32.367 INFO:tasks.workunit.client.0.smithi043.stdout:6/956: write d0/d2/d14/d8/d47/d114/d53/d73/f12a [226422,90789] 0 2023-12-08T20:28:32.393 INFO:tasks.workunit.client.0.smithi043.stdout:6/957: dwrite d0/d2/de/d4a/d56/dc2/ffd [0,4194304] 0 2023-12-08T20:28:32.393 INFO:tasks.workunit.client.0.smithi043.stdout:6/958: dread - d0/d2/d14/d8/f129 zero size 2023-12-08T20:28:32.393 INFO:tasks.workunit.client.0.smithi043.stdout:6/959: stat d0/d2/de/d4a/d56/dc2/d123/c13a 0 2023-12-08T20:28:32.396 INFO:tasks.workunit.client.0.smithi043.stdout:6/960: rmdir d0/d2/d14/d8/d47/d60 39 2023-12-08T20:28:32.399 INFO:tasks.workunit.client.0.smithi043.stdout:6/961: dread d0/d2/d14/db3/df1/d22/d2a/db2/dba/fe0 [0,4194304] 0 2023-12-08T20:28:32.402 INFO:tasks.workunit.client.0.smithi043.stdout:6/962: symlink d0/l141 0 2023-12-08T20:28:32.417 INFO:tasks.workunit.client.0.smithi043.stdout:6/963: dwrite d0/d2/de/d4a/f58 [0,4194304] 0 2023-12-08T20:28:32.427 INFO:tasks.workunit.client.0.smithi043.stdout:6/964: rmdir d0/d2/d14/db3/df1/d22/d2a 39 2023-12-08T20:28:32.427 INFO:tasks.workunit.client.0.smithi043.stdout:6/965: truncate d0/d2/d14/db3/df1/d22/d2a/db2/dba/de3/f101 394168 0 2023-12-08T20:28:32.430 INFO:tasks.workunit.client.0.smithi043.stdout:6/966: creat d0/d2/de/d4a/d56/dc2/dee/f142 x:0 0 0 2023-12-08T20:28:32.430 INFO:tasks.workunit.client.0.smithi043.stdout:6/967: write d0/d2/d14/d8/d47/d114/d3c/d50/f77 [2957045,91083] 0 2023-12-08T20:28:32.430 INFO:tasks.workunit.client.0.smithi043.stdout:6/968: chown d0/d2/d14/d8/d47/d114/d3c/d6c/fce 212000 1 2023-12-08T20:28:32.430 INFO:tasks.workunit.client.0.smithi043.stdout:6/969: dread - d0/d2/d14/db3/df1/d22/d3f/d45/f13c zero size 2023-12-08T20:28:32.430 INFO:tasks.workunit.client.0.smithi043.stdout:6/970: write d0/d2/d14/d8/d47/d114/d3c/d6c/f9e [1003943,130904] 0 2023-12-08T20:28:32.431 INFO:tasks.workunit.client.0.smithi043.stdout:6/971: chown d0/d2/de/ff4 73185 1 2023-12-08T20:28:32.432 INFO:tasks.workunit.client.0.smithi043.stdout:6/972: getdents d0/d2/d14/db3/df1/d22/d2a/db2/dba 0 2023-12-08T20:28:32.434 INFO:tasks.workunit.client.0.smithi043.stdout:6/973: rmdir d0/d2/d14/d8/d47/d60 39 2023-12-08T20:28:32.434 INFO:tasks.workunit.client.0.smithi043.stdout:6/974: read - d0/d2/d14/db3/df1/f13e zero size 2023-12-08T20:28:32.450 INFO:tasks.workunit.client.0.smithi043.stdout:6/975: dread d0/d2/d14/db3/df1/d22/d2a/f5a [0,4194304] 0 2023-12-08T20:28:32.451 INFO:tasks.workunit.client.0.smithi043.stdout:6/976: mknod d0/d2/d14/db3/df1/d66/da4/c143 0 2023-12-08T20:28:32.454 INFO:tasks.workunit.client.0.smithi043.stdout:6/977: rmdir d0/d2/d14/db3/df1/d22/d2a/db2/dba 39 2023-12-08T20:28:32.454 INFO:tasks.workunit.client.0.smithi043.stdout:6/978: fdatasync d0/d2/d14/f18 0 2023-12-08T20:28:32.454 INFO:tasks.workunit.client.0.smithi043.stdout:6/979: dread - d0/d2/d14/db3/df1/d22/d3f/fb1 zero size 2023-12-08T20:28:32.455 INFO:tasks.workunit.client.0.smithi043.stdout:6/980: mkdir d0/d2/de/d4a/d56/dc2/dee/d144 0 2023-12-08T20:28:32.455 INFO:tasks.workunit.client.0.smithi043.stdout:6/981: stat d0/d2/d14/d8/d47/d114/d53/d73/de1 0 2023-12-08T20:28:32.458 INFO:tasks.workunit.client.0.smithi043.stdout:6/982: rename d0/d2/d92/feb to d0/d2/d14/f145 0 2023-12-08T20:28:32.486 INFO:tasks.workunit.client.0.smithi043.stdout:6/983: dwrite d0/d2/d14/d8/d47/d114/d3c/d6c/f9b [0,4194304] 0 2023-12-08T20:28:32.487 INFO:tasks.workunit.client.0.smithi043.stdout:6/984: mknod d0/d2/d14/d8/d47/d114/d3c/d50/c146 0 2023-12-08T20:28:32.488 INFO:tasks.workunit.client.0.smithi043.stdout:6/985: symlink d0/d2/d14/db3/df1/d22/d2a/l147 0 2023-12-08T20:28:32.488 INFO:tasks.workunit.client.0.smithi043.stdout:6/986: chown d0/d2/d14/db3/df1/d22/d2a/db2/dba/de3/f101 42 1 2023-12-08T20:28:32.491 INFO:tasks.workunit.client.0.smithi043.stdout:6/987: link d0/d2/d14/db3/df1/d22/d2a/db2/dba/fbb d0/d2/de/d4a/d56/dc2/d123/f148 0 2023-12-08T20:28:32.504 INFO:tasks.workunit.client.0.smithi043.stdout:6/988: write d0/ddc/d10d/f12e [402874,10501] 0 2023-12-08T20:28:32.520 INFO:tasks.workunit.client.0.smithi043.stdout:6/989: dwrite d0/d2/d14/db3/df1/d22/d2a/db2/dba/de3/f111 [0,4194304] 0 2023-12-08T20:28:32.525 INFO:tasks.workunit.client.0.smithi043.stdout:6/990: mkdir d0/d2/de/d4a/d56/dc2/d149 0 2023-12-08T20:28:32.528 INFO:tasks.workunit.client.0.smithi043.stdout:6/991: unlink d0/d2/d14/lc 0 2023-12-08T20:28:32.531 INFO:tasks.workunit.client.0.smithi043.stdout:6/992: link d0/d2/f28 d0/dc3/f14a 0 2023-12-08T20:28:32.534 INFO:tasks.workunit.client.0.smithi043.stdout:6/993: stat d0/d2/d92/l13b 0 2023-12-08T20:28:32.537 INFO:tasks.workunit.client.0.smithi043.stdout:6/994: rmdir d0/d2/d14/d8/d47/d114/d49 39 2023-12-08T20:28:32.537 INFO:tasks.workunit.client.0.smithi043.stdout:6/995: chown d0/d2/d14/d8/d47/d114/d53/lbc 1368323 1 2023-12-08T20:28:32.546 INFO:tasks.workunit.client.0.smithi043.stdout:6/996: dread d0/d2/d14/db3/df1/d22/f7e [0,4194304] 0 2023-12-08T20:28:32.546 INFO:tasks.workunit.client.0.smithi043.stdout:6/997: chown d0/d2/d14/db3/df1/d22/ffe 59 1 2023-12-08T20:28:32.546 INFO:tasks.workunit.client.0.smithi043.stdout:6/998: getdents d0/ddc/d10d 0 2023-12-08T20:28:32.548 INFO:tasks.workunit.client.0.smithi043.stdout:6/999: link d0/d2/d14/db3/df1/d22/d3f/ff2 d0/d2/de/f14b 0 2023-12-08T20:28:32.551 INFO:tasks.workunit.client.0.smithi043.stderr:+ rm -rf -- ./tmp.YuwGLmRq71 2023-12-08T20:28:32.720 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:32 smithi043 ceph-mon[111966]: pgmap v37: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 125 MiB/s rd, 260 MiB/s wr, 550 op/s 2023-12-08T20:28:32.860 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:32 smithi111 ceph-mon[121341]: pgmap v37: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 125 MiB/s rd, 260 MiB/s wr, 550 op/s 2023-12-08T20:28:34.497 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:34 smithi043 ceph-mon[111966]: pgmap v38: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 82 MiB/s rd, 174 MiB/s wr, 373 op/s 2023-12-08T20:28:34.497 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:34 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:34.497 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:34 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:34.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:34 smithi111 ceph-mon[121341]: pgmap v38: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 82 MiB/s rd, 174 MiB/s wr, 373 op/s 2023-12-08T20:28:34.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:34 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:34.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:34 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:36.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:36 smithi111 ceph-mon[121341]: pgmap v39: 65 pgs: 65 active+clean; 2.1 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 96 MiB/s rd, 211 MiB/s wr, 524 op/s 2023-12-08T20:28:36.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:36 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:36.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:36 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:36.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:36 smithi043 ceph-mon[111966]: pgmap v39: 65 pgs: 65 active+clean; 2.1 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 96 MiB/s rd, 211 MiB/s wr, 524 op/s 2023-12-08T20:28:36.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:36 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:36.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:36 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:37.709 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:37 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:37.710 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:37 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:37.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:37 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:37.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:37 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:38.838 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:38 smithi043 ceph-mon[111966]: pgmap v40: 65 pgs: 65 active+clean; 2.1 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 53 MiB/s rd, 119 MiB/s wr, 329 op/s 2023-12-08T20:28:38.838 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:38 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:28:38.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:38 smithi111 ceph-mon[121341]: pgmap v40: 65 pgs: 65 active+clean; 2.1 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 53 MiB/s rd, 119 MiB/s wr, 329 op/s 2023-12-08T20:28:38.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:38 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:28:40.967 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: pgmap v41: 65 pgs: 65 active+clean; 2.1 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 53 MiB/s rd, 119 MiB/s wr, 329 op/s 2023-12-08T20:28:40.967 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:40.967 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:40.967 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:28:40.967 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:28:40.967 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:40.967 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:28:40.968 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mgr fail", "who": "smithi111.mtcffu"}]: dispatch 2023-12-08T20:28:40.968 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mgr fail", "who": "smithi111.mtcffu"}]: dispatch 2023-12-08T20:28:40.968 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: osdmap e48: 6 total, 6 up, 6 in 2023-12-08T20:28:40.968 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd='[{"prefix": "mgr fail", "who": "smithi111.mtcffu"}]': finished 2023-12-08T20:28:40.968 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: mgrmap e26: smithi043.hqcdcm(active, starting, since 0.00805296s) 2023-12-08T20:28:40.968 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: Active manager daemon smithi043.hqcdcm restarted 2023-12-08T20:28:40.968 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: Activating manager daemon smithi043.hqcdcm 2023-12-08T20:28:40.968 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: osdmap e49: 6 total, 6 up, 6 in 2023-12-08T20:28:40.968 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: mgrmap e27: smithi043.hqcdcm(active, starting, since 0.0104046s) 2023-12-08T20:28:40.968 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.? 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi043.hqcdcm/crt"}]: dispatch 2023-12-08T20:28:40.968 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi043.hqcdcm/crt"}]: dispatch 2023-12-08T20:28:40.968 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:28:40.968 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:28:40.968 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi043.pjmszb"}]: dispatch 2023-12-08T20:28:40.968 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi043.akrjef"}]: dispatch 2023-12-08T20:28:40.969 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.veeegc"}]: dispatch 2023-12-08T20:28:40.969 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.svpasm"}]: dispatch 2023-12-08T20:28:40.969 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr metadata", "who": "smithi043.hqcdcm", "id": "smithi043.hqcdcm"}]: dispatch 2023-12-08T20:28:40.969 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:28:40.969 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-08T20:28:40.969 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:28:40.969 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:28:40.969 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:28:40.969 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:28:40.969 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-08T20:28:40.969 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-08T20:28:40.969 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-08T20:28:40.969 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-08T20:28:40.969 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi043.hqcdcm/key"}]: dispatch 2023-12-08T20:28:40.969 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-08T20:28:40.969 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: Manager daemon smithi043.hqcdcm is now available 2023-12-08T20:28:40.970 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:28:40.970 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:28:40.970 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:40 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:28:41.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: pgmap v41: 65 pgs: 65 active+clean; 2.1 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 53 MiB/s rd, 119 MiB/s wr, 329 op/s 2023-12-08T20:28:41.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:41.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:41.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:28:41.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:28:41.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' 2023-12-08T20:28:41.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:28:41.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.24407 172.21.15.111:0/1884988066' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mgr fail", "who": "smithi111.mtcffu"}]: dispatch 2023-12-08T20:28:41.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "mgr fail", "who": "smithi111.mtcffu"}]: dispatch 2023-12-08T20:28:41.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: osdmap e48: 6 total, 6 up, 6 in 2023-12-08T20:28:41.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.24407 ' entity='mgr.smithi111.mtcffu' cmd='[{"prefix": "mgr fail", "who": "smithi111.mtcffu"}]': finished 2023-12-08T20:28:41.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: mgrmap e26: smithi043.hqcdcm(active, starting, since 0.00805296s) 2023-12-08T20:28:41.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: Active manager daemon smithi043.hqcdcm restarted 2023-12-08T20:28:41.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: Activating manager daemon smithi043.hqcdcm 2023-12-08T20:28:41.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: osdmap e49: 6 total, 6 up, 6 in 2023-12-08T20:28:41.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: mgrmap e27: smithi043.hqcdcm(active, starting, since 0.0104046s) 2023-12-08T20:28:41.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi043.hqcdcm/crt"}]: dispatch 2023-12-08T20:28:41.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi043.hqcdcm/crt"}]: dispatch 2023-12-08T20:28:41.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:28:41.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:28:41.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi043.pjmszb"}]: dispatch 2023-12-08T20:28:41.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi043.akrjef"}]: dispatch 2023-12-08T20:28:41.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.veeegc"}]: dispatch 2023-12-08T20:28:41.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.svpasm"}]: dispatch 2023-12-08T20:28:41.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr metadata", "who": "smithi043.hqcdcm", "id": "smithi043.hqcdcm"}]: dispatch 2023-12-08T20:28:41.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:28:41.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-08T20:28:41.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:28:41.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:28:41.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:28:41.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:28:41.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-08T20:28:41.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-08T20:28:41.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-08T20:28:41.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-08T20:28:41.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi043.hqcdcm/key"}]: dispatch 2023-12-08T20:28:41.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-08T20:28:41.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: Manager daemon smithi043.hqcdcm is now available 2023-12-08T20:28:41.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:28:41.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:28:41.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:40 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:28:41.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:41 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi043.hqcdcm/mirror_snapshot_schedule"}]: dispatch 2023-12-08T20:28:41.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:41 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi043.hqcdcm/trash_purge_schedule"}]: dispatch 2023-12-08T20:28:41.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:41 smithi111 ceph-mon[121341]: mgrmap e28: smithi043.hqcdcm(active, since 1.01346s) 2023-12-08T20:28:42.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:41 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi043.hqcdcm/mirror_snapshot_schedule"}]: dispatch 2023-12-08T20:28:42.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:41 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi043.hqcdcm/trash_purge_schedule"}]: dispatch 2023-12-08T20:28:42.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:41 smithi043 ceph-mon[111966]: mgrmap e28: smithi043.hqcdcm(active, since 1.01346s) 2023-12-08T20:28:43.122 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:42 smithi111 ceph-mon[121341]: [08/Dec/2023:20:28:41] ENGINE Bus STARTING 2023-12-08T20:28:43.122 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:42 smithi111 ceph-mon[121341]: [08/Dec/2023:20:28:41] ENGINE Serving on https://172.21.15.43:7150 2023-12-08T20:28:43.122 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:42 smithi111 ceph-mon[121341]: pgmap v3: 65 pgs: 65 active+clean; 1.5 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2023-12-08T20:28:43.122 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:42 smithi111 ceph-mon[121341]: [08/Dec/2023:20:28:41] ENGINE Serving on http://172.21.15.43:8765 2023-12-08T20:28:43.122 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:42 smithi111 ceph-mon[121341]: [08/Dec/2023:20:28:41] ENGINE Bus STARTED 2023-12-08T20:28:43.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:42 smithi043 ceph-mon[111966]: [08/Dec/2023:20:28:41] ENGINE Bus STARTING 2023-12-08T20:28:43.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:42 smithi043 ceph-mon[111966]: [08/Dec/2023:20:28:41] ENGINE Serving on https://172.21.15.43:7150 2023-12-08T20:28:43.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:42 smithi043 ceph-mon[111966]: pgmap v3: 65 pgs: 65 active+clean; 1.5 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2023-12-08T20:28:43.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:42 smithi043 ceph-mon[111966]: [08/Dec/2023:20:28:41] ENGINE Serving on http://172.21.15.43:8765 2023-12-08T20:28:43.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:42 smithi043 ceph-mon[111966]: [08/Dec/2023:20:28:41] ENGINE Bus STARTED 2023-12-08T20:28:44.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:43 smithi111 ceph-mon[121341]: pgmap v4: 65 pgs: 65 active+clean; 1.5 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2023-12-08T20:28:44.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:43 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:44.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:43 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:44.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:43 smithi111 ceph-mon[121341]: mgrmap e29: smithi043.hqcdcm(active, since 3s) 2023-12-08T20:28:44.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:43 smithi043 ceph-mon[111966]: pgmap v4: 65 pgs: 65 active+clean; 1.5 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2023-12-08T20:28:44.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:43 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:44.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:43 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:44.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:43 smithi043 ceph-mon[111966]: mgrmap e29: smithi043.hqcdcm(active, since 3s) 2023-12-08T20:28:45.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:45 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:45.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:45 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:45.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:45 smithi111 ceph-mon[121341]: pgmap v5: 65 pgs: 65 active+clean; 1.5 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2023-12-08T20:28:45.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:45 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:45.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:45 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:45.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:45 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:45.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:45 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:45.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:45 smithi043 ceph-mon[111966]: pgmap v5: 65 pgs: 65 active+clean; 1.5 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2023-12-08T20:28:45.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:45 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:45.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:45 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:46.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:46 smithi111 ceph-mon[121341]: mgrmap e30: smithi043.hqcdcm(active, since 4s) 2023-12-08T20:28:46.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:46 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:46.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:46 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:46.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:46 smithi043 ceph-mon[111966]: mgrmap e30: smithi043.hqcdcm(active, since 4s) 2023-12-08T20:28:46.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:46 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:46.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:46 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:47.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:47 smithi043 ceph-mon[111966]: pgmap v6: 65 pgs: 65 active+clean; 1.4 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 8.0 KiB/s rd, 8.0 KiB/s wr, 36 op/s 2023-12-08T20:28:47.716 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:47 smithi111 ceph-mon[121341]: pgmap v6: 65 pgs: 65 active+clean; 1.4 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 8.0 KiB/s rd, 8.0 KiB/s wr, 36 op/s 2023-12-08T20:28:48.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:48 smithi111 ceph-mon[121341]: Standby manager daemon smithi111.mtcffu started 2023-12-08T20:28:48.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:48 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.111:0/2585258927' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/crt"}]: dispatch 2023-12-08T20:28:48.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:48 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.111:0/2585258927' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-08T20:28:48.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:48 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.111:0/2585258927' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/key"}]: dispatch 2023-12-08T20:28:48.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:48 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.111:0/2585258927' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-08T20:28:48.758 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:48 smithi043 ceph-mon[111966]: Standby manager daemon smithi111.mtcffu started 2023-12-08T20:28:48.758 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:48 smithi043 ceph-mon[111966]: from='mgr.? 172.21.15.111:0/2585258927' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/crt"}]: dispatch 2023-12-08T20:28:48.758 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:48 smithi043 ceph-mon[111966]: from='mgr.? 172.21.15.111:0/2585258927' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-08T20:28:48.758 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:48 smithi043 ceph-mon[111966]: from='mgr.? 172.21.15.111:0/2585258927' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/key"}]: dispatch 2023-12-08T20:28:48.758 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:48 smithi043 ceph-mon[111966]: from='mgr.? 172.21.15.111:0/2585258927' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-08T20:28:49.574 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-08T20:28:49.575 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-08T20:28:49.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:49 smithi111 ceph-mon[121341]: mgrmap e31: smithi043.hqcdcm(active, since 7s), standbys: smithi111.mtcffu 2023-12-08T20:28:49.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:49 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr metadata", "who": "smithi111.mtcffu", "id": "smithi111.mtcffu"}]: dispatch 2023-12-08T20:28:49.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:49 smithi111 ceph-mon[121341]: pgmap v7: 65 pgs: 65 active+clean; 1015 MiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 48 KiB/s rd, 1.4 MiB/s wr, 192 op/s 2023-12-08T20:28:49.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:49 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:49.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:49 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:49.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:49 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:28:49.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:49 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:28:49.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:49 smithi111 ceph-mon[121341]: Updating smithi043:/etc/ceph/ceph.conf 2023-12-08T20:28:49.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:49 smithi111 ceph-mon[121341]: Updating smithi111:/etc/ceph/ceph.conf 2023-12-08T20:28:49.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:49 smithi043 ceph-mon[111966]: mgrmap e31: smithi043.hqcdcm(active, since 7s), standbys: smithi111.mtcffu 2023-12-08T20:28:49.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:49 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr metadata", "who": "smithi111.mtcffu", "id": "smithi111.mtcffu"}]: dispatch 2023-12-08T20:28:49.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:49 smithi043 ceph-mon[111966]: pgmap v7: 65 pgs: 65 active+clean; 1015 MiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 48 KiB/s rd, 1.4 MiB/s wr, 192 op/s 2023-12-08T20:28:49.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:49 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:49.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:49 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:49.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:49 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:28:49.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:49 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:28:49.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:49 smithi043 ceph-mon[111966]: Updating smithi043:/etc/ceph/ceph.conf 2023-12-08T20:28:49.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:49 smithi043 ceph-mon[111966]: Updating smithi111:/etc/ceph/ceph.conf 2023-12-08T20:28:50.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:50 smithi111 ceph-mon[121341]: Updating smithi111:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:28:50.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:50 smithi111 ceph-mon[121341]: Updating smithi043:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:28:50.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:50 smithi111 ceph-mon[121341]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2023-12-08T20:28:50.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:50 smithi111 ceph-mon[121341]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2023-12-08T20:28:50.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:50 smithi111 ceph-mon[121341]: Updating smithi111:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-08T20:28:50.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:50 smithi111 ceph-mon[121341]: Updating smithi043:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-08T20:28:50.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:50 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:50.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:50 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:50.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:50 smithi043 ceph-mon[111966]: Updating smithi111:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:28:50.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:50 smithi043 ceph-mon[111966]: Updating smithi043:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:28:50.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:50 smithi043 ceph-mon[111966]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2023-12-08T20:28:50.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:50 smithi043 ceph-mon[111966]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2023-12-08T20:28:50.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:50 smithi043 ceph-mon[111966]: Updating smithi111:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-08T20:28:50.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:50 smithi043 ceph-mon[111966]: Updating smithi043:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-08T20:28:50.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:50 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:50.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:50 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:51.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:51 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:51.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:51 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:51.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:51 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:51.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:51 smithi043 ceph-mon[111966]: pgmap v8: 65 pgs: 65 active+clean; 1015 MiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 37 KiB/s rd, 1.1 MiB/s wr, 149 op/s 2023-12-08T20:28:51.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:51 smithi043 ceph-mon[111966]: Reconfiguring prometheus.smithi043 (dependencies changed)... 2023-12-08T20:28:51.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:51 smithi043 ceph-mon[111966]: Reconfiguring daemon prometheus.smithi043 on smithi043 2023-12-08T20:28:51.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:51 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:51.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:51 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:51.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:51 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:51.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:51 smithi111 ceph-mon[121341]: pgmap v8: 65 pgs: 65 active+clean; 1015 MiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 37 KiB/s rd, 1.1 MiB/s wr, 149 op/s 2023-12-08T20:28:51.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:51 smithi111 ceph-mon[121341]: Reconfiguring prometheus.smithi043 (dependencies changed)... 2023-12-08T20:28:51.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:51 smithi111 ceph-mon[121341]: Reconfiguring daemon prometheus.smithi043 on smithi043 2023-12-08T20:28:53.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:53 smithi111 ceph-mon[121341]: pgmap v9: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 52 KiB/s rd, 1.8 MiB/s wr, 272 op/s 2023-12-08T20:28:54.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:53 smithi043 ceph-mon[111966]: pgmap v9: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 52 KiB/s rd, 1.8 MiB/s wr, 272 op/s 2023-12-08T20:28:55.569 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:55 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:55.569 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:55 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:55.569 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:55 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-08T20:28:55.569 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:55 smithi111 ceph-mon[121341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-08T20:28:55.569 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:55 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:28:55.569 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:55 smithi111 ceph-mon[121341]: pgmap v10: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.7 MiB/s wr, 249 op/s 2023-12-08T20:28:55.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:55 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:55.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:55 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:55.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:55 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-08T20:28:55.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:55 smithi043 ceph-mon[111966]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-08T20:28:55.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:55 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:28:55.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:55 smithi043 ceph-mon[111966]: pgmap v10: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.7 MiB/s wr, 249 op/s 2023-12-08T20:28:56.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:56 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:28:56.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:56 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.mtcffu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-08T20:28:56.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:56 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-08T20:28:56.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:56 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:28:56.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:56 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:28:56.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:56 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.mtcffu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-08T20:28:56.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:56 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-08T20:28:56.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:56 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:28:57.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:57 smithi043 ceph-mon[111966]: Upgrade: Updating mgr.smithi111.mtcffu 2023-12-08T20:28:57.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:57 smithi043 ceph-mon[111966]: Deploying daemon mgr.smithi111.mtcffu on smithi111 2023-12-08T20:28:57.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:57 smithi043 ceph-mon[111966]: pgmap v11: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 64 KiB/s rd, 1.8 MiB/s wr, 300 op/s 2023-12-08T20:28:57.835 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:57 smithi111 ceph-mon[121341]: Upgrade: Updating mgr.smithi111.mtcffu 2023-12-08T20:28:57.835 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:57 smithi111 ceph-mon[121341]: Deploying daemon mgr.smithi111.mtcffu on smithi111 2023-12-08T20:28:57.835 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:57 smithi111 ceph-mon[121341]: pgmap v11: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 64 KiB/s rd, 1.8 MiB/s wr, 300 op/s 2023-12-08T20:28:59.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.805+0000 7f7da5d9b700 1 -- 172.21.15.43:0/380666910 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d9c013ad0 con 0x7f7da806eb60 2023-12-08T20:28:59.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.805+0000 7f7dad0ec700 1 -- 172.21.15.43:0/380666910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7da806eb60 msgr2=0x7f7da810ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:28:59.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.805+0000 7f7dad0ec700 1 --2- 172.21.15.43:0/380666910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7da806eb60 0x7f7da810ae70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c004880 tx=0x7f7d9c009e30 comp rx=0 tx=0).stop 2023-12-08T20:28:59.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.805+0000 7f7dad0ec700 1 -- 172.21.15.43:0/380666910 shutdown_connections 2023-12-08T20:28:59.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.805+0000 7f7dad0ec700 1 --2- 172.21.15.43:0/380666910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7da806eb60 0x7f7da810ae70 secure :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c004880 tx=0x7f7d9c009e30 comp rx=0 tx=0).stop 2023-12-08T20:28:59.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.805+0000 7f7dad0ec700 1 --2- 172.21.15.43:0/380666910 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7da806e210 0x7f7da806e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:59.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.805+0000 7f7dad0ec700 1 -- 172.21.15.43:0/380666910 >> 172.21.15.43:0/380666910 conn(0x7f7da8069b20 msgr2=0x7f7da806bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:28:59.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.806+0000 7f7dad0ec700 1 -- 172.21.15.43:0/380666910 shutdown_connections 2023-12-08T20:28:59.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.806+0000 7f7dad0ec700 1 -- 172.21.15.43:0/380666910 wait complete. 2023-12-08T20:28:59.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.807+0000 7f7dad0ec700 1 Processor -- start 2023-12-08T20:28:59.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.807+0000 7f7dad0ec700 1 -- start start 2023-12-08T20:28:59.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.807+0000 7f7dad0ec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7da806e210 0x7f7da810b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:28:59.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.807+0000 7f7dad0ec700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7da810bde0 0x7f7da810ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:28:59.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.807+0000 7f7dad0ec700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da810c2a0 con 0x7f7da806e210 2023-12-08T20:28:59.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.807+0000 7f7dad0ec700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da810c410 con 0x7f7da810bde0 2023-12-08T20:28:59.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.808+0000 7f7da6d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7da806e210 0x7f7da810b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:28:59.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.808+0000 7f7da6d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7da806e210 0x7f7da810b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49264/0 (socket says 172.21.15.43:49264) 2023-12-08T20:28:59.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.808+0000 7f7da6d9d700 1 -- 172.21.15.43:0/3486406410 learned_addr learned my addr 172.21.15.43:0/3486406410 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:28:59.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.809+0000 7f7da6d9d700 1 -- 172.21.15.43:0/3486406410 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7da810bde0 msgr2=0x7f7da810ccd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-08T20:28:59.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.809+0000 7f7da6d9d700 1 --2- 172.21.15.43:0/3486406410 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7da810bde0 0x7f7da810ccd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:28:59.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.809+0000 7f7da6d9d700 1 -- 172.21.15.43:0/3486406410 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c005040 con 0x7f7da806e210 2023-12-08T20:28:59.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.809+0000 7f7da6d9d700 1 --2- 172.21.15.43:0/3486406410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7da806e210 0x7f7da810b8a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7d98002a80 tx=0x7f7d98004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:28:59.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.810+0000 7f7d8f7fe700 1 -- 172.21.15.43:0/3486406410 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d98007cc0 con 0x7f7da806e210 2023-12-08T20:28:59.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.810+0000 7f7d8f7fe700 1 -- 172.21.15.43:0/3486406410 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7d9800f040 con 0x7f7da806e210 2023-12-08T20:28:59.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.810+0000 7f7d8f7fe700 1 -- 172.21.15.43:0/3486406410 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d9800da00 con 0x7f7da806e210 2023-12-08T20:28:59.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.810+0000 7f7dad0ec700 1 -- 172.21.15.43:0/3486406410 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da810d330 con 0x7f7da806e210 2023-12-08T20:28:59.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.810+0000 7f7dad0ec700 1 -- 172.21.15.43:0/3486406410 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da810d820 con 0x7f7da806e210 2023-12-08T20:28:59.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.811+0000 7f7dad0ec700 1 -- 172.21.15.43:0/3486406410 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da8112000 con 0x7f7da806e210 2023-12-08T20:28:59.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.813+0000 7f7d8f7fe700 1 -- 172.21.15.43:0/3486406410 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f7d9800db60 con 0x7f7da806e210 2023-12-08T20:28:59.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.813+0000 7f7d8f7fe700 1 --2- 172.21.15.43:0/3486406410 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f7d9006cc00 0x7f7d9006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:28:59.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.813+0000 7f7d8f7fe700 1 -- 172.21.15.43:0/3486406410 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f7d9808bd60 con 0x7f7da806e210 2023-12-08T20:28:59.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.814+0000 7f7da659c700 1 --2- 172.21.15.43:0/3486406410 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f7d9006cc00 0x7f7d9006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:28:59.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.814+0000 7f7da659c700 1 --2- 172.21.15.43:0/3486406410 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f7d9006cc00 0x7f7d9006f0b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7da810c910 tx=0x7f7d9c009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:28:59.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:28:59.823+0000 7f7d8f7fe700 1 -- 172.21.15.43:0/3486406410 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f7d98055f70 con 0x7f7da806e210 2023-12-08T20:28:59.985 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:59 smithi111 ceph-mon[121341]: pgmap v12: 65 pgs: 65 active+clean; 297 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 61 KiB/s rd, 2.3 MiB/s wr, 398 op/s 2023-12-08T20:28:59.986 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:59 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:59.986 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:59 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:28:59.986 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:28:59 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:29:00.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:59 smithi043 ceph-mon[111966]: pgmap v12: 65 pgs: 65 active+clean; 297 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 61 KiB/s rd, 2.3 MiB/s wr, 398 op/s 2023-12-08T20:29:00.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:59 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:00.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:59 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:00.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:28:59 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:29:00.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.131+0000 7f7dad0ec700 1 -- 172.21.15.43:0/3486406410 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7da805e080 con 0x7f7d9006cc00 2023-12-08T20:29:00.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.133+0000 7f7d8f7fe700 1 -- 172.21.15.43:0/3486406410 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f7da805e080 con 0x7f7d9006cc00 2023-12-08T20:29:00.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.135+0000 7f7dad0ec700 1 -- 172.21.15.43:0/3486406410 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f7d9006cc00 msgr2=0x7f7d9006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:00.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.135+0000 7f7dad0ec700 1 --2- 172.21.15.43:0/3486406410 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f7d9006cc00 0x7f7d9006f0b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7da810c910 tx=0x7f7d9c009e30 comp rx=0 tx=0).stop 2023-12-08T20:29:00.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.135+0000 7f7dad0ec700 1 -- 172.21.15.43:0/3486406410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7da806e210 msgr2=0x7f7da810b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.135+0000 7f7dad0ec700 1 --2- 172.21.15.43:0/3486406410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7da806e210 0x7f7da810b8a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7d98002a80 tx=0x7f7d98004630 comp rx=0 tx=0).stop 2023-12-08T20:29:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.135+0000 7f7dad0ec700 1 -- 172.21.15.43:0/3486406410 shutdown_connections 2023-12-08T20:29:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.135+0000 7f7dad0ec700 1 --2- 172.21.15.43:0/3486406410 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f7d9006cc00 0x7f7d9006f0b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.135+0000 7f7dad0ec700 1 --2- 172.21.15.43:0/3486406410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7da806e210 0x7f7da810b8a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.135+0000 7f7dad0ec700 1 --2- 172.21.15.43:0/3486406410 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7da810bde0 0x7f7da810ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.135+0000 7f7dad0ec700 1 -- 172.21.15.43:0/3486406410 >> 172.21.15.43:0/3486406410 conn(0x7f7da8069b20 msgr2=0x7f7da81096f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:29:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.135+0000 7f7dad0ec700 1 -- 172.21.15.43:0/3486406410 shutdown_connections 2023-12-08T20:29:00.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.136+0000 7f7dad0ec700 1 -- 172.21.15.43:0/3486406410 wait complete. 2023-12-08T20:29:00.149 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:29:00.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.258+0000 7f1e8c2b2700 1 -- 172.21.15.43:0/557170369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e840fbaf0 msgr2=0x7f1e840fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:00.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.258+0000 7f1e8c2b2700 1 --2- 172.21.15.43:0/557170369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e840fbaf0 0x7f1e840fbf00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1e80004880 tx=0x7f1e80009e30 comp rx=0 tx=0).stop 2023-12-08T20:29:00.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.258+0000 7f1e8c2b2700 1 -- 172.21.15.43:0/557170369 shutdown_connections 2023-12-08T20:29:00.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.258+0000 7f1e8c2b2700 1 --2- 172.21.15.43:0/557170369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e840fcd00 0x7f1e840fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:00.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.258+0000 7f1e8c2b2700 1 --2- 172.21.15.43:0/557170369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e840fbaf0 0x7f1e840fbf00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:00.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.259+0000 7f1e8c2b2700 1 -- 172.21.15.43:0/557170369 >> 172.21.15.43:0/557170369 conn(0x7f1e840f71b0 msgr2=0x7f1e840f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:29:00.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.259+0000 7f1e8c2b2700 1 -- 172.21.15.43:0/557170369 shutdown_connections 2023-12-08T20:29:00.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.259+0000 7f1e8c2b2700 1 -- 172.21.15.43:0/557170369 wait complete. 2023-12-08T20:29:00.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.259+0000 7f1e8c2b2700 1 Processor -- start 2023-12-08T20:29:00.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.259+0000 7f1e8c2b2700 1 -- start start 2023-12-08T20:29:00.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.259+0000 7f1e8c2b2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e840fbaf0 0x7f1e840ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:00.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.260+0000 7f1e8c2b2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e840fcd00 0x7f1e840fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:00.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.260+0000 7f1e8c2b2700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840fe640 con 0x7f1e840fbaf0 2023-12-08T20:29:00.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.260+0000 7f1e8c2b2700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840fe7b0 con 0x7f1e840fcd00 2023-12-08T20:29:00.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.260+0000 7f1e8a04e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e840fbaf0 0x7f1e840ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:00.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.260+0000 7f1e8a04e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e840fbaf0 0x7f1e840ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49288/0 (socket says 172.21.15.43:49288) 2023-12-08T20:29:00.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.260+0000 7f1e8a04e700 1 -- 172.21.15.43:0/3547940680 learned_addr learned my addr 172.21.15.43:0/3547940680 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:29:00.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.260+0000 7f1e8984d700 1 --2- 172.21.15.43:0/3547940680 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e840fcd00 0x7f1e840fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:00.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.260+0000 7f1e8a04e700 1 -- 172.21.15.43:0/3547940680 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e840fcd00 msgr2=0x7f1e840fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:00.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.260+0000 7f1e8a04e700 1 --2- 172.21.15.43:0/3547940680 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e840fcd00 0x7f1e840fe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:00.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.260+0000 7f1e8a04e700 1 -- 172.21.15.43:0/3547940680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e74005040 con 0x7f1e840fbaf0 2023-12-08T20:29:00.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.260+0000 7f1e8a04e700 1 --2- 172.21.15.43:0/3547940680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e840fbaf0 0x7f1e840ffbc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1e80000c00 tx=0x7f1e80009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:29:00.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.260+0000 7f1e7affd700 1 -- 172.21.15.43:0/3547940680 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e8000e030 con 0x7f1e840fbaf0 2023-12-08T20:29:00.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.261+0000 7f1e7affd700 1 -- 172.21.15.43:0/3547940680 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1e8001c400 con 0x7f1e840fbaf0 2023-12-08T20:29:00.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.261+0000 7f1e7affd700 1 -- 172.21.15.43:0/3547940680 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e80012600 con 0x7f1e840fbaf0 2023-12-08T20:29:00.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.261+0000 7f1e8c2b2700 1 -- 172.21.15.43:0/3547940680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e80005040 con 0x7f1e840fbaf0 2023-12-08T20:29:00.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.261+0000 7f1e8c2b2700 1 -- 172.21.15.43:0/3547940680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e840fed90 con 0x7f1e840fbaf0 2023-12-08T20:29:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.262+0000 7f1e7affd700 1 -- 172.21.15.43:0/3547940680 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f1e8001c570 con 0x7f1e840fbaf0 2023-12-08T20:29:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.262+0000 7f1e8c2b2700 1 -- 172.21.15.43:0/3547940680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8404bb80 con 0x7f1e840fbaf0 2023-12-08T20:29:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.263+0000 7f1e7affd700 1 --2- 172.21.15.43:0/3547940680 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f1e7006cc00 0x7f1e7006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.263+0000 7f1e7affd700 1 -- 172.21.15.43:0/3547940680 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f1e8008d930 con 0x7f1e840fbaf0 2023-12-08T20:29:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.263+0000 7f1e8984d700 1 --2- 172.21.15.43:0/3547940680 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f1e7006cc00 0x7f1e7006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.263+0000 7f1e8984d700 1 --2- 172.21.15.43:0/3547940680 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f1e7006cc00 0x7f1e7006f0b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1e74009fd0 tx=0x7f1e7400b040 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:29:00.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.268+0000 7f1e7affd700 1 -- 172.21.15.43:0/3547940680 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f1e8005b5d0 con 0x7f1e840fbaf0 2023-12-08T20:29:00.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.604+0000 7f1e8c2b2700 1 -- 172.21.15.43:0/3547940680 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e840662f0 con 0x7f1e7006cc00 2023-12-08T20:29:00.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.606+0000 7f1e7affd700 1 -- 172.21.15.43:0/3547940680 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f1e840662f0 con 0x7f1e7006cc00 2023-12-08T20:29:00.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.609+0000 7f1e8c2b2700 1 -- 172.21.15.43:0/3547940680 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f1e7006cc00 msgr2=0x7f1e7006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:00.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.609+0000 7f1e8c2b2700 1 --2- 172.21.15.43:0/3547940680 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f1e7006cc00 0x7f1e7006f0b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1e74009fd0 tx=0x7f1e7400b040 comp rx=0 tx=0).stop 2023-12-08T20:29:00.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.609+0000 7f1e8c2b2700 1 -- 172.21.15.43:0/3547940680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e840fbaf0 msgr2=0x7f1e840ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:00.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.609+0000 7f1e8c2b2700 1 --2- 172.21.15.43:0/3547940680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e840fbaf0 0x7f1e840ffbc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1e80000c00 tx=0x7f1e80009e30 comp rx=0 tx=0).stop 2023-12-08T20:29:00.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.610+0000 7f1e8c2b2700 1 -- 172.21.15.43:0/3547940680 shutdown_connections 2023-12-08T20:29:00.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.610+0000 7f1e8c2b2700 1 --2- 172.21.15.43:0/3547940680 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f1e7006cc00 0x7f1e7006f0b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:00.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.610+0000 7f1e8c2b2700 1 --2- 172.21.15.43:0/3547940680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e840fbaf0 0x7f1e840ffbc0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:00.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.610+0000 7f1e8c2b2700 1 --2- 172.21.15.43:0/3547940680 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e840fcd00 0x7f1e840fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:00.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.610+0000 7f1e8c2b2700 1 -- 172.21.15.43:0/3547940680 >> 172.21.15.43:0/3547940680 conn(0x7f1e840f71b0 msgr2=0x7f1e84065be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:29:00.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.610+0000 7f1e8c2b2700 1 -- 172.21.15.43:0/3547940680 shutdown_connections 2023-12-08T20:29:00.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.610+0000 7f1e8c2b2700 1 -- 172.21.15.43:0/3547940680 wait complete. 2023-12-08T20:29:00.721 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:00 smithi043 ceph-mon[111966]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:29:00.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.797+0000 7fcf42646700 1 -- 172.21.15.43:0/3002119258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf3c06e210 msgr2=0x7fcf3c06e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:00.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.797+0000 7fcf42646700 1 --2- 172.21.15.43:0/3002119258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf3c06e210 0x7fcf3c06e620 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009ce0 tx=0x7fcf34004d10 comp rx=0 tx=0).stop 2023-12-08T20:29:00.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.797+0000 7fcf42646700 1 -- 172.21.15.43:0/3002119258 shutdown_connections 2023-12-08T20:29:00.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.797+0000 7fcf42646700 1 --2- 172.21.15.43:0/3002119258 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf3c06eb60 0x7fcf3c108c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:00.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.797+0000 7fcf42646700 1 --2- 172.21.15.43:0/3002119258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf3c06e210 0x7fcf3c06e620 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:00.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.797+0000 7fcf42646700 1 -- 172.21.15.43:0/3002119258 >> 172.21.15.43:0/3002119258 conn(0x7fcf3c069b20 msgr2=0x7fcf3c06bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:29:00.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.798+0000 7fcf42646700 1 -- 172.21.15.43:0/3002119258 shutdown_connections 2023-12-08T20:29:00.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.798+0000 7fcf42646700 1 -- 172.21.15.43:0/3002119258 wait complete. 2023-12-08T20:29:00.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.799+0000 7fcf42646700 1 Processor -- start 2023-12-08T20:29:00.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.802+0000 7fcf42646700 1 -- start start 2023-12-08T20:29:00.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.802+0000 7fcf42646700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf3c06e210 0x7fcf3c11c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:00.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.802+0000 7fcf42646700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf3c06eb60 0x7fcf3c11c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:00.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.802+0000 7fcf42646700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c11d060 con 0x7fcf3c06eb60 2023-12-08T20:29:00.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.802+0000 7fcf42646700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c11d8a0 con 0x7fcf3c06e210 2023-12-08T20:29:00.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.803+0000 7fcf3bfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf3c06e210 0x7fcf3c11c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:00.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.803+0000 7fcf3bfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf3c06e210 0x7fcf3c11c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.43:58176/0 (socket says 172.21.15.43:58176) 2023-12-08T20:29:00.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.803+0000 7fcf3bfff700 1 -- 172.21.15.43:0/1354051956 learned_addr learned my addr 172.21.15.43:0/1354051956 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:29:00.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.803+0000 7fcf3b7fe700 1 --2- 172.21.15.43:0/1354051956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf3c06eb60 0x7fcf3c11c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:00.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.805+0000 7fcf3bfff700 1 -- 172.21.15.43:0/1354051956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf3c06eb60 msgr2=0x7fcf3c11c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:00.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.805+0000 7fcf3bfff700 1 --2- 172.21.15.43:0/1354051956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf3c06eb60 0x7fcf3c11c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:00.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.805+0000 7fcf3bfff700 1 -- 172.21.15.43:0/1354051956 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf34009940 con 0x7fcf3c06e210 2023-12-08T20:29:00.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.806+0000 7fcf3bfff700 1 --2- 172.21.15.43:0/1354051956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf3c06e210 0x7fcf3c11c490 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400b740 tx=0x7fcf34004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:29:00.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.806+0000 7fcf38ff9700 1 -- 172.21.15.43:0/1354051956 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf3400e050 con 0x7fcf3c06e210 2023-12-08T20:29:00.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.806+0000 7fcf38ff9700 1 -- 172.21.15.43:0/1354051956 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcf3401d8f0 con 0x7fcf3c06e210 2023-12-08T20:29:00.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.806+0000 7fcf42646700 1 -- 172.21.15.43:0/1354051956 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3c11db20 con 0x7fcf3c06e210 2023-12-08T20:29:00.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.806+0000 7fcf38ff9700 1 -- 172.21.15.43:0/1354051956 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf34012890 con 0x7fcf3c06e210 2023-12-08T20:29:00.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.806+0000 7fcf42646700 1 -- 172.21.15.43:0/1354051956 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3c11e060 con 0x7fcf3c06e210 2023-12-08T20:29:00.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.809+0000 7fcf38ff9700 1 -- 172.21.15.43:0/1354051956 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fcf34019040 con 0x7fcf3c06e210 2023-12-08T20:29:00.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.809+0000 7fcf38ff9700 1 --2- 172.21.15.43:0/1354051956 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fcf2406cc00 0x7fcf2406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:00.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.809+0000 7fcf42646700 1 -- 172.21.15.43:0/1354051956 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3c11dcb0 con 0x7fcf3c06e210 2023-12-08T20:29:00.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.809+0000 7fcf38ff9700 1 -- 172.21.15.43:0/1354051956 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fcf3408eb20 con 0x7fcf3c06e210 2023-12-08T20:29:00.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.812+0000 7fcf3b7fe700 1 --2- 172.21.15.43:0/1354051956 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fcf2406cc00 0x7fcf2406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:00.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.812+0000 7fcf3b7fe700 1 --2- 172.21.15.43:0/1354051956 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fcf2406cc00 0x7fcf2406f0b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c06f690 tx=0x7fcf2c000f90 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:29:00.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:00.817+0000 7fcf38ff9700 1 -- 172.21.15.43:0/1354051956 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fcf3c11dcb0 con 0x7fcf3c06e210 2023-12-08T20:29:01.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.128+0000 7fcf42646700 1 -- 172.21.15.43:0/1354051956 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf3c11dcb0 con 0x7fcf2406cc00 2023-12-08T20:29:01.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.143+0000 7fcf38ff9700 1 -- 172.21.15.43:0/1354051956 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fcf3c11dcb0 con 0x7fcf2406cc00 2023-12-08T20:29:01.144 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-08T20:29:01.145 INFO:teuthology.orchestra.run.smithi043.stdout:alertmanager.smithi043 smithi043 *:9093,9094 running (70s) 16s ago 7m 20.5M - 0.25.0 c8568f914cd2 ff18f4f8094d 2023-12-08T20:29:01.145 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi043 smithi043 running (7m) 16s ago 7m 7432k - 17.2.7-119-ge2143d99 f761b6e42225 f84d492b732c 2023-12-08T20:29:01.145 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi111 smithi111 running (6m) 0s ago 6m 7428k - 17.2.7-119-ge2143d99 f761b6e42225 88b53685ae54 2023-12-08T20:29:01.145 INFO:teuthology.orchestra.run.smithi043.stdout:grafana.smithi043 smithi043 *:3000 running (58s) 16s ago 6m 80.1M - 9.4.7 954c08fa6188 3682a97e102e 2023-12-08T20:29:01.145 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.akrjef smithi043 running (3m) 16s ago 3m 17.0M - 17.2.7-119-ge2143d99 f761b6e42225 1c0cb8d34ef8 2023-12-08T20:29:01.145 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.pjmszb smithi043 running (3m) 16s ago 3m 4244M - 17.2.7-119-ge2143d99 f761b6e42225 d7eee0c78093 2023-12-08T20:29:01.146 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.svpasm smithi111 running (3m) 0s ago 3m 14.9M - 17.2.7-119-ge2143d99 f761b6e42225 657d4d1cf4b2 2023-12-08T20:29:01.146 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.veeegc smithi111 running (3m) 0s ago 3m 2478M - 17.2.7-119-ge2143d99 f761b6e42225 31f794a388ab 2023-12-08T20:29:01.146 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi043.hqcdcm smithi043 *:8443,9283,8765 running (32s) 16s ago 8m 481M - 19.0.0-44-g9dcc13bb f28f2b94f153 14e91c1dac64 2023-12-08T20:29:01.146 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi111.mtcffu smithi111 *:8443,9283,8765 running (2s) 0s ago 6m 53.3M - 19.0.0-44-g9dcc13bb f28f2b94f153 56f4290c6db5 2023-12-08T20:29:01.146 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi043 smithi043 running (8m) 16s ago 8m 91.1M 2048M 17.2.7-119-ge2143d99 f761b6e42225 fe2a56effef3 2023-12-08T20:29:01.146 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi111 smithi111 running (6m) 0s ago 6m 64.8M 2048M 17.2.7-119-ge2143d99 f761b6e42225 2ae21cf3fa1e 2023-12-08T20:29:01.146 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi043 smithi043 *:9100 running (74s) 16s ago 7m 10.6M - 1.5.0 0da6a335fe13 e5ed8365bb26 2023-12-08T20:29:01.147 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi111 smithi111 *:9100 running (42s) 0s ago 6m 18.4M - 1.5.0 0da6a335fe13 62fadfecda38 2023-12-08T20:29:01.147 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (5m) 16s ago 5m 524M 1570M 17.2.7-119-ge2143d99 f761b6e42225 462eeaf62b2c 2023-12-08T20:29:01.147 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi043 running (5m) 16s ago 5m 596M 1570M 17.2.7-119-ge2143d99 f761b6e42225 dde419c88a89 2023-12-08T20:29:01.147 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi043 running (5m) 16s ago 5m 449M 1570M 17.2.7-119-ge2143d99 f761b6e42225 f7e812026ef5 2023-12-08T20:29:01.147 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi111 running (4m) 0s ago 4m 738M 2592M 17.2.7-119-ge2143d99 f761b6e42225 2a738d30441c 2023-12-08T20:29:01.147 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi111 running (4m) 0s ago 4m 563M 2592M 17.2.7-119-ge2143d99 f761b6e42225 38cdb6a88694 2023-12-08T20:29:01.147 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi111 running (4m) 0s ago 4m 689M 2592M 17.2.7-119-ge2143d99 f761b6e42225 59a9ce8c1141 2023-12-08T20:29:01.148 INFO:teuthology.orchestra.run.smithi043.stdout:prometheus.smithi043 smithi043 *:9095 starting - - - - 2023-12-08T20:29:01.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.145+0000 7fcf42646700 1 -- 172.21.15.43:0/1354051956 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fcf2406cc00 msgr2=0x7fcf2406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:01.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.145+0000 7fcf42646700 1 --2- 172.21.15.43:0/1354051956 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fcf2406cc00 0x7fcf2406f0b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c06f690 tx=0x7fcf2c000f90 comp rx=0 tx=0).stop 2023-12-08T20:29:01.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.145+0000 7fcf42646700 1 -- 172.21.15.43:0/1354051956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf3c06e210 msgr2=0x7fcf3c11c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:01.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.145+0000 7fcf42646700 1 --2- 172.21.15.43:0/1354051956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf3c06e210 0x7fcf3c11c490 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400b740 tx=0x7fcf34004d10 comp rx=0 tx=0).stop 2023-12-08T20:29:01.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.145+0000 7fcf42646700 1 -- 172.21.15.43:0/1354051956 shutdown_connections 2023-12-08T20:29:01.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.145+0000 7fcf42646700 1 --2- 172.21.15.43:0/1354051956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf3c06e210 0x7fcf3c11c490 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:01.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.145+0000 7fcf42646700 1 --2- 172.21.15.43:0/1354051956 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fcf2406cc00 0x7fcf2406f0b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:01.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.145+0000 7fcf42646700 1 --2- 172.21.15.43:0/1354051956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf3c06eb60 0x7fcf3c11c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:01.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.145+0000 7fcf42646700 1 -- 172.21.15.43:0/1354051956 >> 172.21.15.43:0/1354051956 conn(0x7fcf3c069b20 msgr2=0x7fcf3c1074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:29:01.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.145+0000 7fcf42646700 1 -- 172.21.15.43:0/1354051956 shutdown_connections 2023-12-08T20:29:01.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.145+0000 7fcf42646700 1 -- 172.21.15.43:0/1354051956 wait complete. 2023-12-08T20:29:01.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:00 smithi111 ceph-mon[121341]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:29:01.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.296+0000 7f0eed006700 1 -- 172.21.15.43:0/298283253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ee80fbaf0 msgr2=0x7f0ee80fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:01.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.296+0000 7f0eed006700 1 --2- 172.21.15.43:0/298283253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ee80fbaf0 0x7f0ee80fbf00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8004940 tx=0x7f0ed8009e30 comp rx=0 tx=0).stop 2023-12-08T20:29:01.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.296+0000 7f0eed006700 1 -- 172.21.15.43:0/298283253 shutdown_connections 2023-12-08T20:29:01.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.296+0000 7f0eed006700 1 --2- 172.21.15.43:0/298283253 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ee80fcd00 0x7f0ee80fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:01.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.296+0000 7f0eed006700 1 --2- 172.21.15.43:0/298283253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ee80fbaf0 0x7f0ee80fbf00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:01.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.296+0000 7f0eed006700 1 -- 172.21.15.43:0/298283253 >> 172.21.15.43:0/298283253 conn(0x7f0ee80f71b0 msgr2=0x7f0ee80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:29:01.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.296+0000 7f0eed006700 1 -- 172.21.15.43:0/298283253 shutdown_connections 2023-12-08T20:29:01.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.296+0000 7f0eed006700 1 -- 172.21.15.43:0/298283253 wait complete. 2023-12-08T20:29:01.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.297+0000 7f0eed006700 1 Processor -- start 2023-12-08T20:29:01.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.297+0000 7f0eed006700 1 -- start start 2023-12-08T20:29:01.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.297+0000 7f0eed006700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ee80fbaf0 0x7f0ee810b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:01.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.297+0000 7f0eed006700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ee80fcd00 0x7f0ee810b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:01.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.297+0000 7f0eed006700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee810bdf0 con 0x7f0ee80fcd00 2023-12-08T20:29:01.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.297+0000 7f0eed006700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee810c690 con 0x7f0ee80fbaf0 2023-12-08T20:29:01.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.297+0000 7f0ee659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ee80fcd00 0x7f0ee810b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:01.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.297+0000 7f0ee6d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ee80fbaf0 0x7f0ee810b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:01.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.297+0000 7f0ee6d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ee80fbaf0 0x7f0ee810b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.43:58200/0 (socket says 172.21.15.43:58200) 2023-12-08T20:29:01.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.297+0000 7f0ee659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ee80fcd00 0x7f0ee810b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42446/0 (socket says 172.21.15.43:42446) 2023-12-08T20:29:01.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.297+0000 7f0ee6d9d700 1 -- 172.21.15.43:0/331502294 learned_addr learned my addr 172.21.15.43:0/331502294 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:29:01.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.298+0000 7f0ee6d9d700 1 -- 172.21.15.43:0/331502294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ee80fcd00 msgr2=0x7f0ee810b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:01.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.298+0000 7f0ee6d9d700 1 --2- 172.21.15.43:0/331502294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ee80fcd00 0x7f0ee810b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:01.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.298+0000 7f0ee6d9d700 1 -- 172.21.15.43:0/331502294 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed8005040 con 0x7f0ee80fbaf0 2023-12-08T20:29:01.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.298+0000 7f0ee6d9d700 1 --2- 172.21.15.43:0/331502294 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ee80fbaf0 0x7f0ee810b260 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8009fd0 tx=0x7f0ed8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:29:01.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.298+0000 7f0ecf7fe700 1 -- 172.21.15.43:0/331502294 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ed8021070 con 0x7f0ee80fbaf0 2023-12-08T20:29:01.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.298+0000 7f0ecf7fe700 1 -- 172.21.15.43:0/331502294 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ed801c400 con 0x7f0ee80fbaf0 2023-12-08T20:29:01.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.298+0000 7f0ecf7fe700 1 -- 172.21.15.43:0/331502294 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ed800e070 con 0x7f0ee80fbaf0 2023-12-08T20:29:01.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.299+0000 7f0eed006700 1 -- 172.21.15.43:0/331502294 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee810c890 con 0x7f0ee80fbaf0 2023-12-08T20:29:01.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.299+0000 7f0eed006700 1 -- 172.21.15.43:0/331502294 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee810cd40 con 0x7f0ee80fbaf0 2023-12-08T20:29:01.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.300+0000 7f0eed006700 1 -- 172.21.15.43:0/331502294 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee804bb80 con 0x7f0ee80fbaf0 2023-12-08T20:29:01.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.300+0000 7f0ecf7fe700 1 -- 172.21.15.43:0/331502294 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f0ed8013a50 con 0x7f0ee80fbaf0 2023-12-08T20:29:01.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.301+0000 7f0ecf7fe700 1 --2- 172.21.15.43:0/331502294 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f0ed006cc00 0x7f0ed006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:01.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.301+0000 7f0ecf7fe700 1 -- 172.21.15.43:0/331502294 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f0ed808d160 con 0x7f0ee80fbaf0 2023-12-08T20:29:01.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.302+0000 7f0ee659c700 1 --2- 172.21.15.43:0/331502294 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f0ed006cc00 0x7f0ed006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:01.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.302+0000 7f0ee659c700 1 --2- 172.21.15.43:0/331502294 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f0ed006cc00 0x7f0ed006f0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009b80 tx=0x7f0edc00b040 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:29:01.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.306+0000 7f0ecf7fe700 1 -- 172.21.15.43:0/331502294 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0ed8057350 con 0x7f0ee80fbaf0 2023-12-08T20:29:01.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.722+0000 7f0eed006700 1 -- 172.21.15.43:0/331502294 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0ee810d070 con 0x7f0ee80fbaf0 2023-12-08T20:29:01.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.723+0000 7f0ecf7fe700 1 -- 172.21.15.43:0/331502294 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f0ed805a970 con 0x7f0ee80fbaf0 2023-12-08T20:29:01.725 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:29:01.725 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": { 2023-12-08T20:29:01.725 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2 2023-12-08T20:29:01.725 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:29:01.725 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": { 2023-12-08T20:29:01.725 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:29:01.725 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:29:01.725 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": { 2023-12-08T20:29:01.726 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 6 2023-12-08T20:29:01.726 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:29:01.726 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2023-12-08T20:29:01.726 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-08T20:29:01.726 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:29:01.726 INFO:teuthology.orchestra.run.smithi043.stdout: "overall": { 2023-12-08T20:29:01.726 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 12, 2023-12-08T20:29:01.726 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:29:01.726 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-12-08T20:29:01.726 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:29:01.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.725+0000 7f0eed006700 1 -- 172.21.15.43:0/331502294 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f0ed006cc00 msgr2=0x7f0ed006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:01.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.725+0000 7f0eed006700 1 --2- 172.21.15.43:0/331502294 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f0ed006cc00 0x7f0ed006f0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009b80 tx=0x7f0edc00b040 comp rx=0 tx=0).stop 2023-12-08T20:29:01.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.725+0000 7f0eed006700 1 -- 172.21.15.43:0/331502294 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ee80fbaf0 msgr2=0x7f0ee810b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:01.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.725+0000 7f0eed006700 1 --2- 172.21.15.43:0/331502294 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ee80fbaf0 0x7f0ee810b260 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8009fd0 tx=0x7f0ed8009e30 comp rx=0 tx=0).stop 2023-12-08T20:29:01.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.725+0000 7f0eed006700 1 -- 172.21.15.43:0/331502294 shutdown_connections 2023-12-08T20:29:01.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.725+0000 7f0eed006700 1 --2- 172.21.15.43:0/331502294 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ee80fbaf0 0x7f0ee810b260 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:01.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.725+0000 7f0eed006700 1 --2- 172.21.15.43:0/331502294 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f0ed006cc00 0x7f0ed006f0b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:01.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.725+0000 7f0eed006700 1 --2- 172.21.15.43:0/331502294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ee80fcd00 0x7f0ee810b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:01.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.725+0000 7f0eed006700 1 -- 172.21.15.43:0/331502294 >> 172.21.15.43:0/331502294 conn(0x7f0ee80f71b0 msgr2=0x7f0ee80fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:29:01.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.725+0000 7f0eed006700 1 -- 172.21.15.43:0/331502294 shutdown_connections 2023-12-08T20:29:01.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.726+0000 7f0eed006700 1 -- 172.21.15.43:0/331502294 wait complete. 2023-12-08T20:29:01.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.914+0000 7f45ddb36700 1 -- 172.21.15.43:0/2107647492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d8107560 msgr2=0x7f45d8109940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:01.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.914+0000 7f45ddb36700 1 --2- 172.21.15.43:0/2107647492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d8107560 0x7f45d8109940 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f45c8004880 tx=0x7f45c8009e30 comp rx=0 tx=0).stop 2023-12-08T20:29:01.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.914+0000 7f45ddb36700 1 -- 172.21.15.43:0/2107647492 shutdown_connections 2023-12-08T20:29:01.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.914+0000 7f45ddb36700 1 --2- 172.21.15.43:0/2107647492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d8107560 0x7f45d8109940 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:01.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.914+0000 7f45ddb36700 1 --2- 172.21.15.43:0/2107647492 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45d8104c40 0x7f45d8107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:01.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.914+0000 7f45ddb36700 1 -- 172.21.15.43:0/2107647492 >> 172.21.15.43:0/2107647492 conn(0x7f45d8069b20 msgr2=0x7f45d806bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:29:01.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.914+0000 7f45ddb36700 1 -- 172.21.15.43:0/2107647492 shutdown_connections 2023-12-08T20:29:01.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.914+0000 7f45ddb36700 1 -- 172.21.15.43:0/2107647492 wait complete. 2023-12-08T20:29:01.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.915+0000 7f45ddb36700 1 Processor -- start 2023-12-08T20:29:01.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.915+0000 7f45ddb36700 1 -- start start 2023-12-08T20:29:01.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.916+0000 7f45ddb36700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45d8104c40 0x7f45d81163a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:01.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.916+0000 7f45ddb36700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d8107560 0x7f45d81168e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:01.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.916+0000 7f45ddb36700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d8116f30 con 0x7f45d8107560 2023-12-08T20:29:01.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.916+0000 7f45ddb36700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d8114ed0 con 0x7f45d8104c40 2023-12-08T20:29:01.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.916+0000 7f45d6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d8107560 0x7f45d81168e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:01.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.916+0000 7f45d6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d8107560 0x7f45d81168e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42456/0 (socket says 172.21.15.43:42456) 2023-12-08T20:29:01.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.916+0000 7f45d6ffd700 1 -- 172.21.15.43:0/2146190330 learned_addr learned my addr 172.21.15.43:0/2146190330 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:29:01.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.916+0000 7f45d6ffd700 1 -- 172.21.15.43:0/2146190330 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45d8104c40 msgr2=0x7f45d81163a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-08T20:29:01.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.916+0000 7f45d6ffd700 1 --2- 172.21.15.43:0/2146190330 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45d8104c40 0x7f45d81163a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:01.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.916+0000 7f45d6ffd700 1 -- 172.21.15.43:0/2146190330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c8005040 con 0x7f45d8107560 2023-12-08T20:29:01.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.917+0000 7f45d6ffd700 1 --2- 172.21.15.43:0/2146190330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d8107560 0x7f45d81168e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f45c8000c00 tx=0x7f45c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:29:01.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.917+0000 7f45cffff700 1 -- 172.21.15.43:0/2146190330 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45c800e040 con 0x7f45d8107560 2023-12-08T20:29:01.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.917+0000 7f45cffff700 1 -- 172.21.15.43:0/2146190330 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f45c8014d10 con 0x7f45d8107560 2023-12-08T20:29:01.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.917+0000 7f45cffff700 1 -- 172.21.15.43:0/2146190330 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45c8012600 con 0x7f45d8107560 2023-12-08T20:29:01.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.917+0000 7f45ddb36700 1 -- 172.21.15.43:0/2146190330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d8115150 con 0x7f45d8107560 2023-12-08T20:29:01.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.918+0000 7f45ddb36700 1 -- 172.21.15.43:0/2146190330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d8115630 con 0x7f45d8107560 2023-12-08T20:29:01.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.920+0000 7f45ddb36700 1 -- 172.21.15.43:0/2146190330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d804bb80 con 0x7f45d8107560 2023-12-08T20:29:01.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.920+0000 7f45cffff700 1 -- 172.21.15.43:0/2146190330 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f45c801ca30 con 0x7f45d8107560 2023-12-08T20:29:01.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.920+0000 7f45cffff700 1 --2- 172.21.15.43:0/2146190330 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f45c406ccc0 0x7f45c406f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:01.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.921+0000 7f45d77fe700 1 --2- 172.21.15.43:0/2146190330 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f45c406ccc0 0x7f45c406f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:01.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.922+0000 7f45d77fe700 1 --2- 172.21.15.43:0/2146190330 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f45c406ccc0 0x7f45c406f170 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f45c0009fd0 tx=0x7f45c0004320 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:29:01.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.923+0000 7f45cffff700 1 -- 172.21.15.43:0/2146190330 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f45c805b160 con 0x7f45d8107560 2023-12-08T20:29:01.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:01.928+0000 7f45cffff700 1 -- 172.21.15.43:0/2146190330 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f45c8092060 con 0x7f45d8107560 2023-12-08T20:29:01.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:01 smithi111 ceph-mon[121341]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:29:01.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:01 smithi111 ceph-mon[121341]: pgmap v13: 65 pgs: 65 active+clean; 297 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.5 MiB/s wr, 302 op/s 2023-12-08T20:29:01.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:01 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:01.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:01 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:01.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:01 smithi111 ceph-mon[121341]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:29:01.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:01 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:01.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:01 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:01.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:01 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/331502294' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:02.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:01 smithi043 ceph-mon[111966]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:29:02.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:01 smithi043 ceph-mon[111966]: pgmap v13: 65 pgs: 65 active+clean; 297 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.5 MiB/s wr, 302 op/s 2023-12-08T20:29:02.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:01 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:02.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:01 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:02.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:01 smithi043 ceph-mon[111966]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:29:02.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:01 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:02.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:01 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:02.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:01 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/331502294' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:02.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:02.244+0000 7f45ddb36700 1 -- 172.21.15.43:0/2146190330 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f45d8115c80 con 0x7f45c406ccc0 2023-12-08T20:29:02.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:02.245+0000 7f45cffff700 1 -- 172.21.15.43:0/2146190330 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f45d8115c80 con 0x7f45c406ccc0 2023-12-08T20:29:02.246 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:29:02.246 INFO:teuthology.orchestra.run.smithi043.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-08T20:29:02.246 INFO:teuthology.orchestra.run.smithi043.stdout: "in_progress": true, 2023-12-08T20:29:02.246 INFO:teuthology.orchestra.run.smithi043.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-08T20:29:02.246 INFO:teuthology.orchestra.run.smithi043.stdout: "services_complete": [ 2023-12-08T20:29:02.246 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr" 2023-12-08T20:29:02.246 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2023-12-08T20:29:02.247 INFO:teuthology.orchestra.run.smithi043.stdout: "progress": "2/2 daemons upgraded", 2023-12-08T20:29:02.247 INFO:teuthology.orchestra.run.smithi043.stdout: "message": "Currently upgrading mgr daemons", 2023-12-08T20:29:02.247 INFO:teuthology.orchestra.run.smithi043.stdout: "is_paused": false 2023-12-08T20:29:02.247 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:29:02.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:02.247+0000 7f45ddb36700 1 -- 172.21.15.43:0/2146190330 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f45c406ccc0 msgr2=0x7f45c406f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:02.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:02.247+0000 7f45ddb36700 1 --2- 172.21.15.43:0/2146190330 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f45c406ccc0 0x7f45c406f170 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f45c0009fd0 tx=0x7f45c0004320 comp rx=0 tx=0).stop 2023-12-08T20:29:02.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:02.247+0000 7f45ddb36700 1 -- 172.21.15.43:0/2146190330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d8107560 msgr2=0x7f45d81168e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:02.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:02.247+0000 7f45ddb36700 1 --2- 172.21.15.43:0/2146190330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d8107560 0x7f45d81168e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f45c8000c00 tx=0x7f45c8009e30 comp rx=0 tx=0).stop 2023-12-08T20:29:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:02.247+0000 7f45ddb36700 1 -- 172.21.15.43:0/2146190330 shutdown_connections 2023-12-08T20:29:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:02.247+0000 7f45ddb36700 1 --2- 172.21.15.43:0/2146190330 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45d8104c40 0x7f45d81163a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:02.247+0000 7f45ddb36700 1 --2- 172.21.15.43:0/2146190330 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f45c406ccc0 0x7f45c406f170 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:02.247+0000 7f45ddb36700 1 --2- 172.21.15.43:0/2146190330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d8107560 0x7f45d81168e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:02.247+0000 7f45ddb36700 1 -- 172.21.15.43:0/2146190330 >> 172.21.15.43:0/2146190330 conn(0x7f45d8069b20 msgr2=0x7f45d806bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:29:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:02.247+0000 7f45ddb36700 1 -- 172.21.15.43:0/2146190330 shutdown_connections 2023-12-08T20:29:02.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:02.247+0000 7f45ddb36700 1 -- 172.21.15.43:0/2146190330 wait complete. 2023-12-08T20:29:04.007 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:03 smithi111 ceph-mon[121341]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:29:04.008 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:03 smithi111 ceph-mon[121341]: pgmap v14: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 2.1 MiB/s wr, 450 op/s 2023-12-08T20:29:04.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:03 smithi043 ceph-mon[111966]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:29:04.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:03 smithi043 ceph-mon[111966]: pgmap v14: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 2.1 MiB/s wr, 450 op/s 2023-12-08T20:29:05.103 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.103 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.103 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.103 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.103 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:29:05.103 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:29:05.103 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.103 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:29:05.103 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:05.104 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.104 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi043.hqcdcm"}]: dispatch 2023-12-08T20:29:05.104 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi043.hqcdcm"}]': finished 2023-12-08T20:29:05.104 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi111.mtcffu"}]: dispatch 2023-12-08T20:29:05.104 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi111.mtcffu"}]': finished 2023-12-08T20:29:05.104 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:05.104 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.104 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:05.104 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.104 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:05.104 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.104 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:05.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:05.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:05.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:05.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:04 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.197 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.198 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.198 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.198 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.198 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:29:05.198 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:29:05.198 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.199 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:29:05.199 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:05.199 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.199 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi043.hqcdcm"}]: dispatch 2023-12-08T20:29:05.199 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi043.hqcdcm"}]': finished 2023-12-08T20:29:05.199 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi111.mtcffu"}]: dispatch 2023-12-08T20:29:05.199 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi111.mtcffu"}]': finished 2023-12-08T20:29:05.199 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:05.199 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.199 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:05.199 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.200 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:05.200 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.200 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:05.200 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.200 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:05.200 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.200 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:05.200 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:05.201 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:05.201 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:04 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:06.044 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:05 smithi111 ceph-mon[121341]: Upgrade: Setting container_image for all mgr 2023-12-08T20:29:06.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:05 smithi111 ceph-mon[121341]: Upgrade: Setting container_image for all rgw 2023-12-08T20:29:06.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:05 smithi111 ceph-mon[121341]: Upgrade: Setting container_image for all rbd-mirror 2023-12-08T20:29:06.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:05 smithi111 ceph-mon[121341]: Upgrade: Setting container_image for all cephfs-mirror 2023-12-08T20:29:06.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:05 smithi111 ceph-mon[121341]: pgmap v15: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 313 op/s 2023-12-08T20:29:06.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:05 smithi111 ceph-mon[121341]: Upgrade: Setting container_image for all ceph-exporter 2023-12-08T20:29:06.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:05 smithi111 ceph-mon[121341]: Upgrade: Setting container_image for all iscsi 2023-12-08T20:29:06.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:05 smithi111 ceph-mon[121341]: Upgrade: Setting container_image for all nfs 2023-12-08T20:29:06.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:05 smithi111 ceph-mon[121341]: Upgrade: Setting container_image for all nvmeof 2023-12-08T20:29:06.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:05 smithi043 ceph-mon[111966]: Upgrade: Setting container_image for all mgr 2023-12-08T20:29:06.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:05 smithi043 ceph-mon[111966]: Upgrade: Setting container_image for all rgw 2023-12-08T20:29:06.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:05 smithi043 ceph-mon[111966]: Upgrade: Setting container_image for all rbd-mirror 2023-12-08T20:29:06.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:05 smithi043 ceph-mon[111966]: Upgrade: Setting container_image for all cephfs-mirror 2023-12-08T20:29:06.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:05 smithi043 ceph-mon[111966]: pgmap v15: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 313 op/s 2023-12-08T20:29:06.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:05 smithi043 ceph-mon[111966]: Upgrade: Setting container_image for all ceph-exporter 2023-12-08T20:29:06.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:05 smithi043 ceph-mon[111966]: Upgrade: Setting container_image for all iscsi 2023-12-08T20:29:06.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:05 smithi043 ceph-mon[111966]: Upgrade: Setting container_image for all nfs 2023-12-08T20:29:06.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:05 smithi043 ceph-mon[111966]: Upgrade: Setting container_image for all nvmeof 2023-12-08T20:29:07.105 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:06 smithi043 ceph-mon[111966]: Upgrade: Updating node-exporter.smithi043 (1/2) 2023-12-08T20:29:07.105 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:06 smithi043 ceph-mon[111966]: Deploying daemon node-exporter.smithi043 on smithi043 2023-12-08T20:29:07.105 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:06 smithi043 ceph-mon[111966]: Standby manager daemon smithi111.mtcffu restarted 2023-12-08T20:29:07.105 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:06 smithi043 ceph-mon[111966]: Standby manager daemon smithi111.mtcffu started 2023-12-08T20:29:07.106 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:06 smithi043 ceph-mon[111966]: from='mgr.? 172.21.15.111:0/1113783347' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/crt"}]: dispatch 2023-12-08T20:29:07.106 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:06 smithi043 ceph-mon[111966]: from='mgr.? 172.21.15.111:0/1113783347' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-08T20:29:07.106 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:06 smithi043 ceph-mon[111966]: from='mgr.? 172.21.15.111:0/1113783347' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/key"}]: dispatch 2023-12-08T20:29:07.106 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:06 smithi043 ceph-mon[111966]: from='mgr.? 172.21.15.111:0/1113783347' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-08T20:29:07.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:06 smithi111 ceph-mon[121341]: Upgrade: Updating node-exporter.smithi043 (1/2) 2023-12-08T20:29:07.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:06 smithi111 ceph-mon[121341]: Deploying daemon node-exporter.smithi043 on smithi043 2023-12-08T20:29:07.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:06 smithi111 ceph-mon[121341]: Standby manager daemon smithi111.mtcffu restarted 2023-12-08T20:29:07.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:06 smithi111 ceph-mon[121341]: Standby manager daemon smithi111.mtcffu started 2023-12-08T20:29:07.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:06 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.111:0/1113783347' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/crt"}]: dispatch 2023-12-08T20:29:07.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:06 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.111:0/1113783347' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-08T20:29:07.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:06 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.111:0/1113783347' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/key"}]: dispatch 2023-12-08T20:29:07.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:06 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.111:0/1113783347' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-08T20:29:08.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:07 smithi111 ceph-mon[121341]: pgmap v16: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.6 MiB/s wr, 367 op/s 2023-12-08T20:29:08.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:07 smithi111 ceph-mon[121341]: mgrmap e32: smithi043.hqcdcm(active, since 26s), standbys: smithi111.mtcffu 2023-12-08T20:29:08.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:07 smithi043 ceph-mon[111966]: pgmap v16: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.6 MiB/s wr, 367 op/s 2023-12-08T20:29:08.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:07 smithi043 ceph-mon[111966]: mgrmap e32: smithi043.hqcdcm(active, since 26s), standbys: smithi111.mtcffu 2023-12-08T20:29:09.113 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:09 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:09.113 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:09 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:09.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:09 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:09.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:09 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:10.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:10 smithi111 ceph-mon[121341]: pgmap v17: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.9 MiB/s wr, 393 op/s 2023-12-08T20:29:10.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:10 smithi111 ceph-mon[121341]: Upgrade: Updating node-exporter.smithi111 (2/2) 2023-12-08T20:29:10.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:10 smithi111 ceph-mon[121341]: Deploying daemon node-exporter.smithi111 on smithi111 2023-12-08T20:29:10.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:10 smithi043 ceph-mon[111966]: pgmap v17: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.9 MiB/s wr, 393 op/s 2023-12-08T20:29:10.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:10 smithi043 ceph-mon[111966]: Upgrade: Updating node-exporter.smithi111 (2/2) 2023-12-08T20:29:10.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:10 smithi043 ceph-mon[111966]: Deploying daemon node-exporter.smithi111 on smithi111 2023-12-08T20:29:11.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:11 smithi111 ceph-mon[121341]: pgmap v18: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.4 MiB/s wr, 279 op/s 2023-12-08T20:29:11.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:11 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:11.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:11 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:11.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:11 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:29:11.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:11 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:29:12.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:11 smithi043 ceph-mon[111966]: pgmap v18: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.4 MiB/s wr, 279 op/s 2023-12-08T20:29:12.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:11 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:12.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:11 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:12.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:11 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:29:12.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:11 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:29:14.256 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:14 smithi043 ceph-mon[111966]: pgmap v19: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.2 MiB/s wr, 442 op/s 2023-12-08T20:29:14.256 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:14 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:14.256 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:14 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:14.256 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:14 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:14.256 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:14 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:14.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:14 smithi111 ceph-mon[121341]: pgmap v19: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.2 MiB/s wr, 442 op/s 2023-12-08T20:29:14.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:14 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:14.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:14 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:14.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:14 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:14.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:14 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:16.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:15 smithi111 ceph-mon[121341]: pgmap v20: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.6 MiB/s wr, 293 op/s 2023-12-08T20:29:16.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:15 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:16.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:15 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:16.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:15 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:16.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:15 smithi043 ceph-mon[111966]: pgmap v20: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.6 MiB/s wr, 293 op/s 2023-12-08T20:29:16.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:15 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:16.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:15 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:16.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:15 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:16.933 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:16 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:16.933 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:16 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:16.933 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:16 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:17.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:16 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:17.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:16 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:17.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:16 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:18.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:17 smithi111 ceph-mon[121341]: pgmap v21: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.7 MiB/s wr, 340 op/s 2023-12-08T20:29:18.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:17 smithi043 ceph-mon[111966]: pgmap v21: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.7 MiB/s wr, 340 op/s 2023-12-08T20:29:20.199 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:19 smithi043 ceph-mon[111966]: pgmap v22: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 2.1 MiB/s wr, 393 op/s 2023-12-08T20:29:20.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:19 smithi111 ceph-mon[121341]: pgmap v22: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 2.1 MiB/s wr, 393 op/s 2023-12-08T20:29:21.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:21 smithi043 ceph-mon[111966]: pgmap v23: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.6 MiB/s wr, 317 op/s 2023-12-08T20:29:21.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:21 smithi111 ceph-mon[121341]: pgmap v23: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.6 MiB/s wr, 317 op/s 2023-12-08T20:29:23.194 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:23 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:23.194 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:23 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:23.194 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:23 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:29:23.194 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:23 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:29:23.194 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:23 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:23.194 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:23 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:29:23.194 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:23 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:23.194 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:23 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:23.194 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:23 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:23.194 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:23 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:23.194 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:23 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:23.195 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:23 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:23.195 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:23 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:23.195 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:23 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:23.195 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:23 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:23.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:23 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:23.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:23 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:23.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:23 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:29:23.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:23 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:29:23.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:23 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:23.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:23 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:29:23.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:23 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:23.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:23 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:23.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:23 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:23.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:23 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:23.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:23 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:23.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:23 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:23.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:23 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:23.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:23 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:23.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:23 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:24.446 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:24 smithi043 ceph-mon[111966]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 2.7 MiB/s wr, 510 op/s 2023-12-08T20:29:24.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:24 smithi111 ceph-mon[121341]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 2.7 MiB/s wr, 510 op/s 2023-12-08T20:29:25.459 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:25 smithi043 ceph-mon[111966]: Upgrade: Updating prometheus.smithi043 2023-12-08T20:29:25.459 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:25 smithi043 ceph-mon[111966]: Deploying daemon prometheus.smithi043 on smithi043 2023-12-08T20:29:25.466 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:25 smithi111 ceph-mon[121341]: Upgrade: Updating prometheus.smithi043 2023-12-08T20:29:25.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:25 smithi111 ceph-mon[121341]: Deploying daemon prometheus.smithi043 on smithi043 2023-12-08T20:29:26.365 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:26 smithi043 ceph-mon[111966]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.9 MiB/s wr, 347 op/s 2023-12-08T20:29:26.366 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:26 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:29:26.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:26 smithi111 ceph-mon[121341]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.9 MiB/s wr, 347 op/s 2023-12-08T20:29:26.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:26 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:29:28.420 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:28 smithi043 ceph-mon[111966]: pgmap v26: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 2.3 MiB/s wr, 484 op/s 2023-12-08T20:29:28.420 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:28 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:28.420 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:28 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:28.420 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:28 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:29:28.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:28 smithi111 ceph-mon[121341]: pgmap v26: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 2.3 MiB/s wr, 484 op/s 2023-12-08T20:29:28.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:28 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:28.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:28 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:28.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:28 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:29:30.394 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:30 smithi043 ceph-mon[111966]: pgmap v27: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 2.5 MiB/s wr, 491 op/s 2023-12-08T20:29:30.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:30 smithi111 ceph-mon[121341]: pgmap v27: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 2.5 MiB/s wr, 491 op/s 2023-12-08T20:29:31.457 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2023-12-08T20:29:31.457 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-12-08T20:29:31.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:31 smithi111 ceph-mon[121341]: pgmap v28: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.8 MiB/s wr, 384 op/s 2023-12-08T20:29:31.733 DEBUG:teuthology.parallel:result is None 2023-12-08T20:29:31.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:31 smithi043 ceph-mon[111966]: pgmap v28: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.8 MiB/s wr, 384 op/s 2023-12-08T20:29:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.377+0000 7fda40ced700 1 -- 172.21.15.43:0/2279632366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda3c100050 msgr2=0x7fda3c102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.377+0000 7fda40ced700 1 --2- 172.21.15.43:0/2279632366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda3c100050 0x7fda3c102430 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fda30004940 tx=0x7fda30009e30 comp rx=0 tx=0).stop 2023-12-08T20:29:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.377+0000 7fda40ced700 1 -- 172.21.15.43:0/2279632366 shutdown_connections 2023-12-08T20:29:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.377+0000 7fda40ced700 1 --2- 172.21.15.43:0/2279632366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda3c100050 0x7fda3c102430 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.377+0000 7fda40ced700 1 --2- 172.21.15.43:0/2279632366 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda3c0fd730 0x7fda3c0ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.377+0000 7fda40ced700 1 -- 172.21.15.43:0/2279632366 >> 172.21.15.43:0/2279632366 conn(0x7fda3c0f71b0 msgr2=0x7fda3c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:29:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.378+0000 7fda40ced700 1 -- 172.21.15.43:0/2279632366 shutdown_connections 2023-12-08T20:29:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.378+0000 7fda40ced700 1 -- 172.21.15.43:0/2279632366 wait complete. 2023-12-08T20:29:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.378+0000 7fda40ced700 1 Processor -- start 2023-12-08T20:29:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.378+0000 7fda40ced700 1 -- start start 2023-12-08T20:29:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.378+0000 7fda40ced700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda3c0fd730 0x7fda3c10d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.378+0000 7fda40ced700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda3c100050 0x7fda3c10d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:32.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.378+0000 7fda40ced700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c10dfd0 con 0x7fda3c0fd730 2023-12-08T20:29:32.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.378+0000 7fda40ced700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c10e870 con 0x7fda3c100050 2023-12-08T20:29:32.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.379+0000 7fda3a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda3c0fd730 0x7fda3c10d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:32.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.379+0000 7fda3a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda3c0fd730 0x7fda3c10d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39976/0 (socket says 172.21.15.43:39976) 2023-12-08T20:29:32.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.379+0000 7fda3a59c700 1 -- 172.21.15.43:0/184677937 learned_addr learned my addr 172.21.15.43:0/184677937 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:29:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.379+0000 7fda39d9b700 1 --2- 172.21.15.43:0/184677937 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda3c100050 0x7fda3c10d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.379+0000 7fda3a59c700 1 -- 172.21.15.43:0/184677937 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda3c100050 msgr2=0x7fda3c10d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.379+0000 7fda3a59c700 1 --2- 172.21.15.43:0/184677937 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda3c100050 0x7fda3c10d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.379+0000 7fda3a59c700 1 -- 172.21.15.43:0/184677937 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda30005040 con 0x7fda3c0fd730 2023-12-08T20:29:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.379+0000 7fda39d9b700 1 --2- 172.21.15.43:0/184677937 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda3c100050 0x7fda3c10d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T20:29:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.379+0000 7fda3a59c700 1 --2- 172.21.15.43:0/184677937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda3c0fd730 0x7fda3c10d490 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fda2c002a80 tx=0x7fda2c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:29:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.379+0000 7fda2affd700 1 -- 172.21.15.43:0/184677937 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda2c007cc0 con 0x7fda3c0fd730 2023-12-08T20:29:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.379+0000 7fda2affd700 1 -- 172.21.15.43:0/184677937 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda2c00f040 con 0x7fda3c0fd730 2023-12-08T20:29:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.379+0000 7fda2affd700 1 -- 172.21.15.43:0/184677937 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda2c00da60 con 0x7fda3c0fd730 2023-12-08T20:29:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.379+0000 7fda40ced700 1 -- 172.21.15.43:0/184677937 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3c10eb50 con 0x7fda3c0fd730 2023-12-08T20:29:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.379+0000 7fda40ced700 1 -- 172.21.15.43:0/184677937 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda3c10f090 con 0x7fda3c0fd730 2023-12-08T20:29:32.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.381+0000 7fda40ced700 1 -- 172.21.15.43:0/184677937 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda3c04bb80 con 0x7fda3c0fd730 2023-12-08T20:29:32.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.381+0000 7fda2affd700 1 -- 172.21.15.43:0/184677937 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 32) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fda2c00dbc0 con 0x7fda3c0fd730 2023-12-08T20:29:32.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.382+0000 7fda2affd700 1 --2- 172.21.15.43:0/184677937 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fda2406cc00 0x7fda2406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:32.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.382+0000 7fda2affd700 1 -- 172.21.15.43:0/184677937 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fda2c08be40 con 0x7fda3c0fd730 2023-12-08T20:29:32.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.382+0000 7fda39d9b700 1 --2- 172.21.15.43:0/184677937 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fda2406cc00 0x7fda2406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:32.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.383+0000 7fda39d9b700 1 --2- 172.21.15.43:0/184677937 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fda2406cc00 0x7fda2406f0b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fda30004890 tx=0x7fda30009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:29:32.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.387+0000 7fda2affd700 1 -- 172.21.15.43:0/184677937 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fda2c0599c0 con 0x7fda3c0fd730 2023-12-08T20:29:32.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.643+0000 7fda40ced700 1 -- 172.21.15.43:0/184677937 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fda3c10f590 con 0x7fda2406cc00 2023-12-08T20:29:32.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.644+0000 7fda2affd700 1 -- 172.21.15.43:0/184677937 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7fda3c10f590 con 0x7fda2406cc00 2023-12-08T20:29:32.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.647+0000 7fda40ced700 1 -- 172.21.15.43:0/184677937 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fda2406cc00 msgr2=0x7fda2406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:32.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.647+0000 7fda40ced700 1 --2- 172.21.15.43:0/184677937 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fda2406cc00 0x7fda2406f0b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fda30004890 tx=0x7fda30009e30 comp rx=0 tx=0).stop 2023-12-08T20:29:32.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.647+0000 7fda40ced700 1 -- 172.21.15.43:0/184677937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda3c0fd730 msgr2=0x7fda3c10d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:32.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.647+0000 7fda40ced700 1 --2- 172.21.15.43:0/184677937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda3c0fd730 0x7fda3c10d490 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fda2c002a80 tx=0x7fda2c0046b0 comp rx=0 tx=0).stop 2023-12-08T20:29:32.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.647+0000 7fda40ced700 1 -- 172.21.15.43:0/184677937 shutdown_connections 2023-12-08T20:29:32.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.647+0000 7fda40ced700 1 --2- 172.21.15.43:0/184677937 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fda2406cc00 0x7fda2406f0b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:32.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.647+0000 7fda40ced700 1 --2- 172.21.15.43:0/184677937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda3c0fd730 0x7fda3c10d490 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:32.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.647+0000 7fda40ced700 1 --2- 172.21.15.43:0/184677937 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda3c100050 0x7fda3c10d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:32.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.647+0000 7fda40ced700 1 -- 172.21.15.43:0/184677937 >> 172.21.15.43:0/184677937 conn(0x7fda3c0f71b0 msgr2=0x7fda3c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:29:32.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.647+0000 7fda40ced700 1 -- 172.21.15.43:0/184677937 shutdown_connections 2023-12-08T20:29:32.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.647+0000 7fda40ced700 1 -- 172.21.15.43:0/184677937 wait complete. 2023-12-08T20:29:32.661 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:29:32.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.767+0000 7fbd99016700 1 -- 172.21.15.43:0/2041808584 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd940fdf60 msgr2=0x7fbd940fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:32.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.767+0000 7fbd99016700 1 --2- 172.21.15.43:0/2041808584 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd940fdf60 0x7fbd940fe3b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c004880 tx=0x7fbd7c009e30 comp rx=0 tx=0).stop 2023-12-08T20:29:32.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.767+0000 7fbd99016700 1 -- 172.21.15.43:0/2041808584 shutdown_connections 2023-12-08T20:29:32.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.767+0000 7fbd99016700 1 --2- 172.21.15.43:0/2041808584 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd940fdf60 0x7fbd940fe3b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:32.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.767+0000 7fbd99016700 1 --2- 172.21.15.43:0/2041808584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd940faed0 0x7fbd940fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:32.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.767+0000 7fbd99016700 1 -- 172.21.15.43:0/2041808584 >> 172.21.15.43:0/2041808584 conn(0x7fbd940f6950 msgr2=0x7fbd940f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:29:32.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.768+0000 7fbd99016700 1 -- 172.21.15.43:0/2041808584 shutdown_connections 2023-12-08T20:29:32.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.768+0000 7fbd99016700 1 -- 172.21.15.43:0/2041808584 wait complete. 2023-12-08T20:29:32.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.768+0000 7fbd99016700 1 Processor -- start 2023-12-08T20:29:32.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.768+0000 7fbd99016700 1 -- start start 2023-12-08T20:29:32.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.769+0000 7fbd99016700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd940faed0 0x7fbd9410d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:32.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.769+0000 7fbd99016700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd940fdf60 0x7fbd9410daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:32.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.769+0000 7fbd99016700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9410e0f0 con 0x7fbd940faed0 2023-12-08T20:29:32.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.769+0000 7fbd99016700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9410e990 con 0x7fbd940fdf60 2023-12-08T20:29:32.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.769+0000 7fbd92d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd940faed0 0x7fbd9410d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:32.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.769+0000 7fbd92d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd940faed0 0x7fbd9410d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39988/0 (socket says 172.21.15.43:39988) 2023-12-08T20:29:32.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.769+0000 7fbd92d9d700 1 -- 172.21.15.43:0/897328940 learned_addr learned my addr 172.21.15.43:0/897328940 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:29:32.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.769+0000 7fbd8a59c700 1 --2- 172.21.15.43:0/897328940 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd940fdf60 0x7fbd9410daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:32.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.769+0000 7fbd8a59c700 1 -- 172.21.15.43:0/897328940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd940faed0 msgr2=0x7fbd9410d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:32.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.769+0000 7fbd8a59c700 1 --2- 172.21.15.43:0/897328940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd940faed0 0x7fbd9410d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:32.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.769+0000 7fbd8a59c700 1 -- 172.21.15.43:0/897328940 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd84005040 con 0x7fbd940fdf60 2023-12-08T20:29:32.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.769+0000 7fbd92d9d700 1 --2- 172.21.15.43:0/897328940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd940faed0 0x7fbd9410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T20:29:32.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.769+0000 7fbd8a59c700 1 --2- 172.21.15.43:0/897328940 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd940fdf60 0x7fbd9410daf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c000c00 tx=0x7fbd7c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:29:32.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.770+0000 7fbd8bfff700 1 -- 172.21.15.43:0/897328940 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd7c00e030 con 0x7fbd940fdf60 2023-12-08T20:29:32.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.770+0000 7fbd8bfff700 1 -- 172.21.15.43:0/897328940 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbd7c01c400 con 0x7fbd940fdf60 2023-12-08T20:29:32.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.770+0000 7fbd99016700 1 -- 172.21.15.43:0/897328940 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7c005040 con 0x7fbd940fdf60 2023-12-08T20:29:32.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.770+0000 7fbd8bfff700 1 -- 172.21.15.43:0/897328940 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd7c012600 con 0x7fbd940fdf60 2023-12-08T20:29:32.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.770+0000 7fbd99016700 1 -- 172.21.15.43:0/897328940 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9410efc0 con 0x7fbd940fdf60 2023-12-08T20:29:32.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.771+0000 7fbd99016700 1 -- 172.21.15.43:0/897328940 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd9404bb80 con 0x7fbd940fdf60 2023-12-08T20:29:32.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.771+0000 7fbd8bfff700 1 -- 172.21.15.43:0/897328940 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 32) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fbd7c012870 con 0x7fbd940fdf60 2023-12-08T20:29:32.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.772+0000 7fbd8bfff700 1 --2- 172.21.15.43:0/897328940 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fbd8006cc00 0x7fbd8006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:32.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.772+0000 7fbd8bfff700 1 -- 172.21.15.43:0/897328940 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fbd7c08d880 con 0x7fbd940fdf60 2023-12-08T20:29:32.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.772+0000 7fbd92d9d700 1 --2- 172.21.15.43:0/897328940 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fbd8006cc00 0x7fbd8006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:32.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.772+0000 7fbd92d9d700 1 --2- 172.21.15.43:0/897328940 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fbd8006cc00 0x7fbd8006f0b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbd840041d0 tx=0x7fbd8400b040 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:29:32.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:32.780+0000 7fbd8bfff700 1 -- 172.21.15.43:0/897328940 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fbd7c05b520 con 0x7fbd940fdf60 2023-12-08T20:29:33.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.076+0000 7fbd99016700 1 -- 172.21.15.43:0/897328940 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd9410f350 con 0x7fbd8006cc00 2023-12-08T20:29:33.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.078+0000 7fbd8bfff700 1 -- 172.21.15.43:0/897328940 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7fbd9410f350 con 0x7fbd8006cc00 2023-12-08T20:29:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.080+0000 7fbd99016700 1 -- 172.21.15.43:0/897328940 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fbd8006cc00 msgr2=0x7fbd8006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.080+0000 7fbd99016700 1 --2- 172.21.15.43:0/897328940 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fbd8006cc00 0x7fbd8006f0b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbd840041d0 tx=0x7fbd8400b040 comp rx=0 tx=0).stop 2023-12-08T20:29:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.080+0000 7fbd99016700 1 -- 172.21.15.43:0/897328940 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd940fdf60 msgr2=0x7fbd9410daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.080+0000 7fbd99016700 1 --2- 172.21.15.43:0/897328940 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd940fdf60 0x7fbd9410daf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c000c00 tx=0x7fbd7c009e30 comp rx=0 tx=0).stop 2023-12-08T20:29:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.081+0000 7fbd99016700 1 -- 172.21.15.43:0/897328940 shutdown_connections 2023-12-08T20:29:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.081+0000 7fbd99016700 1 --2- 172.21.15.43:0/897328940 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fbd8006cc00 0x7fbd8006f0b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.081+0000 7fbd99016700 1 --2- 172.21.15.43:0/897328940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd940faed0 0x7fbd9410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.081+0000 7fbd99016700 1 --2- 172.21.15.43:0/897328940 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd940fdf60 0x7fbd9410daf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.081+0000 7fbd99016700 1 -- 172.21.15.43:0/897328940 >> 172.21.15.43:0/897328940 conn(0x7fbd940f6950 msgr2=0x7fbd94101190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:29:33.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.081+0000 7fbd99016700 1 -- 172.21.15.43:0/897328940 shutdown_connections 2023-12-08T20:29:33.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.081+0000 7fbd99016700 1 -- 172.21.15.43:0/897328940 wait complete. 2023-12-08T20:29:33.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.239+0000 7f1734376700 1 -- 172.21.15.43:0/3079708739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c070510 msgr2=0x7f172c070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:33.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.239+0000 7f1734376700 1 --2- 172.21.15.43:0/3079708739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c070510 0x7f172c070980 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f171c004940 tx=0x7f171c009e30 comp rx=0 tx=0).stop 2023-12-08T20:29:33.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.240+0000 7f1734376700 1 -- 172.21.15.43:0/3079708739 shutdown_connections 2023-12-08T20:29:33.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.240+0000 7f1734376700 1 --2- 172.21.15.43:0/3079708739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c070510 0x7f172c070980 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:33.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.240+0000 7f1734376700 1 --2- 172.21.15.43:0/3079708739 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f172c071b60 0x7f172c06ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:33.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.240+0000 7f1734376700 1 -- 172.21.15.43:0/3079708739 >> 172.21.15.43:0/3079708739 conn(0x7f172c0f82d0 msgr2=0x7f172c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:29:33.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.240+0000 7f1734376700 1 -- 172.21.15.43:0/3079708739 shutdown_connections 2023-12-08T20:29:33.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.240+0000 7f1734376700 1 -- 172.21.15.43:0/3079708739 wait complete. 2023-12-08T20:29:33.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.240+0000 7f1734376700 1 Processor -- start 2023-12-08T20:29:33.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.240+0000 7f1734376700 1 -- start start 2023-12-08T20:29:33.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.241+0000 7f1734376700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c070510 0x7f172c10f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:33.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.241+0000 7f1734376700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f172c071b60 0x7f172c10fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:33.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.241+0000 7f1734376700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c1102c0 con 0x7f172c070510 2023-12-08T20:29:33.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.241+0000 7f1734376700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c110b60 con 0x7f172c071b60 2023-12-08T20:29:33.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.241+0000 7f1732112700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c070510 0x7f172c10f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:33.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.241+0000 7f1732112700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c070510 0x7f172c10f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40000/0 (socket says 172.21.15.43:40000) 2023-12-08T20:29:33.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.241+0000 7f1732112700 1 -- 172.21.15.43:0/2048939744 learned_addr learned my addr 172.21.15.43:0/2048939744 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:29:33.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.241+0000 7f1731911700 1 --2- 172.21.15.43:0/2048939744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f172c071b60 0x7f172c10fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:33.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.241+0000 7f1732112700 1 -- 172.21.15.43:0/2048939744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f172c071b60 msgr2=0x7f172c10fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:33.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.241+0000 7f1732112700 1 --2- 172.21.15.43:0/2048939744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f172c071b60 0x7f172c10fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:33.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.241+0000 7f1732112700 1 -- 172.21.15.43:0/2048939744 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c005040 con 0x7f172c070510 2023-12-08T20:29:33.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.241+0000 7f1731911700 1 --2- 172.21.15.43:0/2048939744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f172c071b60 0x7f172c10fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T20:29:33.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.241+0000 7f1732112700 1 --2- 172.21.15.43:0/2048939744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c070510 0x7f172c10f780 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f172800ec90 tx=0x7f172800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:29:33.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.242+0000 7f1722ffd700 1 -- 172.21.15.43:0/2048939744 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1728007b30 con 0x7f172c070510 2023-12-08T20:29:33.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.242+0000 7f1734376700 1 -- 172.21.15.43:0/2048939744 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172c110e40 con 0x7f172c070510 2023-12-08T20:29:33.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.242+0000 7f1734376700 1 -- 172.21.15.43:0/2048939744 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172c111380 con 0x7f172c070510 2023-12-08T20:29:33.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.242+0000 7f1722ffd700 1 -- 172.21.15.43:0/2048939744 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f172800f040 con 0x7f172c070510 2023-12-08T20:29:33.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.242+0000 7f1722ffd700 1 -- 172.21.15.43:0/2048939744 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f172800cbd0 con 0x7f172c070510 2023-12-08T20:29:33.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.243+0000 7f1734376700 1 -- 172.21.15.43:0/2048939744 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17100052e0 con 0x7f172c070510 2023-12-08T20:29:33.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.244+0000 7f1722ffd700 1 -- 172.21.15.43:0/2048939744 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 32) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f1728007c90 con 0x7f172c070510 2023-12-08T20:29:33.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.244+0000 7f1722ffd700 1 --2- 172.21.15.43:0/2048939744 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f171806cc00 0x7f171806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:33.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.244+0000 7f1722ffd700 1 -- 172.21.15.43:0/2048939744 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f172808c3e0 con 0x7f172c070510 2023-12-08T20:29:33.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.245+0000 7f1731911700 1 --2- 172.21.15.43:0/2048939744 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f171806cc00 0x7f171806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:33.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.245+0000 7f1731911700 1 --2- 172.21.15.43:0/2048939744 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f171806cc00 0x7f171806f0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f171c013680 tx=0x7f171c009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:29:33.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.253+0000 7f1722ffd700 1 -- 172.21.15.43:0/2048939744 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f172805a020 con 0x7f172c070510 2023-12-08T20:29:33.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:33 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:33.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:33 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:33.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:33 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:33.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:33 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:33.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:33 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:33.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:33 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:33.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:33 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:33.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:33 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:33.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.487+0000 7f1734376700 1 -- 172.21.15.43:0/2048939744 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1710000bf0 con 0x7f171806cc00 2023-12-08T20:29:33.501 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-08T20:29:33.501 INFO:teuthology.orchestra.run.smithi043.stdout:alertmanager.smithi043 smithi043 *:9093,9094 running (102s) 1s ago 7m 26.9M - 0.25.0 c8568f914cd2 ff18f4f8094d 2023-12-08T20:29:33.501 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi043 smithi043 running (7m) 1s ago 7m 7432k - 17.2.7-119-ge2143d99 f761b6e42225 f84d492b732c 2023-12-08T20:29:33.501 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi111 smithi111 running (7m) 20s ago 7m 7428k - 17.2.7-119-ge2143d99 f761b6e42225 88b53685ae54 2023-12-08T20:29:33.501 INFO:teuthology.orchestra.run.smithi043.stdout:grafana.smithi043 smithi043 *:3000 running (91s) 1s ago 7m 79.3M - 9.4.7 954c08fa6188 3682a97e102e 2023-12-08T20:29:33.501 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.akrjef smithi043 running (3m) 1s ago 3m 17.6M - 17.2.7-119-ge2143d99 f761b6e42225 1c0cb8d34ef8 2023-12-08T20:29:33.501 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.pjmszb smithi043 running (3m) 1s ago 3m 6892M - 17.2.7-119-ge2143d99 f761b6e42225 d7eee0c78093 2023-12-08T20:29:33.501 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.svpasm smithi111 running (3m) 20s ago 3m 15.2M - 17.2.7-119-ge2143d99 f761b6e42225 657d4d1cf4b2 2023-12-08T20:29:33.501 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.veeegc smithi111 running (3m) 20s ago 3m 2612M - 17.2.7-119-ge2143d99 f761b6e42225 31f794a388ab 2023-12-08T20:29:33.501 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi043.hqcdcm smithi043 *:8443,9283,8765 running (64s) 1s ago 8m 505M - 19.0.0-44-g9dcc13bb f28f2b94f153 14e91c1dac64 2023-12-08T20:29:33.501 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi111.mtcffu smithi111 *:8443,9283,8765 running (35s) 20s ago 7m 449M - 19.0.0-44-g9dcc13bb f28f2b94f153 56f4290c6db5 2023-12-08T20:29:33.501 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi043 smithi043 running (8m) 1s ago 9m 97.2M 2048M 17.2.7-119-ge2143d99 f761b6e42225 fe2a56effef3 2023-12-08T20:29:33.501 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi111 smithi111 running (6m) 20s ago 6m 67.8M 2048M 17.2.7-119-ge2143d99 f761b6e42225 2ae21cf3fa1e 2023-12-08T20:29:33.502 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi043 smithi043 *:9100 running (25s) 1s ago 7m 9281k - 1.5.0 0da6a335fe13 0959b44d9972 2023-12-08T20:29:33.502 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi111 smithi111 *:9100 running (23s) 20s ago 7m 3862k - 1.5.0 0da6a335fe13 10fe4fdb23d0 2023-12-08T20:29:33.502 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (6m) 1s ago 6m 687M 1570M 17.2.7-119-ge2143d99 f761b6e42225 462eeaf62b2c 2023-12-08T20:29:33.502 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi043 running (6m) 1s ago 6m 773M 1570M 17.2.7-119-ge2143d99 f761b6e42225 dde419c88a89 2023-12-08T20:29:33.502 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi043 running (5m) 1s ago 5m 583M 1570M 17.2.7-119-ge2143d99 f761b6e42225 f7e812026ef5 2023-12-08T20:29:33.502 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi111 running (5m) 20s ago 5m 791M 2592M 17.2.7-119-ge2143d99 f761b6e42225 2a738d30441c 2023-12-08T20:29:33.502 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi111 running (5m) 20s ago 5m 600M 2592M 17.2.7-119-ge2143d99 f761b6e42225 38cdb6a88694 2023-12-08T20:29:33.502 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi111 running (4m) 20s ago 4m 728M 2592M 17.2.7-119-ge2143d99 f761b6e42225 59a9ce8c1141 2023-12-08T20:29:33.502 INFO:teuthology.orchestra.run.smithi043.stdout:prometheus.smithi043 smithi043 *:9095 running (6s) 1s ago 7m 45.5M - 2.43.0 a07b618ecd1d d95914ec88d8 2023-12-08T20:29:33.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.499+0000 7f1722ffd700 1 -- 172.21.15.43:0/2048939744 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1710000bf0 con 0x7f171806cc00 2023-12-08T20:29:33.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.501+0000 7f1734376700 1 -- 172.21.15.43:0/2048939744 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f171806cc00 msgr2=0x7f171806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:33.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.501+0000 7f1734376700 1 --2- 172.21.15.43:0/2048939744 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f171806cc00 0x7f171806f0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f171c013680 tx=0x7f171c009e30 comp rx=0 tx=0).stop 2023-12-08T20:29:33.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.501+0000 7f1734376700 1 -- 172.21.15.43:0/2048939744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c070510 msgr2=0x7f172c10f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:33.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.501+0000 7f1734376700 1 --2- 172.21.15.43:0/2048939744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c070510 0x7f172c10f780 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f172800ec90 tx=0x7f172800b040 comp rx=0 tx=0).stop 2023-12-08T20:29:33.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.502+0000 7f1734376700 1 -- 172.21.15.43:0/2048939744 shutdown_connections 2023-12-08T20:29:33.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.502+0000 7f1734376700 1 --2- 172.21.15.43:0/2048939744 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f171806cc00 0x7f171806f0b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:33.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.502+0000 7f1734376700 1 --2- 172.21.15.43:0/2048939744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c070510 0x7f172c10f780 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:33.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.502+0000 7f1734376700 1 --2- 172.21.15.43:0/2048939744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f172c071b60 0x7f172c10fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:33.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.502+0000 7f1734376700 1 -- 172.21.15.43:0/2048939744 >> 172.21.15.43:0/2048939744 conn(0x7f172c0f82d0 msgr2=0x7f172c0fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:29:33.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.502+0000 7f1734376700 1 -- 172.21.15.43:0/2048939744 shutdown_connections 2023-12-08T20:29:33.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.502+0000 7f1734376700 1 -- 172.21.15.43:0/2048939744 wait complete. 2023-12-08T20:29:33.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.627+0000 7fee4bfd5700 1 -- 172.21.15.43:0/943232309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee44100050 msgr2=0x7fee44102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:33.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.627+0000 7fee4bfd5700 1 --2- 172.21.15.43:0/943232309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee44100050 0x7fee44102430 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fee34004940 tx=0x7fee34009e30 comp rx=0 tx=0).stop 2023-12-08T20:29:33.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.627+0000 7fee4bfd5700 1 -- 172.21.15.43:0/943232309 shutdown_connections 2023-12-08T20:29:33.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.627+0000 7fee4bfd5700 1 --2- 172.21.15.43:0/943232309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee44100050 0x7fee44102430 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:33.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.627+0000 7fee4bfd5700 1 --2- 172.21.15.43:0/943232309 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee440fd730 0x7fee440ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:33.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.627+0000 7fee4bfd5700 1 -- 172.21.15.43:0/943232309 >> 172.21.15.43:0/943232309 conn(0x7fee440f7190 msgr2=0x7fee440f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:29:33.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.627+0000 7fee4bfd5700 1 -- 172.21.15.43:0/943232309 shutdown_connections 2023-12-08T20:29:33.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.627+0000 7fee4bfd5700 1 -- 172.21.15.43:0/943232309 wait complete. 2023-12-08T20:29:33.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.627+0000 7fee4bfd5700 1 Processor -- start 2023-12-08T20:29:33.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.627+0000 7fee4bfd5700 1 -- start start 2023-12-08T20:29:33.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.628+0000 7fee4bfd5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee440fd730 0x7fee4410d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:33.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.628+0000 7fee4bfd5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee44100050 0x7fee4410d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:33.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.628+0000 7fee4bfd5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4410dfe0 con 0x7fee440fd730 2023-12-08T20:29:33.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.628+0000 7fee4bfd5700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4410e880 con 0x7fee44100050 2023-12-08T20:29:33.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.628+0000 7fee49d71700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee440fd730 0x7fee4410d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:33.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.628+0000 7fee49d71700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee440fd730 0x7fee4410d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40016/0 (socket says 172.21.15.43:40016) 2023-12-08T20:29:33.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.628+0000 7fee49d71700 1 -- 172.21.15.43:0/3088719482 learned_addr learned my addr 172.21.15.43:0/3088719482 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:29:33.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.628+0000 7fee49570700 1 --2- 172.21.15.43:0/3088719482 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee44100050 0x7fee4410d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:33.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.628+0000 7fee49d71700 1 -- 172.21.15.43:0/3088719482 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee44100050 msgr2=0x7fee4410d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:33.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.628+0000 7fee49d71700 1 --2- 172.21.15.43:0/3088719482 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee44100050 0x7fee4410d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:33.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.628+0000 7fee49d71700 1 -- 172.21.15.43:0/3088719482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee34005040 con 0x7fee440fd730 2023-12-08T20:29:33.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.628+0000 7fee49d71700 1 --2- 172.21.15.43:0/3088719482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee440fd730 0x7fee4410d4a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fee4000eb40 tx=0x7fee4000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:29:33.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.628+0000 7fee3a7fc700 1 -- 172.21.15.43:0/3088719482 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee40007cc0 con 0x7fee440fd730 2023-12-08T20:29:33.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.629+0000 7fee3a7fc700 1 -- 172.21.15.43:0/3088719482 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fee4000f040 con 0x7fee440fd730 2023-12-08T20:29:33.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.629+0000 7fee4bfd5700 1 -- 172.21.15.43:0/3088719482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4410eb00 con 0x7fee440fd730 2023-12-08T20:29:33.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.629+0000 7fee3a7fc700 1 -- 172.21.15.43:0/3088719482 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee4000c990 con 0x7fee440fd730 2023-12-08T20:29:33.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.629+0000 7fee4bfd5700 1 -- 172.21.15.43:0/3088719482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4410f040 con 0x7fee440fd730 2023-12-08T20:29:33.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.630+0000 7fee4bfd5700 1 -- 172.21.15.43:0/3088719482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee4404bb80 con 0x7fee440fd730 2023-12-08T20:29:33.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.630+0000 7fee3a7fc700 1 -- 172.21.15.43:0/3088719482 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 32) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fee4000caf0 con 0x7fee440fd730 2023-12-08T20:29:33.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.631+0000 7fee3a7fc700 1 --2- 172.21.15.43:0/3088719482 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fee3006cc00 0x7fee3006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:33.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.631+0000 7fee3a7fc700 1 -- 172.21.15.43:0/3088719482 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fee4008bb20 con 0x7fee440fd730 2023-12-08T20:29:33.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.631+0000 7fee49570700 1 --2- 172.21.15.43:0/3088719482 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fee3006cc00 0x7fee3006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:33.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.631+0000 7fee49570700 1 --2- 172.21.15.43:0/3088719482 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fee3006cc00 0x7fee3006f0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fee34013600 tx=0x7fee34009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:29:33.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.636+0000 7fee3a7fc700 1 -- 172.21.15.43:0/3088719482 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fee40059870 con 0x7fee440fd730 2023-12-08T20:29:33.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.980+0000 7fee4bfd5700 1 -- 172.21.15.43:0/3088719482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fee4410f440 con 0x7fee440fd730 2023-12-08T20:29:33.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.982+0000 7fee3a7fc700 1 -- 172.21.15.43:0/3088719482 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7fee40059400 con 0x7fee440fd730 2023-12-08T20:29:33.983 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:29:33.984 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": { 2023-12-08T20:29:33.984 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2 2023-12-08T20:29:33.984 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:29:33.984 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": { 2023-12-08T20:29:33.984 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:29:33.984 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:29:33.984 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": { 2023-12-08T20:29:33.984 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 6 2023-12-08T20:29:33.984 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:29:33.984 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2023-12-08T20:29:33.984 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-08T20:29:33.984 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:29:33.984 INFO:teuthology.orchestra.run.smithi043.stdout: "overall": { 2023-12-08T20:29:33.985 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 12, 2023-12-08T20:29:33.985 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:29:33.985 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-12-08T20:29:33.985 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:29:33.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.986+0000 7fee4bfd5700 1 -- 172.21.15.43:0/3088719482 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fee3006cc00 msgr2=0x7fee3006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:33.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.986+0000 7fee4bfd5700 1 --2- 172.21.15.43:0/3088719482 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fee3006cc00 0x7fee3006f0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fee34013600 tx=0x7fee34009e30 comp rx=0 tx=0).stop 2023-12-08T20:29:33.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.986+0000 7fee4bfd5700 1 -- 172.21.15.43:0/3088719482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee440fd730 msgr2=0x7fee4410d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:33.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.986+0000 7fee4bfd5700 1 --2- 172.21.15.43:0/3088719482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee440fd730 0x7fee4410d4a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fee4000eb40 tx=0x7fee4000b040 comp rx=0 tx=0).stop 2023-12-08T20:29:33.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.986+0000 7fee4bfd5700 1 -- 172.21.15.43:0/3088719482 shutdown_connections 2023-12-08T20:29:33.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.986+0000 7fee4bfd5700 1 --2- 172.21.15.43:0/3088719482 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fee3006cc00 0x7fee3006f0b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:33.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.986+0000 7fee4bfd5700 1 --2- 172.21.15.43:0/3088719482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee440fd730 0x7fee4410d4a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:33.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.986+0000 7fee4bfd5700 1 --2- 172.21.15.43:0/3088719482 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee44100050 0x7fee4410d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:33.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.986+0000 7fee4bfd5700 1 -- 172.21.15.43:0/3088719482 >> 172.21.15.43:0/3088719482 conn(0x7fee440f7190 msgr2=0x7fee440f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:29:33.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.987+0000 7fee4bfd5700 1 -- 172.21.15.43:0/3088719482 shutdown_connections 2023-12-08T20:29:33.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:33.988+0000 7fee4bfd5700 1 -- 172.21.15.43:0/3088719482 wait complete. 2023-12-08T20:29:34.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.162+0000 7fc8c7117700 1 -- 172.21.15.43:0/3594007009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8c0104400 msgr2=0x7fc8c0104850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:34.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.162+0000 7fc8c7117700 1 --2- 172.21.15.43:0/3594007009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8c0104400 0x7fc8c0104850 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4004940 tx=0x7fc8b4009e30 comp rx=0 tx=0).stop 2023-12-08T20:29:34.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.162+0000 7fc8c7117700 1 -- 172.21.15.43:0/3594007009 shutdown_connections 2023-12-08T20:29:34.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.162+0000 7fc8c7117700 1 --2- 172.21.15.43:0/3594007009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8c0104400 0x7fc8c0104850 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:34.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.162+0000 7fc8c7117700 1 --2- 172.21.15.43:0/3594007009 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8c01031f0 0x7fc8c0103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:34.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.162+0000 7fc8c7117700 1 -- 172.21.15.43:0/3594007009 >> 172.21.15.43:0/3594007009 conn(0x7fc8c0072480 msgr2=0x7fc8c00748b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:29:34.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.162+0000 7fc8c7117700 1 -- 172.21.15.43:0/3594007009 shutdown_connections 2023-12-08T20:29:34.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.162+0000 7fc8c7117700 1 -- 172.21.15.43:0/3594007009 wait complete. 2023-12-08T20:29:34.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.163+0000 7fc8c7117700 1 Processor -- start 2023-12-08T20:29:34.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.163+0000 7fc8c7117700 1 -- start start 2023-12-08T20:29:34.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.163+0000 7fc8c7117700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8c01031f0 0x7fc8c006edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:34.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.163+0000 7fc8c7117700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8c0104400 0x7fc8c006f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:34.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.163+0000 7fc8c7117700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c011d7b0 con 0x7fc8c0104400 2023-12-08T20:29:34.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.163+0000 7fc8c7117700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c011d8f0 con 0x7fc8c01031f0 2023-12-08T20:29:34.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.164+0000 7fc8bffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8c0104400 0x7fc8c006f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:34.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.164+0000 7fc8bffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8c0104400 0x7fc8c006f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40038/0 (socket says 172.21.15.43:40038) 2023-12-08T20:29:34.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.164+0000 7fc8bffff700 1 -- 172.21.15.43:0/275544673 learned_addr learned my addr 172.21.15.43:0/275544673 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:29:34.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.164+0000 7fc8c4eb3700 1 --2- 172.21.15.43:0/275544673 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8c01031f0 0x7fc8c006edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:34.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.164+0000 7fc8bffff700 1 -- 172.21.15.43:0/275544673 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8c01031f0 msgr2=0x7fc8c006edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:34.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.164+0000 7fc8bffff700 1 --2- 172.21.15.43:0/275544673 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8c01031f0 0x7fc8c006edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:34.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.164+0000 7fc8bffff700 1 -- 172.21.15.43:0/275544673 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b4005040 con 0x7fc8c0104400 2023-12-08T20:29:34.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.164+0000 7fc8bffff700 1 --2- 172.21.15.43:0/275544673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8c0104400 0x7fc8c006f300 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4008fb0 tx=0x7fc8b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:29:34.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.165+0000 7fc8bd7fa700 1 -- 172.21.15.43:0/275544673 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8b400e070 con 0x7fc8c0104400 2023-12-08T20:29:34.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.165+0000 7fc8bd7fa700 1 -- 172.21.15.43:0/275544673 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc8b4013420 con 0x7fc8c0104400 2023-12-08T20:29:34.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.165+0000 7fc8bd7fa700 1 -- 172.21.15.43:0/275544673 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8b401c640 con 0x7fc8c0104400 2023-12-08T20:29:34.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.167+0000 7fc8c7117700 1 -- 172.21.15.43:0/275544673 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c011daf0 con 0x7fc8c0104400 2023-12-08T20:29:34.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.167+0000 7fc8c7117700 1 -- 172.21.15.43:0/275544673 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c011dfa0 con 0x7fc8c0104400 2023-12-08T20:29:34.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.168+0000 7fc8c7117700 1 -- 172.21.15.43:0/275544673 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c004bb80 con 0x7fc8c0104400 2023-12-08T20:29:34.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.170+0000 7fc8bd7fa700 1 -- 172.21.15.43:0/275544673 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 32) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fc8b40139e0 con 0x7fc8c0104400 2023-12-08T20:29:34.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.171+0000 7fc8bd7fa700 1 --2- 172.21.15.43:0/275544673 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fc8a806cc00 0x7fc8a806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:29:34.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.171+0000 7fc8bd7fa700 1 -- 172.21.15.43:0/275544673 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fc8b408ce60 con 0x7fc8c0104400 2023-12-08T20:29:34.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.172+0000 7fc8c4eb3700 1 --2- 172.21.15.43:0/275544673 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fc8a806cc00 0x7fc8a806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:29:34.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.173+0000 7fc8c4eb3700 1 --2- 172.21.15.43:0/275544673 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fc8a806cc00 0x7fc8a806f0b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0006fd0 tx=0x7fc8b0008040 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:29:34.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.180+0000 7fc8bd7fa700 1 -- 172.21.15.43:0/275544673 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fc8b405aa60 con 0x7fc8c0104400 2023-12-08T20:29:34.252 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:34 smithi043 ceph-mon[111966]: pgmap v29: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 2.4 MiB/s wr, 532 op/s 2023-12-08T20:29:34.252 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:34 smithi043 ceph-mon[111966]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:29:34.252 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:34 smithi043 ceph-mon[111966]: from='client.24525 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:29:34.252 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:34 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3088719482' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:34.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.435+0000 7fc8c7117700 1 -- 172.21.15.43:0/275544673 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8c011e540 con 0x7fc8a806cc00 2023-12-08T20:29:34.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.437+0000 7fc8bd7fa700 1 -- 172.21.15.43:0/275544673 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7fc8c011e540 con 0x7fc8a806cc00 2023-12-08T20:29:34.438 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:29:34.438 INFO:teuthology.orchestra.run.smithi043.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-08T20:29:34.438 INFO:teuthology.orchestra.run.smithi043.stdout: "in_progress": true, 2023-12-08T20:29:34.438 INFO:teuthology.orchestra.run.smithi043.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-08T20:29:34.438 INFO:teuthology.orchestra.run.smithi043.stdout: "services_complete": [ 2023-12-08T20:29:34.438 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr" 2023-12-08T20:29:34.438 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2023-12-08T20:29:34.439 INFO:teuthology.orchestra.run.smithi043.stdout: "progress": "2/2 daemons upgraded", 2023-12-08T20:29:34.439 INFO:teuthology.orchestra.run.smithi043.stdout: "message": "Currently upgrading prometheus daemons", 2023-12-08T20:29:34.439 INFO:teuthology.orchestra.run.smithi043.stdout: "is_paused": false 2023-12-08T20:29:34.439 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:29:34.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.439+0000 7fc8c7117700 1 -- 172.21.15.43:0/275544673 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fc8a806cc00 msgr2=0x7fc8a806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:34.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.439+0000 7fc8c7117700 1 --2- 172.21.15.43:0/275544673 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fc8a806cc00 0x7fc8a806f0b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0006fd0 tx=0x7fc8b0008040 comp rx=0 tx=0).stop 2023-12-08T20:29:34.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.439+0000 7fc8c7117700 1 -- 172.21.15.43:0/275544673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8c0104400 msgr2=0x7fc8c006f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:29:34.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.439+0000 7fc8c7117700 1 --2- 172.21.15.43:0/275544673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8c0104400 0x7fc8c006f300 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4008fb0 tx=0x7fc8b4009e30 comp rx=0 tx=0).stop 2023-12-08T20:29:34.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.439+0000 7fc8c7117700 1 -- 172.21.15.43:0/275544673 shutdown_connections 2023-12-08T20:29:34.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.439+0000 7fc8c7117700 1 --2- 172.21.15.43:0/275544673 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8c01031f0 0x7fc8c006edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:34.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.439+0000 7fc8c7117700 1 --2- 172.21.15.43:0/275544673 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fc8a806cc00 0x7fc8a806f0b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:34.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.439+0000 7fc8c7117700 1 --2- 172.21.15.43:0/275544673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8c0104400 0x7fc8c006f300 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:29:34.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.439+0000 7fc8c7117700 1 -- 172.21.15.43:0/275544673 >> 172.21.15.43:0/275544673 conn(0x7fc8c0072480 msgr2=0x7fc8c0107630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:29:34.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.439+0000 7fc8c7117700 1 -- 172.21.15.43:0/275544673 shutdown_connections 2023-12-08T20:29:34.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:29:34.440+0000 7fc8c7117700 1 -- 172.21.15.43:0/275544673 wait complete. 2023-12-08T20:29:34.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:34 smithi111 ceph-mon[121341]: pgmap v29: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 2.4 MiB/s wr, 532 op/s 2023-12-08T20:29:34.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:34 smithi111 ceph-mon[121341]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:29:34.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:34 smithi111 ceph-mon[121341]: from='client.24525 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:29:34.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:34 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/3088719482' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:35 smithi111 ceph-mon[121341]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:29:35.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:35 smithi043 ceph-mon[111966]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:29:36.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:36 smithi043 ceph-mon[111966]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:29:36.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:36 smithi043 ceph-mon[111966]: pgmap v30: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.4 MiB/s wr, 339 op/s 2023-12-08T20:29:36.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:36 smithi111 ceph-mon[121341]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:29:36.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:36 smithi111 ceph-mon[121341]: pgmap v30: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.4 MiB/s wr, 339 op/s 2023-12-08T20:29:37.389 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:37 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:37.390 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:37 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:37.390 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:37 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:29:37.390 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:37 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:29:37.390 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:37 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:37.390 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:37 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-08T20:29:37.390 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:37 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:29:37.390 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:37 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:37.390 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:37 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:37.390 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:37 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:37.390 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:37 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:37.390 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:37 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:37.390 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:37 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:37.390 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:37 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:37.391 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:37 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:37.391 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:37 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:37.391 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:37 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:37.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:37 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:37.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:37 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:37.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:37 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:29:37.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:37 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:29:37.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:37 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:37.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:37 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-08T20:29:37.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:37 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:29:37.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:37 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:37.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:37 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:37.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:37 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:37.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:37 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:37.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:37 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:37.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:37 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:37.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:37 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:37.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:37 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:37.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:37 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:37.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:37 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:38.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:38 smithi111 ceph-mon[121341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-08T20:29:38.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:38 smithi111 ceph-mon[121341]: pgmap v31: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.0 MiB/s wr, 461 op/s 2023-12-08T20:29:38.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:38 smithi043 ceph-mon[111966]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-08T20:29:38.513 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:38 smithi043 ceph-mon[111966]: pgmap v31: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.0 MiB/s wr, 461 op/s 2023-12-08T20:29:39.407 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:39 smithi043 ceph-mon[111966]: Upgrade: Updating alertmanager.smithi043 2023-12-08T20:29:39.407 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:39 smithi043 ceph-mon[111966]: Deploying daemon alertmanager.smithi043 on smithi043 2023-12-08T20:29:39.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:39 smithi111 ceph-mon[121341]: Upgrade: Updating alertmanager.smithi043 2023-12-08T20:29:39.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:39 smithi111 ceph-mon[121341]: Deploying daemon alertmanager.smithi043 on smithi043 2023-12-08T20:29:40.428 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:40 smithi043 ceph-mon[111966]: pgmap v32: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.6 MiB/s wr, 344 op/s 2023-12-08T20:29:40.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:40 smithi111 ceph-mon[121341]: pgmap v32: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.6 MiB/s wr, 344 op/s 2023-12-08T20:29:41.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:41 smithi111 ceph-mon[121341]: pgmap v33: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 290 op/s 2023-12-08T20:29:41.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:41 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:29:42.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:41 smithi043 ceph-mon[111966]: pgmap v33: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 290 op/s 2023-12-08T20:29:42.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:41 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:29:43.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:43 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:43.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:43 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:43.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:43 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:29:43.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:43 smithi111 ceph-mon[121341]: pgmap v34: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.9 MiB/s wr, 445 op/s 2023-12-08T20:29:43.763 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:43 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:43.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:43 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:43.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:43 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:29:43.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:43 smithi043 ceph-mon[111966]: pgmap v34: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.9 MiB/s wr, 445 op/s 2023-12-08T20:29:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:45 smithi111 ceph-mon[121341]: pgmap v35: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 297 op/s 2023-12-08T20:29:46.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:45 smithi043 ceph-mon[111966]: pgmap v35: 65 pgs: 65 active+clean; 305 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 297 op/s 2023-12-08T20:29:46.186 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2023-12-08T20:29:46.186 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-08T20:29:46.546 DEBUG:teuthology.parallel:result is None 2023-12-08T20:29:46.549 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-08T20:29:46.602 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-08T20:29:46.603 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2023-12-08T20:29:46.636 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2023-12-08T20:29:46.636 DEBUG:teuthology.parallel:result is None 2023-12-08T20:29:47.964 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:47 smithi043 ceph-mon[111966]: pgmap v36: 65 pgs: 65 active+clean; 303 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.8 MiB/s wr, 406 op/s 2023-12-08T20:29:47.964 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:47 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:47.964 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:47 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:47.964 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:47 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:47.965 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:47 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:47 smithi111 ceph-mon[121341]: pgmap v36: 65 pgs: 65 active+clean; 303 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.8 MiB/s wr, 406 op/s 2023-12-08T20:29:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:47 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:47 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:47 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:47 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:49.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:49 smithi111 ceph-mon[121341]: pgmap v37: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 305 op/s 2023-12-08T20:29:50.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:49 smithi043 ceph-mon[111966]: pgmap v37: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 305 op/s 2023-12-08T20:29:51.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:51 smithi111 ceph-mon[121341]: pgmap v38: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 285 op/s 2023-12-08T20:29:52.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:51 smithi043 ceph-mon[111966]: pgmap v38: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 285 op/s 2023-12-08T20:29:53.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:53.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:53.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:29:53.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:29:53.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:53.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-08T20:29:53.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-08T20:29:53.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:29:53.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:53 smithi111 ceph-mon[121341]: pgmap v39: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 304 op/s 2023-12-08T20:29:53.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:53.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:53.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:29:53.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:29:53.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:53.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-08T20:29:53.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-08T20:29:53.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:29:53.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:29:53.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:53 smithi043 ceph-mon[111966]: pgmap v39: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 304 op/s 2023-12-08T20:29:55.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:55 smithi111 ceph-mon[121341]: Upgrade: Updating grafana.smithi043 2023-12-08T20:29:55.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:55 smithi111 ceph-mon[121341]: Deploying daemon grafana.smithi043 on smithi043 2023-12-08T20:29:55.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:55 smithi111 ceph-mon[121341]: pgmap v40: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 595 KiB/s wr, 150 op/s 2023-12-08T20:29:55.971 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:55 smithi043 ceph-mon[111966]: Upgrade: Updating grafana.smithi043 2023-12-08T20:29:55.971 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:55 smithi043 ceph-mon[111966]: Deploying daemon grafana.smithi043 on smithi043 2023-12-08T20:29:55.971 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:55 smithi043 ceph-mon[111966]: pgmap v40: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 595 KiB/s wr, 150 op/s 2023-12-08T20:29:56.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:56 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:29:56.972 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:56 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:29:57.951 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:57 smithi043 ceph-mon[111966]: pgmap v41: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 595 KiB/s wr, 150 op/s 2023-12-08T20:29:57.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:57 smithi111 ceph-mon[121341]: pgmap v41: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 595 KiB/s wr, 150 op/s 2023-12-08T20:29:59.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:58 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:59.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:58 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:59.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:58 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:29:59.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:58 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:59.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:58 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:29:59.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:58 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:30:00.214 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:29:59 smithi043 ceph-mon[111966]: pgmap v42: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 69 KiB/s wr, 40 op/s 2023-12-08T20:30:00.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:29:59 smithi111 ceph-mon[121341]: pgmap v42: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 69 KiB/s wr, 40 op/s 2023-12-08T20:30:01.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:00 smithi111 ceph-mon[121341]: overall HEALTH_OK 2023-12-08T20:30:01.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:00 smithi043 ceph-mon[111966]: overall HEALTH_OK 2023-12-08T20:30:02.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:01 smithi111 ceph-mon[121341]: pgmap v43: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 15 KiB/s wr, 19 op/s 2023-12-08T20:30:02.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:01 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:02.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:01 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:02.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:01 smithi043 ceph-mon[111966]: pgmap v43: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 15 KiB/s wr, 19 op/s 2023-12-08T20:30:02.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:01 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:02.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:01 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:03.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:03 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:03.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:03 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:03.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:03 smithi111 ceph-mon[121341]: pgmap v44: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 15 KiB/s wr, 19 op/s 2023-12-08T20:30:03.730 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:03 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:03.730 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:03 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:03.730 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:03 smithi043 ceph-mon[111966]: pgmap v44: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 15 KiB/s wr, 19 op/s 2023-12-08T20:30:04.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.564+0000 7ff7b4bba700 1 -- 172.21.15.43:0/3666083534 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7b00fde00 msgr2=0x7ff7b00fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:04.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.564+0000 7ff7b4bba700 1 --2- 172.21.15.43:0/3666083534 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7b00fde00 0x7ff7b00fe250 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4004940 tx=0x7ff7a4009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:04.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.565+0000 7ff7b4bba700 1 -- 172.21.15.43:0/3666083534 shutdown_connections 2023-12-08T20:30:04.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.565+0000 7ff7b4bba700 1 --2- 172.21.15.43:0/3666083534 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7b00fde00 0x7ff7b00fe250 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:04.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.565+0000 7ff7b4bba700 1 --2- 172.21.15.43:0/3666083534 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff7b00fcbf0 0x7ff7b00fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:04.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.565+0000 7ff7b4bba700 1 -- 172.21.15.43:0/3666083534 >> 172.21.15.43:0/3666083534 conn(0x7ff7b00f82d0 msgr2=0x7ff7b00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:04.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.565+0000 7ff7b4bba700 1 -- 172.21.15.43:0/3666083534 shutdown_connections 2023-12-08T20:30:04.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.565+0000 7ff7b4bba700 1 -- 172.21.15.43:0/3666083534 wait complete. 2023-12-08T20:30:04.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.565+0000 7ff7b4bba700 1 Processor -- start 2023-12-08T20:30:04.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.565+0000 7ff7b4bba700 1 -- start start 2023-12-08T20:30:04.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.566+0000 7ff7b4bba700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7b00fcbf0 0x7ff7b010f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:04.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.566+0000 7ff7b4bba700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff7b00fde00 0x7ff7b010fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:04.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.566+0000 7ff7b4bba700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b0110200 con 0x7ff7b00fcbf0 2023-12-08T20:30:04.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.566+0000 7ff7b4bba700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b0110aa0 con 0x7ff7b00fde00 2023-12-08T20:30:04.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.566+0000 7ff7ae59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7b00fcbf0 0x7ff7b010f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:04.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.566+0000 7ff7ae59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7b00fcbf0 0x7ff7b010f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59234/0 (socket says 172.21.15.43:59234) 2023-12-08T20:30:04.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.566+0000 7ff7ae59c700 1 -- 172.21.15.43:0/1000486608 learned_addr learned my addr 172.21.15.43:0/1000486608 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:30:04.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.566+0000 7ff7add9b700 1 --2- 172.21.15.43:0/1000486608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff7b00fde00 0x7ff7b010fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:04.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.566+0000 7ff7ae59c700 1 -- 172.21.15.43:0/1000486608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff7b00fde00 msgr2=0x7ff7b010fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:04.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.566+0000 7ff7ae59c700 1 --2- 172.21.15.43:0/1000486608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff7b00fde00 0x7ff7b010fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:04.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.566+0000 7ff7ae59c700 1 -- 172.21.15.43:0/1000486608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a4005040 con 0x7ff7b00fcbf0 2023-12-08T20:30:04.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.566+0000 7ff7add9b700 1 --2- 172.21.15.43:0/1000486608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff7b00fde00 0x7ff7b010fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:30:04.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.566+0000 7ff7ae59c700 1 --2- 172.21.15.43:0/1000486608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7b00fcbf0 0x7ff7b010f6c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0002a80 tx=0x7ff7a00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:04.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.567+0000 7ff79effd700 1 -- 172.21.15.43:0/1000486608 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a0007cc0 con 0x7ff7b00fcbf0 2023-12-08T20:30:04.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.567+0000 7ff79effd700 1 -- 172.21.15.43:0/1000486608 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff7a000f040 con 0x7ff7b00fcbf0 2023-12-08T20:30:04.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.567+0000 7ff7b4bba700 1 -- 172.21.15.43:0/1000486608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b0110d80 con 0x7ff7b00fcbf0 2023-12-08T20:30:04.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.567+0000 7ff79effd700 1 -- 172.21.15.43:0/1000486608 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a00095d0 con 0x7ff7b00fcbf0 2023-12-08T20:30:04.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.567+0000 7ff7b4bba700 1 -- 172.21.15.43:0/1000486608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b01112c0 con 0x7ff7b00fcbf0 2023-12-08T20:30:04.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.568+0000 7ff7b4bba700 1 -- 172.21.15.43:0/1000486608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b0101ea0 con 0x7ff7b00fcbf0 2023-12-08T20:30:04.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.568+0000 7ff79effd700 1 -- 172.21.15.43:0/1000486608 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 32) v1 ==== 90899+0+0 (secure 0 0 0) 0x7ff7a0009730 con 0x7ff7b00fcbf0 2023-12-08T20:30:04.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.569+0000 7ff79effd700 1 --2- 172.21.15.43:0/1000486608 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7ff79806cc00 0x7ff79806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:04.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.569+0000 7ff79effd700 1 -- 172.21.15.43:0/1000486608 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ff7a008b8d0 con 0x7ff7b00fcbf0 2023-12-08T20:30:04.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.569+0000 7ff7add9b700 1 --2- 172.21.15.43:0/1000486608 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7ff79806cc00 0x7ff79806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:04.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.570+0000 7ff7add9b700 1 --2- 172.21.15.43:0/1000486608 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7ff79806cc00 0x7ff79806f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4004560 tx=0x7ff7a4009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:04.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.574+0000 7ff79effd700 1 -- 172.21.15.43:0/1000486608 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7ff7a00594f0 con 0x7ff7b00fcbf0 2023-12-08T20:30:04.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.878+0000 7ff7b4bba700 1 -- 172.21.15.43:0/1000486608 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7b0111550 con 0x7ff79806cc00 2023-12-08T20:30:04.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.880+0000 7ff79effd700 1 -- 172.21.15.43:0/1000486608 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7ff7b0111550 con 0x7ff79806cc00 2023-12-08T20:30:04.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.882+0000 7ff7b4bba700 1 -- 172.21.15.43:0/1000486608 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7ff79806cc00 msgr2=0x7ff79806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:04.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.882+0000 7ff7b4bba700 1 --2- 172.21.15.43:0/1000486608 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7ff79806cc00 0x7ff79806f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4004560 tx=0x7ff7a4009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:04.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.882+0000 7ff7b4bba700 1 -- 172.21.15.43:0/1000486608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7b00fcbf0 msgr2=0x7ff7b010f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:04.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.882+0000 7ff7b4bba700 1 --2- 172.21.15.43:0/1000486608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7b00fcbf0 0x7ff7b010f6c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0002a80 tx=0x7ff7a00046b0 comp rx=0 tx=0).stop 2023-12-08T20:30:04.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.882+0000 7ff7b4bba700 1 -- 172.21.15.43:0/1000486608 shutdown_connections 2023-12-08T20:30:04.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.882+0000 7ff7b4bba700 1 --2- 172.21.15.43:0/1000486608 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7ff79806cc00 0x7ff79806f0b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:04.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.882+0000 7ff7b4bba700 1 --2- 172.21.15.43:0/1000486608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7b00fcbf0 0x7ff7b010f6c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:04.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.882+0000 7ff7b4bba700 1 --2- 172.21.15.43:0/1000486608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff7b00fde00 0x7ff7b010fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:04.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.882+0000 7ff7b4bba700 1 -- 172.21.15.43:0/1000486608 >> 172.21.15.43:0/1000486608 conn(0x7ff7b00f82d0 msgr2=0x7ff7b00ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:04.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.882+0000 7ff7b4bba700 1 -- 172.21.15.43:0/1000486608 shutdown_connections 2023-12-08T20:30:04.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:04.882+0000 7ff7b4bba700 1 -- 172.21.15.43:0/1000486608 wait complete. 2023-12-08T20:30:04.898 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:30:05.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.005+0000 7f66434e5700 1 -- 172.21.15.43:0/894053959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f663c104400 msgr2=0x7f663c104850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:05.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.005+0000 7f66434e5700 1 --2- 172.21.15.43:0/894053959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f663c104400 0x7f663c104850 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f662c004940 tx=0x7f662c009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:05.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.005+0000 7f66434e5700 1 -- 172.21.15.43:0/894053959 shutdown_connections 2023-12-08T20:30:05.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.005+0000 7f66434e5700 1 --2- 172.21.15.43:0/894053959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f663c104400 0x7f663c104850 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:05.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.005+0000 7f66434e5700 1 --2- 172.21.15.43:0/894053959 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f663c1031f0 0x7f663c103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:05.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.005+0000 7f66434e5700 1 -- 172.21.15.43:0/894053959 >> 172.21.15.43:0/894053959 conn(0x7f663c072480 msgr2=0x7f663c0748b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:05.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.006+0000 7f66434e5700 1 -- 172.21.15.43:0/894053959 shutdown_connections 2023-12-08T20:30:05.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.006+0000 7f66434e5700 1 -- 172.21.15.43:0/894053959 wait complete. 2023-12-08T20:30:05.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.006+0000 7f66434e5700 1 Processor -- start 2023-12-08T20:30:05.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.006+0000 7f66434e5700 1 -- start start 2023-12-08T20:30:05.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.007+0000 7f66434e5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f663c1031f0 0x7f663c113aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:05.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.007+0000 7f66434e5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f663c104400 0x7f663c113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:05.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.007+0000 7f66434e5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c1145e0 con 0x7f663c104400 2023-12-08T20:30:05.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.007+0000 7f66434e5700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c114e80 con 0x7f663c1031f0 2023-12-08T20:30:05.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.007+0000 7f6640a80700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f663c104400 0x7f663c113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:05.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.007+0000 7f6640a80700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f663c104400 0x7f663c113fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59244/0 (socket says 172.21.15.43:59244) 2023-12-08T20:30:05.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.007+0000 7f6640a80700 1 -- 172.21.15.43:0/4234651829 learned_addr learned my addr 172.21.15.43:0/4234651829 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:30:05.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.007+0000 7f6641281700 1 --2- 172.21.15.43:0/4234651829 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f663c1031f0 0x7f663c113aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:05.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.007+0000 7f6640a80700 1 -- 172.21.15.43:0/4234651829 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f663c1031f0 msgr2=0x7f663c113aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:05.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.007+0000 7f6640a80700 1 --2- 172.21.15.43:0/4234651829 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f663c1031f0 0x7f663c113aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:05.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.007+0000 7f6640a80700 1 -- 172.21.15.43:0/4234651829 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c005040 con 0x7f663c104400 2023-12-08T20:30:05.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.007+0000 7f6641281700 1 --2- 172.21.15.43:0/4234651829 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f663c1031f0 0x7f663c113aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:30:05.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.007+0000 7f6640a80700 1 --2- 172.21.15.43:0/4234651829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f663c104400 0x7f663c113fe0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f662c009380 tx=0x7f662c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:05.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.008+0000 7f6631ffb700 1 -- 172.21.15.43:0/4234651829 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f662c00e040 con 0x7f663c104400 2023-12-08T20:30:05.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.008+0000 7f6631ffb700 1 -- 172.21.15.43:0/4234651829 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f662c00bda0 con 0x7f663c104400 2023-12-08T20:30:05.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.008+0000 7f66434e5700 1 -- 172.21.15.43:0/4234651829 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663c115100 con 0x7f663c104400 2023-12-08T20:30:05.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.008+0000 7f6631ffb700 1 -- 172.21.15.43:0/4234651829 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f662c01c630 con 0x7f663c104400 2023-12-08T20:30:05.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.008+0000 7f66434e5700 1 -- 172.21.15.43:0/4234651829 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c115640 con 0x7f663c104400 2023-12-08T20:30:05.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.009+0000 7f66434e5700 1 -- 172.21.15.43:0/4234651829 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663c04bb80 con 0x7f663c104400 2023-12-08T20:30:05.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.010+0000 7f6631ffb700 1 -- 172.21.15.43:0/4234651829 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 32) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f662c013420 con 0x7f663c104400 2023-12-08T20:30:05.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.010+0000 7f6631ffb700 1 --2- 172.21.15.43:0/4234651829 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f662806ccd0 0x7f662806f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:05.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.011+0000 7f6631ffb700 1 -- 172.21.15.43:0/4234651829 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f662c08d460 con 0x7f663c104400 2023-12-08T20:30:05.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.011+0000 7f6641281700 1 --2- 172.21.15.43:0/4234651829 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f662806ccd0 0x7f662806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:05.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.011+0000 7f6641281700 1 --2- 172.21.15.43:0/4234651829 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f662806ccd0 0x7f662806f180 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f663c104260 tx=0x7f6638007ec0 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:05.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.015+0000 7f6631ffb700 1 -- 172.21.15.43:0/4234651829 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f662c05b0e0 con 0x7f663c104400 2023-12-08T20:30:05.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.255+0000 7f66434e5700 1 -- 172.21.15.43:0/4234651829 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f663c115ae0 con 0x7f662806ccd0 2023-12-08T20:30:05.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.256+0000 7f6631ffb700 1 -- 172.21.15.43:0/4234651829 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f663c115ae0 con 0x7f662806ccd0 2023-12-08T20:30:05.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.258+0000 7f66434e5700 1 -- 172.21.15.43:0/4234651829 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f662806ccd0 msgr2=0x7f662806f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:05.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.258+0000 7f66434e5700 1 --2- 172.21.15.43:0/4234651829 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f662806ccd0 0x7f662806f180 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f663c104260 tx=0x7f6638007ec0 comp rx=0 tx=0).stop 2023-12-08T20:30:05.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.258+0000 7f66434e5700 1 -- 172.21.15.43:0/4234651829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f663c104400 msgr2=0x7f663c113fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:05.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.258+0000 7f66434e5700 1 --2- 172.21.15.43:0/4234651829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f663c104400 0x7f663c113fe0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f662c009380 tx=0x7f662c009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:05.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.258+0000 7f66434e5700 1 -- 172.21.15.43:0/4234651829 shutdown_connections 2023-12-08T20:30:05.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.258+0000 7f66434e5700 1 --2- 172.21.15.43:0/4234651829 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f663c1031f0 0x7f663c113aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:05.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.258+0000 7f66434e5700 1 --2- 172.21.15.43:0/4234651829 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f662806ccd0 0x7f662806f180 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:05.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.258+0000 7f66434e5700 1 --2- 172.21.15.43:0/4234651829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f663c104400 0x7f663c113fe0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:05.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.258+0000 7f66434e5700 1 -- 172.21.15.43:0/4234651829 >> 172.21.15.43:0/4234651829 conn(0x7f663c072480 msgr2=0x7f663c107630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:05.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.258+0000 7f66434e5700 1 -- 172.21.15.43:0/4234651829 shutdown_connections 2023-12-08T20:30:05.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.258+0000 7f66434e5700 1 -- 172.21.15.43:0/4234651829 wait complete. 2023-12-08T20:30:05.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.375+0000 7fcba81e3700 1 -- 172.21.15.43:0/3871551814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcba00fee00 msgr2=0x7fcba00ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:05.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.375+0000 7fcba81e3700 1 --2- 172.21.15.43:0/3871551814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcba00fee00 0x7fcba00ff210 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c004940 tx=0x7fcb9c009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:05.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.375+0000 7fcba81e3700 1 -- 172.21.15.43:0/3871551814 shutdown_connections 2023-12-08T20:30:05.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.375+0000 7fcba81e3700 1 --2- 172.21.15.43:0/3871551814 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcba00fff70 0x7fcba01003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:05.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.375+0000 7fcba81e3700 1 --2- 172.21.15.43:0/3871551814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcba00fee00 0x7fcba00ff210 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:05.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.375+0000 7fcba81e3700 1 -- 172.21.15.43:0/3871551814 >> 172.21.15.43:0/3871551814 conn(0x7fcba00fa5d0 msgr2=0x7fcba00fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:05.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.375+0000 7fcba81e3700 1 -- 172.21.15.43:0/3871551814 shutdown_connections 2023-12-08T20:30:05.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.375+0000 7fcba81e3700 1 -- 172.21.15.43:0/3871551814 wait complete. 2023-12-08T20:30:05.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.376+0000 7fcba81e3700 1 Processor -- start 2023-12-08T20:30:05.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.376+0000 7fcba81e3700 1 -- start start 2023-12-08T20:30:05.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.376+0000 7fcba81e3700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcba00fee00 0x7fcba010f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:05.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.376+0000 7fcba81e3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcba00fff70 0x7fcba010fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:05.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.376+0000 7fcba81e3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba01101f0 con 0x7fcba00fff70 2023-12-08T20:30:05.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.376+0000 7fcba81e3700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba0110a90 con 0x7fcba00fee00 2023-12-08T20:30:05.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.376+0000 7fcba577e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcba00fff70 0x7fcba010fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:05.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.376+0000 7fcba577e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcba00fff70 0x7fcba010fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59258/0 (socket says 172.21.15.43:59258) 2023-12-08T20:30:05.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.376+0000 7fcba577e700 1 -- 172.21.15.43:0/1647963445 learned_addr learned my addr 172.21.15.43:0/1647963445 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:30:05.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.376+0000 7fcba5f7f700 1 --2- 172.21.15.43:0/1647963445 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcba00fee00 0x7fcba010f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:05.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.376+0000 7fcba577e700 1 -- 172.21.15.43:0/1647963445 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcba00fee00 msgr2=0x7fcba010f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:05.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.376+0000 7fcba577e700 1 --2- 172.21.15.43:0/1647963445 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcba00fee00 0x7fcba010f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:05.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.376+0000 7fcba577e700 1 -- 172.21.15.43:0/1647963445 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c005040 con 0x7fcba00fff70 2023-12-08T20:30:05.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.377+0000 7fcba577e700 1 --2- 172.21.15.43:0/1647963445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcba00fff70 0x7fcba010fbf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000eb40 tx=0x7fcb9000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:05.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.377+0000 7fcb967fc700 1 -- 172.21.15.43:0/1647963445 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb90007cc0 con 0x7fcba00fff70 2023-12-08T20:30:05.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.377+0000 7fcba81e3700 1 -- 172.21.15.43:0/1647963445 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba0110d10 con 0x7fcba00fff70 2023-12-08T20:30:05.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.377+0000 7fcb967fc700 1 -- 172.21.15.43:0/1647963445 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcb9000f040 con 0x7fcba00fff70 2023-12-08T20:30:05.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.377+0000 7fcb967fc700 1 -- 172.21.15.43:0/1647963445 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb9000c990 con 0x7fcba00fff70 2023-12-08T20:30:05.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.377+0000 7fcba81e3700 1 -- 172.21.15.43:0/1647963445 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba0111250 con 0x7fcba00fff70 2023-12-08T20:30:05.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.378+0000 7fcba81e3700 1 -- 172.21.15.43:0/1647963445 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba004bb80 con 0x7fcba00fff70 2023-12-08T20:30:05.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.379+0000 7fcb967fc700 1 -- 172.21.15.43:0/1647963445 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 32) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fcb9000cc00 con 0x7fcba00fff70 2023-12-08T20:30:05.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.379+0000 7fcb967fc700 1 --2- 172.21.15.43:0/1647963445 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fcb8c06cc00 0x7fcb8c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:05.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.379+0000 7fcb967fc700 1 -- 172.21.15.43:0/1647963445 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fcb9008bc00 con 0x7fcba00fff70 2023-12-08T20:30:05.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.379+0000 7fcba5f7f700 1 --2- 172.21.15.43:0/1647963445 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fcb8c06cc00 0x7fcb8c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:05.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.380+0000 7fcba5f7f700 1 --2- 172.21.15.43:0/1647963445 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fcb8c06cc00 0x7fcb8c06f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c013680 tx=0x7fcb9c009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:05.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.384+0000 7fcb967fc700 1 -- 172.21.15.43:0/1647963445 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fcb90091020 con 0x7fcba00fff70 2023-12-08T20:30:05.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.578+0000 7fcb967fc700 1 -- 172.21.15.43:0/1647963445 <== mon.0 v2:172.21.15.43:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcb900598d0 con 0x7fcba00fff70 2023-12-08T20:30:05.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.610+0000 7fcba81e3700 1 -- 172.21.15.43:0/1647963445 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcba0104950 con 0x7fcb8c06cc00 2023-12-08T20:30:05.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.621+0000 7fcb967fc700 1 -- 172.21.15.43:0/1647963445 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fcba0104950 con 0x7fcb8c06cc00 2023-12-08T20:30:05.624 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-08T20:30:05.624 INFO:teuthology.orchestra.run.smithi043.stdout:alertmanager.smithi043 smithi043 *:9093,9094 running (23s) 4s ago 8m 17.7M - 0.25.0 c8568f914cd2 d4a6cd00c86b 2023-12-08T20:30:05.624 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi043 smithi043 running (8m) 4s ago 8m 7432k - 17.2.7-119-ge2143d99 f761b6e42225 f84d492b732c 2023-12-08T20:30:05.625 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi111 smithi111 running (7m) 52s ago 7m 7428k - 17.2.7-119-ge2143d99 f761b6e42225 88b53685ae54 2023-12-08T20:30:05.625 INFO:teuthology.orchestra.run.smithi043.stdout:grafana.smithi043 smithi043 *:3000 running (8s) 4s ago 8m 51.4M - 9.4.7 954c08fa6188 8f55491a980b 2023-12-08T20:30:05.625 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.akrjef smithi043 running (4m) 4s ago 4m 17.7M - 17.2.7-119-ge2143d99 f761b6e42225 1c0cb8d34ef8 2023-12-08T20:30:05.625 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.pjmszb smithi043 running (4m) 4s ago 4m 7151M - 17.2.7-119-ge2143d99 f761b6e42225 d7eee0c78093 2023-12-08T20:30:05.625 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.svpasm smithi111 running (4m) 52s ago 4m 15.2M - 17.2.7-119-ge2143d99 f761b6e42225 657d4d1cf4b2 2023-12-08T20:30:05.625 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.veeegc smithi111 running (4m) 52s ago 4m 2612M - 17.2.7-119-ge2143d99 f761b6e42225 31f794a388ab 2023-12-08T20:30:05.625 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi043.hqcdcm smithi043 *:8443,9283,8765 running (96s) 4s ago 9m 507M - 19.0.0-44-g9dcc13bb f28f2b94f153 14e91c1dac64 2023-12-08T20:30:05.626 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi111.mtcffu smithi111 *:8443,9283,8765 running (67s) 52s ago 7m 449M - 19.0.0-44-g9dcc13bb f28f2b94f153 56f4290c6db5 2023-12-08T20:30:05.626 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi043 smithi043 running (9m) 4s ago 9m 100M 2048M 17.2.7-119-ge2143d99 f761b6e42225 fe2a56effef3 2023-12-08T20:30:05.626 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi111 smithi111 running (7m) 52s ago 7m 67.8M 2048M 17.2.7-119-ge2143d99 f761b6e42225 2ae21cf3fa1e 2023-12-08T20:30:05.626 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi043 smithi043 *:9100 running (57s) 4s ago 8m 9.99M - 1.5.0 0da6a335fe13 0959b44d9972 2023-12-08T20:30:05.626 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi111 smithi111 *:9100 running (55s) 52s ago 7m 3862k - 1.5.0 0da6a335fe13 10fe4fdb23d0 2023-12-08T20:30:05.626 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (6m) 4s ago 6m 746M 1570M 17.2.7-119-ge2143d99 f761b6e42225 462eeaf62b2c 2023-12-08T20:30:05.626 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi043 running (6m) 4s ago 6m 853M 1570M 17.2.7-119-ge2143d99 f761b6e42225 dde419c88a89 2023-12-08T20:30:05.627 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi043 running (6m) 4s ago 6m 636M 1570M 17.2.7-119-ge2143d99 f761b6e42225 f7e812026ef5 2023-12-08T20:30:05.627 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi111 running (5m) 52s ago 5m 791M 2592M 17.2.7-119-ge2143d99 f761b6e42225 2a738d30441c 2023-12-08T20:30:05.627 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi111 running (5m) 52s ago 5m 600M 2592M 17.2.7-119-ge2143d99 f761b6e42225 38cdb6a88694 2023-12-08T20:30:05.627 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi111 running (5m) 52s ago 5m 728M 2592M 17.2.7-119-ge2143d99 f761b6e42225 59a9ce8c1141 2023-12-08T20:30:05.627 INFO:teuthology.orchestra.run.smithi043.stdout:prometheus.smithi043 smithi043 *:9095 running (38s) 4s ago 7m 48.1M - 2.43.0 a07b618ecd1d d95914ec88d8 2023-12-08T20:30:05.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.623+0000 7fcba81e3700 1 -- 172.21.15.43:0/1647963445 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fcb8c06cc00 msgr2=0x7fcb8c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:05.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.623+0000 7fcba81e3700 1 --2- 172.21.15.43:0/1647963445 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fcb8c06cc00 0x7fcb8c06f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c013680 tx=0x7fcb9c009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:05.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.623+0000 7fcba81e3700 1 -- 172.21.15.43:0/1647963445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcba00fff70 msgr2=0x7fcba010fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:05.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.623+0000 7fcba81e3700 1 --2- 172.21.15.43:0/1647963445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcba00fff70 0x7fcba010fbf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000eb40 tx=0x7fcb9000b040 comp rx=0 tx=0).stop 2023-12-08T20:30:05.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.624+0000 7fcba81e3700 1 -- 172.21.15.43:0/1647963445 shutdown_connections 2023-12-08T20:30:05.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.624+0000 7fcba81e3700 1 --2- 172.21.15.43:0/1647963445 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcba00fee00 0x7fcba010f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:05.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.624+0000 7fcba81e3700 1 --2- 172.21.15.43:0/1647963445 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fcb8c06cc00 0x7fcb8c06f0b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:05.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.624+0000 7fcba81e3700 1 --2- 172.21.15.43:0/1647963445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcba00fff70 0x7fcba010fbf0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:05.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.624+0000 7fcba81e3700 1 -- 172.21.15.43:0/1647963445 >> 172.21.15.43:0/1647963445 conn(0x7fcba00fa5d0 msgr2=0x7fcba0103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:05.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.624+0000 7fcba81e3700 1 -- 172.21.15.43:0/1647963445 shutdown_connections 2023-12-08T20:30:05.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.624+0000 7fcba81e3700 1 -- 172.21.15.43:0/1647963445 wait complete. 2023-12-08T20:30:05.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.750+0000 7f2786e09700 1 -- 172.21.15.43:0/131236251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27800fdf60 msgr2=0x7f27800fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:05.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.750+0000 7f2786e09700 1 --2- 172.21.15.43:0/131236251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27800fdf60 0x7f27800fe3b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f276c004940 tx=0x7f276c009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:05.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.750+0000 7f2786e09700 1 -- 172.21.15.43:0/131236251 shutdown_connections 2023-12-08T20:30:05.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.750+0000 7f2786e09700 1 --2- 172.21.15.43:0/131236251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27800fdf60 0x7f27800fe3b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:05.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.750+0000 7f2786e09700 1 --2- 172.21.15.43:0/131236251 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27800faed0 0x7f27800fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:05.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.750+0000 7f2786e09700 1 -- 172.21.15.43:0/131236251 >> 172.21.15.43:0/131236251 conn(0x7f27800f6950 msgr2=0x7f27800f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:05.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.751+0000 7f2786e09700 1 -- 172.21.15.43:0/131236251 shutdown_connections 2023-12-08T20:30:05.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.751+0000 7f2786e09700 1 -- 172.21.15.43:0/131236251 wait complete. 2023-12-08T20:30:05.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.751+0000 7f2786e09700 1 Processor -- start 2023-12-08T20:30:05.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.751+0000 7f2786e09700 1 -- start start 2023-12-08T20:30:05.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.752+0000 7f2786e09700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27800faed0 0x7f278010d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:05.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.752+0000 7f2786e09700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27800fdf60 0x7f278010da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:05.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.752+0000 7f2786e09700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278010e090 con 0x7f27800faed0 2023-12-08T20:30:05.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.752+0000 7f2786e09700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278010e930 con 0x7f27800fdf60 2023-12-08T20:30:05.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.752+0000 7f2784ba5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27800faed0 0x7f278010d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:05.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.752+0000 7f2784ba5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27800faed0 0x7f278010d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59276/0 (socket says 172.21.15.43:59276) 2023-12-08T20:30:05.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.752+0000 7f2784ba5700 1 -- 172.21.15.43:0/878030274 learned_addr learned my addr 172.21.15.43:0/878030274 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:30:05.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.752+0000 7f277ffff700 1 --2- 172.21.15.43:0/878030274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27800fdf60 0x7f278010da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:05.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.752+0000 7f2784ba5700 1 -- 172.21.15.43:0/878030274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27800fdf60 msgr2=0x7f278010da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:05.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.752+0000 7f2784ba5700 1 --2- 172.21.15.43:0/878030274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27800fdf60 0x7f278010da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:05.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.752+0000 7f2784ba5700 1 -- 172.21.15.43:0/878030274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c005040 con 0x7f27800faed0 2023-12-08T20:30:05.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.752+0000 7f277ffff700 1 --2- 172.21.15.43:0/878030274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27800fdf60 0x7f278010da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:30:05.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.753+0000 7f2784ba5700 1 --2- 172.21.15.43:0/878030274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27800faed0 0x7f278010d550 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2774002a80 tx=0x7f27740046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:05.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.753+0000 7f277d7fa700 1 -- 172.21.15.43:0/878030274 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2774007cc0 con 0x7f27800faed0 2023-12-08T20:30:05.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.753+0000 7f277d7fa700 1 -- 172.21.15.43:0/878030274 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f277400f040 con 0x7f27800faed0 2023-12-08T20:30:05.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.753+0000 7f2786e09700 1 -- 172.21.15.43:0/878030274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278010ec10 con 0x7f27800faed0 2023-12-08T20:30:05.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.753+0000 7f277d7fa700 1 -- 172.21.15.43:0/878030274 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27740095d0 con 0x7f27800faed0 2023-12-08T20:30:05.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.753+0000 7f2786e09700 1 -- 172.21.15.43:0/878030274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278010f150 con 0x7f27800faed0 2023-12-08T20:30:05.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.754+0000 7f2786e09700 1 -- 172.21.15.43:0/878030274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278004bb80 con 0x7f27800faed0 2023-12-08T20:30:05.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.754+0000 7f277d7fa700 1 -- 172.21.15.43:0/878030274 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 32) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f2774009730 con 0x7f27800faed0 2023-12-08T20:30:05.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.755+0000 7f277d7fa700 1 --2- 172.21.15.43:0/878030274 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f277006cc00 0x7f277006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:05.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.755+0000 7f277d7fa700 1 -- 172.21.15.43:0/878030274 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f277408b800 con 0x7f27800faed0 2023-12-08T20:30:05.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.755+0000 7f277ffff700 1 --2- 172.21.15.43:0/878030274 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f277006cc00 0x7f277006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:05.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.756+0000 7f277ffff700 1 --2- 172.21.15.43:0/878030274 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f277006cc00 0x7f277006f0b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f276c004f90 tx=0x7f276c009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:05.760+0000 7f277d7fa700 1 -- 172.21.15.43:0/878030274 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f27740594a0 con 0x7f27800faed0 2023-12-08T20:30:05.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: pgmap v45: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-08T20:30:05.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:30:05.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:05.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:05.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:30:05.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:30:05.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:05.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-08T20:30:05.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:30:05.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:05.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:05.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:05.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:05.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:05.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:05.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:05.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:05.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:05.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:05.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:05.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:05.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:05.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:05.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:05.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-12-08T20:30:05.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2023-12-08T20:30:05.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-08T20:30:05.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2023-12-08T20:30:05.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-12-08T20:30:05.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-12-08T20:30:05.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-12-08T20:30:05.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-12-08T20:30:05.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2023-12-08T20:30:05.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-12-08T20:30:05.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2023-12-08T20:30:05.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-08T20:30:05.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2023-12-08T20:30:05.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2023-12-08T20:30:05.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-12-08T20:30:05.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2023-12-08T20:30:05.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-12-08T20:30:05.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2023-12-08T20:30:05.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2023-12-08T20:30:05.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2023-12-08T20:30:05.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-08T20:30:05.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-08T20:30:05.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-08T20:30:05.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-08T20:30:05.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-08T20:30:05.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-08T20:30:05.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-12-08T20:30:05.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2023-12-08T20:30:05.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:30:05.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:30:05.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:30:05.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:05 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:06.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: pgmap v45: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-08T20:30:06.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:30:06.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:06.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:06.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:30:06.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:30:06.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:06.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-08T20:30:06.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:30:06.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:06.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:06.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:06.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:06.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:06.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:06.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:06.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:06.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:06.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:06.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:06.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:06.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:06.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:06.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:06.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-12-08T20:30:06.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2023-12-08T20:30:06.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-08T20:30:06.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2023-12-08T20:30:06.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-12-08T20:30:06.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-12-08T20:30:06.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-12-08T20:30:06.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-12-08T20:30:06.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2023-12-08T20:30:06.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-12-08T20:30:06.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2023-12-08T20:30:06.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-08T20:30:06.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2023-12-08T20:30:06.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2023-12-08T20:30:06.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-12-08T20:30:06.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2023-12-08T20:30:06.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-12-08T20:30:06.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2023-12-08T20:30:06.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2023-12-08T20:30:06.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2023-12-08T20:30:06.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-08T20:30:06.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-08T20:30:06.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-08T20:30:06.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-08T20:30:06.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-08T20:30:06.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-08T20:30:06.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-12-08T20:30:06.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2023-12-08T20:30:06.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:30:06.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:30:06.018 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:30:06.018 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:05 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:06.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.073+0000 7f2786e09700 1 -- 172.21.15.43:0/878030274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f278010f4e0 con 0x7f27800faed0 2023-12-08T20:30:06.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.074+0000 7f277d7fa700 1 -- 172.21.15.43:0/878030274 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f2774059030 con 0x7f27800faed0 2023-12-08T20:30:06.076 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:30:06.076 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": { 2023-12-08T20:30:06.076 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2 2023-12-08T20:30:06.076 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:30:06.076 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": { 2023-12-08T20:30:06.077 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:30:06.077 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:30:06.077 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": { 2023-12-08T20:30:06.077 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 6 2023-12-08T20:30:06.077 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:30:06.077 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2023-12-08T20:30:06.077 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-08T20:30:06.077 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:30:06.077 INFO:teuthology.orchestra.run.smithi043.stdout: "overall": { 2023-12-08T20:30:06.077 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 12, 2023-12-08T20:30:06.077 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:30:06.077 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-12-08T20:30:06.077 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:30:06.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.076+0000 7f2786e09700 1 -- 172.21.15.43:0/878030274 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f277006cc00 msgr2=0x7f277006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:06.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.076+0000 7f2786e09700 1 --2- 172.21.15.43:0/878030274 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f277006cc00 0x7f277006f0b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f276c004f90 tx=0x7f276c009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:06.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.076+0000 7f2786e09700 1 -- 172.21.15.43:0/878030274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27800faed0 msgr2=0x7f278010d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:06.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.076+0000 7f2786e09700 1 --2- 172.21.15.43:0/878030274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27800faed0 0x7f278010d550 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2774002a80 tx=0x7f27740046b0 comp rx=0 tx=0).stop 2023-12-08T20:30:06.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.076+0000 7f2786e09700 1 -- 172.21.15.43:0/878030274 shutdown_connections 2023-12-08T20:30:06.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.076+0000 7f2786e09700 1 --2- 172.21.15.43:0/878030274 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f277006cc00 0x7f277006f0b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:06.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.076+0000 7f2786e09700 1 --2- 172.21.15.43:0/878030274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27800faed0 0x7f278010d550 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:06.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.076+0000 7f2786e09700 1 --2- 172.21.15.43:0/878030274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27800fdf60 0x7f278010da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:06.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.076+0000 7f2786e09700 1 -- 172.21.15.43:0/878030274 >> 172.21.15.43:0/878030274 conn(0x7f27800f6950 msgr2=0x7f2780101190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:06.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.076+0000 7f2786e09700 1 -- 172.21.15.43:0/878030274 shutdown_connections 2023-12-08T20:30:06.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.076+0000 7f2786e09700 1 -- 172.21.15.43:0/878030274 wait complete. 2023-12-08T20:30:06.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.190+0000 7fcd44a3e700 1 -- 172.21.15.43:0/2687254043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd40100050 msgr2=0x7fcd40102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:06.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.190+0000 7fcd44a3e700 1 --2- 172.21.15.43:0/2687254043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd40100050 0x7fcd40102430 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcd28004940 tx=0x7fcd28009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:06.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.190+0000 7fcd44a3e700 1 -- 172.21.15.43:0/2687254043 shutdown_connections 2023-12-08T20:30:06.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.190+0000 7fcd44a3e700 1 --2- 172.21.15.43:0/2687254043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd40100050 0x7fcd40102430 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:06.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.190+0000 7fcd44a3e700 1 --2- 172.21.15.43:0/2687254043 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd400fd730 0x7fcd400ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:06.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.190+0000 7fcd44a3e700 1 -- 172.21.15.43:0/2687254043 >> 172.21.15.43:0/2687254043 conn(0x7fcd400f7190 msgr2=0x7fcd400f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:06.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.190+0000 7fcd44a3e700 1 -- 172.21.15.43:0/2687254043 shutdown_connections 2023-12-08T20:30:06.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.190+0000 7fcd44a3e700 1 -- 172.21.15.43:0/2687254043 wait complete. 2023-12-08T20:30:06.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.191+0000 7fcd44a3e700 1 Processor -- start 2023-12-08T20:30:06.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.191+0000 7fcd44a3e700 1 -- start start 2023-12-08T20:30:06.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.191+0000 7fcd44a3e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd400fd730 0x7fcd4010d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:06.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.191+0000 7fcd44a3e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd40100050 0x7fcd4010da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:06.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.191+0000 7fcd44a3e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4010e070 con 0x7fcd400fd730 2023-12-08T20:30:06.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.191+0000 7fcd44a3e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4010e910 con 0x7fcd40100050 2023-12-08T20:30:06.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.191+0000 7fcd3e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd400fd730 0x7fcd4010d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:06.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.191+0000 7fcd3e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd400fd730 0x7fcd4010d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59286/0 (socket says 172.21.15.43:59286) 2023-12-08T20:30:06.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.191+0000 7fcd3e59c700 1 -- 172.21.15.43:0/912395921 learned_addr learned my addr 172.21.15.43:0/912395921 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:30:06.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.191+0000 7fcd3dd9b700 1 --2- 172.21.15.43:0/912395921 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd40100050 0x7fcd4010da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:06.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.191+0000 7fcd3e59c700 1 -- 172.21.15.43:0/912395921 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd40100050 msgr2=0x7fcd4010da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:06.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.191+0000 7fcd3e59c700 1 --2- 172.21.15.43:0/912395921 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd40100050 0x7fcd4010da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:06.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.191+0000 7fcd3e59c700 1 -- 172.21.15.43:0/912395921 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd28005040 con 0x7fcd400fd730 2023-12-08T20:30:06.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.192+0000 7fcd3e59c700 1 --2- 172.21.15.43:0/912395921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd400fd730 0x7fcd4010d530 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcd30002a50 tx=0x7fcd300046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:06.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.192+0000 7fcd36ffd700 1 -- 172.21.15.43:0/912395921 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd30007cc0 con 0x7fcd400fd730 2023-12-08T20:30:06.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.192+0000 7fcd36ffd700 1 -- 172.21.15.43:0/912395921 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcd3000f040 con 0x7fcd400fd730 2023-12-08T20:30:06.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.192+0000 7fcd44a3e700 1 -- 172.21.15.43:0/912395921 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4010ebf0 con 0x7fcd400fd730 2023-12-08T20:30:06.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.192+0000 7fcd36ffd700 1 -- 172.21.15.43:0/912395921 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd3000d9c0 con 0x7fcd400fd730 2023-12-08T20:30:06.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.192+0000 7fcd44a3e700 1 -- 172.21.15.43:0/912395921 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4010f130 con 0x7fcd400fd730 2023-12-08T20:30:06.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.193+0000 7fcd44a3e700 1 -- 172.21.15.43:0/912395921 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd401075c0 con 0x7fcd400fd730 2023-12-08T20:30:06.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.194+0000 7fcd36ffd700 1 -- 172.21.15.43:0/912395921 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 32) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fcd3000db20 con 0x7fcd400fd730 2023-12-08T20:30:06.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.194+0000 7fcd36ffd700 1 --2- 172.21.15.43:0/912395921 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fcd2c06cc00 0x7fcd2c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:06.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.194+0000 7fcd36ffd700 1 -- 172.21.15.43:0/912395921 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fcd3008bc40 con 0x7fcd400fd730 2023-12-08T20:30:06.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.194+0000 7fcd3dd9b700 1 --2- 172.21.15.43:0/912395921 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fcd2c06cc00 0x7fcd2c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:06.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.195+0000 7fcd3dd9b700 1 --2- 172.21.15.43:0/912395921 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fcd2c06cc00 0x7fcd2c06f0b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800b3b0 tx=0x7fcd28009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:06.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.199+0000 7fcd36ffd700 1 -- 172.21.15.43:0/912395921 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fcd300598e0 con 0x7fcd400fd730 2023-12-08T20:30:06.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.425+0000 7fcd44a3e700 1 -- 172.21.15.43:0/912395921 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd4010f410 con 0x7fcd2c06cc00 2023-12-08T20:30:06.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.427+0000 7fcd36ffd700 1 -- 172.21.15.43:0/912395921 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fcd4010f410 con 0x7fcd2c06cc00 2023-12-08T20:30:06.429 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:30:06.429 INFO:teuthology.orchestra.run.smithi043.stdout: "target_image": null, 2023-12-08T20:30:06.429 INFO:teuthology.orchestra.run.smithi043.stdout: "in_progress": false, 2023-12-08T20:30:06.429 INFO:teuthology.orchestra.run.smithi043.stdout: "which": "", 2023-12-08T20:30:06.429 INFO:teuthology.orchestra.run.smithi043.stdout: "services_complete": [], 2023-12-08T20:30:06.429 INFO:teuthology.orchestra.run.smithi043.stdout: "progress": null, 2023-12-08T20:30:06.429 INFO:teuthology.orchestra.run.smithi043.stdout: "message": "", 2023-12-08T20:30:06.430 INFO:teuthology.orchestra.run.smithi043.stdout: "is_paused": false 2023-12-08T20:30:06.430 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:30:06.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.429+0000 7fcd44a3e700 1 -- 172.21.15.43:0/912395921 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fcd2c06cc00 msgr2=0x7fcd2c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:06.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.429+0000 7fcd44a3e700 1 --2- 172.21.15.43:0/912395921 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fcd2c06cc00 0x7fcd2c06f0b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800b3b0 tx=0x7fcd28009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:06.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.429+0000 7fcd44a3e700 1 -- 172.21.15.43:0/912395921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd400fd730 msgr2=0x7fcd4010d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:06.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.429+0000 7fcd44a3e700 1 --2- 172.21.15.43:0/912395921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd400fd730 0x7fcd4010d530 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcd30002a50 tx=0x7fcd300046b0 comp rx=0 tx=0).stop 2023-12-08T20:30:06.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.429+0000 7fcd44a3e700 1 -- 172.21.15.43:0/912395921 shutdown_connections 2023-12-08T20:30:06.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.429+0000 7fcd44a3e700 1 --2- 172.21.15.43:0/912395921 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7fcd2c06cc00 0x7fcd2c06f0b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:06.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.429+0000 7fcd44a3e700 1 --2- 172.21.15.43:0/912395921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd400fd730 0x7fcd4010d530 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:06.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.429+0000 7fcd44a3e700 1 --2- 172.21.15.43:0/912395921 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd40100050 0x7fcd4010da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:06.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.429+0000 7fcd44a3e700 1 -- 172.21.15.43:0/912395921 >> 172.21.15.43:0/912395921 conn(0x7fcd400f7190 msgr2=0x7fcd400f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:06.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.429+0000 7fcd44a3e700 1 -- 172.21.15.43:0/912395921 shutdown_connections 2023-12-08T20:30:06.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:06.429+0000 7fcd44a3e700 1 -- 172.21.15.43:0/912395921 wait complete. 2023-12-08T20:30:06.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:06 smithi111 ceph-mon[121341]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:30:06.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:06 smithi111 ceph-mon[121341]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-08T20:30:06.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:06 smithi111 ceph-mon[121341]: Upgrade: Finalizing container_image settings 2023-12-08T20:30:06.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:06 smithi111 ceph-mon[121341]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:30:06.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:06 smithi111 ceph-mon[121341]: Upgrade: Complete! 2023-12-08T20:30:06.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:06 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:30:06.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:06 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:30:06.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:06 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:30:06.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:06 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:06.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:06 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:06.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:06 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/878030274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:07.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:06 smithi043 ceph-mon[111966]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:30:07.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:06 smithi043 ceph-mon[111966]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-08T20:30:07.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:06 smithi043 ceph-mon[111966]: Upgrade: Finalizing container_image settings 2023-12-08T20:30:07.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:06 smithi043 ceph-mon[111966]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:30:07.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:06 smithi043 ceph-mon[111966]: Upgrade: Complete! 2023-12-08T20:30:07.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:06 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:30:07.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:06 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:30:07.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:06 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:30:07.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:06 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:07.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:06 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:07.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:06 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/878030274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:08.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:07 smithi111 ceph-mon[121341]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:30:08.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:07 smithi111 ceph-mon[121341]: pgmap v46: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-08T20:30:08.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:07 smithi043 ceph-mon[111966]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:30:08.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:07 smithi043 ceph-mon[111966]: pgmap v46: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-08T20:30:10.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:09 smithi111 ceph-mon[121341]: pgmap v47: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-08T20:30:10.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:09 smithi043 ceph-mon[111966]: pgmap v47: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-08T20:30:11.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:11 smithi111 ceph-mon[121341]: pgmap v48: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:11.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:11 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:30:12.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:11 smithi043 ceph-mon[111966]: pgmap v48: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:12.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:11 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:30:12.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:12 smithi111 ceph-mon[121341]: mgrmap e33: smithi043.hqcdcm(active, since 90s), standbys: smithi111.mtcffu 2023-12-08T20:30:13.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:12 smithi043 ceph-mon[111966]: mgrmap e33: smithi043.hqcdcm(active, since 90s), standbys: smithi111.mtcffu 2023-12-08T20:30:13.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:13 smithi111 ceph-mon[121341]: pgmap v49: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-08T20:30:14.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:13 smithi043 ceph-mon[111966]: pgmap v49: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-08T20:30:15.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:15 smithi111 ceph-mon[121341]: pgmap v50: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-08T20:30:16.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:15 smithi043 ceph-mon[111966]: pgmap v50: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-08T20:30:17.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:17 smithi111 ceph-mon[121341]: pgmap v51: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-08T20:30:18.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:17 smithi043 ceph-mon[111966]: pgmap v51: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-08T20:30:19.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:19 smithi111 ceph-mon[121341]: pgmap v52: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-08T20:30:20.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:19 smithi043 ceph-mon[111966]: pgmap v52: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-08T20:30:21.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:21 smithi111 ceph-mon[121341]: pgmap v53: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-08T20:30:22.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:21 smithi043 ceph-mon[111966]: pgmap v53: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-08T20:30:23.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:23 smithi111 ceph-mon[121341]: pgmap v54: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-08T20:30:24.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:23 smithi043 ceph-mon[111966]: pgmap v54: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-08T20:30:25.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:25 smithi111 ceph-mon[121341]: pgmap v55: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:26.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:25 smithi043 ceph-mon[111966]: pgmap v55: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:26.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:26 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:30:27.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:26 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:30:27.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:27 smithi111 ceph-mon[121341]: pgmap v56: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:28.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:27 smithi043 ceph-mon[111966]: pgmap v56: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:29.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:29 smithi111 ceph-mon[121341]: pgmap v57: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:30.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:29 smithi043 ceph-mon[111966]: pgmap v57: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:31.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:31 smithi111 ceph-mon[121341]: pgmap v58: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:32.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:31 smithi043 ceph-mon[111966]: pgmap v58: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:33.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:33 smithi111 ceph-mon[121341]: pgmap v59: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:34.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:33 smithi043 ceph-mon[111966]: pgmap v59: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:35.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:35 smithi111 ceph-mon[121341]: pgmap v60: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:36.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:35 smithi043 ceph-mon[111966]: pgmap v60: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:36.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.554+0000 7f4c0abb7700 1 -- 172.21.15.43:0/1691604281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c04100050 msgr2=0x7f4c04102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:36.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.554+0000 7f4c0abb7700 1 --2- 172.21.15.43:0/1691604281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c04100050 0x7f4c04102430 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8004940 tx=0x7f4bf8009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:36.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.554+0000 7f4c0abb7700 1 -- 172.21.15.43:0/1691604281 shutdown_connections 2023-12-08T20:30:36.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.554+0000 7f4c0abb7700 1 --2- 172.21.15.43:0/1691604281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c04100050 0x7f4c04102430 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:36.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.554+0000 7f4c0abb7700 1 --2- 172.21.15.43:0/1691604281 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c040fd730 0x7f4c040ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:36.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.554+0000 7f4c0abb7700 1 -- 172.21.15.43:0/1691604281 >> 172.21.15.43:0/1691604281 conn(0x7f4c040f7190 msgr2=0x7f4c040f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:36.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.554+0000 7f4c0abb7700 1 -- 172.21.15.43:0/1691604281 shutdown_connections 2023-12-08T20:30:36.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.554+0000 7f4c0abb7700 1 -- 172.21.15.43:0/1691604281 wait complete. 2023-12-08T20:30:36.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.554+0000 7f4c0abb7700 1 Processor -- start 2023-12-08T20:30:36.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.554+0000 7f4c0abb7700 1 -- start start 2023-12-08T20:30:36.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.555+0000 7f4c0abb7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c040fd730 0x7f4c0410d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.555+0000 7f4c0abb7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c04100050 0x7f4c0410da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.555+0000 7f4c0abb7700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0410e000 con 0x7f4c040fd730 2023-12-08T20:30:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.555+0000 7f4c0abb7700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0410e8a0 con 0x7f4c04100050 2023-12-08T20:30:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.555+0000 7f4c08953700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c040fd730 0x7f4c0410d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.555+0000 7f4c08953700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c040fd730 0x7f4c0410d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41470/0 (socket says 172.21.15.43:41470) 2023-12-08T20:30:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.555+0000 7f4c08953700 1 -- 172.21.15.43:0/1973822303 learned_addr learned my addr 172.21.15.43:0/1973822303 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:30:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.555+0000 7f4c03fff700 1 --2- 172.21.15.43:0/1973822303 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c04100050 0x7f4c0410da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.555+0000 7f4c08953700 1 -- 172.21.15.43:0/1973822303 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c04100050 msgr2=0x7f4c0410da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.555+0000 7f4c08953700 1 --2- 172.21.15.43:0/1973822303 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c04100050 0x7f4c0410da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.555+0000 7f4c08953700 1 -- 172.21.15.43:0/1973822303 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf8005040 con 0x7f4c040fd730 2023-12-08T20:30:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.556+0000 7f4c08953700 1 --2- 172.21.15.43:0/1973822303 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c040fd730 0x7f4c0410d4c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400eb70 tx=0x7f4bf400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.556+0000 7f4c017fa700 1 -- 172.21.15.43:0/1973822303 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bf4007cc0 con 0x7f4c040fd730 2023-12-08T20:30:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.556+0000 7f4c0abb7700 1 -- 172.21.15.43:0/1973822303 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0410eb20 con 0x7f4c040fd730 2023-12-08T20:30:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.556+0000 7f4c017fa700 1 -- 172.21.15.43:0/1973822303 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4bf400f040 con 0x7f4c040fd730 2023-12-08T20:30:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.556+0000 7f4c017fa700 1 -- 172.21.15.43:0/1973822303 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bf400c9f0 con 0x7f4c040fd730 2023-12-08T20:30:36.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.556+0000 7f4c0abb7700 1 -- 172.21.15.43:0/1973822303 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0410f060 con 0x7f4c040fd730 2023-12-08T20:30:36.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.557+0000 7f4c0abb7700 1 -- 172.21.15.43:0/1973822303 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0404bb80 con 0x7f4c040fd730 2023-12-08T20:30:36.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.557+0000 7f4c017fa700 1 -- 172.21.15.43:0/1973822303 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f4bf400cb50 con 0x7f4c040fd730 2023-12-08T20:30:36.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.558+0000 7f4c017fa700 1 --2- 172.21.15.43:0/1973822303 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f4bec06cae0 0x7f4bec06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:36.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.558+0000 7f4c017fa700 1 -- 172.21.15.43:0/1973822303 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f4bf408b910 con 0x7f4c040fd730 2023-12-08T20:30:36.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.558+0000 7f4c03fff700 1 --2- 172.21.15.43:0/1973822303 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f4bec06cae0 0x7f4bec06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:36.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.558+0000 7f4c03fff700 1 --2- 172.21.15.43:0/1973822303 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f4bec06cae0 0x7f4bec06ef90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8000c00 tx=0x7f4bf8009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:36.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.563+0000 7f4c017fa700 1 -- 172.21.15.43:0/1973822303 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f4bf4059750 con 0x7f4c040fd730 2023-12-08T20:30:36.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.795+0000 7f4c0abb7700 1 -- 172.21.15.43:0/1973822303 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c0410f470 con 0x7f4bec06cae0 2023-12-08T20:30:36.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.796+0000 7f4c017fa700 1 -- 172.21.15.43:0/1973822303 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f4c0410f470 con 0x7f4bec06cae0 2023-12-08T20:30:36.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.798+0000 7f4c0abb7700 1 -- 172.21.15.43:0/1973822303 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f4bec06cae0 msgr2=0x7f4bec06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:36.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.798+0000 7f4c0abb7700 1 --2- 172.21.15.43:0/1973822303 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f4bec06cae0 0x7f4bec06ef90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8000c00 tx=0x7f4bf8009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:36.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.798+0000 7f4c0abb7700 1 -- 172.21.15.43:0/1973822303 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c040fd730 msgr2=0x7f4c0410d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:36.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.798+0000 7f4c0abb7700 1 --2- 172.21.15.43:0/1973822303 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c040fd730 0x7f4c0410d4c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400eb70 tx=0x7f4bf400b040 comp rx=0 tx=0).stop 2023-12-08T20:30:36.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.798+0000 7f4c0abb7700 1 -- 172.21.15.43:0/1973822303 shutdown_connections 2023-12-08T20:30:36.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.798+0000 7f4c0abb7700 1 --2- 172.21.15.43:0/1973822303 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f4bec06cae0 0x7f4bec06ef90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:36.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.798+0000 7f4c0abb7700 1 --2- 172.21.15.43:0/1973822303 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c040fd730 0x7f4c0410d4c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:36.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.798+0000 7f4c0abb7700 1 --2- 172.21.15.43:0/1973822303 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c04100050 0x7f4c0410da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:36.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.798+0000 7f4c0abb7700 1 -- 172.21.15.43:0/1973822303 >> 172.21.15.43:0/1973822303 conn(0x7f4c040f7190 msgr2=0x7f4c040f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:36.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.798+0000 7f4c0abb7700 1 -- 172.21.15.43:0/1973822303 shutdown_connections 2023-12-08T20:30:36.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:36.798+0000 7f4c0abb7700 1 -- 172.21.15.43:0/1973822303 wait complete. 2023-12-08T20:30:37.318 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2023-12-08T20:30:37.622 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:30:37.965 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:37 smithi043 ceph-mon[111966]: pgmap v61: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:37.965 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:37 smithi043 ceph-mon[111966]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:30:37.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:37 smithi111 ceph-mon[121341]: pgmap v61: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:37.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:37 smithi111 ceph-mon[121341]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:30:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.752+0000 7f9c46bc4700 1 -- 172.21.15.43:0/1410199007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c40065390 msgr2=0x7f9c40065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.752+0000 7f9c46bc4700 1 --2- 172.21.15.43:0/1410199007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c40065390 0x7f9c40065800 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c004940 tx=0x7f9c2c009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.752+0000 7f9c46bc4700 1 -- 172.21.15.43:0/1410199007 shutdown_connections 2023-12-08T20:30:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.752+0000 7f9c46bc4700 1 --2- 172.21.15.43:0/1410199007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c40065390 0x7f9c40065800 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.752+0000 7f9c46bc4700 1 --2- 172.21.15.43:0/1410199007 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c40102c20 0x7f9c40102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.752+0000 7f9c46bc4700 1 -- 172.21.15.43:0/1410199007 >> 172.21.15.43:0/1410199007 conn(0x7f9c400719b0 msgr2=0x7f9c40071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.752+0000 7f9c46bc4700 1 -- 172.21.15.43:0/1410199007 shutdown_connections 2023-12-08T20:30:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.752+0000 7f9c46bc4700 1 -- 172.21.15.43:0/1410199007 wait complete. 2023-12-08T20:30:38.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.753+0000 7f9c46bc4700 1 Processor -- start 2023-12-08T20:30:38.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.753+0000 7f9c46bc4700 1 -- start start 2023-12-08T20:30:38.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.754+0000 7f9c46bc4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c40065390 0x7f9c401135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:38.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.754+0000 7f9c46bc4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c40102c20 0x7f9c40113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:38.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.754+0000 7f9c46bc4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c40114170 con 0x7f9c40065390 2023-12-08T20:30:38.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.754+0000 7f9c46bc4700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4010d4a0 con 0x7f9c40102c20 2023-12-08T20:30:38.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.754+0000 7f9c44960700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c40065390 0x7f9c401135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:38.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.754+0000 7f9c44960700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c40065390 0x7f9c401135e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41492/0 (socket says 172.21.15.43:41492) 2023-12-08T20:30:38.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.754+0000 7f9c44960700 1 -- 172.21.15.43:0/1507604305 learned_addr learned my addr 172.21.15.43:0/1507604305 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:30:38.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.754+0000 7f9c3ffff700 1 --2- 172.21.15.43:0/1507604305 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c40102c20 0x7f9c40113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:38.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.754+0000 7f9c44960700 1 -- 172.21.15.43:0/1507604305 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c40102c20 msgr2=0x7f9c40113b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:38.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.754+0000 7f9c44960700 1 --2- 172.21.15.43:0/1507604305 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c40102c20 0x7f9c40113b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:38.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.754+0000 7f9c44960700 1 -- 172.21.15.43:0/1507604305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c005040 con 0x7f9c40065390 2023-12-08T20:30:38.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.755+0000 7f9c44960700 1 --2- 172.21.15.43:0/1507604305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c40065390 0x7f9c401135e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400eb40 tx=0x7f9c3400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:38.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.755+0000 7f9c3d7fa700 1 -- 172.21.15.43:0/1507604305 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c34007cc0 con 0x7f9c40065390 2023-12-08T20:30:38.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.755+0000 7f9c46bc4700 1 -- 172.21.15.43:0/1507604305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c4010d720 con 0x7f9c40065390 2023-12-08T20:30:38.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.755+0000 7f9c3d7fa700 1 -- 172.21.15.43:0/1507604305 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9c3400f040 con 0x7f9c40065390 2023-12-08T20:30:38.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.755+0000 7f9c3d7fa700 1 -- 172.21.15.43:0/1507604305 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c3400c990 con 0x7f9c40065390 2023-12-08T20:30:38.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.755+0000 7f9c46bc4700 1 -- 172.21.15.43:0/1507604305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4010dc60 con 0x7f9c40065390 2023-12-08T20:30:38.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.756+0000 7f9c46bc4700 1 -- 172.21.15.43:0/1507604305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c400fff40 con 0x7f9c40065390 2023-12-08T20:30:38.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.756+0000 7f9c3d7fa700 1 -- 172.21.15.43:0/1507604305 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f9c3400cc00 con 0x7f9c40065390 2023-12-08T20:30:38.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.757+0000 7f9c3d7fa700 1 --2- 172.21.15.43:0/1507604305 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f9c3006caf0 0x7f9c3006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:38.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.757+0000 7f9c3d7fa700 1 -- 172.21.15.43:0/1507604305 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f9c3408ba10 con 0x7f9c40065390 2023-12-08T20:30:38.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.757+0000 7f9c3ffff700 1 --2- 172.21.15.43:0/1507604305 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f9c3006caf0 0x7f9c3006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:38.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.757+0000 7f9c3ffff700 1 --2- 172.21.15.43:0/1507604305 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f9c3006caf0 0x7f9c3006efa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9c4010ee80 tx=0x7f9c2c009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:38.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:38.762+0000 7f9c3d7fa700 1 -- 172.21.15.43:0/1507604305 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f9c34059860 con 0x7f9c40065390 2023-12-08T20:30:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:39.056+0000 7f9c46bc4700 1 -- 172.21.15.43:0/1507604305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9c4004bb80 con 0x7f9c40065390 2023-12-08T20:30:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:39.057+0000 7f9c3d7fa700 1 -- 172.21.15.43:0/1507604305 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f9c340593f0 con 0x7f9c40065390 2023-12-08T20:30:39.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:39.059+0000 7f9c46bc4700 1 -- 172.21.15.43:0/1507604305 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f9c3006caf0 msgr2=0x7f9c3006efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:39.059+0000 7f9c46bc4700 1 --2- 172.21.15.43:0/1507604305 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f9c3006caf0 0x7f9c3006efa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9c4010ee80 tx=0x7f9c2c009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:39.059+0000 7f9c46bc4700 1 -- 172.21.15.43:0/1507604305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c40065390 msgr2=0x7f9c401135e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:39.059+0000 7f9c46bc4700 1 --2- 172.21.15.43:0/1507604305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c40065390 0x7f9c401135e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400eb40 tx=0x7f9c3400b040 comp rx=0 tx=0).stop 2023-12-08T20:30:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:39.059+0000 7f9c46bc4700 1 -- 172.21.15.43:0/1507604305 shutdown_connections 2023-12-08T20:30:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:39.059+0000 7f9c46bc4700 1 --2- 172.21.15.43:0/1507604305 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f9c3006caf0 0x7f9c3006efa0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:39.059+0000 7f9c46bc4700 1 --2- 172.21.15.43:0/1507604305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c40065390 0x7f9c401135e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:39.059+0000 7f9c46bc4700 1 --2- 172.21.15.43:0/1507604305 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c40102c20 0x7f9c40113b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:39.059+0000 7f9c46bc4700 1 -- 172.21.15.43:0/1507604305 >> 172.21.15.43:0/1507604305 conn(0x7f9c400719b0 msgr2=0x7f9c400fab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:39.059+0000 7f9c46bc4700 1 -- 172.21.15.43:0/1507604305 shutdown_connections 2023-12-08T20:30:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:39.059+0000 7f9c46bc4700 1 -- 172.21.15.43:0/1507604305 wait complete. 2023-12-08T20:30:39.073 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:30:39.443 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2023-12-08T20:30:39.747 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:30:39.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:39 smithi111 ceph-mon[121341]: pgmap v62: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:39.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:39 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/1507604305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:40.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:39 smithi043 ceph-mon[111966]: pgmap v62: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:40.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:39 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/1507604305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:40.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.906+0000 7f8d53c09700 1 -- 172.21.15.43:0/416941167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d4c102bf0 msgr2=0x7f8d4c102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:40.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.906+0000 7f8d53c09700 1 --2- 172.21.15.43:0/416941167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d4c102bf0 0x7f8d4c102fc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8d48004940 tx=0x7f8d48009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:40.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.906+0000 7f8d53c09700 1 -- 172.21.15.43:0/416941167 shutdown_connections 2023-12-08T20:30:40.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.906+0000 7f8d53c09700 1 --2- 172.21.15.43:0/416941167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d4c103590 0x7f8d4c0fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:40.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.906+0000 7f8d53c09700 1 --2- 172.21.15.43:0/416941167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d4c102bf0 0x7f8d4c102fc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:40.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.906+0000 7f8d53c09700 1 -- 172.21.15.43:0/416941167 >> 172.21.15.43:0/416941167 conn(0x7f8d4c0f87a0 msgr2=0x7f8d4c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:40.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.906+0000 7f8d53c09700 1 -- 172.21.15.43:0/416941167 shutdown_connections 2023-12-08T20:30:40.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.906+0000 7f8d53c09700 1 -- 172.21.15.43:0/416941167 wait complete. 2023-12-08T20:30:40.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.906+0000 7f8d53c09700 1 Processor -- start 2023-12-08T20:30:40.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.907+0000 7f8d53c09700 1 -- start start 2023-12-08T20:30:40.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.907+0000 7f8d53c09700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d4c102bf0 0x7f8d4c113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:40.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.907+0000 7f8d53c09700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d4c103590 0x7f8d4c113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:40.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.907+0000 7f8d53c09700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c1141e0 con 0x7f8d4c103590 2023-12-08T20:30:40.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.907+0000 7f8d53c09700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c10d4d0 con 0x7f8d4c102bf0 2023-12-08T20:30:40.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.907+0000 7f8d511a4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d4c103590 0x7f8d4c113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:40.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.907+0000 7f8d511a4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d4c103590 0x7f8d4c113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58466/0 (socket says 172.21.15.43:58466) 2023-12-08T20:30:40.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.907+0000 7f8d511a4700 1 -- 172.21.15.43:0/534580937 learned_addr learned my addr 172.21.15.43:0/534580937 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:30:40.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.907+0000 7f8d519a5700 1 --2- 172.21.15.43:0/534580937 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d4c102bf0 0x7f8d4c113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:40.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.907+0000 7f8d511a4700 1 -- 172.21.15.43:0/534580937 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d4c102bf0 msgr2=0x7f8d4c113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:40.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.907+0000 7f8d511a4700 1 --2- 172.21.15.43:0/534580937 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d4c102bf0 0x7f8d4c113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:40.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.907+0000 7f8d511a4700 1 -- 172.21.15.43:0/534580937 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d48005040 con 0x7f8d4c103590 2023-12-08T20:30:40.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.908+0000 7f8d511a4700 1 --2- 172.21.15.43:0/534580937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d4c103590 0x7f8d4c113b90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c002a50 tx=0x7f8d3c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:40.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.908+0000 7f8d427fc700 1 -- 172.21.15.43:0/534580937 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d3c007cc0 con 0x7f8d4c103590 2023-12-08T20:30:40.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.908+0000 7f8d427fc700 1 -- 172.21.15.43:0/534580937 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8d3c00f040 con 0x7f8d4c103590 2023-12-08T20:30:40.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.908+0000 7f8d427fc700 1 -- 172.21.15.43:0/534580937 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d3c00d920 con 0x7f8d4c103590 2023-12-08T20:30:40.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.908+0000 7f8d53c09700 1 -- 172.21.15.43:0/534580937 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4c10d760 con 0x7f8d4c103590 2023-12-08T20:30:40.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.908+0000 7f8d53c09700 1 -- 172.21.15.43:0/534580937 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4c10dca0 con 0x7f8d4c103590 2023-12-08T20:30:40.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.909+0000 7f8d53c09700 1 -- 172.21.15.43:0/534580937 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4c0fff00 con 0x7f8d4c103590 2023-12-08T20:30:40.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.909+0000 7f8d427fc700 1 -- 172.21.15.43:0/534580937 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f8d3c009680 con 0x7f8d4c103590 2023-12-08T20:30:40.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.910+0000 7f8d427fc700 1 --2- 172.21.15.43:0/534580937 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f8d3806caf0 0x7f8d3806efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:40.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.910+0000 7f8d427fc700 1 -- 172.21.15.43:0/534580937 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f8d3c08bb00 con 0x7f8d4c103590 2023-12-08T20:30:40.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.910+0000 7f8d519a5700 1 --2- 172.21.15.43:0/534580937 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f8d3806caf0 0x7f8d3806efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:40.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.910+0000 7f8d519a5700 1 --2- 172.21.15.43:0/534580937 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f8d3806caf0 0x7f8d3806efa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800b840 tx=0x7f8d48009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:40.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:40.915+0000 7f8d427fc700 1 -- 172.21.15.43:0/534580937 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f8d3c059940 con 0x7f8d4c103590 2023-12-08T20:30:41.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:41.208+0000 7f8d53c09700 1 -- 172.21.15.43:0/534580937 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8d4c10ebf0 con 0x7f8d4c103590 2023-12-08T20:30:41.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:41.209+0000 7f8d427fc700 1 -- 172.21.15.43:0/534580937 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f8d3c0594d0 con 0x7f8d4c103590 2023-12-08T20:30:41.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:41.211+0000 7f8d53c09700 1 -- 172.21.15.43:0/534580937 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f8d3806caf0 msgr2=0x7f8d3806efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:41.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:41.211+0000 7f8d53c09700 1 --2- 172.21.15.43:0/534580937 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f8d3806caf0 0x7f8d3806efa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800b840 tx=0x7f8d48009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:41.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:41.211+0000 7f8d53c09700 1 -- 172.21.15.43:0/534580937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d4c103590 msgr2=0x7f8d4c113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:41.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:41.211+0000 7f8d53c09700 1 --2- 172.21.15.43:0/534580937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d4c103590 0x7f8d4c113b90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c002a50 tx=0x7f8d3c004600 comp rx=0 tx=0).stop 2023-12-08T20:30:41.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:41.211+0000 7f8d53c09700 1 -- 172.21.15.43:0/534580937 shutdown_connections 2023-12-08T20:30:41.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:41.211+0000 7f8d53c09700 1 --2- 172.21.15.43:0/534580937 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d4c102bf0 0x7f8d4c113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:41.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:41.211+0000 7f8d53c09700 1 --2- 172.21.15.43:0/534580937 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f8d3806caf0 0x7f8d3806efa0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:41.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:41.211+0000 7f8d53c09700 1 --2- 172.21.15.43:0/534580937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d4c103590 0x7f8d4c113b90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:41.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:41.211+0000 7f8d53c09700 1 -- 172.21.15.43:0/534580937 >> 172.21.15.43:0/534580937 conn(0x7f8d4c0f87a0 msgr2=0x7f8d4c0fa340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:41.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:41.212+0000 7f8d53c09700 1 -- 172.21.15.43:0/534580937 shutdown_connections 2023-12-08T20:30:41.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:41.212+0000 7f8d53c09700 1 -- 172.21.15.43:0/534580937 wait complete. 2023-12-08T20:30:41.225 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)" 2023-12-08T20:30:41.593 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2023-12-08T20:30:41.902 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:30:41.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:41 smithi111 ceph-mon[121341]: pgmap v63: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:41.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:41 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:30:41.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:41 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/534580937' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:42.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:41 smithi043 ceph-mon[111966]: pgmap v63: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:42.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:41 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:30:42.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:41 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/534580937' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:43.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.017+0000 7f2b83a97700 1 -- 172.21.15.43:0/472979390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b7c102bf0 msgr2=0x7f2b7c102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:43.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.017+0000 7f2b83a97700 1 --2- 172.21.15.43:0/472979390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b7c102bf0 0x7f2b7c102fc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c004940 tx=0x7f2b6c009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:43.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.017+0000 7f2b83a97700 1 -- 172.21.15.43:0/472979390 shutdown_connections 2023-12-08T20:30:43.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.017+0000 7f2b83a97700 1 --2- 172.21.15.43:0/472979390 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b7c103590 0x7f2b7c0fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:43.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.017+0000 7f2b83a97700 1 --2- 172.21.15.43:0/472979390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b7c102bf0 0x7f2b7c102fc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:43.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.017+0000 7f2b83a97700 1 -- 172.21.15.43:0/472979390 >> 172.21.15.43:0/472979390 conn(0x7f2b7c0f87a0 msgr2=0x7f2b7c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:43.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.018+0000 7f2b83a97700 1 -- 172.21.15.43:0/472979390 shutdown_connections 2023-12-08T20:30:43.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.018+0000 7f2b83a97700 1 -- 172.21.15.43:0/472979390 wait complete. 2023-12-08T20:30:43.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.018+0000 7f2b83a97700 1 Processor -- start 2023-12-08T20:30:43.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.018+0000 7f2b83a97700 1 -- start start 2023-12-08T20:30:43.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.018+0000 7f2b83a97700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b7c102bf0 0x7f2b7c113650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:43.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.018+0000 7f2b83a97700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b7c103590 0x7f2b7c113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:43.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.018+0000 7f2b83a97700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c114220 con 0x7f2b7c102bf0 2023-12-08T20:30:43.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.018+0000 7f2b83a97700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c10d510 con 0x7f2b7c103590 2023-12-08T20:30:43.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.019+0000 7f2b81833700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b7c102bf0 0x7f2b7c113650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:43.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.019+0000 7f2b81833700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b7c102bf0 0x7f2b7c113650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58482/0 (socket says 172.21.15.43:58482) 2023-12-08T20:30:43.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.019+0000 7f2b81833700 1 -- 172.21.15.43:0/3949068557 learned_addr learned my addr 172.21.15.43:0/3949068557 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:30:43.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.019+0000 7f2b81032700 1 --2- 172.21.15.43:0/3949068557 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b7c103590 0x7f2b7c113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:43.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.019+0000 7f2b81833700 1 -- 172.21.15.43:0/3949068557 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b7c103590 msgr2=0x7f2b7c113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:43.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.019+0000 7f2b81833700 1 --2- 172.21.15.43:0/3949068557 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b7c103590 0x7f2b7c113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:43.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.019+0000 7f2b81833700 1 -- 172.21.15.43:0/3949068557 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6c005040 con 0x7f2b7c102bf0 2023-12-08T20:30:43.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.019+0000 7f2b81833700 1 --2- 172.21.15.43:0/3949068557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b7c102bf0 0x7f2b7c113650 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c00b3b0 tx=0x7f2b6c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:43.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.019+0000 7f2b727fc700 1 -- 172.21.15.43:0/3949068557 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b6c00e040 con 0x7f2b7c102bf0 2023-12-08T20:30:43.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.019+0000 7f2b727fc700 1 -- 172.21.15.43:0/3949068557 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2b6c01c430 con 0x7f2b7c102bf0 2023-12-08T20:30:43.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.019+0000 7f2b727fc700 1 -- 172.21.15.43:0/3949068557 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b6c013640 con 0x7f2b7c102bf0 2023-12-08T20:30:43.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.019+0000 7f2b83a97700 1 -- 172.21.15.43:0/3949068557 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7c10d740 con 0x7f2b7c102bf0 2023-12-08T20:30:43.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.019+0000 7f2b83a97700 1 -- 172.21.15.43:0/3949068557 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7c10dc80 con 0x7f2b7c102bf0 2023-12-08T20:30:43.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.020+0000 7f2b83a97700 1 -- 172.21.15.43:0/3949068557 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7c0fff00 con 0x7f2b7c102bf0 2023-12-08T20:30:43.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.021+0000 7f2b727fc700 1 -- 172.21.15.43:0/3949068557 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f2b6c01c5a0 con 0x7f2b7c102bf0 2023-12-08T20:30:43.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.021+0000 7f2b727fc700 1 --2- 172.21.15.43:0/3949068557 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f2b6806cae0 0x7f2b6806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:43.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.022+0000 7f2b727fc700 1 -- 172.21.15.43:0/3949068557 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f2b6c08c790 con 0x7f2b7c102bf0 2023-12-08T20:30:43.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.022+0000 7f2b81032700 1 --2- 172.21.15.43:0/3949068557 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f2b6806cae0 0x7f2b6806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:43.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.022+0000 7f2b81032700 1 --2- 172.21.15.43:0/3949068557 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f2b6806cae0 0x7f2b6806ef90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c10eef0 tx=0x7f2b7800b040 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:43.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.026+0000 7f2b727fc700 1 -- 172.21.15.43:0/3949068557 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f2b6c05a7a0 con 0x7f2b7c102bf0 2023-12-08T20:30:43.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.323+0000 7f2b83a97700 1 -- 172.21.15.43:0/3949068557 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2b7c10ec30 con 0x7f2b7c102bf0 2023-12-08T20:30:43.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.323+0000 7f2b727fc700 1 -- 172.21.15.43:0/3949068557 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f2b6c05a330 con 0x7f2b7c102bf0 2023-12-08T20:30:43.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.325+0000 7f2b83a97700 1 -- 172.21.15.43:0/3949068557 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f2b6806cae0 msgr2=0x7f2b6806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:43.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.325+0000 7f2b83a97700 1 --2- 172.21.15.43:0/3949068557 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f2b6806cae0 0x7f2b6806ef90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c10eef0 tx=0x7f2b7800b040 comp rx=0 tx=0).stop 2023-12-08T20:30:43.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.325+0000 7f2b83a97700 1 -- 172.21.15.43:0/3949068557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b7c102bf0 msgr2=0x7f2b7c113650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:43.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.325+0000 7f2b83a97700 1 --2- 172.21.15.43:0/3949068557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b7c102bf0 0x7f2b7c113650 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c00b3b0 tx=0x7f2b6c009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:43.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.325+0000 7f2b83a97700 1 -- 172.21.15.43:0/3949068557 shutdown_connections 2023-12-08T20:30:43.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.325+0000 7f2b83a97700 1 --2- 172.21.15.43:0/3949068557 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f2b6806cae0 0x7f2b6806ef90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:43.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.325+0000 7f2b83a97700 1 --2- 172.21.15.43:0/3949068557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b7c102bf0 0x7f2b7c113650 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:43.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.325+0000 7f2b83a97700 1 --2- 172.21.15.43:0/3949068557 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b7c103590 0x7f2b7c113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:43.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.326+0000 7f2b83a97700 1 -- 172.21.15.43:0/3949068557 >> 172.21.15.43:0/3949068557 conn(0x7f2b7c0f87a0 msgr2=0x7f2b7c0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:43.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.326+0000 7f2b83a97700 1 -- 172.21.15.43:0/3949068557 shutdown_connections 2023-12-08T20:30:43.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:43.326+0000 7f2b83a97700 1 -- 172.21.15.43:0/3949068557 wait complete. 2023-12-08T20:30:43.339 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:30:43.767 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2023-12-08T20:30:43.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:43 smithi111 ceph-mon[121341]: pgmap v64: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:43.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:43 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/3949068557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:44.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:43 smithi043 ceph-mon[111966]: pgmap v64: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:44.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:43 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/3949068557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:30:44.068 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:30:45.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.148+0000 7f6e3da61700 1 -- 172.21.15.43:0/2135348715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e380fdc10 msgr2=0x7f6e380fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:45.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.148+0000 7f6e3da61700 1 --2- 172.21.15.43:0/2135348715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e380fdc10 0x7f6e380fdfe0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6e28004940 tx=0x7f6e28009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:45.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.148+0000 7f6e3da61700 1 -- 172.21.15.43:0/2135348715 shutdown_connections 2023-12-08T20:30:45.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.148+0000 7f6e3da61700 1 --2- 172.21.15.43:0/2135348715 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6e380fe5b0 0x7f6e38106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:45.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.148+0000 7f6e3da61700 1 --2- 172.21.15.43:0/2135348715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e380fdc10 0x7f6e380fdfe0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:45.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.148+0000 7f6e3da61700 1 -- 172.21.15.43:0/2135348715 >> 172.21.15.43:0/2135348715 conn(0x7f6e380f76c0 msgr2=0x7f6e380f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:45.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.148+0000 7f6e3da61700 1 -- 172.21.15.43:0/2135348715 shutdown_connections 2023-12-08T20:30:45.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.148+0000 7f6e3da61700 1 -- 172.21.15.43:0/2135348715 wait complete. 2023-12-08T20:30:45.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.149+0000 7f6e3da61700 1 Processor -- start 2023-12-08T20:30:45.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.149+0000 7f6e3da61700 1 -- start start 2023-12-08T20:30:45.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.150+0000 7f6e3da61700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6e380fdc10 0x7f6e38113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:45.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.150+0000 7f6e3da61700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e380fe5b0 0x7f6e38113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:45.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.150+0000 7f6e3da61700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e38114200 con 0x7f6e380fe5b0 2023-12-08T20:30:45.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.150+0000 7f6e3da61700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3810d4f0 con 0x7f6e380fdc10 2023-12-08T20:30:45.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.150+0000 7f6e367fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e380fe5b0 0x7f6e38113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:45.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.150+0000 7f6e367fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e380fe5b0 0x7f6e38113bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58500/0 (socket says 172.21.15.43:58500) 2023-12-08T20:30:45.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.150+0000 7f6e367fc700 1 -- 172.21.15.43:0/515980118 learned_addr learned my addr 172.21.15.43:0/515980118 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:30:45.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.150+0000 7f6e36ffd700 1 --2- 172.21.15.43:0/515980118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6e380fdc10 0x7f6e38113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:45.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.150+0000 7f6e367fc700 1 -- 172.21.15.43:0/515980118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6e380fdc10 msgr2=0x7f6e38113630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:45.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.150+0000 7f6e367fc700 1 --2- 172.21.15.43:0/515980118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6e380fdc10 0x7f6e38113630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:45.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.150+0000 7f6e367fc700 1 -- 172.21.15.43:0/515980118 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e28005040 con 0x7f6e380fe5b0 2023-12-08T20:30:45.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.150+0000 7f6e367fc700 1 --2- 172.21.15.43:0/515980118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e380fe5b0 0x7f6e38113bb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6e20002a50 tx=0x7f6e200046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:45.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.150+0000 7f6e2f7fe700 1 -- 172.21.15.43:0/515980118 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e20007cc0 con 0x7f6e380fe5b0 2023-12-08T20:30:45.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.150+0000 7f6e2f7fe700 1 -- 172.21.15.43:0/515980118 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6e2000f040 con 0x7f6e380fe5b0 2023-12-08T20:30:45.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.150+0000 7f6e2f7fe700 1 -- 172.21.15.43:0/515980118 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e2000d9c0 con 0x7f6e380fe5b0 2023-12-08T20:30:45.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.150+0000 7f6e3da61700 1 -- 172.21.15.43:0/515980118 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3810d780 con 0x7f6e380fe5b0 2023-12-08T20:30:45.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.151+0000 7f6e3da61700 1 -- 172.21.15.43:0/515980118 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3810dcc0 con 0x7f6e380fe5b0 2023-12-08T20:30:45.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.152+0000 7f6e3da61700 1 -- 172.21.15.43:0/515980118 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e38104200 con 0x7f6e380fe5b0 2023-12-08T20:30:45.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.152+0000 7f6e2f7fe700 1 -- 172.21.15.43:0/515980118 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f6e2000db20 con 0x7f6e380fe5b0 2023-12-08T20:30:45.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.153+0000 7f6e2f7fe700 1 --2- 172.21.15.43:0/515980118 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f6e2406cae0 0x7f6e2406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:45.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.153+0000 7f6e2f7fe700 1 -- 172.21.15.43:0/515980118 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f6e2008b9b0 con 0x7f6e380fe5b0 2023-12-08T20:30:45.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.153+0000 7f6e36ffd700 1 --2- 172.21.15.43:0/515980118 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f6e2406cae0 0x7f6e2406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:45.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.153+0000 7f6e36ffd700 1 --2- 172.21.15.43:0/515980118 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f6e2406cae0 0x7f6e2406ef90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6e28009fd0 tx=0x7f6e28009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:45.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.157+0000 7f6e2f7fe700 1 -- 172.21.15.43:0/515980118 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f6e20059870 con 0x7f6e380fe5b0 2023-12-08T20:30:45.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:45.387+0000 7f6e3da61700 1 -- 172.21.15.43:0/515980118 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e3810ec10 con 0x7f6e2406cae0 2023-12-08T20:30:45.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:45 smithi111 ceph-mon[121341]: pgmap v65: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:46.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:45 smithi043 ceph-mon[111966]: pgmap v65: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:46.943 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:46 smithi043 ceph-mon[111966]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:30:46.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:46 smithi111 ceph-mon[121341]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:30:47.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:47.007+0000 7f6e2f7fe700 1 -- 172.21.15.43:0/515980118 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5089 (secure 0 0 0) 0x7f6e3810ec10 con 0x7f6e2406cae0 2023-12-08T20:30:47.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:47.010+0000 7f6e3da61700 1 -- 172.21.15.43:0/515980118 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f6e2406cae0 msgr2=0x7f6e2406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:47.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:47.010+0000 7f6e3da61700 1 --2- 172.21.15.43:0/515980118 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f6e2406cae0 0x7f6e2406ef90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6e28009fd0 tx=0x7f6e28009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:47.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:47.010+0000 7f6e3da61700 1 -- 172.21.15.43:0/515980118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e380fe5b0 msgr2=0x7f6e38113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:47.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:47.010+0000 7f6e3da61700 1 --2- 172.21.15.43:0/515980118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e380fe5b0 0x7f6e38113bb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6e20002a50 tx=0x7f6e200046b0 comp rx=0 tx=0).stop 2023-12-08T20:30:47.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:47.010+0000 7f6e3da61700 1 -- 172.21.15.43:0/515980118 shutdown_connections 2023-12-08T20:30:47.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:47.010+0000 7f6e3da61700 1 --2- 172.21.15.43:0/515980118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6e380fdc10 0x7f6e38113630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:47.010+0000 7f6e3da61700 1 --2- 172.21.15.43:0/515980118 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f6e2406cae0 0x7f6e2406ef90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:47.010+0000 7f6e3da61700 1 --2- 172.21.15.43:0/515980118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e380fe5b0 0x7f6e38113bb0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:47.010+0000 7f6e3da61700 1 -- 172.21.15.43:0/515980118 >> 172.21.15.43:0/515980118 conn(0x7f6e380f76c0 msgr2=0x7f6e38101380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:47.011+0000 7f6e3da61700 1 -- 172.21.15.43:0/515980118 shutdown_connections 2023-12-08T20:30:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:47.011+0000 7f6e3da61700 1 -- 172.21.15.43:0/515980118 wait complete. 2023-12-08T20:30:47.025 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:30:47.419 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph orch ps' 2023-12-08T20:30:47.725 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:30:47.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:47 smithi111 ceph-mon[121341]: pgmap v66: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:48.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:47 smithi043 ceph-mon[111966]: pgmap v66: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:48.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.890+0000 7f288eda5700 1 -- 172.21.15.43:0/4147483807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2888102c20 msgr2=0x7f2888102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:48.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.890+0000 7f288eda5700 1 --2- 172.21.15.43:0/4147483807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2888102c20 0x7f2888102ff0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2878004940 tx=0x7f2878009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:48.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.890+0000 7f288eda5700 1 -- 172.21.15.43:0/4147483807 shutdown_connections 2023-12-08T20:30:48.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.890+0000 7f288eda5700 1 --2- 172.21.15.43:0/4147483807 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2888065390 0x7f2888065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:48.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.890+0000 7f288eda5700 1 --2- 172.21.15.43:0/4147483807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2888102c20 0x7f2888102ff0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:48.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.890+0000 7f288eda5700 1 -- 172.21.15.43:0/4147483807 >> 172.21.15.43:0/4147483807 conn(0x7f28880719b0 msgr2=0x7f2888071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:48.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.890+0000 7f288eda5700 1 -- 172.21.15.43:0/4147483807 shutdown_connections 2023-12-08T20:30:48.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.890+0000 7f288eda5700 1 -- 172.21.15.43:0/4147483807 wait complete. 2023-12-08T20:30:48.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.891+0000 7f288eda5700 1 Processor -- start 2023-12-08T20:30:48.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.891+0000 7f288eda5700 1 -- start start 2023-12-08T20:30:48.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.891+0000 7f288eda5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2888065390 0x7f2888113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:48.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.891+0000 7f288eda5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2888102c20 0x7f2888113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:48.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.891+0000 7f288eda5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2888114220 con 0x7f2888102c20 2023-12-08T20:30:48.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.891+0000 7f288eda5700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288810d570 con 0x7f2888065390 2023-12-08T20:30:48.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.891+0000 7f2887fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2888102c20 0x7f2888113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:48.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.891+0000 7f2887fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2888102c20 0x7f2888113bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58516/0 (socket says 172.21.15.43:58516) 2023-12-08T20:30:48.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.891+0000 7f2887fff700 1 -- 172.21.15.43:0/1617669537 learned_addr learned my addr 172.21.15.43:0/1617669537 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:30:48.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.891+0000 7f288cb41700 1 --2- 172.21.15.43:0/1617669537 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2888065390 0x7f2888113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:48.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.892+0000 7f2887fff700 1 -- 172.21.15.43:0/1617669537 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2888065390 msgr2=0x7f2888113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:48.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.892+0000 7f2887fff700 1 --2- 172.21.15.43:0/1617669537 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2888065390 0x7f2888113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:48.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.892+0000 7f2887fff700 1 -- 172.21.15.43:0/1617669537 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2878005040 con 0x7f2888102c20 2023-12-08T20:30:48.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.892+0000 7f2887fff700 1 --2- 172.21.15.43:0/1617669537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2888102c20 0x7f2888113bd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f287c002a50 tx=0x7f287c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:48.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.892+0000 7f28857fa700 1 -- 172.21.15.43:0/1617669537 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f287c007cc0 con 0x7f2888102c20 2023-12-08T20:30:48.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.892+0000 7f28857fa700 1 -- 172.21.15.43:0/1617669537 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f287c00f040 con 0x7f2888102c20 2023-12-08T20:30:48.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.892+0000 7f288eda5700 1 -- 172.21.15.43:0/1617669537 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f288810d850 con 0x7f2888102c20 2023-12-08T20:30:48.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.892+0000 7f28857fa700 1 -- 172.21.15.43:0/1617669537 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f287c00d9c0 con 0x7f2888102c20 2023-12-08T20:30:48.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.892+0000 7f288eda5700 1 -- 172.21.15.43:0/1617669537 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288810dd90 con 0x7f2888102c20 2023-12-08T20:30:48.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.893+0000 7f288eda5700 1 -- 172.21.15.43:0/1617669537 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28880fff40 con 0x7f2888102c20 2023-12-08T20:30:48.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.894+0000 7f28857fa700 1 -- 172.21.15.43:0/1617669537 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f287c00db20 con 0x7f2888102c20 2023-12-08T20:30:48.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.894+0000 7f28857fa700 1 --2- 172.21.15.43:0/1617669537 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f287006cae0 0x7f287006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:48.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.895+0000 7f28857fa700 1 -- 172.21.15.43:0/1617669537 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f287c08bb40 con 0x7f2888102c20 2023-12-08T20:30:48.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.895+0000 7f288cb41700 1 --2- 172.21.15.43:0/1617669537 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f287006cae0 0x7f287006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:48.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.895+0000 7f288cb41700 1 --2- 172.21.15.43:0/1617669537 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f287006cae0 0x7f287006ef90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2878004f90 tx=0x7f2878009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:48.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:48.899+0000 7f28857fa700 1 -- 172.21.15.43:0/1617669537 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f287c0598e0 con 0x7f2888102c20 2023-12-08T20:30:49.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:49.119+0000 7f288eda5700 1 -- 172.21.15.43:0/1617669537 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f288804bbf0 con 0x7f287006cae0 2023-12-08T20:30:49.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:49.129+0000 7f28857fa700 1 -- 172.21.15.43:0/1617669537 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f288804bbf0 con 0x7f287006cae0 2023-12-08T20:30:49.131 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-08T20:30:49.132 INFO:teuthology.orchestra.run.smithi043.stdout:alertmanager.smithi043 smithi043 *:9093,9094 running (67s) 47s ago 8m 17.7M - 0.25.0 c8568f914cd2 d4a6cd00c86b 2023-12-08T20:30:49.132 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi043 smithi043 running (9m) 47s ago 9m 7432k - 17.2.7-119-ge2143d99 f761b6e42225 f84d492b732c 2023-12-08T20:30:49.132 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi111 smithi111 running (8m) 96s ago 8m 7428k - 17.2.7-119-ge2143d99 f761b6e42225 88b53685ae54 2023-12-08T20:30:49.132 INFO:teuthology.orchestra.run.smithi043.stdout:grafana.smithi043 smithi043 *:3000 running (51s) 47s ago 8m 51.4M - 9.4.7 954c08fa6188 8f55491a980b 2023-12-08T20:30:49.132 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.akrjef smithi043 running (5m) 47s ago 5m 17.7M - 17.2.7-119-ge2143d99 f761b6e42225 1c0cb8d34ef8 2023-12-08T20:30:49.132 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.pjmszb smithi043 running (5m) 47s ago 5m 7151M - 17.2.7-119-ge2143d99 f761b6e42225 d7eee0c78093 2023-12-08T20:30:49.132 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.svpasm smithi111 running (4m) 96s ago 4m 15.2M - 17.2.7-119-ge2143d99 f761b6e42225 657d4d1cf4b2 2023-12-08T20:30:49.132 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.veeegc smithi111 running (5m) 96s ago 5m 2612M - 17.2.7-119-ge2143d99 f761b6e42225 31f794a388ab 2023-12-08T20:30:49.132 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi043.hqcdcm smithi043 *:8443,9283,8765 running (2m) 47s ago 10m 507M - 19.0.0-44-g9dcc13bb f28f2b94f153 14e91c1dac64 2023-12-08T20:30:49.132 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi111.mtcffu smithi111 *:8443,9283,8765 running (110s) 96s ago 8m 449M - 19.0.0-44-g9dcc13bb f28f2b94f153 56f4290c6db5 2023-12-08T20:30:49.132 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi043 smithi043 running (10m) 47s ago 10m 100M 2048M 17.2.7-119-ge2143d99 f761b6e42225 fe2a56effef3 2023-12-08T20:30:49.132 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi111 smithi111 running (8m) 96s ago 8m 67.8M 2048M 17.2.7-119-ge2143d99 f761b6e42225 2ae21cf3fa1e 2023-12-08T20:30:49.132 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi043 smithi043 *:9100 running (101s) 47s ago 9m 9.99M - 1.5.0 0da6a335fe13 0959b44d9972 2023-12-08T20:30:49.133 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi111 smithi111 *:9100 running (98s) 96s ago 8m 3862k - 1.5.0 0da6a335fe13 10fe4fdb23d0 2023-12-08T20:30:49.133 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (7m) 47s ago 7m 746M 1570M 17.2.7-119-ge2143d99 f761b6e42225 462eeaf62b2c 2023-12-08T20:30:49.133 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi043 running (7m) 47s ago 7m 853M 1570M 17.2.7-119-ge2143d99 f761b6e42225 dde419c88a89 2023-12-08T20:30:49.133 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi043 running (7m) 47s ago 7m 636M 1570M 17.2.7-119-ge2143d99 f761b6e42225 f7e812026ef5 2023-12-08T20:30:49.133 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi111 running (6m) 96s ago 6m 791M 2592M 17.2.7-119-ge2143d99 f761b6e42225 2a738d30441c 2023-12-08T20:30:49.133 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi111 running (6m) 96s ago 6m 600M 2592M 17.2.7-119-ge2143d99 f761b6e42225 38cdb6a88694 2023-12-08T20:30:49.133 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi111 running (6m) 96s ago 6m 728M 2592M 17.2.7-119-ge2143d99 f761b6e42225 59a9ce8c1141 2023-12-08T20:30:49.133 INFO:teuthology.orchestra.run.smithi043.stdout:prometheus.smithi043 smithi043 *:9095 running (81s) 47s ago 8m 48.1M - 2.43.0 a07b618ecd1d d95914ec88d8 2023-12-08T20:30:49.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:49.132+0000 7f288eda5700 1 -- 172.21.15.43:0/1617669537 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f287006cae0 msgr2=0x7f287006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:49.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:49.132+0000 7f288eda5700 1 --2- 172.21.15.43:0/1617669537 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f287006cae0 0x7f287006ef90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2878004f90 tx=0x7f2878009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:49.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:49.132+0000 7f288eda5700 1 -- 172.21.15.43:0/1617669537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2888102c20 msgr2=0x7f2888113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:49.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:49.132+0000 7f288eda5700 1 --2- 172.21.15.43:0/1617669537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2888102c20 0x7f2888113bd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f287c002a50 tx=0x7f287c0046b0 comp rx=0 tx=0).stop 2023-12-08T20:30:49.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:49.132+0000 7f288eda5700 1 -- 172.21.15.43:0/1617669537 shutdown_connections 2023-12-08T20:30:49.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:49.132+0000 7f288eda5700 1 --2- 172.21.15.43:0/1617669537 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2888065390 0x7f2888113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:49.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:49.132+0000 7f288eda5700 1 --2- 172.21.15.43:0/1617669537 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f287006cae0 0x7f287006ef90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:49.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:49.132+0000 7f288eda5700 1 --2- 172.21.15.43:0/1617669537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2888102c20 0x7f2888113bd0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:49.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:49.132+0000 7f288eda5700 1 -- 172.21.15.43:0/1617669537 >> 172.21.15.43:0/1617669537 conn(0x7f28880719b0 msgr2=0x7f28880fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:49.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:49.132+0000 7f288eda5700 1 -- 172.21.15.43:0/1617669537 shutdown_connections 2023-12-08T20:30:49.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:49.132+0000 7f288eda5700 1 -- 172.21.15.43:0/1617669537 wait complete. 2023-12-08T20:30:49.542 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-08T20:30:49.543 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi043.front.sepia.ceph.com 2023-12-08T20:30:49.543 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2023-12-08T20:30:49.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:49 smithi043 ceph-mon[111966]: pgmap v67: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:49.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:49 smithi043 ceph-mon[111966]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:30:49.849 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:30:49.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:49 smithi111 ceph-mon[121341]: pgmap v67: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:49.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:49 smithi111 ceph-mon[121341]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:30:50.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.919+0000 7f48836cf700 1 -- 172.21.15.43:0/4131426845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f487c0ffb40 msgr2=0x7f487c0fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:50.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.919+0000 7f48836cf700 1 --2- 172.21.15.43:0/4131426845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f487c0ffb40 0x7f487c0fffb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f486c004940 tx=0x7f486c009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:50.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.919+0000 7f48836cf700 1 -- 172.21.15.43:0/4131426845 shutdown_connections 2023-12-08T20:30:50.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.919+0000 7f48836cf700 1 --2- 172.21.15.43:0/4131426845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f487c0ffb40 0x7f487c0fffb0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:50.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.919+0000 7f48836cf700 1 --2- 172.21.15.43:0/4131426845 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f487c101ad0 0x7f487c0ff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:50.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.919+0000 7f48836cf700 1 -- 172.21.15.43:0/4131426845 >> 172.21.15.43:0/4131426845 conn(0x7f487c0719b0 msgr2=0x7f487c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:50.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.919+0000 7f48836cf700 1 -- 172.21.15.43:0/4131426845 shutdown_connections 2023-12-08T20:30:50.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.919+0000 7f48836cf700 1 -- 172.21.15.43:0/4131426845 wait complete. 2023-12-08T20:30:50.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.920+0000 7f48836cf700 1 Processor -- start 2023-12-08T20:30:50.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.920+0000 7f48836cf700 1 -- start start 2023-12-08T20:30:50.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.920+0000 7f48836cf700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f487c0ffb40 0x7f487c119ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:50.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.920+0000 7f48836cf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f487c101ad0 0x7f487c11a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:50.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.920+0000 7f48836cf700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c11a730 con 0x7f487c0ffb40 2023-12-08T20:30:50.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.920+0000 7f48836cf700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c113a60 con 0x7f487c101ad0 2023-12-08T20:30:50.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.920+0000 7f488146b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f487c0ffb40 0x7f487c119ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:50.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.920+0000 7f488146b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f487c0ffb40 0x7f487c119ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58778/0 (socket says 172.21.15.43:58778) 2023-12-08T20:30:50.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.920+0000 7f488146b700 1 -- 172.21.15.43:0/2688111466 learned_addr learned my addr 172.21.15.43:0/2688111466 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:30:50.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.920+0000 7f4880c6a700 1 --2- 172.21.15.43:0/2688111466 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f487c101ad0 0x7f487c11a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:50.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.920+0000 7f488146b700 1 -- 172.21.15.43:0/2688111466 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f487c101ad0 msgr2=0x7f487c11a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:50.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.920+0000 7f488146b700 1 --2- 172.21.15.43:0/2688111466 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f487c101ad0 0x7f487c11a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:50.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.920+0000 7f488146b700 1 -- 172.21.15.43:0/2688111466 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486c005040 con 0x7f487c0ffb40 2023-12-08T20:30:50.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.921+0000 7f488146b700 1 --2- 172.21.15.43:0/2688111466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f487c0ffb40 0x7f487c119ba0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f487800eb40 tx=0x7f487800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:50.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.921+0000 7f4871ffb700 1 -- 172.21.15.43:0/2688111466 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4878007cc0 con 0x7f487c0ffb40 2023-12-08T20:30:50.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.921+0000 7f48836cf700 1 -- 172.21.15.43:0/2688111466 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487c113ce0 con 0x7f487c0ffb40 2023-12-08T20:30:50.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.921+0000 7f4871ffb700 1 -- 172.21.15.43:0/2688111466 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f487800f040 con 0x7f487c0ffb40 2023-12-08T20:30:50.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.921+0000 7f4871ffb700 1 -- 172.21.15.43:0/2688111466 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f487800c990 con 0x7f487c0ffb40 2023-12-08T20:30:50.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.921+0000 7f48836cf700 1 -- 172.21.15.43:0/2688111466 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c114220 con 0x7f487c0ffb40 2023-12-08T20:30:50.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.922+0000 7f48836cf700 1 -- 172.21.15.43:0/2688111466 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487c10c0b0 con 0x7f487c0ffb40 2023-12-08T20:30:50.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.922+0000 7f4871ffb700 1 -- 172.21.15.43:0/2688111466 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f487800cc00 con 0x7f487c0ffb40 2023-12-08T20:30:50.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.923+0000 7f4871ffb700 1 --2- 172.21.15.43:0/2688111466 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f486806caf0 0x7f486806efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:50.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.923+0000 7f4871ffb700 1 -- 172.21.15.43:0/2688111466 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f487808b970 con 0x7f487c0ffb40 2023-12-08T20:30:50.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.923+0000 7f4880c6a700 1 --2- 172.21.15.43:0/2688111466 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f486806caf0 0x7f486806efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:50.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.924+0000 7f4880c6a700 1 --2- 172.21.15.43:0/2688111466 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f486806caf0 0x7f486806efa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f487c1153d0 tx=0x7f486c009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:50.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:50.928+0000 7f4871ffb700 1 -- 172.21.15.43:0/2688111466 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f4878059860 con 0x7f487c0ffb40 2023-12-08T20:30:51.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:51.135+0000 7f48836cf700 1 -- 172.21.15.43:0/2688111466 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f487c04bbf0 con 0x7f487c0ffb40 2023-12-08T20:30:51.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:51.140+0000 7f4871ffb700 1 -- 172.21.15.43:0/2688111466 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v47)=0 v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7f48780593f0 con 0x7f487c0ffb40 2023-12-08T20:30:51.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:51.142+0000 7f48836cf700 1 -- 172.21.15.43:0/2688111466 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f486806caf0 msgr2=0x7f486806efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:51.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:51.142+0000 7f48836cf700 1 --2- 172.21.15.43:0/2688111466 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f486806caf0 0x7f486806efa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f487c1153d0 tx=0x7f486c009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:51.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:51.142+0000 7f48836cf700 1 -- 172.21.15.43:0/2688111466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f487c0ffb40 msgr2=0x7f487c119ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:51.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:51.142+0000 7f48836cf700 1 --2- 172.21.15.43:0/2688111466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f487c0ffb40 0x7f487c119ba0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f487800eb40 tx=0x7f487800b040 comp rx=0 tx=0).stop 2023-12-08T20:30:51.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:51.142+0000 7f48836cf700 1 -- 172.21.15.43:0/2688111466 shutdown_connections 2023-12-08T20:30:51.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:51.142+0000 7f48836cf700 1 --2- 172.21.15.43:0/2688111466 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f486806caf0 0x7f486806efa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:51.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:51.142+0000 7f48836cf700 1 --2- 172.21.15.43:0/2688111466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f487c0ffb40 0x7f487c119ba0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:51.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:51.142+0000 7f48836cf700 1 --2- 172.21.15.43:0/2688111466 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f487c101ad0 0x7f487c11a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:51.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:51.142+0000 7f48836cf700 1 -- 172.21.15.43:0/2688111466 >> 172.21.15.43:0/2688111466 conn(0x7f487c0719b0 msgr2=0x7f487c0fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:51.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:51.142+0000 7f48836cf700 1 -- 172.21.15.43:0/2688111466 shutdown_connections 2023-12-08T20:30:51.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:51.142+0000 7f48836cf700 1 -- 172.21.15.43:0/2688111466 wait complete. 2023-12-08T20:30:51.566 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-08T20:30:51.566 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi043.front.sepia.ceph.com 2023-12-08T20:30:51.566 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-08T20:30:51.870 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:30:52.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:52 smithi111 ceph-mon[121341]: pgmap v68: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:52.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:52 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/2688111466' entity='client.admin' 2023-12-08T20:30:52.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:52 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:30:52.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:52 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:30:52.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:52 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:30:52.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:52 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:52.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:52 smithi043 ceph-mon[111966]: pgmap v68: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:52.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:52 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/2688111466' entity='client.admin' 2023-12-08T20:30:52.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:52 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:30:52.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:52 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:30:52.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:52 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:30:52.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:52 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:30:53.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.272+0000 7f06b5790700 1 -- 172.21.15.43:0/4214049119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06b0101b00 msgr2=0x7f06b0101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:53.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.272+0000 7f06b5790700 1 --2- 172.21.15.43:0/4214049119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06b0101b00 0x7f06b0101ed0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f06a0004940 tx=0x7f06a0009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:53.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.273+0000 7f06b5790700 1 -- 172.21.15.43:0/4214049119 shutdown_connections 2023-12-08T20:30:53.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.273+0000 7f06b5790700 1 --2- 172.21.15.43:0/4214049119 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06b00fbb40 0x7f06b00fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:53.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.273+0000 7f06b5790700 1 --2- 172.21.15.43:0/4214049119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06b0101b00 0x7f06b0101ed0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:53.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.273+0000 7f06b5790700 1 -- 172.21.15.43:0/4214049119 >> 172.21.15.43:0/4214049119 conn(0x7f06b00f76c0 msgr2=0x7f06b00f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:53.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.273+0000 7f06b5790700 1 -- 172.21.15.43:0/4214049119 shutdown_connections 2023-12-08T20:30:53.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.273+0000 7f06b5790700 1 -- 172.21.15.43:0/4214049119 wait complete. 2023-12-08T20:30:53.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.273+0000 7f06b5790700 1 Processor -- start 2023-12-08T20:30:53.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.273+0000 7f06b5790700 1 -- start start 2023-12-08T20:30:53.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.274+0000 7f06b5790700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06b00fbb40 0x7f06b0113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:53.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.274+0000 7f06b5790700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06b0101b00 0x7f06b0113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:53.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.274+0000 7f06b5790700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b01141e0 con 0x7f06b00fbb40 2023-12-08T20:30:53.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.274+0000 7f06b5790700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b010d4d0 con 0x7f06b0101b00 2023-12-08T20:30:53.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.274+0000 7f06aeffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06b00fbb40 0x7f06b0113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:53.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.274+0000 7f06aeffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06b00fbb40 0x7f06b0113610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58796/0 (socket says 172.21.15.43:58796) 2023-12-08T20:30:53.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.274+0000 7f06aeffd700 1 -- 172.21.15.43:0/206797203 learned_addr learned my addr 172.21.15.43:0/206797203 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:30:53.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.274+0000 7f06a67fc700 1 --2- 172.21.15.43:0/206797203 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06b0101b00 0x7f06b0113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:53.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.274+0000 7f06aeffd700 1 -- 172.21.15.43:0/206797203 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06b0101b00 msgr2=0x7f06b0113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:53.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.274+0000 7f06aeffd700 1 --2- 172.21.15.43:0/206797203 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06b0101b00 0x7f06b0113b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:53.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.274+0000 7f06aeffd700 1 -- 172.21.15.43:0/206797203 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a0005040 con 0x7f06b00fbb40 2023-12-08T20:30:53.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.274+0000 7f06aeffd700 1 --2- 172.21.15.43:0/206797203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06b00fbb40 0x7f06b0113610 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f06a0009180 tx=0x7f06a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:53.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.274+0000 7f06a7fff700 1 -- 172.21.15.43:0/206797203 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a000e040 con 0x7f06b00fbb40 2023-12-08T20:30:53.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.274+0000 7f06b5790700 1 -- 172.21.15.43:0/206797203 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b010d700 con 0x7f06b00fbb40 2023-12-08T20:30:53.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.274+0000 7f06a7fff700 1 -- 172.21.15.43:0/206797203 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f06a0004290 con 0x7f06b00fbb40 2023-12-08T20:30:53.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.274+0000 7f06a7fff700 1 -- 172.21.15.43:0/206797203 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a001c3f0 con 0x7f06b00fbb40 2023-12-08T20:30:53.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.275+0000 7f06b5790700 1 -- 172.21.15.43:0/206797203 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b010dc40 con 0x7f06b00fbb40 2023-12-08T20:30:53.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.276+0000 7f06b5790700 1 -- 172.21.15.43:0/206797203 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b00fb2c0 con 0x7f06b00fbb40 2023-12-08T20:30:53.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.276+0000 7f06a7fff700 1 -- 172.21.15.43:0/206797203 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f06a0013420 con 0x7f06b00fbb40 2023-12-08T20:30:53.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.277+0000 7f06a7fff700 1 --2- 172.21.15.43:0/206797203 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f069c06cae0 0x7f069c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:53.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.277+0000 7f06a7fff700 1 -- 172.21.15.43:0/206797203 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f06a008d090 con 0x7f06b00fbb40 2023-12-08T20:30:53.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.277+0000 7f06a67fc700 1 --2- 172.21.15.43:0/206797203 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f069c06cae0 0x7f069c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:53.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.277+0000 7f06a67fc700 1 --2- 172.21.15.43:0/206797203 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f069c06cae0 0x7f069c06ef90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f06b010eeb0 tx=0x7f069800b040 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:53.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.281+0000 7f06a7fff700 1 -- 172.21.15.43:0/206797203 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f06a005af50 con 0x7f06b00fbb40 2023-12-08T20:30:53.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.491+0000 7f06b5790700 1 -- 172.21.15.43:0/206797203 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f06b010ebf0 con 0x7f06b00fbb40 2023-12-08T20:30:53.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.492+0000 7f06a7fff700 1 -- 172.21.15.43:0/206797203 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v47)=0 v47) v1 ==== 155+0+0 (secure 0 0 0) 0x7f06a005aae0 con 0x7f06b00fbb40 2023-12-08T20:30:53.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.494+0000 7f06b5790700 1 -- 172.21.15.43:0/206797203 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f069c06cae0 msgr2=0x7f069c06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:53.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.494+0000 7f06b5790700 1 --2- 172.21.15.43:0/206797203 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f069c06cae0 0x7f069c06ef90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f06b010eeb0 tx=0x7f069800b040 comp rx=0 tx=0).stop 2023-12-08T20:30:53.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.494+0000 7f06b5790700 1 -- 172.21.15.43:0/206797203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06b00fbb40 msgr2=0x7f06b0113610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:53.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.494+0000 7f06b5790700 1 --2- 172.21.15.43:0/206797203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06b00fbb40 0x7f06b0113610 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f06a0009180 tx=0x7f06a0009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:53.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.494+0000 7f06b5790700 1 -- 172.21.15.43:0/206797203 shutdown_connections 2023-12-08T20:30:53.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.494+0000 7f06b5790700 1 --2- 172.21.15.43:0/206797203 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f069c06cae0 0x7f069c06ef90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:53.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.494+0000 7f06b5790700 1 --2- 172.21.15.43:0/206797203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06b00fbb40 0x7f06b0113610 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:53.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.494+0000 7f06b5790700 1 --2- 172.21.15.43:0/206797203 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06b0101b00 0x7f06b0113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:53.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.494+0000 7f06b5790700 1 -- 172.21.15.43:0/206797203 >> 172.21.15.43:0/206797203 conn(0x7f06b00f76c0 msgr2=0x7f06b0065c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:53.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.494+0000 7f06b5790700 1 -- 172.21.15.43:0/206797203 shutdown_connections 2023-12-08T20:30:53.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:53.494+0000 7f06b5790700 1 -- 172.21.15.43:0/206797203 wait complete. 2023-12-08T20:30:53.891 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-08T20:30:54.195 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:30:54.401 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:54 smithi043 ceph-mon[111966]: pgmap v69: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:54.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:54 smithi111 ceph-mon[121341]: pgmap v69: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:55.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.306+0000 7f2d2354c700 1 -- 172.21.15.43:0/3363151952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d1c101b60 msgr2=0x7f2d1c101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:55.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.306+0000 7f2d2354c700 1 --2- 172.21.15.43:0/3363151952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d1c101b60 0x7f2d1c101f30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2d18004940 tx=0x7f2d18009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:55.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.306+0000 7f2d2354c700 1 -- 172.21.15.43:0/3363151952 shutdown_connections 2023-12-08T20:30:55.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.306+0000 7f2d2354c700 1 --2- 172.21.15.43:0/3363151952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d1c0fbb00 0x7f2d1c0fbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:55.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.306+0000 7f2d2354c700 1 --2- 172.21.15.43:0/3363151952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d1c101b60 0x7f2d1c101f30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:55.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.306+0000 7f2d2354c700 1 -- 172.21.15.43:0/3363151952 >> 172.21.15.43:0/3363151952 conn(0x7f2d1c0f7680 msgr2=0x7f2d1c0f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:55.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.307+0000 7f2d2354c700 1 -- 172.21.15.43:0/3363151952 shutdown_connections 2023-12-08T20:30:55.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.307+0000 7f2d2354c700 1 -- 172.21.15.43:0/3363151952 wait complete. 2023-12-08T20:30:55.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.307+0000 7f2d2354c700 1 Processor -- start 2023-12-08T20:30:55.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.307+0000 7f2d2354c700 1 -- start start 2023-12-08T20:30:55.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.307+0000 7f2d2354c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d1c0fbb00 0x7f2d1c113620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:55.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.307+0000 7f2d2354c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d1c101b60 0x7f2d1c113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:55.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.307+0000 7f2d2354c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c1141f0 con 0x7f2d1c101b60 2023-12-08T20:30:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.307+0000 7f2d2354c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c10d4e0 con 0x7f2d1c0fbb00 2023-12-08T20:30:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.308+0000 7f2d20ae7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d1c101b60 0x7f2d1c113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.308+0000 7f2d20ae7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d1c101b60 0x7f2d1c113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58814/0 (socket says 172.21.15.43:58814) 2023-12-08T20:30:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.308+0000 7f2d20ae7700 1 -- 172.21.15.43:0/4279027959 learned_addr learned my addr 172.21.15.43:0/4279027959 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:30:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.308+0000 7f2d212e8700 1 --2- 172.21.15.43:0/4279027959 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d1c0fbb00 0x7f2d1c113620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.308+0000 7f2d20ae7700 1 -- 172.21.15.43:0/4279027959 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d1c0fbb00 msgr2=0x7f2d1c113620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.308+0000 7f2d20ae7700 1 --2- 172.21.15.43:0/4279027959 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d1c0fbb00 0x7f2d1c113620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.308+0000 7f2d20ae7700 1 -- 172.21.15.43:0/4279027959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d18005040 con 0x7f2d1c101b60 2023-12-08T20:30:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.308+0000 7f2d20ae7700 1 --2- 172.21.15.43:0/4279027959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d1c101b60 0x7f2d1c113ba0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00c830 tx=0x7f2d0c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.308+0000 7f2d11ffb700 1 -- 172.21.15.43:0/4279027959 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d0c00a760 con 0x7f2d1c101b60 2023-12-08T20:30:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.308+0000 7f2d2354c700 1 -- 172.21.15.43:0/4279027959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1c10d770 con 0x7f2d1c101b60 2023-12-08T20:30:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.308+0000 7f2d11ffb700 1 -- 172.21.15.43:0/4279027959 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2d0c00ad70 con 0x7f2d1c101b60 2023-12-08T20:30:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.308+0000 7f2d11ffb700 1 -- 172.21.15.43:0/4279027959 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d0c0113a0 con 0x7f2d1c101b60 2023-12-08T20:30:55.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.309+0000 7f2d2354c700 1 -- 172.21.15.43:0/4279027959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1c10dcb0 con 0x7f2d1c101b60 2023-12-08T20:30:55.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.310+0000 7f2d2354c700 1 -- 172.21.15.43:0/4279027959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1c104f50 con 0x7f2d1c101b60 2023-12-08T20:30:55.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.310+0000 7f2d11ffb700 1 -- 172.21.15.43:0/4279027959 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f2d0c012400 con 0x7f2d1c101b60 2023-12-08T20:30:55.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.310+0000 7f2d11ffb700 1 --2- 172.21.15.43:0/4279027959 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f2d0806cae0 0x7f2d0806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:55.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.310+0000 7f2d11ffb700 1 -- 172.21.15.43:0/4279027959 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f2d0c08bdb0 con 0x7f2d1c101b60 2023-12-08T20:30:55.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.311+0000 7f2d212e8700 1 --2- 172.21.15.43:0/4279027959 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f2d0806cae0 0x7f2d0806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:55.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.311+0000 7f2d212e8700 1 --2- 172.21.15.43:0/4279027959 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f2d0806cae0 0x7f2d0806ef90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2d18004f90 tx=0x7f2d18009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:55.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.315+0000 7f2d11ffb700 1 -- 172.21.15.43:0/4279027959 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f2d0c059c70 con 0x7f2d1c101b60 2023-12-08T20:30:55.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.526+0000 7f2d2354c700 1 -- 172.21.15.43:0/4279027959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f2d1c0fb280 con 0x7f2d1c101b60 2023-12-08T20:30:55.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.526+0000 7f2d11ffb700 1 -- 172.21.15.43:0/4279027959 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v47)=0 v47) v1 ==== 163+0+0 (secure 0 0 0) 0x7f2d0c059800 con 0x7f2d1c101b60 2023-12-08T20:30:55.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.528+0000 7f2d2354c700 1 -- 172.21.15.43:0/4279027959 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f2d0806cae0 msgr2=0x7f2d0806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:55.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.528+0000 7f2d2354c700 1 --2- 172.21.15.43:0/4279027959 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f2d0806cae0 0x7f2d0806ef90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2d18004f90 tx=0x7f2d18009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:55.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.528+0000 7f2d2354c700 1 -- 172.21.15.43:0/4279027959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d1c101b60 msgr2=0x7f2d1c113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:55.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.528+0000 7f2d2354c700 1 --2- 172.21.15.43:0/4279027959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d1c101b60 0x7f2d1c113ba0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00c830 tx=0x7f2d0c004470 comp rx=0 tx=0).stop 2023-12-08T20:30:55.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.528+0000 7f2d2354c700 1 -- 172.21.15.43:0/4279027959 shutdown_connections 2023-12-08T20:30:55.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.528+0000 7f2d2354c700 1 --2- 172.21.15.43:0/4279027959 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d1c0fbb00 0x7f2d1c113620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:55.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.528+0000 7f2d2354c700 1 --2- 172.21.15.43:0/4279027959 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f2d0806cae0 0x7f2d0806ef90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:55.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.528+0000 7f2d2354c700 1 --2- 172.21.15.43:0/4279027959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d1c101b60 0x7f2d1c113ba0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:55.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.528+0000 7f2d2354c700 1 -- 172.21.15.43:0/4279027959 >> 172.21.15.43:0/4279027959 conn(0x7f2d1c0f7680 msgr2=0x7f2d1c065f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:55.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.528+0000 7f2d2354c700 1 -- 172.21.15.43:0/4279027959 shutdown_connections 2023-12-08T20:30:55.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:55.528+0000 7f2d2354c700 1 -- 172.21.15.43:0/4279027959 wait complete. 2023-12-08T20:30:55.925 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-08T20:30:56.229 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:30:56.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:56 smithi043 ceph-mon[111966]: pgmap v70: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:56.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:56 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:30:56.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:56 smithi111 ceph-mon[121341]: pgmap v70: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:56.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:56 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:30:57.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.309+0000 7f9b5cbe1700 1 -- 172.21.15.43:0/699318318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b58065390 msgr2=0x7f9b58065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:57.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.309+0000 7f9b5cbe1700 1 --2- 172.21.15.43:0/699318318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b58065390 0x7f9b58065800 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9b40004940 tx=0x7f9b40009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:57.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.309+0000 7f9b5cbe1700 1 -- 172.21.15.43:0/699318318 shutdown_connections 2023-12-08T20:30:57.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.309+0000 7f9b5cbe1700 1 --2- 172.21.15.43:0/699318318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b58065390 0x7f9b58065800 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:57.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.309+0000 7f9b5cbe1700 1 --2- 172.21.15.43:0/699318318 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b58102c20 0x7f9b58102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:57.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.309+0000 7f9b5cbe1700 1 -- 172.21.15.43:0/699318318 >> 172.21.15.43:0/699318318 conn(0x7f9b580719b0 msgr2=0x7f9b58071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:57.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.309+0000 7f9b5cbe1700 1 -- 172.21.15.43:0/699318318 shutdown_connections 2023-12-08T20:30:57.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.309+0000 7f9b5cbe1700 1 -- 172.21.15.43:0/699318318 wait complete. 2023-12-08T20:30:57.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.310+0000 7f9b5cbe1700 1 Processor -- start 2023-12-08T20:30:57.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.310+0000 7f9b5cbe1700 1 -- start start 2023-12-08T20:30:57.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.310+0000 7f9b5cbe1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b58065390 0x7f9b58113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:57.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.310+0000 7f9b5cbe1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b58102c20 0x7f9b58113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:57.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.310+0000 7f9b5cbe1700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b581142c0 con 0x7f9b58065390 2023-12-08T20:30:57.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.310+0000 7f9b5cbe1700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5810d5f0 con 0x7f9b58102c20 2023-12-08T20:30:57.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.310+0000 7f9b5659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b58065390 0x7f9b58113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:57.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.311+0000 7f9b5659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b58065390 0x7f9b58113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58834/0 (socket says 172.21.15.43:58834) 2023-12-08T20:30:57.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.311+0000 7f9b5659c700 1 -- 172.21.15.43:0/3602661871 learned_addr learned my addr 172.21.15.43:0/3602661871 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:30:57.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.311+0000 7f9b55d9b700 1 --2- 172.21.15.43:0/3602661871 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b58102c20 0x7f9b58113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:57.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.311+0000 7f9b5659c700 1 -- 172.21.15.43:0/3602661871 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b58102c20 msgr2=0x7f9b58113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:57.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.311+0000 7f9b5659c700 1 --2- 172.21.15.43:0/3602661871 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b58102c20 0x7f9b58113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:57.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.311+0000 7f9b5659c700 1 -- 172.21.15.43:0/3602661871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b40005040 con 0x7f9b58065390 2023-12-08T20:30:57.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.311+0000 7f9b5659c700 1 --2- 172.21.15.43:0/3602661871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b58065390 0x7f9b58113730 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9b48002a50 tx=0x7f9b480046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:57.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.311+0000 7f9b4effd700 1 -- 172.21.15.43:0/3602661871 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b48007cc0 con 0x7f9b58065390 2023-12-08T20:30:57.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.311+0000 7f9b4effd700 1 -- 172.21.15.43:0/3602661871 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9b4800f040 con 0x7f9b58065390 2023-12-08T20:30:57.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.311+0000 7f9b5cbe1700 1 -- 172.21.15.43:0/3602661871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5810d870 con 0x7f9b58065390 2023-12-08T20:30:57.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.311+0000 7f9b4effd700 1 -- 172.21.15.43:0/3602661871 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b4800d9c0 con 0x7f9b58065390 2023-12-08T20:30:57.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.312+0000 7f9b5cbe1700 1 -- 172.21.15.43:0/3602661871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5810dd80 con 0x7f9b58065390 2023-12-08T20:30:57.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.313+0000 7f9b5cbe1700 1 -- 172.21.15.43:0/3602661871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b580fff40 con 0x7f9b58065390 2023-12-08T20:30:57.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.313+0000 7f9b4effd700 1 -- 172.21.15.43:0/3602661871 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f9b4800db20 con 0x7f9b58065390 2023-12-08T20:30:57.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.314+0000 7f9b4effd700 1 --2- 172.21.15.43:0/3602661871 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f9b4406cae0 0x7f9b4406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:57.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.314+0000 7f9b55d9b700 1 --2- 172.21.15.43:0/3602661871 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f9b4406cae0 0x7f9b4406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:57.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.314+0000 7f9b4effd700 1 -- 172.21.15.43:0/3602661871 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f9b4808baa0 con 0x7f9b58065390 2023-12-08T20:30:57.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.314+0000 7f9b55d9b700 1 --2- 172.21.15.43:0/3602661871 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f9b4406cae0 0x7f9b4406ef90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9b5810e920 tx=0x7f9b40009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:57.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.319+0000 7f9b4effd700 1 -- 172.21.15.43:0/3602661871 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f9b480598e0 con 0x7f9b58065390 2023-12-08T20:30:57.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.528+0000 7f9b5cbe1700 1 -- 172.21.15.43:0/3602661871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f9b5804bbf0 con 0x7f9b58065390 2023-12-08T20:30:57.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.528+0000 7f9b4effd700 1 -- 172.21.15.43:0/3602661871 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v47)=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7f9b48059470 con 0x7f9b58065390 2023-12-08T20:30:57.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.530+0000 7f9b5cbe1700 1 -- 172.21.15.43:0/3602661871 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f9b4406cae0 msgr2=0x7f9b4406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:57.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.530+0000 7f9b5cbe1700 1 --2- 172.21.15.43:0/3602661871 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f9b4406cae0 0x7f9b4406ef90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9b5810e920 tx=0x7f9b40009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:57.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.530+0000 7f9b5cbe1700 1 -- 172.21.15.43:0/3602661871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b58065390 msgr2=0x7f9b58113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:57.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.530+0000 7f9b5cbe1700 1 --2- 172.21.15.43:0/3602661871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b58065390 0x7f9b58113730 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9b48002a50 tx=0x7f9b480046b0 comp rx=0 tx=0).stop 2023-12-08T20:30:57.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.530+0000 7f9b5cbe1700 1 -- 172.21.15.43:0/3602661871 shutdown_connections 2023-12-08T20:30:57.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.530+0000 7f9b5cbe1700 1 --2- 172.21.15.43:0/3602661871 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f9b4406cae0 0x7f9b4406ef90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:57.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.530+0000 7f9b5cbe1700 1 --2- 172.21.15.43:0/3602661871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b58065390 0x7f9b58113730 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:57.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.530+0000 7f9b5cbe1700 1 --2- 172.21.15.43:0/3602661871 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b58102c20 0x7f9b58113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:57.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.530+0000 7f9b5cbe1700 1 -- 172.21.15.43:0/3602661871 >> 172.21.15.43:0/3602661871 conn(0x7f9b580719b0 msgr2=0x7f9b580fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:57.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.531+0000 7f9b5cbe1700 1 -- 172.21.15.43:0/3602661871 shutdown_connections 2023-12-08T20:30:57.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:57.531+0000 7f9b5cbe1700 1 -- 172.21.15.43:0/3602661871 wait complete. 2023-12-08T20:30:57.957 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2023-12-08T20:30:58.261 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:30:58.412 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:30:58 smithi043 ceph-mon[111966]: pgmap v71: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:58.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:30:58 smithi111 ceph-mon[121341]: pgmap v71: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:30:59.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.349+0000 7f92bbfdb700 1 -- 172.21.15.43:0/3001091469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92b40708f0 msgr2=0x7f92b4108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:59.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.349+0000 7f92bbfdb700 1 --2- 172.21.15.43:0/3001091469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92b40708f0 0x7f92b4108f00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f92a4004970 tx=0x7f92a4009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:59.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.349+0000 7f92bbfdb700 1 -- 172.21.15.43:0/3001091469 shutdown_connections 2023-12-08T20:30:59.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.349+0000 7f92bbfdb700 1 --2- 172.21.15.43:0/3001091469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92b40708f0 0x7f92b4108f00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:59.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.349+0000 7f92bbfdb700 1 --2- 172.21.15.43:0/3001091469 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92b406ffe0 0x7f92b40703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:59.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.349+0000 7f92bbfdb700 1 -- 172.21.15.43:0/3001091469 >> 172.21.15.43:0/3001091469 conn(0x7f92b40f87a0 msgr2=0x7f92b40fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:59.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.349+0000 7f92bbfdb700 1 -- 172.21.15.43:0/3001091469 shutdown_connections 2023-12-08T20:30:59.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.349+0000 7f92bbfdb700 1 -- 172.21.15.43:0/3001091469 wait complete. 2023-12-08T20:30:59.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.350+0000 7f92bbfdb700 1 Processor -- start 2023-12-08T20:30:59.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.350+0000 7f92bbfdb700 1 -- start start 2023-12-08T20:30:59.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.350+0000 7f92bbfdb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92b406ffe0 0x7f92b4115800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:59.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.350+0000 7f92bbfdb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92b40708f0 0x7f92b4115d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:59.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.350+0000 7f92bbfdb700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b4116390 con 0x7f92b406ffe0 2023-12-08T20:30:59.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.350+0000 7f92bbfdb700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b410f6c0 con 0x7f92b40708f0 2023-12-08T20:30:59.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.350+0000 7f92b9d77700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92b406ffe0 0x7f92b4115800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:59.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.350+0000 7f92b9d77700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92b406ffe0 0x7f92b4115800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58848/0 (socket says 172.21.15.43:58848) 2023-12-08T20:30:59.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.350+0000 7f92b9d77700 1 -- 172.21.15.43:0/222682484 learned_addr learned my addr 172.21.15.43:0/222682484 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:30:59.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.350+0000 7f92b9576700 1 --2- 172.21.15.43:0/222682484 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92b40708f0 0x7f92b4115d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:59.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.350+0000 7f92b9d77700 1 -- 172.21.15.43:0/222682484 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92b40708f0 msgr2=0x7f92b4115d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:59.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.350+0000 7f92b9d77700 1 --2- 172.21.15.43:0/222682484 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92b40708f0 0x7f92b4115d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:59.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.350+0000 7f92b9d77700 1 -- 172.21.15.43:0/222682484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a4005040 con 0x7f92b406ffe0 2023-12-08T20:30:59.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.350+0000 7f92b9576700 1 --2- 172.21.15.43:0/222682484 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92b40708f0 0x7f92b4115d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T20:30:59.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.351+0000 7f92b9d77700 1 --2- 172.21.15.43:0/222682484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92b406ffe0 0x7f92b4115800 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f92b000eb40 tx=0x7f92b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:59.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.351+0000 7f92aa7fc700 1 -- 172.21.15.43:0/222682484 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92b0007cc0 con 0x7f92b406ffe0 2023-12-08T20:30:59.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.351+0000 7f92aa7fc700 1 -- 172.21.15.43:0/222682484 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f92b000f040 con 0x7f92b406ffe0 2023-12-08T20:30:59.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.351+0000 7f92bbfdb700 1 -- 172.21.15.43:0/222682484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b410f940 con 0x7f92b406ffe0 2023-12-08T20:30:59.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.351+0000 7f92aa7fc700 1 -- 172.21.15.43:0/222682484 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92b0009570 con 0x7f92b406ffe0 2023-12-08T20:30:59.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.351+0000 7f92bbfdb700 1 -- 172.21.15.43:0/222682484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b410fe80 con 0x7f92b406ffe0 2023-12-08T20:30:59.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.352+0000 7f92bbfdb700 1 -- 172.21.15.43:0/222682484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b41065c0 con 0x7f92b406ffe0 2023-12-08T20:30:59.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.353+0000 7f92aa7fc700 1 -- 172.21.15.43:0/222682484 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f92b00096d0 con 0x7f92b406ffe0 2023-12-08T20:30:59.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.353+0000 7f92aa7fc700 1 --2- 172.21.15.43:0/222682484 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f92a006cae0 0x7f92a006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:30:59.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.353+0000 7f92aa7fc700 1 -- 172.21.15.43:0/222682484 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f92b008ba30 con 0x7f92b406ffe0 2023-12-08T20:30:59.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.353+0000 7f92b9576700 1 --2- 172.21.15.43:0/222682484 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f92a006cae0 0x7f92a006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:30:59.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.354+0000 7f92b9576700 1 --2- 172.21.15.43:0/222682484 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f92a006cae0 0x7f92a006ef90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f92a4005010 tx=0x7f92a4009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:30:59.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.358+0000 7f92aa7fc700 1 -- 172.21.15.43:0/222682484 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f92b0059920 con 0x7f92b406ffe0 2023-12-08T20:30:59.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.584+0000 7f92bbfdb700 1 -- 172.21.15.43:0/222682484 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882", "target": ["mon-mgr", ""]}) v1 -- 0x7f92b4110de0 con 0x7f92a006cae0 2023-12-08T20:30:59.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.589+0000 7f92aa7fc700 1 -- 172.21.15.43:0/222682484 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f92b4110de0 con 0x7f92a006cae0 2023-12-08T20:30:59.591 INFO:teuthology.orchestra.run.smithi043.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:30:59.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.591+0000 7f92bbfdb700 1 -- 172.21.15.43:0/222682484 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f92a006cae0 msgr2=0x7f92a006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:59.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.591+0000 7f92bbfdb700 1 --2- 172.21.15.43:0/222682484 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f92a006cae0 0x7f92a006ef90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f92a4005010 tx=0x7f92a4009e30 comp rx=0 tx=0).stop 2023-12-08T20:30:59.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.591+0000 7f92bbfdb700 1 -- 172.21.15.43:0/222682484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92b406ffe0 msgr2=0x7f92b4115800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:30:59.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.591+0000 7f92bbfdb700 1 --2- 172.21.15.43:0/222682484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92b406ffe0 0x7f92b4115800 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f92b000eb40 tx=0x7f92b000b040 comp rx=0 tx=0).stop 2023-12-08T20:30:59.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.591+0000 7f92bbfdb700 1 -- 172.21.15.43:0/222682484 shutdown_connections 2023-12-08T20:30:59.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.592+0000 7f92bbfdb700 1 --2- 172.21.15.43:0/222682484 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f92a006cae0 0x7f92a006ef90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:59.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.592+0000 7f92bbfdb700 1 --2- 172.21.15.43:0/222682484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92b406ffe0 0x7f92b4115800 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:59.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.592+0000 7f92bbfdb700 1 --2- 172.21.15.43:0/222682484 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92b40708f0 0x7f92b4115d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:30:59.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.592+0000 7f92bbfdb700 1 -- 172.21.15.43:0/222682484 >> 172.21.15.43:0/222682484 conn(0x7f92b40f87a0 msgr2=0x7f92b4103740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:30:59.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.592+0000 7f92bbfdb700 1 -- 172.21.15.43:0/222682484 shutdown_connections 2023-12-08T20:30:59.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:30:59.592+0000 7f92bbfdb700 1 -- 172.21.15.43:0/222682484 wait complete. 2023-12-08T20:30:59.987 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-08T20:30:59.988 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi043.front.sepia.ceph.com 2023-12-08T20:30:59.988 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2023-12-08T20:31:00.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:00 smithi043 ceph-mon[111966]: pgmap v72: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:00.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:00 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:00.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:00 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:31:00.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:00 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:00.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:00 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:31:00.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:00 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:00.303 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:31:00.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:00 smithi111 ceph-mon[121341]: pgmap v72: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:00.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:00 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:00.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:00 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:31:00.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:00 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:00.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:00 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:31:00.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:00 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:01.446 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:01 smithi043 ceph-mon[111966]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:31:01.446 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:01 smithi043 ceph-mon[111966]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:31:01.446 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:01 smithi043 ceph-mon[111966]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:31:01.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:01 smithi111 ceph-mon[121341]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:31:01.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:01 smithi111 ceph-mon[121341]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:31:01.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:01 smithi111 ceph-mon[121341]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:9dcc13bb80dcc1cdea72b04d80505b4649a2b882 2023-12-08T20:31:01.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.854+0000 7f8f3b054700 1 -- 172.21.15.43:0/766616384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f34070870 msgr2=0x7f8f34108f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:01.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.854+0000 7f8f3b054700 1 --2- 172.21.15.43:0/766616384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f34070870 0x7f8f34108f90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8f20004940 tx=0x7f8f20009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:01.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.854+0000 7f8f3b054700 1 -- 172.21.15.43:0/766616384 shutdown_connections 2023-12-08T20:31:01.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.854+0000 7f8f3b054700 1 --2- 172.21.15.43:0/766616384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f34070870 0x7f8f34108f90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:01.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.854+0000 7f8f3b054700 1 --2- 172.21.15.43:0/766616384 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f3406ff60 0x7f8f34070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:01.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.854+0000 7f8f3b054700 1 -- 172.21.15.43:0/766616384 >> 172.21.15.43:0/766616384 conn(0x7f8f340f8790 msgr2=0x7f8f340faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:01.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.855+0000 7f8f3b054700 1 -- 172.21.15.43:0/766616384 shutdown_connections 2023-12-08T20:31:01.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.855+0000 7f8f3b054700 1 -- 172.21.15.43:0/766616384 wait complete. 2023-12-08T20:31:01.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.855+0000 7f8f3b054700 1 Processor -- start 2023-12-08T20:31:01.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.855+0000 7f8f3b054700 1 -- start start 2023-12-08T20:31:01.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.856+0000 7f8f3b054700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f3406ff60 0x7f8f341158b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:01.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.856+0000 7f8f3b054700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f34070870 0x7f8f34115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:01.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.856+0000 7f8f3b054700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f34116440 con 0x7f8f3406ff60 2023-12-08T20:31:01.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.856+0000 7f8f3b054700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3410f770 con 0x7f8f34070870 2023-12-08T20:31:01.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.856+0000 7f8f38df0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f3406ff60 0x7f8f341158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:01.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.856+0000 7f8f38df0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f3406ff60 0x7f8f341158b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50236/0 (socket says 172.21.15.43:50236) 2023-12-08T20:31:01.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.856+0000 7f8f38df0700 1 -- 172.21.15.43:0/2740743393 learned_addr learned my addr 172.21.15.43:0/2740743393 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:31:01.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.856+0000 7f8f33fff700 1 --2- 172.21.15.43:0/2740743393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f34070870 0x7f8f34115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:01.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.856+0000 7f8f38df0700 1 -- 172.21.15.43:0/2740743393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f34070870 msgr2=0x7f8f34115df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:01.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.856+0000 7f8f38df0700 1 --2- 172.21.15.43:0/2740743393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f34070870 0x7f8f34115df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:01.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.856+0000 7f8f38df0700 1 -- 172.21.15.43:0/2740743393 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f20005040 con 0x7f8f3406ff60 2023-12-08T20:31:01.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.856+0000 7f8f38df0700 1 --2- 172.21.15.43:0/2740743393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f3406ff60 0x7f8f341158b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8f28002a50 tx=0x7f8f280046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:01.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.857+0000 7f8f317fa700 1 -- 172.21.15.43:0/2740743393 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f28007cc0 con 0x7f8f3406ff60 2023-12-08T20:31:01.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.857+0000 7f8f3b054700 1 -- 172.21.15.43:0/2740743393 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3410fa50 con 0x7f8f3406ff60 2023-12-08T20:31:01.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.857+0000 7f8f317fa700 1 -- 172.21.15.43:0/2740743393 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8f2800f040 con 0x7f8f3406ff60 2023-12-08T20:31:01.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.857+0000 7f8f317fa700 1 -- 172.21.15.43:0/2740743393 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f2800d9c0 con 0x7f8f3406ff60 2023-12-08T20:31:01.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.857+0000 7f8f3b054700 1 -- 172.21.15.43:0/2740743393 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3410ff60 con 0x7f8f3406ff60 2023-12-08T20:31:01.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.858+0000 7f8f3b054700 1 -- 172.21.15.43:0/2740743393 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f34106650 con 0x7f8f3406ff60 2023-12-08T20:31:01.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.858+0000 7f8f317fa700 1 -- 172.21.15.43:0/2740743393 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f8f2800db20 con 0x7f8f3406ff60 2023-12-08T20:31:01.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.859+0000 7f8f317fa700 1 --2- 172.21.15.43:0/2740743393 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f8f2406cae0 0x7f8f2406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:01.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.859+0000 7f8f317fa700 1 -- 172.21.15.43:0/2740743393 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f8f2808baa0 con 0x7f8f3406ff60 2023-12-08T20:31:01.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.859+0000 7f8f33fff700 1 --2- 172.21.15.43:0/2740743393 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f8f2406cae0 0x7f8f2406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:01.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.860+0000 7f8f33fff700 1 --2- 172.21.15.43:0/2740743393 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f8f2406cae0 0x7f8f2406ef90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8f34110aa0 tx=0x7f8f20009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:01.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:01.864+0000 7f8f317fa700 1 -- 172.21.15.43:0/2740743393 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f8f280598e0 con 0x7f8f3406ff60 2023-12-08T20:31:02.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.101+0000 7f8f3b054700 1 -- 172.21.15.43:0/2740743393 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f3404bb80 con 0x7f8f2406cae0 2023-12-08T20:31:02.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.102+0000 7f8f317fa700 1 -- 172.21.15.43:0/2740743393 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f8f3404bb80 con 0x7f8f2406cae0 2023-12-08T20:31:02.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.105+0000 7f8f3b054700 1 -- 172.21.15.43:0/2740743393 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f8f2406cae0 msgr2=0x7f8f2406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:02.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.105+0000 7f8f3b054700 1 --2- 172.21.15.43:0/2740743393 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f8f2406cae0 0x7f8f2406ef90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8f34110aa0 tx=0x7f8f20009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:02.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.105+0000 7f8f3b054700 1 -- 172.21.15.43:0/2740743393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f3406ff60 msgr2=0x7f8f341158b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:02.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.105+0000 7f8f3b054700 1 --2- 172.21.15.43:0/2740743393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f3406ff60 0x7f8f341158b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8f28002a50 tx=0x7f8f280046b0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.105+0000 7f8f3b054700 1 -- 172.21.15.43:0/2740743393 shutdown_connections 2023-12-08T20:31:02.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.105+0000 7f8f3b054700 1 --2- 172.21.15.43:0/2740743393 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f8f2406cae0 0x7f8f2406ef90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.105+0000 7f8f3b054700 1 --2- 172.21.15.43:0/2740743393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f3406ff60 0x7f8f341158b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.105+0000 7f8f3b054700 1 --2- 172.21.15.43:0/2740743393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f34070870 0x7f8f34115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.105+0000 7f8f3b054700 1 -- 172.21.15.43:0/2740743393 >> 172.21.15.43:0/2740743393 conn(0x7f8f340f8790 msgr2=0x7f8f341037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:02.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.105+0000 7f8f3b054700 1 -- 172.21.15.43:0/2740743393 shutdown_connections 2023-12-08T20:31:02.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.105+0000 7f8f3b054700 1 -- 172.21.15.43:0/2740743393 wait complete. 2023-12-08T20:31:02.119 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:31:02.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.226+0000 7f299ff6e700 1 -- 172.21.15.43:0/3956424266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998065390 msgr2=0x7f2998065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:02.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.226+0000 7f299ff6e700 1 --2- 172.21.15.43:0/3956424266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998065390 0x7f2998065800 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2988004940 tx=0x7f2988009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:02.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.226+0000 7f299ff6e700 1 -- 172.21.15.43:0/3956424266 shutdown_connections 2023-12-08T20:31:02.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.226+0000 7f299ff6e700 1 --2- 172.21.15.43:0/3956424266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998065390 0x7f2998065800 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.226+0000 7f299ff6e700 1 --2- 172.21.15.43:0/3956424266 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2998102c20 0x7f2998102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.226+0000 7f299ff6e700 1 -- 172.21.15.43:0/3956424266 >> 172.21.15.43:0/3956424266 conn(0x7f29980719b0 msgr2=0x7f2998071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:02.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.227+0000 7f299ff6e700 1 -- 172.21.15.43:0/3956424266 shutdown_connections 2023-12-08T20:31:02.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.227+0000 7f299ff6e700 1 -- 172.21.15.43:0/3956424266 wait complete. 2023-12-08T20:31:02.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.227+0000 7f299ff6e700 1 Processor -- start 2023-12-08T20:31:02.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.227+0000 7f299ff6e700 1 -- start start 2023-12-08T20:31:02.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.227+0000 7f299ff6e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2998065390 0x7f2998113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:02.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.227+0000 7f299ff6e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998102c20 0x7f2998113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:02.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.227+0000 7f299ff6e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29981142c0 con 0x7f2998102c20 2023-12-08T20:31:02.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.227+0000 7f299ff6e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299810d5f0 con 0x7f2998065390 2023-12-08T20:31:02.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.228+0000 7f299d509700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998102c20 0x7f2998113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:02.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.228+0000 7f299d509700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998102c20 0x7f2998113c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50258/0 (socket says 172.21.15.43:50258) 2023-12-08T20:31:02.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.228+0000 7f299d509700 1 -- 172.21.15.43:0/2113901042 learned_addr learned my addr 172.21.15.43:0/2113901042 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:31:02.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.228+0000 7f299dd0a700 1 --2- 172.21.15.43:0/2113901042 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2998065390 0x7f2998113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:02.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.228+0000 7f299d509700 1 -- 172.21.15.43:0/2113901042 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2998065390 msgr2=0x7f2998113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:02.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.228+0000 7f299d509700 1 --2- 172.21.15.43:0/2113901042 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2998065390 0x7f2998113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.228+0000 7f299d509700 1 -- 172.21.15.43:0/2113901042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2988005040 con 0x7f2998102c20 2023-12-08T20:31:02.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.228+0000 7f299d509700 1 --2- 172.21.15.43:0/2113901042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998102c20 0x7f2998113c70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2988009180 tx=0x7f2988009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:02.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.228+0000 7f298e7fc700 1 -- 172.21.15.43:0/2113901042 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f298800e040 con 0x7f2998102c20 2023-12-08T20:31:02.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.228+0000 7f298e7fc700 1 -- 172.21.15.43:0/2113901042 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2988013420 con 0x7f2998102c20 2023-12-08T20:31:02.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.228+0000 7f299ff6e700 1 -- 172.21.15.43:0/2113901042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299810d870 con 0x7f2998102c20 2023-12-08T20:31:02.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.228+0000 7f298e7fc700 1 -- 172.21.15.43:0/2113901042 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f298801c630 con 0x7f2998102c20 2023-12-08T20:31:02.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.228+0000 7f299ff6e700 1 -- 172.21.15.43:0/2113901042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299810ddb0 con 0x7f2998102c20 2023-12-08T20:31:02.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.230+0000 7f299ff6e700 1 -- 172.21.15.43:0/2113901042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297c0052b0 con 0x7f2998102c20 2023-12-08T20:31:02.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.230+0000 7f298e7fc700 1 -- 172.21.15.43:0/2113901042 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f298800bb80 con 0x7f2998102c20 2023-12-08T20:31:02.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.231+0000 7f298e7fc700 1 --2- 172.21.15.43:0/2113901042 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f298406cae0 0x7f298406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:02.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.231+0000 7f298e7fc700 1 -- 172.21.15.43:0/2113901042 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f298808daa0 con 0x7f2998102c20 2023-12-08T20:31:02.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.231+0000 7f299dd0a700 1 --2- 172.21.15.43:0/2113901042 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f298406cae0 0x7f298406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:02.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.232+0000 7f299dd0a700 1 --2- 172.21.15.43:0/2113901042 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f298406cae0 0x7f298406ef90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2994007fd0 tx=0x7f2994009040 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:02.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.236+0000 7f298e7fc700 1 -- 172.21.15.43:0/2113901042 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f298805ba00 con 0x7f2998102c20 2023-12-08T20:31:02.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:02 smithi111 ceph-mon[121341]: pgmap v73: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:02.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:02 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:02.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:02 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:31:02.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:02 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:31:02.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:02 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:02.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:02 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-08T20:31:02.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.466+0000 7f299ff6e700 1 -- 172.21.15.43:0/2113901042 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f297c000bc0 con 0x7f298406cae0 2023-12-08T20:31:02.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.468+0000 7f298e7fc700 1 -- 172.21.15.43:0/2113901042 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f297c000bc0 con 0x7f298406cae0 2023-12-08T20:31:02.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.470+0000 7f299ff6e700 1 -- 172.21.15.43:0/2113901042 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f298406cae0 msgr2=0x7f298406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:02.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.470+0000 7f299ff6e700 1 --2- 172.21.15.43:0/2113901042 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f298406cae0 0x7f298406ef90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2994007fd0 tx=0x7f2994009040 comp rx=0 tx=0).stop 2023-12-08T20:31:02.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.470+0000 7f299ff6e700 1 -- 172.21.15.43:0/2113901042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998102c20 msgr2=0x7f2998113c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:02.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.470+0000 7f299ff6e700 1 --2- 172.21.15.43:0/2113901042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998102c20 0x7f2998113c70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2988009180 tx=0x7f2988009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:02.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.470+0000 7f299ff6e700 1 -- 172.21.15.43:0/2113901042 shutdown_connections 2023-12-08T20:31:02.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.470+0000 7f299ff6e700 1 --2- 172.21.15.43:0/2113901042 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2998065390 0x7f2998113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.470+0000 7f299ff6e700 1 --2- 172.21.15.43:0/2113901042 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f298406cae0 0x7f298406ef90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.470+0000 7f299ff6e700 1 --2- 172.21.15.43:0/2113901042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998102c20 0x7f2998113c70 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.470+0000 7f299ff6e700 1 -- 172.21.15.43:0/2113901042 >> 172.21.15.43:0/2113901042 conn(0x7f29980719b0 msgr2=0x7f29980fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:02.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.470+0000 7f299ff6e700 1 -- 172.21.15.43:0/2113901042 shutdown_connections 2023-12-08T20:31:02.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.470+0000 7f299ff6e700 1 -- 172.21.15.43:0/2113901042 wait complete. 2023-12-08T20:31:02.478 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:02 smithi043 ceph-mon[111966]: pgmap v73: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:02.478 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:02 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:02.478 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:02 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:31:02.478 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:02 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:31:02.478 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:02 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:02.478 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:02 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-08T20:31:02.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.589+0000 7f493b4ed700 1 -- 172.21.15.43:0/3672245145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4934065390 msgr2=0x7f4934065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:02.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.589+0000 7f493b4ed700 1 --2- 172.21.15.43:0/3672245145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4934065390 0x7f4934065800 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4924004940 tx=0x7f4924009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:02.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.589+0000 7f493b4ed700 1 -- 172.21.15.43:0/3672245145 shutdown_connections 2023-12-08T20:31:02.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.589+0000 7f493b4ed700 1 --2- 172.21.15.43:0/3672245145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4934065390 0x7f4934065800 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.589+0000 7f493b4ed700 1 --2- 172.21.15.43:0/3672245145 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4934102c20 0x7f4934102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.589+0000 7f493b4ed700 1 -- 172.21.15.43:0/3672245145 >> 172.21.15.43:0/3672245145 conn(0x7f49340719b0 msgr2=0x7f4934071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:02.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.589+0000 7f493b4ed700 1 -- 172.21.15.43:0/3672245145 shutdown_connections 2023-12-08T20:31:02.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.589+0000 7f493b4ed700 1 -- 172.21.15.43:0/3672245145 wait complete. 2023-12-08T20:31:02.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.590+0000 7f493b4ed700 1 Processor -- start 2023-12-08T20:31:02.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.590+0000 7f493b4ed700 1 -- start start 2023-12-08T20:31:02.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.591+0000 7f493b4ed700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4934065390 0x7f4934113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:02.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.591+0000 7f493b4ed700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4934102c20 0x7f4934113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:02.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.591+0000 7f493b4ed700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49341142c0 con 0x7f4934065390 2023-12-08T20:31:02.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.591+0000 7f493b4ed700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493410d5f0 con 0x7f4934102c20 2023-12-08T20:31:02.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.591+0000 7f4939289700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4934065390 0x7f4934113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:02.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.591+0000 7f4939289700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4934065390 0x7f4934113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50286/0 (socket says 172.21.15.43:50286) 2023-12-08T20:31:02.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.591+0000 7f4939289700 1 -- 172.21.15.43:0/4175675063 learned_addr learned my addr 172.21.15.43:0/4175675063 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:31:02.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.591+0000 7f4938a88700 1 --2- 172.21.15.43:0/4175675063 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4934102c20 0x7f4934113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:02.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.591+0000 7f4939289700 1 -- 172.21.15.43:0/4175675063 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4934102c20 msgr2=0x7f4934113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:02.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.591+0000 7f4939289700 1 --2- 172.21.15.43:0/4175675063 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4934102c20 0x7f4934113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.591+0000 7f4939289700 1 -- 172.21.15.43:0/4175675063 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4924005040 con 0x7f4934065390 2023-12-08T20:31:02.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.591+0000 7f4939289700 1 --2- 172.21.15.43:0/4175675063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4934065390 0x7f4934113730 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4930002a50 tx=0x7f49300046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:02.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.591+0000 7f4929ffb700 1 -- 172.21.15.43:0/4175675063 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4930007cc0 con 0x7f4934065390 2023-12-08T20:31:02.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.591+0000 7f493b4ed700 1 -- 172.21.15.43:0/4175675063 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493410d8d0 con 0x7f4934065390 2023-12-08T20:31:02.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.591+0000 7f4929ffb700 1 -- 172.21.15.43:0/4175675063 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f493000f040 con 0x7f4934065390 2023-12-08T20:31:02.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.591+0000 7f4929ffb700 1 -- 172.21.15.43:0/4175675063 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4930009540 con 0x7f4934065390 2023-12-08T20:31:02.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.592+0000 7f493b4ed700 1 -- 172.21.15.43:0/4175675063 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493410de10 con 0x7f4934065390 2023-12-08T20:31:02.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.593+0000 7f493b4ed700 1 -- 172.21.15.43:0/4175675063 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49340fff40 con 0x7f4934065390 2023-12-08T20:31:02.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.593+0000 7f4929ffb700 1 -- 172.21.15.43:0/4175675063 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f49300096a0 con 0x7f4934065390 2023-12-08T20:31:02.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.594+0000 7f4929ffb700 1 --2- 172.21.15.43:0/4175675063 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f492006cae0 0x7f492006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:02.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.594+0000 7f4929ffb700 1 -- 172.21.15.43:0/4175675063 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f493008bbf0 con 0x7f4934065390 2023-12-08T20:31:02.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.594+0000 7f4938a88700 1 --2- 172.21.15.43:0/4175675063 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f492006cae0 0x7f492006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:02.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.594+0000 7f4938a88700 1 --2- 172.21.15.43:0/4175675063 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f492006cae0 0x7f492006ef90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f492400b3b0 tx=0x7f4924009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:02.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.598+0000 7f4929ffb700 1 -- 172.21.15.43:0/4175675063 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f49300599d0 con 0x7f4934065390 2023-12-08T20:31:02.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.822+0000 7f493b4ed700 1 -- 172.21.15.43:0/4175675063 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f493404bbf0 con 0x7f492006cae0 2023-12-08T20:31:02.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.834+0000 7f4929ffb700 1 -- 172.21.15.43:0/4175675063 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f493404bbf0 con 0x7f492006cae0 2023-12-08T20:31:02.836 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-08T20:31:02.836 INFO:teuthology.orchestra.run.smithi043.stdout:alertmanager.smithi043 smithi043 *:9093,9094 running (80s) 61s ago 9m 17.7M - 0.25.0 c8568f914cd2 d4a6cd00c86b 2023-12-08T20:31:02.836 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi043 smithi043 running (9m) 61s ago 9m 7432k - 17.2.7-119-ge2143d99 f761b6e42225 f84d492b732c 2023-12-08T20:31:02.836 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi111 smithi111 running (8m) 109s ago 8m 7428k - 17.2.7-119-ge2143d99 f761b6e42225 88b53685ae54 2023-12-08T20:31:02.836 INFO:teuthology.orchestra.run.smithi043.stdout:grafana.smithi043 smithi043 *:3000 running (65s) 61s ago 9m 51.4M - 9.4.7 954c08fa6188 8f55491a980b 2023-12-08T20:31:02.836 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.akrjef smithi043 running (5m) 61s ago 5m 17.7M - 17.2.7-119-ge2143d99 f761b6e42225 1c0cb8d34ef8 2023-12-08T20:31:02.836 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.pjmszb smithi043 running (5m) 61s ago 5m 7151M - 17.2.7-119-ge2143d99 f761b6e42225 d7eee0c78093 2023-12-08T20:31:02.836 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.svpasm smithi111 running (5m) 109s ago 5m 15.2M - 17.2.7-119-ge2143d99 f761b6e42225 657d4d1cf4b2 2023-12-08T20:31:02.836 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.veeegc smithi111 running (5m) 109s ago 5m 2612M - 17.2.7-119-ge2143d99 f761b6e42225 31f794a388ab 2023-12-08T20:31:02.836 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi043.hqcdcm smithi043 *:8443,9283,8765 running (2m) 61s ago 10m 507M - 19.0.0-44-g9dcc13bb f28f2b94f153 14e91c1dac64 2023-12-08T20:31:02.836 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi111.mtcffu smithi111 *:8443,9283,8765 running (2m) 109s ago 8m 449M - 19.0.0-44-g9dcc13bb f28f2b94f153 56f4290c6db5 2023-12-08T20:31:02.836 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi043 smithi043 running (10m) 61s ago 10m 100M 2048M 17.2.7-119-ge2143d99 f761b6e42225 fe2a56effef3 2023-12-08T20:31:02.837 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi111 smithi111 running (8m) 109s ago 8m 67.8M 2048M 17.2.7-119-ge2143d99 f761b6e42225 2ae21cf3fa1e 2023-12-08T20:31:02.837 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi043 smithi043 *:9100 running (115s) 61s ago 9m 9.99M - 1.5.0 0da6a335fe13 0959b44d9972 2023-12-08T20:31:02.837 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi111 smithi111 *:9100 running (112s) 109s ago 8m 3862k - 1.5.0 0da6a335fe13 10fe4fdb23d0 2023-12-08T20:31:02.837 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (7m) 61s ago 7m 746M 1570M 17.2.7-119-ge2143d99 f761b6e42225 462eeaf62b2c 2023-12-08T20:31:02.837 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi043 running (7m) 61s ago 7m 853M 1570M 17.2.7-119-ge2143d99 f761b6e42225 dde419c88a89 2023-12-08T20:31:02.837 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi043 running (7m) 61s ago 7m 636M 1570M 17.2.7-119-ge2143d99 f761b6e42225 f7e812026ef5 2023-12-08T20:31:02.837 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi111 running (6m) 109s ago 6m 791M 2592M 17.2.7-119-ge2143d99 f761b6e42225 2a738d30441c 2023-12-08T20:31:02.837 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi111 running (6m) 109s ago 6m 600M 2592M 17.2.7-119-ge2143d99 f761b6e42225 38cdb6a88694 2023-12-08T20:31:02.837 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi111 running (6m) 109s ago 6m 728M 2592M 17.2.7-119-ge2143d99 f761b6e42225 59a9ce8c1141 2023-12-08T20:31:02.837 INFO:teuthology.orchestra.run.smithi043.stdout:prometheus.smithi043 smithi043 *:9095 running (95s) 61s ago 8m 48.1M - 2.43.0 a07b618ecd1d d95914ec88d8 2023-12-08T20:31:02.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.836+0000 7f493b4ed700 1 -- 172.21.15.43:0/4175675063 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f492006cae0 msgr2=0x7f492006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:02.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.836+0000 7f493b4ed700 1 --2- 172.21.15.43:0/4175675063 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f492006cae0 0x7f492006ef90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f492400b3b0 tx=0x7f4924009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:02.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.836+0000 7f493b4ed700 1 -- 172.21.15.43:0/4175675063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4934065390 msgr2=0x7f4934113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:02.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.836+0000 7f493b4ed700 1 --2- 172.21.15.43:0/4175675063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4934065390 0x7f4934113730 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4930002a50 tx=0x7f49300046b0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.836+0000 7f493b4ed700 1 -- 172.21.15.43:0/4175675063 shutdown_connections 2023-12-08T20:31:02.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.836+0000 7f493b4ed700 1 --2- 172.21.15.43:0/4175675063 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f492006cae0 0x7f492006ef90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.836+0000 7f493b4ed700 1 --2- 172.21.15.43:0/4175675063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4934065390 0x7f4934113730 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.836+0000 7f493b4ed700 1 --2- 172.21.15.43:0/4175675063 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4934102c20 0x7f4934113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.836+0000 7f493b4ed700 1 -- 172.21.15.43:0/4175675063 >> 172.21.15.43:0/4175675063 conn(0x7f49340719b0 msgr2=0x7f49340fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:02.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.837+0000 7f493b4ed700 1 -- 172.21.15.43:0/4175675063 shutdown_connections 2023-12-08T20:31:02.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.837+0000 7f493b4ed700 1 -- 172.21.15.43:0/4175675063 wait complete. 2023-12-08T20:31:02.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.952+0000 7f4efd81b700 1 -- 172.21.15.43:0/1340343925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ef8070890 msgr2=0x7f4ef8108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:02.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.952+0000 7f4efd81b700 1 --2- 172.21.15.43:0/1340343925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ef8070890 0x7f4ef8108f70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8004970 tx=0x7f4ee8009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:02.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.952+0000 7f4efd81b700 1 -- 172.21.15.43:0/1340343925 shutdown_connections 2023-12-08T20:31:02.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.952+0000 7f4efd81b700 1 --2- 172.21.15.43:0/1340343925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ef8070890 0x7f4ef8108f70 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.952+0000 7f4efd81b700 1 --2- 172.21.15.43:0/1340343925 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ef806ff80 0x7f4ef8070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.952+0000 7f4efd81b700 1 -- 172.21.15.43:0/1340343925 >> 172.21.15.43:0/1340343925 conn(0x7f4ef80f8790 msgr2=0x7f4ef80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:02.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.952+0000 7f4efd81b700 1 -- 172.21.15.43:0/1340343925 shutdown_connections 2023-12-08T20:31:02.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.952+0000 7f4efd81b700 1 -- 172.21.15.43:0/1340343925 wait complete. 2023-12-08T20:31:02.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.953+0000 7f4efd81b700 1 Processor -- start 2023-12-08T20:31:02.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.953+0000 7f4efd81b700 1 -- start start 2023-12-08T20:31:02.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.953+0000 7f4efd81b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ef806ff80 0x7f4ef8115820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:02.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.953+0000 7f4efd81b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ef8070890 0x7f4ef8115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:02.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.953+0000 7f4efd81b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef81163b0 con 0x7f4ef806ff80 2023-12-08T20:31:02.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.953+0000 7f4efd81b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef810f6e0 con 0x7f4ef8070890 2023-12-08T20:31:02.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.954+0000 7f4ef6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ef806ff80 0x7f4ef8115820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:02.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.954+0000 7f4ef6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ef806ff80 0x7f4ef8115820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50306/0 (socket says 172.21.15.43:50306) 2023-12-08T20:31:02.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.954+0000 7f4ef6ffd700 1 -- 172.21.15.43:0/4273754259 learned_addr learned my addr 172.21.15.43:0/4273754259 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:31:02.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.954+0000 7f4ef67fc700 1 --2- 172.21.15.43:0/4273754259 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ef8070890 0x7f4ef8115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:02.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.954+0000 7f4ef6ffd700 1 -- 172.21.15.43:0/4273754259 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ef8070890 msgr2=0x7f4ef8115d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:02.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.954+0000 7f4ef6ffd700 1 --2- 172.21.15.43:0/4273754259 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ef8070890 0x7f4ef8115d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:02.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.954+0000 7f4ef6ffd700 1 -- 172.21.15.43:0/4273754259 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee8005040 con 0x7f4ef806ff80 2023-12-08T20:31:02.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.954+0000 7f4ef6ffd700 1 --2- 172.21.15.43:0/4273754259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ef806ff80 0x7f4ef8115820 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0002a50 tx=0x7f4ee00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:02.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.954+0000 7f4eef7fe700 1 -- 172.21.15.43:0/4273754259 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ee0007cc0 con 0x7f4ef806ff80 2023-12-08T20:31:02.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.954+0000 7f4eef7fe700 1 -- 172.21.15.43:0/4273754259 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4ee000f040 con 0x7f4ef806ff80 2023-12-08T20:31:02.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.954+0000 7f4efd81b700 1 -- 172.21.15.43:0/4273754259 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef810f9c0 con 0x7f4ef806ff80 2023-12-08T20:31:02.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.954+0000 7f4eef7fe700 1 -- 172.21.15.43:0/4273754259 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ee000d9c0 con 0x7f4ef806ff80 2023-12-08T20:31:02.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.954+0000 7f4efd81b700 1 -- 172.21.15.43:0/4273754259 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef810fed0 con 0x7f4ef806ff80 2023-12-08T20:31:02.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.955+0000 7f4efd81b700 1 -- 172.21.15.43:0/4273754259 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef8106630 con 0x7f4ef806ff80 2023-12-08T20:31:02.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.956+0000 7f4eef7fe700 1 -- 172.21.15.43:0/4273754259 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f4ee000db20 con 0x7f4ef806ff80 2023-12-08T20:31:02.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.957+0000 7f4eef7fe700 1 --2- 172.21.15.43:0/4273754259 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f4ee406cbb0 0x7f4ee406f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:02.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.957+0000 7f4eef7fe700 1 -- 172.21.15.43:0/4273754259 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f4ee008c000 con 0x7f4ef806ff80 2023-12-08T20:31:02.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.957+0000 7f4ef67fc700 1 --2- 172.21.15.43:0/4273754259 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f4ee406cbb0 0x7f4ee406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:02.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.957+0000 7f4ef67fc700 1 --2- 172.21.15.43:0/4273754259 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f4ee406cbb0 0x7f4ee406f060 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8004f50 tx=0x7f4ee8009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:02.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:02.961+0000 7f4eef7fe700 1 -- 172.21.15.43:0/4273754259 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f4ee0059f60 con 0x7f4ef806ff80 2023-12-08T20:31:03.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.264+0000 7f4efd81b700 1 -- 172.21.15.43:0/4273754259 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4ef804bbb0 con 0x7f4ef806ff80 2023-12-08T20:31:03.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.265+0000 7f4eef7fe700 1 -- 172.21.15.43:0/4273754259 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f4ee0059af0 con 0x7f4ef806ff80 2023-12-08T20:31:03.266 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:31:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": { 2023-12-08T20:31:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2 2023-12-08T20:31:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:31:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": { 2023-12-08T20:31:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:31:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:31:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": { 2023-12-08T20:31:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 6 2023-12-08T20:31:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:31:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2023-12-08T20:31:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-08T20:31:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:31:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "overall": { 2023-12-08T20:31:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 12, 2023-12-08T20:31:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:31:03.268 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-12-08T20:31:03.268 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:31:03.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.267+0000 7f4efd81b700 1 -- 172.21.15.43:0/4273754259 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f4ee406cbb0 msgr2=0x7f4ee406f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:03.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.267+0000 7f4efd81b700 1 --2- 172.21.15.43:0/4273754259 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f4ee406cbb0 0x7f4ee406f060 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8004f50 tx=0x7f4ee8009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:03.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.267+0000 7f4efd81b700 1 -- 172.21.15.43:0/4273754259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ef806ff80 msgr2=0x7f4ef8115820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:03.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.267+0000 7f4efd81b700 1 --2- 172.21.15.43:0/4273754259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ef806ff80 0x7f4ef8115820 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0002a50 tx=0x7f4ee00046b0 comp rx=0 tx=0).stop 2023-12-08T20:31:03.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.267+0000 7f4efd81b700 1 -- 172.21.15.43:0/4273754259 shutdown_connections 2023-12-08T20:31:03.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.267+0000 7f4efd81b700 1 --2- 172.21.15.43:0/4273754259 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f4ee406cbb0 0x7f4ee406f060 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:03.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.267+0000 7f4efd81b700 1 --2- 172.21.15.43:0/4273754259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ef806ff80 0x7f4ef8115820 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:03.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.267+0000 7f4efd81b700 1 --2- 172.21.15.43:0/4273754259 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ef8070890 0x7f4ef8115d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:03.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.267+0000 7f4efd81b700 1 -- 172.21.15.43:0/4273754259 >> 172.21.15.43:0/4273754259 conn(0x7f4ef80f8790 msgr2=0x7f4ef81037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:03.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.268+0000 7f4efd81b700 1 -- 172.21.15.43:0/4273754259 shutdown_connections 2023-12-08T20:31:03.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.268+0000 7f4efd81b700 1 -- 172.21.15.43:0/4273754259 wait complete. 2023-12-08T20:31:03.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.391+0000 7f7e326f8700 1 -- 172.21.15.43:0/1495548074 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2c0fbb40 msgr2=0x7f7e2c0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:03.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.391+0000 7f7e326f8700 1 --2- 172.21.15.43:0/1495548074 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2c0fbb40 0x7f7e2c0fbfb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7e20004940 tx=0x7f7e20009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:03.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.391+0000 7f7e326f8700 1 -- 172.21.15.43:0/1495548074 shutdown_connections 2023-12-08T20:31:03.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.391+0000 7f7e326f8700 1 --2- 172.21.15.43:0/1495548074 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2c0fbb40 0x7f7e2c0fbfb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:03.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.391+0000 7f7e326f8700 1 --2- 172.21.15.43:0/1495548074 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e2c101b00 0x7f7e2c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:03.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.391+0000 7f7e326f8700 1 -- 172.21.15.43:0/1495548074 >> 172.21.15.43:0/1495548074 conn(0x7f7e2c0719b0 msgr2=0x7f7e2c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:03.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.391+0000 7f7e326f8700 1 -- 172.21.15.43:0/1495548074 shutdown_connections 2023-12-08T20:31:03.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.391+0000 7f7e326f8700 1 -- 172.21.15.43:0/1495548074 wait complete. 2023-12-08T20:31:03.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.391+0000 7f7e326f8700 1 Processor -- start 2023-12-08T20:31:03.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.392+0000 7f7e326f8700 1 -- start start 2023-12-08T20:31:03.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.392+0000 7f7e326f8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2c0fbb40 0x7f7e2c1136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:03.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.392+0000 7f7e326f8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e2c101b00 0x7f7e2c113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:03.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.392+0000 7f7e326f8700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c114280 con 0x7f7e2c0fbb40 2023-12-08T20:31:03.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.392+0000 7f7e326f8700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c10d570 con 0x7f7e2c101b00 2023-12-08T20:31:03.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.392+0000 7f7e2bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2c0fbb40 0x7f7e2c1136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:03.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.392+0000 7f7e2bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2c0fbb40 0x7f7e2c1136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50334/0 (socket says 172.21.15.43:50334) 2023-12-08T20:31:03.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.392+0000 7f7e2bfff700 1 -- 172.21.15.43:0/1673532865 learned_addr learned my addr 172.21.15.43:0/1673532865 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:31:03.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.392+0000 7f7e2b7fe700 1 --2- 172.21.15.43:0/1673532865 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e2c101b00 0x7f7e2c113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:03.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.392+0000 7f7e2bfff700 1 -- 172.21.15.43:0/1673532865 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e2c101b00 msgr2=0x7f7e2c113c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:03.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.392+0000 7f7e2bfff700 1 --2- 172.21.15.43:0/1673532865 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e2c101b00 0x7f7e2c113c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:03.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.392+0000 7f7e2bfff700 1 -- 172.21.15.43:0/1673532865 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e20005040 con 0x7f7e2c0fbb40 2023-12-08T20:31:03.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.392+0000 7f7e2bfff700 1 --2- 172.21.15.43:0/1673532865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2c0fbb40 0x7f7e2c1136f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c002a50 tx=0x7f7e1c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:03.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.393+0000 7f7e28ff9700 1 -- 172.21.15.43:0/1673532865 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e1c007cc0 con 0x7f7e2c0fbb40 2023-12-08T20:31:03.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.393+0000 7f7e28ff9700 1 -- 172.21.15.43:0/1673532865 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7e1c00f040 con 0x7f7e2c0fbb40 2023-12-08T20:31:03.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.393+0000 7f7e28ff9700 1 -- 172.21.15.43:0/1673532865 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e1c00d9c0 con 0x7f7e2c0fbb40 2023-12-08T20:31:03.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.393+0000 7f7e326f8700 1 -- 172.21.15.43:0/1673532865 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2c10d850 con 0x7f7e2c0fbb40 2023-12-08T20:31:03.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.393+0000 7f7e326f8700 1 -- 172.21.15.43:0/1673532865 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2c10dd90 con 0x7f7e2c0fbb40 2023-12-08T20:31:03.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.394+0000 7f7e326f8700 1 -- 172.21.15.43:0/1673532865 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2c1133a0 con 0x7f7e2c0fbb40 2023-12-08T20:31:03.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.394+0000 7f7e28ff9700 1 -- 172.21.15.43:0/1673532865 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f7e1c00db20 con 0x7f7e2c0fbb40 2023-12-08T20:31:03.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.395+0000 7f7e28ff9700 1 --2- 172.21.15.43:0/1673532865 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f7e1406cae0 0x7f7e1406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:03.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.395+0000 7f7e28ff9700 1 -- 172.21.15.43:0/1673532865 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f7e1c08ba50 con 0x7f7e2c0fbb40 2023-12-08T20:31:03.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.395+0000 7f7e2b7fe700 1 --2- 172.21.15.43:0/1673532865 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f7e1406cae0 0x7f7e1406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:03.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.395+0000 7f7e2b7fe700 1 --2- 172.21.15.43:0/1673532865 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f7e1406cae0 0x7f7e1406ef90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7e20004f90 tx=0x7f7e20009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:03.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.399+0000 7f7e28ff9700 1 -- 172.21.15.43:0/1673532865 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f7e1c059870 con 0x7f7e2c0fbb40 2023-12-08T20:31:03.417 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:03 smithi043 ceph-mon[111966]: Upgrade: Target is version 19.0.0-44-g9dcc13bb (unknown) 2023-12-08T20:31:03.417 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:03 smithi043 ceph-mon[111966]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389'] 2023-12-08T20:31:03.418 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:03 smithi043 ceph-mon[111966]: Upgrade: Setting container_image for all mgr 2023-12-08T20:31:03.418 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:03 smithi043 ceph-mon[111966]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:31:03.418 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:03 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:03.418 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:03 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-08T20:31:03.418 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:03 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-08T20:31:03.418 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:03 smithi043 ceph-mon[111966]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:03.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:03 smithi111 ceph-mon[121341]: Upgrade: Target is version 19.0.0-44-g9dcc13bb (unknown) 2023-12-08T20:31:03.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:03 smithi111 ceph-mon[121341]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389'] 2023-12-08T20:31:03.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:03 smithi111 ceph-mon[121341]: Upgrade: Setting container_image for all mgr 2023-12-08T20:31:03.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:03 smithi111 ceph-mon[121341]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:31:03.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:03 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:03.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:03 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-08T20:31:03.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:03 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-08T20:31:03.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:03 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:03.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.663+0000 7f7e326f8700 1 -- 172.21.15.43:0/1673532865 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7e2c10ec90 con 0x7f7e2c0fbb40 2023-12-08T20:31:03.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.663+0000 7f7e28ff9700 1 -- 172.21.15.43:0/1673532865 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f7e1c059400 con 0x7f7e2c0fbb40 2023-12-08T20:31:03.665 INFO:teuthology.orchestra.run.smithi043.stdout:e15 2023-12-08T20:31:03.665 INFO:teuthology.orchestra.run.smithi043.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-08T20:31:03.665 INFO:teuthology.orchestra.run.smithi043.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:31:03.666 INFO:teuthology.orchestra.run.smithi043.stdout:legacy client fscid: 1 2023-12-08T20:31:03.666 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:31:03.666 INFO:teuthology.orchestra.run.smithi043.stdout:Filesystem 'cephfs' (1) 2023-12-08T20:31:03.666 INFO:teuthology.orchestra.run.smithi043.stdout:fs_name cephfs 2023-12-08T20:31:03.666 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 15 2023-12-08T20:31:03.666 INFO:teuthology.orchestra.run.smithi043.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-08T20:31:03.666 INFO:teuthology.orchestra.run.smithi043.stdout:created 2023-12-08T20:25:41.527734+0000 2023-12-08T20:31:03.666 INFO:teuthology.orchestra.run.smithi043.stdout:modified 2023-12-08T20:28:01.721203+0000 2023-12-08T20:31:03.666 INFO:teuthology.orchestra.run.smithi043.stdout:tableserver 0 2023-12-08T20:31:03.666 INFO:teuthology.orchestra.run.smithi043.stdout:root 0 2023-12-08T20:31:03.666 INFO:teuthology.orchestra.run.smithi043.stdout:session_timeout 60 2023-12-08T20:31:03.666 INFO:teuthology.orchestra.run.smithi043.stdout:session_autoclose 300 2023-12-08T20:31:03.666 INFO:teuthology.orchestra.run.smithi043.stdout:max_file_size 1099511627776 2023-12-08T20:31:03.666 INFO:teuthology.orchestra.run.smithi043.stdout:required_client_features {} 2023-12-08T20:31:03.666 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure 0 2023-12-08T20:31:03.667 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure_osd_epoch 0 2023-12-08T20:31:03.667 INFO:teuthology.orchestra.run.smithi043.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:31:03.667 INFO:teuthology.orchestra.run.smithi043.stdout:max_mds 2 2023-12-08T20:31:03.667 INFO:teuthology.orchestra.run.smithi043.stdout:in 0,1 2023-12-08T20:31:03.667 INFO:teuthology.orchestra.run.smithi043.stdout:up {0=14452,1=24315} 2023-12-08T20:31:03.667 INFO:teuthology.orchestra.run.smithi043.stdout:failed 2023-12-08T20:31:03.667 INFO:teuthology.orchestra.run.smithi043.stdout:damaged 2023-12-08T20:31:03.667 INFO:teuthology.orchestra.run.smithi043.stdout:stopped 2023-12-08T20:31:03.667 INFO:teuthology.orchestra.run.smithi043.stdout:data_pools [3] 2023-12-08T20:31:03.667 INFO:teuthology.orchestra.run.smithi043.stdout:metadata_pool 2 2023-12-08T20:31:03.667 INFO:teuthology.orchestra.run.smithi043.stdout:inline_data disabled 2023-12-08T20:31:03.667 INFO:teuthology.orchestra.run.smithi043.stdout:balancer 2023-12-08T20:31:03.667 INFO:teuthology.orchestra.run.smithi043.stdout:standby_count_wanted 1 2023-12-08T20:31:03.667 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi043.pjmszb{0:14452} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.43:6826/441584552,v1:172.21.15.43:6827/441584552] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:31:03.667 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi111.veeegc{1:24315} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.111:6824/1990395192,v1:172.21.15.111:6825/1990395192] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:31:03.667 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:31:03.668 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:31:03.668 INFO:teuthology.orchestra.run.smithi043.stdout:Standby daemons: 2023-12-08T20:31:03.668 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:31:03.668 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi043.akrjef{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.43:6828/2926918083,v1:172.21.15.43:6829/2926918083] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:31:03.668 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi111.svpasm{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6826/2885759138,v1:172.21.15.111:6827/2885759138] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:31:03.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.666+0000 7f7e326f8700 1 -- 172.21.15.43:0/1673532865 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f7e1406cae0 msgr2=0x7f7e1406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:03.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.666+0000 7f7e326f8700 1 --2- 172.21.15.43:0/1673532865 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f7e1406cae0 0x7f7e1406ef90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7e20004f90 tx=0x7f7e20009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:03.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.666+0000 7f7e326f8700 1 -- 172.21.15.43:0/1673532865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2c0fbb40 msgr2=0x7f7e2c1136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:03.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.666+0000 7f7e326f8700 1 --2- 172.21.15.43:0/1673532865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2c0fbb40 0x7f7e2c1136f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c002a50 tx=0x7f7e1c0046b0 comp rx=0 tx=0).stop 2023-12-08T20:31:03.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.666+0000 7f7e326f8700 1 -- 172.21.15.43:0/1673532865 shutdown_connections 2023-12-08T20:31:03.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.666+0000 7f7e326f8700 1 --2- 172.21.15.43:0/1673532865 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f7e1406cae0 0x7f7e1406ef90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:03.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.666+0000 7f7e326f8700 1 --2- 172.21.15.43:0/1673532865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2c0fbb40 0x7f7e2c1136f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:03.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.666+0000 7f7e326f8700 1 --2- 172.21.15.43:0/1673532865 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e2c101b00 0x7f7e2c113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:03.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.666+0000 7f7e326f8700 1 -- 172.21.15.43:0/1673532865 >> 172.21.15.43:0/1673532865 conn(0x7f7e2c0719b0 msgr2=0x7f7e2c0654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:03.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.666+0000 7f7e326f8700 1 -- 172.21.15.43:0/1673532865 shutdown_connections 2023-12-08T20:31:03.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.666+0000 7f7e326f8700 1 -- 172.21.15.43:0/1673532865 wait complete. 2023-12-08T20:31:03.669 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 15 2023-12-08T20:31:03.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.781+0000 7f20010a0700 1 -- 172.21.15.43:0/677028517 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ffc101c10 msgr2=0x7f1ffc0fb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:03.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.781+0000 7f20010a0700 1 --2- 172.21.15.43:0/677028517 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ffc101c10 0x7f1ffc0fb2d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0004940 tx=0x7f1ff0009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:03.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.782+0000 7f20010a0700 1 -- 172.21.15.43:0/677028517 shutdown_connections 2023-12-08T20:31:03.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.782+0000 7f20010a0700 1 --2- 172.21.15.43:0/677028517 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ffc101c10 0x7f1ffc0fb2d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:03.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.782+0000 7f20010a0700 1 --2- 172.21.15.43:0/677028517 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ffc101270 0x7f1ffc101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:03.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.782+0000 7f20010a0700 1 -- 172.21.15.43:0/677028517 >> 172.21.15.43:0/677028517 conn(0x7f1ffc0711a0 msgr2=0x7f1ffc0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:03.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.782+0000 7f20010a0700 1 -- 172.21.15.43:0/677028517 shutdown_connections 2023-12-08T20:31:03.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.782+0000 7f20010a0700 1 -- 172.21.15.43:0/677028517 wait complete. 2023-12-08T20:31:03.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.782+0000 7f20010a0700 1 Processor -- start 2023-12-08T20:31:03.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.782+0000 7f20010a0700 1 -- start start 2023-12-08T20:31:03.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.783+0000 7f20010a0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ffc101270 0x7f1ffc111420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:03.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.783+0000 7f20010a0700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ffc101c10 0x7f1ffc111960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:03.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.783+0000 7f20010a0700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc111fb0 con 0x7f1ffc101c10 2023-12-08T20:31:03.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.783+0000 7f20010a0700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc10b300 con 0x7f1ffc101270 2023-12-08T20:31:03.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.783+0000 7f1ffa59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ffc101c10 0x7f1ffc111960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:03.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.783+0000 7f1ffad9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ffc101270 0x7f1ffc111420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:03.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.783+0000 7f1ffa59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ffc101c10 0x7f1ffc111960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50364/0 (socket says 172.21.15.43:50364) 2023-12-08T20:31:03.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.783+0000 7f1ffa59c700 1 -- 172.21.15.43:0/406687454 learned_addr learned my addr 172.21.15.43:0/406687454 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:31:03.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.783+0000 7f1ffa59c700 1 -- 172.21.15.43:0/406687454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ffc101270 msgr2=0x7f1ffc111420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:03.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.783+0000 7f1ffa59c700 1 --2- 172.21.15.43:0/406687454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ffc101270 0x7f1ffc111420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:03.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.783+0000 7f1ffa59c700 1 -- 172.21.15.43:0/406687454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff0005040 con 0x7f1ffc101c10 2023-12-08T20:31:03.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.783+0000 7f1ffa59c700 1 --2- 172.21.15.43:0/406687454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ffc101c10 0x7f1ffc111960 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009fd0 tx=0x7f1ff0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:03.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.784+0000 7f1fe37fe700 1 -- 172.21.15.43:0/406687454 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ff000e040 con 0x7f1ffc101c10 2023-12-08T20:31:03.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.784+0000 7f1fe37fe700 1 -- 172.21.15.43:0/406687454 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1ff0013420 con 0x7f1ffc101c10 2023-12-08T20:31:03.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.784+0000 7f20010a0700 1 -- 172.21.15.43:0/406687454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ffc10b580 con 0x7f1ffc101c10 2023-12-08T20:31:03.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.784+0000 7f20010a0700 1 -- 172.21.15.43:0/406687454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ffc10bac0 con 0x7f1ffc101c10 2023-12-08T20:31:03.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.784+0000 7f1fe37fe700 1 -- 172.21.15.43:0/406687454 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ff001c630 con 0x7f1ffc101c10 2023-12-08T20:31:03.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.785+0000 7f20010a0700 1 -- 172.21.15.43:0/406687454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ffc103740 con 0x7f1ffc101c10 2023-12-08T20:31:03.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.785+0000 7f1fe37fe700 1 -- 172.21.15.43:0/406687454 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f1ff0013a00 con 0x7f1ffc101c10 2023-12-08T20:31:03.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.786+0000 7f1fe37fe700 1 --2- 172.21.15.43:0/406687454 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f1fe406cae0 0x7f1fe406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:03.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.786+0000 7f1fe37fe700 1 -- 172.21.15.43:0/406687454 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f1ff008cff0 con 0x7f1ffc101c10 2023-12-08T20:31:03.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.786+0000 7f1ffad9d700 1 --2- 172.21.15.43:0/406687454 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f1fe406cae0 0x7f1fe406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:03.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.786+0000 7f1ffad9d700 1 --2- 172.21.15.43:0/406687454 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f1fe406cae0 0x7f1fe406ef90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1fec004f50 tx=0x7f1fec002040 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:03.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:03.790+0000 7f1fe37fe700 1 -- 172.21.15.43:0/406687454 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f1ff00573e0 con 0x7f1ffc101c10 2023-12-08T20:31:04.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.022+0000 7f20010a0700 1 -- 172.21.15.43:0/406687454 --> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ffc04bb80 con 0x7f1fe406cae0 2023-12-08T20:31:04.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.023+0000 7f1fe37fe700 1 -- 172.21.15.43:0/406687454 <== mgr.14640 v2:172.21.15.43:6800/2216649665 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f1ffc04bb80 con 0x7f1fe406cae0 2023-12-08T20:31:04.024 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:31:04.024 INFO:teuthology.orchestra.run.smithi043.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-08T20:31:04.025 INFO:teuthology.orchestra.run.smithi043.stdout: "in_progress": true, 2023-12-08T20:31:04.025 INFO:teuthology.orchestra.run.smithi043.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-08T20:31:04.025 INFO:teuthology.orchestra.run.smithi043.stdout: "services_complete": [ 2023-12-08T20:31:04.025 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr" 2023-12-08T20:31:04.025 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2023-12-08T20:31:04.025 INFO:teuthology.orchestra.run.smithi043.stdout: "progress": "2/21 daemons upgraded", 2023-12-08T20:31:04.025 INFO:teuthology.orchestra.run.smithi043.stdout: "message": "Currently upgrading mon daemons", 2023-12-08T20:31:04.025 INFO:teuthology.orchestra.run.smithi043.stdout: "is_paused": false 2023-12-08T20:31:04.025 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:31:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.025+0000 7f20010a0700 1 -- 172.21.15.43:0/406687454 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f1fe406cae0 msgr2=0x7f1fe406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.025+0000 7f20010a0700 1 --2- 172.21.15.43:0/406687454 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f1fe406cae0 0x7f1fe406ef90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1fec004f50 tx=0x7f1fec002040 comp rx=0 tx=0).stop 2023-12-08T20:31:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.025+0000 7f20010a0700 1 -- 172.21.15.43:0/406687454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ffc101c10 msgr2=0x7f1ffc111960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.025+0000 7f20010a0700 1 --2- 172.21.15.43:0/406687454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ffc101c10 0x7f1ffc111960 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009fd0 tx=0x7f1ff0009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.026+0000 7f20010a0700 1 -- 172.21.15.43:0/406687454 shutdown_connections 2023-12-08T20:31:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.026+0000 7f20010a0700 1 --2- 172.21.15.43:0/406687454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ffc101270 0x7f1ffc111420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.026+0000 7f20010a0700 1 --2- 172.21.15.43:0/406687454 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f1fe406cae0 0x7f1fe406ef90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.026+0000 7f20010a0700 1 --2- 172.21.15.43:0/406687454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ffc101c10 0x7f1ffc111960 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.026+0000 7f20010a0700 1 -- 172.21.15.43:0/406687454 >> 172.21.15.43:0/406687454 conn(0x7f1ffc0711a0 msgr2=0x7f1ffc0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.026+0000 7f20010a0700 1 -- 172.21.15.43:0/406687454 shutdown_connections 2023-12-08T20:31:04.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.026+0000 7f20010a0700 1 -- 172.21.15.43:0/406687454 wait complete. 2023-12-08T20:31:04.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.156+0000 7f1011b35700 1 -- 172.21.15.43:0/1606882020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100c102c00 msgr2=0x7f100c102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:04.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.156+0000 7f1011b35700 1 --2- 172.21.15.43:0/1606882020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100c102c00 0x7f100c102fd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4004940 tx=0x7f0ff4009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:04.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.156+0000 7f1011b35700 1 -- 172.21.15.43:0/1606882020 shutdown_connections 2023-12-08T20:31:04.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.156+0000 7f1011b35700 1 --2- 172.21.15.43:0/1606882020 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f100c1035a0 0x7f100c0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:04.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.156+0000 7f1011b35700 1 --2- 172.21.15.43:0/1606882020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100c102c00 0x7f100c102fd0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:04.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.157+0000 7f1011b35700 1 -- 172.21.15.43:0/1606882020 >> 172.21.15.43:0/1606882020 conn(0x7f100c0f8790 msgr2=0x7f100c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:04.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.157+0000 7f1011b35700 1 -- 172.21.15.43:0/1606882020 shutdown_connections 2023-12-08T20:31:04.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.157+0000 7f1011b35700 1 -- 172.21.15.43:0/1606882020 wait complete. 2023-12-08T20:31:04.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.157+0000 7f1011b35700 1 Processor -- start 2023-12-08T20:31:04.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.157+0000 7f1011b35700 1 -- start start 2023-12-08T20:31:04.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.158+0000 7f1011b35700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f100c102c00 0x7f100c113640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:04.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.158+0000 7f1011b35700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100c1035a0 0x7f100c113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:04.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.158+0000 7f1011b35700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c114210 con 0x7f100c1035a0 2023-12-08T20:31:04.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.158+0000 7f1011b35700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c10d500 con 0x7f100c102c00 2023-12-08T20:31:04.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.158+0000 7f100affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100c1035a0 0x7f100c113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:04.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.158+0000 7f100affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100c1035a0 0x7f100c113bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50378/0 (socket says 172.21.15.43:50378) 2023-12-08T20:31:04.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.158+0000 7f100affd700 1 -- 172.21.15.43:0/396618454 learned_addr learned my addr 172.21.15.43:0/396618454 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:31:04.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.158+0000 7f100b7fe700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f100c102c00 0x7f100c113640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:04.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.158+0000 7f100affd700 1 -- 172.21.15.43:0/396618454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f100c102c00 msgr2=0x7f100c113640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:04.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.158+0000 7f100affd700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f100c102c00 0x7f100c113640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:04.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.158+0000 7f100affd700 1 -- 172.21.15.43:0/396618454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff4005040 con 0x7f100c1035a0 2023-12-08T20:31:04.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.158+0000 7f100affd700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100c1035a0 0x7f100c113bc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00eb40 tx=0x7f0ffc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:04.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.159+0000 7f1003fff700 1 -- 172.21.15.43:0/396618454 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ffc007cc0 con 0x7f100c1035a0 2023-12-08T20:31:04.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.159+0000 7f1011b35700 1 -- 172.21.15.43:0/396618454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100c10d730 con 0x7f100c1035a0 2023-12-08T20:31:04.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.159+0000 7f1003fff700 1 -- 172.21.15.43:0/396618454 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ffc00f040 con 0x7f100c1035a0 2023-12-08T20:31:04.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.159+0000 7f1003fff700 1 -- 172.21.15.43:0/396618454 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ffc009570 con 0x7f100c1035a0 2023-12-08T20:31:04.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.159+0000 7f1011b35700 1 -- 172.21.15.43:0/396618454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100c10dc70 con 0x7f100c1035a0 2023-12-08T20:31:04.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.160+0000 7f1011b35700 1 -- 172.21.15.43:0/396618454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f100c0fff10 con 0x7f100c1035a0 2023-12-08T20:31:04.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.161+0000 7f1003fff700 1 -- 172.21.15.43:0/396618454 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f0ffc0096d0 con 0x7f100c1035a0 2023-12-08T20:31:04.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.161+0000 7f1003fff700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f0ff806caf0 0x7f0ff806efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:04.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.161+0000 7f1003fff700 1 -- 172.21.15.43:0/396618454 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f0ffc08b830 con 0x7f100c1035a0 2023-12-08T20:31:04.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.161+0000 7f100b7fe700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f0ff806caf0 0x7f0ff806efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:04.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.162+0000 7f100b7fe700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f0ff806caf0 0x7f0ff806efa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400b0d0 tx=0x7f0ff4009e30 comp rx=0 tx=0).ready entity=mgr.14640 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:04.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.173+0000 7f1003fff700 1 -- 172.21.15.43:0/396618454 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0ffc059720 con 0x7f100c1035a0 2023-12-08T20:31:04.427 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:04 smithi043 ceph-mon[111966]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:31:04.427 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:04 smithi043 ceph-mon[111966]: pgmap v74: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:04.427 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:04 smithi043 ceph-mon[111966]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:31:04.427 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:04 smithi043 ceph-mon[111966]: Upgrade: Updating mon.smithi043 2023-12-08T20:31:04.427 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:04 smithi043 ceph-mon[111966]: Deploying daemon mon.smithi043 on smithi043 2023-12-08T20:31:04.428 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:04 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/4273754259' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:31:04.428 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:04 smithi043 ceph-mon[111966]: from='client.? 172.21.15.43:0/1673532865' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-08T20:31:04.428 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:04 smithi043 systemd[1]: Stopping Ceph mon.smithi043 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:31:04.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.426+0000 7f100affd700 1 -- 172.21.15.43:0/396618454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100c1035a0 msgr2=0x7f100c113bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-08T20:31:04.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.426+0000 7f100affd700 1 -- 172.21.15.43:0/396618454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100c1035a0 msgr2=0x7f100c113bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-08T20:31:04.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.426+0000 7f100affd700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100c1035a0 0x7f100c113bc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00eb40 tx=0x7f0ffc00b040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-08T20:31:04.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.426+0000 7f100affd700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100c1035a0 0x7f100c113bc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00eb40 tx=0x7f0ffc00b040 comp rx=0 tx=0).stop 2023-12-08T20:31:04.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.426+0000 7f1003fff700 1 -- 172.21.15.43:0/396618454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100c1035a0 msgr2=0x7f100c113bc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-12-08T20:31:04.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.426+0000 7f1003fff700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100c1035a0 0x7f100c113bc0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:04.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.426+0000 7f1003fff700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f100c102c00 0x7f0ff8076750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:04.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.426+0000 7f1003fff700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ff8076e50 0x7f0ff80792d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:04.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.426+0000 7f1003fff700 1 -- 172.21.15.43:0/396618454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8079cf0 con 0x7f0ff8076e50 2023-12-08T20:31:04.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.426+0000 7f1003fff700 1 -- 172.21.15.43:0/396618454 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8079e30 con 0x7f100c102c00 2023-12-08T20:31:04.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.426+0000 7f100bfff700 1 -- 172.21.15.43:0/396618454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ff8076e50 msgr2=0x7f0ff80792d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:3300/0 2023-12-08T20:31:04.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.426+0000 7f100bfff700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ff8076e50 0x7f0ff80792d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T20:31:04.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.427+0000 7f100affd700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f100c102c00 0x7f0ff8076750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:04.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.427+0000 7f100affd700 1 -- 172.21.15.43:0/396618454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ff8076e50 msgr2=0x7f0ff80792d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-08T20:31:04.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.427+0000 7f100affd700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ff8076e50 0x7f0ff80792d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:04.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.427+0000 7f100affd700 1 -- 172.21.15.43:0/396618454 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=3+}) v3 -- 0x7f0ff8079f70 con 0x7f100c102c00 2023-12-08T20:31:04.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.428+0000 7f100affd700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f100c102c00 0x7f0ff8076750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f100c0fc4f0 tx=0x7f0ffc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:04.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.428+0000 7f1003fff700 1 -- 172.21.15.43:0/396618454 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ffc090020 con 0x7f100c102c00 2023-12-08T20:31:04.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.429+0000 7f1003fff700 1 -- 172.21.15.43:0/396618454 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ffc059720 con 0x7f100c102c00 2023-12-08T20:31:04.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.431+0000 7f1003fff700 1 -- 172.21.15.43:0/396618454 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f0ffc0790a0 con 0x7f100c102c00 2023-12-08T20:31:04.442 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:04 smithi111 ceph-mon[121341]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:31:04.442 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:04 smithi111 ceph-mon[121341]: pgmap v74: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:04.442 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:04 smithi111 ceph-mon[121341]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:31:04.442 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:04 smithi111 ceph-mon[121341]: Upgrade: Updating mon.smithi043 2023-12-08T20:31:04.442 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:04 smithi111 ceph-mon[121341]: Deploying daemon mon.smithi043 on smithi043 2023-12-08T20:31:04.443 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:04 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/4273754259' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:31:04.443 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:04 smithi111 ceph-mon[121341]: from='client.? 172.21.15.43:0/1673532865' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-08T20:31:04.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.486+0000 7f1011b35700 1 -- 172.21.15.43:0/396618454 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f100c0fc360 con 0x7f100c102c00 2023-12-08T20:31:04.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.486+0000 7f1003fff700 1 -- 172.21.15.43:0/396618454 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0ffc061ba0 con 0x7f100c102c00 2023-12-08T20:31:04.488 INFO:teuthology.orchestra.run.smithi043.stdout:HEALTH_OK 2023-12-08T20:31:04.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.488+0000 7f1011b35700 1 -- 172.21.15.43:0/396618454 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f0ff806caf0 msgr2=0x7f0ff806efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:04.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.488+0000 7f1011b35700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f0ff806caf0 0x7f0ff806efa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400b0d0 tx=0x7f0ff4009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:04.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.489+0000 7f1011b35700 1 -- 172.21.15.43:0/396618454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f100c102c00 msgr2=0x7f0ff8076750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.489+0000 7f1011b35700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f100c102c00 0x7f0ff8076750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f100c0fc4f0 tx=0x7f0ffc00b040 comp rx=0 tx=0).stop 2023-12-08T20:31:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.489+0000 7f1011b35700 1 -- 172.21.15.43:0/396618454 shutdown_connections 2023-12-08T20:31:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.489+0000 7f1011b35700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f100c102c00 0x7f0ff8076750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.489+0000 7f1011b35700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ff8076e50 0x7f0ff80792d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.489+0000 7f1011b35700 1 --2- 172.21.15.43:0/396618454 >> [v2:172.21.15.43:6800/2216649665,v1:172.21.15.43:6801/2216649665] conn(0x7f0ff806caf0 0x7f0ff806efa0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.489+0000 7f1011b35700 1 -- 172.21.15.43:0/396618454 >> 172.21.15.43:0/396618454 conn(0x7f100c0f8790 msgr2=0x7f100c0fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.489+0000 7f1011b35700 1 -- 172.21.15.43:0/396618454 shutdown_connections 2023-12-08T20:31:04.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:04.489+0000 7f1011b35700 1 -- 172.21.15.43:0/396618454 wait complete. 2023-12-08T20:31:04.703 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:04 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-mon-smithi043[111943]: 2023-12-08T20:31:04.424+0000 7f786d6d6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi043 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-08T20:31:04.703 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:04 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-mon-smithi043[111943]: 2023-12-08T20:31:04.424+0000 7f786d6d6700 -1 mon.smithi043@0(leader) e2 *** Got Signal Terminated *** 2023-12-08T20:31:05.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:04 smithi043 bash[218991]: ceph-28476818-9607-11ee-95a3-87774f69a715-mon-smithi043 2023-12-08T20:31:05.410 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 systemd[1]: ceph-28476818-9607-11ee-95a3-87774f69a715@mon.smithi043.service: Succeeded. 2023-12-08T20:31:05.410 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 systemd[1]: Stopped Ceph mon.smithi043 for 28476818-9607-11ee-95a3-87774f69a715. 2023-12-08T20:31:05.410 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 systemd[1]: Starting Ceph mon.smithi043 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:31:05.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 bash[219156]: 3597e3a60ebc0a48ea54d34dd9526d1a3beb0d2f79f233c0acaea8d32ddf04d2 2023-12-08T20:31:05.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: set uid:gid to 167:167 (ceph:ceph) 2023-12-08T20:31:05.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 systemd[1]: Started Ceph mon.smithi043 for 28476818-9607-11ee-95a3-87774f69a715. 2023-12-08T20:31:05.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev), process ceph-mon, pid 7 2023-12-08T20:31:05.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: pidfile_write: ignore empty --pid-file 2023-12-08T20:31:05.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: load: jerasure load: lrc 2023-12-08T20:31:05.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: RocksDB version: 7.9.2 2023-12-08T20:31:05.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Git sha 0 2023-12-08T20:31:05.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Compile date 2023-12-08 17:42:16 2023-12-08T20:31:05.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: DB SUMMARY 2023-12-08T20:31:05.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: DB Session ID: R6J6EEKH85I6CMER8AJ3 2023-12-08T20:31:05.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: CURRENT file: CURRENT 2023-12-08T20:31:05.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: IDENTITY file: IDENTITY 2023-12-08T20:31:05.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1164 Bytes 2023-12-08T20:31:05.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi043/store.db dir, Total Num: 1, files: 000033.sst 2023-12-08T20:31:05.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi043/store.db: 000031.log size: 146928 ; 2023-12-08T20:31:05.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.error_if_exists: 0 2023-12-08T20:31:05.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.create_if_missing: 0 2023-12-08T20:31:05.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.paranoid_checks: 1 2023-12-08T20:31:05.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-08T20:31:05.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-08T20:31:05.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-08T20:31:05.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.env: 0x5570bd603a60 2023-12-08T20:31:05.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.fs: PosixFileSystem 2023-12-08T20:31:05.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.info_log: 0x5570bfb31600 2023-12-08T20:31:05.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_file_opening_threads: 16 2023-12-08T20:31:05.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.statistics: (nil) 2023-12-08T20:31:05.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.use_fsync: 0 2023-12-08T20:31:05.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_log_file_size: 0 2023-12-08T20:31:05.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-08T20:31:05.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-08T20:31:05.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.keep_log_file_num: 1000 2023-12-08T20:31:05.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.recycle_log_file_num: 0 2023-12-08T20:31:05.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.allow_fallocate: 1 2023-12-08T20:31:05.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.allow_mmap_reads: 0 2023-12-08T20:31:05.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.allow_mmap_writes: 0 2023-12-08T20:31:05.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.use_direct_reads: 0 2023-12-08T20:31:05.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-08T20:31:05.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.create_missing_column_families: 0 2023-12-08T20:31:05.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.db_log_dir: 2023-12-08T20:31:05.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.wal_dir: 2023-12-08T20:31:05.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-08T20:31:05.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-08T20:31:05.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-08T20:31:05.767 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-08T20:31:05.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-08T20:31:05.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-08T20:31:05.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.advise_random_on_open: 1 2023-12-08T20:31:05.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.db_write_buffer_size: 0 2023-12-08T20:31:05.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.write_buffer_manager: 0x5570bfae7360 2023-12-08T20:31:05.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-08T20:31:05.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-08T20:31:05.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-08T20:31:05.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.rate_limiter: (nil) 2023-12-08T20:31:05.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-08T20:31:05.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.wal_recovery_mode: 2 2023-12-08T20:31:05.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.enable_thread_tracking: 0 2023-12-08T20:31:05.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.enable_pipelined_write: 0 2023-12-08T20:31:05.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.unordered_write: 0 2023-12-08T20:31:05.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-08T20:31:05.768 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-08T20:31:05.769 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-08T20:31:05.769 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-08T20:31:05.769 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.row_cache: None 2023-12-08T20:31:05.769 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.wal_filter: None 2023-12-08T20:31:05.769 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-08T20:31:05.769 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.allow_ingest_behind: 0 2023-12-08T20:31:05.769 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.two_write_queues: 0 2023-12-08T20:31:05.769 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.manual_wal_flush: 0 2023-12-08T20:31:05.769 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.wal_compression: 0 2023-12-08T20:31:05.769 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.atomic_flush: 0 2023-12-08T20:31:05.769 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-08T20:31:05.769 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-08T20:31:05.769 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-08T20:31:05.769 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.log_readahead_size: 0 2023-12-08T20:31:05.769 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-08T20:31:05.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.best_efforts_recovery: 0 2023-12-08T20:31:05.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-08T20:31:05.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-08T20:31:05.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.allow_data_in_errors: 0 2023-12-08T20:31:05.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.db_host_id: __hostname__ 2023-12-08T20:31:05.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-08T20:31:05.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_background_jobs: 2 2023-12-08T20:31:05.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_background_compactions: -1 2023-12-08T20:31:05.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_subcompactions: 1 2023-12-08T20:31:05.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-08T20:31:05.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-08T20:31:05.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-08T20:31:05.770 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_total_wal_size: 0 2023-12-08T20:31:05.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-08T20:31:05.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-08T20:31:05.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-08T20:31:05.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-08T20:31:05.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_open_files: -1 2023-12-08T20:31:05.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.bytes_per_sync: 0 2023-12-08T20:31:05.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-08T20:31:05.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-08T20:31:05.771 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compaction_readahead_size: 0 2023-12-08T20:31:05.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_background_flushes: -1 2023-12-08T20:31:05.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Compression algorithms supported: 2023-12-08T20:31:05.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-08T20:31:05.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: kZSTD supported: 0 2023-12-08T20:31:05.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: kXpressCompression supported: 0 2023-12-08T20:31:05.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: kLZ4HCCompression supported: 1 2023-12-08T20:31:05.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: kZlibCompression supported: 1 2023-12-08T20:31:05.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: kSnappyCompression supported: 1 2023-12-08T20:31:05.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: kLZ4Compression supported: 1 2023-12-08T20:31:05.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: kBZip2Compression supported: 0 2023-12-08T20:31:05.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-08T20:31:05.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-08T20:31:05.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi043/store.db/MANIFEST-000015 2023-12-08T20:31:05.772 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-08T20:31:05.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-08T20:31:05.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.merge_operator: 2023-12-08T20:31:05.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compaction_filter: None 2023-12-08T20:31:05.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compaction_filter_factory: None 2023-12-08T20:31:05.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.sst_partitioner_factory: None 2023-12-08T20:31:05.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-08T20:31:05.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-08T20:31:05.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5570bfb31700) 2023-12-08T20:31:05.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: cache_index_and_filter_blocks: 1 2023-12-08T20:31:05.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-08T20:31:05.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-08T20:31:05.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: pin_top_level_index_and_filter: 1 2023-12-08T20:31:05.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: index_type: 0 2023-12-08T20:31:05.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: data_block_index_type: 0 2023-12-08T20:31:05.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: index_shortening: 1 2023-12-08T20:31:05.773 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-08T20:31:05.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: checksum: 4 2023-12-08T20:31:05.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: no_block_cache: 0 2023-12-08T20:31:05.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: block_cache: 0x5570bfb87090 2023-12-08T20:31:05.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: block_cache_name: BinnedLRUCache 2023-12-08T20:31:05.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: block_cache_options: 2023-12-08T20:31:05.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: capacity : 536870912 2023-12-08T20:31:05.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: num_shard_bits : 4 2023-12-08T20:31:05.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: strict_capacity_limit : 0 2023-12-08T20:31:05.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: high_pri_pool_ratio: 0.000 2023-12-08T20:31:05.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: block_cache_compressed: (nil) 2023-12-08T20:31:05.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: persistent_cache: (nil) 2023-12-08T20:31:05.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: block_size: 4096 2023-12-08T20:31:05.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: block_size_deviation: 10 2023-12-08T20:31:05.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: block_restart_interval: 16 2023-12-08T20:31:05.774 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: index_block_restart_interval: 1 2023-12-08T20:31:05.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: metadata_block_size: 4096 2023-12-08T20:31:05.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: partition_filters: 0 2023-12-08T20:31:05.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: use_delta_encoding: 1 2023-12-08T20:31:05.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: filter_policy: bloomfilter 2023-12-08T20:31:05.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: whole_key_filtering: 1 2023-12-08T20:31:05.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: verify_compression: 0 2023-12-08T20:31:05.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: read_amp_bytes_per_bit: 0 2023-12-08T20:31:05.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: format_version: 5 2023-12-08T20:31:05.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: enable_index_compression: 1 2023-12-08T20:31:05.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: block_align: 0 2023-12-08T20:31:05.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: max_auto_readahead_size: 262144 2023-12-08T20:31:05.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: prepopulate_block_cache: 0 2023-12-08T20:31:05.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: initial_auto_readahead_size: 8192 2023-12-08T20:31:05.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: num_file_reads_for_auto_readahead: 2 2023-12-08T20:31:05.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.write_buffer_size: 33554432 2023-12-08T20:31:05.775 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_write_buffer_number: 2 2023-12-08T20:31:05.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compression: NoCompression 2023-12-08T20:31:05.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.bottommost_compression: Disabled 2023-12-08T20:31:05.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.prefix_extractor: nullptr 2023-12-08T20:31:05.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-08T20:31:05.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.num_levels: 7 2023-12-08T20:31:05.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-08T20:31:05.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-08T20:31:05.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-08T20:31:05.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-08T20:31:05.776 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-08T20:31:05.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-08T20:31:05.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-08T20:31:05.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-08T20:31:05.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-08T20:31:05.777 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-08T20:31:05.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-08T20:31:05.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-08T20:31:05.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-08T20:31:05.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compression_opts.level: 32767 2023-12-08T20:31:05.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compression_opts.strategy: 0 2023-12-08T20:31:05.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-08T20:31:05.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-08T20:31:05.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-08T20:31:05.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-08T20:31:05.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compression_opts.enabled: false 2023-12-08T20:31:05.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-08T20:31:05.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-08T20:31:05.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-08T20:31:05.778 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-08T20:31:05.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.target_file_size_base: 67108864 2023-12-08T20:31:05.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-08T20:31:05.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-08T20:31:05.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-08T20:31:05.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-08T20:31:05.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-08T20:31:05.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-08T20:31:05.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-08T20:31:05.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-08T20:31:05.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-08T20:31:05.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-08T20:31:05.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-08T20:31:05.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-08T20:31:05.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-08T20:31:05.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-08T20:31:05.779 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.arena_block_size: 1048576 2023-12-08T20:31:05.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-08T20:31:05.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-08T20:31:05.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.disable_auto_compactions: 0 2023-12-08T20:31:05.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-08T20:31:05.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-08T20:31:05.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-08T20:31:05.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-08T20:31:05.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-08T20:31:05.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-08T20:31:05.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-08T20:31:05.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-08T20:31:05.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-08T20:31:05.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-08T20:31:05.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.table_properties_collectors: 2023-12-08T20:31:05.780 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.inplace_update_support: 0 2023-12-08T20:31:05.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-08T20:31:05.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-08T20:31:05.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-08T20:31:05.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-08T20:31:05.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.bloom_locality: 0 2023-12-08T20:31:05.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.max_successive_merges: 0 2023-12-08T20:31:05.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-08T20:31:05.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.paranoid_file_checks: 0 2023-12-08T20:31:05.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.force_consistency_checks: 1 2023-12-08T20:31:05.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.report_bg_io_stats: 0 2023-12-08T20:31:05.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.ttl: 2592000 2023-12-08T20:31:05.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-08T20:31:05.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-08T20:31:05.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-08T20:31:05.781 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.enable_blob_files: false 2023-12-08T20:31:05.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.min_blob_size: 0 2023-12-08T20:31:05.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.blob_file_size: 268435456 2023-12-08T20:31:05.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-08T20:31:05.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-08T20:31:05.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-08T20:31:05.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-08T20:31:05.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-08T20:31:05.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.blob_file_starting_level: 0 2023-12-08T20:31:05.782 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-08T20:31:05.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2023-12-08T20:31:05.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-08T20:31:05.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi043/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12588, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-08T20:31:05.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2023-12-08T20:31:05.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 566da84b-9dcc-4abc-9859-d2ca306baf63 2023-12-08T20:31:05.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702067465484689, "job": 1, "event": "recovery_started", "wal_files": [31]} 2023-12-08T20:31:05.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2023-12-08T20:31:05.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702067465486113, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 142843, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12580, "largest_seqno": 12861, "table_properties": {"data_size": 140841, "index_size": 604, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 389, "raw_key_size": 3265, "raw_average_key_size": 24, "raw_value_size": 138080, "raw_average_value_size": 1046, "num_data_blocks": 27, "num_entries": 132, "num_filter_entries": 132, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702067465, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "566da84b-9dcc-4abc-9859-d2ca306baf63", "db_session_id": "R6J6EEKH85I6CMER8AJ3", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2023-12-08T20:31:05.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702067465486218, "job": 1, "event": "recovery_finished"} 2023-12-08T20:31:05.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2023-12-08T20:31:05.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-08T20:31:05.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi043/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-08T20:31:05.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5570bfc22000 2023-12-08T20:31:05.783 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: DB pointer 0x5570bfc0e000 2023-12-08T20:31:05.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-08T20:31:05.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-08T20:31:05.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: ** DB Stats ** 2023-12-08T20:31:05.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-08T20:31:05.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-08T20:31:05.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-08T20:31:05.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-08T20:31:05.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-08T20:31:05.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-08T20:31:05.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-08T20:31:05.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: 2023-12-08T20:31:05.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: ** Compaction Stats [default] ** 2023-12-08T20:31:05.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-08T20:31:05.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-08T20:31:05.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: L0 1/0 139.50 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-08T20:31:05.784 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: L6 1/0 6.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-08T20:31:05.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Sum 2/0 7.04 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-08T20:31:05.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-08T20:31:05.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: 2023-12-08T20:31:05.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: ** Compaction Stats [default] ** 2023-12-08T20:31:05.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-08T20:31:05.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-08T20:31:05.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 153.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-08T20:31:05.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: 2023-12-08T20:31:05.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-08T20:31:05.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: 2023-12-08T20:31:05.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-08T20:31:05.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-08T20:31:05.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-08T20:31:05.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-08T20:31:05.785 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-08T20:31:05.786 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-08T20:31:05.786 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Cumulative compaction: 0.00 GB write, 32.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-08T20:31:05.786 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Interval compaction: 0.00 GB write, 32.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-08T20:31:05.786 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-08T20:31:05.786 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Block cache BinnedLRUCache@0x5570bfb87090#7 capacity: 512.00 MB usage: 1.14 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-12-08T20:31:05.786 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.44 KB,8.34465e-05%) IndexBlock(1,0.70 KB,0.00013411%) Misc(1,0.00 KB,0%) 2023-12-08T20:31:05.786 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: 2023-12-08T20:31:05.786 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-08T20:31:05.786 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: starting mon.smithi043 rank 0 at public addrs [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] at bind addrs [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi043 fsid 28476818-9607-11ee-95a3-87774f69a715 2023-12-08T20:31:05.786 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: mon.smithi043@-1(???) e2 preinit fsid 28476818-9607-11ee-95a3-87774f69a715 2023-12-08T20:31:05.786 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: mon.smithi043@-1(???).mds e15 new map 2023-12-08T20:31:05.786 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: mon.smithi043@-1(???).mds e15 print_map 2023-12-08T20:31:05.786 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: e15 2023-12-08T20:31:05.786 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-08T20:31:05.787 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:31:05.787 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: legacy client fscid: 1 2023-12-08T20:31:05.787 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: 2023-12-08T20:31:05.787 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Filesystem 'cephfs' (1) 2023-12-08T20:31:05.787 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: fs_name cephfs 2023-12-08T20:31:05.787 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: epoch 15 2023-12-08T20:31:05.787 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-08T20:31:05.787 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: created 2023-12-08T20:25:41.527734+0000 2023-12-08T20:31:05.787 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: modified 2023-12-08T20:28:01.721203+0000 2023-12-08T20:31:05.787 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: tableserver 0 2023-12-08T20:31:05.787 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: root 0 2023-12-08T20:31:05.787 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: session_timeout 60 2023-12-08T20:31:05.787 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: session_autoclose 300 2023-12-08T20:31:05.787 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: max_file_size 1099511627776 2023-12-08T20:31:05.787 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: max_xattr_size 65536 2023-12-08T20:31:05.787 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: required_client_features {} 2023-12-08T20:31:05.787 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: last_failure 0 2023-12-08T20:31:05.788 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: last_failure_osd_epoch 0 2023-12-08T20:31:05.788 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:31:05.788 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: max_mds 2 2023-12-08T20:31:05.788 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: in 0,1 2023-12-08T20:31:05.788 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: up {0=14452,1=24315} 2023-12-08T20:31:05.788 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: failed 2023-12-08T20:31:05.788 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: damaged 2023-12-08T20:31:05.788 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: stopped 2023-12-08T20:31:05.788 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: data_pools [3] 2023-12-08T20:31:05.788 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: metadata_pool 2 2023-12-08T20:31:05.788 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: inline_data disabled 2023-12-08T20:31:05.788 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: balancer 2023-12-08T20:31:05.788 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: bal_rank_mask -1 2023-12-08T20:31:05.788 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: standby_count_wanted 1 2023-12-08T20:31:05.788 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: [mds.cephfs.smithi043.pjmszb{0:14452} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.43:6826/441584552,v1:172.21.15.43:6827/441584552] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:31:05.788 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: [mds.cephfs.smithi111.veeegc{1:24315} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.111:6824/1990395192,v1:172.21.15.111:6825/1990395192] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:31:05.789 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: 2023-12-08T20:31:05.789 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: 2023-12-08T20:31:05.789 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: Standby daemons: 2023-12-08T20:31:05.789 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: 2023-12-08T20:31:05.789 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: [mds.cephfs.smithi043.akrjef{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.43:6828/2926918083,v1:172.21.15.43:6829/2926918083] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:31:05.789 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout: [mds.cephfs.smithi111.svpasm{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6826/2885759138,v1:172.21.15.111:6827/2885759138] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:31:05.789 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: mon.smithi043@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-08T20:31:05.789 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: mon.smithi043@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2023-12-08T20:31:05.789 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: mon.smithi043@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2023-12-08T20:31:05.789 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: mon.smithi043@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2023-12-08T20:31:05.789 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:05 smithi043 ceph-mon[219193]: mon.smithi043@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2023-12-08T20:31:06.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:06 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:31:06.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:06 smithi111 ceph-mon[121341]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:31:06.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:06 smithi111 ceph-mon[121341]: from='client.14804 172.21.15.43:0/396618454' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-08T20:31:06.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:06 smithi111 ceph-mon[121341]: pgmap v75: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:06.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:06 smithi111 ceph-mon[121341]: mon.smithi043 calling monitor election 2023-12-08T20:31:06.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:06 smithi111 ceph-mon[121341]: mon.smithi043 is new leader, mons smithi043,smithi111 in quorum (ranks 0,1) 2023-12-08T20:31:06.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:06 smithi111 ceph-mon[121341]: monmap e2: 2 mons at {smithi043=[v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0],smithi111=[v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-08T20:31:06.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:06 smithi111 ceph-mon[121341]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:31:06.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:06 smithi111 ceph-mon[121341]: osdmap e49: 6 total, 6 up, 6 in 2023-12-08T20:31:06.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:06 smithi111 ceph-mon[121341]: mgrmap e33: smithi043.hqcdcm(active, since 2m), standbys: smithi111.mtcffu 2023-12-08T20:31:06.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:06 smithi111 ceph-mon[121341]: from='mgr.14640 ' entity='' 2023-12-08T20:31:06.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:06 smithi111 ceph-mon[121341]: mgrmap e34: smithi043.hqcdcm(active, since 2m), standbys: smithi111.mtcffu 2023-12-08T20:31:06.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:06 smithi111 ceph-mon[121341]: overall HEALTH_OK 2023-12-08T20:31:06.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:06 smithi043 ceph-mon[219193]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:31:06.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:06 smithi043 ceph-mon[219193]: from='mgr.14640 172.21.15.43:0/1397659219' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:31:06.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:06 smithi043 ceph-mon[219193]: from='client.14804 172.21.15.43:0/396618454' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-08T20:31:06.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:06 smithi043 ceph-mon[219193]: pgmap v75: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:06.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:06 smithi043 ceph-mon[219193]: mon.smithi043 calling monitor election 2023-12-08T20:31:06.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:06 smithi043 ceph-mon[219193]: mon.smithi043 is new leader, mons smithi043,smithi111 in quorum (ranks 0,1) 2023-12-08T20:31:06.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:06 smithi043 ceph-mon[219193]: monmap e2: 2 mons at {smithi043=[v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0],smithi111=[v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-08T20:31:06.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:06 smithi043 ceph-mon[219193]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:31:06.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:06 smithi043 ceph-mon[219193]: osdmap e49: 6 total, 6 up, 6 in 2023-12-08T20:31:06.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:06 smithi043 ceph-mon[219193]: mgrmap e33: smithi043.hqcdcm(active, since 2m), standbys: smithi111.mtcffu 2023-12-08T20:31:06.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:06 smithi043 ceph-mon[219193]: from='mgr.14640 ' entity='' 2023-12-08T20:31:06.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:06 smithi043 ceph-mon[219193]: mgrmap e34: smithi043.hqcdcm(active, since 2m), standbys: smithi111.mtcffu 2023-12-08T20:31:06.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:06 smithi043 ceph-mon[219193]: overall HEALTH_OK 2023-12-08T20:31:12.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:12 smithi111 ceph-mon[121341]: Standby manager daemon smithi111.mtcffu restarted 2023-12-08T20:31:12.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:12 smithi111 ceph-mon[121341]: Standby manager daemon smithi111.mtcffu started 2023-12-08T20:31:12.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:12 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.111:0/4245896503' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/crt"}]: dispatch 2023-12-08T20:31:12.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:12 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.111:0/4245896503' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-08T20:31:12.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:12 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.111:0/4245896503' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/key"}]: dispatch 2023-12-08T20:31:12.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:12 smithi111 ceph-mon[121341]: from='mgr.? 172.21.15.111:0/4245896503' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-08T20:31:13.263 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:12 smithi043 ceph-mon[219193]: Standby manager daemon smithi111.mtcffu restarted 2023-12-08T20:31:13.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:12 smithi043 ceph-mon[219193]: Standby manager daemon smithi111.mtcffu started 2023-12-08T20:31:13.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:12 smithi043 ceph-mon[219193]: from='mgr.? 172.21.15.111:0/4245896503' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/crt"}]: dispatch 2023-12-08T20:31:13.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:12 smithi043 ceph-mon[219193]: from='mgr.? 172.21.15.111:0/4245896503' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-08T20:31:13.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:12 smithi043 ceph-mon[219193]: from='mgr.? 172.21.15.111:0/4245896503' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.mtcffu/key"}]: dispatch 2023-12-08T20:31:13.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:12 smithi043 ceph-mon[219193]: from='mgr.? 172.21.15.111:0/4245896503' entity='mgr.smithi111.mtcffu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-08T20:31:14.010 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:13 smithi043 ceph-mon[219193]: mgrmap e35: smithi043.hqcdcm(active, since 2m), standbys: smithi111.mtcffu 2023-12-08T20:31:14.011 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:13 smithi043 ceph-mon[219193]: Active manager daemon smithi043.hqcdcm restarted 2023-12-08T20:31:14.011 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:13 smithi043 ceph-mon[219193]: Activating manager daemon smithi043.hqcdcm 2023-12-08T20:31:14.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:13 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-mon-smithi111[121318]: 2023-12-08T20:31:13.870+0000 7f5c7273e700 -1 mon.smithi111@1(peon).osd e50 update_from_paxos full map CRC mismatch, resetting to canonical 2023-12-08T20:31:14.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:13 smithi111 ceph-mon[121341]: mgrmap e35: smithi043.hqcdcm(active, since 2m), standbys: smithi111.mtcffu 2023-12-08T20:31:14.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:13 smithi111 ceph-mon[121341]: Active manager daemon smithi043.hqcdcm restarted 2023-12-08T20:31:14.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:13 smithi111 ceph-mon[121341]: Activating manager daemon smithi043.hqcdcm 2023-12-08T20:31:15.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: osdmap e50: 6 total, 6 up, 6 in 2023-12-08T20:31:15.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: mgrmap e36: smithi043.hqcdcm(active, starting, since 0.00616749s), standbys: smithi111.mtcffu 2023-12-08T20:31:15.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: failed to encode map e50 with expected crc 2023-12-08T20:31:15.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:31:15.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:31:15.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi043.pjmszb"}]: dispatch 2023-12-08T20:31:15.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi043.akrjef"}]: dispatch 2023-12-08T20:31:15.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.veeegc"}]: dispatch 2023-12-08T20:31:15.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.svpasm"}]: dispatch 2023-12-08T20:31:15.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr metadata", "who": "smithi043.hqcdcm", "id": "smithi043.hqcdcm"}]: dispatch 2023-12-08T20:31:15.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr metadata", "who": "smithi111.mtcffu", "id": "smithi111.mtcffu"}]: dispatch 2023-12-08T20:31:15.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:31:15.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-08T20:31:15.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:31:15.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:31:15.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:31:15.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:31:15.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-08T20:31:15.221 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-08T20:31:15.221 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-08T20:31:15.221 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: Manager daemon smithi043.hqcdcm is now available 2023-12-08T20:31:15.221 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:31:15.221 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:31:15.221 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:31:15.221 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi043.hqcdcm/mirror_snapshot_schedule"}]: dispatch 2023-12-08T20:31:15.221 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi043.hqcdcm/trash_purge_schedule"}]: dispatch 2023-12-08T20:31:15.222 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: failed to encode map e50 with expected crc 2023-12-08T20:31:15.222 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: failed to encode map e50 with expected crc 2023-12-08T20:31:15.222 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:15.222 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:14 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:15.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: osdmap e50: 6 total, 6 up, 6 in 2023-12-08T20:31:15.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: mgrmap e36: smithi043.hqcdcm(active, starting, since 0.00616749s), standbys: smithi111.mtcffu 2023-12-08T20:31:15.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: failed to encode map e50 with expected crc 2023-12-08T20:31:15.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:31:15.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:31:15.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi043.pjmszb"}]: dispatch 2023-12-08T20:31:15.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi043.akrjef"}]: dispatch 2023-12-08T20:31:15.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.veeegc"}]: dispatch 2023-12-08T20:31:15.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.svpasm"}]: dispatch 2023-12-08T20:31:15.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr metadata", "who": "smithi043.hqcdcm", "id": "smithi043.hqcdcm"}]: dispatch 2023-12-08T20:31:15.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr metadata", "who": "smithi111.mtcffu", "id": "smithi111.mtcffu"}]: dispatch 2023-12-08T20:31:15.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:31:15.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-08T20:31:15.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:31:15.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:31:15.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:31:15.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:31:15.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-08T20:31:15.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-08T20:31:15.266 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-08T20:31:15.266 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: Manager daemon smithi043.hqcdcm is now available 2023-12-08T20:31:15.266 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:31:15.266 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:31:15.266 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:31:15.266 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi043.hqcdcm/mirror_snapshot_schedule"}]: dispatch 2023-12-08T20:31:15.266 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi043.hqcdcm/trash_purge_schedule"}]: dispatch 2023-12-08T20:31:15.266 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: failed to encode map e50 with expected crc 2023-12-08T20:31:15.267 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: failed to encode map e50 with expected crc 2023-12-08T20:31:15.267 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:15.267 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:15.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:15 smithi111 ceph-mon[121341]: [08/Dec/2023:20:31:14] ENGINE Bus STARTING 2023-12-08T20:31:15.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:15 smithi111 ceph-mon[121341]: [08/Dec/2023:20:31:14] ENGINE Serving on https://172.21.15.43:7150 2023-12-08T20:31:15.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:15 smithi111 ceph-mon[121341]: [08/Dec/2023:20:31:14] ENGINE Serving on http://172.21.15.43:8765 2023-12-08T20:31:15.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:15 smithi111 ceph-mon[121341]: [08/Dec/2023:20:31:14] ENGINE Bus STARTED 2023-12-08T20:31:15.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:15 smithi111 ceph-mon[121341]: mgrmap e37: smithi043.hqcdcm(active, since 1.02721s), standbys: smithi111.mtcffu 2023-12-08T20:31:15.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:15 smithi111 ceph-mon[121341]: pgmap v3: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:16.236 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:15 smithi043 ceph-mon[219193]: [08/Dec/2023:20:31:14] ENGINE Bus STARTING 2023-12-08T20:31:16.237 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:15 smithi043 ceph-mon[219193]: [08/Dec/2023:20:31:14] ENGINE Serving on https://172.21.15.43:7150 2023-12-08T20:31:16.237 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:15 smithi043 ceph-mon[219193]: [08/Dec/2023:20:31:14] ENGINE Serving on http://172.21.15.43:8765 2023-12-08T20:31:16.237 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:15 smithi043 ceph-mon[219193]: [08/Dec/2023:20:31:14] ENGINE Bus STARTED 2023-12-08T20:31:16.237 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:15 smithi043 ceph-mon[219193]: mgrmap e37: smithi043.hqcdcm(active, since 1.02721s), standbys: smithi111.mtcffu 2023-12-08T20:31:16.237 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:15 smithi043 ceph-mon[219193]: pgmap v3: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:17.458 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:17 smithi111 ceph-mon[121341]: pgmap v4: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:17.458 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:17 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:17.458 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:17 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:17.458 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:17 smithi111 ceph-mon[121341]: mgrmap e38: smithi043.hqcdcm(active, since 2s), standbys: smithi111.mtcffu 2023-12-08T20:31:17.458 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:17 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:17.458 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:17 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:17.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:17 smithi043 ceph-mon[219193]: pgmap v4: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:17.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:17 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:17.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:17 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:17.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:17 smithi043 ceph-mon[219193]: mgrmap e38: smithi043.hqcdcm(active, since 2s), standbys: smithi111.mtcffu 2023-12-08T20:31:17.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:17 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:17.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:17 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:19.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:19 smithi111 ceph-mon[121341]: pgmap v5: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:19.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:19 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:19.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:19 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:19.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:19 smithi111 ceph-mon[121341]: mgrmap e39: smithi043.hqcdcm(active, since 4s), standbys: smithi111.mtcffu 2023-12-08T20:31:19.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:19 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:19.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:19 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:19.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:19 smithi043 ceph-mon[219193]: pgmap v5: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:19.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:19 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:19.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:19 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:19.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:19 smithi043 ceph-mon[219193]: mgrmap e39: smithi043.hqcdcm(active, since 4s), standbys: smithi111.mtcffu 2023-12-08T20:31:19.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:19 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:19.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:19 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:20.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:20 smithi043 ceph-mon[219193]: Detected new or changed devices on smithi111 2023-12-08T20:31:20.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:20 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:20.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:20 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:20.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:20 smithi043 ceph-mon[219193]: pgmap v6: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:20.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:20 smithi111 ceph-mon[121341]: Detected new or changed devices on smithi111 2023-12-08T20:31:20.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:20 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:20.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:20 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:20.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:20 smithi111 ceph-mon[121341]: pgmap v6: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:22.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:22 smithi111 ceph-mon[121341]: Detected new or changed devices on smithi043 2023-12-08T20:31:22.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:22 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:22.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:22 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:22.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:22 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:22.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:22 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:31:22.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:22 smithi111 ceph-mon[121341]: Updating smithi043:/etc/ceph/ceph.conf 2023-12-08T20:31:22.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:22 smithi111 ceph-mon[121341]: Updating smithi111:/etc/ceph/ceph.conf 2023-12-08T20:31:22.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:22 smithi111 ceph-mon[121341]: pgmap v7: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 16 op/s 2023-12-08T20:31:22.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:22 smithi111 ceph-mon[121341]: Updating smithi111:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:31:22.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:22 smithi111 ceph-mon[121341]: Updating smithi043:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:31:22.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:22 smithi111 ceph-mon[121341]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2023-12-08T20:31:23.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:22 smithi043 ceph-mon[219193]: Detected new or changed devices on smithi043 2023-12-08T20:31:23.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:22 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:23.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:22 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:23.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:22 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:23.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:22 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:31:23.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:22 smithi043 ceph-mon[219193]: Updating smithi043:/etc/ceph/ceph.conf 2023-12-08T20:31:23.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:22 smithi043 ceph-mon[219193]: Updating smithi111:/etc/ceph/ceph.conf 2023-12-08T20:31:23.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:22 smithi043 ceph-mon[219193]: pgmap v7: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 16 op/s 2023-12-08T20:31:23.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:22 smithi043 ceph-mon[219193]: Updating smithi111:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:31:23.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:22 smithi043 ceph-mon[219193]: Updating smithi043:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.conf 2023-12-08T20:31:23.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:22 smithi043 ceph-mon[219193]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2023-12-08T20:31:23.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:23 smithi111 ceph-mon[121341]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2023-12-08T20:31:23.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:23 smithi111 ceph-mon[121341]: Updating smithi111:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-08T20:31:23.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:23 smithi111 ceph-mon[121341]: Updating smithi043:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-08T20:31:23.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:23 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:23.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:23 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:23.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:23 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:23.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:23 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:23.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:23 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:23.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:23 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:31:23.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:23 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:31:23.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:23 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-08T20:31:24.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:23 smithi043 ceph-mon[219193]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2023-12-08T20:31:24.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:23 smithi043 ceph-mon[219193]: Updating smithi111:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-08T20:31:24.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:23 smithi043 ceph-mon[219193]: Updating smithi043:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/config/ceph.client.admin.keyring 2023-12-08T20:31:24.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:23 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:24.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:23 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:24.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:23 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:24.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:23 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:24.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:23 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:24.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:23 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:31:24.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:23 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:31:24.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:23 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-08T20:31:25.195 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:24 smithi111 ceph-mon[121341]: pgmap v8: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2023-12-08T20:31:25.196 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:24 smithi111 ceph-mon[121341]: Upgrade: Updating mon.smithi111 2023-12-08T20:31:25.196 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:24 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:25.196 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:24 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-08T20:31:25.196 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:24 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-08T20:31:25.196 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:24 smithi111 ceph-mon[121341]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:25.196 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:24 smithi111 ceph-mon[121341]: Deploying daemon mon.smithi111 on smithi111 2023-12-08T20:31:25.196 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:25 smithi111 systemd[1]: Stopping Ceph mon.smithi111 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:31:25.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:24 smithi043 ceph-mon[219193]: pgmap v8: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2023-12-08T20:31:25.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:24 smithi043 ceph-mon[219193]: Upgrade: Updating mon.smithi111 2023-12-08T20:31:25.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:24 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:25.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:24 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-08T20:31:25.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:24 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-08T20:31:25.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:24 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:25.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:24 smithi043 ceph-mon[219193]: Deploying daemon mon.smithi111 on smithi111 2023-12-08T20:31:25.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:25 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-mon-smithi111[121318]: 2023-12-08T20:31:25.192+0000 7f5c77f49700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi111 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-08T20:31:25.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:25 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-mon-smithi111[121318]: 2023-12-08T20:31:25.192+0000 7f5c77f49700 -1 mon.smithi111@1(peon) e2 *** Got Signal Terminated *** 2023-12-08T20:31:25.831 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:25 smithi111 bash[182288]: ceph-28476818-9607-11ee-95a3-87774f69a715-mon-smithi111 2023-12-08T20:31:26.184 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:25 smithi111 systemd[1]: ceph-28476818-9607-11ee-95a3-87774f69a715@mon.smithi111.service: Succeeded. 2023-12-08T20:31:26.184 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:25 smithi111 systemd[1]: Stopped Ceph mon.smithi111 for 28476818-9607-11ee-95a3-87774f69a715. 2023-12-08T20:31:26.184 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:25 smithi111 systemd[1]: Starting Ceph mon.smithi111 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:31:26.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: set uid:gid to 167:167 (ceph:ceph) 2023-12-08T20:31:26.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev), process ceph-mon, pid 6 2023-12-08T20:31:26.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: pidfile_write: ignore empty --pid-file 2023-12-08T20:31:26.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 bash[182437]: 528aa182165fb039ee7a03d8b1f26c123ba4505fb797d31d7b759e1c66c82206 2023-12-08T20:31:26.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: load: jerasure load: lrc 2023-12-08T20:31:26.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: RocksDB version: 7.9.2 2023-12-08T20:31:26.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Git sha 0 2023-12-08T20:31:26.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Compile date 2023-12-08 17:42:16 2023-12-08T20:31:26.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: DB SUMMARY 2023-12-08T20:31:26.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: DB Session ID: N3842CVBLTQ3POWYWSN1 2023-12-08T20:31:26.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: CURRENT file: CURRENT 2023-12-08T20:31:26.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: IDENTITY file: IDENTITY 2023-12-08T20:31:26.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1089 Bytes 2023-12-08T20:31:26.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi111/store.db dir, Total Num: 1, files: 000027.sst 2023-12-08T20:31:26.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi111/store.db: 000025.log size: 3150537 ; 2023-12-08T20:31:26.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.error_if_exists: 0 2023-12-08T20:31:26.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.create_if_missing: 0 2023-12-08T20:31:26.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.paranoid_checks: 1 2023-12-08T20:31:26.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-08T20:31:26.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-08T20:31:26.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-08T20:31:26.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.env: 0x56065ed16a60 2023-12-08T20:31:26.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.fs: PosixFileSystem 2023-12-08T20:31:26.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.info_log: 0x56065fb87600 2023-12-08T20:31:26.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_file_opening_threads: 16 2023-12-08T20:31:26.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.statistics: (nil) 2023-12-08T20:31:26.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.use_fsync: 0 2023-12-08T20:31:26.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_log_file_size: 0 2023-12-08T20:31:26.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-08T20:31:26.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-08T20:31:26.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.keep_log_file_num: 1000 2023-12-08T20:31:26.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.recycle_log_file_num: 0 2023-12-08T20:31:26.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.allow_fallocate: 1 2023-12-08T20:31:26.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.allow_mmap_reads: 0 2023-12-08T20:31:26.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.allow_mmap_writes: 0 2023-12-08T20:31:26.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.use_direct_reads: 0 2023-12-08T20:31:26.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-08T20:31:26.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.create_missing_column_families: 0 2023-12-08T20:31:26.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.db_log_dir: 2023-12-08T20:31:26.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.wal_dir: 2023-12-08T20:31:26.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-08T20:31:26.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-08T20:31:26.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-08T20:31:26.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-08T20:31:26.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-08T20:31:26.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-08T20:31:26.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.advise_random_on_open: 1 2023-12-08T20:31:26.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.db_write_buffer_size: 0 2023-12-08T20:31:26.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.write_buffer_manager: 0x56065fb3d360 2023-12-08T20:31:26.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-08T20:31:26.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-08T20:31:26.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-08T20:31:26.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.rate_limiter: (nil) 2023-12-08T20:31:26.722 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-08T20:31:26.722 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.wal_recovery_mode: 2 2023-12-08T20:31:26.722 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.enable_thread_tracking: 0 2023-12-08T20:31:26.723 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.enable_pipelined_write: 0 2023-12-08T20:31:26.723 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.unordered_write: 0 2023-12-08T20:31:26.723 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-08T20:31:26.723 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-08T20:31:26.723 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-08T20:31:26.723 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-08T20:31:26.723 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.row_cache: None 2023-12-08T20:31:26.723 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.wal_filter: None 2023-12-08T20:31:26.723 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-08T20:31:26.723 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.allow_ingest_behind: 0 2023-12-08T20:31:26.723 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.two_write_queues: 0 2023-12-08T20:31:26.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.manual_wal_flush: 0 2023-12-08T20:31:26.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.wal_compression: 0 2023-12-08T20:31:26.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.atomic_flush: 0 2023-12-08T20:31:26.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-08T20:31:26.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-08T20:31:26.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-08T20:31:26.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.log_readahead_size: 0 2023-12-08T20:31:26.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-08T20:31:26.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.best_efforts_recovery: 0 2023-12-08T20:31:26.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-08T20:31:26.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-08T20:31:26.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.allow_data_in_errors: 0 2023-12-08T20:31:26.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.db_host_id: __hostname__ 2023-12-08T20:31:26.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-08T20:31:26.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_background_jobs: 2 2023-12-08T20:31:26.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_background_compactions: -1 2023-12-08T20:31:26.725 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_subcompactions: 1 2023-12-08T20:31:26.725 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-08T20:31:26.725 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-08T20:31:26.725 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-08T20:31:26.725 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_total_wal_size: 0 2023-12-08T20:31:26.725 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-08T20:31:26.725 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-08T20:31:26.725 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-08T20:31:26.725 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-08T20:31:26.725 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_open_files: -1 2023-12-08T20:31:26.725 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.bytes_per_sync: 0 2023-12-08T20:31:26.725 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-08T20:31:26.725 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-08T20:31:26.725 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compaction_readahead_size: 0 2023-12-08T20:31:26.725 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_background_flushes: -1 2023-12-08T20:31:26.726 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Compression algorithms supported: 2023-12-08T20:31:26.726 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-08T20:31:26.726 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: kZSTD supported: 0 2023-12-08T20:31:26.726 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: kXpressCompression supported: 0 2023-12-08T20:31:26.726 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: kLZ4HCCompression supported: 1 2023-12-08T20:31:26.726 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: kZlibCompression supported: 1 2023-12-08T20:31:26.726 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: kSnappyCompression supported: 1 2023-12-08T20:31:26.726 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: kLZ4Compression supported: 1 2023-12-08T20:31:26.726 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: kBZip2Compression supported: 0 2023-12-08T20:31:26.726 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-08T20:31:26.726 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-08T20:31:26.726 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi111/store.db/MANIFEST-000009 2023-12-08T20:31:26.726 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-08T20:31:26.726 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-08T20:31:26.726 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.merge_operator: 2023-12-08T20:31:26.727 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compaction_filter: None 2023-12-08T20:31:26.727 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compaction_filter_factory: None 2023-12-08T20:31:26.727 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.sst_partitioner_factory: None 2023-12-08T20:31:26.727 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-08T20:31:26.727 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-08T20:31:26.727 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56065fb87700) 2023-12-08T20:31:26.727 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: cache_index_and_filter_blocks: 1 2023-12-08T20:31:26.727 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-08T20:31:26.727 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-08T20:31:26.727 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: pin_top_level_index_and_filter: 1 2023-12-08T20:31:26.727 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: index_type: 0 2023-12-08T20:31:26.727 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: data_block_index_type: 0 2023-12-08T20:31:26.727 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: index_shortening: 1 2023-12-08T20:31:26.727 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-08T20:31:26.727 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: checksum: 4 2023-12-08T20:31:26.727 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: no_block_cache: 0 2023-12-08T20:31:26.728 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache: 0x56065fbdd090 2023-12-08T20:31:26.728 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache_name: BinnedLRUCache 2023-12-08T20:31:26.728 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache_options: 2023-12-08T20:31:26.728 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: capacity : 536870912 2023-12-08T20:31:26.728 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: num_shard_bits : 4 2023-12-08T20:31:26.728 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: strict_capacity_limit : 0 2023-12-08T20:31:26.728 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: high_pri_pool_ratio: 0.000 2023-12-08T20:31:26.728 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache_compressed: (nil) 2023-12-08T20:31:26.728 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: persistent_cache: (nil) 2023-12-08T20:31:26.728 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_size: 4096 2023-12-08T20:31:26.728 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_size_deviation: 10 2023-12-08T20:31:26.728 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_restart_interval: 16 2023-12-08T20:31:26.728 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: index_block_restart_interval: 1 2023-12-08T20:31:26.728 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: metadata_block_size: 4096 2023-12-08T20:31:26.728 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: partition_filters: 0 2023-12-08T20:31:26.729 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: use_delta_encoding: 1 2023-12-08T20:31:26.729 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: filter_policy: bloomfilter 2023-12-08T20:31:26.729 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: whole_key_filtering: 1 2023-12-08T20:31:26.729 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: verify_compression: 0 2023-12-08T20:31:26.729 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: read_amp_bytes_per_bit: 0 2023-12-08T20:31:26.729 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: format_version: 5 2023-12-08T20:31:26.729 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: enable_index_compression: 1 2023-12-08T20:31:26.729 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_align: 0 2023-12-08T20:31:26.729 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: max_auto_readahead_size: 262144 2023-12-08T20:31:26.729 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: prepopulate_block_cache: 0 2023-12-08T20:31:26.729 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: initial_auto_readahead_size: 8192 2023-12-08T20:31:26.729 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: num_file_reads_for_auto_readahead: 2 2023-12-08T20:31:26.729 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.write_buffer_size: 33554432 2023-12-08T20:31:26.729 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_write_buffer_number: 2 2023-12-08T20:31:26.729 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compression: NoCompression 2023-12-08T20:31:26.729 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.bottommost_compression: Disabled 2023-12-08T20:31:26.729 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.prefix_extractor: nullptr 2023-12-08T20:31:26.730 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-08T20:31:26.730 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.num_levels: 7 2023-12-08T20:31:26.730 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-08T20:31:26.730 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-08T20:31:26.730 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-08T20:31:26.730 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-08T20:31:26.730 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-08T20:31:26.730 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-08T20:31:26.731 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-08T20:31:26.731 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-08T20:31:26.731 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-08T20:31:26.731 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-08T20:31:26.732 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-08T20:31:26.732 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-08T20:31:26.732 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-08T20:31:26.732 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compression_opts.level: 32767 2023-12-08T20:31:26.732 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compression_opts.strategy: 0 2023-12-08T20:31:26.732 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-08T20:31:26.732 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-08T20:31:26.733 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-08T20:31:26.733 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-08T20:31:26.733 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compression_opts.enabled: false 2023-12-08T20:31:26.733 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-08T20:31:26.733 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-08T20:31:26.733 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-08T20:31:26.733 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-08T20:31:26.733 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.target_file_size_base: 67108864 2023-12-08T20:31:26.733 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-08T20:31:26.733 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-08T20:31:26.734 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-08T20:31:26.734 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-08T20:31:26.734 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-08T20:31:26.734 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-08T20:31:26.734 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-08T20:31:26.734 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-08T20:31:26.734 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-08T20:31:26.734 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-08T20:31:26.734 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-08T20:31:26.734 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-08T20:31:26.734 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-08T20:31:26.734 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-08T20:31:26.734 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.arena_block_size: 1048576 2023-12-08T20:31:26.734 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-08T20:31:26.735 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-08T20:31:26.735 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.disable_auto_compactions: 0 2023-12-08T20:31:26.735 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-08T20:31:26.735 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-08T20:31:26.735 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-08T20:31:26.735 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-08T20:31:26.735 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-08T20:31:26.735 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-08T20:31:26.735 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-08T20:31:26.735 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-08T20:31:26.735 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-08T20:31:26.735 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-08T20:31:26.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.table_properties_collectors: 2023-12-08T20:31:26.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.inplace_update_support: 0 2023-12-08T20:31:26.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-08T20:31:26.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-08T20:31:26.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-08T20:31:26.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-08T20:31:26.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.bloom_locality: 0 2023-12-08T20:31:26.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.max_successive_merges: 0 2023-12-08T20:31:26.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-08T20:31:26.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.paranoid_file_checks: 0 2023-12-08T20:31:26.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.force_consistency_checks: 1 2023-12-08T20:31:26.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.report_bg_io_stats: 0 2023-12-08T20:31:26.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.ttl: 2592000 2023-12-08T20:31:26.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-08T20:31:26.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-08T20:31:26.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-08T20:31:26.737 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.enable_blob_files: false 2023-12-08T20:31:26.737 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.min_blob_size: 0 2023-12-08T20:31:26.737 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.blob_file_size: 268435456 2023-12-08T20:31:26.737 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-08T20:31:26.737 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-08T20:31:26.737 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-08T20:31:26.737 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-08T20:31:26.737 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-08T20:31:26.737 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.blob_file_starting_level: 0 2023-12-08T20:31:26.737 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-08T20:31:26.737 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2023-12-08T20:31:26.737 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-08T20:31:26.737 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi111/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12892, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-08T20:31:26.737 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2023-12-08T20:31:26.737 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8fcab20a-b7f6-4354-ac24-d4476291bca5 2023-12-08T20:31:26.738 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702067486254093, "job": 1, "event": "recovery_started", "wal_files": [25]} 2023-12-08T20:31:26.738 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2023-12-08T20:31:26.738 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 systemd[1]: Started Ceph mon.smithi111 for 28476818-9607-11ee-95a3-87774f69a715. 2023-12-08T20:31:26.738 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702067486262018, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 1996017, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12887, "largest_seqno": 13705, "table_properties": {"data_size": 1992014, "index_size": 2093, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 901, "raw_key_size": 8537, "raw_average_key_size": 24, "raw_value_size": 1984472, "raw_average_value_size": 5637, "num_data_blocks": 95, "num_entries": 352, "num_filter_entries": 352, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702067486, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8fcab20a-b7f6-4354-ac24-d4476291bca5", "db_session_id": "N3842CVBLTQ3POWYWSN1", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2023-12-08T20:31:26.738 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702067486262117, "job": 1, "event": "recovery_finished"} 2023-12-08T20:31:26.738 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2023-12-08T20:31:26.738 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-08T20:31:26.738 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi111/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-08T20:31:26.738 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56065fc78000 2023-12-08T20:31:26.738 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: DB pointer 0x56065fc64000 2023-12-08T20:31:26.738 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-08T20:31:26.738 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-08T20:31:26.738 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** DB Stats ** 2023-12-08T20:31:26.738 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-08T20:31:26.738 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-08T20:31:26.739 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-08T20:31:26.739 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-08T20:31:26.739 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-08T20:31:26.739 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-08T20:31:26.739 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-08T20:31:26.739 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2023-12-08T20:31:26.739 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** Compaction Stats [default] ** 2023-12-08T20:31:26.739 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-08T20:31:26.739 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-08T20:31:26.739 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: L0 1/0 1.90 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 604.9 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-08T20:31:26.740 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: L6 1/0 6.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-08T20:31:26.740 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Sum 2/0 8.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 604.9 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-08T20:31:26.740 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 604.9 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-08T20:31:26.740 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2023-12-08T20:31:26.740 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** Compaction Stats [default] ** 2023-12-08T20:31:26.740 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-08T20:31:26.740 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-08T20:31:26.740 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 604.9 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-08T20:31:26.740 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2023-12-08T20:31:26.740 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-08T20:31:26.740 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2023-12-08T20:31:26.740 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-08T20:31:26.740 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Flush(GB): cumulative 0.002, interval 0.002 2023-12-08T20:31:26.740 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-08T20:31:26.740 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-08T20:31:26.741 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-08T20:31:26.741 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-08T20:31:26.741 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative compaction: 0.00 GB write, 156.74 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-08T20:31:26.741 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval compaction: 0.00 GB write, 156.74 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-08T20:31:26.741 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-08T20:31:26.741 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Block cache BinnedLRUCache@0x56065fbdd090#6 capacity: 512.00 MB usage: 3.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-12-08T20:31:26.741 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.03 KB,0.000196695%) IndexBlock(1,2.33 KB,0.000444055%) Misc(1,0.00 KB,0%) 2023-12-08T20:31:26.741 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2023-12-08T20:31:26.741 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-08T20:31:26.741 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: starting mon.smithi111 rank 1 at public addrs [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] at bind addrs [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi111 fsid 28476818-9607-11ee-95a3-87774f69a715 2023-12-08T20:31:26.741 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: mon.smithi111@-1(???) e2 preinit fsid 28476818-9607-11ee-95a3-87774f69a715 2023-12-08T20:31:26.741 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: mon.smithi111@-1(???).mds e15 new map 2023-12-08T20:31:26.741 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: mon.smithi111@-1(???).mds e15 print_map 2023-12-08T20:31:26.741 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: e15 2023-12-08T20:31:26.741 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-08T20:31:26.742 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:31:26.742 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: legacy client fscid: 1 2023-12-08T20:31:26.742 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2023-12-08T20:31:26.742 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Filesystem 'cephfs' (1) 2023-12-08T20:31:26.742 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: fs_name cephfs 2023-12-08T20:31:26.742 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: epoch 15 2023-12-08T20:31:26.742 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-08T20:31:26.742 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: created 2023-12-08T20:25:41.527734+0000 2023-12-08T20:31:26.742 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: modified 2023-12-08T20:28:01.721203+0000 2023-12-08T20:31:26.742 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: tableserver 0 2023-12-08T20:31:26.742 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: root 0 2023-12-08T20:31:26.742 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: session_timeout 60 2023-12-08T20:31:26.742 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: session_autoclose 300 2023-12-08T20:31:26.742 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: max_file_size 1099511627776 2023-12-08T20:31:26.742 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: max_xattr_size 65536 2023-12-08T20:31:26.743 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: required_client_features {} 2023-12-08T20:31:26.744 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: last_failure 0 2023-12-08T20:31:26.744 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: last_failure_osd_epoch 0 2023-12-08T20:31:26.744 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:31:26.744 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: max_mds 2 2023-12-08T20:31:26.744 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: in 0,1 2023-12-08T20:31:26.744 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: up {0=14452,1=24315} 2023-12-08T20:31:26.744 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: failed 2023-12-08T20:31:26.744 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: damaged 2023-12-08T20:31:26.744 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: stopped 2023-12-08T20:31:26.744 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: data_pools [3] 2023-12-08T20:31:26.744 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: metadata_pool 2 2023-12-08T20:31:26.744 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: inline_data disabled 2023-12-08T20:31:26.744 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: balancer 2023-12-08T20:31:26.744 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: bal_rank_mask -1 2023-12-08T20:31:26.744 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: standby_count_wanted 1 2023-12-08T20:31:26.745 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: [mds.cephfs.smithi043.pjmszb{0:14452} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.43:6826/441584552,v1:172.21.15.43:6827/441584552] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:31:26.745 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: [mds.cephfs.smithi111.veeegc{1:24315} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.111:6824/1990395192,v1:172.21.15.111:6825/1990395192] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:31:26.745 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2023-12-08T20:31:26.745 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2023-12-08T20:31:26.745 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Standby daemons: 2023-12-08T20:31:26.745 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2023-12-08T20:31:26.745 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: [mds.cephfs.smithi043.akrjef{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.43:6828/2926918083,v1:172.21.15.43:6829/2926918083] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:31:26.745 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: [mds.cephfs.smithi111.svpasm{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6826/2885759138,v1:172.21.15.111:6827/2885759138] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:31:26.745 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: mon.smithi111@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-08T20:31:26.745 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: mon.smithi111@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2023-12-08T20:31:26.745 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: mon.smithi111@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2023-12-08T20:31:26.746 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: mon.smithi111@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2023-12-08T20:31:26.746 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:26 smithi111 ceph-mon[182474]: mon.smithi111@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2023-12-08T20:31:27.949 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:27 smithi043 ceph-mon[219193]: overall HEALTH_OK 2023-12-08T20:31:27.949 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:27 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:31:27.949 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:27 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:31:27.949 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:27 smithi043 ceph-mon[219193]: mon.smithi043 calling monitor election 2023-12-08T20:31:27.949 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:27 smithi043 ceph-mon[219193]: mon.smithi111 calling monitor election 2023-12-08T20:31:27.949 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:27 smithi043 ceph-mon[219193]: mon.smithi043 is new leader, mons smithi043,smithi111 in quorum (ranks 0,1) 2023-12-08T20:31:27.950 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:27 smithi043 ceph-mon[219193]: monmap e3: 2 mons at {smithi043=[v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0],smithi111=[v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-08T20:31:27.950 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:27 smithi043 ceph-mon[219193]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:31:27.950 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:27 smithi043 ceph-mon[219193]: osdmap e50: 6 total, 6 up, 6 in 2023-12-08T20:31:27.950 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:27 smithi043 ceph-mon[219193]: mgrmap e39: smithi043.hqcdcm(active, since 13s), standbys: smithi111.mtcffu 2023-12-08T20:31:28.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:27 smithi111 ceph-mon[182474]: overall HEALTH_OK 2023-12-08T20:31:28.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:27 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi043"}]: dispatch 2023-12-08T20:31:28.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:27 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2023-12-08T20:31:28.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:27 smithi111 ceph-mon[182474]: mon.smithi043 calling monitor election 2023-12-08T20:31:28.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:27 smithi111 ceph-mon[182474]: mon.smithi111 calling monitor election 2023-12-08T20:31:28.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:27 smithi111 ceph-mon[182474]: mon.smithi043 is new leader, mons smithi043,smithi111 in quorum (ranks 0,1) 2023-12-08T20:31:28.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:27 smithi111 ceph-mon[182474]: monmap e3: 2 mons at {smithi043=[v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0],smithi111=[v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-08T20:31:28.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:27 smithi111 ceph-mon[182474]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:31:28.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:27 smithi111 ceph-mon[182474]: osdmap e50: 6 total, 6 up, 6 in 2023-12-08T20:31:28.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:27 smithi111 ceph-mon[182474]: mgrmap e39: smithi043.hqcdcm(active, since 13s), standbys: smithi111.mtcffu 2023-12-08T20:31:28.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:27 smithi111 ceph-mon[182474]: overall HEALTH_OK 2023-12-08T20:31:28.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:27 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:28.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:27 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:28.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:27 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:31:28.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:27 smithi043 ceph-mon[219193]: overall HEALTH_OK 2023-12-08T20:31:28.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:27 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:28.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:27 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:28.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:27 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:31:29.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:28 smithi043 ceph-mon[219193]: pgmap v10: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-08T20:31:29.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:28 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:29.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:28 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:29.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:28 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:31:29.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:28 smithi111 ceph-mon[182474]: pgmap v10: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-08T20:31:29.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:28 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:29.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:28 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:29.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:28 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:31:30.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:30 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:30.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:30 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:30.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:30 smithi111 ceph-mon[182474]: pgmap v11: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-08T20:31:30.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:30 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:30.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:30 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:30.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:30 smithi043 ceph-mon[219193]: pgmap v11: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-08T20:31:33.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:32 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:33.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:32 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:33.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:32 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:33.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:32 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:31:33.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:32 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:33.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:32 smithi111 ceph-mon[182474]: pgmap v12: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-08T20:31:33.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:32 smithi111 ceph-mon[182474]: Reconfiguring mon.smithi043 (monmap changed)... 2023-12-08T20:31:33.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:32 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-08T20:31:33.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:32 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-08T20:31:33.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:32 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:33.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:32 smithi111 ceph-mon[182474]: Reconfiguring daemon mon.smithi043 on smithi043 2023-12-08T20:31:33.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:32 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:33.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:32 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:33.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:32 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:33.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:32 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:31:33.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:32 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:33.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:32 smithi043 ceph-mon[219193]: pgmap v12: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-08T20:31:33.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:32 smithi043 ceph-mon[219193]: Reconfiguring mon.smithi043 (monmap changed)... 2023-12-08T20:31:33.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:32 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-08T20:31:33.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:32 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-08T20:31:33.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:32 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:33.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:32 smithi043 ceph-mon[219193]: Reconfiguring daemon mon.smithi043 on smithi043 2023-12-08T20:31:34.254 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:34 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:34.254 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:34 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:34.254 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:34 smithi043 ceph-mon[219193]: Reconfiguring mgr.smithi043.hqcdcm (monmap changed)... 2023-12-08T20:31:34.255 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:34 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi043.hqcdcm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-08T20:31:34.255 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:34 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-08T20:31:34.255 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:34 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:34.255 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:34 smithi043 ceph-mon[219193]: Reconfiguring daemon mgr.smithi043.hqcdcm on smithi043 2023-12-08T20:31:34.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:34 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:34.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:34 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:34.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:34 smithi111 ceph-mon[182474]: Reconfiguring mgr.smithi043.hqcdcm (monmap changed)... 2023-12-08T20:31:34.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:34 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi043.hqcdcm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-08T20:31:34.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:34 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-08T20:31:34.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:34 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:34.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:34 smithi111 ceph-mon[182474]: Reconfiguring daemon mgr.smithi043.hqcdcm on smithi043 2023-12-08T20:31:34.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.626+0000 7fcf9aaea700 1 -- 172.21.15.43:0/718409133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf940fe5c0 msgr2=0x7fcf94106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:34.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.626+0000 7fcf9aaea700 1 --2- 172.21.15.43:0/718409133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf940fe5c0 0x7fcf94106c90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcf80004970 tx=0x7fcf80009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:34.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.626+0000 7fcf9aaea700 1 -- 172.21.15.43:0/718409133 shutdown_connections 2023-12-08T20:31:34.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.626+0000 7fcf9aaea700 1 --2- 172.21.15.43:0/718409133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf940fe5c0 0x7fcf94106c90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:34.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.626+0000 7fcf9aaea700 1 --2- 172.21.15.43:0/718409133 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf940fdc20 0x7fcf940fdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:34.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.626+0000 7fcf9aaea700 1 -- 172.21.15.43:0/718409133 >> 172.21.15.43:0/718409133 conn(0x7fcf940f76c0 msgr2=0x7fcf940f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:34.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.626+0000 7fcf9aaea700 1 -- 172.21.15.43:0/718409133 shutdown_connections 2023-12-08T20:31:34.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.626+0000 7fcf9aaea700 1 -- 172.21.15.43:0/718409133 wait complete. 2023-12-08T20:31:34.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.627+0000 7fcf9aaea700 1 Processor -- start 2023-12-08T20:31:34.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.627+0000 7fcf9aaea700 1 -- start start 2023-12-08T20:31:34.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.627+0000 7fcf9aaea700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf940fdc20 0x7fcf94113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:34.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.627+0000 7fcf9aaea700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf940fe5c0 0x7fcf94113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:34.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.627+0000 7fcf9aaea700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf941141e0 con 0x7fcf940fe5c0 2023-12-08T20:31:34.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.627+0000 7fcf9aaea700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9410d4d0 con 0x7fcf940fdc20 2023-12-08T20:31:34.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.628+0000 7fcf93fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf940fe5c0 0x7fcf94113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:34.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.628+0000 7fcf93fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf940fe5c0 0x7fcf94113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53982/0 (socket says 172.21.15.43:53982) 2023-12-08T20:31:34.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.628+0000 7fcf93fff700 1 -- 172.21.15.43:0/2355061435 learned_addr learned my addr 172.21.15.43:0/2355061435 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:31:34.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.628+0000 7fcf98886700 1 --2- 172.21.15.43:0/2355061435 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf940fdc20 0x7fcf94113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:34.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.628+0000 7fcf93fff700 1 -- 172.21.15.43:0/2355061435 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf940fdc20 msgr2=0x7fcf94113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:34.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.628+0000 7fcf93fff700 1 --2- 172.21.15.43:0/2355061435 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf940fdc20 0x7fcf94113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:34.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.628+0000 7fcf93fff700 1 -- 172.21.15.43:0/2355061435 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf80005040 con 0x7fcf940fe5c0 2023-12-08T20:31:34.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.628+0000 7fcf93fff700 1 --2- 172.21.15.43:0/2355061435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf940fe5c0 0x7fcf94113b90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009380 tx=0x7fcf80009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:34.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.628+0000 7fcf917fa700 1 -- 172.21.15.43:0/2355061435 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf8000e040 con 0x7fcf940fe5c0 2023-12-08T20:31:34.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.629+0000 7fcf917fa700 1 -- 172.21.15.43:0/2355061435 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcf80004290 con 0x7fcf940fe5c0 2023-12-08T20:31:34.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.629+0000 7fcf917fa700 1 -- 172.21.15.43:0/2355061435 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf8001c3f0 con 0x7fcf940fe5c0 2023-12-08T20:31:34.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.629+0000 7fcf9aaea700 1 -- 172.21.15.43:0/2355061435 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9410d700 con 0x7fcf940fe5c0 2023-12-08T20:31:34.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.629+0000 7fcf9aaea700 1 -- 172.21.15.43:0/2355061435 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9410dc40 con 0x7fcf940fe5c0 2023-12-08T20:31:34.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.630+0000 7fcf9aaea700 1 -- 172.21.15.43:0/2355061435 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf94104350 con 0x7fcf940fe5c0 2023-12-08T20:31:34.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.631+0000 7fcf917fa700 1 -- 172.21.15.43:0/2355061435 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fcf80013420 con 0x7fcf940fe5c0 2023-12-08T20:31:34.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.631+0000 7fcf917fa700 1 --2- 172.21.15.43:0/2355061435 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fcf8406cf80 0x7fcf8406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:34.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.631+0000 7fcf917fa700 1 -- 172.21.15.43:0/2355061435 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fcf8008d770 con 0x7fcf940fe5c0 2023-12-08T20:31:34.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.631+0000 7fcf98886700 1 --2- 172.21.15.43:0/2355061435 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fcf8406cf80 0x7fcf8406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:34.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.632+0000 7fcf98886700 1 --2- 172.21.15.43:0/2355061435 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fcf8406cf80 0x7fcf8406f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcf940f8f30 tx=0x7fcf8800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:34.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.637+0000 7fcf917fa700 1 -- 172.21.15.43:0/2355061435 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fcf8005b030 con 0x7fcf940fe5c0 2023-12-08T20:31:34.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.873+0000 7fcf9aaea700 1 -- 172.21.15.43:0/2355061435 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf941132e0 con 0x7fcf8406cf80 2023-12-08T20:31:34.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.875+0000 7fcf917fa700 1 -- 172.21.15.43:0/2355061435 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fcf941132e0 con 0x7fcf8406cf80 2023-12-08T20:31:34.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.877+0000 7fcf9aaea700 1 -- 172.21.15.43:0/2355061435 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fcf8406cf80 msgr2=0x7fcf8406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:34.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.877+0000 7fcf9aaea700 1 --2- 172.21.15.43:0/2355061435 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fcf8406cf80 0x7fcf8406f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcf940f8f30 tx=0x7fcf8800b040 comp rx=0 tx=0).stop 2023-12-08T20:31:34.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.877+0000 7fcf9aaea700 1 -- 172.21.15.43:0/2355061435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf940fe5c0 msgr2=0x7fcf94113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:34.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.877+0000 7fcf9aaea700 1 --2- 172.21.15.43:0/2355061435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf940fe5c0 0x7fcf94113b90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009380 tx=0x7fcf80009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:34.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.877+0000 7fcf9aaea700 1 -- 172.21.15.43:0/2355061435 shutdown_connections 2023-12-08T20:31:34.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.878+0000 7fcf9aaea700 1 --2- 172.21.15.43:0/2355061435 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fcf8406cf80 0x7fcf8406f430 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:34.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.878+0000 7fcf9aaea700 1 --2- 172.21.15.43:0/2355061435 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf940fdc20 0x7fcf94113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:34.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.878+0000 7fcf9aaea700 1 --2- 172.21.15.43:0/2355061435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf940fe5c0 0x7fcf94113b90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:34.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.878+0000 7fcf9aaea700 1 -- 172.21.15.43:0/2355061435 >> 172.21.15.43:0/2355061435 conn(0x7fcf940f76c0 msgr2=0x7fcf941014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:34.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.878+0000 7fcf9aaea700 1 -- 172.21.15.43:0/2355061435 shutdown_connections 2023-12-08T20:31:34.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.878+0000 7fcf9aaea700 1 -- 172.21.15.43:0/2355061435 wait complete. 2023-12-08T20:31:34.892 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:31:34.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.996+0000 7fbef9624700 1 -- 172.21.15.43:0/1333377189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbef40fdc70 msgr2=0x7fbef40fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:34.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.996+0000 7fbef9624700 1 --2- 172.21.15.43:0/1333377189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbef40fdc70 0x7fbef40fe040 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbee4004940 tx=0x7fbee4009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:34.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.996+0000 7fbef9624700 1 -- 172.21.15.43:0/1333377189 shutdown_connections 2023-12-08T20:31:34.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.996+0000 7fbef9624700 1 --2- 172.21.15.43:0/1333377189 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbef40fe610 0x7fbef4106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:34.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.996+0000 7fbef9624700 1 --2- 172.21.15.43:0/1333377189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbef40fdc70 0x7fbef40fe040 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:34.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.996+0000 7fbef9624700 1 -- 172.21.15.43:0/1333377189 >> 172.21.15.43:0/1333377189 conn(0x7fbef40f76c0 msgr2=0x7fbef40f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:34.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.996+0000 7fbef9624700 1 -- 172.21.15.43:0/1333377189 shutdown_connections 2023-12-08T20:31:34.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.996+0000 7fbef9624700 1 -- 172.21.15.43:0/1333377189 wait complete. 2023-12-08T20:31:35.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.997+0000 7fbef9624700 1 Processor -- start 2023-12-08T20:31:35.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.997+0000 7fbef9624700 1 -- start start 2023-12-08T20:31:35.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.997+0000 7fbef9624700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbef40fdc70 0x7fbef41136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:35.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.997+0000 7fbef9624700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbef40fe610 0x7fbef4113c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:35.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.997+0000 7fbef9624700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef4114290 con 0x7fbef40fdc70 2023-12-08T20:31:35.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.997+0000 7fbef9624700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef410d580 con 0x7fbef40fe610 2023-12-08T20:31:35.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.997+0000 7fbef2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbef40fdc70 0x7fbef41136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:35.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.997+0000 7fbef2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbef40fdc70 0x7fbef41136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53988/0 (socket says 172.21.15.43:53988) 2023-12-08T20:31:35.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.997+0000 7fbef2ffd700 1 -- 172.21.15.43:0/2555922528 learned_addr learned my addr 172.21.15.43:0/2555922528 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:31:35.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.997+0000 7fbef27fc700 1 --2- 172.21.15.43:0/2555922528 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbef40fe610 0x7fbef4113c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:35.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.997+0000 7fbef2ffd700 1 -- 172.21.15.43:0/2555922528 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbef40fe610 msgr2=0x7fbef4113c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:35.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.997+0000 7fbef2ffd700 1 --2- 172.21.15.43:0/2555922528 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbef40fe610 0x7fbef4113c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:35.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.997+0000 7fbef2ffd700 1 -- 172.21.15.43:0/2555922528 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee4005040 con 0x7fbef40fdc70 2023-12-08T20:31:35.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.997+0000 7fbef2ffd700 1 --2- 172.21.15.43:0/2555922528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbef40fdc70 0x7fbef41136c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbee400b3b0 tx=0x7fbee4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:35.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.998+0000 7fbedb7fe700 1 -- 172.21.15.43:0/2555922528 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbee400e040 con 0x7fbef40fdc70 2023-12-08T20:31:35.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.998+0000 7fbedb7fe700 1 -- 172.21.15.43:0/2555922528 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbee4009af0 con 0x7fbef40fdc70 2023-12-08T20:31:35.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.998+0000 7fbef9624700 1 -- 172.21.15.43:0/2555922528 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef410d810 con 0x7fbef40fdc70 2023-12-08T20:31:35.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.998+0000 7fbedb7fe700 1 -- 172.21.15.43:0/2555922528 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbee401c3f0 con 0x7fbef40fdc70 2023-12-08T20:31:35.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.999+0000 7fbef9624700 1 -- 172.21.15.43:0/2555922528 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef410dd50 con 0x7fbef40fdc70 2023-12-08T20:31:35.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:34.999+0000 7fbedb7fe700 1 -- 172.21.15.43:0/2555922528 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fbee4013800 con 0x7fbef40fdc70 2023-12-08T20:31:35.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.000+0000 7fbedb7fe700 1 --2- 172.21.15.43:0/2555922528 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fbedc06cf80 0x7fbedc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:35.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.000+0000 7fbef9624700 1 -- 172.21.15.43:0/2555922528 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef4104260 con 0x7fbef40fdc70 2023-12-08T20:31:35.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.000+0000 7fbedb7fe700 1 -- 172.21.15.43:0/2555922528 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fbee408cfc0 con 0x7fbef40fdc70 2023-12-08T20:31:35.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.000+0000 7fbef27fc700 1 --2- 172.21.15.43:0/2555922528 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fbedc06cf80 0x7fbedc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:35.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.000+0000 7fbef27fc700 1 --2- 172.21.15.43:0/2555922528 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fbedc06cf80 0x7fbedc06f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbef410ef60 tx=0x7fbee800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:35.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.005+0000 7fbedb7fe700 1 -- 172.21.15.43:0/2555922528 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbee4092060 con 0x7fbef40fdc70 2023-12-08T20:31:35.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.238+0000 7fbef9624700 1 -- 172.21.15.43:0/2555922528 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbef410eca0 con 0x7fbedc06cf80 2023-12-08T20:31:35.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.239+0000 7fbedb7fe700 1 -- 172.21.15.43:0/2555922528 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fbef410eca0 con 0x7fbedc06cf80 2023-12-08T20:31:35.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.241+0000 7fbef9624700 1 -- 172.21.15.43:0/2555922528 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fbedc06cf80 msgr2=0x7fbedc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.241+0000 7fbef9624700 1 --2- 172.21.15.43:0/2555922528 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fbedc06cf80 0x7fbedc06f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbef410ef60 tx=0x7fbee800b040 comp rx=0 tx=0).stop 2023-12-08T20:31:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.241+0000 7fbef9624700 1 -- 172.21.15.43:0/2555922528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbef40fdc70 msgr2=0x7fbef41136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.241+0000 7fbef9624700 1 --2- 172.21.15.43:0/2555922528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbef40fdc70 0x7fbef41136c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbee400b3b0 tx=0x7fbee4009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.241+0000 7fbef9624700 1 -- 172.21.15.43:0/2555922528 shutdown_connections 2023-12-08T20:31:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.241+0000 7fbef9624700 1 --2- 172.21.15.43:0/2555922528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbef40fdc70 0x7fbef41136c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.241+0000 7fbef9624700 1 --2- 172.21.15.43:0/2555922528 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fbedc06cf80 0x7fbedc06f430 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.241+0000 7fbef9624700 1 --2- 172.21.15.43:0/2555922528 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbef40fe610 0x7fbef4113c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.241+0000 7fbef9624700 1 -- 172.21.15.43:0/2555922528 >> 172.21.15.43:0/2555922528 conn(0x7fbef40f76c0 msgr2=0x7fbef41013e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.242+0000 7fbef9624700 1 -- 172.21.15.43:0/2555922528 shutdown_connections 2023-12-08T20:31:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.242+0000 7fbef9624700 1 -- 172.21.15.43:0/2555922528 wait complete. 2023-12-08T20:31:35.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.360+0000 7fd10a308700 1 -- 172.21.15.43:0/3372171222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd104101b00 msgr2=0x7fd104101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:35.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.360+0000 7fd10a308700 1 --2- 172.21.15.43:0/3372171222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd104101b00 0x7fd104101ed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4004940 tx=0x7fd0f4009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:35.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.360+0000 7fd10a308700 1 -- 172.21.15.43:0/3372171222 shutdown_connections 2023-12-08T20:31:35.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.360+0000 7fd10a308700 1 --2- 172.21.15.43:0/3372171222 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1040fbb40 0x7fd1040fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:35.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.360+0000 7fd10a308700 1 --2- 172.21.15.43:0/3372171222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd104101b00 0x7fd104101ed0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:35.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.360+0000 7fd10a308700 1 -- 172.21.15.43:0/3372171222 >> 172.21.15.43:0/3372171222 conn(0x7fd1040719b0 msgr2=0x7fd104071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:35.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.360+0000 7fd10a308700 1 -- 172.21.15.43:0/3372171222 shutdown_connections 2023-12-08T20:31:35.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.360+0000 7fd10a308700 1 -- 172.21.15.43:0/3372171222 wait complete. 2023-12-08T20:31:35.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.360+0000 7fd10a308700 1 Processor -- start 2023-12-08T20:31:35.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.361+0000 7fd10a308700 1 -- start start 2023-12-08T20:31:35.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.361+0000 7fd10a308700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1040fbb40 0x7fd1041135c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:35.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.361+0000 7fd10a308700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd104101b00 0x7fd104113b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:35.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.361+0000 7fd10a308700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd104114150 con 0x7fd1040fbb40 2023-12-08T20:31:35.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.361+0000 7fd10a308700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10410d480 con 0x7fd104101b00 2023-12-08T20:31:35.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.361+0000 7fd103fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1040fbb40 0x7fd1041135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:35.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.361+0000 7fd103fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1040fbb40 0x7fd1041135c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54020/0 (socket says 172.21.15.43:54020) 2023-12-08T20:31:35.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.361+0000 7fd103fff700 1 -- 172.21.15.43:0/921942562 learned_addr learned my addr 172.21.15.43:0/921942562 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:31:35.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.361+0000 7fd1037fe700 1 --2- 172.21.15.43:0/921942562 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd104101b00 0x7fd104113b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:35.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.361+0000 7fd103fff700 1 -- 172.21.15.43:0/921942562 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd104101b00 msgr2=0x7fd104113b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:35.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.361+0000 7fd103fff700 1 --2- 172.21.15.43:0/921942562 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd104101b00 0x7fd104113b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:35.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.361+0000 7fd103fff700 1 -- 172.21.15.43:0/921942562 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f4005040 con 0x7fd1040fbb40 2023-12-08T20:31:35.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.362+0000 7fd103fff700 1 --2- 172.21.15.43:0/921942562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1040fbb40 0x7fd1041135c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4000c00 tx=0x7fd0f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:35.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.362+0000 7fd100ff9700 1 -- 172.21.15.43:0/921942562 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0f4021070 con 0x7fd1040fbb40 2023-12-08T20:31:35.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.362+0000 7fd10a308700 1 -- 172.21.15.43:0/921942562 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10410d700 con 0x7fd1040fbb40 2023-12-08T20:31:35.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.362+0000 7fd100ff9700 1 -- 172.21.15.43:0/921942562 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd0f401c400 con 0x7fd1040fbb40 2023-12-08T20:31:35.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.362+0000 7fd100ff9700 1 -- 172.21.15.43:0/921942562 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0f400e070 con 0x7fd1040fbb40 2023-12-08T20:31:35.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.362+0000 7fd10a308700 1 -- 172.21.15.43:0/921942562 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10410dbe0 con 0x7fd1040fbb40 2023-12-08T20:31:35.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.363+0000 7fd10a308700 1 -- 172.21.15.43:0/921942562 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1040734d0 con 0x7fd1040fbb40 2023-12-08T20:31:35.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.364+0000 7fd100ff9700 1 -- 172.21.15.43:0/921942562 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fd0f401c970 con 0x7fd1040fbb40 2023-12-08T20:31:35.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.364+0000 7fd100ff9700 1 --2- 172.21.15.43:0/921942562 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fd0ec06cf80 0x7fd0ec06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:35.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.364+0000 7fd100ff9700 1 -- 172.21.15.43:0/921942562 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd0f408d670 con 0x7fd1040fbb40 2023-12-08T20:31:35.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.364+0000 7fd1037fe700 1 --2- 172.21.15.43:0/921942562 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fd0ec06cf80 0x7fd0ec06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:35.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.365+0000 7fd1037fe700 1 --2- 172.21.15.43:0/921942562 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fd0ec06cf80 0x7fd0ec06f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd10410ee60 tx=0x7fd0f800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:35.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.369+0000 7fd100ff9700 1 -- 172.21.15.43:0/921942562 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd0f405ae30 con 0x7fd1040fbb40 2023-12-08T20:31:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:35 smithi111 ceph-mon[182474]: pgmap v13: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:35 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:35 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:35 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi043", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-08T20:31:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:35 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:35.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:35 smithi043 ceph-mon[219193]: pgmap v13: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:35.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:35 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:35.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:35 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:35.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:35 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi043", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-08T20:31:35.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:35 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:35.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.599+0000 7fd10a308700 1 -- 172.21.15.43:0/921942562 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd10410ec10 con 0x7fd0ec06cf80 2023-12-08T20:31:35.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.611+0000 7fd100ff9700 1 -- 172.21.15.43:0/921942562 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd10410ec10 con 0x7fd0ec06cf80 2023-12-08T20:31:35.615 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-08T20:31:35.615 INFO:teuthology.orchestra.run.smithi043.stdout:alertmanager.smithi043 smithi043 *:9093,9094 running (113s) 17s ago 9m 17.9M - 0.25.0 c8568f914cd2 d4a6cd00c86b 2023-12-08T20:31:35.615 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi043 smithi043 running (9m) 17s ago 9m 7432k - 17.2.7-119-ge2143d99 f761b6e42225 f84d492b732c 2023-12-08T20:31:35.615 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi111 smithi111 running (9m) 6s ago 9m 7428k - 17.2.7-119-ge2143d99 f761b6e42225 88b53685ae54 2023-12-08T20:31:35.615 INFO:teuthology.orchestra.run.smithi043.stdout:grafana.smithi043 smithi043 *:3000 running (98s) 17s ago 9m 83.4M - 9.4.7 954c08fa6188 8f55491a980b 2023-12-08T20:31:35.616 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.akrjef smithi043 running (5m) 17s ago 5m 18.3M - 17.2.7-119-ge2143d99 f761b6e42225 1c0cb8d34ef8 2023-12-08T20:31:35.616 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.pjmszb smithi043 running (5m) 17s ago 5m 7153M - 17.2.7-119-ge2143d99 f761b6e42225 d7eee0c78093 2023-12-08T20:31:35.616 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.svpasm smithi111 running (5m) 6s ago 5m 16.1M - 17.2.7-119-ge2143d99 f761b6e42225 657d4d1cf4b2 2023-12-08T20:31:35.616 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.veeegc smithi111 running (5m) 6s ago 5m 3706M - 17.2.7-119-ge2143d99 f761b6e42225 31f794a388ab 2023-12-08T20:31:35.616 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi043.hqcdcm smithi043 *:8443,9283,8765 running (3m) 17s ago 10m 486M - 19.0.0-44-g9dcc13bb f28f2b94f153 14e91c1dac64 2023-12-08T20:31:35.616 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi111.mtcffu smithi111 *:8443,9283,8765 running (2m) 6s ago 9m 449M - 19.0.0-44-g9dcc13bb f28f2b94f153 56f4290c6db5 2023-12-08T20:31:35.616 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi043 smithi043 running (30s) 17s ago 11m 32.8M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 3597e3a60ebc 2023-12-08T20:31:35.616 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi111 smithi111 running (9s) 6s ago 9m 25.1M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 528aa182165f 2023-12-08T20:31:35.616 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi043 smithi043 *:9100 running (2m) 17s ago 9m 17.0M - 1.5.0 0da6a335fe13 0959b44d9972 2023-12-08T20:31:35.616 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi111 smithi111 *:9100 running (2m) 6s ago 9m 18.3M - 1.5.0 0da6a335fe13 10fe4fdb23d0 2023-12-08T20:31:35.616 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (8m) 17s ago 8m 750M 1570M 17.2.7-119-ge2143d99 f761b6e42225 462eeaf62b2c 2023-12-08T20:31:35.616 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi043 running (8m) 17s ago 8m 858M 1570M 17.2.7-119-ge2143d99 f761b6e42225 dde419c88a89 2023-12-08T20:31:35.616 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi043 running (7m) 17s ago 7m 641M 1570M 17.2.7-119-ge2143d99 f761b6e42225 f7e812026ef5 2023-12-08T20:31:35.616 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi111 running (7m) 6s ago 7m 979M 2592M 17.2.7-119-ge2143d99 f761b6e42225 2a738d30441c 2023-12-08T20:31:35.617 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi111 running (7m) 6s ago 7m 719M 2592M 17.2.7-119-ge2143d99 f761b6e42225 38cdb6a88694 2023-12-08T20:31:35.617 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi111 running (6m) 6s ago 6m 871M 2592M 17.2.7-119-ge2143d99 f761b6e42225 59a9ce8c1141 2023-12-08T20:31:35.617 INFO:teuthology.orchestra.run.smithi043.stdout:prometheus.smithi043 smithi043 *:9095 running (2m) 17s ago 9m 56.7M - 2.43.0 a07b618ecd1d d95914ec88d8 2023-12-08T20:31:35.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.615+0000 7fd10a308700 1 -- 172.21.15.43:0/921942562 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fd0ec06cf80 msgr2=0x7fd0ec06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:35.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.615+0000 7fd10a308700 1 --2- 172.21.15.43:0/921942562 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fd0ec06cf80 0x7fd0ec06f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd10410ee60 tx=0x7fd0f800b040 comp rx=0 tx=0).stop 2023-12-08T20:31:35.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.615+0000 7fd10a308700 1 -- 172.21.15.43:0/921942562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1040fbb40 msgr2=0x7fd1041135c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:35.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.615+0000 7fd10a308700 1 --2- 172.21.15.43:0/921942562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1040fbb40 0x7fd1041135c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4000c00 tx=0x7fd0f4009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:35.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.615+0000 7fd10a308700 1 -- 172.21.15.43:0/921942562 shutdown_connections 2023-12-08T20:31:35.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.615+0000 7fd10a308700 1 --2- 172.21.15.43:0/921942562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1040fbb40 0x7fd1041135c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:35.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.615+0000 7fd10a308700 1 --2- 172.21.15.43:0/921942562 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fd0ec06cf80 0x7fd0ec06f430 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:35.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.615+0000 7fd10a308700 1 --2- 172.21.15.43:0/921942562 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd104101b00 0x7fd104113b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:35.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.615+0000 7fd10a308700 1 -- 172.21.15.43:0/921942562 >> 172.21.15.43:0/921942562 conn(0x7fd1040719b0 msgr2=0x7fd1040653b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:35.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.615+0000 7fd10a308700 1 -- 172.21.15.43:0/921942562 shutdown_connections 2023-12-08T20:31:35.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.615+0000 7fd10a308700 1 -- 172.21.15.43:0/921942562 wait complete. 2023-12-08T20:31:35.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.741+0000 7f22af88f700 1 -- 172.21.15.43:0/4246297214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22a80fe5f0 msgr2=0x7f22a8106c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:35.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.741+0000 7f22af88f700 1 --2- 172.21.15.43:0/4246297214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22a80fe5f0 0x7f22a8106c30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2298004970 tx=0x7f2298009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:35.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.741+0000 7f22af88f700 1 -- 172.21.15.43:0/4246297214 shutdown_connections 2023-12-08T20:31:35.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.741+0000 7f22af88f700 1 --2- 172.21.15.43:0/4246297214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22a80fe5f0 0x7f22a8106c30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:35.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.741+0000 7f22af88f700 1 --2- 172.21.15.43:0/4246297214 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22a80fdc50 0x7f22a80fe020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:35.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.741+0000 7f22af88f700 1 -- 172.21.15.43:0/4246297214 >> 172.21.15.43:0/4246297214 conn(0x7f22a80f76c0 msgr2=0x7f22a80f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:35.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.742+0000 7f22af88f700 1 -- 172.21.15.43:0/4246297214 shutdown_connections 2023-12-08T20:31:35.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.742+0000 7f22af88f700 1 -- 172.21.15.43:0/4246297214 wait complete. 2023-12-08T20:31:35.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.742+0000 7f22af88f700 1 Processor -- start 2023-12-08T20:31:35.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.742+0000 7f22af88f700 1 -- start start 2023-12-08T20:31:35.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.743+0000 7f22af88f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22a80fdc50 0x7f22a8113640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:35.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.743+0000 7f22af88f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22a80fe5f0 0x7f22a8113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:35.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.743+0000 7f22af88f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a8114210 con 0x7f22a80fe5f0 2023-12-08T20:31:35.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.743+0000 7f22af88f700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a810d500 con 0x7f22a80fdc50 2023-12-08T20:31:35.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.743+0000 7f22ace2a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22a80fe5f0 0x7f22a8113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:35.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.743+0000 7f22ace2a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22a80fe5f0 0x7f22a8113bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54028/0 (socket says 172.21.15.43:54028) 2023-12-08T20:31:35.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.743+0000 7f22ace2a700 1 -- 172.21.15.43:0/972977797 learned_addr learned my addr 172.21.15.43:0/972977797 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:31:35.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.743+0000 7f22ad62b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22a80fdc50 0x7f22a8113640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:35.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.743+0000 7f22ace2a700 1 -- 172.21.15.43:0/972977797 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22a80fdc50 msgr2=0x7f22a8113640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:35.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.743+0000 7f22ace2a700 1 --2- 172.21.15.43:0/972977797 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22a80fdc50 0x7f22a8113640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:35.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.743+0000 7f22ace2a700 1 -- 172.21.15.43:0/972977797 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2298005040 con 0x7f22a80fe5f0 2023-12-08T20:31:35.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.743+0000 7f22ace2a700 1 --2- 172.21.15.43:0/972977797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22a80fe5f0 0x7f22a8113bc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2298005010 tx=0x7f2298009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:35.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.744+0000 7f229dffb700 1 -- 172.21.15.43:0/972977797 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f229800e040 con 0x7f22a80fe5f0 2023-12-08T20:31:35.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.744+0000 7f229dffb700 1 -- 172.21.15.43:0/972977797 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2298004290 con 0x7f22a80fe5f0 2023-12-08T20:31:35.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.744+0000 7f22af88f700 1 -- 172.21.15.43:0/972977797 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a810d730 con 0x7f22a80fe5f0 2023-12-08T20:31:35.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.744+0000 7f229dffb700 1 -- 172.21.15.43:0/972977797 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f229801c3f0 con 0x7f22a80fe5f0 2023-12-08T20:31:35.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.744+0000 7f22af88f700 1 -- 172.21.15.43:0/972977797 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a810dc70 con 0x7f22a80fe5f0 2023-12-08T20:31:35.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.745+0000 7f22af88f700 1 -- 172.21.15.43:0/972977797 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a81042f0 con 0x7f22a80fe5f0 2023-12-08T20:31:35.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.746+0000 7f229dffb700 1 -- 172.21.15.43:0/972977797 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f22980136b0 con 0x7f22a80fe5f0 2023-12-08T20:31:35.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.746+0000 7f229dffb700 1 --2- 172.21.15.43:0/972977797 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f229406cf80 0x7f229406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:35.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.746+0000 7f229dffb700 1 -- 172.21.15.43:0/972977797 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f229808d690 con 0x7f22a80fe5f0 2023-12-08T20:31:35.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.746+0000 7f22ad62b700 1 --2- 172.21.15.43:0/972977797 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f229406cf80 0x7f229406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:35.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.747+0000 7f22ad62b700 1 --2- 172.21.15.43:0/972977797 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f229406cf80 0x7f229406f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f22a80f8f30 tx=0x7f22a400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:35.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:35.751+0000 7f229dffb700 1 -- 172.21.15.43:0/972977797 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f229805af50 con 0x7f22a80fe5f0 2023-12-08T20:31:36.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.085+0000 7f22af88f700 1 -- 172.21.15.43:0/972977797 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f22a80fb2c0 con 0x7f22a80fe5f0 2023-12-08T20:31:36.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.085+0000 7f229dffb700 1 -- 172.21.15.43:0/972977797 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+727 (secure 0 0 0) 0x7f229805aae0 con 0x7f22a80fe5f0 2023-12-08T20:31:36.088 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:31:36.088 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": { 2023-12-08T20:31:36.088 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:31:36.088 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:31:36.088 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": { 2023-12-08T20:31:36.089 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:31:36.089 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:31:36.089 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": { 2023-12-08T20:31:36.089 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 6 2023-12-08T20:31:36.089 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:31:36.089 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2023-12-08T20:31:36.089 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-08T20:31:36.089 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:31:36.089 INFO:teuthology.orchestra.run.smithi043.stdout: "overall": { 2023-12-08T20:31:36.089 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 10, 2023-12-08T20:31:36.089 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 4 2023-12-08T20:31:36.089 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-12-08T20:31:36.089 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:31:36.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.088+0000 7f22af88f700 1 -- 172.21.15.43:0/972977797 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f229406cf80 msgr2=0x7f229406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:36.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.088+0000 7f22af88f700 1 --2- 172.21.15.43:0/972977797 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f229406cf80 0x7f229406f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f22a80f8f30 tx=0x7f22a400b040 comp rx=0 tx=0).stop 2023-12-08T20:31:36.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.088+0000 7f22af88f700 1 -- 172.21.15.43:0/972977797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22a80fe5f0 msgr2=0x7f22a8113bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:36.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.088+0000 7f22af88f700 1 --2- 172.21.15.43:0/972977797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22a80fe5f0 0x7f22a8113bc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2298005010 tx=0x7f2298009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:36.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.088+0000 7f22af88f700 1 -- 172.21.15.43:0/972977797 shutdown_connections 2023-12-08T20:31:36.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.088+0000 7f22af88f700 1 --2- 172.21.15.43:0/972977797 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f229406cf80 0x7f229406f430 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:36.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.088+0000 7f22af88f700 1 --2- 172.21.15.43:0/972977797 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22a80fdc50 0x7f22a8113640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:36.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.088+0000 7f22af88f700 1 --2- 172.21.15.43:0/972977797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22a80fe5f0 0x7f22a8113bc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:36.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.088+0000 7f22af88f700 1 -- 172.21.15.43:0/972977797 >> 172.21.15.43:0/972977797 conn(0x7f22a80f76c0 msgr2=0x7f22a8101470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:36.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.088+0000 7f22af88f700 1 -- 172.21.15.43:0/972977797 shutdown_connections 2023-12-08T20:31:36.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.088+0000 7f22af88f700 1 -- 172.21.15.43:0/972977797 wait complete. 2023-12-08T20:31:36.188 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:36 smithi043 ceph-mon[219193]: Reconfiguring crash.smithi043 (monmap changed)... 2023-12-08T20:31:36.189 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:36 smithi043 ceph-mon[219193]: Reconfiguring daemon crash.smithi043 on smithi043 2023-12-08T20:31:36.189 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:36 smithi043 ceph-mon[219193]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:31:36.189 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:36 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:36.189 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:36 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:36.189 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:36 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-08T20:31:36.189 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:36 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:36.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.202+0000 7f6ebaf0d700 1 -- 172.21.15.43:0/756759259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb40fbb40 msgr2=0x7f6eb40fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.202+0000 7f6ebaf0d700 1 --2- 172.21.15.43:0/756759259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb40fbb40 0x7f6eb40fbfb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8004940 tx=0x7f6ea8009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.203+0000 7f6ebaf0d700 1 -- 172.21.15.43:0/756759259 shutdown_connections 2023-12-08T20:31:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.203+0000 7f6ebaf0d700 1 --2- 172.21.15.43:0/756759259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb40fbb40 0x7f6eb40fbfb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.203+0000 7f6ebaf0d700 1 --2- 172.21.15.43:0/756759259 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6eb4101b00 0x7f6eb4101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.203+0000 7f6ebaf0d700 1 -- 172.21.15.43:0/756759259 >> 172.21.15.43:0/756759259 conn(0x7f6eb40719b0 msgr2=0x7f6eb4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.203+0000 7f6ebaf0d700 1 -- 172.21.15.43:0/756759259 shutdown_connections 2023-12-08T20:31:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.203+0000 7f6ebaf0d700 1 -- 172.21.15.43:0/756759259 wait complete. 2023-12-08T20:31:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.203+0000 7f6ebaf0d700 1 Processor -- start 2023-12-08T20:31:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.203+0000 7f6ebaf0d700 1 -- start start 2023-12-08T20:31:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.204+0000 7f6ebaf0d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6eb40fbb40 0x7f6eb4113620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.204+0000 7f6ebaf0d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb4101b00 0x7f6eb4113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.204+0000 7f6ebaf0d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb41141f0 con 0x7f6eb4101b00 2023-12-08T20:31:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.204+0000 7f6ebaf0d700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb410d4e0 con 0x7f6eb40fbb40 2023-12-08T20:31:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.204+0000 7f6eb3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb4101b00 0x7f6eb4113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:36.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.204+0000 7f6eb3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb4101b00 0x7f6eb4113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54048/0 (socket says 172.21.15.43:54048) 2023-12-08T20:31:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.204+0000 7f6eb3fff700 1 -- 172.21.15.43:0/2025228800 learned_addr learned my addr 172.21.15.43:0/2025228800 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:31:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.204+0000 7f6eb8ca9700 1 --2- 172.21.15.43:0/2025228800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6eb40fbb40 0x7f6eb4113620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.204+0000 7f6eb3fff700 1 -- 172.21.15.43:0/2025228800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6eb40fbb40 msgr2=0x7f6eb4113620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.204+0000 7f6eb3fff700 1 --2- 172.21.15.43:0/2025228800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6eb40fbb40 0x7f6eb4113620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.204+0000 7f6eb3fff700 1 -- 172.21.15.43:0/2025228800 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea8005040 con 0x7f6eb4101b00 2023-12-08T20:31:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.204+0000 7f6eb8ca9700 1 --2- 172.21.15.43:0/2025228800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6eb40fbb40 0x7f6eb4113620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:31:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.204+0000 7f6eb3fff700 1 --2- 172.21.15.43:0/2025228800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb4101b00 0x7f6eb4113ba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8008d80 tx=0x7f6ea8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.204+0000 7f6eb17fa700 1 -- 172.21.15.43:0/2025228800 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ea800e030 con 0x7f6eb4101b00 2023-12-08T20:31:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.205+0000 7f6eb17fa700 1 -- 172.21.15.43:0/2025228800 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ea8004290 con 0x7f6eb4101b00 2023-12-08T20:31:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.205+0000 7f6ebaf0d700 1 -- 172.21.15.43:0/2025228800 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb410d710 con 0x7f6eb4101b00 2023-12-08T20:31:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.205+0000 7f6eb17fa700 1 -- 172.21.15.43:0/2025228800 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ea801ce60 con 0x7f6eb4101b00 2023-12-08T20:31:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.205+0000 7f6ebaf0d700 1 -- 172.21.15.43:0/2025228800 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb410dc50 con 0x7f6eb4101b00 2023-12-08T20:31:36.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.206+0000 7f6ebaf0d700 1 -- 172.21.15.43:0/2025228800 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb40734d0 con 0x7f6eb4101b00 2023-12-08T20:31:36.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.206+0000 7f6eb17fa700 1 -- 172.21.15.43:0/2025228800 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f6ea801c690 con 0x7f6eb4101b00 2023-12-08T20:31:36.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.207+0000 7f6eb17fa700 1 --2- 172.21.15.43:0/2025228800 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f6e9c06cf10 0x7f6e9c06f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:36.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.207+0000 7f6eb17fa700 1 -- 172.21.15.43:0/2025228800 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f6ea808de80 con 0x7f6eb4101b00 2023-12-08T20:31:36.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.207+0000 7f6eb8ca9700 1 --2- 172.21.15.43:0/2025228800 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f6e9c06cf10 0x7f6e9c06f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:36.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.207+0000 7f6eb8ca9700 1 --2- 172.21.15.43:0/2025228800 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f6e9c06cf10 0x7f6e9c06f3c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40fb990 tx=0x7f6ea400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:36.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.212+0000 7f6eb17fa700 1 -- 172.21.15.43:0/2025228800 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6ea805b6a0 con 0x7f6eb4101b00 2023-12-08T20:31:36.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:36 smithi111 ceph-mon[182474]: Reconfiguring crash.smithi043 (monmap changed)... 2023-12-08T20:31:36.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:36 smithi111 ceph-mon[182474]: Reconfiguring daemon crash.smithi043 on smithi043 2023-12-08T20:31:36.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:36 smithi111 ceph-mon[182474]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:31:36.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:36 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:36.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:36 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:36.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:36 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-08T20:31:36.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:36 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:36.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.468+0000 7f6ebaf0d700 1 -- 172.21.15.43:0/2025228800 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6eb4108ab0 con 0x7f6eb4101b00 2023-12-08T20:31:36.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.468+0000 7f6eb17fa700 1 -- 172.21.15.43:0/2025228800 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1889 (secure 0 0 0) 0x7f6ea805b230 con 0x7f6eb4101b00 2023-12-08T20:31:36.471 INFO:teuthology.orchestra.run.smithi043.stdout:e15 2023-12-08T20:31:36.471 INFO:teuthology.orchestra.run.smithi043.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-08T20:31:36.471 INFO:teuthology.orchestra.run.smithi043.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:31:36.471 INFO:teuthology.orchestra.run.smithi043.stdout:legacy client fscid: 1 2023-12-08T20:31:36.471 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:31:36.471 INFO:teuthology.orchestra.run.smithi043.stdout:Filesystem 'cephfs' (1) 2023-12-08T20:31:36.471 INFO:teuthology.orchestra.run.smithi043.stdout:fs_name cephfs 2023-12-08T20:31:36.472 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 15 2023-12-08T20:31:36.472 INFO:teuthology.orchestra.run.smithi043.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-08T20:31:36.472 INFO:teuthology.orchestra.run.smithi043.stdout:created 2023-12-08T20:25:41.527734+0000 2023-12-08T20:31:36.472 INFO:teuthology.orchestra.run.smithi043.stdout:modified 2023-12-08T20:28:01.721203+0000 2023-12-08T20:31:36.472 INFO:teuthology.orchestra.run.smithi043.stdout:tableserver 0 2023-12-08T20:31:36.472 INFO:teuthology.orchestra.run.smithi043.stdout:root 0 2023-12-08T20:31:36.472 INFO:teuthology.orchestra.run.smithi043.stdout:session_timeout 60 2023-12-08T20:31:36.472 INFO:teuthology.orchestra.run.smithi043.stdout:session_autoclose 300 2023-12-08T20:31:36.472 INFO:teuthology.orchestra.run.smithi043.stdout:max_file_size 1099511627776 2023-12-08T20:31:36.472 INFO:teuthology.orchestra.run.smithi043.stdout:max_xattr_size 65536 2023-12-08T20:31:36.472 INFO:teuthology.orchestra.run.smithi043.stdout:required_client_features {} 2023-12-08T20:31:36.472 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure 0 2023-12-08T20:31:36.472 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure_osd_epoch 0 2023-12-08T20:31:36.472 INFO:teuthology.orchestra.run.smithi043.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:31:36.472 INFO:teuthology.orchestra.run.smithi043.stdout:max_mds 2 2023-12-08T20:31:36.472 INFO:teuthology.orchestra.run.smithi043.stdout:in 0,1 2023-12-08T20:31:36.472 INFO:teuthology.orchestra.run.smithi043.stdout:up {0=14452,1=24315} 2023-12-08T20:31:36.473 INFO:teuthology.orchestra.run.smithi043.stdout:failed 2023-12-08T20:31:36.473 INFO:teuthology.orchestra.run.smithi043.stdout:damaged 2023-12-08T20:31:36.473 INFO:teuthology.orchestra.run.smithi043.stdout:stopped 2023-12-08T20:31:36.473 INFO:teuthology.orchestra.run.smithi043.stdout:data_pools [3] 2023-12-08T20:31:36.473 INFO:teuthology.orchestra.run.smithi043.stdout:metadata_pool 2 2023-12-08T20:31:36.473 INFO:teuthology.orchestra.run.smithi043.stdout:inline_data disabled 2023-12-08T20:31:36.473 INFO:teuthology.orchestra.run.smithi043.stdout:balancer 2023-12-08T20:31:36.473 INFO:teuthology.orchestra.run.smithi043.stdout:bal_rank_mask -1 2023-12-08T20:31:36.473 INFO:teuthology.orchestra.run.smithi043.stdout:standby_count_wanted 1 2023-12-08T20:31:36.473 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi043.pjmszb{0:14452} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.43:6826/441584552,v1:172.21.15.43:6827/441584552] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:31:36.473 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi111.veeegc{1:24315} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.111:6824/1990395192,v1:172.21.15.111:6825/1990395192] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:31:36.473 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:31:36.473 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:31:36.473 INFO:teuthology.orchestra.run.smithi043.stdout:Standby daemons: 2023-12-08T20:31:36.473 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:31:36.473 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi043.akrjef{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.43:6828/2926918083,v1:172.21.15.43:6829/2926918083] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:31:36.474 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi111.svpasm{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6826/2885759138,v1:172.21.15.111:6827/2885759138] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:31:36.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.471+0000 7f6ebaf0d700 1 -- 172.21.15.43:0/2025228800 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f6e9c06cf10 msgr2=0x7f6e9c06f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:36.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.471+0000 7f6ebaf0d700 1 --2- 172.21.15.43:0/2025228800 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f6e9c06cf10 0x7f6e9c06f3c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40fb990 tx=0x7f6ea400b040 comp rx=0 tx=0).stop 2023-12-08T20:31:36.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.471+0000 7f6ebaf0d700 1 -- 172.21.15.43:0/2025228800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb4101b00 msgr2=0x7f6eb4113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:36.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.471+0000 7f6ebaf0d700 1 --2- 172.21.15.43:0/2025228800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb4101b00 0x7f6eb4113ba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8008d80 tx=0x7f6ea8009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:36.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.471+0000 7f6ebaf0d700 1 -- 172.21.15.43:0/2025228800 shutdown_connections 2023-12-08T20:31:36.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.471+0000 7f6ebaf0d700 1 --2- 172.21.15.43:0/2025228800 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f6e9c06cf10 0x7f6e9c06f3c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:36.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.471+0000 7f6ebaf0d700 1 --2- 172.21.15.43:0/2025228800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6eb40fbb40 0x7f6eb4113620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:36.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.471+0000 7f6ebaf0d700 1 --2- 172.21.15.43:0/2025228800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb4101b00 0x7f6eb4113ba0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:36.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.471+0000 7f6ebaf0d700 1 -- 172.21.15.43:0/2025228800 >> 172.21.15.43:0/2025228800 conn(0x7f6eb40719b0 msgr2=0x7f6eb40653b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:36.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.471+0000 7f6ebaf0d700 1 -- 172.21.15.43:0/2025228800 shutdown_connections 2023-12-08T20:31:36.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.471+0000 7f6ebaf0d700 1 -- 172.21.15.43:0/2025228800 wait complete. 2023-12-08T20:31:36.476 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 15 2023-12-08T20:31:36.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.600+0000 7f2ebae62700 1 -- 172.21.15.43:0/2322901942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb40fb1e0 msgr2=0x7f2eb40fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:36.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.600+0000 7f2ebae62700 1 --2- 172.21.15.43:0/2322901942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb40fb1e0 0x7f2eb40fb630 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8004940 tx=0x7f2ea8009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:36.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.600+0000 7f2ebae62700 1 -- 172.21.15.43:0/2322901942 shutdown_connections 2023-12-08T20:31:36.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.600+0000 7f2ebae62700 1 --2- 172.21.15.43:0/2322901942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb40fb1e0 0x7f2eb40fb630 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:36.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.600+0000 7f2ebae62700 1 --2- 172.21.15.43:0/2322901942 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2eb4102c70 0x7f2eb4103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:36.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.600+0000 7f2ebae62700 1 -- 172.21.15.43:0/2322901942 >> 172.21.15.43:0/2322901942 conn(0x7f2eb40711a0 msgr2=0x7f2eb40715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:36.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.601+0000 7f2ebae62700 1 -- 172.21.15.43:0/2322901942 shutdown_connections 2023-12-08T20:31:36.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.601+0000 7f2ebae62700 1 -- 172.21.15.43:0/2322901942 wait complete. 2023-12-08T20:31:36.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.601+0000 7f2ebae62700 1 Processor -- start 2023-12-08T20:31:36.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.601+0000 7f2ebae62700 1 -- start start 2023-12-08T20:31:36.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.602+0000 7f2ebae62700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2eb40fb1e0 0x7f2eb4113560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:36.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.602+0000 7f2ebae62700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb4102c70 0x7f2eb4113aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:36.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.602+0000 7f2ebae62700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb41140f0 con 0x7f2eb4102c70 2023-12-08T20:31:36.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.602+0000 7f2ebae62700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb410d420 con 0x7f2eb40fb1e0 2023-12-08T20:31:36.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.602+0000 7f2eb3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb4102c70 0x7f2eb4113aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:36.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.602+0000 7f2eb3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb4102c70 0x7f2eb4113aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54064/0 (socket says 172.21.15.43:54064) 2023-12-08T20:31:36.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.602+0000 7f2eb3fff700 1 -- 172.21.15.43:0/4248363799 learned_addr learned my addr 172.21.15.43:0/4248363799 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:31:36.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.602+0000 7f2eb8bfe700 1 --2- 172.21.15.43:0/4248363799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2eb40fb1e0 0x7f2eb4113560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:36.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.602+0000 7f2eb3fff700 1 -- 172.21.15.43:0/4248363799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2eb40fb1e0 msgr2=0x7f2eb4113560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:36.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.602+0000 7f2eb3fff700 1 --2- 172.21.15.43:0/4248363799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2eb40fb1e0 0x7f2eb4113560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:36.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.602+0000 7f2eb3fff700 1 -- 172.21.15.43:0/4248363799 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea8005040 con 0x7f2eb4102c70 2023-12-08T20:31:36.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.602+0000 7f2eb8bfe700 1 --2- 172.21.15.43:0/4248363799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2eb40fb1e0 0x7f2eb4113560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:31:36.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.602+0000 7f2eb3fff700 1 --2- 172.21.15.43:0/4248363799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb4102c70 0x7f2eb4113aa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8008d80 tx=0x7f2ea8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:36.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.603+0000 7f2eb17fa700 1 -- 172.21.15.43:0/4248363799 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ea800e030 con 0x7f2eb4102c70 2023-12-08T20:31:36.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.603+0000 7f2eb17fa700 1 -- 172.21.15.43:0/4248363799 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ea8004290 con 0x7f2eb4102c70 2023-12-08T20:31:36.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.603+0000 7f2eb17fa700 1 -- 172.21.15.43:0/4248363799 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ea801ce60 con 0x7f2eb4102c70 2023-12-08T20:31:36.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.603+0000 7f2ebae62700 1 -- 172.21.15.43:0/4248363799 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb410d6a0 con 0x7f2eb4102c70 2023-12-08T20:31:36.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.603+0000 7f2ebae62700 1 -- 172.21.15.43:0/4248363799 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb410db90 con 0x7f2eb4102c70 2023-12-08T20:31:36.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.604+0000 7f2eb17fa700 1 -- 172.21.15.43:0/4248363799 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f2ea801c690 con 0x7f2eb4102c70 2023-12-08T20:31:36.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.605+0000 7f2ebae62700 1 -- 172.21.15.43:0/4248363799 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb4105050 con 0x7f2eb4102c70 2023-12-08T20:31:36.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.605+0000 7f2eb17fa700 1 --2- 172.21.15.43:0/4248363799 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f2e9c06cf10 0x7f2e9c06f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:36.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.605+0000 7f2eb17fa700 1 -- 172.21.15.43:0/4248363799 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f2ea808de80 con 0x7f2eb4102c70 2023-12-08T20:31:36.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.607+0000 7f2eb8bfe700 1 --2- 172.21.15.43:0/4248363799 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f2e9c06cf10 0x7f2e9c06f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:36.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.607+0000 7f2eb8bfe700 1 --2- 172.21.15.43:0/4248363799 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f2e9c06cf10 0x7f2e9c06f3c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4004600 tx=0x7f2ea400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:36.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.611+0000 7f2eb17fa700 1 -- 172.21.15.43:0/4248363799 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2ea805b6a0 con 0x7f2eb4102c70 2023-12-08T20:31:36.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.877+0000 7f2ebae62700 1 -- 172.21.15.43:0/4248363799 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2eb4113230 con 0x7f2e9c06cf10 2023-12-08T20:31:36.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.878+0000 7f2eb17fa700 1 -- 172.21.15.43:0/4248363799 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f2eb4113230 con 0x7f2e9c06cf10 2023-12-08T20:31:36.881 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:31:36.881 INFO:teuthology.orchestra.run.smithi043.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-08T20:31:36.881 INFO:teuthology.orchestra.run.smithi043.stdout: "in_progress": true, 2023-12-08T20:31:36.881 INFO:teuthology.orchestra.run.smithi043.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-08T20:31:36.881 INFO:teuthology.orchestra.run.smithi043.stdout: "services_complete": [ 2023-12-08T20:31:36.881 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr", 2023-12-08T20:31:36.881 INFO:teuthology.orchestra.run.smithi043.stdout: "mon" 2023-12-08T20:31:36.881 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2023-12-08T20:31:36.881 INFO:teuthology.orchestra.run.smithi043.stdout: "progress": "4/21 daemons upgraded", 2023-12-08T20:31:36.881 INFO:teuthology.orchestra.run.smithi043.stdout: "message": "Currently upgrading mon daemons", 2023-12-08T20:31:36.881 INFO:teuthology.orchestra.run.smithi043.stdout: "is_paused": false 2023-12-08T20:31:36.881 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:31:36.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.880+0000 7f2ebae62700 1 -- 172.21.15.43:0/4248363799 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f2e9c06cf10 msgr2=0x7f2e9c06f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:36.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.880+0000 7f2ebae62700 1 --2- 172.21.15.43:0/4248363799 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f2e9c06cf10 0x7f2e9c06f3c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4004600 tx=0x7f2ea400b040 comp rx=0 tx=0).stop 2023-12-08T20:31:36.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.880+0000 7f2ebae62700 1 -- 172.21.15.43:0/4248363799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb4102c70 msgr2=0x7f2eb4113aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:36.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.880+0000 7f2ebae62700 1 --2- 172.21.15.43:0/4248363799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb4102c70 0x7f2eb4113aa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8008d80 tx=0x7f2ea8009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:36.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.881+0000 7f2ebae62700 1 -- 172.21.15.43:0/4248363799 shutdown_connections 2023-12-08T20:31:36.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.881+0000 7f2ebae62700 1 --2- 172.21.15.43:0/4248363799 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f2e9c06cf10 0x7f2e9c06f3c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:36.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.881+0000 7f2ebae62700 1 --2- 172.21.15.43:0/4248363799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2eb40fb1e0 0x7f2eb4113560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:36.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.881+0000 7f2ebae62700 1 --2- 172.21.15.43:0/4248363799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2eb4102c70 0x7f2eb4113aa0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:36.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.881+0000 7f2ebae62700 1 -- 172.21.15.43:0/4248363799 >> 172.21.15.43:0/4248363799 conn(0x7f2eb40711a0 msgr2=0x7f2eb40fa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:36.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.881+0000 7f2ebae62700 1 -- 172.21.15.43:0/4248363799 shutdown_connections 2023-12-08T20:31:36.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.881+0000 7f2ebae62700 1 -- 172.21.15.43:0/4248363799 wait complete. 2023-12-08T20:31:37.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.999+0000 7f5713c4d700 1 -- 172.21.15.43:0/3792921495 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f570c0fbb30 msgr2=0x7f570c0fbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:37.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.999+0000 7f5713c4d700 1 --2- 172.21.15.43:0/3792921495 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f570c0fbb30 0x7f570c0fbfa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f56fc004940 tx=0x7f56fc009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:37.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.999+0000 7f5713c4d700 1 -- 172.21.15.43:0/3792921495 shutdown_connections 2023-12-08T20:31:37.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.999+0000 7f5713c4d700 1 --2- 172.21.15.43:0/3792921495 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f570c0fbb30 0x7f570c0fbfa0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:37.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.999+0000 7f5713c4d700 1 --2- 172.21.15.43:0/3792921495 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f570c101af0 0x7f570c101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:37.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.999+0000 7f5713c4d700 1 -- 172.21.15.43:0/3792921495 >> 172.21.15.43:0/3792921495 conn(0x7f570c0f7690 msgr2=0x7f570c0f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:37.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.999+0000 7f5713c4d700 1 -- 172.21.15.43:0/3792921495 shutdown_connections 2023-12-08T20:31:37.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:36.999+0000 7f5713c4d700 1 -- 172.21.15.43:0/3792921495 wait complete. 2023-12-08T20:31:37.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.000+0000 7f5713c4d700 1 Processor -- start 2023-12-08T20:31:37.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.000+0000 7f5713c4d700 1 -- start start 2023-12-08T20:31:37.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.000+0000 7f5713c4d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f570c0fbb30 0x7f570c113650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:37.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.000+0000 7f5713c4d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f570c101af0 0x7f570c113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:37.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.000+0000 7f5713c4d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570c1141e0 con 0x7f570c101af0 2023-12-08T20:31:37.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.000+0000 7f5713c4d700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570c10d4d0 con 0x7f570c0fbb30 2023-12-08T20:31:37.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.000+0000 7f57111e8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f570c101af0 0x7f570c113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:37.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.000+0000 7f57111e8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f570c101af0 0x7f570c113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54074/0 (socket says 172.21.15.43:54074) 2023-12-08T20:31:37.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.000+0000 7f57111e8700 1 -- 172.21.15.43:0/49663028 learned_addr learned my addr 172.21.15.43:0/49663028 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:31:37.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.000+0000 7f57119e9700 1 --2- 172.21.15.43:0/49663028 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f570c0fbb30 0x7f570c113650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:37.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.001+0000 7f57111e8700 1 -- 172.21.15.43:0/49663028 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f570c0fbb30 msgr2=0x7f570c113650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:37.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.001+0000 7f57111e8700 1 --2- 172.21.15.43:0/49663028 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f570c0fbb30 0x7f570c113650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:37.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.001+0000 7f57111e8700 1 -- 172.21.15.43:0/49663028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56fc005040 con 0x7f570c101af0 2023-12-08T20:31:37.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.001+0000 7f57111e8700 1 --2- 172.21.15.43:0/49663028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f570c101af0 0x7f570c113b90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f56fc000c00 tx=0x7f56fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:37.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.001+0000 7f57027fc700 1 -- 172.21.15.43:0/49663028 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56fc021070 con 0x7f570c101af0 2023-12-08T20:31:37.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.001+0000 7f57027fc700 1 -- 172.21.15.43:0/49663028 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f56fc01c400 con 0x7f570c101af0 2023-12-08T20:31:37.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.001+0000 7f5713c4d700 1 -- 172.21.15.43:0/49663028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f570c10d750 con 0x7f570c101af0 2023-12-08T20:31:37.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.001+0000 7f5713c4d700 1 -- 172.21.15.43:0/49663028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f570c10dc90 con 0x7f570c101af0 2023-12-08T20:31:37.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.001+0000 7f57027fc700 1 -- 172.21.15.43:0/49663028 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56fc00e070 con 0x7f570c101af0 2023-12-08T20:31:37.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.002+0000 7f5713c4d700 1 -- 172.21.15.43:0/49663028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f00052e0 con 0x7f570c101af0 2023-12-08T20:31:37.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.003+0000 7f57027fc700 1 -- 172.21.15.43:0/49663028 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f56fc013a30 con 0x7f570c101af0 2023-12-08T20:31:37.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.004+0000 7f57027fc700 1 --2- 172.21.15.43:0/49663028 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f56f806cf80 0x7f56f806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:31:37.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.004+0000 7f57027fc700 1 -- 172.21.15.43:0/49663028 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f56fc08dcd0 con 0x7f570c101af0 2023-12-08T20:31:37.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.004+0000 7f57119e9700 1 --2- 172.21.15.43:0/49663028 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f56f806cf80 0x7f56f806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:31:37.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.005+0000 7f57119e9700 1 --2- 172.21.15.43:0/49663028 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f56f806cf80 0x7f56f806f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5708009b80 tx=0x7f570800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:31:37.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.008+0000 7f57027fc700 1 -- 172.21.15.43:0/49663028 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f56fc05b4d0 con 0x7f570c101af0 2023-12-08T20:31:37.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:37 smithi043 ceph-mon[219193]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:31:37.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:37 smithi043 ceph-mon[219193]: Reconfiguring osd.0 (monmap changed)... 2023-12-08T20:31:37.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:37 smithi043 ceph-mon[219193]: Reconfiguring daemon osd.0 on smithi043 2023-12-08T20:31:37.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:37 smithi043 ceph-mon[219193]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:31:37.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:37 smithi043 ceph-mon[219193]: pgmap v14: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:37.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:37 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/972977797' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:31:37.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:37 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/2025228800' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-08T20:31:37.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:37 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:37.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:37 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:37.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:37 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-08T20:31:37.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:37 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:37.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.325+0000 7f5713c4d700 1 -- 172.21.15.43:0/49663028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f56f0005860 con 0x7f570c101af0 2023-12-08T20:31:37.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.325+0000 7f57027fc700 1 -- 172.21.15.43:0/49663028 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f56fc05b060 con 0x7f570c101af0 2023-12-08T20:31:37.328 INFO:teuthology.orchestra.run.smithi043.stdout:HEALTH_OK 2023-12-08T20:31:37.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.327+0000 7f5713c4d700 1 -- 172.21.15.43:0/49663028 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f56f806cf80 msgr2=0x7f56f806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:37.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.327+0000 7f5713c4d700 1 --2- 172.21.15.43:0/49663028 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f56f806cf80 0x7f56f806f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5708009b80 tx=0x7f570800b040 comp rx=0 tx=0).stop 2023-12-08T20:31:37.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.327+0000 7f5713c4d700 1 -- 172.21.15.43:0/49663028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f570c101af0 msgr2=0x7f570c113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:31:37.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.327+0000 7f5713c4d700 1 --2- 172.21.15.43:0/49663028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f570c101af0 0x7f570c113b90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f56fc000c00 tx=0x7f56fc009e30 comp rx=0 tx=0).stop 2023-12-08T20:31:37.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.328+0000 7f5713c4d700 1 -- 172.21.15.43:0/49663028 shutdown_connections 2023-12-08T20:31:37.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.328+0000 7f5713c4d700 1 --2- 172.21.15.43:0/49663028 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f56f806cf80 0x7f56f806f430 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:37.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.328+0000 7f5713c4d700 1 --2- 172.21.15.43:0/49663028 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f570c0fbb30 0x7f570c113650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:37.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.328+0000 7f5713c4d700 1 --2- 172.21.15.43:0/49663028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f570c101af0 0x7f570c113b90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:31:37.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.328+0000 7f5713c4d700 1 -- 172.21.15.43:0/49663028 >> 172.21.15.43:0/49663028 conn(0x7f570c0f7690 msgr2=0x7f570c0ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:31:37.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.328+0000 7f5713c4d700 1 -- 172.21.15.43:0/49663028 shutdown_connections 2023-12-08T20:31:37.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:31:37.328+0000 7f5713c4d700 1 -- 172.21.15.43:0/49663028 wait complete. 2023-12-08T20:31:37.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:37 smithi111 ceph-mon[182474]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:31:37.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:37 smithi111 ceph-mon[182474]: Reconfiguring osd.0 (monmap changed)... 2023-12-08T20:31:37.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:37 smithi111 ceph-mon[182474]: Reconfiguring daemon osd.0 on smithi043 2023-12-08T20:31:37.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:37 smithi111 ceph-mon[182474]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:31:37.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:37 smithi111 ceph-mon[182474]: pgmap v14: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:37.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:37 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/972977797' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:31:37.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:37 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/2025228800' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-08T20:31:37.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:37 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:37.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:37 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:37.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:37 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-08T20:31:37.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:37 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:38.447 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:38 smithi043 ceph-mon[219193]: Reconfiguring osd.1 (monmap changed)... 2023-12-08T20:31:38.447 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:38 smithi043 ceph-mon[219193]: Reconfiguring daemon osd.1 on smithi043 2023-12-08T20:31:38.447 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:38 smithi043 ceph-mon[219193]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:31:38.447 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:38 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/49663028' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-08T20:31:38.447 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:38 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:38.447 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:38 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:38.447 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:38 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-08T20:31:38.448 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:38 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:38.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:38 smithi111 ceph-mon[182474]: Reconfiguring osd.1 (monmap changed)... 2023-12-08T20:31:38.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:38 smithi111 ceph-mon[182474]: Reconfiguring daemon osd.1 on smithi043 2023-12-08T20:31:38.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:38 smithi111 ceph-mon[182474]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:31:38.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:38 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/49663028' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-08T20:31:38.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:38 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:38.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:38 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:38.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:38 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-08T20:31:38.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:38 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:39.454 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:39 smithi043 ceph-mon[219193]: Reconfiguring osd.2 (monmap changed)... 2023-12-08T20:31:39.455 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:39 smithi043 ceph-mon[219193]: Reconfiguring daemon osd.2 on smithi043 2023-12-08T20:31:39.455 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:39 smithi043 ceph-mon[219193]: pgmap v15: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:39.455 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:39 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:39.455 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:39 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:39.455 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:39 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi043.pjmszb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-08T20:31:39.455 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:39 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:39.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:39 smithi111 ceph-mon[182474]: Reconfiguring osd.2 (monmap changed)... 2023-12-08T20:31:39.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:39 smithi111 ceph-mon[182474]: Reconfiguring daemon osd.2 on smithi043 2023-12-08T20:31:39.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:39 smithi111 ceph-mon[182474]: pgmap v15: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:39.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:39 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:39.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:39 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:39.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:39 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi043.pjmszb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-08T20:31:39.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:39 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:40.353 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:40 smithi043 ceph-mon[219193]: Reconfiguring mds.cephfs.smithi043.pjmszb (monmap changed)... 2023-12-08T20:31:40.353 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:40 smithi043 ceph-mon[219193]: Reconfiguring daemon mds.cephfs.smithi043.pjmszb on smithi043 2023-12-08T20:31:40.353 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:40 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:40.353 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:40 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:40.354 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:40 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi043.akrjef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-08T20:31:40.354 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:40 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:40.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:40 smithi111 ceph-mon[182474]: Reconfiguring mds.cephfs.smithi043.pjmszb (monmap changed)... 2023-12-08T20:31:40.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:40 smithi111 ceph-mon[182474]: Reconfiguring daemon mds.cephfs.smithi043.pjmszb on smithi043 2023-12-08T20:31:40.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:40 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:40.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:40 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:40.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:40 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi043.akrjef", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-08T20:31:40.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:40 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:41.374 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:41 smithi111 ceph-mon[182474]: pgmap v16: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:41.375 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:41 smithi111 ceph-mon[182474]: Reconfiguring mds.cephfs.smithi043.akrjef (monmap changed)... 2023-12-08T20:31:41.375 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:41 smithi111 ceph-mon[182474]: Reconfiguring daemon mds.cephfs.smithi043.akrjef on smithi043 2023-12-08T20:31:41.375 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:41 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:41.375 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:41 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:41.375 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:41 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-08T20:31:41.375 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:41 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:41.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:41 smithi043 ceph-mon[219193]: pgmap v16: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:41.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:41 smithi043 ceph-mon[219193]: Reconfiguring mds.cephfs.smithi043.akrjef (monmap changed)... 2023-12-08T20:31:41.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:41 smithi043 ceph-mon[219193]: Reconfiguring daemon mds.cephfs.smithi043.akrjef on smithi043 2023-12-08T20:31:41.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:41 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:41.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:41 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:41.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:41 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-08T20:31:41.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:41 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:42.374 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:42 smithi111 ceph-mon[182474]: Reconfiguring crash.smithi111 (monmap changed)... 2023-12-08T20:31:42.374 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:42 smithi111 ceph-mon[182474]: Reconfiguring daemon crash.smithi111 on smithi111 2023-12-08T20:31:42.374 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:42 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:42.374 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:42 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:42.374 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:42 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.mtcffu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-08T20:31:42.374 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:42 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-08T20:31:42.374 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:42 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:42.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:42 smithi043 ceph-mon[219193]: Reconfiguring crash.smithi111 (monmap changed)... 2023-12-08T20:31:42.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:42 smithi043 ceph-mon[219193]: Reconfiguring daemon crash.smithi111 on smithi111 2023-12-08T20:31:42.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:42 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:42.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:42 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:42.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:42 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.mtcffu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-08T20:31:42.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:42 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-08T20:31:42.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:42 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:43.406 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:43 smithi111 ceph-mon[182474]: pgmap v17: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:43.406 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:43 smithi111 ceph-mon[182474]: Reconfiguring mgr.smithi111.mtcffu (monmap changed)... 2023-12-08T20:31:43.406 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:43 smithi111 ceph-mon[182474]: Reconfiguring daemon mgr.smithi111.mtcffu on smithi111 2023-12-08T20:31:43.406 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:43 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:43.406 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:43 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:43.406 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:43 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-08T20:31:43.407 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:43 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-08T20:31:43.407 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:43 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:43.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:43 smithi043 ceph-mon[219193]: pgmap v17: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:43.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:43 smithi043 ceph-mon[219193]: Reconfiguring mgr.smithi111.mtcffu (monmap changed)... 2023-12-08T20:31:43.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:43 smithi043 ceph-mon[219193]: Reconfiguring daemon mgr.smithi111.mtcffu on smithi111 2023-12-08T20:31:43.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:43 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:43.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:43 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:43.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:43 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-08T20:31:43.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:43 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-08T20:31:43.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:43 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:44.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:44 smithi111 ceph-mon[182474]: Reconfiguring mon.smithi111 (monmap changed)... 2023-12-08T20:31:44.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:44 smithi111 ceph-mon[182474]: Reconfiguring daemon mon.smithi111 on smithi111 2023-12-08T20:31:44.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:44.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:44.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-08T20:31:44.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:44.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:31:44.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:44 smithi043 ceph-mon[219193]: Reconfiguring mon.smithi111 (monmap changed)... 2023-12-08T20:31:44.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:44 smithi043 ceph-mon[219193]: Reconfiguring daemon mon.smithi111 on smithi111 2023-12-08T20:31:44.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:44.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:44.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-08T20:31:44.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:44.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:31:45.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:45 smithi111 ceph-mon[182474]: Reconfiguring osd.3 (monmap changed)... 2023-12-08T20:31:45.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:45 smithi111 ceph-mon[182474]: Reconfiguring daemon osd.3 on smithi111 2023-12-08T20:31:45.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:45 smithi111 ceph-mon[182474]: pgmap v18: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:45.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:45 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:45.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:45 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:45.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:45 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-08T20:31:45.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:45 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:45.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:45 smithi043 ceph-mon[219193]: Reconfiguring osd.3 (monmap changed)... 2023-12-08T20:31:45.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:45 smithi043 ceph-mon[219193]: Reconfiguring daemon osd.3 on smithi111 2023-12-08T20:31:45.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:45 smithi043 ceph-mon[219193]: pgmap v18: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:45.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:45 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:45.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:45 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:45.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:45 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-08T20:31:45.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:45 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:46.451 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:46 smithi111 ceph-mon[182474]: Reconfiguring osd.4 (monmap changed)... 2023-12-08T20:31:46.451 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:46 smithi111 ceph-mon[182474]: Reconfiguring daemon osd.4 on smithi111 2023-12-08T20:31:46.451 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:46 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:46.451 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:46 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:46.451 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:46 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-08T20:31:46.451 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:46 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:46.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:46 smithi043 ceph-mon[219193]: Reconfiguring osd.4 (monmap changed)... 2023-12-08T20:31:46.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:46 smithi043 ceph-mon[219193]: Reconfiguring daemon osd.4 on smithi111 2023-12-08T20:31:46.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:46 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:46.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:46 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:46.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:46 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-08T20:31:46.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:46 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:47.400 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:47 smithi111 ceph-mon[182474]: Reconfiguring osd.5 (monmap changed)... 2023-12-08T20:31:47.400 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:47 smithi111 ceph-mon[182474]: Reconfiguring daemon osd.5 on smithi111 2023-12-08T20:31:47.400 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:47 smithi111 ceph-mon[182474]: pgmap v19: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:47.400 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:47 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:47.401 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:47 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:47.401 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:47 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.veeegc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-08T20:31:47.401 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:47 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:47.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:47 smithi043 ceph-mon[219193]: Reconfiguring osd.5 (monmap changed)... 2023-12-08T20:31:47.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:47 smithi043 ceph-mon[219193]: Reconfiguring daemon osd.5 on smithi111 2023-12-08T20:31:47.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:47 smithi043 ceph-mon[219193]: pgmap v19: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:47.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:47 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:47.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:47 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:47.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:47 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.veeegc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-08T20:31:47.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:47 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:48.333 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:48 smithi111 ceph-mon[182474]: Reconfiguring mds.cephfs.smithi111.veeegc (monmap changed)... 2023-12-08T20:31:48.333 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:48 smithi111 ceph-mon[182474]: Reconfiguring daemon mds.cephfs.smithi111.veeegc on smithi111 2023-12-08T20:31:48.334 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:48 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:48.334 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:48 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:48.334 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:48 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.svpasm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-08T20:31:48.334 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:48 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:48.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:48 smithi043 ceph-mon[219193]: Reconfiguring mds.cephfs.smithi111.veeegc (monmap changed)... 2023-12-08T20:31:48.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:48 smithi043 ceph-mon[219193]: Reconfiguring daemon mds.cephfs.smithi111.veeegc on smithi111 2023-12-08T20:31:48.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:48 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:48.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:48 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:48.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:48 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.svpasm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-08T20:31:48.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:48 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:49.359 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:49 smithi043 ceph-mon[219193]: Reconfiguring mds.cephfs.smithi111.svpasm (monmap changed)... 2023-12-08T20:31:49.359 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:49 smithi043 ceph-mon[219193]: Reconfiguring daemon mds.cephfs.smithi111.svpasm on smithi111 2023-12-08T20:31:49.359 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:49 smithi043 ceph-mon[219193]: pgmap v20: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:49.359 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:49.359 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:49.359 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:31:49.359 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:31:49.359 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:31:49.359 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:49.359 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi043"}]: dispatch 2023-12-08T20:31:49.360 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi043"}]': finished 2023-12-08T20:31:49.360 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi111"}]: dispatch 2023-12-08T20:31:49.360 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi111"}]': finished 2023-12-08T20:31:49.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:49 smithi111 ceph-mon[182474]: Reconfiguring mds.cephfs.smithi111.svpasm (monmap changed)... 2023-12-08T20:31:49.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:49 smithi111 ceph-mon[182474]: Reconfiguring daemon mds.cephfs.smithi111.svpasm on smithi111 2023-12-08T20:31:49.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:49 smithi111 ceph-mon[182474]: pgmap v20: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:49.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:49.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:49.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:31:49.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:31:49.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:31:49.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:49.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi043"}]: dispatch 2023-12-08T20:31:49.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi043"}]': finished 2023-12-08T20:31:49.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi111"}]: dispatch 2023-12-08T20:31:49.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi111"}]': finished 2023-12-08T20:31:50.446 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:50 smithi043 ceph-mon[219193]: Upgrade: Setting container_image for all mon 2023-12-08T20:31:50.446 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:50 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:50.446 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:50 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi043", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-08T20:31:50.446 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:50 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:50.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:50 smithi111 ceph-mon[182474]: Upgrade: Setting container_image for all mon 2023-12-08T20:31:50.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:50 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:50.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:50 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi043", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-08T20:31:50.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:50 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:51.363 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:51 smithi043 ceph-mon[219193]: Upgrade: Updating crash.smithi043 (1/2) 2023-12-08T20:31:51.363 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:51 smithi043 ceph-mon[219193]: Deploying daemon crash.smithi043 on smithi043 2023-12-08T20:31:51.364 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:51 smithi043 ceph-mon[219193]: pgmap v21: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:51.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:51 smithi111 ceph-mon[182474]: Upgrade: Updating crash.smithi043 (1/2) 2023-12-08T20:31:51.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:51 smithi111 ceph-mon[182474]: Deploying daemon crash.smithi043 on smithi043 2023-12-08T20:31:51.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:51 smithi111 ceph-mon[182474]: pgmap v21: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:53.286 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:53 smithi111 ceph-mon[182474]: pgmap v22: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:53.286 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:53 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:53.286 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:53 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:53.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:53 smithi043 ceph-mon[219193]: pgmap v22: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:53.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:53 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:53.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:53 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:54.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:54 smithi043 ceph-mon[219193]: Upgrade: Updating crash.smithi111 (2/2) 2023-12-08T20:31:54.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:54 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:54.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:54 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-08T20:31:54.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:54 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:54.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:54 smithi043 ceph-mon[219193]: Deploying daemon crash.smithi111 on smithi111 2023-12-08T20:31:54.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:54 smithi043 ceph-mon[219193]: pgmap v23: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:54.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:54 smithi111 ceph-mon[182474]: Upgrade: Updating crash.smithi111 (2/2) 2023-12-08T20:31:54.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:54 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:54.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:54 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-08T20:31:54.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:54 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:31:54.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:54 smithi111 ceph-mon[182474]: Deploying daemon crash.smithi111 on smithi111 2023-12-08T20:31:54.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:54 smithi111 ceph-mon[182474]: pgmap v23: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:56.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:56 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:56.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:56 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:56.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:56 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:31:56.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:56 smithi111 ceph-mon[182474]: pgmap v24: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:57.013 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:56 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:57.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:56 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:57.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:56 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:31:57.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:56 smithi043 ceph-mon[219193]: pgmap v24: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:58.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:58 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:58.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:58 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:58.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:58 smithi043 ceph-mon[219193]: pgmap v25: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:58.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:58 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:58.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:58 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:58.656 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:58 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:58.656 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:58 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:58.656 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:58 smithi111 ceph-mon[182474]: pgmap v25: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:31:58.656 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:58 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:58.656 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:58 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:59.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:59 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:31:59.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:59 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:59.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:31:59 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:59.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:59 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:31:59.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:59 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:31:59.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:31:59 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:01.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:00 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:01.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:00 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:01.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:00 smithi043 ceph-mon[219193]: pgmap v26: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:01.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:00 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:01.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:00 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:01.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:00 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:01.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:00 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:01.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:00 smithi111 ceph-mon[182474]: pgmap v26: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:01.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:00 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:01.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:00 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:02.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:02 smithi043 ceph-mon[219193]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:32:02.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:02 smithi043 ceph-mon[219193]: pgmap v27: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:02.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:02 smithi111 ceph-mon[182474]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:32:02.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:02 smithi111 ceph-mon[182474]: pgmap v27: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:03.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:03 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:03.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:03 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:03.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:03 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:32:03.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:03 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:32:03.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:03 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:03.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:03 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:32:03.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:03 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:03.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:03 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:03.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:03 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:03.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:03 smithi043 ceph-mon[219193]: Upgrade: Setting container_image for all crash 2023-12-08T20:32:03.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:03 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:03.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:03 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi043"}]: dispatch 2023-12-08T20:32:03.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:03 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi043"}]': finished 2023-12-08T20:32:03.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:03 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi111"}]: dispatch 2023-12-08T20:32:03.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:03 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi111"}]': finished 2023-12-08T20:32:03.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:03 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-08T20:32:03.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:03 smithi043 ceph-mon[219193]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-08T20:32:03.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:03 smithi043 ceph-mon[219193]: Upgrade: osd.0 is safe to restart 2023-12-08T20:32:03.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:03 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:03.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:03 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:03.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:03 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:32:03.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:03 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:32:03.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:03 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:03.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:03 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:32:03.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:03 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:03.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:03 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:03.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:03 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:03.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:03 smithi111 ceph-mon[182474]: Upgrade: Setting container_image for all crash 2023-12-08T20:32:03.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:03 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:03.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:03 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi043"}]: dispatch 2023-12-08T20:32:03.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:03 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi043"}]': finished 2023-12-08T20:32:03.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:03 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi111"}]: dispatch 2023-12-08T20:32:03.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:03 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi111"}]': finished 2023-12-08T20:32:03.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:03 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-08T20:32:03.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:03 smithi111 ceph-mon[182474]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-08T20:32:03.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:03 smithi111 ceph-mon[182474]: Upgrade: osd.0 is safe to restart 2023-12-08T20:32:05.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:04 smithi043 ceph-mon[219193]: pgmap v28: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:05.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:04 smithi043 ceph-mon[219193]: Upgrade: Updating osd.0 2023-12-08T20:32:05.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:04 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:05.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:04 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-08T20:32:05.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:04 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:32:05.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:04 smithi043 ceph-mon[219193]: Deploying daemon osd.0 on smithi043 2023-12-08T20:32:05.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:04 smithi111 ceph-mon[182474]: pgmap v28: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:05.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:04 smithi111 ceph-mon[182474]: Upgrade: Updating osd.0 2023-12-08T20:32:05.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:04 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:05.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:04 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-08T20:32:05.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:04 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:32:05.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:04 smithi111 ceph-mon[182474]: Deploying daemon osd.0 on smithi043 2023-12-08T20:32:06.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:05 smithi043 ceph-mon[219193]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:32:06.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:05 smithi111 ceph-mon[182474]: fsmap cephfs:2 {0=cephfs.smithi043.pjmszb=up:active,1=cephfs.smithi111.veeegc=up:active} 2 up:standby 2023-12-08T20:32:06.764 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:06 smithi043 systemd[1]: Stopping Ceph osd.0 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:32:06.764 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:06 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-0[136255]: 2023-12-08T20:32:06.582+0000 7fafea195700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-08T20:32:06.764 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:06 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-0[136255]: 2023-12-08T20:32:06.582+0000 7fafea195700 -1 osd.0 50 *** Got signal Terminated *** 2023-12-08T20:32:06.764 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:06 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-0[136255]: 2023-12-08T20:32:06.582+0000 7fafea195700 -1 osd.0 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-08T20:32:07.266 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:06 smithi043 ceph-mon[219193]: pgmap v29: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:07.266 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:06 smithi043 ceph-mon[219193]: osd.0 marked itself down and dead 2023-12-08T20:32:07.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.452+0000 7f33c0a36700 1 -- 172.21.15.43:0/1138945093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33bc0fbb40 msgr2=0x7f33bc0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:07.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.452+0000 7f33c0a36700 1 --2- 172.21.15.43:0/1138945093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33bc0fbb40 0x7f33bc0fbfb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f33b0004940 tx=0x7f33b0009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:07.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.453+0000 7f33c0a36700 1 -- 172.21.15.43:0/1138945093 shutdown_connections 2023-12-08T20:32:07.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.453+0000 7f33c0a36700 1 --2- 172.21.15.43:0/1138945093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33bc0fbb40 0x7f33bc0fbfb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:07.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.453+0000 7f33c0a36700 1 --2- 172.21.15.43:0/1138945093 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f33bc101b00 0x7f33bc101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:07.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.453+0000 7f33c0a36700 1 -- 172.21.15.43:0/1138945093 >> 172.21.15.43:0/1138945093 conn(0x7f33bc0719b0 msgr2=0x7f33bc071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:07.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.453+0000 7f33c0a36700 1 -- 172.21.15.43:0/1138945093 shutdown_connections 2023-12-08T20:32:07.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.453+0000 7f33c0a36700 1 -- 172.21.15.43:0/1138945093 wait complete. 2023-12-08T20:32:07.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.453+0000 7f33c0a36700 1 Processor -- start 2023-12-08T20:32:07.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.453+0000 7f33c0a36700 1 -- start start 2023-12-08T20:32:07.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.453+0000 7f33c0a36700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f33bc0fbb40 0x7f33bc1158e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:07.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.453+0000 7f33c0a36700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33bc101b00 0x7f33bc115e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:07.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.453+0000 7f33c0a36700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc116470 con 0x7f33bc101b00 2023-12-08T20:32:07.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.454+0000 7f33c0a36700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc10f7a0 con 0x7f33bc0fbb40 2023-12-08T20:32:07.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.454+0000 7f33b9d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33bc101b00 0x7f33bc115e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:07.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.454+0000 7f33b9d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33bc101b00 0x7f33bc115e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60708/0 (socket says 172.21.15.43:60708) 2023-12-08T20:32:07.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.454+0000 7f33b9d9b700 1 -- 172.21.15.43:0/3108496416 learned_addr learned my addr 172.21.15.43:0/3108496416 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:32:07.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.454+0000 7f33ba59c700 1 --2- 172.21.15.43:0/3108496416 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f33bc0fbb40 0x7f33bc1158e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:07.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.454+0000 7f33b9d9b700 1 -- 172.21.15.43:0/3108496416 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f33bc0fbb40 msgr2=0x7f33bc1158e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:07.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.454+0000 7f33b9d9b700 1 --2- 172.21.15.43:0/3108496416 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f33bc0fbb40 0x7f33bc1158e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:07.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.454+0000 7f33b9d9b700 1 -- 172.21.15.43:0/3108496416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b0005040 con 0x7f33bc101b00 2023-12-08T20:32:07.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.454+0000 7f33ba59c700 1 --2- 172.21.15.43:0/3108496416 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f33bc0fbb40 0x7f33bc1158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:32:07.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.454+0000 7f33b9d9b700 1 --2- 172.21.15.43:0/3108496416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33bc101b00 0x7f33bc115e20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f33b000b3b0 tx=0x7f33b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:07.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.454+0000 7f33aaffd700 1 -- 172.21.15.43:0/3108496416 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33b000e040 con 0x7f33bc101b00 2023-12-08T20:32:07.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.454+0000 7f33aaffd700 1 -- 172.21.15.43:0/3108496416 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f33b000bc50 con 0x7f33bc101b00 2023-12-08T20:32:07.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.454+0000 7f33c0a36700 1 -- 172.21.15.43:0/3108496416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33bc10fa20 con 0x7f33bc101b00 2023-12-08T20:32:07.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.454+0000 7f33aaffd700 1 -- 172.21.15.43:0/3108496416 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33b0013420 con 0x7f33bc101b00 2023-12-08T20:32:07.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.454+0000 7f33c0a36700 1 -- 172.21.15.43:0/3108496416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33bc10ff60 con 0x7f33bc101b00 2023-12-08T20:32:07.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.456+0000 7f33c0a36700 1 -- 172.21.15.43:0/3108496416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33bc0734d0 con 0x7f33bc101b00 2023-12-08T20:32:07.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.456+0000 7f33aaffd700 1 -- 172.21.15.43:0/3108496416 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f33b001c430 con 0x7f33bc101b00 2023-12-08T20:32:07.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.457+0000 7f33aaffd700 1 --2- 172.21.15.43:0/3108496416 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f33a406cf80 0x7f33a406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:07.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.457+0000 7f33aaffd700 1 -- 172.21.15.43:0/3108496416 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f33b008db20 con 0x7f33bc101b00 2023-12-08T20:32:07.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.457+0000 7f33ba59c700 1 --2- 172.21.15.43:0/3108496416 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f33a406cf80 0x7f33a406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:07.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.458+0000 7f33ba59c700 1 --2- 172.21.15.43:0/3108496416 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f33a406cf80 0x7f33a406f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009fd0 tx=0x7f33ac009f20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:07.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.462+0000 7f33aaffd700 1 -- 172.21.15.43:0/3108496416 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f33b005b3d0 con 0x7f33bc101b00 2023-12-08T20:32:07.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:06 smithi111 ceph-mon[182474]: pgmap v29: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:07.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:06 smithi111 ceph-mon[182474]: osd.0 marked itself down and dead 2023-12-08T20:32:07.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.698+0000 7f33c0a36700 1 -- 172.21.15.43:0/3108496416 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f33bc04bbf0 con 0x7f33a406cf80 2023-12-08T20:32:07.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.699+0000 7f33aaffd700 1 -- 172.21.15.43:0/3108496416 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f33bc04bbf0 con 0x7f33a406cf80 2023-12-08T20:32:07.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.701+0000 7f33c0a36700 1 -- 172.21.15.43:0/3108496416 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f33a406cf80 msgr2=0x7f33a406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:07.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.701+0000 7f33c0a36700 1 --2- 172.21.15.43:0/3108496416 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f33a406cf80 0x7f33a406f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009fd0 tx=0x7f33ac009f20 comp rx=0 tx=0).stop 2023-12-08T20:32:07.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.701+0000 7f33c0a36700 1 -- 172.21.15.43:0/3108496416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33bc101b00 msgr2=0x7f33bc115e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:07.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.701+0000 7f33c0a36700 1 --2- 172.21.15.43:0/3108496416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33bc101b00 0x7f33bc115e20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f33b000b3b0 tx=0x7f33b0009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:07.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.701+0000 7f33c0a36700 1 -- 172.21.15.43:0/3108496416 shutdown_connections 2023-12-08T20:32:07.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.701+0000 7f33c0a36700 1 --2- 172.21.15.43:0/3108496416 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f33a406cf80 0x7f33a406f430 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:07.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.701+0000 7f33c0a36700 1 --2- 172.21.15.43:0/3108496416 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f33bc0fbb40 0x7f33bc1158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:07.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.701+0000 7f33c0a36700 1 --2- 172.21.15.43:0/3108496416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33bc101b00 0x7f33bc115e20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:07.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.701+0000 7f33c0a36700 1 -- 172.21.15.43:0/3108496416 >> 172.21.15.43:0/3108496416 conn(0x7f33bc0719b0 msgr2=0x7f33bc0654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:07.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.701+0000 7f33c0a36700 1 -- 172.21.15.43:0/3108496416 shutdown_connections 2023-12-08T20:32:07.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.701+0000 7f33c0a36700 1 -- 172.21.15.43:0/3108496416 wait complete. 2023-12-08T20:32:07.715 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:32:07.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.815+0000 7f23fc285700 1 -- 172.21.15.43:0/4103944012 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23f40fb1e0 msgr2=0x7f23f40fb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:07.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.815+0000 7f23fc285700 1 --2- 172.21.15.43:0/4103944012 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23f40fb1e0 0x7f23f40fb650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23e4004940 tx=0x7f23e4009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:07.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.815+0000 7f23fc285700 1 -- 172.21.15.43:0/4103944012 shutdown_connections 2023-12-08T20:32:07.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.815+0000 7f23fc285700 1 --2- 172.21.15.43:0/4103944012 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23f40fb1e0 0x7f23f40fb650 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:07.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.815+0000 7f23fc285700 1 --2- 172.21.15.43:0/4103944012 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f23f40fda20 0x7f23f40fddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:07.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.815+0000 7f23fc285700 1 -- 172.21.15.43:0/4103944012 >> 172.21.15.43:0/4103944012 conn(0x7f23f40711a0 msgr2=0x7f23f40715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:07.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.815+0000 7f23fc285700 1 -- 172.21.15.43:0/4103944012 shutdown_connections 2023-12-08T20:32:07.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.815+0000 7f23fc285700 1 -- 172.21.15.43:0/4103944012 wait complete. 2023-12-08T20:32:07.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.816+0000 7f23fc285700 1 Processor -- start 2023-12-08T20:32:07.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.816+0000 7f23fc285700 1 -- start start 2023-12-08T20:32:07.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.816+0000 7f23fc285700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f23f40fb1e0 0x7f23f4115870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:07.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.816+0000 7f23fc285700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23f40fda20 0x7f23f4115db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:07.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.816+0000 7f23fc285700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f4116400 con 0x7f23f40fda20 2023-12-08T20:32:07.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.816+0000 7f23fc285700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f410f730 con 0x7f23f40fb1e0 2023-12-08T20:32:07.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.816+0000 7f23f9820700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23f40fda20 0x7f23f4115db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:07.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.816+0000 7f23f9820700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23f40fda20 0x7f23f4115db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60736/0 (socket says 172.21.15.43:60736) 2023-12-08T20:32:07.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.816+0000 7f23f9820700 1 -- 172.21.15.43:0/2412821316 learned_addr learned my addr 172.21.15.43:0/2412821316 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:32:07.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.817+0000 7f23fa021700 1 --2- 172.21.15.43:0/2412821316 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f23f40fb1e0 0x7f23f4115870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:07.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.817+0000 7f23f9820700 1 -- 172.21.15.43:0/2412821316 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f23f40fb1e0 msgr2=0x7f23f4115870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:07.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.817+0000 7f23f9820700 1 --2- 172.21.15.43:0/2412821316 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f23f40fb1e0 0x7f23f4115870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:07.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.817+0000 7f23f9820700 1 -- 172.21.15.43:0/2412821316 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e4005040 con 0x7f23f40fda20 2023-12-08T20:32:07.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.817+0000 7f23f9820700 1 --2- 172.21.15.43:0/2412821316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23f40fda20 0x7f23f4115db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f23e4009360 tx=0x7f23e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:07.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.817+0000 7f23eaffd700 1 -- 172.21.15.43:0/2412821316 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23e400e040 con 0x7f23f40fda20 2023-12-08T20:32:07.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.817+0000 7f23eaffd700 1 -- 172.21.15.43:0/2412821316 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f23e400bc50 con 0x7f23f40fda20 2023-12-08T20:32:07.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.817+0000 7f23fc285700 1 -- 172.21.15.43:0/2412821316 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f410f9b0 con 0x7f23f40fda20 2023-12-08T20:32:07.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.817+0000 7f23eaffd700 1 -- 172.21.15.43:0/2412821316 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23e401c630 con 0x7f23f40fda20 2023-12-08T20:32:07.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.817+0000 7f23fc285700 1 -- 172.21.15.43:0/2412821316 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f410fef0 con 0x7f23f40fda20 2023-12-08T20:32:07.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.818+0000 7f23fc285700 1 -- 172.21.15.43:0/2412821316 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f4072cc0 con 0x7f23f40fda20 2023-12-08T20:32:07.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.819+0000 7f23eaffd700 1 -- 172.21.15.43:0/2412821316 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f23e4013960 con 0x7f23f40fda20 2023-12-08T20:32:07.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.819+0000 7f23eaffd700 1 --2- 172.21.15.43:0/2412821316 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f23e006cf80 0x7f23e006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:07.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.820+0000 7f23eaffd700 1 -- 172.21.15.43:0/2412821316 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f23e408d8c0 con 0x7f23f40fda20 2023-12-08T20:32:07.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.820+0000 7f23fa021700 1 --2- 172.21.15.43:0/2412821316 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f23e006cf80 0x7f23e006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:07.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.820+0000 7f23fa021700 1 --2- 172.21.15.43:0/2412821316 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f23e006cf80 0x7f23e006f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009fd0 tx=0x7f23f0009f00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:07.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:07.825+0000 7f23eaffd700 1 -- 172.21.15.43:0/2412821316 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f23e405b0e0 con 0x7f23f40fda20 2023-12-08T20:32:08.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.059+0000 7f23fc285700 1 -- 172.21.15.43:0/2412821316 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f23f4115540 con 0x7f23e006cf80 2023-12-08T20:32:08.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.060+0000 7f23eaffd700 1 -- 172.21.15.43:0/2412821316 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f23f4115540 con 0x7f23e006cf80 2023-12-08T20:32:08.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.063+0000 7f23fc285700 1 -- 172.21.15.43:0/2412821316 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f23e006cf80 msgr2=0x7f23e006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:08.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.063+0000 7f23fc285700 1 --2- 172.21.15.43:0/2412821316 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f23e006cf80 0x7f23e006f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009fd0 tx=0x7f23f0009f00 comp rx=0 tx=0).stop 2023-12-08T20:32:08.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.063+0000 7f23fc285700 1 -- 172.21.15.43:0/2412821316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23f40fda20 msgr2=0x7f23f4115db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:08.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.063+0000 7f23fc285700 1 --2- 172.21.15.43:0/2412821316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23f40fda20 0x7f23f4115db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f23e4009360 tx=0x7f23e4009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:08.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.063+0000 7f23fc285700 1 -- 172.21.15.43:0/2412821316 shutdown_connections 2023-12-08T20:32:08.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.063+0000 7f23fc285700 1 --2- 172.21.15.43:0/2412821316 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f23e006cf80 0x7f23e006f430 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:08.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.063+0000 7f23fc285700 1 --2- 172.21.15.43:0/2412821316 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f23f40fb1e0 0x7f23f4115870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:08.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.063+0000 7f23fc285700 1 --2- 172.21.15.43:0/2412821316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23f40fda20 0x7f23f4115db0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:08.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.063+0000 7f23fc285700 1 -- 172.21.15.43:0/2412821316 >> 172.21.15.43:0/2412821316 conn(0x7f23f40711a0 msgr2=0x7f23f40f9310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:08.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.063+0000 7f23fc285700 1 -- 172.21.15.43:0/2412821316 shutdown_connections 2023-12-08T20:32:08.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.063+0000 7f23fc285700 1 -- 172.21.15.43:0/2412821316 wait complete. 2023-12-08T20:32:08.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.180+0000 7fb75d8ad700 1 -- 172.21.15.43:0/3645096405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7580fdbf0 msgr2=0x7fb7580fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:08.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.180+0000 7fb75d8ad700 1 --2- 172.21.15.43:0/3645096405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7580fdbf0 0x7fb7580fdfc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb748004940 tx=0x7fb748009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:08.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.181+0000 7fb75d8ad700 1 -- 172.21.15.43:0/3645096405 shutdown_connections 2023-12-08T20:32:08.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.181+0000 7fb75d8ad700 1 --2- 172.21.15.43:0/3645096405 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7580fe590 0x7fb758106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:08.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.181+0000 7fb75d8ad700 1 --2- 172.21.15.43:0/3645096405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7580fdbf0 0x7fb7580fdfc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:08.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.181+0000 7fb75d8ad700 1 -- 172.21.15.43:0/3645096405 >> 172.21.15.43:0/3645096405 conn(0x7fb7580f7680 msgr2=0x7fb7580f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:08.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.181+0000 7fb75d8ad700 1 -- 172.21.15.43:0/3645096405 shutdown_connections 2023-12-08T20:32:08.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.181+0000 7fb75d8ad700 1 -- 172.21.15.43:0/3645096405 wait complete. 2023-12-08T20:32:08.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.182+0000 7fb75d8ad700 1 Processor -- start 2023-12-08T20:32:08.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.182+0000 7fb75d8ad700 1 -- start start 2023-12-08T20:32:08.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.182+0000 7fb75d8ad700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7580fdbf0 0x7fb7581135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:08.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.182+0000 7fb75d8ad700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7580fe590 0x7fb758113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:08.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.182+0000 7fb75d8ad700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb758114140 con 0x7fb7580fdbf0 2023-12-08T20:32:08.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.182+0000 7fb75d8ad700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75810d470 con 0x7fb7580fe590 2023-12-08T20:32:08.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.182+0000 7fb756ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7580fdbf0 0x7fb7581135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:08.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.182+0000 7fb756ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7580fdbf0 0x7fb7581135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60758/0 (socket says 172.21.15.43:60758) 2023-12-08T20:32:08.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.182+0000 7fb756ffd700 1 -- 172.21.15.43:0/3287242624 learned_addr learned my addr 172.21.15.43:0/3287242624 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:32:08.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.182+0000 7fb74ffff700 1 --2- 172.21.15.43:0/3287242624 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7580fe590 0x7fb758113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:08.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.183+0000 7fb756ffd700 1 -- 172.21.15.43:0/3287242624 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7580fe590 msgr2=0x7fb758113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:08.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.183+0000 7fb756ffd700 1 --2- 172.21.15.43:0/3287242624 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7580fe590 0x7fb758113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:08.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.183+0000 7fb756ffd700 1 -- 172.21.15.43:0/3287242624 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb748005040 con 0x7fb7580fdbf0 2023-12-08T20:32:08.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.183+0000 7fb756ffd700 1 --2- 172.21.15.43:0/3287242624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7580fdbf0 0x7fb7581135b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb748000c00 tx=0x7fb748009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:08.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.183+0000 7fb74f7fe700 1 -- 172.21.15.43:0/3287242624 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb748021070 con 0x7fb7580fdbf0 2023-12-08T20:32:08.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.183+0000 7fb74f7fe700 1 -- 172.21.15.43:0/3287242624 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb7480093b0 con 0x7fb7580fdbf0 2023-12-08T20:32:08.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.183+0000 7fb75d8ad700 1 -- 172.21.15.43:0/3287242624 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75810d6f0 con 0x7fb7580fdbf0 2023-12-08T20:32:08.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.183+0000 7fb74f7fe700 1 -- 172.21.15.43:0/3287242624 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb74800e070 con 0x7fb7580fdbf0 2023-12-08T20:32:08.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.183+0000 7fb75d8ad700 1 -- 172.21.15.43:0/3287242624 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75810dc30 con 0x7fb7580fdbf0 2023-12-08T20:32:08.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.184+0000 7fb75d8ad700 1 -- 172.21.15.43:0/3287242624 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7581041e0 con 0x7fb7580fdbf0 2023-12-08T20:32:08.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.185+0000 7fb74f7fe700 1 -- 172.21.15.43:0/3287242624 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fb748013a50 con 0x7fb7580fdbf0 2023-12-08T20:32:08.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.185+0000 7fb74f7fe700 1 --2- 172.21.15.43:0/3287242624 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb74406cf80 0x7fb74406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:08.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.185+0000 7fb74f7fe700 1 -- 172.21.15.43:0/3287242624 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb74808d520 con 0x7fb7580fdbf0 2023-12-08T20:32:08.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.186+0000 7fb74ffff700 1 --2- 172.21.15.43:0/3287242624 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb74406cf80 0x7fb74406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:08.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.186+0000 7fb74ffff700 1 --2- 172.21.15.43:0/3287242624 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb74406cf80 0x7fb74406f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb75810ee50 tx=0x7fb74000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:08.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.193+0000 7fb74f7fe700 1 -- 172.21.15.43:0/3287242624 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb74805ade0 con 0x7fb7580fdbf0 2023-12-08T20:32:08.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:07 smithi043 ceph-mon[219193]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-08T20:32:08.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:07 smithi043 ceph-mon[219193]: osdmap e51: 6 total, 5 up, 6 in 2023-12-08T20:32:08.264 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:08 smithi043 bash[232202]: ceph-28476818-9607-11ee-95a3-87774f69a715-osd-0 2023-12-08T20:32:08.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.423+0000 7fb75d8ad700 1 -- 172.21.15.43:0/3287242624 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb75804bb80 con 0x7fb74406cf80 2023-12-08T20:32:08.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.434+0000 7fb74f7fe700 1 -- 172.21.15.43:0/3287242624 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fb75804bb80 con 0x7fb74406cf80 2023-12-08T20:32:08.436 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-08T20:32:08.437 INFO:teuthology.orchestra.run.smithi043.stdout:alertmanager.smithi043 smithi043 *:9093,9094 running (2m) 9s ago 10m 26.4M - 0.25.0 c8568f914cd2 d4a6cd00c86b 2023-12-08T20:32:08.437 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi043 smithi043 running (16s) 9s ago 10m 7482k - 19.0.0-44-g9dcc13bb f28f2b94f153 f570eddb8e8a 2023-12-08T20:32:08.437 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi111 smithi111 running (13s) 11s ago 9m 7453k - 19.0.0-44-g9dcc13bb f28f2b94f153 b2013e24b94e 2023-12-08T20:32:08.437 INFO:teuthology.orchestra.run.smithi043.stdout:grafana.smithi043 smithi043 *:3000 running (2m) 9s ago 10m 84.2M - 9.4.7 954c08fa6188 8f55491a980b 2023-12-08T20:32:08.437 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.akrjef smithi043 running (6m) 9s ago 6m 18.5M - 17.2.7-119-ge2143d99 f761b6e42225 1c0cb8d34ef8 2023-12-08T20:32:08.437 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.pjmszb smithi043 running (6m) 9s ago 6m 7153M - 17.2.7-119-ge2143d99 f761b6e42225 d7eee0c78093 2023-12-08T20:32:08.437 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.svpasm smithi111 running (6m) 11s ago 6m 16.2M - 17.2.7-119-ge2143d99 f761b6e42225 657d4d1cf4b2 2023-12-08T20:32:08.437 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.veeegc smithi111 running (6m) 11s ago 6m 3706M - 17.2.7-119-ge2143d99 f761b6e42225 31f794a388ab 2023-12-08T20:32:08.437 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi043.hqcdcm smithi043 *:8443,9283,8765 running (3m) 9s ago 11m 504M - 19.0.0-44-g9dcc13bb f28f2b94f153 14e91c1dac64 2023-12-08T20:32:08.437 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi111.mtcffu smithi111 *:8443,9283,8765 running (3m) 11s ago 9m 449M - 19.0.0-44-g9dcc13bb f28f2b94f153 56f4290c6db5 2023-12-08T20:32:08.437 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi043 smithi043 running (63s) 9s ago 11m 49.1M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 3597e3a60ebc 2023-12-08T20:32:08.438 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi111 smithi111 running (42s) 11s ago 9m 38.6M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 528aa182165f 2023-12-08T20:32:08.438 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi043 smithi043 *:9100 running (3m) 9s ago 10m 17.0M - 1.5.0 0da6a335fe13 0959b44d9972 2023-12-08T20:32:08.438 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi111 smithi111 *:9100 running (2m) 11s ago 9m 17.9M - 1.5.0 0da6a335fe13 10fe4fdb23d0 2023-12-08T20:32:08.438 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (9m) 9s ago 9m 752M 1570M 17.2.7-119-ge2143d99 f761b6e42225 462eeaf62b2c 2023-12-08T20:32:08.438 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi043 running (8m) 9s ago 8m 860M 1570M 17.2.7-119-ge2143d99 f761b6e42225 dde419c88a89 2023-12-08T20:32:08.438 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi043 running (8m) 9s ago 8m 642M 1570M 17.2.7-119-ge2143d99 f761b6e42225 f7e812026ef5 2023-12-08T20:32:08.438 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi111 running (8m) 11s ago 8m 980M 2592M 17.2.7-119-ge2143d99 f761b6e42225 2a738d30441c 2023-12-08T20:32:08.438 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi111 running (7m) 11s ago 7m 720M 2592M 17.2.7-119-ge2143d99 f761b6e42225 38cdb6a88694 2023-12-08T20:32:08.438 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi111 running (7m) 11s ago 7m 873M 2592M 17.2.7-119-ge2143d99 f761b6e42225 59a9ce8c1141 2023-12-08T20:32:08.438 INFO:teuthology.orchestra.run.smithi043.stdout:prometheus.smithi043 smithi043 *:9095 running (2m) 9s ago 9m 57.1M - 2.43.0 a07b618ecd1d d95914ec88d8 2023-12-08T20:32:08.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.436+0000 7fb75d8ad700 1 -- 172.21.15.43:0/3287242624 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb74406cf80 msgr2=0x7fb74406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:08.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.436+0000 7fb75d8ad700 1 --2- 172.21.15.43:0/3287242624 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb74406cf80 0x7fb74406f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb75810ee50 tx=0x7fb74000b040 comp rx=0 tx=0).stop 2023-12-08T20:32:08.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.436+0000 7fb75d8ad700 1 -- 172.21.15.43:0/3287242624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7580fdbf0 msgr2=0x7fb7581135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:08.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.436+0000 7fb75d8ad700 1 --2- 172.21.15.43:0/3287242624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7580fdbf0 0x7fb7581135b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb748000c00 tx=0x7fb748009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:08.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.436+0000 7fb75d8ad700 1 -- 172.21.15.43:0/3287242624 shutdown_connections 2023-12-08T20:32:08.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.436+0000 7fb75d8ad700 1 --2- 172.21.15.43:0/3287242624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7580fdbf0 0x7fb7581135b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:08.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.436+0000 7fb75d8ad700 1 --2- 172.21.15.43:0/3287242624 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb74406cf80 0x7fb74406f430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:08.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.436+0000 7fb75d8ad700 1 --2- 172.21.15.43:0/3287242624 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7580fe590 0x7fb758113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:08.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.436+0000 7fb75d8ad700 1 -- 172.21.15.43:0/3287242624 >> 172.21.15.43:0/3287242624 conn(0x7fb7580f7680 msgr2=0x7fb758101360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:08.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.436+0000 7fb75d8ad700 1 -- 172.21.15.43:0/3287242624 shutdown_connections 2023-12-08T20:32:08.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.436+0000 7fb75d8ad700 1 -- 172.21.15.43:0/3287242624 wait complete. 2023-12-08T20:32:08.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:07 smithi111 ceph-mon[182474]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-08T20:32:08.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:07 smithi111 ceph-mon[182474]: osdmap e51: 6 total, 5 up, 6 in 2023-12-08T20:32:08.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.572+0000 7fb01a6f4700 1 -- 172.21.15.43:0/1652804065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb014105890 msgr2=0x7fb0140fef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:08.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.572+0000 7fb01a6f4700 1 --2- 172.21.15.43:0/1652804065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb014105890 0x7fb0140fef00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb008004940 tx=0x7fb008009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:08.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.573+0000 7fb01a6f4700 1 -- 172.21.15.43:0/1652804065 shutdown_connections 2023-12-08T20:32:08.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.573+0000 7fb01a6f4700 1 --2- 172.21.15.43:0/1652804065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb014105890 0x7fb0140fef00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:08.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.573+0000 7fb01a6f4700 1 --2- 172.21.15.43:0/1652804065 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb014104ef0 0x7fb0141052c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:08.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.573+0000 7fb01a6f4700 1 -- 172.21.15.43:0/1652804065 >> 172.21.15.43:0/1652804065 conn(0x7fb0140faaa0 msgr2=0x7fb0140fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:08.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.573+0000 7fb01a6f4700 1 -- 172.21.15.43:0/1652804065 shutdown_connections 2023-12-08T20:32:08.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.573+0000 7fb01a6f4700 1 -- 172.21.15.43:0/1652804065 wait complete. 2023-12-08T20:32:08.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.573+0000 7fb01a6f4700 1 Processor -- start 2023-12-08T20:32:08.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.574+0000 7fb01a6f4700 1 -- start start 2023-12-08T20:32:08.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.574+0000 7fb01a6f4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb014104ef0 0x7fb0141158f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:08.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.574+0000 7fb01a6f4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb014105890 0x7fb014115e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:08.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.574+0000 7fb01a6f4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb014116480 con 0x7fb014104ef0 2023-12-08T20:32:08.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.574+0000 7fb01a6f4700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01410f7b0 con 0x7fb014105890 2023-12-08T20:32:08.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.574+0000 7fb013fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb014104ef0 0x7fb0141158f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:08.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.574+0000 7fb013fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb014104ef0 0x7fb0141158f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60782/0 (socket says 172.21.15.43:60782) 2023-12-08T20:32:08.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.574+0000 7fb013fff700 1 -- 172.21.15.43:0/1177626350 learned_addr learned my addr 172.21.15.43:0/1177626350 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:32:08.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.574+0000 7fb0137fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb014105890 0x7fb014115e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:08.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.574+0000 7fb013fff700 1 -- 172.21.15.43:0/1177626350 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb014105890 msgr2=0x7fb014115e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:08.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.574+0000 7fb013fff700 1 --2- 172.21.15.43:0/1177626350 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb014105890 0x7fb014115e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:08.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.574+0000 7fb013fff700 1 -- 172.21.15.43:0/1177626350 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb008005040 con 0x7fb014104ef0 2023-12-08T20:32:08.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.574+0000 7fb0137fe700 1 --2- 172.21.15.43:0/1177626350 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb014105890 0x7fb014115e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T20:32:08.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.575+0000 7fb013fff700 1 --2- 172.21.15.43:0/1177626350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb014104ef0 0x7fb0141158f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb00400eb40 tx=0x7fb00400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:08.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.575+0000 7fb010ff9700 1 -- 172.21.15.43:0/1177626350 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb004007cc0 con 0x7fb014104ef0 2023-12-08T20:32:08.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.575+0000 7fb010ff9700 1 -- 172.21.15.43:0/1177626350 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb00400f040 con 0x7fb014104ef0 2023-12-08T20:32:08.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.575+0000 7fb010ff9700 1 -- 172.21.15.43:0/1177626350 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb00400c990 con 0x7fb014104ef0 2023-12-08T20:32:08.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.575+0000 7fb01a6f4700 1 -- 172.21.15.43:0/1177626350 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01410fa30 con 0x7fb014104ef0 2023-12-08T20:32:08.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.575+0000 7fb01a6f4700 1 -- 172.21.15.43:0/1177626350 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01410ff40 con 0x7fb014104ef0 2023-12-08T20:32:08.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.576+0000 7fb01a6f4700 1 -- 172.21.15.43:0/1177626350 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0141073c0 con 0x7fb014104ef0 2023-12-08T20:32:08.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.577+0000 7fb010ff9700 1 -- 172.21.15.43:0/1177626350 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fb00400caf0 con 0x7fb014104ef0 2023-12-08T20:32:08.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.577+0000 7fb010ff9700 1 --2- 172.21.15.43:0/1177626350 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7faffc06cf80 0x7faffc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:08.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.578+0000 7fb0137fe700 1 --2- 172.21.15.43:0/1177626350 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7faffc06cf80 0x7faffc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:08.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.578+0000 7fb0137fe700 1 --2- 172.21.15.43:0/1177626350 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7faffc06cf80 0x7faffc06f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb014111220 tx=0x7fb008009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:08.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.581+0000 7fb010ff9700 1 -- 172.21.15.43:0/1177626350 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb004007e20 con 0x7fb014104ef0 2023-12-08T20:32:08.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.582+0000 7fb010ff9700 1 -- 172.21.15.43:0/1177626350 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb0040598f0 con 0x7fb014104ef0 2023-12-08T20:32:08.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.893+0000 7fb01a6f4700 1 -- 172.21.15.43:0/1177626350 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb01404bb80 con 0x7fb014104ef0 2023-12-08T20:32:08.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.894+0000 7fb010ff9700 1 -- 172.21.15.43:0/1177626350 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+726 (secure 0 0 0) 0x7fb004059480 con 0x7fb014104ef0 2023-12-08T20:32:08.896 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:32:08.896 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": { 2023-12-08T20:32:08.896 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:32:08.896 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:32:08.896 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": { 2023-12-08T20:32:08.896 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:32:08.896 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:32:08.896 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": { 2023-12-08T20:32:08.896 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 5 2023-12-08T20:32:08.896 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:32:08.897 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2023-12-08T20:32:08.897 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-08T20:32:08.897 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:32:08.897 INFO:teuthology.orchestra.run.smithi043.stdout: "overall": { 2023-12-08T20:32:08.897 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 9, 2023-12-08T20:32:08.897 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 4 2023-12-08T20:32:08.897 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-12-08T20:32:08.897 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:32:08.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.896+0000 7fb01a6f4700 1 -- 172.21.15.43:0/1177626350 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7faffc06cf80 msgr2=0x7faffc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:08.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.896+0000 7fb01a6f4700 1 --2- 172.21.15.43:0/1177626350 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7faffc06cf80 0x7faffc06f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb014111220 tx=0x7fb008009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:08.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.896+0000 7fb01a6f4700 1 -- 172.21.15.43:0/1177626350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb014104ef0 msgr2=0x7fb0141158f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:08.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.896+0000 7fb01a6f4700 1 --2- 172.21.15.43:0/1177626350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb014104ef0 0x7fb0141158f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb00400eb40 tx=0x7fb00400b040 comp rx=0 tx=0).stop 2023-12-08T20:32:08.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.897+0000 7fb01a6f4700 1 -- 172.21.15.43:0/1177626350 shutdown_connections 2023-12-08T20:32:08.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.897+0000 7fb01a6f4700 1 --2- 172.21.15.43:0/1177626350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb014104ef0 0x7fb0141158f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:08.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.897+0000 7fb01a6f4700 1 --2- 172.21.15.43:0/1177626350 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7faffc06cf80 0x7faffc06f430 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:08.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.897+0000 7fb01a6f4700 1 --2- 172.21.15.43:0/1177626350 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb014105890 0x7fb014115e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:08.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.897+0000 7fb01a6f4700 1 -- 172.21.15.43:0/1177626350 >> 172.21.15.43:0/1177626350 conn(0x7fb0140faaa0 msgr2=0x7fb0140fc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:08.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.897+0000 7fb01a6f4700 1 -- 172.21.15.43:0/1177626350 shutdown_connections 2023-12-08T20:32:08.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:08.897+0000 7fb01a6f4700 1 -- 172.21.15.43:0/1177626350 wait complete. 2023-12-08T20:32:09.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.014+0000 7fcc93f33700 1 -- 172.21.15.43:0/814664673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc8c102c00 msgr2=0x7fcc8c102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:09.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.014+0000 7fcc93f33700 1 --2- 172.21.15.43:0/814664673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc8c102c00 0x7fcc8c102fd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcc88004940 tx=0x7fcc88009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:09.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.014+0000 7fcc93f33700 1 -- 172.21.15.43:0/814664673 shutdown_connections 2023-12-08T20:32:09.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.014+0000 7fcc93f33700 1 --2- 172.21.15.43:0/814664673 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc8c1035a0 0x7fcc8c0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:09.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.014+0000 7fcc93f33700 1 --2- 172.21.15.43:0/814664673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc8c102c00 0x7fcc8c102fd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:09.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.014+0000 7fcc93f33700 1 -- 172.21.15.43:0/814664673 >> 172.21.15.43:0/814664673 conn(0x7fcc8c0f8790 msgr2=0x7fcc8c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:09.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.015+0000 7fcc93f33700 1 -- 172.21.15.43:0/814664673 shutdown_connections 2023-12-08T20:32:09.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.015+0000 7fcc93f33700 1 -- 172.21.15.43:0/814664673 wait complete. 2023-12-08T20:32:09.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.015+0000 7fcc93f33700 1 Processor -- start 2023-12-08T20:32:09.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.015+0000 7fcc93f33700 1 -- start start 2023-12-08T20:32:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.015+0000 7fcc93f33700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc8c102c00 0x7fcc8c113640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.015+0000 7fcc93f33700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc8c1035a0 0x7fcc8c113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.015+0000 7fcc93f33700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c114210 con 0x7fcc8c1035a0 2023-12-08T20:32:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.015+0000 7fcc93f33700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c10d500 con 0x7fcc8c102c00 2023-12-08T20:32:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.016+0000 7fcc914ce700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc8c1035a0 0x7fcc8c113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.016+0000 7fcc914ce700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc8c1035a0 0x7fcc8c113bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60798/0 (socket says 172.21.15.43:60798) 2023-12-08T20:32:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.016+0000 7fcc914ce700 1 -- 172.21.15.43:0/3849916087 learned_addr learned my addr 172.21.15.43:0/3849916087 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:32:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.016+0000 7fcc91ccf700 1 --2- 172.21.15.43:0/3849916087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc8c102c00 0x7fcc8c113640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.016+0000 7fcc914ce700 1 -- 172.21.15.43:0/3849916087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc8c102c00 msgr2=0x7fcc8c113640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.016+0000 7fcc914ce700 1 --2- 172.21.15.43:0/3849916087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc8c102c00 0x7fcc8c113640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.016+0000 7fcc914ce700 1 -- 172.21.15.43:0/3849916087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc88005040 con 0x7fcc8c1035a0 2023-12-08T20:32:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.016+0000 7fcc914ce700 1 --2- 172.21.15.43:0/3849916087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc8c1035a0 0x7fcc8c113bc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00eb40 tx=0x7fcc7c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.016+0000 7fcc827fc700 1 -- 172.21.15.43:0/3849916087 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc7c007cc0 con 0x7fcc8c1035a0 2023-12-08T20:32:09.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.016+0000 7fcc827fc700 1 -- 172.21.15.43:0/3849916087 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcc7c00f040 con 0x7fcc8c1035a0 2023-12-08T20:32:09.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.016+0000 7fcc827fc700 1 -- 172.21.15.43:0/3849916087 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc7c00c8f0 con 0x7fcc8c1035a0 2023-12-08T20:32:09.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.016+0000 7fcc93f33700 1 -- 172.21.15.43:0/3849916087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8c10d730 con 0x7fcc8c1035a0 2023-12-08T20:32:09.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.016+0000 7fcc93f33700 1 -- 172.21.15.43:0/3849916087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8c10dc70 con 0x7fcc8c1035a0 2023-12-08T20:32:09.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.018+0000 7fcc93f33700 1 -- 172.21.15.43:0/3849916087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8c0fff10 con 0x7fcc8c1035a0 2023-12-08T20:32:09.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.018+0000 7fcc827fc700 1 -- 172.21.15.43:0/3849916087 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fcc7c00cb60 con 0x7fcc8c1035a0 2023-12-08T20:32:09.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.019+0000 7fcc827fc700 1 --2- 172.21.15.43:0/3849916087 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fcc7806cf80 0x7fcc7806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:09.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.019+0000 7fcc827fc700 1 -- 172.21.15.43:0/3849916087 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fcc7c08bee0 con 0x7fcc8c1035a0 2023-12-08T20:32:09.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.019+0000 7fcc91ccf700 1 --2- 172.21.15.43:0/3849916087 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fcc7806cf80 0x7fcc7806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:09.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.019+0000 7fcc91ccf700 1 --2- 172.21.15.43:0/3849916087 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fcc7806cf80 0x7fcc7806f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcc88009fd0 tx=0x7fcc88009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:09.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.024+0000 7fcc827fc700 1 -- 172.21.15.43:0/3849916087 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fcc7c059730 con 0x7fcc8c1035a0 2023-12-08T20:32:09.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:08 smithi043 ceph-mon[219193]: failed to encode map e51 with expected crc 2023-12-08T20:32:09.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:08 smithi043 ceph-mon[219193]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:32:09.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:08 smithi043 ceph-mon[219193]: pgmap v31: 65 pgs: 9 stale+active+clean, 56 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:09.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:08 smithi043 ceph-mon[219193]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:32:09.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:08 smithi043 ceph-mon[219193]: failed to encode map e52 with expected crc 2023-12-08T20:32:09.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:08 smithi043 ceph-mon[219193]: osdmap e52: 6 total, 5 up, 6 in 2023-12-08T20:32:09.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:08 smithi043 ceph-mon[219193]: failed to encode map e52 with expected crc 2023-12-08T20:32:09.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:08 smithi043 ceph-mon[219193]: failed to encode map e52 with expected crc 2023-12-08T20:32:09.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:08 smithi043 ceph-mon[219193]: failed to encode map e52 with expected crc 2023-12-08T20:32:09.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:08 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/1177626350' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:09.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.286+0000 7fcc93f33700 1 -- 172.21.15.43:0/3849916087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcc8c04bbb0 con 0x7fcc8c1035a0 2023-12-08T20:32:09.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.287+0000 7fcc827fc700 1 -- 172.21.15.43:0/3849916087 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1855 (secure 0 0 0) 0x7fcc7c0592c0 con 0x7fcc8c1035a0 2023-12-08T20:32:09.289 INFO:teuthology.orchestra.run.smithi043.stdout:e17 2023-12-08T20:32:09.290 INFO:teuthology.orchestra.run.smithi043.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-08T20:32:09.290 INFO:teuthology.orchestra.run.smithi043.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:32:09.290 INFO:teuthology.orchestra.run.smithi043.stdout:legacy client fscid: 1 2023-12-08T20:32:09.290 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:32:09.290 INFO:teuthology.orchestra.run.smithi043.stdout:Filesystem 'cephfs' (1) 2023-12-08T20:32:09.290 INFO:teuthology.orchestra.run.smithi043.stdout:fs_name cephfs 2023-12-08T20:32:09.290 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 17 2023-12-08T20:32:09.290 INFO:teuthology.orchestra.run.smithi043.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-08T20:32:09.290 INFO:teuthology.orchestra.run.smithi043.stdout:created 2023-12-08T20:25:41.527734+0000 2023-12-08T20:32:09.290 INFO:teuthology.orchestra.run.smithi043.stdout:modified 2023-12-08T20:32:04.068774+0000 2023-12-08T20:32:09.290 INFO:teuthology.orchestra.run.smithi043.stdout:tableserver 0 2023-12-08T20:32:09.290 INFO:teuthology.orchestra.run.smithi043.stdout:root 0 2023-12-08T20:32:09.290 INFO:teuthology.orchestra.run.smithi043.stdout:session_timeout 60 2023-12-08T20:32:09.291 INFO:teuthology.orchestra.run.smithi043.stdout:session_autoclose 300 2023-12-08T20:32:09.291 INFO:teuthology.orchestra.run.smithi043.stdout:max_file_size 1099511627776 2023-12-08T20:32:09.291 INFO:teuthology.orchestra.run.smithi043.stdout:max_xattr_size 65536 2023-12-08T20:32:09.291 INFO:teuthology.orchestra.run.smithi043.stdout:required_client_features {} 2023-12-08T20:32:09.291 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure 0 2023-12-08T20:32:09.291 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure_osd_epoch 0 2023-12-08T20:32:09.291 INFO:teuthology.orchestra.run.smithi043.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:32:09.291 INFO:teuthology.orchestra.run.smithi043.stdout:max_mds 2 2023-12-08T20:32:09.291 INFO:teuthology.orchestra.run.smithi043.stdout:in 0,1 2023-12-08T20:32:09.291 INFO:teuthology.orchestra.run.smithi043.stdout:up {0=14452,1=24315} 2023-12-08T20:32:09.291 INFO:teuthology.orchestra.run.smithi043.stdout:failed 2023-12-08T20:32:09.292 INFO:teuthology.orchestra.run.smithi043.stdout:damaged 2023-12-08T20:32:09.292 INFO:teuthology.orchestra.run.smithi043.stdout:stopped 2023-12-08T20:32:09.292 INFO:teuthology.orchestra.run.smithi043.stdout:data_pools [3] 2023-12-08T20:32:09.292 INFO:teuthology.orchestra.run.smithi043.stdout:metadata_pool 2 2023-12-08T20:32:09.292 INFO:teuthology.orchestra.run.smithi043.stdout:inline_data disabled 2023-12-08T20:32:09.292 INFO:teuthology.orchestra.run.smithi043.stdout:balancer 2023-12-08T20:32:09.292 INFO:teuthology.orchestra.run.smithi043.stdout:bal_rank_mask -1 2023-12-08T20:32:09.292 INFO:teuthology.orchestra.run.smithi043.stdout:standby_count_wanted 1 2023-12-08T20:32:09.292 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi043.pjmszb{0:14452} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.43:6826/441584552,v1:172.21.15.43:6827/441584552] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:32:09.292 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi111.veeegc{1:24315} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.111:6824/1990395192,v1:172.21.15.111:6825/1990395192] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:32:09.292 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:32:09.292 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:32:09.292 INFO:teuthology.orchestra.run.smithi043.stdout:Standby daemons: 2023-12-08T20:32:09.292 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:32:09.293 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi043.akrjef{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.43:6828/2926918083,v1:172.21.15.43:6829/2926918083] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:32:09.293 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi111.svpasm{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6826/2885759138,v1:172.21.15.111:6827/2885759138] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:32:09.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.290+0000 7fcc93f33700 1 -- 172.21.15.43:0/3849916087 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fcc7806cf80 msgr2=0x7fcc7806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:09.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.290+0000 7fcc93f33700 1 --2- 172.21.15.43:0/3849916087 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fcc7806cf80 0x7fcc7806f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcc88009fd0 tx=0x7fcc88009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:09.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.290+0000 7fcc93f33700 1 -- 172.21.15.43:0/3849916087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc8c1035a0 msgr2=0x7fcc8c113bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:09.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.290+0000 7fcc93f33700 1 --2- 172.21.15.43:0/3849916087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc8c1035a0 0x7fcc8c113bc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00eb40 tx=0x7fcc7c00b040 comp rx=0 tx=0).stop 2023-12-08T20:32:09.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.290+0000 7fcc93f33700 1 -- 172.21.15.43:0/3849916087 shutdown_connections 2023-12-08T20:32:09.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.290+0000 7fcc93f33700 1 --2- 172.21.15.43:0/3849916087 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fcc7806cf80 0x7fcc7806f430 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:09.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.290+0000 7fcc93f33700 1 --2- 172.21.15.43:0/3849916087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc8c102c00 0x7fcc8c113640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:09.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.290+0000 7fcc93f33700 1 --2- 172.21.15.43:0/3849916087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc8c1035a0 0x7fcc8c113bc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:09.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.290+0000 7fcc93f33700 1 -- 172.21.15.43:0/3849916087 >> 172.21.15.43:0/3849916087 conn(0x7fcc8c0f8790 msgr2=0x7fcc8c0fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:09.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.290+0000 7fcc93f33700 1 -- 172.21.15.43:0/3849916087 shutdown_connections 2023-12-08T20:32:09.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.290+0000 7fcc93f33700 1 -- 172.21.15.43:0/3849916087 wait complete. 2023-12-08T20:32:09.294 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 17 2023-12-08T20:32:09.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.404+0000 7f8e9c0d2700 1 -- 172.21.15.43:0/1863174165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e940fbb40 msgr2=0x7f8e940fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:09.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.404+0000 7f8e9c0d2700 1 --2- 172.21.15.43:0/1863174165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e940fbb40 0x7f8e940fbfb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8e90004940 tx=0x7f8e90009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:09.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.404+0000 7f8e9c0d2700 1 -- 172.21.15.43:0/1863174165 shutdown_connections 2023-12-08T20:32:09.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.404+0000 7f8e9c0d2700 1 --2- 172.21.15.43:0/1863174165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e940fbb40 0x7f8e940fbfb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:09.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.404+0000 7f8e9c0d2700 1 --2- 172.21.15.43:0/1863174165 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e94101b00 0x7f8e94101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:09.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.404+0000 7f8e9c0d2700 1 -- 172.21.15.43:0/1863174165 >> 172.21.15.43:0/1863174165 conn(0x7f8e940719b0 msgr2=0x7f8e94071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:09.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.404+0000 7f8e9c0d2700 1 -- 172.21.15.43:0/1863174165 shutdown_connections 2023-12-08T20:32:09.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.404+0000 7f8e9c0d2700 1 -- 172.21.15.43:0/1863174165 wait complete. 2023-12-08T20:32:09.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.405+0000 7f8e9c0d2700 1 Processor -- start 2023-12-08T20:32:09.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.405+0000 7f8e9c0d2700 1 -- start start 2023-12-08T20:32:09.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.405+0000 7f8e9c0d2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e940fbb40 0x7f8e941135c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:09.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.405+0000 7f8e9c0d2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e94101b00 0x7f8e94113b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:09.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.405+0000 7f8e9c0d2700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e94114150 con 0x7f8e94101b00 2023-12-08T20:32:09.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.405+0000 7f8e9c0d2700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9410d480 con 0x7f8e940fbb40 2023-12-08T20:32:09.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.405+0000 7f8e9966d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e94101b00 0x7f8e94113b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:09.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.405+0000 7f8e9966d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e94101b00 0x7f8e94113b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60806/0 (socket says 172.21.15.43:60806) 2023-12-08T20:32:09.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.405+0000 7f8e9966d700 1 -- 172.21.15.43:0/4115023563 learned_addr learned my addr 172.21.15.43:0/4115023563 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:32:09.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.405+0000 7f8e99e6e700 1 --2- 172.21.15.43:0/4115023563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e940fbb40 0x7f8e941135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:09.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.406+0000 7f8e9966d700 1 -- 172.21.15.43:0/4115023563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e940fbb40 msgr2=0x7f8e941135c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:09.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.406+0000 7f8e9966d700 1 --2- 172.21.15.43:0/4115023563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e940fbb40 0x7f8e941135c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:09.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.406+0000 7f8e9966d700 1 -- 172.21.15.43:0/4115023563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e90005040 con 0x7f8e94101b00 2023-12-08T20:32:09.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.406+0000 7f8e9966d700 1 --2- 172.21.15.43:0/4115023563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e94101b00 0x7f8e94113b00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8e900040d0 tx=0x7f8e90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:09.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.406+0000 7f8e867fc700 1 -- 172.21.15.43:0/4115023563 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e90021070 con 0x7f8e94101b00 2023-12-08T20:32:09.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.406+0000 7f8e867fc700 1 -- 172.21.15.43:0/4115023563 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e900093b0 con 0x7f8e94101b00 2023-12-08T20:32:09.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.406+0000 7f8e9c0d2700 1 -- 172.21.15.43:0/4115023563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9410d700 con 0x7f8e94101b00 2023-12-08T20:32:09.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.406+0000 7f8e867fc700 1 -- 172.21.15.43:0/4115023563 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e9000e070 con 0x7f8e94101b00 2023-12-08T20:32:09.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.406+0000 7f8e9c0d2700 1 -- 172.21.15.43:0/4115023563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9410dbe0 con 0x7f8e94101b00 2023-12-08T20:32:09.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.407+0000 7f8e9c0d2700 1 -- 172.21.15.43:0/4115023563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e940734d0 con 0x7f8e94101b00 2023-12-08T20:32:09.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.408+0000 7f8e867fc700 1 -- 172.21.15.43:0/4115023563 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f8e9001c5e0 con 0x7f8e94101b00 2023-12-08T20:32:09.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.408+0000 7f8e867fc700 1 --2- 172.21.15.43:0/4115023563 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f8e8006cf80 0x7f8e8006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:09.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.408+0000 7f8e867fc700 1 -- 172.21.15.43:0/4115023563 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f8e9008d6c0 con 0x7f8e94101b00 2023-12-08T20:32:09.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.408+0000 7f8e99e6e700 1 --2- 172.21.15.43:0/4115023563 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f8e8006cf80 0x7f8e8006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:09.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.409+0000 7f8e99e6e700 1 --2- 172.21.15.43:0/4115023563 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f8e8006cf80 0x7f8e8006f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009b80 tx=0x7f8e8800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:09.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.413+0000 7f8e867fc700 1 -- 172.21.15.43:0/4115023563 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8e9005ae80 con 0x7f8e94101b00 2023-12-08T20:32:09.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:08 smithi111 ceph-mon[182474]: failed to encode map e51 with expected crc 2023-12-08T20:32:09.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:08 smithi111 ceph-mon[182474]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:32:09.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:08 smithi111 ceph-mon[182474]: pgmap v31: 65 pgs: 9 stale+active+clean, 56 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:09.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:08 smithi111 ceph-mon[182474]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:32:09.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:08 smithi111 ceph-mon[182474]: failed to encode map e52 with expected crc 2023-12-08T20:32:09.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:08 smithi111 ceph-mon[182474]: osdmap e52: 6 total, 5 up, 6 in 2023-12-08T20:32:09.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:08 smithi111 ceph-mon[182474]: failed to encode map e52 with expected crc 2023-12-08T20:32:09.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:08 smithi111 ceph-mon[182474]: failed to encode map e52 with expected crc 2023-12-08T20:32:09.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:08 smithi111 ceph-mon[182474]: failed to encode map e52 with expected crc 2023-12-08T20:32:09.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:08 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/1177626350' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:09.636 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:09 smithi043 systemd[1]: ceph-28476818-9607-11ee-95a3-87774f69a715@osd.0.service: Succeeded. 2023-12-08T20:32:09.636 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:09 smithi043 systemd[1]: Stopped Ceph osd.0 for 28476818-9607-11ee-95a3-87774f69a715. 2023-12-08T20:32:09.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.673+0000 7f8e9c0d2700 1 -- 172.21.15.43:0/4115023563 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e9410ec10 con 0x7f8e8006cf80 2023-12-08T20:32:09.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.675+0000 7f8e867fc700 1 -- 172.21.15.43:0/4115023563 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8e9410ec10 con 0x7f8e8006cf80 2023-12-08T20:32:09.676 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:32:09.676 INFO:teuthology.orchestra.run.smithi043.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-08T20:32:09.677 INFO:teuthology.orchestra.run.smithi043.stdout: "in_progress": true, 2023-12-08T20:32:09.677 INFO:teuthology.orchestra.run.smithi043.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-08T20:32:09.677 INFO:teuthology.orchestra.run.smithi043.stdout: "services_complete": [ 2023-12-08T20:32:09.677 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2023-12-08T20:32:09.677 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr", 2023-12-08T20:32:09.677 INFO:teuthology.orchestra.run.smithi043.stdout: "mon" 2023-12-08T20:32:09.677 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2023-12-08T20:32:09.677 INFO:teuthology.orchestra.run.smithi043.stdout: "progress": "6/21 daemons upgraded", 2023-12-08T20:32:09.677 INFO:teuthology.orchestra.run.smithi043.stdout: "message": "Currently upgrading osd daemons", 2023-12-08T20:32:09.677 INFO:teuthology.orchestra.run.smithi043.stdout: "is_paused": false 2023-12-08T20:32:09.677 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:32:09.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.677+0000 7f8e9c0d2700 1 -- 172.21.15.43:0/4115023563 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f8e8006cf80 msgr2=0x7f8e8006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:09.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.677+0000 7f8e9c0d2700 1 --2- 172.21.15.43:0/4115023563 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f8e8006cf80 0x7f8e8006f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009b80 tx=0x7f8e8800b040 comp rx=0 tx=0).stop 2023-12-08T20:32:09.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.677+0000 7f8e9c0d2700 1 -- 172.21.15.43:0/4115023563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e94101b00 msgr2=0x7f8e94113b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:09.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.677+0000 7f8e9c0d2700 1 --2- 172.21.15.43:0/4115023563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e94101b00 0x7f8e94113b00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8e900040d0 tx=0x7f8e90009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:09.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.677+0000 7f8e9c0d2700 1 -- 172.21.15.43:0/4115023563 shutdown_connections 2023-12-08T20:32:09.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.677+0000 7f8e9c0d2700 1 --2- 172.21.15.43:0/4115023563 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f8e8006cf80 0x7f8e8006f430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:09.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.677+0000 7f8e9c0d2700 1 --2- 172.21.15.43:0/4115023563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e940fbb40 0x7f8e941135c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:09.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.677+0000 7f8e9c0d2700 1 --2- 172.21.15.43:0/4115023563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e94101b00 0x7f8e94113b00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:09.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.677+0000 7f8e9c0d2700 1 -- 172.21.15.43:0/4115023563 >> 172.21.15.43:0/4115023563 conn(0x7f8e940719b0 msgr2=0x7f8e940653f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:09.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.677+0000 7f8e9c0d2700 1 -- 172.21.15.43:0/4115023563 shutdown_connections 2023-12-08T20:32:09.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.678+0000 7f8e9c0d2700 1 -- 172.21.15.43:0/4115023563 wait complete. 2023-12-08T20:32:09.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.809+0000 7f84eb27a700 1 -- 172.21.15.43:0/3645995886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84e4102c70 msgr2=0x7f84e4103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:09.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.809+0000 7f84eb27a700 1 --2- 172.21.15.43:0/3645995886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84e4102c70 0x7f84e4103040 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f84e0004940 tx=0x7f84e0009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:09.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.809+0000 7f84eb27a700 1 -- 172.21.15.43:0/3645995886 shutdown_connections 2023-12-08T20:32:09.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.809+0000 7f84eb27a700 1 --2- 172.21.15.43:0/3645995886 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84e40fb1e0 0x7f84e40fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:09.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.809+0000 7f84eb27a700 1 --2- 172.21.15.43:0/3645995886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84e4102c70 0x7f84e4103040 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:09.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.809+0000 7f84eb27a700 1 -- 172.21.15.43:0/3645995886 >> 172.21.15.43:0/3645995886 conn(0x7f84e40711a0 msgr2=0x7f84e40715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:09.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.810+0000 7f84eb27a700 1 -- 172.21.15.43:0/3645995886 shutdown_connections 2023-12-08T20:32:09.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.810+0000 7f84eb27a700 1 -- 172.21.15.43:0/3645995886 wait complete. 2023-12-08T20:32:09.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.810+0000 7f84eb27a700 1 Processor -- start 2023-12-08T20:32:09.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.810+0000 7f84eb27a700 1 -- start start 2023-12-08T20:32:09.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.810+0000 7f84eb27a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84e40fb1e0 0x7f84e40fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:09.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.810+0000 7f84eb27a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84e4102c70 0x7f84e40fc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:09.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.810+0000 7f84eb27a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40fcf00 con 0x7f84e40fb1e0 2023-12-08T20:32:09.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.810+0000 7f84eb27a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40fd070 con 0x7f84e4102c70 2023-12-08T20:32:09.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.811+0000 7f84e9016700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84e40fb1e0 0x7f84e40fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:09.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.811+0000 7f84e9016700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84e40fb1e0 0x7f84e40fc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60818/0 (socket says 172.21.15.43:60818) 2023-12-08T20:32:09.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.811+0000 7f84e9016700 1 -- 172.21.15.43:0/1779653638 learned_addr learned my addr 172.21.15.43:0/1779653638 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:32:09.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.811+0000 7f84e8815700 1 --2- 172.21.15.43:0/1779653638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84e4102c70 0x7f84e40fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:09.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.811+0000 7f84e9016700 1 -- 172.21.15.43:0/1779653638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84e4102c70 msgr2=0x7f84e40fc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:09.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.811+0000 7f84e9016700 1 --2- 172.21.15.43:0/1779653638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84e4102c70 0x7f84e40fc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:09.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.811+0000 7f84e9016700 1 -- 172.21.15.43:0/1779653638 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e0005040 con 0x7f84e40fb1e0 2023-12-08T20:32:09.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.811+0000 7f84e9016700 1 --2- 172.21.15.43:0/1779653638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84e40fb1e0 0x7f84e40fc3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009180 tx=0x7f84e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:09.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.811+0000 7f84d9ffb700 1 -- 172.21.15.43:0/1779653638 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84e000e040 con 0x7f84e40fb1e0 2023-12-08T20:32:09.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.811+0000 7f84d9ffb700 1 -- 172.21.15.43:0/1779653638 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f84e0004290 con 0x7f84e40fb1e0 2023-12-08T20:32:09.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.811+0000 7f84eb27a700 1 -- 172.21.15.43:0/1779653638 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e4119870 con 0x7f84e40fb1e0 2023-12-08T20:32:09.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.811+0000 7f84d9ffb700 1 -- 172.21.15.43:0/1779653638 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84e001c3f0 con 0x7f84e40fb1e0 2023-12-08T20:32:09.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.812+0000 7f84eb27a700 1 -- 172.21.15.43:0/1779653638 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e4119cd0 con 0x7f84e40fb1e0 2023-12-08T20:32:09.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.813+0000 7f84eb27a700 1 -- 172.21.15.43:0/1779653638 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e40fff10 con 0x7f84e40fb1e0 2023-12-08T20:32:09.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.814+0000 7f84d9ffb700 1 -- 172.21.15.43:0/1779653638 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f84e0013420 con 0x7f84e40fb1e0 2023-12-08T20:32:09.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.814+0000 7f84d9ffb700 1 --2- 172.21.15.43:0/1779653638 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f84d006cf80 0x7f84d006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:09.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.814+0000 7f84d9ffb700 1 -- 172.21.15.43:0/1779653638 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f84e008e260 con 0x7f84e40fb1e0 2023-12-08T20:32:09.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.814+0000 7f84e8815700 1 --2- 172.21.15.43:0/1779653638 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f84d006cf80 0x7f84d006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:09.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.815+0000 7f84e8815700 1 --2- 172.21.15.43:0/1779653638 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f84d006cf80 0x7f84d006f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f84e40fddc0 tx=0x7f84d400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:09.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:09.818+0000 7f84d9ffb700 1 -- 172.21.15.43:0/1779653638 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f84e0058090 con 0x7f84e40fb1e0 2023-12-08T20:32:09.951 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:09 smithi043 systemd[1]: Starting Ceph osd.0 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:32:10.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:10.126+0000 7f84eb27a700 1 -- 172.21.15.43:0/1779653638 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f84e4072cc0 con 0x7f84e40fb1e0 2023-12-08T20:32:10.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:10.127+0000 7f84d9ffb700 1 -- 172.21.15.43:0/1779653638 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+100 (secure 0 0 0) 0x7f84e005b6b0 con 0x7f84e40fb1e0 2023-12-08T20:32:10.129 INFO:teuthology.orchestra.run.smithi043.stdout:HEALTH_WARN 1 osds down 2023-12-08T20:32:10.129 INFO:teuthology.orchestra.run.smithi043.stdout:[WRN] OSD_DOWN: 1 osds down 2023-12-08T20:32:10.129 INFO:teuthology.orchestra.run.smithi043.stdout: osd.0 (root=default,host=smithi043) is down 2023-12-08T20:32:10.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:10.129+0000 7f84eb27a700 1 -- 172.21.15.43:0/1779653638 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f84d006cf80 msgr2=0x7f84d006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:10.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:10.129+0000 7f84eb27a700 1 --2- 172.21.15.43:0/1779653638 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f84d006cf80 0x7f84d006f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f84e40fddc0 tx=0x7f84d400b040 comp rx=0 tx=0).stop 2023-12-08T20:32:10.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:10.129+0000 7f84eb27a700 1 -- 172.21.15.43:0/1779653638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84e40fb1e0 msgr2=0x7f84e40fc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:10.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:10.129+0000 7f84eb27a700 1 --2- 172.21.15.43:0/1779653638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84e40fb1e0 0x7f84e40fc3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009180 tx=0x7f84e0009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:10.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:10.130+0000 7f84eb27a700 1 -- 172.21.15.43:0/1779653638 shutdown_connections 2023-12-08T20:32:10.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:10.130+0000 7f84eb27a700 1 --2- 172.21.15.43:0/1779653638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84e40fb1e0 0x7f84e40fc3c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:10.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:10.130+0000 7f84eb27a700 1 --2- 172.21.15.43:0/1779653638 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f84d006cf80 0x7f84d006f430 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:10.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:10.130+0000 7f84eb27a700 1 --2- 172.21.15.43:0/1779653638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84e4102c70 0x7f84e40fc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:10.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:10.130+0000 7f84eb27a700 1 -- 172.21.15.43:0/1779653638 >> 172.21.15.43:0/1779653638 conn(0x7f84e40711a0 msgr2=0x7f84e40fa180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:10.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:10.130+0000 7f84eb27a700 1 -- 172.21.15.43:0/1779653638 shutdown_connections 2023-12-08T20:32:10.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:10.130+0000 7f84eb27a700 1 -- 172.21.15.43:0/1779653638 wait complete. 2023-12-08T20:32:10.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:09 smithi043 ceph-mon[219193]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:32:10.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:09 smithi043 ceph-mon[219193]: failed to encode map e52 with expected crc 2023-12-08T20:32:10.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:09 smithi043 ceph-mon[219193]: failed to encode map e52 with expected crc 2023-12-08T20:32:10.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:09 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/3849916087' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-08T20:32:10.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:09 smithi111 ceph-mon[182474]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:32:10.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:09 smithi111 ceph-mon[182474]: failed to encode map e52 with expected crc 2023-12-08T20:32:10.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:09 smithi111 ceph-mon[182474]: failed to encode map e52 with expected crc 2023-12-08T20:32:10.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:09 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/3849916087' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-08T20:32:10.764 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:10 smithi043 bash[232603]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-08T20:32:10.764 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:10 smithi043 bash[232603]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-08T20:32:10.764 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:10 smithi043 bash[232603]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-08T20:32:10.764 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:10 smithi043 bash[232603]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-08T20:32:10.764 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:10 smithi043 bash[232603]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2023-12-08T20:32:10.764 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:10 smithi043 bash[232603]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-08T20:32:10.764 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:10 smithi043 bash[232603]: --> ceph-volume raw activate successful for osd ID: 0 2023-12-08T20:32:11.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:10 smithi043 ceph-mon[219193]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:32:11.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:10 smithi043 ceph-mon[219193]: pgmap v33: 65 pgs: 9 stale+active+clean, 56 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:11.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:10 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/1779653638' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-08T20:32:11.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:10 smithi111 ceph-mon[182474]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:32:11.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:10 smithi111 ceph-mon[182474]: pgmap v33: 65 pgs: 9 stale+active+clean, 56 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:11.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:10 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/1779653638' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-08T20:32:11.764 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:11 smithi043 ceph-osd[232948]: -- 172.21.15.43:0/2133535179 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56300522f1e0 con 0x5630051ff000 2023-12-08T20:32:11.764 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:11 smithi043 bash[232911]: 298e9b98d7a4b2d76dc130624dd298c62f011408d350ed00b9eb2a0ec8777ca4 2023-12-08T20:32:11.764 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:11 smithi043 systemd[1]: Started Ceph osd.0 for 28476818-9607-11ee-95a3-87774f69a715. 2023-12-08T20:32:12.092 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:11 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-0[232925]: 2023-12-08T20:32:11.813+0000 7f4eefc33640 -1 Falling back to public interface 2023-12-08T20:32:12.635 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:12 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:12.635 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:12 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:12.635 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:12 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:32:12.635 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:12 smithi043 ceph-mon[219193]: pgmap v34: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2023-12-08T20:32:12.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:12 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:12.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:12 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:12.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:12 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:32:12.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:12 smithi111 ceph-mon[182474]: pgmap v34: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2023-12-08T20:32:13.688 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:13 smithi043 ceph-mon[219193]: Health check failed: Degraded data redundancy: 70/357 objects degraded (19.608%), 20 pgs degraded (PG_DEGRADED) 2023-12-08T20:32:13.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:13 smithi111 ceph-mon[182474]: Health check failed: Degraded data redundancy: 70/357 objects degraded (19.608%), 20 pgs degraded (PG_DEGRADED) 2023-12-08T20:32:15.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:14 smithi111 ceph-mon[182474]: pgmap v35: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2023-12-08T20:32:15.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:14 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:15.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:14 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:32:15.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:14 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:15.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:14 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:15.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:14 smithi043 ceph-mon[219193]: pgmap v35: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2023-12-08T20:32:15.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:15.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:32:15.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:15.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:16.290 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:16 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-0[232925]: 2023-12-08T20:32:16.036+0000 7f4eefc33640 -1 osd.0 0 read_superblock omap replica is missing. 2023-12-08T20:32:16.576 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:16 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-0[232925]: 2023-12-08T20:32:16.573+0000 7f4eefc33640 -1 osd.0 50 log_to_monitors true 2023-12-08T20:32:16.827 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:32:16 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-0[232925]: 2023-12-08T20:32:16.796+0000 7f4ee10a4700 -1 osd.0 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:32:16.827 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:16 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:16.827 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:16 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:16.828 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:16 smithi043 ceph-mon[219193]: pgmap v36: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2023-12-08T20:32:16.828 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:16 smithi043 ceph-mon[219193]: from='osd.0 [v2:172.21.15.43:6802/4101340685,v1:172.21.15.43:6803/4101340685]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-08T20:32:17.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:16 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:17.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:16 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:17.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:16 smithi111 ceph-mon[182474]: pgmap v36: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2023-12-08T20:32:17.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:16 smithi111 ceph-mon[182474]: from='osd.0 [v2:172.21.15.43:6802/4101340685,v1:172.21.15.43:6803/4101340685]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-08T20:32:18.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:17 smithi111 ceph-mon[182474]: from='osd.0 [v2:172.21.15.43:6802/4101340685,v1:172.21.15.43:6803/4101340685]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-08T20:32:18.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:17 smithi111 ceph-mon[182474]: failed to encode map e53 with expected crc 2023-12-08T20:32:18.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:17 smithi111 ceph-mon[182474]: osdmap e53: 6 total, 5 up, 6 in 2023-12-08T20:32:18.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:17 smithi111 ceph-mon[182474]: from='osd.0 [v2:172.21.15.43:6802/4101340685,v1:172.21.15.43:6803/4101340685]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2023-12-08T20:32:18.238 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:17 smithi043 ceph-mon[219193]: from='osd.0 [v2:172.21.15.43:6802/4101340685,v1:172.21.15.43:6803/4101340685]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-08T20:32:18.238 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:17 smithi043 ceph-mon[219193]: failed to encode map e53 with expected crc 2023-12-08T20:32:18.238 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:17 smithi043 ceph-mon[219193]: osdmap e53: 6 total, 5 up, 6 in 2023-12-08T20:32:18.239 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:17 smithi043 ceph-mon[219193]: from='osd.0 [v2:172.21.15.43:6802/4101340685,v1:172.21.15.43:6803/4101340685]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2023-12-08T20:32:19.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:18 smithi043 ceph-mon[219193]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-08T20:32:19.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:18 smithi043 ceph-mon[219193]: failed to encode map e53 with expected crc 2023-12-08T20:32:19.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:18 smithi043 ceph-mon[219193]: osd.0 [v2:172.21.15.43:6802/4101340685,v1:172.21.15.43:6803/4101340685] boot 2023-12-08T20:32:19.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:18 smithi043 ceph-mon[219193]: osdmap e54: 6 total, 6 up, 6 in 2023-12-08T20:32:19.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:18 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:32:19.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:18 smithi043 ceph-mon[219193]: pgmap v39: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2023-12-08T20:32:19.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:18 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:19.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:18 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:19.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:18 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:32:19.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:18 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:32:19.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:18 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:19.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:18 smithi111 ceph-mon[182474]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-08T20:32:19.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:18 smithi111 ceph-mon[182474]: failed to encode map e53 with expected crc 2023-12-08T20:32:19.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:18 smithi111 ceph-mon[182474]: osd.0 [v2:172.21.15.43:6802/4101340685,v1:172.21.15.43:6803/4101340685] boot 2023-12-08T20:32:19.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:18 smithi111 ceph-mon[182474]: osdmap e54: 6 total, 6 up, 6 in 2023-12-08T20:32:19.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:18 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-08T20:32:19.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:18 smithi111 ceph-mon[182474]: pgmap v39: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2023-12-08T20:32:19.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:18 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:19.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:18 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:19.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:18 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:32:19.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:18 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:32:19.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:18 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:20.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:19 smithi111 ceph-mon[182474]: failed to encode map e55 with expected crc 2023-12-08T20:32:20.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:19 smithi111 ceph-mon[182474]: osdmap e55: 6 total, 6 up, 6 in 2023-12-08T20:32:20.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:19 smithi111 ceph-mon[182474]: failed to encode map e55 with expected crc 2023-12-08T20:32:20.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:19 smithi111 ceph-mon[182474]: failed to encode map e55 with expected crc 2023-12-08T20:32:20.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:19 smithi111 ceph-mon[182474]: failed to encode map e55 with expected crc 2023-12-08T20:32:20.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:19 smithi111 ceph-mon[182474]: failed to encode map e55 with expected crc 2023-12-08T20:32:20.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:19 smithi111 ceph-mon[182474]: failed to encode map e55 with expected crc 2023-12-08T20:32:20.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:19 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:32:20.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:19 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:20.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:19 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:20.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:19 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:20.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:19 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-08T20:32:20.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:19 smithi111 ceph-mon[182474]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-08T20:32:20.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:19 smithi111 ceph-mon[182474]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-08T20:32:20.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:19 smithi043 ceph-mon[219193]: failed to encode map e55 with expected crc 2023-12-08T20:32:20.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:19 smithi043 ceph-mon[219193]: osdmap e55: 6 total, 6 up, 6 in 2023-12-08T20:32:20.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:19 smithi043 ceph-mon[219193]: failed to encode map e55 with expected crc 2023-12-08T20:32:20.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:19 smithi043 ceph-mon[219193]: failed to encode map e55 with expected crc 2023-12-08T20:32:20.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:19 smithi043 ceph-mon[219193]: failed to encode map e55 with expected crc 2023-12-08T20:32:20.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:19 smithi043 ceph-mon[219193]: failed to encode map e55 with expected crc 2023-12-08T20:32:20.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:19 smithi043 ceph-mon[219193]: failed to encode map e55 with expected crc 2023-12-08T20:32:20.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:19 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:32:20.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:19 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:20.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:19 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:20.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:19 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:20.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:19 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-08T20:32:20.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:19 smithi043 ceph-mon[219193]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-08T20:32:20.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:19 smithi043 ceph-mon[219193]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-08T20:32:21.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:20 smithi111 ceph-mon[182474]: pgmap v41: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2023-12-08T20:32:21.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:20 smithi043 ceph-mon[219193]: pgmap v41: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2023-12-08T20:32:22.266 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:21 smithi043 ceph-mon[219193]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 70/357 objects degraded (19.608%), 20 pgs degraded) 2023-12-08T20:32:22.266 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:21 smithi043 ceph-mon[219193]: Cluster is now healthy 2023-12-08T20:32:22.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:21 smithi111 ceph-mon[182474]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 70/357 objects degraded (19.608%), 20 pgs degraded) 2023-12-08T20:32:22.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:21 smithi111 ceph-mon[182474]: Cluster is now healthy 2023-12-08T20:32:23.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:22 smithi043 ceph-mon[219193]: pgmap v42: 65 pgs: 65 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:23.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:22 smithi111 ceph-mon[182474]: pgmap v42: 65 pgs: 65 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:25.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:25 smithi043 ceph-mon[219193]: pgmap v43: 65 pgs: 65 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:25.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:25 smithi111 ceph-mon[182474]: pgmap v43: 65 pgs: 65 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:26.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:26 smithi111 ceph-mon[182474]: pgmap v44: 65 pgs: 65 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:27.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:26 smithi043 ceph-mon[219193]: pgmap v44: 65 pgs: 65 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:29.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:28 smithi111 ceph-mon[182474]: pgmap v45: 65 pgs: 65 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:29.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:28 smithi043 ceph-mon[219193]: pgmap v45: 65 pgs: 65 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:30.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:29 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:30.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:29 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:32:30.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:29 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:30.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:29 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:30.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:29 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:32:30.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:29 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:31.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:30 smithi043 ceph-mon[219193]: pgmap v46: 65 pgs: 65 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:31.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:30 smithi111 ceph-mon[182474]: pgmap v46: 65 pgs: 65 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:33.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:32 smithi043 ceph-mon[219193]: pgmap v47: 65 pgs: 65 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:33.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:32 smithi111 ceph-mon[182474]: pgmap v47: 65 pgs: 65 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:34.254 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:33 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-08T20:32:34.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:33 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-08T20:32:35.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:34 smithi043 ceph-mon[219193]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-08T20:32:35.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:34 smithi043 ceph-mon[219193]: Upgrade: osd.1 is safe to restart 2023-12-08T20:32:35.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:34 smithi043 ceph-mon[219193]: pgmap v48: 65 pgs: 65 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:35.470 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:34 smithi111 ceph-mon[182474]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-08T20:32:35.470 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:34 smithi111 ceph-mon[182474]: Upgrade: osd.1 is safe to restart 2023-12-08T20:32:35.470 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:34 smithi111 ceph-mon[182474]: pgmap v48: 65 pgs: 65 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:36.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:36 smithi043 ceph-mon[219193]: Upgrade: Updating osd.1 2023-12-08T20:32:36.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:36 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:36.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:36 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-08T20:32:36.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:36 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:32:36.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:36 smithi043 ceph-mon[219193]: Deploying daemon osd.1 on smithi043 2023-12-08T20:32:36.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:36 smithi111 ceph-mon[182474]: Upgrade: Updating osd.1 2023-12-08T20:32:36.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:36 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:36.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:36 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-08T20:32:36.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:36 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:32:36.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:36 smithi111 ceph-mon[182474]: Deploying daemon osd.1 on smithi043 2023-12-08T20:32:37.391 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:37 smithi043 ceph-mon[219193]: pgmap v49: 65 pgs: 65 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:37.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:37 smithi111 ceph-mon[182474]: pgmap v49: 65 pgs: 65 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:37.738 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:37 smithi043 systemd[1]: Stopping Ceph osd.1 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:32:38.014 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:37 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-1[145532]: 2023-12-08T20:32:37.735+0000 7fd0023c7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-08T20:32:38.014 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:37 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-1[145532]: 2023-12-08T20:32:37.735+0000 7fd0023c7700 -1 osd.1 55 *** Got signal Terminated *** 2023-12-08T20:32:38.014 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:37 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-1[145532]: 2023-12-08T20:32:37.735+0000 7fd0023c7700 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-08T20:32:38.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:38 smithi111 ceph-mon[182474]: osd.1 marked itself down and dead 2023-12-08T20:32:38.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:38 smithi043 ceph-mon[219193]: osd.1 marked itself down and dead 2023-12-08T20:32:39.014 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:38 smithi043 bash[238828]: ceph-28476818-9607-11ee-95a3-87774f69a715-osd-1 2023-12-08T20:32:39.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:39 smithi111 ceph-mon[182474]: pgmap v50: 65 pgs: 65 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:39.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:39 smithi111 ceph-mon[182474]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-08T20:32:39.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:39 smithi111 ceph-mon[182474]: failed to encode map e56 with expected crc 2023-12-08T20:32:39.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:39 smithi111 ceph-mon[182474]: failed to encode map e56 with expected crc 2023-12-08T20:32:39.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:39 smithi111 ceph-mon[182474]: failed to encode map e56 with expected crc 2023-12-08T20:32:39.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:39 smithi111 ceph-mon[182474]: osdmap e56: 6 total, 5 up, 6 in 2023-12-08T20:32:39.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:39 smithi111 ceph-mon[182474]: failed to encode map e56 with expected crc 2023-12-08T20:32:39.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:39 smithi043 ceph-mon[219193]: pgmap v50: 65 pgs: 65 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:39.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:39 smithi043 ceph-mon[219193]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-08T20:32:39.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:39 smithi043 ceph-mon[219193]: failed to encode map e56 with expected crc 2023-12-08T20:32:39.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:39 smithi043 ceph-mon[219193]: failed to encode map e56 with expected crc 2023-12-08T20:32:39.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:39 smithi043 ceph-mon[219193]: failed to encode map e56 with expected crc 2023-12-08T20:32:39.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:39 smithi043 ceph-mon[219193]: osdmap e56: 6 total, 5 up, 6 in 2023-12-08T20:32:39.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:39 smithi043 ceph-mon[219193]: failed to encode map e56 with expected crc 2023-12-08T20:32:40.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.256+0000 7f2b96cac700 1 -- 172.21.15.43:0/1461594124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b90102c70 msgr2=0x7f2b90103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:40.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.256+0000 7f2b96cac700 1 --2- 172.21.15.43:0/1461594124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b90102c70 0x7f2b90103040 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2b84004940 tx=0x7f2b84009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:40.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.256+0000 7f2b96cac700 1 -- 172.21.15.43:0/1461594124 shutdown_connections 2023-12-08T20:32:40.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.256+0000 7f2b96cac700 1 --2- 172.21.15.43:0/1461594124 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b900fb1e0 0x7f2b900fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:40.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.256+0000 7f2b96cac700 1 --2- 172.21.15.43:0/1461594124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b90102c70 0x7f2b90103040 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:40.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.256+0000 7f2b96cac700 1 -- 172.21.15.43:0/1461594124 >> 172.21.15.43:0/1461594124 conn(0x7f2b900711a0 msgr2=0x7f2b900715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:40.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.257+0000 7f2b96cac700 1 -- 172.21.15.43:0/1461594124 shutdown_connections 2023-12-08T20:32:40.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.257+0000 7f2b96cac700 1 -- 172.21.15.43:0/1461594124 wait complete. 2023-12-08T20:32:40.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.258+0000 7f2b96cac700 1 Processor -- start 2023-12-08T20:32:40.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.258+0000 7f2b96cac700 1 -- start start 2023-12-08T20:32:40.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.259+0000 7f2b96cac700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b900fb1e0 0x7f2b900fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:40.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.259+0000 7f2b96cac700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b90102c70 0x7f2b900fc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:40.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.259+0000 7f2b96cac700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900fcf00 con 0x7f2b900fb1e0 2023-12-08T20:32:40.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.259+0000 7f2b96cac700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900fd070 con 0x7f2b90102c70 2023-12-08T20:32:40.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.259+0000 7f2b94a48700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b900fb1e0 0x7f2b900fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:40.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.259+0000 7f2b94a48700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b900fb1e0 0x7f2b900fc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48382/0 (socket says 172.21.15.43:48382) 2023-12-08T20:32:40.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.259+0000 7f2b94a48700 1 -- 172.21.15.43:0/3017027356 learned_addr learned my addr 172.21.15.43:0/3017027356 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:32:40.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.259+0000 7f2b8ffff700 1 --2- 172.21.15.43:0/3017027356 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b90102c70 0x7f2b900fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:40.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.259+0000 7f2b94a48700 1 -- 172.21.15.43:0/3017027356 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b90102c70 msgr2=0x7f2b900fc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:40.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.259+0000 7f2b94a48700 1 --2- 172.21.15.43:0/3017027356 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b90102c70 0x7f2b900fc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:40.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.259+0000 7f2b94a48700 1 -- 172.21.15.43:0/3017027356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b84005040 con 0x7f2b900fb1e0 2023-12-08T20:32:40.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.260+0000 7f2b94a48700 1 --2- 172.21.15.43:0/3017027356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b900fb1e0 0x7f2b900fc3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009180 tx=0x7f2b84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:40.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.260+0000 7f2b8d7fa700 1 -- 172.21.15.43:0/3017027356 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b8400e040 con 0x7f2b900fb1e0 2023-12-08T20:32:40.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.260+0000 7f2b8d7fa700 1 -- 172.21.15.43:0/3017027356 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2b84004290 con 0x7f2b900fb1e0 2023-12-08T20:32:40.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.260+0000 7f2b8d7fa700 1 -- 172.21.15.43:0/3017027356 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b8401c3f0 con 0x7f2b900fb1e0 2023-12-08T20:32:40.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.260+0000 7f2b96cac700 1 -- 172.21.15.43:0/3017027356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b901197b0 con 0x7f2b900fb1e0 2023-12-08T20:32:40.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.260+0000 7f2b96cac700 1 -- 172.21.15.43:0/3017027356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b90119bc0 con 0x7f2b900fb1e0 2023-12-08T20:32:40.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.261+0000 7f2b96cac700 1 -- 172.21.15.43:0/3017027356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b90072cc0 con 0x7f2b900fb1e0 2023-12-08T20:32:40.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.262+0000 7f2b8d7fa700 1 -- 172.21.15.43:0/3017027356 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f2b84013420 con 0x7f2b900fb1e0 2023-12-08T20:32:40.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.262+0000 7f2b8d7fa700 1 --2- 172.21.15.43:0/3017027356 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f2b8006cf80 0x7f2b8006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:40.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.263+0000 7f2b8d7fa700 1 -- 172.21.15.43:0/3017027356 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f2b8408e290 con 0x7f2b900fb1e0 2023-12-08T20:32:40.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.263+0000 7f2b8ffff700 1 --2- 172.21.15.43:0/3017027356 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f2b8006cf80 0x7f2b8006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:40.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.263+0000 7f2b8ffff700 1 --2- 172.21.15.43:0/3017027356 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f2b8006cf80 0x7f2b8006f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2b900fddc0 tx=0x7f2b7c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:40.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.267+0000 7f2b8d7fa700 1 -- 172.21.15.43:0/3017027356 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2b840580c0 con 0x7f2b900fb1e0 2023-12-08T20:32:40.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:40 smithi111 ceph-mon[182474]: failed to encode map e57 with expected crc 2023-12-08T20:32:40.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:40 smithi111 ceph-mon[182474]: osdmap e57: 6 total, 5 up, 6 in 2023-12-08T20:32:40.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:40 smithi111 ceph-mon[182474]: failed to encode map e57 with expected crc 2023-12-08T20:32:40.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:40 smithi111 ceph-mon[182474]: failed to encode map e57 with expected crc 2023-12-08T20:32:40.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:40 smithi111 ceph-mon[182474]: failed to encode map e57 with expected crc 2023-12-08T20:32:40.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:40 smithi111 ceph-mon[182474]: failed to encode map e57 with expected crc 2023-12-08T20:32:40.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:40 smithi111 ceph-mon[182474]: failed to encode map e57 with expected crc 2023-12-08T20:32:40.472 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:40 smithi043 systemd[1]: ceph-28476818-9607-11ee-95a3-87774f69a715@osd.1.service: Succeeded. 2023-12-08T20:32:40.472 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:40 smithi043 systemd[1]: Stopped Ceph osd.1 for 28476818-9607-11ee-95a3-87774f69a715. 2023-12-08T20:32:40.472 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:40 smithi043 systemd[1]: Starting Ceph osd.1 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:32:40.472 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:40 smithi043 ceph-mon[219193]: failed to encode map e57 with expected crc 2023-12-08T20:32:40.473 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:40 smithi043 ceph-mon[219193]: osdmap e57: 6 total, 5 up, 6 in 2023-12-08T20:32:40.473 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:40 smithi043 ceph-mon[219193]: failed to encode map e57 with expected crc 2023-12-08T20:32:40.473 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:40 smithi043 ceph-mon[219193]: failed to encode map e57 with expected crc 2023-12-08T20:32:40.473 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:40 smithi043 ceph-mon[219193]: failed to encode map e57 with expected crc 2023-12-08T20:32:40.473 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:40 smithi043 ceph-mon[219193]: failed to encode map e57 with expected crc 2023-12-08T20:32:40.473 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:40 smithi043 ceph-mon[219193]: failed to encode map e57 with expected crc 2023-12-08T20:32:40.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.509+0000 7f2b96cac700 1 -- 172.21.15.43:0/3017027356 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b900fdc10 con 0x7f2b8006cf80 2023-12-08T20:32:40.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.510+0000 7f2b8d7fa700 1 -- 172.21.15.43:0/3017027356 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2b900fdc10 con 0x7f2b8006cf80 2023-12-08T20:32:40.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.513+0000 7f2b96cac700 1 -- 172.21.15.43:0/3017027356 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f2b8006cf80 msgr2=0x7f2b8006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:40.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.513+0000 7f2b96cac700 1 --2- 172.21.15.43:0/3017027356 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f2b8006cf80 0x7f2b8006f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2b900fddc0 tx=0x7f2b7c00b040 comp rx=0 tx=0).stop 2023-12-08T20:32:40.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.513+0000 7f2b96cac700 1 -- 172.21.15.43:0/3017027356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b900fb1e0 msgr2=0x7f2b900fc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:40.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.513+0000 7f2b96cac700 1 --2- 172.21.15.43:0/3017027356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b900fb1e0 0x7f2b900fc3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009180 tx=0x7f2b84009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:40.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.513+0000 7f2b96cac700 1 -- 172.21.15.43:0/3017027356 shutdown_connections 2023-12-08T20:32:40.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.513+0000 7f2b96cac700 1 --2- 172.21.15.43:0/3017027356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b900fb1e0 0x7f2b900fc3c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:40.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.513+0000 7f2b96cac700 1 --2- 172.21.15.43:0/3017027356 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f2b8006cf80 0x7f2b8006f430 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:40.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.513+0000 7f2b96cac700 1 --2- 172.21.15.43:0/3017027356 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b90102c70 0x7f2b900fc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:40.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.513+0000 7f2b96cac700 1 -- 172.21.15.43:0/3017027356 >> 172.21.15.43:0/3017027356 conn(0x7f2b900711a0 msgr2=0x7f2b900fa0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:40.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.513+0000 7f2b96cac700 1 -- 172.21.15.43:0/3017027356 shutdown_connections 2023-12-08T20:32:40.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.513+0000 7f2b96cac700 1 -- 172.21.15.43:0/3017027356 wait complete. 2023-12-08T20:32:40.527 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:32:40.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.630+0000 7fc713671700 1 -- 172.21.15.43:0/2473887349 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc70c101b00 msgr2=0x7fc70c101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:40.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.630+0000 7fc713671700 1 --2- 172.21.15.43:0/2473887349 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc70c101b00 0x7fc70c101ed0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc708004940 tx=0x7fc708009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:40.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.630+0000 7fc713671700 1 -- 172.21.15.43:0/2473887349 shutdown_connections 2023-12-08T20:32:40.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.630+0000 7fc713671700 1 --2- 172.21.15.43:0/2473887349 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc70c0fbb40 0x7fc70c0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:40.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.630+0000 7fc713671700 1 --2- 172.21.15.43:0/2473887349 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc70c101b00 0x7fc70c101ed0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:40.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.631+0000 7fc713671700 1 -- 172.21.15.43:0/2473887349 >> 172.21.15.43:0/2473887349 conn(0x7fc70c0719b0 msgr2=0x7fc70c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:40.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.631+0000 7fc713671700 1 -- 172.21.15.43:0/2473887349 shutdown_connections 2023-12-08T20:32:40.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.631+0000 7fc713671700 1 -- 172.21.15.43:0/2473887349 wait complete. 2023-12-08T20:32:40.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.631+0000 7fc713671700 1 Processor -- start 2023-12-08T20:32:40.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.631+0000 7fc713671700 1 -- start start 2023-12-08T20:32:40.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.632+0000 7fc713671700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc70c0fbb40 0x7fc70c10e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:40.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.632+0000 7fc713671700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc70c101b00 0x7fc70c10eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:40.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.632+0000 7fc713671700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c10f130 con 0x7fc70c101b00 2023-12-08T20:32:40.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.632+0000 7fc713671700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c10f2a0 con 0x7fc70c0fbb40 2023-12-08T20:32:40.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.632+0000 7fc710c0c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc70c101b00 0x7fc70c10eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:40.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.632+0000 7fc710c0c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc70c101b00 0x7fc70c10eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55254/0 (socket says 172.21.15.43:55254) 2023-12-08T20:32:40.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.632+0000 7fc710c0c700 1 -- 172.21.15.43:0/3944685013 learned_addr learned my addr 172.21.15.43:0/3944685013 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:32:40.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.632+0000 7fc71140d700 1 --2- 172.21.15.43:0/3944685013 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc70c0fbb40 0x7fc70c10e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:40.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.632+0000 7fc710c0c700 1 -- 172.21.15.43:0/3944685013 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc70c0fbb40 msgr2=0x7fc70c10e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:40.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.632+0000 7fc710c0c700 1 --2- 172.21.15.43:0/3944685013 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc70c0fbb40 0x7fc70c10e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:40.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.632+0000 7fc710c0c700 1 -- 172.21.15.43:0/3944685013 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc708005040 con 0x7fc70c101b00 2023-12-08T20:32:40.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.633+0000 7fc710c0c700 1 --2- 172.21.15.43:0/3944685013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc70c101b00 0x7fc70c10eb80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00eb40 tx=0x7fc6fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:40.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.633+0000 7fc701ffb700 1 -- 172.21.15.43:0/3944685013 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6fc007cc0 con 0x7fc70c101b00 2023-12-08T20:32:40.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.633+0000 7fc701ffb700 1 -- 172.21.15.43:0/3944685013 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc6fc00f040 con 0x7fc70c101b00 2023-12-08T20:32:40.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.633+0000 7fc713671700 1 -- 172.21.15.43:0/3944685013 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70c1175b0 con 0x7fc70c101b00 2023-12-08T20:32:40.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.633+0000 7fc701ffb700 1 -- 172.21.15.43:0/3944685013 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6fc00c990 con 0x7fc70c101b00 2023-12-08T20:32:40.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.633+0000 7fc713671700 1 -- 172.21.15.43:0/3944685013 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70c117ac0 con 0x7fc70c101b00 2023-12-08T20:32:40.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.634+0000 7fc713671700 1 -- 172.21.15.43:0/3944685013 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70c103fb0 con 0x7fc70c101b00 2023-12-08T20:32:40.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.635+0000 7fc701ffb700 1 -- 172.21.15.43:0/3944685013 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fc6fc00caf0 con 0x7fc70c101b00 2023-12-08T20:32:40.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.635+0000 7fc701ffb700 1 --2- 172.21.15.43:0/3944685013 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fc6f806cf80 0x7fc6f806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:40.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.635+0000 7fc701ffb700 1 -- 172.21.15.43:0/3944685013 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc6fc08c020 con 0x7fc70c101b00 2023-12-08T20:32:40.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.635+0000 7fc71140d700 1 --2- 172.21.15.43:0/3944685013 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fc6f806cf80 0x7fc6f806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:40.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.636+0000 7fc71140d700 1 --2- 172.21.15.43:0/3944685013 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fc6f806cf80 0x7fc6f806f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc708000c00 tx=0x7fc708009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:40.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.640+0000 7fc701ffb700 1 -- 172.21.15.43:0/3944685013 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc6fc055e60 con 0x7fc70c101b00 2023-12-08T20:32:40.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.869+0000 7fc713671700 1 -- 172.21.15.43:0/3944685013 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc70c065b70 con 0x7fc6f806cf80 2023-12-08T20:32:40.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.871+0000 7fc701ffb700 1 -- 172.21.15.43:0/3944685013 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc70c065b70 con 0x7fc6f806cf80 2023-12-08T20:32:40.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.873+0000 7fc713671700 1 -- 172.21.15.43:0/3944685013 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fc6f806cf80 msgr2=0x7fc6f806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:40.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.873+0000 7fc713671700 1 --2- 172.21.15.43:0/3944685013 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fc6f806cf80 0x7fc6f806f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc708000c00 tx=0x7fc708009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:40.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.873+0000 7fc713671700 1 -- 172.21.15.43:0/3944685013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc70c101b00 msgr2=0x7fc70c10eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:40.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.873+0000 7fc713671700 1 --2- 172.21.15.43:0/3944685013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc70c101b00 0x7fc70c10eb80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00eb40 tx=0x7fc6fc00b040 comp rx=0 tx=0).stop 2023-12-08T20:32:40.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.873+0000 7fc713671700 1 -- 172.21.15.43:0/3944685013 shutdown_connections 2023-12-08T20:32:40.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.873+0000 7fc713671700 1 --2- 172.21.15.43:0/3944685013 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fc6f806cf80 0x7fc6f806f430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:40.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.873+0000 7fc713671700 1 --2- 172.21.15.43:0/3944685013 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc70c0fbb40 0x7fc70c10e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:40.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.873+0000 7fc713671700 1 --2- 172.21.15.43:0/3944685013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc70c101b00 0x7fc70c10eb80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:40.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.873+0000 7fc713671700 1 -- 172.21.15.43:0/3944685013 >> 172.21.15.43:0/3944685013 conn(0x7fc70c0719b0 msgr2=0x7fc70c0faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:40.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.873+0000 7fc713671700 1 -- 172.21.15.43:0/3944685013 shutdown_connections 2023-12-08T20:32:40.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.873+0000 7fc713671700 1 -- 172.21.15.43:0/3944685013 wait complete. 2023-12-08T20:32:40.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.992+0000 7fb36b6c3700 1 -- 172.21.15.43:0/2685708842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb364065390 msgr2=0x7fb364065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:40.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.992+0000 7fb36b6c3700 1 --2- 172.21.15.43:0/2685708842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb364065390 0x7fb364065800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb354004940 tx=0x7fb354009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:40.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.992+0000 7fb36b6c3700 1 -- 172.21.15.43:0/2685708842 shutdown_connections 2023-12-08T20:32:40.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.992+0000 7fb36b6c3700 1 --2- 172.21.15.43:0/2685708842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb364065390 0x7fb364065800 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:40.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.992+0000 7fb36b6c3700 1 --2- 172.21.15.43:0/2685708842 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb364102c20 0x7fb364102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:40.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.992+0000 7fb36b6c3700 1 -- 172.21.15.43:0/2685708842 >> 172.21.15.43:0/2685708842 conn(0x7fb3640719b0 msgr2=0x7fb364071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:40.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.993+0000 7fb36b6c3700 1 -- 172.21.15.43:0/2685708842 shutdown_connections 2023-12-08T20:32:40.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.993+0000 7fb36b6c3700 1 -- 172.21.15.43:0/2685708842 wait complete. 2023-12-08T20:32:40.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.993+0000 7fb36b6c3700 1 Processor -- start 2023-12-08T20:32:40.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.993+0000 7fb36b6c3700 1 -- start start 2023-12-08T20:32:40.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.994+0000 7fb36b6c3700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb364065390 0x7fb364113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:40.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.994+0000 7fb36b6c3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb364102c20 0x7fb364113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:40.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.994+0000 7fb36b6c3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3641142c0 con 0x7fb364102c20 2023-12-08T20:32:41.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.994+0000 7fb36b6c3700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36410d5f0 con 0x7fb364065390 2023-12-08T20:32:41.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.994+0000 7fb368c5e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb364102c20 0x7fb364113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:41.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.994+0000 7fb368c5e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb364102c20 0x7fb364113c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55270/0 (socket says 172.21.15.43:55270) 2023-12-08T20:32:41.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.994+0000 7fb368c5e700 1 -- 172.21.15.43:0/2846288497 learned_addr learned my addr 172.21.15.43:0/2846288497 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:32:41.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.994+0000 7fb36945f700 1 --2- 172.21.15.43:0/2846288497 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb364065390 0x7fb364113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:41.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.994+0000 7fb368c5e700 1 -- 172.21.15.43:0/2846288497 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb364065390 msgr2=0x7fb364113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:41.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.994+0000 7fb368c5e700 1 --2- 172.21.15.43:0/2846288497 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb364065390 0x7fb364113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:41.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.994+0000 7fb368c5e700 1 -- 172.21.15.43:0/2846288497 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb354005040 con 0x7fb364102c20 2023-12-08T20:32:41.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.994+0000 7fb36945f700 1 --2- 172.21.15.43:0/2846288497 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb364065390 0x7fb364113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T20:32:41.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.994+0000 7fb368c5e700 1 --2- 172.21.15.43:0/2846288497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb364102c20 0x7fb364113c70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb354009180 tx=0x7fb354009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:41.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.995+0000 7fb359ffb700 1 -- 172.21.15.43:0/2846288497 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb35400e040 con 0x7fb364102c20 2023-12-08T20:32:41.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.995+0000 7fb36b6c3700 1 -- 172.21.15.43:0/2846288497 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb36410d870 con 0x7fb364102c20 2023-12-08T20:32:41.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.995+0000 7fb359ffb700 1 -- 172.21.15.43:0/2846288497 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb354013420 con 0x7fb364102c20 2023-12-08T20:32:41.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.995+0000 7fb359ffb700 1 -- 172.21.15.43:0/2846288497 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb35401c630 con 0x7fb364102c20 2023-12-08T20:32:41.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.995+0000 7fb36b6c3700 1 -- 172.21.15.43:0/2846288497 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36410ddb0 con 0x7fb364102c20 2023-12-08T20:32:41.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.996+0000 7fb36b6c3700 1 -- 172.21.15.43:0/2846288497 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3640fff40 con 0x7fb364102c20 2023-12-08T20:32:41.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.997+0000 7fb359ffb700 1 -- 172.21.15.43:0/2846288497 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fb3540139e0 con 0x7fb364102c20 2023-12-08T20:32:41.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.997+0000 7fb359ffb700 1 --2- 172.21.15.43:0/2846288497 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb35006cf80 0x7fb35006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:41.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.997+0000 7fb359ffb700 1 -- 172.21.15.43:0/2846288497 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb35408d790 con 0x7fb364102c20 2023-12-08T20:32:41.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.997+0000 7fb36945f700 1 --2- 172.21.15.43:0/2846288497 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb35006cf80 0x7fb35006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:41.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:40.998+0000 7fb36945f700 1 --2- 172.21.15.43:0/2846288497 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb35006cf80 0x7fb35006f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb360009fd0 tx=0x7fb36000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:41.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.006+0000 7fb359ffb700 1 -- 172.21.15.43:0/2846288497 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb35405b050 con 0x7fb364102c20 2023-12-08T20:32:41.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.235+0000 7fb36b6c3700 1 -- 172.21.15.43:0/2846288497 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb36404bb80 con 0x7fb35006cf80 2023-12-08T20:32:41.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.248+0000 7fb359ffb700 1 -- 172.21.15.43:0/2846288497 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fb36404bb80 con 0x7fb35006cf80 2023-12-08T20:32:41.250 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-08T20:32:41.250 INFO:teuthology.orchestra.run.smithi043.stdout:alertmanager.smithi043 smithi043 *:9093,9094 running (2m) 26s ago 10m 26.4M - 0.25.0 c8568f914cd2 d4a6cd00c86b 2023-12-08T20:32:41.250 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi043 smithi043 running (49s) 26s ago 11m 7482k - 19.0.0-44-g9dcc13bb f28f2b94f153 f570eddb8e8a 2023-12-08T20:32:41.250 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi111 smithi111 running (45s) 43s ago 10m 7453k - 19.0.0-44-g9dcc13bb f28f2b94f153 b2013e24b94e 2023-12-08T20:32:41.250 INFO:teuthology.orchestra.run.smithi043.stdout:grafana.smithi043 smithi043 *:3000 running (2m) 26s ago 10m 84.4M - 9.4.7 954c08fa6188 8f55491a980b 2023-12-08T20:32:41.250 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.akrjef smithi043 running (6m) 26s ago 6m 18.6M - 17.2.7-119-ge2143d99 f761b6e42225 1c0cb8d34ef8 2023-12-08T20:32:41.250 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.pjmszb smithi043 running (6m) 26s ago 6m 7153M - 17.2.7-119-ge2143d99 f761b6e42225 d7eee0c78093 2023-12-08T20:32:41.250 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.svpasm smithi111 running (6m) 43s ago 6m 16.2M - 17.2.7-119-ge2143d99 f761b6e42225 657d4d1cf4b2 2023-12-08T20:32:41.250 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.veeegc smithi111 running (6m) 43s ago 6m 3706M - 17.2.7-119-ge2143d99 f761b6e42225 31f794a388ab 2023-12-08T20:32:41.250 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi043.hqcdcm smithi043 *:8443,9283,8765 running (4m) 26s ago 12m 507M - 19.0.0-44-g9dcc13bb f28f2b94f153 14e91c1dac64 2023-12-08T20:32:41.251 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi111.mtcffu smithi111 *:8443,9283,8765 running (3m) 43s ago 10m 449M - 19.0.0-44-g9dcc13bb f28f2b94f153 56f4290c6db5 2023-12-08T20:32:41.251 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi043 smithi043 running (95s) 26s ago 12m 52.4M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 3597e3a60ebc 2023-12-08T20:32:41.251 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi111 smithi111 running (75s) 43s ago 10m 38.6M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 528aa182165f 2023-12-08T20:32:41.251 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi043 smithi043 *:9100 running (3m) 26s ago 10m 17.0M - 1.5.0 0da6a335fe13 0959b44d9972 2023-12-08T20:32:41.251 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi111 smithi111 *:9100 running (3m) 43s ago 10m 17.9M - 1.5.0 0da6a335fe13 10fe4fdb23d0 2023-12-08T20:32:41.251 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (30s) 26s ago 9m 15.2M 1570M 19.0.0-44-g9dcc13bb f28f2b94f153 298e9b98d7a4 2023-12-08T20:32:41.251 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi043 running (9m) 26s ago 9m 861M 1570M 17.2.7-119-ge2143d99 f761b6e42225 dde419c88a89 2023-12-08T20:32:41.251 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi043 running (8m) 26s ago 8m 644M 1570M 17.2.7-119-ge2143d99 f761b6e42225 f7e812026ef5 2023-12-08T20:32:41.251 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi111 running (8m) 43s ago 8m 980M 2592M 17.2.7-119-ge2143d99 f761b6e42225 2a738d30441c 2023-12-08T20:32:41.251 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi111 running (8m) 43s ago 8m 720M 2592M 17.2.7-119-ge2143d99 f761b6e42225 38cdb6a88694 2023-12-08T20:32:41.251 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi111 running (7m) 43s ago 7m 873M 2592M 17.2.7-119-ge2143d99 f761b6e42225 59a9ce8c1141 2023-12-08T20:32:41.251 INFO:teuthology.orchestra.run.smithi043.stdout:prometheus.smithi043 smithi043 *:9095 running (3m) 26s ago 10m 57.5M - 2.43.0 a07b618ecd1d d95914ec88d8 2023-12-08T20:32:41.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.250+0000 7fb36b6c3700 1 -- 172.21.15.43:0/2846288497 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb35006cf80 msgr2=0x7fb35006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:41.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.250+0000 7fb36b6c3700 1 --2- 172.21.15.43:0/2846288497 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb35006cf80 0x7fb35006f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb360009fd0 tx=0x7fb36000b040 comp rx=0 tx=0).stop 2023-12-08T20:32:41.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.250+0000 7fb36b6c3700 1 -- 172.21.15.43:0/2846288497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb364102c20 msgr2=0x7fb364113c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:41.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.250+0000 7fb36b6c3700 1 --2- 172.21.15.43:0/2846288497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb364102c20 0x7fb364113c70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb354009180 tx=0x7fb354009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:41.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.250+0000 7fb36b6c3700 1 -- 172.21.15.43:0/2846288497 shutdown_connections 2023-12-08T20:32:41.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.250+0000 7fb36b6c3700 1 --2- 172.21.15.43:0/2846288497 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb35006cf80 0x7fb35006f430 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:41.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.250+0000 7fb36b6c3700 1 --2- 172.21.15.43:0/2846288497 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb364065390 0x7fb364113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:41.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.250+0000 7fb36b6c3700 1 --2- 172.21.15.43:0/2846288497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb364102c20 0x7fb364113c70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:41.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.250+0000 7fb36b6c3700 1 -- 172.21.15.43:0/2846288497 >> 172.21.15.43:0/2846288497 conn(0x7fb3640719b0 msgr2=0x7fb3640fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:41.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.250+0000 7fb36b6c3700 1 -- 172.21.15.43:0/2846288497 shutdown_connections 2023-12-08T20:32:41.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.250+0000 7fb36b6c3700 1 -- 172.21.15.43:0/2846288497 wait complete. 2023-12-08T20:32:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.364+0000 7fbdfd09b700 1 -- 172.21.15.43:0/2195271911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf806ffe0 msgr2=0x7fbdf80703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.364+0000 7fbdfd09b700 1 --2- 172.21.15.43:0/2195271911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf806ffe0 0x7fbdf80703b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbdec004970 tx=0x7fbdec009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.364+0000 7fbdfd09b700 1 -- 172.21.15.43:0/2195271911 shutdown_connections 2023-12-08T20:32:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.364+0000 7fbdfd09b700 1 --2- 172.21.15.43:0/2195271911 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdf80708f0 0x7fbdf8108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.364+0000 7fbdfd09b700 1 --2- 172.21.15.43:0/2195271911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf806ffe0 0x7fbdf80703b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.364+0000 7fbdfd09b700 1 -- 172.21.15.43:0/2195271911 >> 172.21.15.43:0/2195271911 conn(0x7fbdf80f8790 msgr2=0x7fbdf80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.364+0000 7fbdfd09b700 1 -- 172.21.15.43:0/2195271911 shutdown_connections 2023-12-08T20:32:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.364+0000 7fbdfd09b700 1 -- 172.21.15.43:0/2195271911 wait complete. 2023-12-08T20:32:41.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.365+0000 7fbdfd09b700 1 Processor -- start 2023-12-08T20:32:41.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.365+0000 7fbdfd09b700 1 -- start start 2023-12-08T20:32:41.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.365+0000 7fbdfd09b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf806ffe0 0x7fbdf81157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:41.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.365+0000 7fbdfd09b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdf80708f0 0x7fbdf8115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:41.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.365+0000 7fbdfd09b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8116380 con 0x7fbdf806ffe0 2023-12-08T20:32:41.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.365+0000 7fbdfd09b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf810f6b0 con 0x7fbdf80708f0 2023-12-08T20:32:41.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.365+0000 7fbdf6d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf806ffe0 0x7fbdf81157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:41.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.365+0000 7fbdf6d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf806ffe0 0x7fbdf81157f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55288/0 (socket says 172.21.15.43:55288) 2023-12-08T20:32:41.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.365+0000 7fbdf6d9d700 1 -- 172.21.15.43:0/2326217373 learned_addr learned my addr 172.21.15.43:0/2326217373 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:32:41.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.365+0000 7fbdf659c700 1 --2- 172.21.15.43:0/2326217373 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdf80708f0 0x7fbdf8115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:41.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.365+0000 7fbdf6d9d700 1 -- 172.21.15.43:0/2326217373 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdf80708f0 msgr2=0x7fbdf8115d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:41.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.365+0000 7fbdf6d9d700 1 --2- 172.21.15.43:0/2326217373 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdf80708f0 0x7fbdf8115d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:41.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.365+0000 7fbdf6d9d700 1 -- 172.21.15.43:0/2326217373 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec005040 con 0x7fbdf806ffe0 2023-12-08T20:32:41.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.365+0000 7fbdf659c700 1 --2- 172.21.15.43:0/2326217373 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdf80708f0 0x7fbdf8115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T20:32:41.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.366+0000 7fbdf6d9d700 1 --2- 172.21.15.43:0/2326217373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf806ffe0 0x7fbdf81157f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbdec00b370 tx=0x7fbdec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:41.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.366+0000 7fbddf7fe700 1 -- 172.21.15.43:0/2326217373 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdec00e040 con 0x7fbdf806ffe0 2023-12-08T20:32:41.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.366+0000 7fbdfd09b700 1 -- 172.21.15.43:0/2326217373 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf810f930 con 0x7fbdf806ffe0 2023-12-08T20:32:41.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.366+0000 7fbddf7fe700 1 -- 172.21.15.43:0/2326217373 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbdec009af0 con 0x7fbdf806ffe0 2023-12-08T20:32:41.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.366+0000 7fbddf7fe700 1 -- 172.21.15.43:0/2326217373 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdec013ea0 con 0x7fbdf806ffe0 2023-12-08T20:32:41.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.366+0000 7fbdfd09b700 1 -- 172.21.15.43:0/2326217373 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf810fe70 con 0x7fbdf806ffe0 2023-12-08T20:32:41.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.367+0000 7fbdfd09b700 1 -- 172.21.15.43:0/2326217373 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf81065d0 con 0x7fbdf806ffe0 2023-12-08T20:32:41.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.368+0000 7fbddf7fe700 1 -- 172.21.15.43:0/2326217373 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fbdec013420 con 0x7fbdf806ffe0 2023-12-08T20:32:41.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.368+0000 7fbddf7fe700 1 --2- 172.21.15.43:0/2326217373 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fbde006cf80 0x7fbde006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:41.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.368+0000 7fbddf7fe700 1 -- 172.21.15.43:0/2326217373 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fbdec08e1f0 con 0x7fbdf806ffe0 2023-12-08T20:32:41.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.368+0000 7fbdf659c700 1 --2- 172.21.15.43:0/2326217373 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fbde006cf80 0x7fbde006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:41.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.369+0000 7fbdf659c700 1 --2- 172.21.15.43:0/2326217373 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fbde006cf80 0x7fbde006f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8111020 tx=0x7fbde800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:41.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.373+0000 7fbddf7fe700 1 -- 172.21.15.43:0/2326217373 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbdec05bab0 con 0x7fbdf806ffe0 2023-12-08T20:32:41.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:41 smithi111 ceph-mon[182474]: pgmap v53: 65 pgs: 12 stale+active+clean, 53 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:41.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:41 smithi043 ceph-mon[219193]: pgmap v53: 65 pgs: 12 stale+active+clean, 53 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:41.514 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:41 smithi043 bash[239114]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-08T20:32:41.514 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:41 smithi043 bash[239114]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-08T20:32:41.514 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:41 smithi043 bash[239114]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-08T20:32:41.514 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:41 smithi043 bash[239114]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-08T20:32:41.514 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:41 smithi043 bash[239114]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2023-12-08T20:32:41.515 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:41 smithi043 bash[239114]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-08T20:32:41.515 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:41 smithi043 bash[239114]: --> ceph-volume raw activate successful for osd ID: 1 2023-12-08T20:32:41.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.693+0000 7fbdfd09b700 1 -- 172.21.15.43:0/2326217373 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbdf80fc390 con 0x7fbdf806ffe0 2023-12-08T20:32:41.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.693+0000 7fbddf7fe700 1 -- 172.21.15.43:0/2326217373 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7fbdec05b640 con 0x7fbdf806ffe0 2023-12-08T20:32:41.695 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:32:41.695 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": { 2023-12-08T20:32:41.695 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:32:41.695 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:32:41.695 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": { 2023-12-08T20:32:41.695 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:32:41.696 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:32:41.696 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": { 2023-12-08T20:32:41.696 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4, 2023-12-08T20:32:41.696 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 1 2023-12-08T20:32:41.696 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:32:41.696 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2023-12-08T20:32:41.696 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-08T20:32:41.696 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:32:41.696 INFO:teuthology.orchestra.run.smithi043.stdout: "overall": { 2023-12-08T20:32:41.696 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 8, 2023-12-08T20:32:41.696 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 5 2023-12-08T20:32:41.696 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-12-08T20:32:41.696 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:32:41.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.696+0000 7fbdfd09b700 1 -- 172.21.15.43:0/2326217373 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fbde006cf80 msgr2=0x7fbde006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:41.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.696+0000 7fbdfd09b700 1 --2- 172.21.15.43:0/2326217373 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fbde006cf80 0x7fbde006f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8111020 tx=0x7fbde800b040 comp rx=0 tx=0).stop 2023-12-08T20:32:41.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.696+0000 7fbdfd09b700 1 -- 172.21.15.43:0/2326217373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf806ffe0 msgr2=0x7fbdf81157f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:41.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.696+0000 7fbdfd09b700 1 --2- 172.21.15.43:0/2326217373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf806ffe0 0x7fbdf81157f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbdec00b370 tx=0x7fbdec009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:41.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.696+0000 7fbdfd09b700 1 -- 172.21.15.43:0/2326217373 shutdown_connections 2023-12-08T20:32:41.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.696+0000 7fbdfd09b700 1 --2- 172.21.15.43:0/2326217373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf806ffe0 0x7fbdf81157f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:41.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.696+0000 7fbdfd09b700 1 --2- 172.21.15.43:0/2326217373 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fbde006cf80 0x7fbde006f430 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:41.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.696+0000 7fbdfd09b700 1 --2- 172.21.15.43:0/2326217373 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdf80708f0 0x7fbdf8115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:41.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.696+0000 7fbdfd09b700 1 -- 172.21.15.43:0/2326217373 >> 172.21.15.43:0/2326217373 conn(0x7fbdf80f8790 msgr2=0x7fbdf8103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:41.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.696+0000 7fbdfd09b700 1 -- 172.21.15.43:0/2326217373 shutdown_connections 2023-12-08T20:32:41.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.696+0000 7fbdfd09b700 1 -- 172.21.15.43:0/2326217373 wait complete. 2023-12-08T20:32:41.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.821+0000 7f2454fec700 1 -- 172.21.15.43:0/1165123162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2450102c70 msgr2=0x7f2450103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:41.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.821+0000 7f2454fec700 1 --2- 172.21.15.43:0/1165123162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2450102c70 0x7f2450103040 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2440004940 tx=0x7f2440009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:41.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.821+0000 7f2454fec700 1 -- 172.21.15.43:0/1165123162 shutdown_connections 2023-12-08T20:32:41.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.821+0000 7f2454fec700 1 --2- 172.21.15.43:0/1165123162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24500fb1e0 0x7f24500fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:41.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.821+0000 7f2454fec700 1 --2- 172.21.15.43:0/1165123162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2450102c70 0x7f2450103040 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:41.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.821+0000 7f2454fec700 1 -- 172.21.15.43:0/1165123162 >> 172.21.15.43:0/1165123162 conn(0x7f24500711a0 msgr2=0x7f24500715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:41.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.821+0000 7f2454fec700 1 -- 172.21.15.43:0/1165123162 shutdown_connections 2023-12-08T20:32:41.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.821+0000 7f2454fec700 1 -- 172.21.15.43:0/1165123162 wait complete. 2023-12-08T20:32:41.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.822+0000 7f2454fec700 1 Processor -- start 2023-12-08T20:32:41.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.822+0000 7f2454fec700 1 -- start start 2023-12-08T20:32:41.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.822+0000 7f2454fec700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24500fb1e0 0x7f2450113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:41.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.822+0000 7f2454fec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2450102c70 0x7f2450113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:41.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.822+0000 7f2454fec700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2450114100 con 0x7f2450102c70 2023-12-08T20:32:41.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.822+0000 7f2454fec700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245010d430 con 0x7f24500fb1e0 2023-12-08T20:32:41.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.822+0000 7f244dd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2450102c70 0x7f2450113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:41.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.822+0000 7f244dd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2450102c70 0x7f2450113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55322/0 (socket says 172.21.15.43:55322) 2023-12-08T20:32:41.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.822+0000 7f244dd9b700 1 -- 172.21.15.43:0/1006667682 learned_addr learned my addr 172.21.15.43:0/1006667682 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:32:41.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.822+0000 7f244e59c700 1 --2- 172.21.15.43:0/1006667682 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24500fb1e0 0x7f2450113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:41.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.823+0000 7f244dd9b700 1 -- 172.21.15.43:0/1006667682 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24500fb1e0 msgr2=0x7f2450113570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:41.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.823+0000 7f244dd9b700 1 --2- 172.21.15.43:0/1006667682 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24500fb1e0 0x7f2450113570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:41.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.823+0000 7f244dd9b700 1 -- 172.21.15.43:0/1006667682 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2440005040 con 0x7f2450102c70 2023-12-08T20:32:41.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.823+0000 7f244dd9b700 1 --2- 172.21.15.43:0/1006667682 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2450102c70 0x7f2450113ab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2444002a80 tx=0x7f24440046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:41.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.823+0000 7f243effd700 1 -- 172.21.15.43:0/1006667682 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2444007cc0 con 0x7f2450102c70 2023-12-08T20:32:41.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.823+0000 7f243effd700 1 -- 172.21.15.43:0/1006667682 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f244400f040 con 0x7f2450102c70 2023-12-08T20:32:41.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.823+0000 7f2454fec700 1 -- 172.21.15.43:0/1006667682 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245010d710 con 0x7f2450102c70 2023-12-08T20:32:41.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.823+0000 7f243effd700 1 -- 172.21.15.43:0/1006667682 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2444009640 con 0x7f2450102c70 2023-12-08T20:32:41.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.823+0000 7f2454fec700 1 -- 172.21.15.43:0/1006667682 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245010dc50 con 0x7f2450102c70 2023-12-08T20:32:41.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.824+0000 7f2454fec700 1 -- 172.21.15.43:0/1006667682 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2450072cc0 con 0x7f2450102c70 2023-12-08T20:32:41.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.825+0000 7f243effd700 1 -- 172.21.15.43:0/1006667682 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f24440097a0 con 0x7f2450102c70 2023-12-08T20:32:41.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.825+0000 7f243effd700 1 --2- 172.21.15.43:0/1006667682 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f243806cf80 0x7f243806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:41.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.825+0000 7f243effd700 1 -- 172.21.15.43:0/1006667682 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f244408bc00 con 0x7f2450102c70 2023-12-08T20:32:41.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.825+0000 7f244e59c700 1 --2- 172.21.15.43:0/1006667682 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f243806cf80 0x7f243806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:41.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.826+0000 7f244e59c700 1 --2- 172.21.15.43:0/1006667682 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f243806cf80 0x7f243806f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f244000b3b0 tx=0x7f2440009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:41.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:41.830+0000 7f243effd700 1 -- 172.21.15.43:0/1006667682 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2444091020 con 0x7f2450102c70 2023-12-08T20:32:42.087 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:41 smithi043 ceph-osd[239487]: -- 172.21.15.43:0/3585469203 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5570d65751e0 con 0x5570d6545000 2023-12-08T20:32:42.087 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:41 smithi043 bash[239446]: 1ad10def08c3a07c84b28d2ca1b973ae0e85c2d8c47f0c192bf4a889e2eda041 2023-12-08T20:32:42.087 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:41 smithi043 systemd[1]: Started Ceph osd.1 for 28476818-9607-11ee-95a3-87774f69a715. 2023-12-08T20:32:42.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.101+0000 7f2454fec700 1 -- 172.21.15.43:0/1006667682 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2450109b70 con 0x7f2450102c70 2023-12-08T20:32:42.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.102+0000 7f243effd700 1 -- 172.21.15.43:0/1006667682 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1855 (secure 0 0 0) 0x7f2444059420 con 0x7f2450102c70 2023-12-08T20:32:42.104 INFO:teuthology.orchestra.run.smithi043.stdout:e17 2023-12-08T20:32:42.104 INFO:teuthology.orchestra.run.smithi043.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-08T20:32:42.104 INFO:teuthology.orchestra.run.smithi043.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:32:42.105 INFO:teuthology.orchestra.run.smithi043.stdout:legacy client fscid: 1 2023-12-08T20:32:42.105 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:32:42.105 INFO:teuthology.orchestra.run.smithi043.stdout:Filesystem 'cephfs' (1) 2023-12-08T20:32:42.105 INFO:teuthology.orchestra.run.smithi043.stdout:fs_name cephfs 2023-12-08T20:32:42.105 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 17 2023-12-08T20:32:42.105 INFO:teuthology.orchestra.run.smithi043.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-08T20:32:42.105 INFO:teuthology.orchestra.run.smithi043.stdout:created 2023-12-08T20:25:41.527734+0000 2023-12-08T20:32:42.105 INFO:teuthology.orchestra.run.smithi043.stdout:modified 2023-12-08T20:32:04.068774+0000 2023-12-08T20:32:42.105 INFO:teuthology.orchestra.run.smithi043.stdout:tableserver 0 2023-12-08T20:32:42.105 INFO:teuthology.orchestra.run.smithi043.stdout:root 0 2023-12-08T20:32:42.105 INFO:teuthology.orchestra.run.smithi043.stdout:session_timeout 60 2023-12-08T20:32:42.105 INFO:teuthology.orchestra.run.smithi043.stdout:session_autoclose 300 2023-12-08T20:32:42.105 INFO:teuthology.orchestra.run.smithi043.stdout:max_file_size 1099511627776 2023-12-08T20:32:42.105 INFO:teuthology.orchestra.run.smithi043.stdout:max_xattr_size 65536 2023-12-08T20:32:42.105 INFO:teuthology.orchestra.run.smithi043.stdout:required_client_features {} 2023-12-08T20:32:42.105 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure 0 2023-12-08T20:32:42.106 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure_osd_epoch 0 2023-12-08T20:32:42.106 INFO:teuthology.orchestra.run.smithi043.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:32:42.106 INFO:teuthology.orchestra.run.smithi043.stdout:max_mds 2 2023-12-08T20:32:42.106 INFO:teuthology.orchestra.run.smithi043.stdout:in 0,1 2023-12-08T20:32:42.106 INFO:teuthology.orchestra.run.smithi043.stdout:up {0=14452,1=24315} 2023-12-08T20:32:42.106 INFO:teuthology.orchestra.run.smithi043.stdout:failed 2023-12-08T20:32:42.106 INFO:teuthology.orchestra.run.smithi043.stdout:damaged 2023-12-08T20:32:42.106 INFO:teuthology.orchestra.run.smithi043.stdout:stopped 2023-12-08T20:32:42.106 INFO:teuthology.orchestra.run.smithi043.stdout:data_pools [3] 2023-12-08T20:32:42.106 INFO:teuthology.orchestra.run.smithi043.stdout:metadata_pool 2 2023-12-08T20:32:42.106 INFO:teuthology.orchestra.run.smithi043.stdout:inline_data disabled 2023-12-08T20:32:42.106 INFO:teuthology.orchestra.run.smithi043.stdout:balancer 2023-12-08T20:32:42.106 INFO:teuthology.orchestra.run.smithi043.stdout:bal_rank_mask -1 2023-12-08T20:32:42.106 INFO:teuthology.orchestra.run.smithi043.stdout:standby_count_wanted 1 2023-12-08T20:32:42.106 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi043.pjmszb{0:14452} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.43:6826/441584552,v1:172.21.15.43:6827/441584552] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:32:42.107 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi111.veeegc{1:24315} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.111:6824/1990395192,v1:172.21.15.111:6825/1990395192] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:32:42.107 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:32:42.107 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:32:42.107 INFO:teuthology.orchestra.run.smithi043.stdout:Standby daemons: 2023-12-08T20:32:42.107 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:32:42.107 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi043.akrjef{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.43:6828/2926918083,v1:172.21.15.43:6829/2926918083] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:32:42.107 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi111.svpasm{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6826/2885759138,v1:172.21.15.111:6827/2885759138] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:32:42.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.104+0000 7f2454fec700 1 -- 172.21.15.43:0/1006667682 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f243806cf80 msgr2=0x7f243806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:42.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.104+0000 7f2454fec700 1 --2- 172.21.15.43:0/1006667682 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f243806cf80 0x7f243806f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f244000b3b0 tx=0x7f2440009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:42.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.104+0000 7f2454fec700 1 -- 172.21.15.43:0/1006667682 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2450102c70 msgr2=0x7f2450113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:42.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.104+0000 7f2454fec700 1 --2- 172.21.15.43:0/1006667682 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2450102c70 0x7f2450113ab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2444002a80 tx=0x7f24440046b0 comp rx=0 tx=0).stop 2023-12-08T20:32:42.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.104+0000 7f2454fec700 1 -- 172.21.15.43:0/1006667682 shutdown_connections 2023-12-08T20:32:42.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.104+0000 7f2454fec700 1 --2- 172.21.15.43:0/1006667682 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f243806cf80 0x7f243806f430 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:42.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.104+0000 7f2454fec700 1 --2- 172.21.15.43:0/1006667682 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24500fb1e0 0x7f2450113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:42.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.104+0000 7f2454fec700 1 --2- 172.21.15.43:0/1006667682 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2450102c70 0x7f2450113ab0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:42.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.104+0000 7f2454fec700 1 -- 172.21.15.43:0/1006667682 >> 172.21.15.43:0/1006667682 conn(0x7f24500711a0 msgr2=0x7f24500fa0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:42.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.104+0000 7f2454fec700 1 -- 172.21.15.43:0/1006667682 shutdown_connections 2023-12-08T20:32:42.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.105+0000 7f2454fec700 1 -- 172.21.15.43:0/1006667682 wait complete. 2023-12-08T20:32:42.109 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 17 2023-12-08T20:32:42.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.228+0000 7f25f1022700 1 -- 172.21.15.43:0/2886947928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25ec101c10 msgr2=0x7f25ec0fb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:42.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.228+0000 7f25f1022700 1 --2- 172.21.15.43:0/2886947928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25ec101c10 0x7f25ec0fb2d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f25e0004940 tx=0x7f25e0009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:42.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.228+0000 7f25f1022700 1 -- 172.21.15.43:0/2886947928 shutdown_connections 2023-12-08T20:32:42.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.228+0000 7f25f1022700 1 --2- 172.21.15.43:0/2886947928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25ec101c10 0x7f25ec0fb2d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:42.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.228+0000 7f25f1022700 1 --2- 172.21.15.43:0/2886947928 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25ec101270 0x7f25ec101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:42.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.228+0000 7f25f1022700 1 -- 172.21.15.43:0/2886947928 >> 172.21.15.43:0/2886947928 conn(0x7f25ec0711a0 msgr2=0x7f25ec0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:42.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.228+0000 7f25f1022700 1 -- 172.21.15.43:0/2886947928 shutdown_connections 2023-12-08T20:32:42.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.228+0000 7f25f1022700 1 -- 172.21.15.43:0/2886947928 wait complete. 2023-12-08T20:32:42.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.229+0000 7f25f1022700 1 Processor -- start 2023-12-08T20:32:42.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.229+0000 7f25f1022700 1 -- start start 2023-12-08T20:32:42.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.229+0000 7f25f1022700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25ec101270 0x7f25ec114450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:42.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.229+0000 7f25f1022700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25ec101c10 0x7f25ec10b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:42.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.229+0000 7f25f1022700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec114ae0 con 0x7f25ec101270 2023-12-08T20:32:42.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.229+0000 7f25f1022700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec10b770 con 0x7f25ec101c10 2023-12-08T20:32:42.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.230+0000 7f25ead9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25ec101270 0x7f25ec114450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:42.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.230+0000 7f25ead9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25ec101270 0x7f25ec114450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55348/0 (socket says 172.21.15.43:55348) 2023-12-08T20:32:42.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.230+0000 7f25ead9d700 1 -- 172.21.15.43:0/4214745378 learned_addr learned my addr 172.21.15.43:0/4214745378 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:32:42.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.230+0000 7f25ea59c700 1 --2- 172.21.15.43:0/4214745378 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25ec101c10 0x7f25ec10b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:42.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.230+0000 7f25ead9d700 1 -- 172.21.15.43:0/4214745378 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25ec101c10 msgr2=0x7f25ec10b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:42.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.230+0000 7f25ead9d700 1 --2- 172.21.15.43:0/4214745378 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25ec101c10 0x7f25ec10b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:42.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.230+0000 7f25ead9d700 1 -- 172.21.15.43:0/4214745378 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e0005040 con 0x7f25ec101270 2023-12-08T20:32:42.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.230+0000 7f25ead9d700 1 --2- 172.21.15.43:0/4214745378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25ec101270 0x7f25ec114450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00a6c0 tx=0x7f25dc00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:42.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.230+0000 7f25d37fe700 1 -- 172.21.15.43:0/4214745378 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25dc00ab50 con 0x7f25ec101270 2023-12-08T20:32:42.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.231+0000 7f25d37fe700 1 -- 172.21.15.43:0/4214745378 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f25dc010040 con 0x7f25ec101270 2023-12-08T20:32:42.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.231+0000 7f25d37fe700 1 -- 172.21.15.43:0/4214745378 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25dc00e920 con 0x7f25ec101270 2023-12-08T20:32:42.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.231+0000 7f25f1022700 1 -- 172.21.15.43:0/4214745378 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ec10b9f0 con 0x7f25ec101270 2023-12-08T20:32:42.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.231+0000 7f25f1022700 1 -- 172.21.15.43:0/4214745378 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25ec10bf30 con 0x7f25ec101270 2023-12-08T20:32:42.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.232+0000 7f25f1022700 1 -- 172.21.15.43:0/4214745378 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25ec072cc0 con 0x7f25ec101270 2023-12-08T20:32:42.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.233+0000 7f25d37fe700 1 -- 172.21.15.43:0/4214745378 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f25dc007cc0 con 0x7f25ec101270 2023-12-08T20:32:42.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.233+0000 7f25d37fe700 1 --2- 172.21.15.43:0/4214745378 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f25d406cf80 0x7f25d406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:42.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.233+0000 7f25d37fe700 1 -- 172.21.15.43:0/4214745378 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f25dc08bcc0 con 0x7f25ec101270 2023-12-08T20:32:42.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.233+0000 7f25ea59c700 1 --2- 172.21.15.43:0/4214745378 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f25d406cf80 0x7f25d406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:42.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.234+0000 7f25ea59c700 1 --2- 172.21.15.43:0/4214745378 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f25d406cf80 0x7f25d406f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f25ec10cc30 tx=0x7f25e0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:42.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.238+0000 7f25d37fe700 1 -- 172.21.15.43:0/4214745378 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f25dc0595b0 con 0x7f25ec101270 2023-12-08T20:32:42.339 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:42 smithi043 ceph-mon[219193]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:32:42.339 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:42 smithi043 ceph-mon[219193]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:32:42.339 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:42 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/2326217373' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:42.339 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:42 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:42.339 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:42 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:42.339 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:42 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:32:42.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:42 smithi111 ceph-mon[182474]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:32:42.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:42 smithi111 ceph-mon[182474]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:32:42.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:42 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/2326217373' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:42.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:42 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:42.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:42 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:42.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:42 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:32:42.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.479+0000 7f25f1022700 1 -- 172.21.15.43:0/4214745378 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f25ec10c970 con 0x7f25d406cf80 2023-12-08T20:32:42.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.481+0000 7f25d37fe700 1 -- 172.21.15.43:0/4214745378 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f25ec10c970 con 0x7f25d406cf80 2023-12-08T20:32:42.483 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:32:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-08T20:32:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "in_progress": true, 2023-12-08T20:32:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-08T20:32:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "services_complete": [ 2023-12-08T20:32:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2023-12-08T20:32:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr", 2023-12-08T20:32:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "mon" 2023-12-08T20:32:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2023-12-08T20:32:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "progress": "7/21 daemons upgraded", 2023-12-08T20:32:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "message": "Currently upgrading osd daemons", 2023-12-08T20:32:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: "is_paused": false 2023-12-08T20:32:42.483 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:32:42.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.483+0000 7f25f1022700 1 -- 172.21.15.43:0/4214745378 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f25d406cf80 msgr2=0x7f25d406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:42.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.483+0000 7f25f1022700 1 --2- 172.21.15.43:0/4214745378 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f25d406cf80 0x7f25d406f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f25ec10cc30 tx=0x7f25e0009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:42.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.483+0000 7f25f1022700 1 -- 172.21.15.43:0/4214745378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25ec101270 msgr2=0x7f25ec114450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:42.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.483+0000 7f25f1022700 1 --2- 172.21.15.43:0/4214745378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25ec101270 0x7f25ec114450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00a6c0 tx=0x7f25dc00c040 comp rx=0 tx=0).stop 2023-12-08T20:32:42.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.483+0000 7f25f1022700 1 -- 172.21.15.43:0/4214745378 shutdown_connections 2023-12-08T20:32:42.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.483+0000 7f25f1022700 1 --2- 172.21.15.43:0/4214745378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25ec101270 0x7f25ec114450 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:42.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.483+0000 7f25f1022700 1 --2- 172.21.15.43:0/4214745378 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f25d406cf80 0x7f25d406f430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:42.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.483+0000 7f25f1022700 1 --2- 172.21.15.43:0/4214745378 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25ec101c10 0x7f25ec10b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:42.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.483+0000 7f25f1022700 1 -- 172.21.15.43:0/4214745378 >> 172.21.15.43:0/4214745378 conn(0x7f25ec0711a0 msgr2=0x7f25ec0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:42.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.483+0000 7f25f1022700 1 -- 172.21.15.43:0/4214745378 shutdown_connections 2023-12-08T20:32:42.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.483+0000 7f25f1022700 1 -- 172.21.15.43:0/4214745378 wait complete. 2023-12-08T20:32:42.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.607+0000 7f8fa512a700 1 -- 172.21.15.43:0/1975092731 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fa0102bf0 msgr2=0x7f8fa0102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:42.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.607+0000 7f8fa512a700 1 --2- 172.21.15.43:0/1975092731 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fa0102bf0 0x7f8fa0102fc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8f90004940 tx=0x7f8f90009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:42.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.607+0000 7f8fa512a700 1 -- 172.21.15.43:0/1975092731 shutdown_connections 2023-12-08T20:32:42.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.607+0000 7f8fa512a700 1 --2- 172.21.15.43:0/1975092731 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8fa0103590 0x7f8fa00fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:42.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.607+0000 7f8fa512a700 1 --2- 172.21.15.43:0/1975092731 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fa0102bf0 0x7f8fa0102fc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:42.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.607+0000 7f8fa512a700 1 -- 172.21.15.43:0/1975092731 >> 172.21.15.43:0/1975092731 conn(0x7f8fa00f87a0 msgr2=0x7f8fa00fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:42.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.608+0000 7f8fa512a700 1 -- 172.21.15.43:0/1975092731 shutdown_connections 2023-12-08T20:32:42.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.608+0000 7f8fa512a700 1 -- 172.21.15.43:0/1975092731 wait complete. 2023-12-08T20:32:42.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.609+0000 7f8fa512a700 1 Processor -- start 2023-12-08T20:32:42.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.609+0000 7f8fa512a700 1 -- start start 2023-12-08T20:32:42.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.609+0000 7f8fa512a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8fa0102bf0 0x7f8fa006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:42.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.609+0000 7f8fa512a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fa0103590 0x7f8fa0070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:42.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.609+0000 7f8fa512a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa0070a80 con 0x7f8fa0103590 2023-12-08T20:32:42.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.609+0000 7f8fa512a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa0070bf0 con 0x7f8fa0102bf0 2023-12-08T20:32:42.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.609+0000 7f8f9e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fa0103590 0x7f8fa0070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:42.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.609+0000 7f8f9e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fa0103590 0x7f8fa0070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55374/0 (socket says 172.21.15.43:55374) 2023-12-08T20:32:42.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.609+0000 7f8f9e59c700 1 -- 172.21.15.43:0/2229610429 learned_addr learned my addr 172.21.15.43:0/2229610429 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:32:42.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.609+0000 7f8f9ed9d700 1 --2- 172.21.15.43:0/2229610429 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8fa0102bf0 0x7f8fa006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:42.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.610+0000 7f8f9e59c700 1 -- 172.21.15.43:0/2229610429 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8fa0102bf0 msgr2=0x7f8fa006ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:42.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.610+0000 7f8f9e59c700 1 --2- 172.21.15.43:0/2229610429 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8fa0102bf0 0x7f8fa006ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:42.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.610+0000 7f8f9e59c700 1 -- 172.21.15.43:0/2229610429 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f90005040 con 0x7f8fa0103590 2023-12-08T20:32:42.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.610+0000 7f8f9e59c700 1 --2- 172.21.15.43:0/2229610429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fa0103590 0x7f8fa0070480 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8f94002a50 tx=0x7f8f94004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:42.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.610+0000 7f8f877fe700 1 -- 172.21.15.43:0/2229610429 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f94007cc0 con 0x7f8fa0103590 2023-12-08T20:32:42.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.610+0000 7f8f877fe700 1 -- 172.21.15.43:0/2229610429 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8f9400f040 con 0x7f8fa0103590 2023-12-08T20:32:42.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.610+0000 7f8fa512a700 1 -- 172.21.15.43:0/2229610429 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa0119890 con 0x7f8fa0103590 2023-12-08T20:32:42.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.610+0000 7f8f877fe700 1 -- 172.21.15.43:0/2229610429 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f9400d920 con 0x7f8fa0103590 2023-12-08T20:32:42.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.610+0000 7f8fa512a700 1 -- 172.21.15.43:0/2229610429 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa0119d70 con 0x7f8fa0103590 2023-12-08T20:32:42.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.611+0000 7f8fa512a700 1 -- 172.21.15.43:0/2229610429 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa00fff00 con 0x7f8fa0103590 2023-12-08T20:32:42.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.612+0000 7f8f877fe700 1 -- 172.21.15.43:0/2229610429 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 39) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f8f9400dae0 con 0x7f8fa0103590 2023-12-08T20:32:42.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.612+0000 7f8f877fe700 1 --2- 172.21.15.43:0/2229610429 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f8f8806cf80 0x7f8f8806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:32:42.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.613+0000 7f8f877fe700 1 -- 172.21.15.43:0/2229610429 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f8f9408c270 con 0x7f8fa0103590 2023-12-08T20:32:42.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.613+0000 7f8f9ed9d700 1 --2- 172.21.15.43:0/2229610429 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f8f8806cf80 0x7f8f8806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:32:42.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.614+0000 7f8f9ed9d700 1 --2- 172.21.15.43:0/2229610429 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f8f8806cf80 0x7f8f8806f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000b3b0 tx=0x7f8f90009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:32:42.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.618+0000 7f8f877fe700 1 -- 172.21.15.43:0/2229610429 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8f94055fd0 con 0x7f8fa0103590 2023-12-08T20:32:42.634 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:42 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-1[239460]: 2023-12-08T20:32:42.335+0000 7fb2faf66640 -1 Falling back to public interface 2023-12-08T20:32:42.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.939+0000 7f8fa512a700 1 -- 172.21.15.43:0/2229610429 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8fa00fc3a0 con 0x7f8fa0103590 2023-12-08T20:32:42.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.940+0000 7f8f877fe700 1 -- 172.21.15.43:0/2229610429 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1160 (secure 0 0 0) 0x7f8f940595f0 con 0x7f8fa0103590 2023-12-08T20:32:42.941 INFO:teuthology.orchestra.run.smithi043.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 55/357 objects degraded (15.406%), 16 pgs degraded 2023-12-08T20:32:42.942 INFO:teuthology.orchestra.run.smithi043.stdout:[WRN] OSD_DOWN: 1 osds down 2023-12-08T20:32:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: osd.1 (root=default,host=smithi043) is down 2023-12-08T20:32:42.942 INFO:teuthology.orchestra.run.smithi043.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 55/357 objects degraded (15.406%), 16 pgs degraded 2023-12-08T20:32:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2023-12-08T20:32:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2023-12-08T20:32:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2023-12-08T20:32:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2023-12-08T20:32:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2023-12-08T20:32:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2023-12-08T20:32:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2023-12-08T20:32:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2023-12-08T20:32:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2023-12-08T20:32:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2023-12-08T20:32:42.942 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2023-12-08T20:32:42.943 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2023-12-08T20:32:42.943 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2023-12-08T20:32:42.943 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2023-12-08T20:32:42.943 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2023-12-08T20:32:42.943 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2023-12-08T20:32:42.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.942+0000 7f8fa512a700 1 -- 172.21.15.43:0/2229610429 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f8f8806cf80 msgr2=0x7f8f8806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:42.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.942+0000 7f8fa512a700 1 --2- 172.21.15.43:0/2229610429 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f8f8806cf80 0x7f8f8806f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000b3b0 tx=0x7f8f90009e30 comp rx=0 tx=0).stop 2023-12-08T20:32:42.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.942+0000 7f8fa512a700 1 -- 172.21.15.43:0/2229610429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fa0103590 msgr2=0x7f8fa0070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:32:42.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.942+0000 7f8fa512a700 1 --2- 172.21.15.43:0/2229610429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fa0103590 0x7f8fa0070480 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8f94002a50 tx=0x7f8f94004600 comp rx=0 tx=0).stop 2023-12-08T20:32:42.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.942+0000 7f8fa512a700 1 -- 172.21.15.43:0/2229610429 shutdown_connections 2023-12-08T20:32:42.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.942+0000 7f8fa512a700 1 --2- 172.21.15.43:0/2229610429 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f8f8806cf80 0x7f8f8806f430 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:42.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.942+0000 7f8fa512a700 1 --2- 172.21.15.43:0/2229610429 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8fa0102bf0 0x7f8fa006ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:42.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.942+0000 7f8fa512a700 1 --2- 172.21.15.43:0/2229610429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fa0103590 0x7f8fa0070480 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:32:42.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.942+0000 7f8fa512a700 1 -- 172.21.15.43:0/2229610429 >> 172.21.15.43:0/2229610429 conn(0x7f8fa00f87a0 msgr2=0x7f8fa00fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:32:42.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.942+0000 7f8fa512a700 1 -- 172.21.15.43:0/2229610429 shutdown_connections 2023-12-08T20:32:42.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:32:42.942+0000 7f8fa512a700 1 -- 172.21.15.43:0/2229610429 wait complete. 2023-12-08T20:32:43.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:43 smithi111 ceph-mon[182474]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:32:43.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:43 smithi111 ceph-mon[182474]: pgmap v54: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2023-12-08T20:32:43.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:43 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/1006667682' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-08T20:32:43.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:43 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:43.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:43 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:43.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:43 smithi111 ceph-mon[182474]: Health check failed: Degraded data redundancy: 55/357 objects degraded (15.406%), 16 pgs degraded (PG_DEGRADED) 2023-12-08T20:32:43.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:43 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/2229610429' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-08T20:32:43.481 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:43 smithi043 ceph-mon[219193]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:32:43.482 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:43 smithi043 ceph-mon[219193]: pgmap v54: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2023-12-08T20:32:43.482 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:43 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/1006667682' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-08T20:32:43.482 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:43 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:43.482 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:43 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:43.482 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:43 smithi043 ceph-mon[219193]: Health check failed: Degraded data redundancy: 55/357 objects degraded (15.406%), 16 pgs degraded (PG_DEGRADED) 2023-12-08T20:32:43.482 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:43 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/2229610429' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-08T20:32:44.450 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:44 smithi043 ceph-mon[219193]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:32:44.450 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:44.450 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:32:44.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:44 smithi111 ceph-mon[182474]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:32:44.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:44.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:32:45.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:45 smithi111 ceph-mon[182474]: pgmap v55: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2023-12-08T20:32:45.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:45 smithi043 ceph-mon[219193]: pgmap v55: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2023-12-08T20:32:46.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:46 smithi111 ceph-mon[182474]: mgrmap e40: smithi043.hqcdcm(active, since 91s), standbys: smithi111.mtcffu 2023-12-08T20:32:46.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:46 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:46.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:46 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:46.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:46 smithi043 ceph-mon[219193]: mgrmap e40: smithi043.hqcdcm(active, since 91s), standbys: smithi111.mtcffu 2023-12-08T20:32:46.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:46 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:46.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:46 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:47.243 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:46 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-1[239460]: 2023-12-08T20:32:46.924+0000 7fb2faf66640 -1 osd.1 0 read_superblock omap replica is missing. 2023-12-08T20:32:47.244 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:47 smithi043 ceph-mon[219193]: pgmap v56: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 55/357 objects degraded (15.406%) 2023-12-08T20:32:47.244 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:47 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:47.244 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:47 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:47.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:47 smithi111 ceph-mon[182474]: pgmap v56: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 55/357 objects degraded (15.406%) 2023-12-08T20:32:47.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:47 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:47.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:47 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:48.014 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:47 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-1[239460]: 2023-12-08T20:32:47.537+0000 7fb2faf66640 -1 osd.1 55 log_to_monitors true 2023-12-08T20:32:48.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:48 smithi111 ceph-mon[182474]: from='osd.1 [v2:172.21.15.43:6810/565859461,v1:172.21.15.43:6811/565859461]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-08T20:32:48.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:48 smithi043 ceph-mon[219193]: from='osd.1 [v2:172.21.15.43:6810/565859461,v1:172.21.15.43:6811/565859461]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-08T20:32:48.514 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:32:48 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-1[239460]: 2023-12-08T20:32:48.142+0000 7fb2e83cf700 -1 osd.1 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:32:49.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:49 smithi111 ceph-mon[182474]: pgmap v57: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 625 B/s wr, 0 op/s; 55/357 objects degraded (15.406%) 2023-12-08T20:32:49.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:49 smithi111 ceph-mon[182474]: from='osd.1 [v2:172.21.15.43:6810/565859461,v1:172.21.15.43:6811/565859461]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-08T20:32:49.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:49 smithi111 ceph-mon[182474]: osdmap e58: 6 total, 5 up, 6 in 2023-12-08T20:32:49.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:49 smithi111 ceph-mon[182474]: from='osd.1 [v2:172.21.15.43:6810/565859461,v1:172.21.15.43:6811/565859461]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2023-12-08T20:32:49.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:49 smithi111 ceph-mon[182474]: failed to encode map e58 with expected crc 2023-12-08T20:32:49.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:49 smithi043 ceph-mon[219193]: pgmap v57: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 301 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 625 B/s wr, 0 op/s; 55/357 objects degraded (15.406%) 2023-12-08T20:32:49.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:49 smithi043 ceph-mon[219193]: from='osd.1 [v2:172.21.15.43:6810/565859461,v1:172.21.15.43:6811/565859461]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-08T20:32:49.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:49 smithi043 ceph-mon[219193]: osdmap e58: 6 total, 5 up, 6 in 2023-12-08T20:32:49.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:49 smithi043 ceph-mon[219193]: from='osd.1 [v2:172.21.15.43:6810/565859461,v1:172.21.15.43:6811/565859461]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2023-12-08T20:32:49.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:49 smithi043 ceph-mon[219193]: failed to encode map e58 with expected crc 2023-12-08T20:32:50.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:50 smithi111 ceph-mon[182474]: failed to encode map e58 with expected crc 2023-12-08T20:32:50.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:50 smithi111 ceph-mon[182474]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-08T20:32:50.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:50 smithi111 ceph-mon[182474]: failed to encode map e59 with expected crc 2023-12-08T20:32:50.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:50 smithi111 ceph-mon[182474]: osd.1 [v2:172.21.15.43:6810/565859461,v1:172.21.15.43:6811/565859461] boot 2023-12-08T20:32:50.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:50 smithi111 ceph-mon[182474]: osdmap e59: 6 total, 6 up, 6 in 2023-12-08T20:32:50.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:50 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-08T20:32:50.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:50 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:50.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:50 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:50.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:50 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:32:50.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:50 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:32:50.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:50 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:50.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:50 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:32:50.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:50 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:50.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:50 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:50.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:50 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:50.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:50 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-08T20:32:50.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:50 smithi043 ceph-mon[219193]: failed to encode map e58 with expected crc 2023-12-08T20:32:50.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:50 smithi043 ceph-mon[219193]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-08T20:32:50.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:50 smithi043 ceph-mon[219193]: failed to encode map e59 with expected crc 2023-12-08T20:32:50.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:50 smithi043 ceph-mon[219193]: osd.1 [v2:172.21.15.43:6810/565859461,v1:172.21.15.43:6811/565859461] boot 2023-12-08T20:32:50.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:50 smithi043 ceph-mon[219193]: osdmap e59: 6 total, 6 up, 6 in 2023-12-08T20:32:50.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:50 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-08T20:32:50.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:50 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:50.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:50 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:50.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:50 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:32:50.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:50 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:32:50.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:50 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:32:50.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:50 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:32:50.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:50 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:50.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:50 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:50.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:50 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:32:50.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:50 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-08T20:32:51.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:51 smithi111 ceph-mon[182474]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-08T20:32:51.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:51 smithi111 ceph-mon[182474]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-08T20:32:51.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:51 smithi111 ceph-mon[182474]: pgmap v60: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 55/357 objects degraded (15.406%) 2023-12-08T20:32:51.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:51 smithi111 ceph-mon[182474]: osdmap e60: 6 total, 6 up, 6 in 2023-12-08T20:32:51.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:51 smithi111 ceph-mon[182474]: failed to encode map e60 with expected crc 2023-12-08T20:32:51.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:51 smithi111 ceph-mon[182474]: failed to encode map e60 with expected crc 2023-12-08T20:32:51.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:51 smithi111 ceph-mon[182474]: failed to encode map e60 with expected crc 2023-12-08T20:32:51.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:51 smithi111 ceph-mon[182474]: failed to encode map e60 with expected crc 2023-12-08T20:32:51.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:51 smithi111 ceph-mon[182474]: failed to encode map e60 with expected crc 2023-12-08T20:32:51.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:51 smithi111 ceph-mon[182474]: failed to encode map e60 with expected crc 2023-12-08T20:32:51.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:51 smithi111 ceph-mon[182474]: failed to encode map e60 with expected crc 2023-12-08T20:32:51.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:51 smithi111 ceph-mon[182474]: failed to encode map e60 with expected crc 2023-12-08T20:32:51.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:51 smithi043 ceph-mon[219193]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-08T20:32:51.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:51 smithi043 ceph-mon[219193]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-08T20:32:51.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:51 smithi043 ceph-mon[219193]: pgmap v60: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 55/357 objects degraded (15.406%) 2023-12-08T20:32:51.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:51 smithi043 ceph-mon[219193]: osdmap e60: 6 total, 6 up, 6 in 2023-12-08T20:32:51.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:51 smithi043 ceph-mon[219193]: failed to encode map e60 with expected crc 2023-12-08T20:32:51.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:51 smithi043 ceph-mon[219193]: failed to encode map e60 with expected crc 2023-12-08T20:32:51.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:51 smithi043 ceph-mon[219193]: failed to encode map e60 with expected crc 2023-12-08T20:32:51.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:51 smithi043 ceph-mon[219193]: failed to encode map e60 with expected crc 2023-12-08T20:32:51.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:51 smithi043 ceph-mon[219193]: failed to encode map e60 with expected crc 2023-12-08T20:32:51.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:51 smithi043 ceph-mon[219193]: failed to encode map e60 with expected crc 2023-12-08T20:32:51.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:51 smithi043 ceph-mon[219193]: failed to encode map e60 with expected crc 2023-12-08T20:32:51.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:51 smithi043 ceph-mon[219193]: failed to encode map e60 with expected crc 2023-12-08T20:32:52.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:52 smithi111 ceph-mon[182474]: Health check update: Degraded data redundancy: 24/357 objects degraded (6.723%), 7 pgs degraded (PG_DEGRADED) 2023-12-08T20:32:52.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:52 smithi043 ceph-mon[219193]: Health check update: Degraded data redundancy: 24/357 objects degraded (6.723%), 7 pgs degraded (PG_DEGRADED) 2023-12-08T20:32:53.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:53 smithi111 ceph-mon[182474]: pgmap v62: 65 pgs: 20 peering, 7 active+undersized+degraded, 5 active+undersized, 33 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 24/357 objects degraded (6.723%) 2023-12-08T20:32:53.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:53 smithi043 ceph-mon[219193]: pgmap v62: 65 pgs: 20 peering, 7 active+undersized+degraded, 5 active+undersized, 33 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 24/357 objects degraded (6.723%) 2023-12-08T20:32:54.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:54 smithi043 ceph-mon[219193]: pgmap v63: 65 pgs: 20 peering, 45 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:54.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:54 smithi043 ceph-mon[219193]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/357 objects degraded (6.723%), 7 pgs degraded) 2023-12-08T20:32:54.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:54 smithi043 ceph-mon[219193]: Cluster is now healthy 2023-12-08T20:32:54.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:54 smithi111 ceph-mon[182474]: pgmap v63: 65 pgs: 20 peering, 45 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:32:54.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:54 smithi111 ceph-mon[182474]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/357 objects degraded (6.723%), 7 pgs degraded) 2023-12-08T20:32:54.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:54 smithi111 ceph-mon[182474]: Cluster is now healthy 2023-12-08T20:32:56.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:56 smithi111 ceph-mon[182474]: pgmap v64: 65 pgs: 65 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 47 B/s, 0 objects/s recovering 2023-12-08T20:32:57.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:56 smithi043 ceph-mon[219193]: pgmap v64: 65 pgs: 65 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 47 B/s, 0 objects/s recovering 2023-12-08T20:32:59.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:58 smithi111 ceph-mon[182474]: pgmap v65: 65 pgs: 65 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 42 B/s, 0 objects/s recovering 2023-12-08T20:32:59.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:58 smithi043 ceph-mon[219193]: pgmap v65: 65 pgs: 65 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 42 B/s, 0 objects/s recovering 2023-12-08T20:33:00.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:59 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:00.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:32:59 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:33:00.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:59 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:00.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:32:59 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:33:01.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:00 smithi043 ceph-mon[219193]: pgmap v66: 65 pgs: 65 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 37 B/s, 0 objects/s recovering 2023-12-08T20:33:01.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:00 smithi111 ceph-mon[182474]: pgmap v66: 65 pgs: 65 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 37 B/s, 0 objects/s recovering 2023-12-08T20:33:03.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:02 smithi043 ceph-mon[219193]: pgmap v67: 65 pgs: 65 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31 B/s, 0 objects/s recovering 2023-12-08T20:33:03.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:02 smithi111 ceph-mon[182474]: pgmap v67: 65 pgs: 65 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31 B/s, 0 objects/s recovering 2023-12-08T20:33:05.120 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:04 smithi043 ceph-mon[219193]: pgmap v68: 65 pgs: 65 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 30 B/s, 0 objects/s recovering 2023-12-08T20:33:05.120 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:04 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:05.121 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:04 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-08T20:33:05.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:04 smithi111 ceph-mon[182474]: pgmap v68: 65 pgs: 65 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 30 B/s, 0 objects/s recovering 2023-12-08T20:33:05.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:04 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:05.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:04 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-08T20:33:06.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:05 smithi043 ceph-mon[219193]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-08T20:33:06.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:05 smithi043 ceph-mon[219193]: Upgrade: osd.2 is safe to restart 2023-12-08T20:33:06.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:05 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:06.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:05 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-08T20:33:06.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:05 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:33:06.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:05 smithi111 ceph-mon[182474]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-08T20:33:06.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:05 smithi111 ceph-mon[182474]: Upgrade: osd.2 is safe to restart 2023-12-08T20:33:06.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:05 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:06.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:05 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-08T20:33:06.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:05 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:33:07.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:06 smithi043 ceph-mon[219193]: Upgrade: Updating osd.2 2023-12-08T20:33:07.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:06 smithi043 ceph-mon[219193]: Deploying daemon osd.2 on smithi043 2023-12-08T20:33:07.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:06 smithi043 ceph-mon[219193]: pgmap v69: 65 pgs: 65 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 30 B/s, 0 objects/s recovering 2023-12-08T20:33:07.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:06 smithi111 ceph-mon[182474]: Upgrade: Updating osd.2 2023-12-08T20:33:07.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:06 smithi111 ceph-mon[182474]: Deploying daemon osd.2 on smithi043 2023-12-08T20:33:07.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:06 smithi111 ceph-mon[182474]: pgmap v69: 65 pgs: 65 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 30 B/s, 0 objects/s recovering 2023-12-08T20:33:08.266 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:07 smithi043 systemd[1]: Stopping Ceph osd.2 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:33:08.266 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:08 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-2[155391]: 2023-12-08T20:33:08.188+0000 7f25b4d5d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-08T20:33:08.266 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:08 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-2[155391]: 2023-12-08T20:33:08.188+0000 7f25b4d5d700 -1 osd.2 60 *** Got signal Terminated *** 2023-12-08T20:33:08.266 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:08 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-2[155391]: 2023-12-08T20:33:08.188+0000 7f25b4d5d700 -1 osd.2 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-08T20:33:09.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:08 smithi043 ceph-mon[219193]: pgmap v70: 65 pgs: 65 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:33:09.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:08 smithi043 ceph-mon[219193]: osd.2 marked itself down and dead 2023-12-08T20:33:09.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:08 smithi111 ceph-mon[182474]: pgmap v70: 65 pgs: 65 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:33:09.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:08 smithi111 ceph-mon[182474]: osd.2 marked itself down and dead 2023-12-08T20:33:09.992 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:09 smithi043 bash[246218]: ceph-28476818-9607-11ee-95a3-87774f69a715-osd-2 2023-12-08T20:33:10.252 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:09 smithi043 ceph-mon[219193]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-08T20:33:10.252 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:09 smithi043 ceph-mon[219193]: osdmap e61: 6 total, 5 up, 6 in 2023-12-08T20:33:10.252 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:09 smithi043 ceph-mon[219193]: failed to encode map e61 with expected crc 2023-12-08T20:33:10.252 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:09 smithi043 ceph-mon[219193]: failed to encode map e61 with expected crc 2023-12-08T20:33:10.252 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:09 smithi043 ceph-mon[219193]: failed to encode map e61 with expected crc 2023-12-08T20:33:10.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:09 smithi111 ceph-mon[182474]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-08T20:33:10.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:09 smithi111 ceph-mon[182474]: osdmap e61: 6 total, 5 up, 6 in 2023-12-08T20:33:10.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:09 smithi111 ceph-mon[182474]: failed to encode map e61 with expected crc 2023-12-08T20:33:10.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:09 smithi111 ceph-mon[182474]: failed to encode map e61 with expected crc 2023-12-08T20:33:10.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:09 smithi111 ceph-mon[182474]: failed to encode map e61 with expected crc 2023-12-08T20:33:11.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:10 smithi043 ceph-mon[219193]: pgmap v72: 65 pgs: 12 peering, 7 stale+active+clean, 46 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:33:11.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:10 smithi043 ceph-mon[219193]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-12-08T20:33:11.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:10 smithi043 ceph-mon[219193]: failed to encode map e62 with expected crc 2023-12-08T20:33:11.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:10 smithi043 ceph-mon[219193]: osdmap e62: 6 total, 5 up, 6 in 2023-12-08T20:33:11.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:10 smithi043 ceph-mon[219193]: failed to encode map e62 with expected crc 2023-12-08T20:33:11.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:10 smithi043 ceph-mon[219193]: failed to encode map e62 with expected crc 2023-12-08T20:33:11.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:10 smithi043 ceph-mon[219193]: failed to encode map e62 with expected crc 2023-12-08T20:33:11.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:10 smithi043 ceph-mon[219193]: failed to encode map e62 with expected crc 2023-12-08T20:33:11.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:10 smithi043 ceph-mon[219193]: failed to encode map e62 with expected crc 2023-12-08T20:33:11.265 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:10 smithi043 systemd[1]: ceph-28476818-9607-11ee-95a3-87774f69a715@osd.2.service: Succeeded. 2023-12-08T20:33:11.265 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:10 smithi043 systemd[1]: Stopped Ceph osd.2 for 28476818-9607-11ee-95a3-87774f69a715. 2023-12-08T20:33:11.265 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:11 smithi043 systemd[1]: Starting Ceph osd.2 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:33:11.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:10 smithi111 ceph-mon[182474]: pgmap v72: 65 pgs: 12 peering, 7 stale+active+clean, 46 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-08T20:33:11.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:10 smithi111 ceph-mon[182474]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-12-08T20:33:11.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:10 smithi111 ceph-mon[182474]: failed to encode map e62 with expected crc 2023-12-08T20:33:11.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:10 smithi111 ceph-mon[182474]: osdmap e62: 6 total, 5 up, 6 in 2023-12-08T20:33:11.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:10 smithi111 ceph-mon[182474]: failed to encode map e62 with expected crc 2023-12-08T20:33:11.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:10 smithi111 ceph-mon[182474]: failed to encode map e62 with expected crc 2023-12-08T20:33:11.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:10 smithi111 ceph-mon[182474]: failed to encode map e62 with expected crc 2023-12-08T20:33:11.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:10 smithi111 ceph-mon[182474]: failed to encode map e62 with expected crc 2023-12-08T20:33:11.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:10 smithi111 ceph-mon[182474]: failed to encode map e62 with expected crc 2023-12-08T20:33:12.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:12 smithi111 ceph-mon[182474]: Health check failed: Degraded data redundancy: 12/357 objects degraded (3.361%), 4 pgs degraded (PG_DEGRADED) 2023-12-08T20:33:12.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:12 smithi043 ceph-mon[219193]: Health check failed: Degraded data redundancy: 12/357 objects degraded (3.361%), 4 pgs degraded (PG_DEGRADED) 2023-12-08T20:33:12.515 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:12 smithi043 bash[246481]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-08T20:33:12.515 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:12 smithi043 bash[246481]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-08T20:33:12.515 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:12 smithi043 bash[246481]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-08T20:33:12.515 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:12 smithi043 bash[246481]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-08T20:33:12.515 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:12 smithi043 bash[246481]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2023-12-08T20:33:12.516 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:12 smithi043 bash[246481]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-08T20:33:12.516 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:12 smithi043 bash[246481]: --> ceph-volume raw activate successful for osd ID: 2 2023-12-08T20:33:13.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.064+0000 7fc0175c8700 1 -- 172.21.15.43:0/1692861552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc010102c00 msgr2=0x7fc010102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:13.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.064+0000 7fc0175c8700 1 --2- 172.21.15.43:0/1692861552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc010102c00 0x7fc010102fd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc00c009ce0 tx=0x7fc00c004d10 comp rx=0 tx=0).stop 2023-12-08T20:33:13.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.064+0000 7fc0175c8700 1 -- 172.21.15.43:0/1692861552 shutdown_connections 2023-12-08T20:33:13.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.064+0000 7fc0175c8700 1 --2- 172.21.15.43:0/1692861552 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0101035a0 0x7fc0100fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:13.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.064+0000 7fc0175c8700 1 --2- 172.21.15.43:0/1692861552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc010102c00 0x7fc010102fd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:13.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.064+0000 7fc0175c8700 1 -- 172.21.15.43:0/1692861552 >> 172.21.15.43:0/1692861552 conn(0x7fc0100f8790 msgr2=0x7fc0100faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:13.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.064+0000 7fc0175c8700 1 -- 172.21.15.43:0/1692861552 shutdown_connections 2023-12-08T20:33:13.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.064+0000 7fc0175c8700 1 -- 172.21.15.43:0/1692861552 wait complete. 2023-12-08T20:33:13.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.065+0000 7fc0175c8700 1 Processor -- start 2023-12-08T20:33:13.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.065+0000 7fc0175c8700 1 -- start start 2023-12-08T20:33:13.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.065+0000 7fc0175c8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc010102c00 0x7fc0101136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:13.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.065+0000 7fc0175c8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0101035a0 0x7fc010113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:13.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.065+0000 7fc0175c8700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc010114280 con 0x7fc010102c00 2023-12-08T20:33:13.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.065+0000 7fc0175c8700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01010d570 con 0x7fc0101035a0 2023-12-08T20:33:13.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.065+0000 7fc015364700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc010102c00 0x7fc0101136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:13.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.065+0000 7fc015364700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc010102c00 0x7fc0101136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54386/0 (socket says 172.21.15.43:54386) 2023-12-08T20:33:13.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.065+0000 7fc015364700 1 -- 172.21.15.43:0/1820099799 learned_addr learned my addr 172.21.15.43:0/1820099799 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:33:13.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.065+0000 7fc014b63700 1 --2- 172.21.15.43:0/1820099799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0101035a0 0x7fc010113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:13.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.065+0000 7fc015364700 1 -- 172.21.15.43:0/1820099799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0101035a0 msgr2=0x7fc010113c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:13.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.065+0000 7fc015364700 1 --2- 172.21.15.43:0/1820099799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0101035a0 0x7fc010113c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:13.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.066+0000 7fc015364700 1 -- 172.21.15.43:0/1820099799 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c009940 con 0x7fc010102c00 2023-12-08T20:33:13.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.066+0000 7fc014b63700 1 --2- 172.21.15.43:0/1820099799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0101035a0 0x7fc010113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:33:13.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.066+0000 7fc015364700 1 --2- 172.21.15.43:0/1820099799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc010102c00 0x7fc0101136f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc00c009360 tx=0x7fc00c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:13.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.066+0000 7fc005ffb700 1 -- 172.21.15.43:0/1820099799 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc00c00e040 con 0x7fc010102c00 2023-12-08T20:33:13.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.066+0000 7fc0175c8700 1 -- 172.21.15.43:0/1820099799 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01010d7f0 con 0x7fc010102c00 2023-12-08T20:33:13.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.066+0000 7fc005ffb700 1 -- 172.21.15.43:0/1820099799 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc00c004610 con 0x7fc010102c00 2023-12-08T20:33:13.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.066+0000 7fc005ffb700 1 -- 172.21.15.43:0/1820099799 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc00c012b50 con 0x7fc010102c00 2023-12-08T20:33:13.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.066+0000 7fc0175c8700 1 -- 172.21.15.43:0/1820099799 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01010dd30 con 0x7fc010102c00 2023-12-08T20:33:13.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.067+0000 7fc0175c8700 1 -- 172.21.15.43:0/1820099799 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0101133a0 con 0x7fc010102c00 2023-12-08T20:33:13.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.069+0000 7fc005ffb700 1 -- 172.21.15.43:0/1820099799 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fc00c01c830 con 0x7fc010102c00 2023-12-08T20:33:13.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.069+0000 7fc005ffb700 1 --2- 172.21.15.43:0/1820099799 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fbffc06ce70 0x7fbffc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:13.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.069+0000 7fc005ffb700 1 -- 172.21.15.43:0/1820099799 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc00c08ec00 con 0x7fc010102c00 2023-12-08T20:33:13.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.069+0000 7fc014b63700 1 --2- 172.21.15.43:0/1820099799 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fbffc06ce70 0x7fbffc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:13.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.070+0000 7fc014b63700 1 --2- 172.21.15.43:0/1820099799 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fbffc06ce70 0x7fbffc06f320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc000004600 tx=0x7fc00000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:13.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.073+0000 7fc005ffb700 1 -- 172.21.15.43:0/1820099799 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc00c05c5a0 con 0x7fc010102c00 2023-12-08T20:33:13.264 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:12 smithi043 ceph-osd[246803]: -- 172.21.15.43:0/4106824353 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559f44fe11e0 con 0x559f44fb1000 2023-12-08T20:33:13.264 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:12 smithi043 bash[246765]: 0b56e93b08fce3acd8474891eeaecef5592d7679f7f6e0a7ac345d1cfb09cb1d 2023-12-08T20:33:13.264 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:12 smithi043 systemd[1]: Started Ceph osd.2 for 28476818-9607-11ee-95a3-87774f69a715. 2023-12-08T20:33:13.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:13 smithi043 ceph-mon[219193]: pgmap v74: 65 pgs: 4 active+undersized+degraded, 12 peering, 4 stale+active+clean, 4 active+undersized, 41 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 12/357 objects degraded (3.361%) 2023-12-08T20:33:13.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:13 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:13.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:13 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:13.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:13 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:33:13.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.320+0000 7fc0175c8700 1 -- 172.21.15.43:0/1820099799 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc01004bbf0 con 0x7fbffc06ce70 2023-12-08T20:33:13.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.324+0000 7fc005ffb700 1 -- 172.21.15.43:0/1820099799 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc01004bbf0 con 0x7fbffc06ce70 2023-12-08T20:33:13.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.327+0000 7fc0175c8700 1 -- 172.21.15.43:0/1820099799 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fbffc06ce70 msgr2=0x7fbffc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:13.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.327+0000 7fc0175c8700 1 --2- 172.21.15.43:0/1820099799 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fbffc06ce70 0x7fbffc06f320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc000004600 tx=0x7fc00000b040 comp rx=0 tx=0).stop 2023-12-08T20:33:13.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.327+0000 7fc0175c8700 1 -- 172.21.15.43:0/1820099799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc010102c00 msgr2=0x7fc0101136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:13.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.327+0000 7fc0175c8700 1 --2- 172.21.15.43:0/1820099799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc010102c00 0x7fc0101136f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc00c009360 tx=0x7fc00c004d10 comp rx=0 tx=0).stop 2023-12-08T20:33:13.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.327+0000 7fc0175c8700 1 -- 172.21.15.43:0/1820099799 shutdown_connections 2023-12-08T20:33:13.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.327+0000 7fc0175c8700 1 --2- 172.21.15.43:0/1820099799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc010102c00 0x7fc0101136f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:13.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.327+0000 7fc0175c8700 1 --2- 172.21.15.43:0/1820099799 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fbffc06ce70 0x7fbffc06f320 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:13.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.327+0000 7fc0175c8700 1 --2- 172.21.15.43:0/1820099799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0101035a0 0x7fc010113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:13.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.327+0000 7fc0175c8700 1 -- 172.21.15.43:0/1820099799 >> 172.21.15.43:0/1820099799 conn(0x7fc0100f8790 msgr2=0x7fc0100fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:13.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.327+0000 7fc0175c8700 1 -- 172.21.15.43:0/1820099799 shutdown_connections 2023-12-08T20:33:13.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.327+0000 7fc0175c8700 1 -- 172.21.15.43:0/1820099799 wait complete. 2023-12-08T20:33:13.343 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:33:13.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.452+0000 7f3794890700 1 -- 172.21.15.43:0/2377145814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3790102c70 msgr2=0x7f3790103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:13.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.452+0000 7f3794890700 1 --2- 172.21.15.43:0/2377145814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3790102c70 0x7f3790103040 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3780004940 tx=0x7f3780009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:13.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.452+0000 7f3794890700 1 -- 172.21.15.43:0/2377145814 shutdown_connections 2023-12-08T20:33:13.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.452+0000 7f3794890700 1 --2- 172.21.15.43:0/2377145814 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37900fb1e0 0x7f37900fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:13.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.452+0000 7f3794890700 1 --2- 172.21.15.43:0/2377145814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3790102c70 0x7f3790103040 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:13.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.452+0000 7f3794890700 1 -- 172.21.15.43:0/2377145814 >> 172.21.15.43:0/2377145814 conn(0x7f37900711a0 msgr2=0x7f37900715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:13.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.452+0000 7f3794890700 1 -- 172.21.15.43:0/2377145814 shutdown_connections 2023-12-08T20:33:13.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.452+0000 7f3794890700 1 -- 172.21.15.43:0/2377145814 wait complete. 2023-12-08T20:33:13.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.452+0000 7f3794890700 1 Processor -- start 2023-12-08T20:33:13.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.452+0000 7f3794890700 1 -- start start 2023-12-08T20:33:13.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.453+0000 7f3794890700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37900fb1e0 0x7f3790113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:13.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.453+0000 7f3794890700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3790102c70 0x7f3790113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:13.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.453+0000 7f3794890700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3790114200 con 0x7f37900fb1e0 2023-12-08T20:33:13.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.453+0000 7f3794890700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379010d4f0 con 0x7f3790102c70 2023-12-08T20:33:13.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.453+0000 7f378e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37900fb1e0 0x7f3790113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:13.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.453+0000 7f378e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37900fb1e0 0x7f3790113630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54394/0 (socket says 172.21.15.43:54394) 2023-12-08T20:33:13.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.453+0000 7f378e59c700 1 -- 172.21.15.43:0/3060655035 learned_addr learned my addr 172.21.15.43:0/3060655035 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:33:13.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.453+0000 7f3787fff700 1 --2- 172.21.15.43:0/3060655035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3790102c70 0x7f3790113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:13.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.453+0000 7f378e59c700 1 -- 172.21.15.43:0/3060655035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3790102c70 msgr2=0x7f3790113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:13.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.453+0000 7f378e59c700 1 --2- 172.21.15.43:0/3060655035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3790102c70 0x7f3790113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:13.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.453+0000 7f378e59c700 1 -- 172.21.15.43:0/3060655035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3780005040 con 0x7f37900fb1e0 2023-12-08T20:33:13.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.453+0000 7f378e59c700 1 --2- 172.21.15.43:0/3060655035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37900fb1e0 0x7f3790113630 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3780009fd0 tx=0x7f3780009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:13.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.454+0000 7f3786ffd700 1 -- 172.21.15.43:0/3060655035 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f378000e040 con 0x7f37900fb1e0 2023-12-08T20:33:13.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.454+0000 7f3786ffd700 1 -- 172.21.15.43:0/3060655035 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f378000bc50 con 0x7f37900fb1e0 2023-12-08T20:33:13.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.454+0000 7f3794890700 1 -- 172.21.15.43:0/3060655035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379010d720 con 0x7f37900fb1e0 2023-12-08T20:33:13.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.454+0000 7f3794890700 1 -- 172.21.15.43:0/3060655035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379010dc60 con 0x7f37900fb1e0 2023-12-08T20:33:13.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.454+0000 7f3786ffd700 1 -- 172.21.15.43:0/3060655035 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3780013ea0 con 0x7f37900fb1e0 2023-12-08T20:33:13.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.455+0000 7f3786ffd700 1 -- 172.21.15.43:0/3060655035 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f3780013420 con 0x7f37900fb1e0 2023-12-08T20:33:13.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.455+0000 7f3794890700 1 -- 172.21.15.43:0/3060655035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37700052e0 con 0x7f37900fb1e0 2023-12-08T20:33:13.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.456+0000 7f3786ffd700 1 --2- 172.21.15.43:0/3060655035 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f377c06ce70 0x7f377c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:13.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.456+0000 7f3787fff700 1 --2- 172.21.15.43:0/3060655035 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f377c06ce70 0x7f377c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:13.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.456+0000 7f3786ffd700 1 -- 172.21.15.43:0/3060655035 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f378008d6e0 con 0x7f37900fb1e0 2023-12-08T20:33:13.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.456+0000 7f3787fff700 1 --2- 172.21.15.43:0/3060655035 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f377c06ce70 0x7f377c06f320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3778007fd0 tx=0x7f3778009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:13.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.461+0000 7f3786ffd700 1 -- 172.21.15.43:0/3060655035 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f378005b1d0 con 0x7f37900fb1e0 2023-12-08T20:33:13.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:13 smithi111 ceph-mon[182474]: pgmap v74: 65 pgs: 4 active+undersized+degraded, 12 peering, 4 stale+active+clean, 4 active+undersized, 41 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 12/357 objects degraded (3.361%) 2023-12-08T20:33:13.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:13 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:13.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:13 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:13.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:13 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:33:13.640 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:13 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-2[246780]: 2023-12-08T20:33:13.374+0000 7f87c04ff640 -1 Falling back to public interface 2023-12-08T20:33:13.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.697+0000 7f3794890700 1 -- 172.21.15.43:0/3060655035 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3770000bf0 con 0x7f377c06ce70 2023-12-08T20:33:13.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.699+0000 7f3786ffd700 1 -- 172.21.15.43:0/3060655035 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3770000bf0 con 0x7f377c06ce70 2023-12-08T20:33:13.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.701+0000 7f3794890700 1 -- 172.21.15.43:0/3060655035 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f377c06ce70 msgr2=0x7f377c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:13.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.701+0000 7f3794890700 1 --2- 172.21.15.43:0/3060655035 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f377c06ce70 0x7f377c06f320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3778007fd0 tx=0x7f3778009040 comp rx=0 tx=0).stop 2023-12-08T20:33:13.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.701+0000 7f3794890700 1 -- 172.21.15.43:0/3060655035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37900fb1e0 msgr2=0x7f3790113630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:13.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.701+0000 7f3794890700 1 --2- 172.21.15.43:0/3060655035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37900fb1e0 0x7f3790113630 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3780009fd0 tx=0x7f3780009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:13.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.701+0000 7f3794890700 1 -- 172.21.15.43:0/3060655035 shutdown_connections 2023-12-08T20:33:13.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.701+0000 7f3794890700 1 --2- 172.21.15.43:0/3060655035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37900fb1e0 0x7f3790113630 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:13.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.701+0000 7f3794890700 1 --2- 172.21.15.43:0/3060655035 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f377c06ce70 0x7f377c06f320 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:13.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.701+0000 7f3794890700 1 --2- 172.21.15.43:0/3060655035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3790102c70 0x7f3790113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:13.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.701+0000 7f3794890700 1 -- 172.21.15.43:0/3060655035 >> 172.21.15.43:0/3060655035 conn(0x7f37900711a0 msgr2=0x7f37900fa180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:13.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.701+0000 7f3794890700 1 -- 172.21.15.43:0/3060655035 shutdown_connections 2023-12-08T20:33:13.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.701+0000 7f3794890700 1 -- 172.21.15.43:0/3060655035 wait complete. 2023-12-08T20:33:13.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.820+0000 7f295fe10700 1 -- 172.21.15.43:0/1085951425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29580fdbf0 msgr2=0x7f29580fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:13.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.820+0000 7f295fe10700 1 --2- 172.21.15.43:0/1085951425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29580fdbf0 0x7f29580fdfc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2954004940 tx=0x7f2954009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:13.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.820+0000 7f295fe10700 1 -- 172.21.15.43:0/1085951425 shutdown_connections 2023-12-08T20:33:13.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.820+0000 7f295fe10700 1 --2- 172.21.15.43:0/1085951425 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29580fe590 0x7f2958106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:13.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.820+0000 7f295fe10700 1 --2- 172.21.15.43:0/1085951425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29580fdbf0 0x7f29580fdfc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:13.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.820+0000 7f295fe10700 1 -- 172.21.15.43:0/1085951425 >> 172.21.15.43:0/1085951425 conn(0x7f29580f7680 msgr2=0x7f29580f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:13.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.820+0000 7f295fe10700 1 -- 172.21.15.43:0/1085951425 shutdown_connections 2023-12-08T20:33:13.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.820+0000 7f295fe10700 1 -- 172.21.15.43:0/1085951425 wait complete. 2023-12-08T20:33:13.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.821+0000 7f295fe10700 1 Processor -- start 2023-12-08T20:33:13.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.821+0000 7f295fe10700 1 -- start start 2023-12-08T20:33:13.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.821+0000 7f295fe10700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29580fdbf0 0x7f29580fba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:13.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.821+0000 7f295fe10700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29580fe590 0x7f29580fbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:13.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.821+0000 7f295fe10700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29580fc560 con 0x7f29580fe590 2023-12-08T20:33:13.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.821+0000 7f295fe10700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29580fc6d0 con 0x7f29580fdbf0 2023-12-08T20:33:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.821+0000 7f295d3ab700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29580fe590 0x7f29580fbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.821+0000 7f295d3ab700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29580fe590 0x7f29580fbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54418/0 (socket says 172.21.15.43:54418) 2023-12-08T20:33:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.821+0000 7f295d3ab700 1 -- 172.21.15.43:0/4148268011 learned_addr learned my addr 172.21.15.43:0/4148268011 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:33:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.821+0000 7f295dbac700 1 --2- 172.21.15.43:0/4148268011 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29580fdbf0 0x7f29580fba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.822+0000 7f295d3ab700 1 -- 172.21.15.43:0/4148268011 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29580fdbf0 msgr2=0x7f29580fba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.822+0000 7f295d3ab700 1 --2- 172.21.15.43:0/4148268011 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29580fdbf0 0x7f29580fba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.822+0000 7f295d3ab700 1 -- 172.21.15.43:0/4148268011 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2954005040 con 0x7f29580fe590 2023-12-08T20:33:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.822+0000 7f295dbac700 1 --2- 172.21.15.43:0/4148268011 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29580fdbf0 0x7f29580fba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:33:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.822+0000 7f295d3ab700 1 --2- 172.21.15.43:0/4148268011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29580fe590 0x7f29580fbf60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f294800eb40 tx=0x7f294800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.822+0000 7f294e7fc700 1 -- 172.21.15.43:0/4148268011 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2948007cc0 con 0x7f29580fe590 2023-12-08T20:33:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.822+0000 7f294e7fc700 1 -- 172.21.15.43:0/4148268011 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f294800f040 con 0x7f29580fe590 2023-12-08T20:33:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.822+0000 7f295fe10700 1 -- 172.21.15.43:0/4148268011 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29581197f0 con 0x7f29580fe590 2023-12-08T20:33:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.822+0000 7f294e7fc700 1 -- 172.21.15.43:0/4148268011 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2948009570 con 0x7f29580fe590 2023-12-08T20:33:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.822+0000 7f295fe10700 1 -- 172.21.15.43:0/4148268011 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2958119c50 con 0x7f29580fe590 2023-12-08T20:33:13.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.823+0000 7f295fe10700 1 -- 172.21.15.43:0/4148268011 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29581041e0 con 0x7f29580fe590 2023-12-08T20:33:13.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.824+0000 7f294e7fc700 1 -- 172.21.15.43:0/4148268011 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f29480096d0 con 0x7f29580fe590 2023-12-08T20:33:13.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.824+0000 7f294e7fc700 1 --2- 172.21.15.43:0/4148268011 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f294406ce60 0x7f294406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:13.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.824+0000 7f294e7fc700 1 -- 172.21.15.43:0/4148268011 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f294808bf40 con 0x7f29580fe590 2023-12-08T20:33:13.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.824+0000 7f295dbac700 1 --2- 172.21.15.43:0/4148268011 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f294406ce60 0x7f294406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:13.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.825+0000 7f295dbac700 1 --2- 172.21.15.43:0/4148268011 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f294406ce60 0x7f294406f310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2954004560 tx=0x7f2954009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:13.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:13.829+0000 7f294e7fc700 1 -- 172.21.15.43:0/4148268011 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f29480bf2f0 con 0x7f29580fe590 2023-12-08T20:33:14.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.093+0000 7f295fe10700 1 -- 172.21.15.43:0/4148268011 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f29580fb250 con 0x7f294406ce60 2023-12-08T20:33:14.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.103+0000 7f294e7fc700 1 -- 172.21.15.43:0/4148268011 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f29580fb250 con 0x7f294406ce60 2023-12-08T20:33:14.107 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-08T20:33:14.107 INFO:teuthology.orchestra.run.smithi043.stdout:alertmanager.smithi043 smithi043 *:9093,9094 running (3m) 28s ago 11m 26.4M - 0.25.0 c8568f914cd2 d4a6cd00c86b 2023-12-08T20:33:14.107 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi043 smithi043 running (82s) 28s ago 11m 7482k - 19.0.0-44-g9dcc13bb f28f2b94f153 f570eddb8e8a 2023-12-08T20:33:14.107 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi111 smithi111 running (78s) 76s ago 10m 7453k - 19.0.0-44-g9dcc13bb f28f2b94f153 b2013e24b94e 2023-12-08T20:33:14.107 INFO:teuthology.orchestra.run.smithi043.stdout:grafana.smithi043 smithi043 *:3000 running (3m) 28s ago 11m 84.4M - 9.4.7 954c08fa6188 8f55491a980b 2023-12-08T20:33:14.107 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.akrjef smithi043 running (7m) 28s ago 7m 18.7M - 17.2.7-119-ge2143d99 f761b6e42225 1c0cb8d34ef8 2023-12-08T20:33:14.107 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.pjmszb smithi043 running (7m) 28s ago 7m 7154M - 17.2.7-119-ge2143d99 f761b6e42225 d7eee0c78093 2023-12-08T20:33:14.108 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.svpasm smithi111 running (7m) 76s ago 7m 16.2M - 17.2.7-119-ge2143d99 f761b6e42225 657d4d1cf4b2 2023-12-08T20:33:14.108 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.veeegc smithi111 running (7m) 76s ago 7m 3706M - 17.2.7-119-ge2143d99 f761b6e42225 31f794a388ab 2023-12-08T20:33:14.108 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi043.hqcdcm smithi043 *:8443,9283,8765 running (4m) 28s ago 12m 510M - 19.0.0-44-g9dcc13bb f28f2b94f153 14e91c1dac64 2023-12-08T20:33:14.108 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi111.mtcffu smithi111 *:8443,9283,8765 running (4m) 76s ago 10m 449M - 19.0.0-44-g9dcc13bb f28f2b94f153 56f4290c6db5 2023-12-08T20:33:14.108 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi043 smithi043 running (2m) 28s ago 12m 57.1M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 3597e3a60ebc 2023-12-08T20:33:14.108 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi111 smithi111 running (108s) 76s ago 10m 38.6M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 528aa182165f 2023-12-08T20:33:14.108 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi043 smithi043 *:9100 running (4m) 28s ago 11m 17.7M - 1.5.0 0da6a335fe13 0959b44d9972 2023-12-08T20:33:14.108 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi111 smithi111 *:9100 running (4m) 76s ago 10m 17.9M - 1.5.0 0da6a335fe13 10fe4fdb23d0 2023-12-08T20:33:14.108 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (63s) 28s ago 10m 115M 1570M 19.0.0-44-g9dcc13bb f28f2b94f153 298e9b98d7a4 2023-12-08T20:33:14.108 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi043 running (32s) 28s ago 9m 14.7M 1570M 19.0.0-44-g9dcc13bb f28f2b94f153 1ad10def08c3 2023-12-08T20:33:14.108 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi043 starting - - - 1570M 2023-12-08T20:33:14.108 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi111 running (9m) 76s ago 9m 980M 2592M 17.2.7-119-ge2143d99 f761b6e42225 2a738d30441c 2023-12-08T20:33:14.108 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi111 running (8m) 76s ago 8m 720M 2592M 17.2.7-119-ge2143d99 f761b6e42225 38cdb6a88694 2023-12-08T20:33:14.108 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi111 running (8m) 76s ago 8m 873M 2592M 17.2.7-119-ge2143d99 f761b6e42225 59a9ce8c1141 2023-12-08T20:33:14.108 INFO:teuthology.orchestra.run.smithi043.stdout:prometheus.smithi043 smithi043 *:9095 running (3m) 28s ago 11m 62.4M - 2.43.0 a07b618ecd1d d95914ec88d8 2023-12-08T20:33:14.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.106+0000 7f295fe10700 1 -- 172.21.15.43:0/4148268011 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f294406ce60 msgr2=0x7f294406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:14.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.106+0000 7f295fe10700 1 --2- 172.21.15.43:0/4148268011 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f294406ce60 0x7f294406f310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2954004560 tx=0x7f2954009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:14.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.106+0000 7f295fe10700 1 -- 172.21.15.43:0/4148268011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29580fe590 msgr2=0x7f29580fbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:14.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.106+0000 7f295fe10700 1 --2- 172.21.15.43:0/4148268011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29580fe590 0x7f29580fbf60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f294800eb40 tx=0x7f294800b040 comp rx=0 tx=0).stop 2023-12-08T20:33:14.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.106+0000 7f295fe10700 1 -- 172.21.15.43:0/4148268011 shutdown_connections 2023-12-08T20:33:14.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.106+0000 7f295fe10700 1 --2- 172.21.15.43:0/4148268011 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f294406ce60 0x7f294406f310 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:14.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.106+0000 7f295fe10700 1 --2- 172.21.15.43:0/4148268011 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29580fdbf0 0x7f29580fba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:14.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.106+0000 7f295fe10700 1 --2- 172.21.15.43:0/4148268011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29580fe590 0x7f29580fbf60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:14.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.106+0000 7f295fe10700 1 -- 172.21.15.43:0/4148268011 >> 172.21.15.43:0/4148268011 conn(0x7f29580f7680 msgr2=0x7f2958101360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:14.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.106+0000 7f295fe10700 1 -- 172.21.15.43:0/4148268011 shutdown_connections 2023-12-08T20:33:14.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.106+0000 7f295fe10700 1 -- 172.21.15.43:0/4148268011 wait complete. 2023-12-08T20:33:14.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.224+0000 7f7d29c8b700 1 -- 172.21.15.43:0/4042631730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d24065390 msgr2=0x7f7d24065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:14.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.224+0000 7f7d29c8b700 1 --2- 172.21.15.43:0/4042631730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d24065390 0x7f7d24065800 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7d18004940 tx=0x7f7d18009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:14.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.224+0000 7f7d29c8b700 1 -- 172.21.15.43:0/4042631730 shutdown_connections 2023-12-08T20:33:14.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.224+0000 7f7d29c8b700 1 --2- 172.21.15.43:0/4042631730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d24065390 0x7f7d24065800 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:14.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.224+0000 7f7d29c8b700 1 --2- 172.21.15.43:0/4042631730 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d24102c20 0x7f7d24102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:14.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.224+0000 7f7d29c8b700 1 -- 172.21.15.43:0/4042631730 >> 172.21.15.43:0/4042631730 conn(0x7f7d240719b0 msgr2=0x7f7d24071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:14.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.224+0000 7f7d29c8b700 1 -- 172.21.15.43:0/4042631730 shutdown_connections 2023-12-08T20:33:14.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.224+0000 7f7d29c8b700 1 -- 172.21.15.43:0/4042631730 wait complete. 2023-12-08T20:33:14.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.225+0000 7f7d29c8b700 1 Processor -- start 2023-12-08T20:33:14.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.225+0000 7f7d29c8b700 1 -- start start 2023-12-08T20:33:14.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.225+0000 7f7d29c8b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d24065390 0x7f7d240fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:14.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.225+0000 7f7d29c8b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d24102c20 0x7f7d240fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:14.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.225+0000 7f7d29c8b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d240fc730 con 0x7f7d24065390 2023-12-08T20:33:14.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.225+0000 7f7d29c8b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d240fc8a0 con 0x7f7d24102c20 2023-12-08T20:33:14.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.226+0000 7f7d237fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d24065390 0x7f7d240fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:14.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.226+0000 7f7d237fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d24065390 0x7f7d240fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54442/0 (socket says 172.21.15.43:54442) 2023-12-08T20:33:14.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.226+0000 7f7d237fe700 1 -- 172.21.15.43:0/3298125639 learned_addr learned my addr 172.21.15.43:0/3298125639 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:33:14.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.226+0000 7f7d22ffd700 1 --2- 172.21.15.43:0/3298125639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d24102c20 0x7f7d240fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:14.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.226+0000 7f7d237fe700 1 -- 172.21.15.43:0/3298125639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d24102c20 msgr2=0x7f7d240fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:14.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.226+0000 7f7d237fe700 1 --2- 172.21.15.43:0/3298125639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d24102c20 0x7f7d240fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:14.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.226+0000 7f7d237fe700 1 -- 172.21.15.43:0/3298125639 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d18005040 con 0x7f7d24065390 2023-12-08T20:33:14.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.226+0000 7f7d22ffd700 1 --2- 172.21.15.43:0/3298125639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d24102c20 0x7f7d240fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T20:33:14.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.226+0000 7f7d237fe700 1 --2- 172.21.15.43:0/3298125639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d24065390 0x7f7d240fbbf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7d14002a50 tx=0x7f7d140046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:14.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.226+0000 7f7d0bfff700 1 -- 172.21.15.43:0/3298125639 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d14007cc0 con 0x7f7d24065390 2023-12-08T20:33:14.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.226+0000 7f7d0bfff700 1 -- 172.21.15.43:0/3298125639 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7d1400f040 con 0x7f7d24065390 2023-12-08T20:33:14.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.226+0000 7f7d29c8b700 1 -- 172.21.15.43:0/3298125639 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d24119970 con 0x7f7d24065390 2023-12-08T20:33:14.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.226+0000 7f7d0bfff700 1 -- 172.21.15.43:0/3298125639 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d14009540 con 0x7f7d24065390 2023-12-08T20:33:14.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.226+0000 7f7d29c8b700 1 -- 172.21.15.43:0/3298125639 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d24119e50 con 0x7f7d24065390 2023-12-08T20:33:14.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.228+0000 7f7d29c8b700 1 -- 172.21.15.43:0/3298125639 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d240fff40 con 0x7f7d24065390 2023-12-08T20:33:14.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.228+0000 7f7d0bfff700 1 -- 172.21.15.43:0/3298125639 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f7d140096c0 con 0x7f7d24065390 2023-12-08T20:33:14.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.229+0000 7f7d0bfff700 1 --2- 172.21.15.43:0/3298125639 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7d0c06ce60 0x7f7d0c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:14.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.229+0000 7f7d0bfff700 1 -- 172.21.15.43:0/3298125639 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f7d1408c050 con 0x7f7d24065390 2023-12-08T20:33:14.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.229+0000 7f7d22ffd700 1 --2- 172.21.15.43:0/3298125639 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7d0c06ce60 0x7f7d0c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:14.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.229+0000 7f7d22ffd700 1 --2- 172.21.15.43:0/3298125639 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7d0c06ce60 0x7f7d0c06f310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009fd0 tx=0x7f7d18009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:14.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.234+0000 7f7d0bfff700 1 -- 172.21.15.43:0/3298125639 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7d14056030 con 0x7f7d24065390 2023-12-08T20:33:14.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.556+0000 7f7d29c8b700 1 -- 172.21.15.43:0/3298125639 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7d2404bb80 con 0x7f7d24065390 2023-12-08T20:33:14.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.557+0000 7f7d0bfff700 1 -- 172.21.15.43:0/3298125639 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f7d14009970 con 0x7f7d24065390 2023-12-08T20:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": { 2023-12-08T20:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": { 2023-12-08T20:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": { 2023-12-08T20:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 3, 2023-12-08T20:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2023-12-08T20:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-08T20:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "overall": { 2023-12-08T20:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 7, 2023-12-08T20:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 6 2023-12-08T20:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-12-08T20:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:33:14.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.559+0000 7f7d29c8b700 1 -- 172.21.15.43:0/3298125639 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7d0c06ce60 msgr2=0x7f7d0c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:14.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.559+0000 7f7d29c8b700 1 --2- 172.21.15.43:0/3298125639 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7d0c06ce60 0x7f7d0c06f310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009fd0 tx=0x7f7d18009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:14.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.559+0000 7f7d29c8b700 1 -- 172.21.15.43:0/3298125639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d24065390 msgr2=0x7f7d240fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:14.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.559+0000 7f7d29c8b700 1 --2- 172.21.15.43:0/3298125639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d24065390 0x7f7d240fbbf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7d14002a50 tx=0x7f7d140046b0 comp rx=0 tx=0).stop 2023-12-08T20:33:14.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.559+0000 7f7d29c8b700 1 -- 172.21.15.43:0/3298125639 shutdown_connections 2023-12-08T20:33:14.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.559+0000 7f7d29c8b700 1 --2- 172.21.15.43:0/3298125639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d24065390 0x7f7d240fbbf0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:14.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.559+0000 7f7d29c8b700 1 --2- 172.21.15.43:0/3298125639 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7d0c06ce60 0x7f7d0c06f310 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:14.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.559+0000 7f7d29c8b700 1 --2- 172.21.15.43:0/3298125639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d24102c20 0x7f7d240fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:14.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.559+0000 7f7d29c8b700 1 -- 172.21.15.43:0/3298125639 >> 172.21.15.43:0/3298125639 conn(0x7f7d240719b0 msgr2=0x7f7d240fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:14.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.560+0000 7f7d29c8b700 1 -- 172.21.15.43:0/3298125639 shutdown_connections 2023-12-08T20:33:14.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.560+0000 7f7d29c8b700 1 -- 172.21.15.43:0/3298125639 wait complete. 2023-12-08T20:33:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.674+0000 7f132e56f700 1 -- 172.21.15.43:0/1229572261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1328065390 msgr2=0x7f1328065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.674+0000 7f132e56f700 1 --2- 172.21.15.43:0/1229572261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1328065390 0x7f1328065800 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f131c004880 tx=0x7f131c009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.674+0000 7f132e56f700 1 -- 172.21.15.43:0/1229572261 shutdown_connections 2023-12-08T20:33:14.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.674+0000 7f132e56f700 1 --2- 172.21.15.43:0/1229572261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1328065390 0x7f1328065800 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:14.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.674+0000 7f132e56f700 1 --2- 172.21.15.43:0/1229572261 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1328102c20 0x7f1328102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:14.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.674+0000 7f132e56f700 1 -- 172.21.15.43:0/1229572261 >> 172.21.15.43:0/1229572261 conn(0x7f13280719b0 msgr2=0x7f1328071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:14.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.674+0000 7f132e56f700 1 -- 172.21.15.43:0/1229572261 shutdown_connections 2023-12-08T20:33:14.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.674+0000 7f132e56f700 1 -- 172.21.15.43:0/1229572261 wait complete. 2023-12-08T20:33:14.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.674+0000 7f132e56f700 1 Processor -- start 2023-12-08T20:33:14.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.675+0000 7f132e56f700 1 -- start start 2023-12-08T20:33:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.675+0000 7f132e56f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1328065390 0x7f132810b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.675+0000 7f132e56f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1328102c20 0x7f132810bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.675+0000 7f132e56f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132810c280 con 0x7f1328065390 2023-12-08T20:33:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.675+0000 7f132e56f700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13281211f0 con 0x7f1328102c20 2023-12-08T20:33:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.675+0000 7f1327fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1328065390 0x7f132810b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.675+0000 7f1327fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1328065390 0x7f132810b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54452/0 (socket says 172.21.15.43:54452) 2023-12-08T20:33:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.675+0000 7f1327fff700 1 -- 172.21.15.43:0/3650928658 learned_addr learned my addr 172.21.15.43:0/3650928658 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:33:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.675+0000 7f13277fe700 1 --2- 172.21.15.43:0/3650928658 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1328102c20 0x7f132810bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.676+0000 7f1327fff700 1 -- 172.21.15.43:0/3650928658 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1328102c20 msgr2=0x7f132810bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.676+0000 7f1327fff700 1 --2- 172.21.15.43:0/3650928658 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1328102c20 0x7f132810bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.676+0000 7f1327fff700 1 -- 172.21.15.43:0/3650928658 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c005040 con 0x7f1328065390 2023-12-08T20:33:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.676+0000 7f1327fff700 1 --2- 172.21.15.43:0/3650928658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1328065390 0x7f132810b6f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f131800eaf0 tx=0x7f131800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.676+0000 7f1324ff9700 1 -- 172.21.15.43:0/3650928658 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1318007cc0 con 0x7f1328065390 2023-12-08T20:33:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.676+0000 7f132e56f700 1 -- 172.21.15.43:0/3650928658 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1328121420 con 0x7f1328065390 2023-12-08T20:33:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.676+0000 7f1324ff9700 1 -- 172.21.15.43:0/3650928658 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f131800f040 con 0x7f1328065390 2023-12-08T20:33:14.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.676+0000 7f1324ff9700 1 -- 172.21.15.43:0/3650928658 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f131800cb20 con 0x7f1328065390 2023-12-08T20:33:14.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.676+0000 7f132e56f700 1 -- 172.21.15.43:0/3650928658 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1328121930 con 0x7f1328065390 2023-12-08T20:33:14.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.677+0000 7f132e56f700 1 -- 172.21.15.43:0/3650928658 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13280fff40 con 0x7f1328065390 2023-12-08T20:33:14.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.678+0000 7f1324ff9700 1 -- 172.21.15.43:0/3650928658 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f131800cc80 con 0x7f1328065390 2023-12-08T20:33:14.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.678+0000 7f1324ff9700 1 --2- 172.21.15.43:0/3650928658 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f131006ce60 0x7f131006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:14.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.678+0000 7f13277fe700 1 --2- 172.21.15.43:0/3650928658 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f131006ce60 0x7f131006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:14.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.678+0000 7f1324ff9700 1 -- 172.21.15.43:0/3650928658 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f131808bee0 con 0x7f1328065390 2023-12-08T20:33:14.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.679+0000 7f13277fe700 1 --2- 172.21.15.43:0/3650928658 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f131006ce60 0x7f131006f310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f131c004fa0 tx=0x7f131c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:14.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.683+0000 7f1324ff9700 1 -- 172.21.15.43:0/3650928658 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1318055e10 con 0x7f1328065390 2023-12-08T20:33:14.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.958+0000 7f132e56f700 1 -- 172.21.15.43:0/3650928658 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f132804bb80 con 0x7f1328065390 2023-12-08T20:33:14.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.959+0000 7f1324ff9700 1 -- 172.21.15.43:0/3650928658 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1855 (secure 0 0 0) 0x7f1318059430 con 0x7f1328065390 2023-12-08T20:33:14.961 INFO:teuthology.orchestra.run.smithi043.stdout:e17 2023-12-08T20:33:14.961 INFO:teuthology.orchestra.run.smithi043.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-08T20:33:14.961 INFO:teuthology.orchestra.run.smithi043.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:33:14.961 INFO:teuthology.orchestra.run.smithi043.stdout:legacy client fscid: 1 2023-12-08T20:33:14.961 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:33:14.961 INFO:teuthology.orchestra.run.smithi043.stdout:Filesystem 'cephfs' (1) 2023-12-08T20:33:14.961 INFO:teuthology.orchestra.run.smithi043.stdout:fs_name cephfs 2023-12-08T20:33:14.961 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 17 2023-12-08T20:33:14.961 INFO:teuthology.orchestra.run.smithi043.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-08T20:33:14.961 INFO:teuthology.orchestra.run.smithi043.stdout:created 2023-12-08T20:25:41.527734+0000 2023-12-08T20:33:14.961 INFO:teuthology.orchestra.run.smithi043.stdout:modified 2023-12-08T20:32:04.068774+0000 2023-12-08T20:33:14.961 INFO:teuthology.orchestra.run.smithi043.stdout:tableserver 0 2023-12-08T20:33:14.961 INFO:teuthology.orchestra.run.smithi043.stdout:root 0 2023-12-08T20:33:14.962 INFO:teuthology.orchestra.run.smithi043.stdout:session_timeout 60 2023-12-08T20:33:14.962 INFO:teuthology.orchestra.run.smithi043.stdout:session_autoclose 300 2023-12-08T20:33:14.962 INFO:teuthology.orchestra.run.smithi043.stdout:max_file_size 1099511627776 2023-12-08T20:33:14.962 INFO:teuthology.orchestra.run.smithi043.stdout:max_xattr_size 65536 2023-12-08T20:33:14.962 INFO:teuthology.orchestra.run.smithi043.stdout:required_client_features {} 2023-12-08T20:33:14.962 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure 0 2023-12-08T20:33:14.962 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure_osd_epoch 0 2023-12-08T20:33:14.962 INFO:teuthology.orchestra.run.smithi043.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:33:14.962 INFO:teuthology.orchestra.run.smithi043.stdout:max_mds 2 2023-12-08T20:33:14.962 INFO:teuthology.orchestra.run.smithi043.stdout:in 0,1 2023-12-08T20:33:14.962 INFO:teuthology.orchestra.run.smithi043.stdout:up {0=14452,1=24315} 2023-12-08T20:33:14.962 INFO:teuthology.orchestra.run.smithi043.stdout:failed 2023-12-08T20:33:14.962 INFO:teuthology.orchestra.run.smithi043.stdout:damaged 2023-12-08T20:33:14.962 INFO:teuthology.orchestra.run.smithi043.stdout:stopped 2023-12-08T20:33:14.962 INFO:teuthology.orchestra.run.smithi043.stdout:data_pools [3] 2023-12-08T20:33:14.963 INFO:teuthology.orchestra.run.smithi043.stdout:metadata_pool 2 2023-12-08T20:33:14.963 INFO:teuthology.orchestra.run.smithi043.stdout:inline_data disabled 2023-12-08T20:33:14.963 INFO:teuthology.orchestra.run.smithi043.stdout:balancer 2023-12-08T20:33:14.963 INFO:teuthology.orchestra.run.smithi043.stdout:bal_rank_mask -1 2023-12-08T20:33:14.963 INFO:teuthology.orchestra.run.smithi043.stdout:standby_count_wanted 1 2023-12-08T20:33:14.963 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi043.pjmszb{0:14452} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.43:6826/441584552,v1:172.21.15.43:6827/441584552] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:33:14.963 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi111.veeegc{1:24315} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.111:6824/1990395192,v1:172.21.15.111:6825/1990395192] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:33:14.963 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:33:14.963 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:33:14.963 INFO:teuthology.orchestra.run.smithi043.stdout:Standby daemons: 2023-12-08T20:33:14.963 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:33:14.963 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi043.akrjef{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.43:6828/2926918083,v1:172.21.15.43:6829/2926918083] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:33:14.963 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi111.svpasm{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6826/2885759138,v1:172.21.15.111:6827/2885759138] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:33:14.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.962+0000 7f132e56f700 1 -- 172.21.15.43:0/3650928658 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f131006ce60 msgr2=0x7f131006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:14.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.962+0000 7f132e56f700 1 --2- 172.21.15.43:0/3650928658 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f131006ce60 0x7f131006f310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f131c004fa0 tx=0x7f131c009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:14.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.962+0000 7f132e56f700 1 -- 172.21.15.43:0/3650928658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1328065390 msgr2=0x7f132810b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:14.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.962+0000 7f132e56f700 1 --2- 172.21.15.43:0/3650928658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1328065390 0x7f132810b6f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f131800eaf0 tx=0x7f131800b040 comp rx=0 tx=0).stop 2023-12-08T20:33:14.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.962+0000 7f132e56f700 1 -- 172.21.15.43:0/3650928658 shutdown_connections 2023-12-08T20:33:14.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.962+0000 7f132e56f700 1 --2- 172.21.15.43:0/3650928658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1328065390 0x7f132810b6f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:14.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.962+0000 7f132e56f700 1 --2- 172.21.15.43:0/3650928658 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f131006ce60 0x7f131006f310 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:14.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.962+0000 7f132e56f700 1 --2- 172.21.15.43:0/3650928658 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1328102c20 0x7f132810bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:14.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.962+0000 7f132e56f700 1 -- 172.21.15.43:0/3650928658 >> 172.21.15.43:0/3650928658 conn(0x7f13280719b0 msgr2=0x7f13280fad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:14.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.962+0000 7f132e56f700 1 -- 172.21.15.43:0/3650928658 shutdown_connections 2023-12-08T20:33:14.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:14.962+0000 7f132e56f700 1 -- 172.21.15.43:0/3650928658 wait complete. 2023-12-08T20:33:14.966 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 17 2023-12-08T20:33:15.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:14 smithi043 ceph-mon[219193]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:33:15.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:14 smithi043 ceph-mon[219193]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:33:15.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:14 smithi043 ceph-mon[219193]: pgmap v75: 65 pgs: 7 active+undersized+degraded, 12 peering, 8 active+undersized, 38 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 25/357 objects degraded (7.003%) 2023-12-08T20:33:15.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:15.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:33:15.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:14 smithi043 ceph-mon[219193]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:33:15.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:14 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/3298125639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:33:15.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:14 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/3650928658' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-08T20:33:15.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.091+0000 7f04c53a4700 1 -- 172.21.15.43:0/1826234411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04c01035a0 msgr2=0x7f04c00fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:15.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.091+0000 7f04c53a4700 1 --2- 172.21.15.43:0/1826234411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04c01035a0 0x7f04c00fcc10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f04b4004940 tx=0x7f04b4009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:15.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.091+0000 7f04c53a4700 1 -- 172.21.15.43:0/1826234411 shutdown_connections 2023-12-08T20:33:15.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.091+0000 7f04c53a4700 1 --2- 172.21.15.43:0/1826234411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04c01035a0 0x7f04c00fcc10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:15.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.091+0000 7f04c53a4700 1 --2- 172.21.15.43:0/1826234411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04c0102c00 0x7f04c0102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:15.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.091+0000 7f04c53a4700 1 -- 172.21.15.43:0/1826234411 >> 172.21.15.43:0/1826234411 conn(0x7f04c00f8790 msgr2=0x7f04c00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:15.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.092+0000 7f04c53a4700 1 -- 172.21.15.43:0/1826234411 shutdown_connections 2023-12-08T20:33:15.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.092+0000 7f04c53a4700 1 -- 172.21.15.43:0/1826234411 wait complete. 2023-12-08T20:33:15.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.092+0000 7f04c53a4700 1 Processor -- start 2023-12-08T20:33:15.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.093+0000 7f04c53a4700 1 -- start start 2023-12-08T20:33:15.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.093+0000 7f04c53a4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04c0102c00 0x7f04c01135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:15.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.093+0000 7f04c53a4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04c01035a0 0x7f04c0113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:15.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.093+0000 7f04c53a4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c0114160 con 0x7f04c0102c00 2023-12-08T20:33:15.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.093+0000 7f04c53a4700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c010d490 con 0x7f04c01035a0 2023-12-08T20:33:15.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.093+0000 7f04beffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04c0102c00 0x7f04c01135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:15.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.093+0000 7f04beffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04c0102c00 0x7f04c01135d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54478/0 (socket says 172.21.15.43:54478) 2023-12-08T20:33:15.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.093+0000 7f04beffd700 1 -- 172.21.15.43:0/463111710 learned_addr learned my addr 172.21.15.43:0/463111710 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:33:15.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.093+0000 7f04be7fc700 1 --2- 172.21.15.43:0/463111710 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04c01035a0 0x7f04c0113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:15.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.093+0000 7f04beffd700 1 -- 172.21.15.43:0/463111710 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04c01035a0 msgr2=0x7f04c0113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:15.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.093+0000 7f04beffd700 1 --2- 172.21.15.43:0/463111710 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04c01035a0 0x7f04c0113b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:15.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.093+0000 7f04beffd700 1 -- 172.21.15.43:0/463111710 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b4005040 con 0x7f04c0102c00 2023-12-08T20:33:15.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.093+0000 7f04be7fc700 1 --2- 172.21.15.43:0/463111710 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04c01035a0 0x7f04c0113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:33:15.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.094+0000 7f04beffd700 1 --2- 172.21.15.43:0/463111710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04c0102c00 0x7f04c01135d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04b0002a80 tx=0x7f04b00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:15.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.094+0000 7f04a77fe700 1 -- 172.21.15.43:0/463111710 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04b0007cc0 con 0x7f04c0102c00 2023-12-08T20:33:15.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.094+0000 7f04a77fe700 1 -- 172.21.15.43:0/463111710 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f04b000f040 con 0x7f04c0102c00 2023-12-08T20:33:15.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.094+0000 7f04c53a4700 1 -- 172.21.15.43:0/463111710 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c010d770 con 0x7f04c0102c00 2023-12-08T20:33:15.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.094+0000 7f04a77fe700 1 -- 172.21.15.43:0/463111710 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04b0009640 con 0x7f04c0102c00 2023-12-08T20:33:15.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.094+0000 7f04c53a4700 1 -- 172.21.15.43:0/463111710 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c010dcb0 con 0x7f04c0102c00 2023-12-08T20:33:15.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.095+0000 7f04c53a4700 1 -- 172.21.15.43:0/463111710 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c00fc390 con 0x7f04c0102c00 2023-12-08T20:33:15.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.096+0000 7f04a77fe700 1 -- 172.21.15.43:0/463111710 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f04b00097a0 con 0x7f04c0102c00 2023-12-08T20:33:15.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.096+0000 7f04a77fe700 1 --2- 172.21.15.43:0/463111710 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f04a806ce60 0x7f04a806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:15.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.096+0000 7f04a77fe700 1 -- 172.21.15.43:0/463111710 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f04b008ba60 con 0x7f04c0102c00 2023-12-08T20:33:15.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.096+0000 7f04be7fc700 1 --2- 172.21.15.43:0/463111710 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f04a806ce60 0x7f04a806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:15.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.097+0000 7f04be7fc700 1 --2- 172.21.15.43:0/463111710 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f04a806ce60 0x7f04a806f310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f04c010ee70 tx=0x7f04b4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:15.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.101+0000 7f04a77fe700 1 -- 172.21.15.43:0/463111710 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f04b0059420 con 0x7f04c0102c00 2023-12-08T20:33:15.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:14 smithi111 ceph-mon[182474]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:33:15.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:14 smithi111 ceph-mon[182474]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:33:15.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:14 smithi111 ceph-mon[182474]: pgmap v75: 65 pgs: 7 active+undersized+degraded, 12 peering, 8 active+undersized, 38 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 25/357 objects degraded (7.003%) 2023-12-08T20:33:15.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:14 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:15.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:14 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:33:15.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:14 smithi111 ceph-mon[182474]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:33:15.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:14 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/3298125639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:33:15.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:14 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/3650928658' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-08T20:33:15.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.343+0000 7f04c53a4700 1 -- 172.21.15.43:0/463111710 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f04c010ec50 con 0x7f04a806ce60 2023-12-08T20:33:15.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.345+0000 7f04a77fe700 1 -- 172.21.15.43:0/463111710 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f04c010ec50 con 0x7f04a806ce60 2023-12-08T20:33:15.348 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:33:15.348 INFO:teuthology.orchestra.run.smithi043.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-08T20:33:15.348 INFO:teuthology.orchestra.run.smithi043.stdout: "in_progress": true, 2023-12-08T20:33:15.349 INFO:teuthology.orchestra.run.smithi043.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-08T20:33:15.349 INFO:teuthology.orchestra.run.smithi043.stdout: "services_complete": [ 2023-12-08T20:33:15.349 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2023-12-08T20:33:15.349 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr", 2023-12-08T20:33:15.349 INFO:teuthology.orchestra.run.smithi043.stdout: "mon" 2023-12-08T20:33:15.349 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2023-12-08T20:33:15.349 INFO:teuthology.orchestra.run.smithi043.stdout: "progress": "8/21 daemons upgraded", 2023-12-08T20:33:15.349 INFO:teuthology.orchestra.run.smithi043.stdout: "message": "Currently upgrading osd daemons", 2023-12-08T20:33:15.349 INFO:teuthology.orchestra.run.smithi043.stdout: "is_paused": false 2023-12-08T20:33:15.349 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:33:15.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.347+0000 7f04c53a4700 1 -- 172.21.15.43:0/463111710 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f04a806ce60 msgr2=0x7f04a806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:15.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.347+0000 7f04c53a4700 1 --2- 172.21.15.43:0/463111710 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f04a806ce60 0x7f04a806f310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f04c010ee70 tx=0x7f04b4009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:15.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.347+0000 7f04c53a4700 1 -- 172.21.15.43:0/463111710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04c0102c00 msgr2=0x7f04c01135d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:15.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.347+0000 7f04c53a4700 1 --2- 172.21.15.43:0/463111710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04c0102c00 0x7f04c01135d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04b0002a80 tx=0x7f04b00046b0 comp rx=0 tx=0).stop 2023-12-08T20:33:15.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.347+0000 7f04c53a4700 1 -- 172.21.15.43:0/463111710 shutdown_connections 2023-12-08T20:33:15.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.347+0000 7f04c53a4700 1 --2- 172.21.15.43:0/463111710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04c0102c00 0x7f04c01135d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:15.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.347+0000 7f04c53a4700 1 --2- 172.21.15.43:0/463111710 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f04a806ce60 0x7f04a806f310 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:15.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.347+0000 7f04c53a4700 1 --2- 172.21.15.43:0/463111710 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04c01035a0 0x7f04c0113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:15.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.347+0000 7f04c53a4700 1 -- 172.21.15.43:0/463111710 >> 172.21.15.43:0/463111710 conn(0x7f04c00f8790 msgr2=0x7f04c00fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:15.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.347+0000 7f04c53a4700 1 -- 172.21.15.43:0/463111710 shutdown_connections 2023-12-08T20:33:15.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.347+0000 7f04c53a4700 1 -- 172.21.15.43:0/463111710 wait complete. 2023-12-08T20:33:15.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.465+0000 7f7aaaa18700 1 -- 172.21.15.43:0/1346597645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7aa40fcee0 msgr2=0x7f7aa4109190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:15.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.465+0000 7f7aaaa18700 1 --2- 172.21.15.43:0/1346597645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7aa40fcee0 0x7f7aa4109190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7a98004940 tx=0x7f7a98009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:15.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.465+0000 7f7aaaa18700 1 -- 172.21.15.43:0/1346597645 shutdown_connections 2023-12-08T20:33:15.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.465+0000 7f7aaaa18700 1 --2- 172.21.15.43:0/1346597645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7aa40fcee0 0x7f7aa4109190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:15.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.465+0000 7f7aaaa18700 1 --2- 172.21.15.43:0/1346597645 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7aa40fc5d0 0x7f7aa40fc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:15.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.465+0000 7f7aaaa18700 1 -- 172.21.15.43:0/1346597645 >> 172.21.15.43:0/1346597645 conn(0x7f7aa40719b0 msgr2=0x7f7aa4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:15.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.466+0000 7f7aaaa18700 1 -- 172.21.15.43:0/1346597645 shutdown_connections 2023-12-08T20:33:15.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.466+0000 7f7aaaa18700 1 -- 172.21.15.43:0/1346597645 wait complete. 2023-12-08T20:33:15.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.466+0000 7f7aaaa18700 1 Processor -- start 2023-12-08T20:33:15.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.466+0000 7f7aaaa18700 1 -- start start 2023-12-08T20:33:15.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.467+0000 7f7aaaa18700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7aa40fc5d0 0x7f7aa4115980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:15.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.467+0000 7f7aaaa18700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7aa40fcee0 0x7f7aa4115ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:15.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.467+0000 7f7aaaa18700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa4116510 con 0x7f7aa40fc5d0 2023-12-08T20:33:15.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.467+0000 7f7aaaa18700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa410f840 con 0x7f7aa40fcee0 2023-12-08T20:33:15.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.467+0000 7f7aa3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7aa40fc5d0 0x7f7aa4115980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:15.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.467+0000 7f7aa3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7aa40fc5d0 0x7f7aa4115980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54494/0 (socket says 172.21.15.43:54494) 2023-12-08T20:33:15.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.467+0000 7f7aa3fff700 1 -- 172.21.15.43:0/1945807739 learned_addr learned my addr 172.21.15.43:0/1945807739 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:33:15.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.467+0000 7f7aa37fe700 1 --2- 172.21.15.43:0/1945807739 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7aa40fcee0 0x7f7aa4115ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:15.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.467+0000 7f7aa3fff700 1 -- 172.21.15.43:0/1945807739 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7aa40fcee0 msgr2=0x7f7aa4115ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:15.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.467+0000 7f7aa3fff700 1 --2- 172.21.15.43:0/1945807739 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7aa40fcee0 0x7f7aa4115ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:15.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.467+0000 7f7aa3fff700 1 -- 172.21.15.43:0/1945807739 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a98005040 con 0x7f7aa40fc5d0 2023-12-08T20:33:15.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.467+0000 7f7aa37fe700 1 --2- 172.21.15.43:0/1945807739 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7aa40fcee0 0x7f7aa4115ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T20:33:15.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.467+0000 7f7aa3fff700 1 --2- 172.21.15.43:0/1945807739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7aa40fc5d0 0x7f7aa4115980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7a94002a50 tx=0x7f7a940046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:15.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.467+0000 7f7aa0ff9700 1 -- 172.21.15.43:0/1945807739 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a94007cc0 con 0x7f7aa40fc5d0 2023-12-08T20:33:15.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.468+0000 7f7aa0ff9700 1 -- 172.21.15.43:0/1945807739 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7a9400f040 con 0x7f7aa40fc5d0 2023-12-08T20:33:15.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.468+0000 7f7aaaa18700 1 -- 172.21.15.43:0/1945807739 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa410fb20 con 0x7f7aa40fc5d0 2023-12-08T20:33:15.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.468+0000 7f7aa0ff9700 1 -- 172.21.15.43:0/1945807739 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a94009540 con 0x7f7aa40fc5d0 2023-12-08T20:33:15.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.468+0000 7f7aaaa18700 1 -- 172.21.15.43:0/1945807739 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa4110060 con 0x7f7aa40fc5d0 2023-12-08T20:33:15.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.469+0000 7f7aaaa18700 1 -- 172.21.15.43:0/1945807739 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa41068c0 con 0x7f7aa40fc5d0 2023-12-08T20:33:15.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.469+0000 7f7aa0ff9700 1 -- 172.21.15.43:0/1945807739 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f7a940096a0 con 0x7f7aa40fc5d0 2023-12-08T20:33:15.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.470+0000 7f7aa0ff9700 1 --2- 172.21.15.43:0/1945807739 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7a8c06ce60 0x7f7a8c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:15.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.470+0000 7f7aa0ff9700 1 -- 172.21.15.43:0/1945807739 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f7a9408bf90 con 0x7f7aa40fc5d0 2023-12-08T20:33:15.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.470+0000 7f7aa37fe700 1 --2- 172.21.15.43:0/1945807739 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7a8c06ce60 0x7f7a8c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:15.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.470+0000 7f7aa37fe700 1 --2- 172.21.15.43:0/1945807739 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7a8c06ce60 0x7f7a8c06f310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009fd0 tx=0x7f7a98009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:15.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.475+0000 7f7aa0ff9700 1 -- 172.21.15.43:0/1945807739 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7a940599d0 con 0x7f7aa40fc5d0 2023-12-08T20:33:15.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.793+0000 7f7aaaa18700 1 -- 172.21.15.43:0/1945807739 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7aa404bb80 con 0x7f7aa40fc5d0 2023-12-08T20:33:15.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.794+0000 7f7aa0ff9700 1 -- 172.21.15.43:0/1945807739 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+920 (secure 0 0 0) 0x7f7a94059560 con 0x7f7aa40fc5d0 2023-12-08T20:33:15.796 INFO:teuthology.orchestra.run.smithi043.stdout:HEALTH_WARN 1 osds down; Reduced data availability: 2 pgs peering; Degraded data redundancy: 25/357 objects degraded (7.003%), 7 pgs degraded 2023-12-08T20:33:15.796 INFO:teuthology.orchestra.run.smithi043.stdout:[WRN] OSD_DOWN: 1 osds down 2023-12-08T20:33:15.796 INFO:teuthology.orchestra.run.smithi043.stdout: osd.2 (root=default,host=smithi043) is down 2023-12-08T20:33:15.796 INFO:teuthology.orchestra.run.smithi043.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 2 pgs peering 2023-12-08T20:33:15.796 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.c is stuck peering for 3m, current state peering, last acting [3,0] 2023-12-08T20:33:15.796 INFO:teuthology.orchestra.run.smithi043.stdout: pg 3.1e is stuck peering for 3m, current state peering, last acting [3,1] 2023-12-08T20:33:15.796 INFO:teuthology.orchestra.run.smithi043.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 25/357 objects degraded (7.003%), 7 pgs degraded 2023-12-08T20:33:15.796 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2023-12-08T20:33:15.796 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2023-12-08T20:33:15.796 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2023-12-08T20:33:15.796 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2023-12-08T20:33:15.797 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2023-12-08T20:33:15.797 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2023-12-08T20:33:15.797 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2023-12-08T20:33:15.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.797+0000 7f7aaaa18700 1 -- 172.21.15.43:0/1945807739 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7a8c06ce60 msgr2=0x7f7a8c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:15.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.797+0000 7f7aaaa18700 1 --2- 172.21.15.43:0/1945807739 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7a8c06ce60 0x7f7a8c06f310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009fd0 tx=0x7f7a98009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:15.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.797+0000 7f7aaaa18700 1 -- 172.21.15.43:0/1945807739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7aa40fc5d0 msgr2=0x7f7aa4115980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:15.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.797+0000 7f7aaaa18700 1 --2- 172.21.15.43:0/1945807739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7aa40fc5d0 0x7f7aa4115980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7a94002a50 tx=0x7f7a940046b0 comp rx=0 tx=0).stop 2023-12-08T20:33:15.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.797+0000 7f7aaaa18700 1 -- 172.21.15.43:0/1945807739 shutdown_connections 2023-12-08T20:33:15.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.797+0000 7f7aaaa18700 1 --2- 172.21.15.43:0/1945807739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7aa40fc5d0 0x7f7aa4115980 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:15.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.797+0000 7f7aaaa18700 1 --2- 172.21.15.43:0/1945807739 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7a8c06ce60 0x7f7a8c06f310 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:15.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.797+0000 7f7aaaa18700 1 --2- 172.21.15.43:0/1945807739 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7aa40fcee0 0x7f7aa4115ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:15.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.797+0000 7f7aaaa18700 1 -- 172.21.15.43:0/1945807739 >> 172.21.15.43:0/1945807739 conn(0x7f7aa40719b0 msgr2=0x7f7aa40fa770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:15.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.798+0000 7f7aaaa18700 1 -- 172.21.15.43:0/1945807739 shutdown_connections 2023-12-08T20:33:15.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:15.798+0000 7f7aaaa18700 1 -- 172.21.15.43:0/1945807739 wait complete. 2023-12-08T20:33:16.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:16 smithi043 ceph-mon[219193]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:33:16.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:16 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/1945807739' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-08T20:33:16.766 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:16 smithi043 ceph-mon[219193]: pgmap v76: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/357 objects degraded (11.485%) 2023-12-08T20:33:16.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:16 smithi111 ceph-mon[182474]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:33:16.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:16 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/1945807739' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-08T20:33:16.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:16 smithi111 ceph-mon[182474]: pgmap v76: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/357 objects degraded (11.485%) 2023-12-08T20:33:17.764 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:17 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-2[246780]: 2023-12-08T20:33:17.304+0000 7f87c04ff640 -1 osd.2 0 read_superblock omap replica is missing. 2023-12-08T20:33:17.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:17 smithi043 ceph-mon[219193]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2023-12-08T20:33:17.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:17 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:17.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:17 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:17.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:17 smithi111 ceph-mon[182474]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2023-12-08T20:33:17.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:17 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:17.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:17 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:18.147 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:17 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-2[246780]: 2023-12-08T20:33:17.796+0000 7f87c04ff640 -1 osd.2 60 log_to_monitors true 2023-12-08T20:33:18.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:18 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:18.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:18 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:18.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:18 smithi111 ceph-mon[182474]: from='osd.2 [v2:172.21.15.43:6818/242438115,v1:172.21.15.43:6819/242438115]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-08T20:33:18.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:18 smithi111 ceph-mon[182474]: pgmap v77: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/357 objects degraded (11.485%) 2023-12-08T20:33:19.016 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:33:18 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-2[246780]: 2023-12-08T20:33:18.679+0000 7f87af16b700 -1 osd.2 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:33:19.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:18 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:19.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:18 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:19.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:18 smithi043 ceph-mon[219193]: from='osd.2 [v2:172.21.15.43:6818/242438115,v1:172.21.15.43:6819/242438115]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-08T20:33:19.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:18 smithi043 ceph-mon[219193]: pgmap v77: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 301 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/357 objects degraded (11.485%) 2023-12-08T20:33:19.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:19 smithi111 ceph-mon[182474]: from='osd.2 [v2:172.21.15.43:6818/242438115,v1:172.21.15.43:6819/242438115]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-08T20:33:19.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:19 smithi111 ceph-mon[182474]: osdmap e63: 6 total, 5 up, 6 in 2023-12-08T20:33:19.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:19 smithi111 ceph-mon[182474]: from='osd.2 [v2:172.21.15.43:6818/242438115,v1:172.21.15.43:6819/242438115]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2023-12-08T20:33:19.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:19 smithi111 ceph-mon[182474]: failed to encode map e63 with expected crc 2023-12-08T20:33:20.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:19 smithi043 ceph-mon[219193]: from='osd.2 [v2:172.21.15.43:6818/242438115,v1:172.21.15.43:6819/242438115]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-08T20:33:20.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:19 smithi043 ceph-mon[219193]: osdmap e63: 6 total, 5 up, 6 in 2023-12-08T20:33:20.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:19 smithi043 ceph-mon[219193]: from='osd.2 [v2:172.21.15.43:6818/242438115,v1:172.21.15.43:6819/242438115]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2023-12-08T20:33:20.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:19 smithi043 ceph-mon[219193]: failed to encode map e63 with expected crc 2023-12-08T20:33:20.866 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:20 smithi043 ceph-mon[219193]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-08T20:33:20.867 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:20 smithi043 ceph-mon[219193]: failed to encode map e64 with expected crc 2023-12-08T20:33:20.867 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:20 smithi043 ceph-mon[219193]: osd.2 [v2:172.21.15.43:6818/242438115,v1:172.21.15.43:6819/242438115] boot 2023-12-08T20:33:20.867 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:20 smithi043 ceph-mon[219193]: osdmap e64: 6 total, 6 up, 6 in 2023-12-08T20:33:20.867 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:20 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:33:20.867 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:20 smithi043 ceph-mon[219193]: failed to encode map e63 with expected crc 2023-12-08T20:33:20.867 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:20 smithi043 ceph-mon[219193]: failed to encode map e63 with expected crc 2023-12-08T20:33:20.867 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:20 smithi043 ceph-mon[219193]: pgmap v80: 65 pgs: 10 peering, 8 active+undersized+degraded, 9 active+undersized, 38 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 26/357 objects degraded (7.283%) 2023-12-08T20:33:20.867 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:20 smithi043 ceph-mon[219193]: Health check update: Degraded data redundancy: 41/357 objects degraded (11.485%), 13 pgs degraded (PG_DEGRADED) 2023-12-08T20:33:20.867 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:20 smithi043 ceph-mon[219193]: osdmap e65: 6 total, 6 up, 6 in 2023-12-08T20:33:20.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:20 smithi111 ceph-mon[182474]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-08T20:33:20.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:20 smithi111 ceph-mon[182474]: failed to encode map e64 with expected crc 2023-12-08T20:33:20.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:20 smithi111 ceph-mon[182474]: osd.2 [v2:172.21.15.43:6818/242438115,v1:172.21.15.43:6819/242438115] boot 2023-12-08T20:33:20.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:20 smithi111 ceph-mon[182474]: osdmap e64: 6 total, 6 up, 6 in 2023-12-08T20:33:20.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:20 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-08T20:33:20.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:20 smithi111 ceph-mon[182474]: failed to encode map e63 with expected crc 2023-12-08T20:33:20.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:20 smithi111 ceph-mon[182474]: failed to encode map e63 with expected crc 2023-12-08T20:33:20.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:20 smithi111 ceph-mon[182474]: pgmap v80: 65 pgs: 10 peering, 8 active+undersized+degraded, 9 active+undersized, 38 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 26/357 objects degraded (7.283%) 2023-12-08T20:33:20.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:20 smithi111 ceph-mon[182474]: Health check update: Degraded data redundancy: 41/357 objects degraded (11.485%), 13 pgs degraded (PG_DEGRADED) 2023-12-08T20:33:20.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:20 smithi111 ceph-mon[182474]: osdmap e65: 6 total, 6 up, 6 in 2023-12-08T20:33:21.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:21 smithi111 ceph-mon[182474]: failed to encode map e65 with expected crc 2023-12-08T20:33:21.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:21 smithi111 ceph-mon[182474]: failed to encode map e65 with expected crc 2023-12-08T20:33:21.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:21 smithi111 ceph-mon[182474]: failed to encode map e65 with expected crc 2023-12-08T20:33:21.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:21 smithi111 ceph-mon[182474]: failed to encode map e65 with expected crc 2023-12-08T20:33:21.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:21 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:21.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:21 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:21.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:21 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:33:21.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:21 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:33:21.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:21 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:21.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:21 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:33:21.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:21 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:33:21.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:21 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:33:21.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:21 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:33:21.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:21 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-08T20:33:21.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:21 smithi111 ceph-mon[182474]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-08T20:33:21.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:21 smithi111 ceph-mon[182474]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-08T20:33:22.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:21 smithi043 ceph-mon[219193]: failed to encode map e65 with expected crc 2023-12-08T20:33:22.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:21 smithi043 ceph-mon[219193]: failed to encode map e65 with expected crc 2023-12-08T20:33:22.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:21 smithi043 ceph-mon[219193]: failed to encode map e65 with expected crc 2023-12-08T20:33:22.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:21 smithi043 ceph-mon[219193]: failed to encode map e65 with expected crc 2023-12-08T20:33:22.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:21 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:22.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:21 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:22.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:21 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:33:22.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:21 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:33:22.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:21 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:22.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:21 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:33:22.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:21 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:33:22.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:21 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:33:22.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:21 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:33:22.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:21 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-08T20:33:22.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:21 smithi043 ceph-mon[219193]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-08T20:33:22.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:21 smithi043 ceph-mon[219193]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-08T20:33:22.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:22 smithi111 ceph-mon[182474]: pgmap v82: 65 pgs: 10 peering, 6 active+undersized+degraded, 6 active+undersized, 43 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 18/357 objects degraded (5.042%) 2023-12-08T20:33:23.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:22 smithi043 ceph-mon[219193]: pgmap v82: 65 pgs: 10 peering, 6 active+undersized+degraded, 6 active+undersized, 43 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 18/357 objects degraded (5.042%) 2023-12-08T20:33:24.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:24 smithi043 ceph-mon[219193]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/357 objects degraded (5.042%), 6 pgs degraded) 2023-12-08T20:33:24.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:24 smithi043 ceph-mon[219193]: Cluster is now healthy 2023-12-08T20:33:24.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:24 smithi111 ceph-mon[182474]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/357 objects degraded (5.042%), 6 pgs degraded) 2023-12-08T20:33:24.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:24 smithi111 ceph-mon[182474]: Cluster is now healthy 2023-12-08T20:33:25.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:25 smithi111 ceph-mon[182474]: pgmap v83: 65 pgs: 10 peering, 55 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:25.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:25 smithi043 ceph-mon[219193]: pgmap v83: 65 pgs: 10 peering, 55 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:26.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:26 smithi111 ceph-mon[182474]: pgmap v84: 65 pgs: 65 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:27.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:26 smithi043 ceph-mon[219193]: pgmap v84: 65 pgs: 65 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:29.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:28 smithi111 ceph-mon[182474]: pgmap v85: 65 pgs: 65 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:29.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:28 smithi043 ceph-mon[219193]: pgmap v85: 65 pgs: 65 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:30.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:29 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:30.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:29 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:33:30.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:29 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:30.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:29 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:33:31.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:30 smithi043 ceph-mon[219193]: pgmap v86: 65 pgs: 65 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:31.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:30 smithi111 ceph-mon[182474]: pgmap v86: 65 pgs: 65 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:33.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:32 smithi043 ceph-mon[219193]: pgmap v87: 65 pgs: 65 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:33.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:32 smithi111 ceph-mon[182474]: pgmap v87: 65 pgs: 65 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:35.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:34 smithi043 ceph-mon[219193]: pgmap v88: 65 pgs: 65 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:35.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:34 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:34 smithi111 ceph-mon[182474]: pgmap v88: 65 pgs: 65 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:34 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:36.796 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:36 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-08T20:33:36.796 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:36 smithi111 ceph-mon[182474]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-08T20:33:36.796 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:36 smithi111 ceph-mon[182474]: Upgrade: osd.3 is safe to restart 2023-12-08T20:33:36.796 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:36 smithi111 ceph-mon[182474]: pgmap v89: 65 pgs: 65 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:37.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:36 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-08T20:33:37.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:36 smithi043 ceph-mon[219193]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-08T20:33:37.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:36 smithi043 ceph-mon[219193]: Upgrade: osd.3 is safe to restart 2023-12-08T20:33:37.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:36 smithi043 ceph-mon[219193]: pgmap v89: 65 pgs: 65 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:37.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:37 smithi111 ceph-mon[182474]: Upgrade: Updating osd.3 2023-12-08T20:33:37.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:37 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:37.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:37 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-08T20:33:37.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:37 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:33:37.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:37 smithi111 ceph-mon[182474]: Deploying daemon osd.3 on smithi111 2023-12-08T20:33:38.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:37 smithi043 ceph-mon[219193]: Upgrade: Updating osd.3 2023-12-08T20:33:38.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:37 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:38.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:37 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-08T20:33:38.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:37 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:33:38.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:37 smithi043 ceph-mon[219193]: Deploying daemon osd.3 on smithi111 2023-12-08T20:33:38.956 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:38 smithi111 ceph-mon[182474]: pgmap v90: 65 pgs: 65 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:39.218 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:38 smithi111 systemd[1]: Stopping Ceph osd.3 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:33:39.218 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:39 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-3[127506]: 2023-12-08T20:33:39.146+0000 7f54790ed700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-08T20:33:39.218 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:39 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-3[127506]: 2023-12-08T20:33:39.146+0000 7f54790ed700 -1 osd.3 65 *** Got signal Terminated *** 2023-12-08T20:33:39.218 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:39 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-3[127506]: 2023-12-08T20:33:39.146+0000 7f54790ed700 -1 osd.3 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-08T20:33:39.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:38 smithi043 ceph-mon[219193]: pgmap v90: 65 pgs: 65 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:40.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:39 smithi111 ceph-mon[182474]: osd.3 marked itself down and dead 2023-12-08T20:33:40.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:39 smithi043 ceph-mon[219193]: osd.3 marked itself down and dead 2023-12-08T20:33:40.895 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:40 smithi111 bash[194164]: ceph-28476818-9607-11ee-95a3-87774f69a715-osd-3 2023-12-08T20:33:41.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:40 smithi111 ceph-mon[182474]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-08T20:33:41.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:40 smithi111 ceph-mon[182474]: failed to encode map e66 with expected crc 2023-12-08T20:33:41.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:40 smithi111 ceph-mon[182474]: osdmap e66: 6 total, 5 up, 6 in 2023-12-08T20:33:41.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:40 smithi111 ceph-mon[182474]: pgmap v92: 65 pgs: 9 peering, 13 stale+active+clean, 43 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:41.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:40 smithi043 ceph-mon[219193]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-08T20:33:41.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:40 smithi043 ceph-mon[219193]: failed to encode map e66 with expected crc 2023-12-08T20:33:41.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:40 smithi043 ceph-mon[219193]: osdmap e66: 6 total, 5 up, 6 in 2023-12-08T20:33:41.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:40 smithi043 ceph-mon[219193]: pgmap v92: 65 pgs: 9 peering, 13 stale+active+clean, 43 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:42.198 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:41 smithi111 ceph-mon[182474]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-12-08T20:33:42.198 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:41 smithi111 ceph-mon[182474]: osdmap e67: 6 total, 5 up, 6 in 2023-12-08T20:33:42.198 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:41 smithi111 ceph-mon[182474]: failed to encode map e67 with expected crc 2023-12-08T20:33:42.198 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:41 smithi111 ceph-mon[182474]: failed to encode map e67 with expected crc 2023-12-08T20:33:42.198 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:41 smithi111 ceph-mon[182474]: failed to encode map e67 with expected crc 2023-12-08T20:33:42.198 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:41 smithi111 ceph-mon[182474]: failed to encode map e67 with expected crc 2023-12-08T20:33:42.198 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:41 smithi111 systemd[1]: ceph-28476818-9607-11ee-95a3-87774f69a715@osd.3.service: Succeeded. 2023-12-08T20:33:42.199 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:41 smithi111 systemd[1]: Stopped Ceph osd.3 for 28476818-9607-11ee-95a3-87774f69a715. 2023-12-08T20:33:42.199 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:41 smithi111 systemd[1]: Starting Ceph osd.3 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:33:42.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:41 smithi043 ceph-mon[219193]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-12-08T20:33:42.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:41 smithi043 ceph-mon[219193]: osdmap e67: 6 total, 5 up, 6 in 2023-12-08T20:33:42.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:41 smithi043 ceph-mon[219193]: failed to encode map e67 with expected crc 2023-12-08T20:33:42.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:41 smithi043 ceph-mon[219193]: failed to encode map e67 with expected crc 2023-12-08T20:33:42.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:41 smithi043 ceph-mon[219193]: failed to encode map e67 with expected crc 2023-12-08T20:33:42.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:41 smithi043 ceph-mon[219193]: failed to encode map e67 with expected crc 2023-12-08T20:33:42.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:42 smithi111 ceph-mon[182474]: pgmap v94: 65 pgs: 3 active+undersized+degraded, 18 peering, 3 stale+active+clean, 4 active+undersized, 37 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 9/357 objects degraded (2.521%) 2023-12-08T20:33:42.968 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:42 smithi111 bash[194433]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-08T20:33:42.968 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:42 smithi111 bash[194433]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-08T20:33:42.968 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:42 smithi111 bash[194433]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-08T20:33:42.968 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:42 smithi111 bash[194433]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-08T20:33:42.968 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:42 smithi111 bash[194433]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2023-12-08T20:33:42.968 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:42 smithi111 bash[194433]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-08T20:33:42.968 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:42 smithi111 bash[194433]: --> ceph-volume raw activate successful for osd ID: 3 2023-12-08T20:33:43.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:42 smithi043 ceph-mon[219193]: pgmap v94: 65 pgs: 3 active+undersized+degraded, 18 peering, 3 stale+active+clean, 4 active+undersized, 37 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 9/357 objects degraded (2.521%) 2023-12-08T20:33:43.717 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:43 smithi111 ceph-osd[194737]: -- 172.21.15.111:0/2998199934 <== mon.1 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ad7849f1e0 con 0x55ad7846ec00 2023-12-08T20:33:43.717 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:43 smithi111 bash[194698]: 75c0817b18fc07278efb3c2adcfd6db4f118095d638e349b45519fa88fdacc9a 2023-12-08T20:33:43.717 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:43 smithi111 systemd[1]: Started Ceph osd.3 for 28476818-9607-11ee-95a3-87774f69a715. 2023-12-08T20:33:44.217 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:43 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-3[194713]: 2023-12-08T20:33:43.896+0000 7f8cf7dcb640 -1 Falling back to public interface 2023-12-08T20:33:44.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:43 smithi111 ceph-mon[182474]: Health check failed: Degraded data redundancy: 9/357 objects degraded (2.521%), 3 pgs degraded (PG_DEGRADED) 2023-12-08T20:33:44.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:43 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:44.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:43 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:44.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:43 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:33:44.255 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:43 smithi043 ceph-mon[219193]: Health check failed: Degraded data redundancy: 9/357 objects degraded (2.521%), 3 pgs degraded (PG_DEGRADED) 2023-12-08T20:33:44.255 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:43 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:44.255 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:43 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:44.255 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:43 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:33:45.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:44 smithi111 ceph-mon[182474]: pgmap v95: 65 pgs: 11 active+undersized+degraded, 18 peering, 9 active+undersized, 27 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 33/357 objects degraded (9.244%) 2023-12-08T20:33:45.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:45.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:33:45.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:44 smithi043 ceph-mon[219193]: pgmap v95: 65 pgs: 11 active+undersized+degraded, 18 peering, 9 active+undersized, 27 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 33/357 objects degraded (9.244%) 2023-12-08T20:33:45.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:45.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:33:45.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.927+0000 7fa5e947f700 1 -- 172.21.15.43:0/1844743268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5e40fbb00 msgr2=0x7fa5e40fbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:45.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.927+0000 7fa5e947f700 1 --2- 172.21.15.43:0/1844743268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5e40fbb00 0x7fa5e40fbf70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8004940 tx=0x7fa5d8009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:45.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.927+0000 7fa5e947f700 1 -- 172.21.15.43:0/1844743268 shutdown_connections 2023-12-08T20:33:45.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.927+0000 7fa5e947f700 1 --2- 172.21.15.43:0/1844743268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5e40fbb00 0x7fa5e40fbf70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:45.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.927+0000 7fa5e947f700 1 --2- 172.21.15.43:0/1844743268 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5e4101b60 0x7fa5e4101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:45.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.927+0000 7fa5e947f700 1 -- 172.21.15.43:0/1844743268 >> 172.21.15.43:0/1844743268 conn(0x7fa5e40f7640 msgr2=0x7fa5e40f9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:45.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.927+0000 7fa5e947f700 1 -- 172.21.15.43:0/1844743268 shutdown_connections 2023-12-08T20:33:45.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.927+0000 7fa5e947f700 1 -- 172.21.15.43:0/1844743268 wait complete. 2023-12-08T20:33:45.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.928+0000 7fa5e947f700 1 Processor -- start 2023-12-08T20:33:45.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.928+0000 7fa5e947f700 1 -- start start 2023-12-08T20:33:45.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.928+0000 7fa5e947f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5e40fbb00 0x7fa5e41135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:45.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.928+0000 7fa5e947f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5e4101b60 0x7fa5e4113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:45.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.928+0000 7fa5e947f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e4114170 con 0x7fa5e4101b60 2023-12-08T20:33:45.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.928+0000 7fa5e947f700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e410d4a0 con 0x7fa5e40fbb00 2023-12-08T20:33:45.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.928+0000 7fa5e27fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5e4101b60 0x7fa5e4113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:45.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.928+0000 7fa5e2ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5e40fbb00 0x7fa5e41135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:45.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.928+0000 7fa5e27fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5e4101b60 0x7fa5e4113b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55102/0 (socket says 172.21.15.43:55102) 2023-12-08T20:33:45.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.928+0000 7fa5e27fc700 1 -- 172.21.15.43:0/107757935 learned_addr learned my addr 172.21.15.43:0/107757935 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:33:45.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.929+0000 7fa5e2ffd700 1 -- 172.21.15.43:0/107757935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5e4101b60 msgr2=0x7fa5e4113b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:45.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.929+0000 7fa5e2ffd700 1 --2- 172.21.15.43:0/107757935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5e4101b60 0x7fa5e4113b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:45.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.929+0000 7fa5e2ffd700 1 -- 172.21.15.43:0/107757935 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d8005040 con 0x7fa5e40fbb00 2023-12-08T20:33:45.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.929+0000 7fa5e2ffd700 1 --2- 172.21.15.43:0/107757935 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5e40fbb00 0x7fa5e41135e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4009fd0 tx=0x7fa5d400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:45.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.929+0000 7fa5cb7fe700 1 -- 172.21.15.43:0/107757935 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5d4004e90 con 0x7fa5e40fbb00 2023-12-08T20:33:45.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.929+0000 7fa5cb7fe700 1 -- 172.21.15.43:0/107757935 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa5d400f040 con 0x7fa5e40fbb00 2023-12-08T20:33:45.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.929+0000 7fa5e947f700 1 -- 172.21.15.43:0/107757935 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e410d720 con 0x7fa5e40fbb00 2023-12-08T20:33:45.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.929+0000 7fa5cb7fe700 1 -- 172.21.15.43:0/107757935 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5d400c9b0 con 0x7fa5e40fbb00 2023-12-08T20:33:45.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.929+0000 7fa5e947f700 1 -- 172.21.15.43:0/107757935 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e410dc60 con 0x7fa5e40fbb00 2023-12-08T20:33:45.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.930+0000 7fa5e947f700 1 -- 172.21.15.43:0/107757935 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e40fb280 con 0x7fa5e40fbb00 2023-12-08T20:33:45.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.931+0000 7fa5cb7fe700 1 -- 172.21.15.43:0/107757935 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fa5d40090d0 con 0x7fa5e40fbb00 2023-12-08T20:33:45.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.931+0000 7fa5cb7fe700 1 --2- 172.21.15.43:0/107757935 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa5cc06ce60 0x7fa5cc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:45.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.931+0000 7fa5e27fc700 1 --2- 172.21.15.43:0/107757935 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa5cc06ce60 0x7fa5cc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:45.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.931+0000 7fa5cb7fe700 1 -- 172.21.15.43:0/107757935 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa5d408bcd0 con 0x7fa5e40fbb00 2023-12-08T20:33:45.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.932+0000 7fa5e27fc700 1 --2- 172.21.15.43:0/107757935 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa5cc06ce60 0x7fa5cc06f310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5e410ee80 tx=0x7fa5d8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:45.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:45.936+0000 7fa5cb7fe700 1 -- 172.21.15.43:0/107757935 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa5d4059720 con 0x7fa5e40fbb00 2023-12-08T20:33:46.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.164+0000 7fa5e947f700 1 -- 172.21.15.43:0/107757935 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5e410ecd0 con 0x7fa5cc06ce60 2023-12-08T20:33:46.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.165+0000 7fa5cb7fe700 1 -- 172.21.15.43:0/107757935 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fa5e410ecd0 con 0x7fa5cc06ce60 2023-12-08T20:33:46.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.168+0000 7fa5e947f700 1 -- 172.21.15.43:0/107757935 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa5cc06ce60 msgr2=0x7fa5cc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:46.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.168+0000 7fa5e947f700 1 --2- 172.21.15.43:0/107757935 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa5cc06ce60 0x7fa5cc06f310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5e410ee80 tx=0x7fa5d8009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:46.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.168+0000 7fa5e947f700 1 -- 172.21.15.43:0/107757935 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5e40fbb00 msgr2=0x7fa5e41135e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:46.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.168+0000 7fa5e947f700 1 --2- 172.21.15.43:0/107757935 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5e40fbb00 0x7fa5e41135e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4009fd0 tx=0x7fa5d400b040 comp rx=0 tx=0).stop 2023-12-08T20:33:46.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.168+0000 7fa5e947f700 1 -- 172.21.15.43:0/107757935 shutdown_connections 2023-12-08T20:33:46.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.168+0000 7fa5e947f700 1 --2- 172.21.15.43:0/107757935 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa5cc06ce60 0x7fa5cc06f310 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:46.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.168+0000 7fa5e947f700 1 --2- 172.21.15.43:0/107757935 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5e40fbb00 0x7fa5e41135e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:46.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.168+0000 7fa5e947f700 1 --2- 172.21.15.43:0/107757935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5e4101b60 0x7fa5e4113b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:46.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.168+0000 7fa5e947f700 1 -- 172.21.15.43:0/107757935 >> 172.21.15.43:0/107757935 conn(0x7fa5e40f7640 msgr2=0x7fa5e40ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:46.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.168+0000 7fa5e947f700 1 -- 172.21.15.43:0/107757935 shutdown_connections 2023-12-08T20:33:46.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.168+0000 7fa5e947f700 1 -- 172.21.15.43:0/107757935 wait complete. 2023-12-08T20:33:46.181 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:33:46.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.283+0000 7f59be014700 1 -- 172.21.15.43:0/2054791270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b8065d00 msgr2=0x7f59b8109080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:46.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.283+0000 7f59be014700 1 --2- 172.21.15.43:0/2054791270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b8065d00 0x7f59b8109080 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f59a8004940 tx=0x7f59a8009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:46.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.283+0000 7f59be014700 1 -- 172.21.15.43:0/2054791270 shutdown_connections 2023-12-08T20:33:46.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.283+0000 7f59be014700 1 --2- 172.21.15.43:0/2054791270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b8065d00 0x7f59b8109080 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:46.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.283+0000 7f59be014700 1 --2- 172.21.15.43:0/2054791270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f59b80653f0 0x7f59b80657c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:46.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.283+0000 7f59be014700 1 -- 172.21.15.43:0/2054791270 >> 172.21.15.43:0/2054791270 conn(0x7f59b8071970 msgr2=0x7f59b8071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:46.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.283+0000 7f59be014700 1 -- 172.21.15.43:0/2054791270 shutdown_connections 2023-12-08T20:33:46.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.283+0000 7f59be014700 1 -- 172.21.15.43:0/2054791270 wait complete. 2023-12-08T20:33:46.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.283+0000 7f59be014700 1 Processor -- start 2023-12-08T20:33:46.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.284+0000 7f59be014700 1 -- start start 2023-12-08T20:33:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.284+0000 7f59be014700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f59b80653f0 0x7f59b8115690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.284+0000 7f59be014700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b8065d00 0x7f59b8115c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.284+0000 7f59be014700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b8116260 con 0x7f59b8065d00 2023-12-08T20:33:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.284+0000 7f59be014700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b810f550 con 0x7f59b80653f0 2023-12-08T20:33:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.284+0000 7f59b6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b8065d00 0x7f59b8115c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.284+0000 7f59b6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b8065d00 0x7f59b8115c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55122/0 (socket says 172.21.15.43:55122) 2023-12-08T20:33:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.284+0000 7f59b6ffd700 1 -- 172.21.15.43:0/3818743471 learned_addr learned my addr 172.21.15.43:0/3818743471 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:33:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.284+0000 7f59b77fe700 1 --2- 172.21.15.43:0/3818743471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f59b80653f0 0x7f59b8115690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.284+0000 7f59b6ffd700 1 -- 172.21.15.43:0/3818743471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f59b80653f0 msgr2=0x7f59b8115690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.284+0000 7f59b6ffd700 1 --2- 172.21.15.43:0/3818743471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f59b80653f0 0x7f59b8115690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.284+0000 7f59b6ffd700 1 -- 172.21.15.43:0/3818743471 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a8005040 con 0x7f59b8065d00 2023-12-08T20:33:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.285+0000 7f59b6ffd700 1 --2- 172.21.15.43:0/3818743471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b8065d00 0x7f59b8115c10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f59a8009180 tx=0x7f59a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.285+0000 7f59affff700 1 -- 172.21.15.43:0/3818743471 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59a800e040 con 0x7f59b8065d00 2023-12-08T20:33:46.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.285+0000 7f59affff700 1 -- 172.21.15.43:0/3818743471 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f59a8004290 con 0x7f59b8065d00 2023-12-08T20:33:46.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.285+0000 7f59be014700 1 -- 172.21.15.43:0/3818743471 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b810f780 con 0x7f59b8065d00 2023-12-08T20:33:46.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.285+0000 7f59affff700 1 -- 172.21.15.43:0/3818743471 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59a801c3f0 con 0x7f59b8065d00 2023-12-08T20:33:46.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.285+0000 7f59be014700 1 -- 172.21.15.43:0/3818743471 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b810fcc0 con 0x7f59b8065d00 2023-12-08T20:33:46.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.286+0000 7f59be014700 1 -- 172.21.15.43:0/3818743471 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b81067b0 con 0x7f59b8065d00 2023-12-08T20:33:46.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.286+0000 7f59affff700 1 -- 172.21.15.43:0/3818743471 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f59a8013420 con 0x7f59b8065d00 2023-12-08T20:33:46.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.287+0000 7f59affff700 1 --2- 172.21.15.43:0/3818743471 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f59a406ce60 0x7f59a406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:46.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.287+0000 7f59affff700 1 -- 172.21.15.43:0/3818743471 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f59a808d550 con 0x7f59b8065d00 2023-12-08T20:33:46.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.287+0000 7f59b77fe700 1 --2- 172.21.15.43:0/3818743471 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f59a406ce60 0x7f59a406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:46.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.287+0000 7f59b77fe700 1 --2- 172.21.15.43:0/3818743471 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f59a406ce60 0x7f59a406f310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f59b80fd070 tx=0x7f59a000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:46.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.292+0000 7f59affff700 1 -- 172.21.15.43:0/3818743471 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f59a805b040 con 0x7f59b8065d00 2023-12-08T20:33:46.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:46 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:46.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:46 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:46.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:46 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:46.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:46 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:46.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:46 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:46.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:46 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:46.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:46 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:46.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:46 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:46.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.523+0000 7f59be014700 1 -- 172.21.15.43:0/3818743471 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f59b8110c70 con 0x7f59a406ce60 2023-12-08T20:33:46.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.524+0000 7f59affff700 1 -- 172.21.15.43:0/3818743471 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f59b8110c70 con 0x7f59a406ce60 2023-12-08T20:33:46.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.526+0000 7f59be014700 1 -- 172.21.15.43:0/3818743471 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f59a406ce60 msgr2=0x7f59a406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:46.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.526+0000 7f59be014700 1 --2- 172.21.15.43:0/3818743471 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f59a406ce60 0x7f59a406f310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f59b80fd070 tx=0x7f59a000b040 comp rx=0 tx=0).stop 2023-12-08T20:33:46.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.526+0000 7f59be014700 1 -- 172.21.15.43:0/3818743471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b8065d00 msgr2=0x7f59b8115c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:46.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.526+0000 7f59be014700 1 --2- 172.21.15.43:0/3818743471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b8065d00 0x7f59b8115c10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f59a8009180 tx=0x7f59a8009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:46.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.526+0000 7f59be014700 1 -- 172.21.15.43:0/3818743471 shutdown_connections 2023-12-08T20:33:46.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.526+0000 7f59be014700 1 --2- 172.21.15.43:0/3818743471 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f59a406ce60 0x7f59a406f310 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:46.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.526+0000 7f59be014700 1 --2- 172.21.15.43:0/3818743471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f59b80653f0 0x7f59b8115690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:46.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.526+0000 7f59be014700 1 --2- 172.21.15.43:0/3818743471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59b8065d00 0x7f59b8115c10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:46.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.526+0000 7f59be014700 1 -- 172.21.15.43:0/3818743471 >> 172.21.15.43:0/3818743471 conn(0x7f59b8071970 msgr2=0x7f59b80fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:46.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.527+0000 7f59be014700 1 -- 172.21.15.43:0/3818743471 shutdown_connections 2023-12-08T20:33:46.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.527+0000 7f59be014700 1 -- 172.21.15.43:0/3818743471 wait complete. 2023-12-08T20:33:46.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.640+0000 7f8e2bd39700 1 -- 172.21.15.43:0/3668541946 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e240fbb40 msgr2=0x7f8e240fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:46.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.640+0000 7f8e2bd39700 1 --2- 172.21.15.43:0/3668541946 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e240fbb40 0x7f8e240fbfb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8e14004940 tx=0x7f8e14009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:46.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.640+0000 7f8e2bd39700 1 -- 172.21.15.43:0/3668541946 shutdown_connections 2023-12-08T20:33:46.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.640+0000 7f8e2bd39700 1 --2- 172.21.15.43:0/3668541946 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e240fbb40 0x7f8e240fbfb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:46.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.640+0000 7f8e2bd39700 1 --2- 172.21.15.43:0/3668541946 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e24101b00 0x7f8e24101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:46.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.640+0000 7f8e2bd39700 1 -- 172.21.15.43:0/3668541946 >> 172.21.15.43:0/3668541946 conn(0x7f8e240719b0 msgr2=0x7f8e24071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:46.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.640+0000 7f8e2bd39700 1 -- 172.21.15.43:0/3668541946 shutdown_connections 2023-12-08T20:33:46.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.640+0000 7f8e2bd39700 1 -- 172.21.15.43:0/3668541946 wait complete. 2023-12-08T20:33:46.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.640+0000 7f8e2bd39700 1 Processor -- start 2023-12-08T20:33:46.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.640+0000 7f8e2bd39700 1 -- start start 2023-12-08T20:33:46.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.641+0000 7f8e2bd39700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e240fbb40 0x7f8e240fdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:46.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.641+0000 7f8e2bd39700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e24101b00 0x7f8e240fe090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:46.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.641+0000 7f8e2bd39700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e240fe6e0 con 0x7f8e24101b00 2023-12-08T20:33:46.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.641+0000 7f8e2bd39700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e240fe850 con 0x7f8e240fbb40 2023-12-08T20:33:46.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.641+0000 7f8e292d4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e24101b00 0x7f8e240fe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:46.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.641+0000 7f8e29ad5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e240fbb40 0x7f8e240fdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:46.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.641+0000 7f8e292d4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e24101b00 0x7f8e240fe090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55142/0 (socket says 172.21.15.43:55142) 2023-12-08T20:33:46.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.641+0000 7f8e292d4700 1 -- 172.21.15.43:0/3777948492 learned_addr learned my addr 172.21.15.43:0/3777948492 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:33:46.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.641+0000 7f8e29ad5700 1 -- 172.21.15.43:0/3777948492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e24101b00 msgr2=0x7f8e240fe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:46.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.641+0000 7f8e29ad5700 1 --2- 172.21.15.43:0/3777948492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e24101b00 0x7f8e240fe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:46.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.641+0000 7f8e29ad5700 1 -- 172.21.15.43:0/3777948492 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e14005040 con 0x7f8e240fbb40 2023-12-08T20:33:46.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.641+0000 7f8e292d4700 1 --2- 172.21.15.43:0/3777948492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e24101b00 0x7f8e240fe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T20:33:46.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.641+0000 7f8e29ad5700 1 --2- 172.21.15.43:0/3777948492 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e240fbb40 0x7f8e240fdb30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8e20009fd0 tx=0x7f8e2000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:46.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.641+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/3777948492 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e20004e90 con 0x7f8e240fbb40 2023-12-08T20:33:46.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.642+0000 7f8e2bd39700 1 -- 172.21.15.43:0/3777948492 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e24119810 con 0x7f8e240fbb40 2023-12-08T20:33:46.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.642+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/3777948492 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e2000f040 con 0x7f8e240fbb40 2023-12-08T20:33:46.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.642+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/3777948492 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e2000c9b0 con 0x7f8e240fbb40 2023-12-08T20:33:46.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.642+0000 7f8e2bd39700 1 -- 172.21.15.43:0/3777948492 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e24119cf0 con 0x7f8e240fbb40 2023-12-08T20:33:46.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.642+0000 7f8e2bd39700 1 -- 172.21.15.43:0/3777948492 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e240734d0 con 0x7f8e240fbb40 2023-12-08T20:33:46.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.643+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/3777948492 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f8e20007cc0 con 0x7f8e240fbb40 2023-12-08T20:33:46.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.643+0000 7f8e1a7fc700 1 --2- 172.21.15.43:0/3777948492 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f8e1006ce60 0x7f8e1006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:46.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.644+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/3777948492 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f8e2008bc60 con 0x7f8e240fbb40 2023-12-08T20:33:46.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.644+0000 7f8e292d4700 1 --2- 172.21.15.43:0/3777948492 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f8e1006ce60 0x7f8e1006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:46.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.644+0000 7f8e292d4700 1 --2- 172.21.15.43:0/3777948492 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f8e1006ce60 0x7f8e1006f310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e240ff530 tx=0x7f8e14009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:46.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.649+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/3777948492 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8e20055c40 con 0x7f8e240fbb40 2023-12-08T20:33:46.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.868+0000 7f8e2bd39700 1 -- 172.21.15.43:0/3777948492 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e240ff380 con 0x7f8e1006ce60 2023-12-08T20:33:46.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.879+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/3777948492 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f8e240ff380 con 0x7f8e1006ce60 2023-12-08T20:33:46.881 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-08T20:33:46.881 INFO:teuthology.orchestra.run.smithi043.stdout:alertmanager.smithi043 smithi043 *:9093,9094 running (4m) 30s ago 11m 26.4M - 0.25.0 c8568f914cd2 d4a6cd00c86b 2023-12-08T20:33:46.881 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi043 smithi043 running (114s) 30s ago 12m 7482k - 19.0.0-44-g9dcc13bb f28f2b94f153 f570eddb8e8a 2023-12-08T20:33:46.881 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi111 smithi111 running (111s) 1s ago 11m 7457k - 19.0.0-44-g9dcc13bb f28f2b94f153 b2013e24b94e 2023-12-08T20:33:46.881 INFO:teuthology.orchestra.run.smithi043.stdout:grafana.smithi043 smithi043 *:3000 running (3m) 30s ago 11m 84.4M - 9.4.7 954c08fa6188 8f55491a980b 2023-12-08T20:33:46.881 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.akrjef smithi043 running (7m) 30s ago 7m 18.9M - 17.2.7-119-ge2143d99 f761b6e42225 1c0cb8d34ef8 2023-12-08T20:33:46.881 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.pjmszb smithi043 running (8m) 30s ago 8m 7154M - 17.2.7-119-ge2143d99 f761b6e42225 d7eee0c78093 2023-12-08T20:33:46.881 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.svpasm smithi111 running (7m) 1s ago 7m 16.7M - 17.2.7-119-ge2143d99 f761b6e42225 657d4d1cf4b2 2023-12-08T20:33:46.882 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.veeegc smithi111 running (8m) 1s ago 8m 3706M - 17.2.7-119-ge2143d99 f761b6e42225 31f794a388ab 2023-12-08T20:33:46.882 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi043.hqcdcm smithi043 *:8443,9283,8765 running (5m) 30s ago 13m 510M - 19.0.0-44-g9dcc13bb f28f2b94f153 14e91c1dac64 2023-12-08T20:33:46.882 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi111.mtcffu smithi111 *:8443,9283,8765 running (4m) 1s ago 11m 451M - 19.0.0-44-g9dcc13bb f28f2b94f153 56f4290c6db5 2023-12-08T20:33:46.882 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi043 smithi043 running (2m) 30s ago 13m 61.7M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 3597e3a60ebc 2023-12-08T20:33:46.882 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi111 smithi111 running (2m) 1s ago 11m 50.7M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 528aa182165f 2023-12-08T20:33:46.882 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi043 smithi043 *:9100 running (4m) 30s ago 12m 17.4M - 1.5.0 0da6a335fe13 0959b44d9972 2023-12-08T20:33:46.882 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi111 smithi111 *:9100 running (4m) 1s ago 11m 17.9M - 1.5.0 0da6a335fe13 10fe4fdb23d0 2023-12-08T20:33:46.882 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (95s) 30s ago 10m 121M 1570M 19.0.0-44-g9dcc13bb f28f2b94f153 298e9b98d7a4 2023-12-08T20:33:46.882 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi043 running (65s) 30s ago 10m 127M 1570M 19.0.0-44-g9dcc13bb f28f2b94f153 1ad10def08c3 2023-12-08T20:33:46.882 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi043 running (34s) 30s ago 9m 14.9M 1570M 19.0.0-44-g9dcc13bb f28f2b94f153 0b56e93b08fc 2023-12-08T20:33:46.882 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi111 running (3s) 1s ago 9m 12.1M 2592M 19.0.0-44-g9dcc13bb f28f2b94f153 75c0817b18fc 2023-12-08T20:33:46.882 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi111 running (9m) 1s ago 9m 740M 2592M 17.2.7-119-ge2143d99 f761b6e42225 38cdb6a88694 2023-12-08T20:33:46.882 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi111 running (9m) 1s ago 9m 888M 2592M 17.2.7-119-ge2143d99 f761b6e42225 59a9ce8c1141 2023-12-08T20:33:46.883 INFO:teuthology.orchestra.run.smithi043.stdout:prometheus.smithi043 smithi043 *:9095 running (4m) 30s ago 11m 64.7M - 2.43.0 a07b618ecd1d d95914ec88d8 2023-12-08T20:33:46.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.881+0000 7f8e2bd39700 1 -- 172.21.15.43:0/3777948492 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f8e1006ce60 msgr2=0x7f8e1006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:46.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.881+0000 7f8e2bd39700 1 --2- 172.21.15.43:0/3777948492 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f8e1006ce60 0x7f8e1006f310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e240ff530 tx=0x7f8e14009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:46.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.881+0000 7f8e2bd39700 1 -- 172.21.15.43:0/3777948492 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e240fbb40 msgr2=0x7f8e240fdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:46.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.881+0000 7f8e2bd39700 1 --2- 172.21.15.43:0/3777948492 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e240fbb40 0x7f8e240fdb30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8e20009fd0 tx=0x7f8e2000b040 comp rx=0 tx=0).stop 2023-12-08T20:33:46.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.881+0000 7f8e2bd39700 1 -- 172.21.15.43:0/3777948492 shutdown_connections 2023-12-08T20:33:46.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.881+0000 7f8e2bd39700 1 --2- 172.21.15.43:0/3777948492 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f8e1006ce60 0x7f8e1006f310 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:46.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.881+0000 7f8e2bd39700 1 --2- 172.21.15.43:0/3777948492 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e240fbb40 0x7f8e240fdb30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:46.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.881+0000 7f8e2bd39700 1 --2- 172.21.15.43:0/3777948492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e24101b00 0x7f8e240fe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:46.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.881+0000 7f8e2bd39700 1 -- 172.21.15.43:0/3777948492 >> 172.21.15.43:0/3777948492 conn(0x7f8e240719b0 msgr2=0x7f8e240ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:46.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.881+0000 7f8e2bd39700 1 -- 172.21.15.43:0/3777948492 shutdown_connections 2023-12-08T20:33:46.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.881+0000 7f8e2bd39700 1 -- 172.21.15.43:0/3777948492 wait complete. 2023-12-08T20:33:46.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.993+0000 7f4ea3ba3700 1 -- 172.21.15.43:0/2729062320 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e9c0fbb40 msgr2=0x7f4e9c0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:46.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.993+0000 7f4ea3ba3700 1 --2- 172.21.15.43:0/2729062320 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e9c0fbb40 0x7f4e9c0fbfb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c004940 tx=0x7f4e8c009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:46.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.993+0000 7f4ea3ba3700 1 -- 172.21.15.43:0/2729062320 shutdown_connections 2023-12-08T20:33:46.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.993+0000 7f4ea3ba3700 1 --2- 172.21.15.43:0/2729062320 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e9c0fbb40 0x7f4e9c0fbfb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:46.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.993+0000 7f4ea3ba3700 1 --2- 172.21.15.43:0/2729062320 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4e9c101b00 0x7f4e9c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:46.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.993+0000 7f4ea3ba3700 1 -- 172.21.15.43:0/2729062320 >> 172.21.15.43:0/2729062320 conn(0x7f4e9c0719b0 msgr2=0x7f4e9c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:46.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.993+0000 7f4ea3ba3700 1 -- 172.21.15.43:0/2729062320 shutdown_connections 2023-12-08T20:33:46.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.993+0000 7f4ea3ba3700 1 -- 172.21.15.43:0/2729062320 wait complete. 2023-12-08T20:33:46.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.994+0000 7f4ea3ba3700 1 Processor -- start 2023-12-08T20:33:46.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.994+0000 7f4ea3ba3700 1 -- start start 2023-12-08T20:33:46.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.994+0000 7f4ea3ba3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e9c0fbb40 0x7f4e9c10e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:46.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.994+0000 7f4ea3ba3700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4e9c101b00 0x7f4e9c10ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:46.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.994+0000 7f4ea3ba3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c10f200 con 0x7f4e9c0fbb40 2023-12-08T20:33:46.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.994+0000 7f4ea3ba3700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c10f370 con 0x7f4e9c101b00 2023-12-08T20:33:46.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.994+0000 7f4ea193f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e9c0fbb40 0x7f4e9c10e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:46.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.994+0000 7f4ea193f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e9c0fbb40 0x7f4e9c10e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55166/0 (socket says 172.21.15.43:55166) 2023-12-08T20:33:46.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.994+0000 7f4ea193f700 1 -- 172.21.15.43:0/3206845943 learned_addr learned my addr 172.21.15.43:0/3206845943 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:33:46.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.994+0000 7f4ea113e700 1 --2- 172.21.15.43:0/3206845943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4e9c101b00 0x7f4e9c10ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:46.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.995+0000 7f4ea193f700 1 -- 172.21.15.43:0/3206845943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4e9c101b00 msgr2=0x7f4e9c10ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:46.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.995+0000 7f4ea193f700 1 --2- 172.21.15.43:0/3206845943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4e9c101b00 0x7f4e9c10ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:46.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.995+0000 7f4ea193f700 1 -- 172.21.15.43:0/3206845943 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c005040 con 0x7f4e9c0fbb40 2023-12-08T20:33:46.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.995+0000 7f4ea193f700 1 --2- 172.21.15.43:0/3206845943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e9c0fbb40 0x7f4e9c10e670 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800eb70 tx=0x7f4e9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:46.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.995+0000 7f4e927fc700 1 -- 172.21.15.43:0/3206845943 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e98007e60 con 0x7f4e9c0fbb40 2023-12-08T20:33:46.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.995+0000 7f4e927fc700 1 -- 172.21.15.43:0/3206845943 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4e9800f040 con 0x7f4e9c0fbb40 2023-12-08T20:33:46.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.995+0000 7f4e927fc700 1 -- 172.21.15.43:0/3206845943 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e9800cb80 con 0x7f4e9c0fbb40 2023-12-08T20:33:46.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.995+0000 7f4ea3ba3700 1 -- 172.21.15.43:0/3206845943 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9c1175e0 con 0x7f4e9c0fbb40 2023-12-08T20:33:46.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.995+0000 7f4ea3ba3700 1 -- 172.21.15.43:0/3206845943 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9c117b20 con 0x7f4e9c0fbb40 2023-12-08T20:33:46.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.996+0000 7f4ea3ba3700 1 -- 172.21.15.43:0/3206845943 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9c0734d0 con 0x7f4e9c0fbb40 2023-12-08T20:33:46.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.997+0000 7f4e927fc700 1 -- 172.21.15.43:0/3206845943 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f4e9800cce0 con 0x7f4e9c0fbb40 2023-12-08T20:33:47.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.997+0000 7f4e927fc700 1 --2- 172.21.15.43:0/3206845943 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f4e8806ce70 0x7f4e8806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:47.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.997+0000 7f4e927fc700 1 -- 172.21.15.43:0/3206845943 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f4e9808bf00 con 0x7f4e9c0fbb40 2023-12-08T20:33:47.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.997+0000 7f4ea113e700 1 --2- 172.21.15.43:0/3206845943 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f4e8806ce70 0x7f4e8806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:47.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:46.998+0000 7f4ea113e700 1 --2- 172.21.15.43:0/3206845943 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f4e8806ce70 0x7f4e8806f320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c065e50 tx=0x7f4e8c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:47.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.002+0000 7f4e927fc700 1 -- 172.21.15.43:0/3206845943 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4e98055f60 con 0x7f4e9c0fbb40 2023-12-08T20:33:47.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.300+0000 7f4ea3ba3700 1 -- 172.21.15.43:0/3206845943 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4e9c065c30 con 0x7f4e9c0fbb40 2023-12-08T20:33:47.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.301+0000 7f4e927fc700 1 -- 172.21.15.43:0/3206845943 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f4e98059580 con 0x7f4e9c0fbb40 2023-12-08T20:33:47.303 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:33:47.303 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": { 2023-12-08T20:33:47.303 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:33:47.303 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:33:47.303 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": { 2023-12-08T20:33:47.303 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:33:47.303 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:33:47.303 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": { 2023-12-08T20:33:47.303 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 2, 2023-12-08T20:33:47.303 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 3 2023-12-08T20:33:47.303 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:33:47.303 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2023-12-08T20:33:47.304 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-08T20:33:47.304 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:33:47.304 INFO:teuthology.orchestra.run.smithi043.stdout: "overall": { 2023-12-08T20:33:47.304 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 6, 2023-12-08T20:33:47.304 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 7 2023-12-08T20:33:47.304 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-12-08T20:33:47.304 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:33:47.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.303+0000 7f4ea3ba3700 1 -- 172.21.15.43:0/3206845943 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f4e8806ce70 msgr2=0x7f4e8806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:47.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.303+0000 7f4ea3ba3700 1 --2- 172.21.15.43:0/3206845943 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f4e8806ce70 0x7f4e8806f320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c065e50 tx=0x7f4e8c009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:47.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.303+0000 7f4ea3ba3700 1 -- 172.21.15.43:0/3206845943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e9c0fbb40 msgr2=0x7f4e9c10e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:47.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.303+0000 7f4ea3ba3700 1 --2- 172.21.15.43:0/3206845943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e9c0fbb40 0x7f4e9c10e670 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800eb70 tx=0x7f4e9800b040 comp rx=0 tx=0).stop 2023-12-08T20:33:47.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.303+0000 7f4ea3ba3700 1 -- 172.21.15.43:0/3206845943 shutdown_connections 2023-12-08T20:33:47.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.303+0000 7f4ea3ba3700 1 --2- 172.21.15.43:0/3206845943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e9c0fbb40 0x7f4e9c10e670 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:47.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.303+0000 7f4ea3ba3700 1 --2- 172.21.15.43:0/3206845943 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f4e8806ce70 0x7f4e8806f320 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:47.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.303+0000 7f4ea3ba3700 1 --2- 172.21.15.43:0/3206845943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4e9c101b00 0x7f4e9c10ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:47.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.303+0000 7f4ea3ba3700 1 -- 172.21.15.43:0/3206845943 >> 172.21.15.43:0/3206845943 conn(0x7f4e9c0719b0 msgr2=0x7f4e9c0faa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:47.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.303+0000 7f4ea3ba3700 1 -- 172.21.15.43:0/3206845943 shutdown_connections 2023-12-08T20:33:47.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.303+0000 7f4ea3ba3700 1 -- 172.21.15.43:0/3206845943 wait complete. 2023-12-08T20:33:47.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.416+0000 7fa97ab50700 1 -- 172.21.15.43:0/4149448757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa974102c20 msgr2=0x7fa974102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:47.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.416+0000 7fa97ab50700 1 --2- 172.21.15.43:0/4149448757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa974102c20 0x7fa974102ff0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa968004940 tx=0x7fa968009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:47.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.416+0000 7fa97ab50700 1 -- 172.21.15.43:0/4149448757 shutdown_connections 2023-12-08T20:33:47.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.416+0000 7fa97ab50700 1 --2- 172.21.15.43:0/4149448757 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa974065390 0x7fa974065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:47.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.416+0000 7fa97ab50700 1 --2- 172.21.15.43:0/4149448757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa974102c20 0x7fa974102ff0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:47.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.416+0000 7fa97ab50700 1 -- 172.21.15.43:0/4149448757 >> 172.21.15.43:0/4149448757 conn(0x7fa9740719b0 msgr2=0x7fa974071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:47.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.416+0000 7fa97ab50700 1 -- 172.21.15.43:0/4149448757 shutdown_connections 2023-12-08T20:33:47.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.416+0000 7fa97ab50700 1 -- 172.21.15.43:0/4149448757 wait complete. 2023-12-08T20:33:47.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.417+0000 7fa97ab50700 1 Processor -- start 2023-12-08T20:33:47.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.417+0000 7fa97ab50700 1 -- start start 2023-12-08T20:33:47.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.417+0000 7fa97ab50700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa974065390 0x7fa974113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:47.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.417+0000 7fa97ab50700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa974102c20 0x7fa974113c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:47.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.417+0000 7fa97ab50700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97410d540 con 0x7fa974065390 2023-12-08T20:33:47.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.417+0000 7fa97ab50700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97410d6b0 con 0x7fa974102c20 2023-12-08T20:33:47.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.417+0000 7fa9788ec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa974065390 0x7fa974113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:47.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.417+0000 7fa9788ec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa974065390 0x7fa974113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55194/0 (socket says 172.21.15.43:55194) 2023-12-08T20:33:47.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.417+0000 7fa9788ec700 1 -- 172.21.15.43:0/3550019388 learned_addr learned my addr 172.21.15.43:0/3550019388 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:33:47.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.418+0000 7fa973fff700 1 --2- 172.21.15.43:0/3550019388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa974102c20 0x7fa974113c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:47.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.418+0000 7fa9788ec700 1 -- 172.21.15.43:0/3550019388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa974102c20 msgr2=0x7fa974113c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:47.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.418+0000 7fa9788ec700 1 --2- 172.21.15.43:0/3550019388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa974102c20 0x7fa974113c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:47.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.418+0000 7fa9788ec700 1 -- 172.21.15.43:0/3550019388 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa968005040 con 0x7fa974065390 2023-12-08T20:33:47.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.418+0000 7fa973fff700 1 --2- 172.21.15.43:0/3550019388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa974102c20 0x7fa974113c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:33:47.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.418+0000 7fa9788ec700 1 --2- 172.21.15.43:0/3550019388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa974065390 0x7fa974113680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa96800b3b0 tx=0x7fa968009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:47.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.418+0000 7fa9717fa700 1 -- 172.21.15.43:0/3550019388 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa96800e040 con 0x7fa974065390 2023-12-08T20:33:47.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.418+0000 7fa9717fa700 1 -- 172.21.15.43:0/3550019388 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa96800bc50 con 0x7fa974065390 2023-12-08T20:33:47.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.418+0000 7fa97ab50700 1 -- 172.21.15.43:0/3550019388 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa97410d930 con 0x7fa974065390 2023-12-08T20:33:47.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.418+0000 7fa9717fa700 1 -- 172.21.15.43:0/3550019388 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa968013420 con 0x7fa974065390 2023-12-08T20:33:47.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.418+0000 7fa97ab50700 1 -- 172.21.15.43:0/3550019388 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97410de70 con 0x7fa974065390 2023-12-08T20:33:47.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.419+0000 7fa97ab50700 1 -- 172.21.15.43:0/3550019388 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9740fff40 con 0x7fa974065390 2023-12-08T20:33:47.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.420+0000 7fa9717fa700 1 -- 172.21.15.43:0/3550019388 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fa96801c430 con 0x7fa974065390 2023-12-08T20:33:47.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.420+0000 7fa9717fa700 1 --2- 172.21.15.43:0/3550019388 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa96406ce60 0x7fa96406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:47.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.421+0000 7fa9717fa700 1 -- 172.21.15.43:0/3550019388 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa96808d020 con 0x7fa974065390 2023-12-08T20:33:47.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.421+0000 7fa973fff700 1 --2- 172.21.15.43:0/3550019388 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa96406ce60 0x7fa96406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:47.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.421+0000 7fa973fff700 1 --2- 172.21.15.43:0/3550019388 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa96406ce60 0x7fa96406f310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa97410ef20 tx=0x7fa960008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:47.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.425+0000 7fa9717fa700 1 -- 172.21.15.43:0/3550019388 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa96805ab10 con 0x7fa974065390 2023-12-08T20:33:47.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:47 smithi111 ceph-mon[182474]: pgmap v96: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2023-12-08T20:33:47.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:47 smithi111 ceph-mon[182474]: from='client.44219 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:33:47.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:47 smithi111 ceph-mon[182474]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2023-12-08T20:33:47.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:47 smithi043 ceph-mon[219193]: pgmap v96: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2023-12-08T20:33:47.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:47 smithi043 ceph-mon[219193]: from='client.44219 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:33:47.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:47 smithi043 ceph-mon[219193]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2023-12-08T20:33:47.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.682+0000 7fa97ab50700 1 -- 172.21.15.43:0/3550019388 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa97404bb80 con 0x7fa974065390 2023-12-08T20:33:47.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.682+0000 7fa9717fa700 1 -- 172.21.15.43:0/3550019388 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1855 (secure 0 0 0) 0x7fa96805a6a0 con 0x7fa974065390 2023-12-08T20:33:47.684 INFO:teuthology.orchestra.run.smithi043.stdout:e17 2023-12-08T20:33:47.684 INFO:teuthology.orchestra.run.smithi043.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-08T20:33:47.684 INFO:teuthology.orchestra.run.smithi043.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:33:47.684 INFO:teuthology.orchestra.run.smithi043.stdout:legacy client fscid: 1 2023-12-08T20:33:47.685 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:33:47.685 INFO:teuthology.orchestra.run.smithi043.stdout:Filesystem 'cephfs' (1) 2023-12-08T20:33:47.685 INFO:teuthology.orchestra.run.smithi043.stdout:fs_name cephfs 2023-12-08T20:33:47.685 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 17 2023-12-08T20:33:47.685 INFO:teuthology.orchestra.run.smithi043.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-08T20:33:47.685 INFO:teuthology.orchestra.run.smithi043.stdout:created 2023-12-08T20:25:41.527734+0000 2023-12-08T20:33:47.685 INFO:teuthology.orchestra.run.smithi043.stdout:modified 2023-12-08T20:32:04.068774+0000 2023-12-08T20:33:47.685 INFO:teuthology.orchestra.run.smithi043.stdout:tableserver 0 2023-12-08T20:33:47.685 INFO:teuthology.orchestra.run.smithi043.stdout:root 0 2023-12-08T20:33:47.685 INFO:teuthology.orchestra.run.smithi043.stdout:session_timeout 60 2023-12-08T20:33:47.685 INFO:teuthology.orchestra.run.smithi043.stdout:session_autoclose 300 2023-12-08T20:33:47.685 INFO:teuthology.orchestra.run.smithi043.stdout:max_file_size 1099511627776 2023-12-08T20:33:47.686 INFO:teuthology.orchestra.run.smithi043.stdout:max_xattr_size 65536 2023-12-08T20:33:47.686 INFO:teuthology.orchestra.run.smithi043.stdout:required_client_features {} 2023-12-08T20:33:47.686 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure 0 2023-12-08T20:33:47.686 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure_osd_epoch 0 2023-12-08T20:33:47.686 INFO:teuthology.orchestra.run.smithi043.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:33:47.686 INFO:teuthology.orchestra.run.smithi043.stdout:max_mds 2 2023-12-08T20:33:47.686 INFO:teuthology.orchestra.run.smithi043.stdout:in 0,1 2023-12-08T20:33:47.686 INFO:teuthology.orchestra.run.smithi043.stdout:up {0=14452,1=24315} 2023-12-08T20:33:47.686 INFO:teuthology.orchestra.run.smithi043.stdout:failed 2023-12-08T20:33:47.686 INFO:teuthology.orchestra.run.smithi043.stdout:damaged 2023-12-08T20:33:47.686 INFO:teuthology.orchestra.run.smithi043.stdout:stopped 2023-12-08T20:33:47.687 INFO:teuthology.orchestra.run.smithi043.stdout:data_pools [3] 2023-12-08T20:33:47.687 INFO:teuthology.orchestra.run.smithi043.stdout:metadata_pool 2 2023-12-08T20:33:47.687 INFO:teuthology.orchestra.run.smithi043.stdout:inline_data disabled 2023-12-08T20:33:47.687 INFO:teuthology.orchestra.run.smithi043.stdout:balancer 2023-12-08T20:33:47.687 INFO:teuthology.orchestra.run.smithi043.stdout:bal_rank_mask -1 2023-12-08T20:33:47.687 INFO:teuthology.orchestra.run.smithi043.stdout:standby_count_wanted 1 2023-12-08T20:33:47.687 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi043.pjmszb{0:14452} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.43:6826/441584552,v1:172.21.15.43:6827/441584552] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:33:47.687 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi111.veeegc{1:24315} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.111:6824/1990395192,v1:172.21.15.111:6825/1990395192] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:33:47.688 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:33:47.688 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:33:47.688 INFO:teuthology.orchestra.run.smithi043.stdout:Standby daemons: 2023-12-08T20:33:47.688 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:33:47.688 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi043.akrjef{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.43:6828/2926918083,v1:172.21.15.43:6829/2926918083] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:33:47.688 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi111.svpasm{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6826/2885759138,v1:172.21.15.111:6827/2885759138] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:33:47.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.685+0000 7fa97ab50700 1 -- 172.21.15.43:0/3550019388 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa96406ce60 msgr2=0x7fa96406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:47.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.685+0000 7fa97ab50700 1 --2- 172.21.15.43:0/3550019388 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa96406ce60 0x7fa96406f310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa97410ef20 tx=0x7fa960008040 comp rx=0 tx=0).stop 2023-12-08T20:33:47.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.685+0000 7fa97ab50700 1 -- 172.21.15.43:0/3550019388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa974065390 msgr2=0x7fa974113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:47.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.685+0000 7fa97ab50700 1 --2- 172.21.15.43:0/3550019388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa974065390 0x7fa974113680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa96800b3b0 tx=0x7fa968009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:47.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.685+0000 7fa97ab50700 1 -- 172.21.15.43:0/3550019388 shutdown_connections 2023-12-08T20:33:47.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.685+0000 7fa97ab50700 1 --2- 172.21.15.43:0/3550019388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa974065390 0x7fa974113680 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:47.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.685+0000 7fa97ab50700 1 --2- 172.21.15.43:0/3550019388 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa96406ce60 0x7fa96406f310 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:47.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.685+0000 7fa97ab50700 1 --2- 172.21.15.43:0/3550019388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa974102c20 0x7fa974113c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:47.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.685+0000 7fa97ab50700 1 -- 172.21.15.43:0/3550019388 >> 172.21.15.43:0/3550019388 conn(0x7fa9740719b0 msgr2=0x7fa9740faaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:47.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.685+0000 7fa97ab50700 1 -- 172.21.15.43:0/3550019388 shutdown_connections 2023-12-08T20:33:47.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.685+0000 7fa97ab50700 1 -- 172.21.15.43:0/3550019388 wait complete. 2023-12-08T20:33:47.691 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 17 2023-12-08T20:33:47.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.799+0000 7efe85d20700 1 -- 172.21.15.43:0/859333977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe80102c20 msgr2=0x7efe80102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:47.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.799+0000 7efe85d20700 1 --2- 172.21.15.43:0/859333977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe80102c20 0x7efe80102ff0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efe70004940 tx=0x7efe70009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:47.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.799+0000 7efe85d20700 1 -- 172.21.15.43:0/859333977 shutdown_connections 2023-12-08T20:33:47.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.799+0000 7efe85d20700 1 --2- 172.21.15.43:0/859333977 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe80065390 0x7efe80065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:47.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.799+0000 7efe85d20700 1 --2- 172.21.15.43:0/859333977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe80102c20 0x7efe80102ff0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:47.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.799+0000 7efe85d20700 1 -- 172.21.15.43:0/859333977 >> 172.21.15.43:0/859333977 conn(0x7efe800719b0 msgr2=0x7efe80071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:47.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.799+0000 7efe85d20700 1 -- 172.21.15.43:0/859333977 shutdown_connections 2023-12-08T20:33:47.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.799+0000 7efe85d20700 1 -- 172.21.15.43:0/859333977 wait complete. 2023-12-08T20:33:47.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.799+0000 7efe85d20700 1 Processor -- start 2023-12-08T20:33:47.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.800+0000 7efe85d20700 1 -- start start 2023-12-08T20:33:47.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.800+0000 7efe85d20700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe80065390 0x7efe80113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:47.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.800+0000 7efe85d20700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe80102c20 0x7efe80113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:47.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.800+0000 7efe85d20700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe801141e0 con 0x7efe80102c20 2023-12-08T20:33:47.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.800+0000 7efe85d20700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8010d4d0 con 0x7efe80065390 2023-12-08T20:33:47.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.800+0000 7efe7effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe80102c20 0x7efe80113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:47.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.800+0000 7efe7effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe80102c20 0x7efe80113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55224/0 (socket says 172.21.15.43:55224) 2023-12-08T20:33:47.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.800+0000 7efe7effd700 1 -- 172.21.15.43:0/1640197278 learned_addr learned my addr 172.21.15.43:0/1640197278 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:33:47.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.800+0000 7efe7f7fe700 1 --2- 172.21.15.43:0/1640197278 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe80065390 0x7efe80113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:47.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.800+0000 7efe7effd700 1 -- 172.21.15.43:0/1640197278 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe80065390 msgr2=0x7efe80113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:47.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.801+0000 7efe7effd700 1 --2- 172.21.15.43:0/1640197278 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe80065390 0x7efe80113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:47.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.801+0000 7efe7effd700 1 -- 172.21.15.43:0/1640197278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe68005040 con 0x7efe80102c20 2023-12-08T20:33:47.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.801+0000 7efe7effd700 1 --2- 172.21.15.43:0/1640197278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe80102c20 0x7efe80113b90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efe680096d0 tx=0x7efe68009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:47.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.801+0000 7efe77fff700 1 -- 172.21.15.43:0/1640197278 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe6800e840 con 0x7efe80102c20 2023-12-08T20:33:47.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.801+0000 7efe77fff700 1 -- 172.21.15.43:0/1640197278 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efe6800f040 con 0x7efe80102c20 2023-12-08T20:33:47.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.801+0000 7efe85d20700 1 -- 172.21.15.43:0/1640197278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe70005040 con 0x7efe80102c20 2023-12-08T20:33:47.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.801+0000 7efe77fff700 1 -- 172.21.15.43:0/1640197278 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe68013d30 con 0x7efe80102c20 2023-12-08T20:33:47.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.801+0000 7efe85d20700 1 -- 172.21.15.43:0/1640197278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8010dab0 con 0x7efe80102c20 2023-12-08T20:33:47.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.802+0000 7efe85d20700 1 -- 172.21.15.43:0/1640197278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe800734d0 con 0x7efe80102c20 2023-12-08T20:33:47.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.803+0000 7efe77fff700 1 -- 172.21.15.43:0/1640197278 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7efe6800e9a0 con 0x7efe80102c20 2023-12-08T20:33:47.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.803+0000 7efe77fff700 1 --2- 172.21.15.43:0/1640197278 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7efe6c06ce60 0x7efe6c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:47.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.803+0000 7efe77fff700 1 -- 172.21.15.43:0/1640197278 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6328+0+0 (secure 0 0 0) 0x7efe6808c070 con 0x7efe80102c20 2023-12-08T20:33:47.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.803+0000 7efe7f7fe700 1 --2- 172.21.15.43:0/1640197278 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7efe6c06ce60 0x7efe6c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:47.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.803+0000 7efe7f7fe700 1 --2- 172.21.15.43:0/1640197278 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7efe6c06ce60 0x7efe6c06f310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efe70009fd0 tx=0x7efe70009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:47.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:47.808+0000 7efe77fff700 1 -- 172.21.15.43:0/1640197278 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7efe68059a30 con 0x7efe80102c20 2023-12-08T20:33:48.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.038+0000 7efe85d20700 1 -- 172.21.15.43:0/1640197278 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe8010ebf0 con 0x7efe6c06ce60 2023-12-08T20:33:48.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.039+0000 7efe77fff700 1 -- 172.21.15.43:0/1640197278 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7efe8010ebf0 con 0x7efe6c06ce60 2023-12-08T20:33:48.041 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:33:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-08T20:33:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: "in_progress": true, 2023-12-08T20:33:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-08T20:33:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: "services_complete": [ 2023-12-08T20:33:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2023-12-08T20:33:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr", 2023-12-08T20:33:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: "mon" 2023-12-08T20:33:48.042 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2023-12-08T20:33:48.042 INFO:teuthology.orchestra.run.smithi043.stdout: "progress": "10/21 daemons upgraded", 2023-12-08T20:33:48.042 INFO:teuthology.orchestra.run.smithi043.stdout: "message": "Currently upgrading osd daemons", 2023-12-08T20:33:48.042 INFO:teuthology.orchestra.run.smithi043.stdout: "is_paused": false 2023-12-08T20:33:48.042 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:33:48.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.041+0000 7efe85d20700 1 -- 172.21.15.43:0/1640197278 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7efe6c06ce60 msgr2=0x7efe6c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:48.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.041+0000 7efe85d20700 1 --2- 172.21.15.43:0/1640197278 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7efe6c06ce60 0x7efe6c06f310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efe70009fd0 tx=0x7efe70009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:48.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.041+0000 7efe85d20700 1 -- 172.21.15.43:0/1640197278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe80102c20 msgr2=0x7efe80113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:48.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.041+0000 7efe85d20700 1 --2- 172.21.15.43:0/1640197278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe80102c20 0x7efe80113b90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efe680096d0 tx=0x7efe68009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:48.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.041+0000 7efe85d20700 1 -- 172.21.15.43:0/1640197278 shutdown_connections 2023-12-08T20:33:48.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.041+0000 7efe85d20700 1 --2- 172.21.15.43:0/1640197278 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7efe6c06ce60 0x7efe6c06f310 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:48.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.041+0000 7efe85d20700 1 --2- 172.21.15.43:0/1640197278 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe80065390 0x7efe80113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:48.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.041+0000 7efe85d20700 1 --2- 172.21.15.43:0/1640197278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe80102c20 0x7efe80113b90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:48.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.041+0000 7efe85d20700 1 -- 172.21.15.43:0/1640197278 >> 172.21.15.43:0/1640197278 conn(0x7efe800719b0 msgr2=0x7efe800fab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:48.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.042+0000 7efe85d20700 1 -- 172.21.15.43:0/1640197278 shutdown_connections 2023-12-08T20:33:48.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.042+0000 7efe85d20700 1 -- 172.21.15.43:0/1640197278 wait complete. 2023-12-08T20:33:48.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.154+0000 7f01d6129700 1 -- 172.21.15.43:0/2614288782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01d00fbb30 msgr2=0x7f01d00fbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:48.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.154+0000 7f01d6129700 1 --2- 172.21.15.43:0/2614288782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01d00fbb30 0x7f01d00fbfa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f01c4004940 tx=0x7f01c4009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:48.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.154+0000 7f01d6129700 1 -- 172.21.15.43:0/2614288782 shutdown_connections 2023-12-08T20:33:48.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.154+0000 7f01d6129700 1 --2- 172.21.15.43:0/2614288782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01d00fbb30 0x7f01d00fbfa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:48.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.154+0000 7f01d6129700 1 --2- 172.21.15.43:0/2614288782 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f01d0101af0 0x7f01d0101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:48.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.154+0000 7f01d6129700 1 -- 172.21.15.43:0/2614288782 >> 172.21.15.43:0/2614288782 conn(0x7f01d00f7690 msgr2=0x7f01d00f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:48.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.154+0000 7f01d6129700 1 -- 172.21.15.43:0/2614288782 shutdown_connections 2023-12-08T20:33:48.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.154+0000 7f01d6129700 1 -- 172.21.15.43:0/2614288782 wait complete. 2023-12-08T20:33:48.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.155+0000 7f01d6129700 1 Processor -- start 2023-12-08T20:33:48.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.155+0000 7f01d6129700 1 -- start start 2023-12-08T20:33:48.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.155+0000 7f01d6129700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01d00fbb30 0x7f01d010e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:48.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.155+0000 7f01d6129700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f01d0101af0 0x7f01d010ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:48.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.155+0000 7f01d6129700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d010f1b0 con 0x7f01d00fbb30 2023-12-08T20:33:48.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.156+0000 7f01d6129700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d010f320 con 0x7f01d0101af0 2023-12-08T20:33:48.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.156+0000 7f01cf7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01d00fbb30 0x7f01d010e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:48.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.156+0000 7f01cf7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01d00fbb30 0x7f01d010e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55244/0 (socket says 172.21.15.43:55244) 2023-12-08T20:33:48.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.156+0000 7f01cf7fe700 1 -- 172.21.15.43:0/3404755863 learned_addr learned my addr 172.21.15.43:0/3404755863 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:33:48.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.156+0000 7f01ceffd700 1 --2- 172.21.15.43:0/3404755863 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f01d0101af0 0x7f01d010ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:48.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.156+0000 7f01cf7fe700 1 -- 172.21.15.43:0/3404755863 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f01d0101af0 msgr2=0x7f01d010ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:48.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.156+0000 7f01cf7fe700 1 --2- 172.21.15.43:0/3404755863 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f01d0101af0 0x7f01d010ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:48.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.156+0000 7f01cf7fe700 1 -- 172.21.15.43:0/3404755863 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c4005040 con 0x7f01d00fbb30 2023-12-08T20:33:48.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.156+0000 7f01cf7fe700 1 --2- 172.21.15.43:0/3404755863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01d00fbb30 0x7f01d010e670 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f01c000eb40 tx=0x7f01c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:48.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.156+0000 7f01b7fff700 1 -- 172.21.15.43:0/3404755863 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01c0007cc0 con 0x7f01d00fbb30 2023-12-08T20:33:48.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.156+0000 7f01b7fff700 1 -- 172.21.15.43:0/3404755863 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f01c000f040 con 0x7f01d00fbb30 2023-12-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.156+0000 7f01d6129700 1 -- 172.21.15.43:0/3404755863 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d0117610 con 0x7f01d00fbb30 2023-12-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.156+0000 7f01b7fff700 1 -- 172.21.15.43:0/3404755863 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01c000c930 con 0x7f01d00fbb30 2023-12-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.156+0000 7f01d6129700 1 -- 172.21.15.43:0/3404755863 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d0117b50 con 0x7f01d00fbb30 2023-12-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.158+0000 7f01d6129700 1 -- 172.21.15.43:0/3404755863 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d0103fa0 con 0x7f01d00fbb30 2023-12-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.158+0000 7f01b7fff700 1 -- 172.21.15.43:0/3404755863 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f01c000cba0 con 0x7f01d00fbb30 2023-12-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.158+0000 7f01b7fff700 1 --2- 172.21.15.43:0/3404755863 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f01b806ce60 0x7f01b806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:33:48.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.159+0000 7f01b7fff700 1 -- 172.21.15.43:0/3404755863 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f01c008bda0 con 0x7f01d00fbb30 2023-12-08T20:33:48.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.159+0000 7f01ceffd700 1 --2- 172.21.15.43:0/3404755863 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f01b806ce60 0x7f01b806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:33:48.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.159+0000 7f01ceffd700 1 --2- 172.21.15.43:0/3404755863 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f01b806ce60 0x7f01b806f310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f01d0066720 tx=0x7f01c4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:33:48.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.163+0000 7f01b7fff700 1 -- 172.21.15.43:0/3404755863 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f01c0055e00 con 0x7f01d00fbb30 2023-12-08T20:33:48.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.464+0000 7f01d6129700 1 -- 172.21.15.43:0/3404755863 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f01d00fb290 con 0x7f01d00fbb30 2023-12-08T20:33:48.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.464+0000 7f01b7fff700 1 -- 172.21.15.43:0/3404755863 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1383 (secure 0 0 0) 0x7f01c0019580 con 0x7f01d00fbb30 2023-12-08T20:33:48.466 INFO:teuthology.orchestra.run.smithi043.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 75/357 objects degraded (21.008%), 20 pgs degraded 2023-12-08T20:33:48.466 INFO:teuthology.orchestra.run.smithi043.stdout:[WRN] OSD_DOWN: 1 osds down 2023-12-08T20:33:48.466 INFO:teuthology.orchestra.run.smithi043.stdout: osd.3 (root=default,host=smithi111) is down 2023-12-08T20:33:48.466 INFO:teuthology.orchestra.run.smithi043.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 75/357 objects degraded (21.008%), 20 pgs degraded 2023-12-08T20:33:48.466 INFO:teuthology.orchestra.run.smithi043.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2023-12-08T20:33:48.466 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2023-12-08T20:33:48.467 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2023-12-08T20:33:48.467 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2023-12-08T20:33:48.467 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2023-12-08T20:33:48.467 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2023-12-08T20:33:48.467 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2023-12-08T20:33:48.467 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2023-12-08T20:33:48.467 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2023-12-08T20:33:48.467 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2023-12-08T20:33:48.467 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2023-12-08T20:33:48.467 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.11 is active+undersized+degraded, acting [4,1] 2023-12-08T20:33:48.467 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.12 is active+undersized+degraded, acting [1,0] 2023-12-08T20:33:48.467 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2023-12-08T20:33:48.467 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2023-12-08T20:33:48.467 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2023-12-08T20:33:48.467 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2023-12-08T20:33:48.468 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2023-12-08T20:33:48.468 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2023-12-08T20:33:48.468 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2023-12-08T20:33:48.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:48 smithi111 ceph-mon[182474]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:33:48.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:48 smithi111 ceph-mon[182474]: from='client.44227 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:33:48.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:48 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/3206845943' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:33:48.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:48 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/3550019388' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-08T20:33:48.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.466+0000 7f01d6129700 1 -- 172.21.15.43:0/3404755863 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f01b806ce60 msgr2=0x7f01b806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:48.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.466+0000 7f01d6129700 1 --2- 172.21.15.43:0/3404755863 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f01b806ce60 0x7f01b806f310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f01d0066720 tx=0x7f01c4009e30 comp rx=0 tx=0).stop 2023-12-08T20:33:48.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.466+0000 7f01d6129700 1 -- 172.21.15.43:0/3404755863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01d00fbb30 msgr2=0x7f01d010e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:33:48.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.466+0000 7f01d6129700 1 --2- 172.21.15.43:0/3404755863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01d00fbb30 0x7f01d010e670 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f01c000eb40 tx=0x7f01c000b040 comp rx=0 tx=0).stop 2023-12-08T20:33:48.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.466+0000 7f01d6129700 1 -- 172.21.15.43:0/3404755863 shutdown_connections 2023-12-08T20:33:48.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.466+0000 7f01d6129700 1 --2- 172.21.15.43:0/3404755863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01d00fbb30 0x7f01d010e670 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:48.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.466+0000 7f01d6129700 1 --2- 172.21.15.43:0/3404755863 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f01b806ce60 0x7f01b806f310 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:48.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.466+0000 7f01d6129700 1 --2- 172.21.15.43:0/3404755863 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f01d0101af0 0x7f01d010ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:33:48.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.466+0000 7f01d6129700 1 -- 172.21.15.43:0/3404755863 >> 172.21.15.43:0/3404755863 conn(0x7f01d00f7690 msgr2=0x7f01d00f91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:33:48.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.467+0000 7f01d6129700 1 -- 172.21.15.43:0/3404755863 shutdown_connections 2023-12-08T20:33:48.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:33:48.467+0000 7f01d6129700 1 -- 172.21.15.43:0/3404755863 wait complete. 2023-12-08T20:33:48.473 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:48 smithi043 ceph-mon[219193]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:33:48.473 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:48 smithi043 ceph-mon[219193]: from='client.44227 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:33:48.473 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:48 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/3206845943' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:33:48.473 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:48 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/3550019388' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-08T20:33:48.967 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:48 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-3[194713]: 2023-12-08T20:33:48.482+0000 7f8cf7dcb640 -1 osd.3 0 read_superblock omap replica is missing. 2023-12-08T20:33:49.347 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:48 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-3[194713]: 2023-12-08T20:33:48.987+0000 7f8cf7dcb640 -1 osd.3 65 log_to_monitors true 2023-12-08T20:33:49.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:49 smithi111 ceph-mon[182474]: pgmap v97: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2023-12-08T20:33:49.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:49 smithi111 ceph-mon[182474]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:33:49.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:49.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:49.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:33:49.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:33:49.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:49.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:49 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/3404755863' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-08T20:33:49.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:33:49.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:33:49.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:33:49.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:33:49.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:49 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-08T20:33:49.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:49 smithi111 ceph-mon[182474]: from='osd.3 [v2:172.21.15.111:6800/118153540,v1:172.21.15.111:6801/118153540]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-08T20:33:49.348 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:49 smithi111 ceph-mon[182474]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-08T20:33:49.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:49 smithi043 ceph-mon[219193]: pgmap v97: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 301 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2023-12-08T20:33:49.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:49 smithi043 ceph-mon[219193]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:33:49.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:49.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:49.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:33:49.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:33:49.516 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:49.516 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:49 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/3404755863' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-08T20:33:49.516 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:33:49.516 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:33:49.516 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:33:49.516 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:33:49.516 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:49 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-08T20:33:49.517 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:49 smithi043 ceph-mon[219193]: from='osd.3 [v2:172.21.15.111:6800/118153540,v1:172.21.15.111:6801/118153540]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-08T20:33:49.517 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:49 smithi043 ceph-mon[219193]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-08T20:33:49.717 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:33:49 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-3[194713]: 2023-12-08T20:33:49.345+0000 7f8ce923c700 -1 osd.3 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:33:50.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:50 smithi111 ceph-mon[182474]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-08T20:33:50.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:50 smithi111 ceph-mon[182474]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-12-08T20:33:50.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:50 smithi111 ceph-mon[182474]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-08T20:33:50.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:50 smithi111 ceph-mon[182474]: osdmap e68: 6 total, 5 up, 6 in 2023-12-08T20:33:50.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:50 smithi111 ceph-mon[182474]: from='osd.3 [v2:172.21.15.111:6800/118153540,v1:172.21.15.111:6801/118153540]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:33:50.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:50 smithi111 ceph-mon[182474]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:33:50.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:50 smithi043 ceph-mon[219193]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-08T20:33:50.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:50 smithi043 ceph-mon[219193]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-12-08T20:33:50.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:50 smithi043 ceph-mon[219193]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-08T20:33:50.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:50 smithi043 ceph-mon[219193]: osdmap e68: 6 total, 5 up, 6 in 2023-12-08T20:33:50.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:50 smithi043 ceph-mon[219193]: from='osd.3 [v2:172.21.15.111:6800/118153540,v1:172.21.15.111:6801/118153540]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:33:50.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:50 smithi043 ceph-mon[219193]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:33:51.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:51 smithi111 ceph-mon[182474]: pgmap v99: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2023-12-08T20:33:51.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:51 smithi111 ceph-mon[182474]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-08T20:33:51.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:51 smithi111 ceph-mon[182474]: failed to encode map e68 with expected crc 2023-12-08T20:33:51.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:51 smithi111 ceph-mon[182474]: osd.3 [v2:172.21.15.111:6800/118153540,v1:172.21.15.111:6801/118153540] boot 2023-12-08T20:33:51.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:51 smithi111 ceph-mon[182474]: osdmap e69: 6 total, 6 up, 6 in 2023-12-08T20:33:51.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:51 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:33:51.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:51 smithi111 ceph-mon[182474]: Health check update: Degraded data redundancy: 75/357 objects degraded (21.008%), 20 pgs degraded (PG_DEGRADED) 2023-12-08T20:33:51.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:51 smithi043 ceph-mon[219193]: pgmap v99: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2023-12-08T20:33:51.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:51 smithi043 ceph-mon[219193]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-08T20:33:51.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:51 smithi043 ceph-mon[219193]: failed to encode map e68 with expected crc 2023-12-08T20:33:51.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:51 smithi043 ceph-mon[219193]: osd.3 [v2:172.21.15.111:6800/118153540,v1:172.21.15.111:6801/118153540] boot 2023-12-08T20:33:51.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:51 smithi043 ceph-mon[219193]: osdmap e69: 6 total, 6 up, 6 in 2023-12-08T20:33:51.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:51 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-08T20:33:51.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:51 smithi043 ceph-mon[219193]: Health check update: Degraded data redundancy: 75/357 objects degraded (21.008%), 20 pgs degraded (PG_DEGRADED) 2023-12-08T20:33:52.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:52 smithi111 ceph-mon[182474]: failed to encode map e70 with expected crc 2023-12-08T20:33:52.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:52 smithi111 ceph-mon[182474]: osdmap e70: 6 total, 6 up, 6 in 2023-12-08T20:33:52.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:52 smithi111 ceph-mon[182474]: failed to encode map e70 with expected crc 2023-12-08T20:33:52.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:52 smithi111 ceph-mon[182474]: failed to encode map e70 with expected crc 2023-12-08T20:33:52.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:52 smithi111 ceph-mon[182474]: failed to encode map e70 with expected crc 2023-12-08T20:33:52.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:52 smithi111 ceph-mon[182474]: pgmap v102: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 71/357 objects degraded (19.888%) 2023-12-08T20:33:52.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:52 smithi043 ceph-mon[219193]: failed to encode map e70 with expected crc 2023-12-08T20:33:52.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:52 smithi043 ceph-mon[219193]: osdmap e70: 6 total, 6 up, 6 in 2023-12-08T20:33:52.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:52 smithi043 ceph-mon[219193]: failed to encode map e70 with expected crc 2023-12-08T20:33:52.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:52 smithi043 ceph-mon[219193]: failed to encode map e70 with expected crc 2023-12-08T20:33:52.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:52 smithi043 ceph-mon[219193]: failed to encode map e70 with expected crc 2023-12-08T20:33:52.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:52 smithi043 ceph-mon[219193]: pgmap v102: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 71/357 objects degraded (19.888%) 2023-12-08T20:33:55.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:54 smithi043 ceph-mon[219193]: pgmap v103: 65 pgs: 13 active+undersized+degraded, 11 active+undersized, 41 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2023-12-08T20:33:55.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:54 smithi111 ceph-mon[182474]: pgmap v103: 65 pgs: 13 active+undersized+degraded, 11 active+undersized, 41 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2023-12-08T20:33:56.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:55 smithi043 ceph-mon[219193]: Health check update: Degraded data redundancy: 55/357 objects degraded (15.406%), 13 pgs degraded (PG_DEGRADED) 2023-12-08T20:33:56.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:55 smithi111 ceph-mon[182474]: Health check update: Degraded data redundancy: 55/357 objects degraded (15.406%), 13 pgs degraded (PG_DEGRADED) 2023-12-08T20:33:57.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:56 smithi043 ceph-mon[219193]: pgmap v104: 65 pgs: 65 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:57.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:56 smithi043 ceph-mon[219193]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/357 objects degraded (15.406%), 13 pgs degraded) 2023-12-08T20:33:57.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:56 smithi043 ceph-mon[219193]: Cluster is now healthy 2023-12-08T20:33:57.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:56 smithi111 ceph-mon[182474]: pgmap v104: 65 pgs: 65 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:57.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:56 smithi111 ceph-mon[182474]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/357 objects degraded (15.406%), 13 pgs degraded) 2023-12-08T20:33:57.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:56 smithi111 ceph-mon[182474]: Cluster is now healthy 2023-12-08T20:33:59.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:58 smithi043 ceph-mon[219193]: pgmap v105: 65 pgs: 65 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:59.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:58 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:59.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:33:58 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:33:59.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:58 smithi111 ceph-mon[182474]: pgmap v105: 65 pgs: 65 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:33:59.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:58 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:33:59.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:33:58 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:34:01.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:00 smithi043 ceph-mon[219193]: pgmap v106: 65 pgs: 65 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:01.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:00 smithi111 ceph-mon[182474]: pgmap v106: 65 pgs: 65 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:03.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:02 smithi043 ceph-mon[219193]: pgmap v107: 65 pgs: 65 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:03.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:02 smithi111 ceph-mon[182474]: pgmap v107: 65 pgs: 65 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:04.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:03 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-08T20:34:04.255 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:03 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-08T20:34:05.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:05 smithi111 ceph-mon[182474]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-08T20:34:05.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:05 smithi111 ceph-mon[182474]: Upgrade: osd.4 is safe to restart 2023-12-08T20:34:05.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:05 smithi111 ceph-mon[182474]: pgmap v108: 65 pgs: 65 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:05.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:05 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:05.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:05 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:05.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:05 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-08T20:34:05.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:05 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:34:05.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:05 smithi043 ceph-mon[219193]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-08T20:34:05.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:05 smithi043 ceph-mon[219193]: Upgrade: osd.4 is safe to restart 2023-12-08T20:34:05.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:05 smithi043 ceph-mon[219193]: pgmap v108: 65 pgs: 65 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:05.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:05 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:05.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:05 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:05.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:05 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-08T20:34:05.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:05 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:34:06.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:06 smithi111 ceph-mon[182474]: Upgrade: Updating osd.4 2023-12-08T20:34:06.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:06 smithi111 ceph-mon[182474]: Deploying daemon osd.4 on smithi111 2023-12-08T20:34:06.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:06 smithi043 ceph-mon[219193]: Upgrade: Updating osd.4 2023-12-08T20:34:06.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:06 smithi043 ceph-mon[219193]: Deploying daemon osd.4 on smithi111 2023-12-08T20:34:06.787 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:06 smithi111 systemd[1]: Stopping Ceph osd.4 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:34:07.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:07 smithi111 ceph-mon[182474]: pgmap v109: 65 pgs: 65 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:07.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:07 smithi111 ceph-mon[182474]: osd.4 marked itself down and dead 2023-12-08T20:34:07.220 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:06 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4[135430]: 2023-12-08T20:34:06.784+0000 7feabde96700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-08T20:34:07.220 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:06 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4[135430]: 2023-12-08T20:34:06.784+0000 7feabde96700 -1 osd.4 70 *** Got signal Terminated *** 2023-12-08T20:34:07.220 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:06 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4[135430]: 2023-12-08T20:34:06.784+0000 7feabde96700 -1 osd.4 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-08T20:34:07.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:07 smithi043 ceph-mon[219193]: pgmap v109: 65 pgs: 65 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:07.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:07 smithi043 ceph-mon[219193]: osd.4 marked itself down and dead 2023-12-08T20:34:08.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:08 smithi043 ceph-mon[219193]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-08T20:34:08.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:08 smithi043 ceph-mon[219193]: failed to encode map e71 with expected crc 2023-12-08T20:34:08.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:08 smithi043 ceph-mon[219193]: osdmap e71: 6 total, 5 up, 6 in 2023-12-08T20:34:08.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:08 smithi043 ceph-mon[219193]: failed to encode map e71 with expected crc 2023-12-08T20:34:08.467 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:08 smithi111 bash[200251]: ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4 2023-12-08T20:34:08.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:08 smithi111 ceph-mon[182474]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-08T20:34:08.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:08 smithi111 ceph-mon[182474]: failed to encode map e71 with expected crc 2023-12-08T20:34:08.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:08 smithi111 ceph-mon[182474]: osdmap e71: 6 total, 5 up, 6 in 2023-12-08T20:34:08.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:08 smithi111 ceph-mon[182474]: failed to encode map e71 with expected crc 2023-12-08T20:34:09.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:09 smithi111 ceph-mon[182474]: pgmap v111: 65 pgs: 6 stale+active+clean, 59 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:09.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:09 smithi111 ceph-mon[182474]: osdmap e72: 6 total, 5 up, 6 in 2023-12-08T20:34:09.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:09 smithi111 ceph-mon[182474]: failed to encode map e72 with expected crc 2023-12-08T20:34:09.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:09 smithi111 ceph-mon[182474]: failed to encode map e72 with expected crc 2023-12-08T20:34:09.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:09 smithi111 ceph-mon[182474]: failed to encode map e72 with expected crc 2023-12-08T20:34:09.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:09 smithi043 ceph-mon[219193]: pgmap v111: 65 pgs: 6 stale+active+clean, 59 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:09.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:09 smithi043 ceph-mon[219193]: osdmap e72: 6 total, 5 up, 6 in 2023-12-08T20:34:09.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:09 smithi043 ceph-mon[219193]: failed to encode map e72 with expected crc 2023-12-08T20:34:09.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:09 smithi043 ceph-mon[219193]: failed to encode map e72 with expected crc 2023-12-08T20:34:09.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:09 smithi043 ceph-mon[219193]: failed to encode map e72 with expected crc 2023-12-08T20:34:09.602 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:09 smithi111 systemd[1]: ceph-28476818-9607-11ee-95a3-87774f69a715@osd.4.service: Succeeded. 2023-12-08T20:34:09.603 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:09 smithi111 systemd[1]: Stopped Ceph osd.4 for 28476818-9607-11ee-95a3-87774f69a715. 2023-12-08T20:34:09.603 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:09 smithi111 systemd[1]: Starting Ceph osd.4 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:34:10.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:10 smithi111 ceph-mon[182474]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-08T20:34:10.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:10 smithi111 ceph-mon[182474]: Health check failed: Degraded data redundancy: 33/357 objects degraded (9.244%), 8 pgs degraded (PG_DEGRADED) 2023-12-08T20:34:10.468 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:10 smithi111 bash[200517]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-08T20:34:10.468 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:10 smithi111 bash[200517]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-08T20:34:10.468 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:10 smithi111 bash[200517]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-08T20:34:10.468 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:10 smithi111 bash[200517]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-08T20:34:10.468 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:10 smithi111 bash[200517]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2023-12-08T20:34:10.469 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:10 smithi111 bash[200517]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-08T20:34:10.469 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:10 smithi111 bash[200517]: --> ceph-volume raw activate successful for osd ID: 4 2023-12-08T20:34:10.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:10 smithi043 ceph-mon[219193]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-08T20:34:10.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:10 smithi043 ceph-mon[219193]: Health check failed: Degraded data redundancy: 33/357 objects degraded (9.244%), 8 pgs degraded (PG_DEGRADED) 2023-12-08T20:34:11.062 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:10 smithi111 ceph-osd[200806]: -- 172.21.15.111:0/1569455466 <== mon.1 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55be6cd771e0 con 0x55be6cd46c00 2023-12-08T20:34:11.062 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:10 smithi111 bash[200769]: b9e4953b16d685e3cb36502b294fe142537c5ab22ca26d755677f61859bb3405 2023-12-08T20:34:11.062 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:10 smithi111 systemd[1]: Started Ceph osd.4 for 28476818-9607-11ee-95a3-87774f69a715. 2023-12-08T20:34:11.062 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:11 smithi111 ceph-mon[182474]: pgmap v113: 65 pgs: 8 active+undersized+degraded, 8 peering, 2 stale+active+clean, 10 active+undersized, 37 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 33/357 objects degraded (9.244%) 2023-12-08T20:34:11.062 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:11 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:11.062 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:11 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:11.062 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:11 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:34:11.467 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:11 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4[200783]: 2023-12-08T20:34:11.254+0000 7fbf1fdc6640 -1 Falling back to public interface 2023-12-08T20:34:11.517 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:11 smithi043 ceph-mon[219193]: pgmap v113: 65 pgs: 8 active+undersized+degraded, 8 peering, 2 stale+active+clean, 10 active+undersized, 37 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 33/357 objects degraded (9.244%) 2023-12-08T20:34:11.517 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:11 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:11.518 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:11 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:11.518 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:11 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:34:13.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:13 smithi111 ceph-mon[182474]: pgmap v114: 65 pgs: 12 active+undersized+degraded, 8 peering, 14 active+undersized, 31 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 47/357 objects degraded (13.165%) 2023-12-08T20:34:13.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:13 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:13.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:13 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:13.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:13 smithi043 ceph-mon[219193]: pgmap v114: 65 pgs: 12 active+undersized+degraded, 8 peering, 14 active+undersized, 31 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 47/357 objects degraded (13.165%) 2023-12-08T20:34:13.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:13 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:13.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:13 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:14.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:14 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:14.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:14 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:14.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:14 smithi111 ceph-mon[182474]: pgmap v115: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2023-12-08T20:34:14.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:14 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:14.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:14 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:34:14.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:14.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:14.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:14 smithi043 ceph-mon[219193]: pgmap v115: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2023-12-08T20:34:14.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:14.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:34:15.717 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:15 smithi111 ceph-mon[182474]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-08T20:34:15.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:15 smithi043 ceph-mon[219193]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-08T20:34:16.217 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:15 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4[200783]: 2023-12-08T20:34:15.821+0000 7fbf1fdc6640 -1 osd.4 0 read_superblock omap replica is missing. 2023-12-08T20:34:16.718 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:16 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4[200783]: 2023-12-08T20:34:16.347+0000 7fbf1fdc6640 -1 osd.4 70 log_to_monitors true 2023-12-08T20:34:16.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:16 smithi111 ceph-mon[182474]: Health check update: Degraded data redundancy: 60/357 objects degraded (16.807%), 16 pgs degraded (PG_DEGRADED) 2023-12-08T20:34:16.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:16 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:16.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:16 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:16.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:16 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:34:16.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:16 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:34:16.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:16 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:16.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:16 smithi111 ceph-mon[182474]: pgmap v116: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2023-12-08T20:34:16.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:16 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:34:16.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:16 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:34:16.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:16 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:34:16.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:16 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:34:16.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:16 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-08T20:34:16.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:16 smithi111 ceph-mon[182474]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-08T20:34:16.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:16 smithi111 ceph-mon[182474]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-08T20:34:16.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:16 smithi111 ceph-mon[182474]: from='osd.4 [v2:172.21.15.111:6808/552414651,v1:172.21.15.111:6809/552414651]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-08T20:34:16.719 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:16 smithi111 ceph-mon[182474]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-08T20:34:16.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:16 smithi043 ceph-mon[219193]: Health check update: Degraded data redundancy: 60/357 objects degraded (16.807%), 16 pgs degraded (PG_DEGRADED) 2023-12-08T20:34:16.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:16 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:16.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:16 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:16.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:16 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:34:16.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:16 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:34:16.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:16 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:16.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:16 smithi043 ceph-mon[219193]: pgmap v116: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 301 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2023-12-08T20:34:16.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:16 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:34:16.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:16 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:34:16.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:16 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:34:16.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:16 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:34:16.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:16 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-08T20:34:16.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:16 smithi043 ceph-mon[219193]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-08T20:34:16.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:16 smithi043 ceph-mon[219193]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-08T20:34:16.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:16 smithi043 ceph-mon[219193]: from='osd.4 [v2:172.21.15.111:6808/552414651,v1:172.21.15.111:6809/552414651]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-08T20:34:16.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:16 smithi043 ceph-mon[219193]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-08T20:34:17.217 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:34:16 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4[200783]: 2023-12-08T20:34:16.881+0000 7fbf11237700 -1 osd.4 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:34:18.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:17 smithi111 ceph-mon[182474]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-08T20:34:18.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:17 smithi111 ceph-mon[182474]: failed to encode map e73 with expected crc 2023-12-08T20:34:18.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:17 smithi111 ceph-mon[182474]: osdmap e73: 6 total, 5 up, 6 in 2023-12-08T20:34:18.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:17 smithi111 ceph-mon[182474]: from='osd.4 [v2:172.21.15.111:6808/552414651,v1:172.21.15.111:6809/552414651]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:34:18.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:17 smithi111 ceph-mon[182474]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:34:18.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:17 smithi043 ceph-mon[219193]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-08T20:34:18.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:17 smithi043 ceph-mon[219193]: failed to encode map e73 with expected crc 2023-12-08T20:34:18.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:17 smithi043 ceph-mon[219193]: osdmap e73: 6 total, 5 up, 6 in 2023-12-08T20:34:18.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:17 smithi043 ceph-mon[219193]: from='osd.4 [v2:172.21.15.111:6808/552414651,v1:172.21.15.111:6809/552414651]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:34:18.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:17 smithi043 ceph-mon[219193]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:34:18.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.589+0000 7f87450ae700 1 -- 172.21.15.43:0/749082812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87400fbb40 msgr2=0x7f87400fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:18.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.589+0000 7f87450ae700 1 --2- 172.21.15.43:0/749082812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87400fbb40 0x7f87400fbfb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8734004940 tx=0x7f8734009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:18.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.589+0000 7f87450ae700 1 -- 172.21.15.43:0/749082812 shutdown_connections 2023-12-08T20:34:18.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.589+0000 7f87450ae700 1 --2- 172.21.15.43:0/749082812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87400fbb40 0x7f87400fbfb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:18.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.589+0000 7f87450ae700 1 --2- 172.21.15.43:0/749082812 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8740101b00 0x7f8740101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:18.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.589+0000 7f87450ae700 1 -- 172.21.15.43:0/749082812 >> 172.21.15.43:0/749082812 conn(0x7f87400719b0 msgr2=0x7f8740071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:18.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.589+0000 7f87450ae700 1 -- 172.21.15.43:0/749082812 shutdown_connections 2023-12-08T20:34:18.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.589+0000 7f87450ae700 1 -- 172.21.15.43:0/749082812 wait complete. 2023-12-08T20:34:18.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.590+0000 7f87450ae700 1 Processor -- start 2023-12-08T20:34:18.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.590+0000 7f87450ae700 1 -- start start 2023-12-08T20:34:18.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.590+0000 7f87450ae700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87400fbb40 0x7f874010e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:18.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.590+0000 7f87450ae700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8740101b00 0x7f874010ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:18.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.590+0000 7f87450ae700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874010f200 con 0x7f87400fbb40 2023-12-08T20:34:18.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.590+0000 7f87450ae700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874010f370 con 0x7f8740101b00 2023-12-08T20:34:18.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.591+0000 7f873ed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87400fbb40 0x7f874010e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:18.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.591+0000 7f873ed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87400fbb40 0x7f874010e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37280/0 (socket says 172.21.15.43:37280) 2023-12-08T20:34:18.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.591+0000 7f873ed9d700 1 -- 172.21.15.43:0/526574883 learned_addr learned my addr 172.21.15.43:0/526574883 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:34:18.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.591+0000 7f873e59c700 1 --2- 172.21.15.43:0/526574883 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8740101b00 0x7f874010ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:18.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.591+0000 7f873ed9d700 1 -- 172.21.15.43:0/526574883 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8740101b00 msgr2=0x7f874010ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:18.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.591+0000 7f873ed9d700 1 --2- 172.21.15.43:0/526574883 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8740101b00 0x7f874010ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:18.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.591+0000 7f873ed9d700 1 -- 172.21.15.43:0/526574883 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8734005040 con 0x7f87400fbb40 2023-12-08T20:34:18.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.591+0000 7f873e59c700 1 --2- 172.21.15.43:0/526574883 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8740101b00 0x7f874010ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T20:34:18.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.591+0000 7f873ed9d700 1 --2- 172.21.15.43:0/526574883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87400fbb40 0x7f874010e670 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f873000eb70 tx=0x7f873000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:18.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.591+0000 7f87277fe700 1 -- 172.21.15.43:0/526574883 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8730007cc0 con 0x7f87400fbb40 2023-12-08T20:34:18.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.591+0000 7f87277fe700 1 -- 172.21.15.43:0/526574883 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f873000f040 con 0x7f87400fbb40 2023-12-08T20:34:18.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.591+0000 7f87450ae700 1 -- 172.21.15.43:0/526574883 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87401175e0 con 0x7f87400fbb40 2023-12-08T20:34:18.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.591+0000 7f87277fe700 1 -- 172.21.15.43:0/526574883 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8730009580 con 0x7f87400fbb40 2023-12-08T20:34:18.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.591+0000 7f87450ae700 1 -- 172.21.15.43:0/526574883 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8740117b20 con 0x7f87400fbb40 2023-12-08T20:34:18.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.592+0000 7f87450ae700 1 -- 172.21.15.43:0/526574883 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87400734d0 con 0x7f87400fbb40 2023-12-08T20:34:18.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.593+0000 7f87277fe700 1 -- 172.21.15.43:0/526574883 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f87300097f0 con 0x7f87400fbb40 2023-12-08T20:34:18.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.593+0000 7f87277fe700 1 --2- 172.21.15.43:0/526574883 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f872806ce60 0x7f872806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:18.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.594+0000 7f87277fe700 1 -- 172.21.15.43:0/526574883 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f873008bf80 con 0x7f87400fbb40 2023-12-08T20:34:18.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.594+0000 7f873e59c700 1 --2- 172.21.15.43:0/526574883 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f872806ce60 0x7f872806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:18.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.594+0000 7f873e59c700 1 --2- 172.21.15.43:0/526574883 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f872806ce60 0x7f872806f310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8734000c00 tx=0x7f8734009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:18.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.599+0000 7f87277fe700 1 -- 172.21.15.43:0/526574883 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8730055f60 con 0x7f87400fbb40 2023-12-08T20:34:18.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.829+0000 7f87450ae700 1 -- 172.21.15.43:0/526574883 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8740065ca0 con 0x7f872806ce60 2023-12-08T20:34:18.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.830+0000 7f87277fe700 1 -- 172.21.15.43:0/526574883 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f8740065ca0 con 0x7f872806ce60 2023-12-08T20:34:18.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.832+0000 7f87450ae700 1 -- 172.21.15.43:0/526574883 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f872806ce60 msgr2=0x7f872806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:18.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.832+0000 7f87450ae700 1 --2- 172.21.15.43:0/526574883 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f872806ce60 0x7f872806f310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8734000c00 tx=0x7f8734009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:18.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.832+0000 7f87450ae700 1 -- 172.21.15.43:0/526574883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87400fbb40 msgr2=0x7f874010e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:18.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.832+0000 7f87450ae700 1 --2- 172.21.15.43:0/526574883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87400fbb40 0x7f874010e670 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f873000eb70 tx=0x7f873000b040 comp rx=0 tx=0).stop 2023-12-08T20:34:18.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.832+0000 7f87450ae700 1 -- 172.21.15.43:0/526574883 shutdown_connections 2023-12-08T20:34:18.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.832+0000 7f87450ae700 1 --2- 172.21.15.43:0/526574883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87400fbb40 0x7f874010e670 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:18.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.832+0000 7f87450ae700 1 --2- 172.21.15.43:0/526574883 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f872806ce60 0x7f872806f310 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:18.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.832+0000 7f87450ae700 1 --2- 172.21.15.43:0/526574883 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8740101b00 0x7f874010ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:18.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.832+0000 7f87450ae700 1 -- 172.21.15.43:0/526574883 >> 172.21.15.43:0/526574883 conn(0x7f87400719b0 msgr2=0x7f87400faa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:18.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.832+0000 7f87450ae700 1 -- 172.21.15.43:0/526574883 shutdown_connections 2023-12-08T20:34:18.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.832+0000 7f87450ae700 1 -- 172.21.15.43:0/526574883 wait complete. 2023-12-08T20:34:18.847 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:34:18.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.974+0000 7fc1fb7e5700 1 -- 172.21.15.43:0/271053866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f4101320 msgr2=0x7fc1f41016f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:18.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.974+0000 7fc1fb7e5700 1 --2- 172.21.15.43:0/271053866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f4101320 0x7fc1f41016f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0004940 tx=0x7fc1f0009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:18.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.974+0000 7fc1fb7e5700 1 -- 172.21.15.43:0/271053866 shutdown_connections 2023-12-08T20:34:18.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.974+0000 7fc1fb7e5700 1 --2- 172.21.15.43:0/271053866 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1f40fb650 0x7fc1f40fbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:18.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.974+0000 7fc1fb7e5700 1 --2- 172.21.15.43:0/271053866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f4101320 0x7fc1f41016f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:18.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.974+0000 7fc1fb7e5700 1 -- 172.21.15.43:0/271053866 >> 172.21.15.43:0/271053866 conn(0x7fc1f4071cf0 msgr2=0x7fc1f40720f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:18.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.975+0000 7fc1fb7e5700 1 -- 172.21.15.43:0/271053866 shutdown_connections 2023-12-08T20:34:18.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.975+0000 7fc1fb7e5700 1 -- 172.21.15.43:0/271053866 wait complete. 2023-12-08T20:34:18.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.975+0000 7fc1fb7e5700 1 Processor -- start 2023-12-08T20:34:18.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.975+0000 7fc1fb7e5700 1 -- start start 2023-12-08T20:34:18.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.975+0000 7fc1fb7e5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f40fb650 0x7fc1f40fceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:18.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.975+0000 7fc1fb7e5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1f4101320 0x7fc1f40fd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:18.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.975+0000 7fc1fb7e5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40fd9f0 con 0x7fc1f40fb650 2023-12-08T20:34:18.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.975+0000 7fc1fb7e5700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40fdb60 con 0x7fc1f4101320 2023-12-08T20:34:18.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.976+0000 7fc1f9581700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f40fb650 0x7fc1f40fceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:18.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.976+0000 7fc1f9581700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f40fb650 0x7fc1f40fceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37298/0 (socket says 172.21.15.43:37298) 2023-12-08T20:34:18.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.976+0000 7fc1f9581700 1 -- 172.21.15.43:0/370794954 learned_addr learned my addr 172.21.15.43:0/370794954 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:34:18.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.976+0000 7fc1f8d80700 1 --2- 172.21.15.43:0/370794954 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1f4101320 0x7fc1f40fd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:18.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.976+0000 7fc1f9581700 1 -- 172.21.15.43:0/370794954 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1f4101320 msgr2=0x7fc1f40fd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:18.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.976+0000 7fc1f9581700 1 --2- 172.21.15.43:0/370794954 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1f4101320 0x7fc1f40fd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:18.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.976+0000 7fc1f9581700 1 -- 172.21.15.43:0/370794954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f0005040 con 0x7fc1f40fb650 2023-12-08T20:34:18.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.976+0000 7fc1f9581700 1 --2- 172.21.15.43:0/370794954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f40fb650 0x7fc1f40fceb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc1f000b3b0 tx=0x7fc1f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:18.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.976+0000 7fc1e9ffb700 1 -- 172.21.15.43:0/370794954 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1f000e040 con 0x7fc1f40fb650 2023-12-08T20:34:18.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.976+0000 7fc1e9ffb700 1 -- 172.21.15.43:0/370794954 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc1f001c430 con 0x7fc1f40fb650 2023-12-08T20:34:18.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.976+0000 7fc1fb7e5700 1 -- 172.21.15.43:0/370794954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f41198b0 con 0x7fc1f40fb650 2023-12-08T20:34:18.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.976+0000 7fc1e9ffb700 1 -- 172.21.15.43:0/370794954 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1f0013640 con 0x7fc1f40fb650 2023-12-08T20:34:18.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.977+0000 7fc1fb7e5700 1 -- 172.21.15.43:0/370794954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f4119d10 con 0x7fc1f40fb650 2023-12-08T20:34:18.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.978+0000 7fc1fb7e5700 1 -- 172.21.15.43:0/370794954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f4105770 con 0x7fc1f40fb650 2023-12-08T20:34:18.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.978+0000 7fc1e9ffb700 1 -- 172.21.15.43:0/370794954 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fc1f001c5a0 con 0x7fc1f40fb650 2023-12-08T20:34:18.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.979+0000 7fc1e9ffb700 1 --2- 172.21.15.43:0/370794954 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fc1e006ce60 0x7fc1e006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:18.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.979+0000 7fc1e9ffb700 1 -- 172.21.15.43:0/370794954 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc1f008cca0 con 0x7fc1f40fb650 2023-12-08T20:34:18.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.979+0000 7fc1f8d80700 1 --2- 172.21.15.43:0/370794954 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fc1e006ce60 0x7fc1e006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:18.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.979+0000 7fc1f8d80700 1 --2- 172.21.15.43:0/370794954 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fc1e006ce60 0x7fc1e006f310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40fe8b0 tx=0x7fc1e4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:18.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:18.984+0000 7fc1e9ffb700 1 -- 172.21.15.43:0/370794954 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc1f0091070 con 0x7fc1f40fb650 2023-12-08T20:34:19.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.211+0000 7fc1fb7e5700 1 -- 172.21.15.43:0/370794954 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1f40fe5f0 con 0x7fc1e006ce60 2023-12-08T20:34:19.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.212+0000 7fc1e9ffb700 1 -- 172.21.15.43:0/370794954 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fc1f40fe5f0 con 0x7fc1e006ce60 2023-12-08T20:34:19.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:18 smithi111 ceph-mon[182474]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-08T20:34:19.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:18 smithi111 ceph-mon[182474]: failed to encode map e74 with expected crc 2023-12-08T20:34:19.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:18 smithi111 ceph-mon[182474]: osd.4 [v2:172.21.15.111:6808/552414651,v1:172.21.15.111:6809/552414651] boot 2023-12-08T20:34:19.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:18 smithi111 ceph-mon[182474]: osdmap e74: 6 total, 6 up, 6 in 2023-12-08T20:34:19.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:18 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:34:19.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:18 smithi111 ceph-mon[182474]: failed to encode map e74 with expected crc 2023-12-08T20:34:19.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:18 smithi111 ceph-mon[182474]: pgmap v119: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2023-12-08T20:34:19.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:18 smithi111 ceph-mon[182474]: osdmap e75: 6 total, 6 up, 6 in 2023-12-08T20:34:19.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.215+0000 7fc1fb7e5700 1 -- 172.21.15.43:0/370794954 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fc1e006ce60 msgr2=0x7fc1e006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:19.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.215+0000 7fc1fb7e5700 1 --2- 172.21.15.43:0/370794954 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fc1e006ce60 0x7fc1e006f310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40fe8b0 tx=0x7fc1e4009040 comp rx=0 tx=0).stop 2023-12-08T20:34:19.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.215+0000 7fc1fb7e5700 1 -- 172.21.15.43:0/370794954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f40fb650 msgr2=0x7fc1f40fceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:19.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.215+0000 7fc1fb7e5700 1 --2- 172.21.15.43:0/370794954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f40fb650 0x7fc1f40fceb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc1f000b3b0 tx=0x7fc1f0009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:19.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.215+0000 7fc1fb7e5700 1 -- 172.21.15.43:0/370794954 shutdown_connections 2023-12-08T20:34:19.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.215+0000 7fc1fb7e5700 1 --2- 172.21.15.43:0/370794954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f40fb650 0x7fc1f40fceb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:19.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.215+0000 7fc1fb7e5700 1 --2- 172.21.15.43:0/370794954 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fc1e006ce60 0x7fc1e006f310 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:19.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.215+0000 7fc1fb7e5700 1 --2- 172.21.15.43:0/370794954 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1f4101320 0x7fc1f40fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:19.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.215+0000 7fc1fb7e5700 1 -- 172.21.15.43:0/370794954 >> 172.21.15.43:0/370794954 conn(0x7fc1f4071cf0 msgr2=0x7fc1f4100630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:19.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.215+0000 7fc1fb7e5700 1 -- 172.21.15.43:0/370794954 shutdown_connections 2023-12-08T20:34:19.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.215+0000 7fc1fb7e5700 1 -- 172.21.15.43:0/370794954 wait complete. 2023-12-08T20:34:19.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:18 smithi043 ceph-mon[219193]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-08T20:34:19.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:18 smithi043 ceph-mon[219193]: failed to encode map e74 with expected crc 2023-12-08T20:34:19.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:18 smithi043 ceph-mon[219193]: osd.4 [v2:172.21.15.111:6808/552414651,v1:172.21.15.111:6809/552414651] boot 2023-12-08T20:34:19.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:18 smithi043 ceph-mon[219193]: osdmap e74: 6 total, 6 up, 6 in 2023-12-08T20:34:19.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:18 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-08T20:34:19.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:18 smithi043 ceph-mon[219193]: failed to encode map e74 with expected crc 2023-12-08T20:34:19.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:18 smithi043 ceph-mon[219193]: pgmap v119: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2023-12-08T20:34:19.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:18 smithi043 ceph-mon[219193]: osdmap e75: 6 total, 6 up, 6 in 2023-12-08T20:34:19.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.327+0000 7f74a4976700 1 -- 172.21.15.43:0/2553177963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74a0104e00 msgr2=0x7f74a01051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:19.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.327+0000 7f74a4976700 1 --2- 172.21.15.43:0/2553177963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74a0104e00 0x7f74a01051d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7488004940 tx=0x7f7488009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:19.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.327+0000 7f74a4976700 1 -- 172.21.15.43:0/2553177963 shutdown_connections 2023-12-08T20:34:19.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.327+0000 7f74a4976700 1 --2- 172.21.15.43:0/2553177963 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74a01057a0 0x7f74a00fee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:19.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.327+0000 7f74a4976700 1 --2- 172.21.15.43:0/2553177963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74a0104e00 0x7f74a01051d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:19.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.327+0000 7f74a4976700 1 -- 172.21.15.43:0/2553177963 >> 172.21.15.43:0/2553177963 conn(0x7f74a00fa990 msgr2=0x7f74a00fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:19.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.327+0000 7f74a4976700 1 -- 172.21.15.43:0/2553177963 shutdown_connections 2023-12-08T20:34:19.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.327+0000 7f74a4976700 1 -- 172.21.15.43:0/2553177963 wait complete. 2023-12-08T20:34:19.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.328+0000 7f74a4976700 1 Processor -- start 2023-12-08T20:34:19.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.328+0000 7f74a4976700 1 -- start start 2023-12-08T20:34:19.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.328+0000 7f74a4976700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74a0104e00 0x7f74a0115850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:19.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.328+0000 7f74a4976700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74a01057a0 0x7f74a0115d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:19.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.328+0000 7f74a4976700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a01163e0 con 0x7f74a0104e00 2023-12-08T20:34:19.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.328+0000 7f74a4976700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a010f710 con 0x7f74a01057a0 2023-12-08T20:34:19.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.328+0000 7f749e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74a0104e00 0x7f74a0115850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:19.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.328+0000 7f749e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74a0104e00 0x7f74a0115850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37326/0 (socket says 172.21.15.43:37326) 2023-12-08T20:34:19.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.328+0000 7f749e59c700 1 -- 172.21.15.43:0/514899880 learned_addr learned my addr 172.21.15.43:0/514899880 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:34:19.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.328+0000 7f749dd9b700 1 --2- 172.21.15.43:0/514899880 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74a01057a0 0x7f74a0115d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:19.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.328+0000 7f749e59c700 1 -- 172.21.15.43:0/514899880 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74a01057a0 msgr2=0x7f74a0115d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:19.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.328+0000 7f749e59c700 1 --2- 172.21.15.43:0/514899880 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74a01057a0 0x7f74a0115d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:19.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.328+0000 7f749e59c700 1 -- 172.21.15.43:0/514899880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7488005040 con 0x7f74a0104e00 2023-12-08T20:34:19.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.329+0000 7f749e59c700 1 --2- 172.21.15.43:0/514899880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74a0104e00 0x7f74a0115850 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f748800b3b0 tx=0x7f7488009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:19.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.329+0000 7f7496ffd700 1 -- 172.21.15.43:0/514899880 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f748800e040 con 0x7f74a0104e00 2023-12-08T20:34:19.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.329+0000 7f7496ffd700 1 -- 172.21.15.43:0/514899880 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f748800bc50 con 0x7f74a0104e00 2023-12-08T20:34:19.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.329+0000 7f74a4976700 1 -- 172.21.15.43:0/514899880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a010f990 con 0x7f74a0104e00 2023-12-08T20:34:19.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.329+0000 7f7496ffd700 1 -- 172.21.15.43:0/514899880 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7488013420 con 0x7f74a0104e00 2023-12-08T20:34:19.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.329+0000 7f74a4976700 1 -- 172.21.15.43:0/514899880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a010fed0 con 0x7f74a0104e00 2023-12-08T20:34:19.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.330+0000 7f74a4976700 1 -- 172.21.15.43:0/514899880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a0102110 con 0x7f74a0104e00 2023-12-08T20:34:19.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.331+0000 7f7496ffd700 1 -- 172.21.15.43:0/514899880 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f748801c430 con 0x7f74a0104e00 2023-12-08T20:34:19.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.331+0000 7f7496ffd700 1 --2- 172.21.15.43:0/514899880 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f748c06ce60 0x7f748c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:19.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.331+0000 7f7496ffd700 1 -- 172.21.15.43:0/514899880 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f748808cf60 con 0x7f74a0104e00 2023-12-08T20:34:19.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.331+0000 7f749dd9b700 1 --2- 172.21.15.43:0/514899880 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f748c06ce60 0x7f748c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:19.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.332+0000 7f749dd9b700 1 --2- 172.21.15.43:0/514899880 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f748c06ce60 0x7f748c06f310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7490007fd0 tx=0x7f7490009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:19.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.336+0000 7f7496ffd700 1 -- 172.21.15.43:0/514899880 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f74880c02f0 con 0x7f74a0104e00 2023-12-08T20:34:19.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.555+0000 7f74a4976700 1 -- 172.21.15.43:0/514899880 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f74a004bb80 con 0x7f748c06ce60 2023-12-08T20:34:19.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.566+0000 7f7496ffd700 1 -- 172.21.15.43:0/514899880 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f74a004bb80 con 0x7f748c06ce60 2023-12-08T20:34:19.569 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-08T20:34:19.569 INFO:teuthology.orchestra.run.smithi043.stdout:alertmanager.smithi043 smithi043 *:9093,9094 running (4m) 62s ago 12m 26.4M - 0.25.0 c8568f914cd2 d4a6cd00c86b 2023-12-08T20:34:19.570 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi043 smithi043 running (2m) 62s ago 12m 7482k - 19.0.0-44-g9dcc13bb f28f2b94f153 f570eddb8e8a 2023-12-08T20:34:19.570 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi111 smithi111 running (2m) 6s ago 11m 7448k - 19.0.0-44-g9dcc13bb f28f2b94f153 b2013e24b94e 2023-12-08T20:34:19.570 INFO:teuthology.orchestra.run.smithi043.stdout:grafana.smithi043 smithi043 *:3000 running (4m) 62s ago 12m 84.4M - 9.4.7 954c08fa6188 8f55491a980b 2023-12-08T20:34:19.570 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.akrjef smithi043 running (8m) 62s ago 8m 18.9M - 17.2.7-119-ge2143d99 f761b6e42225 1c0cb8d34ef8 2023-12-08T20:34:19.570 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.pjmszb smithi043 running (8m) 62s ago 8m 7154M - 17.2.7-119-ge2143d99 f761b6e42225 d7eee0c78093 2023-12-08T20:34:19.570 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.svpasm smithi111 running (8m) 6s ago 8m 16.8M - 17.2.7-119-ge2143d99 f761b6e42225 657d4d1cf4b2 2023-12-08T20:34:19.570 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.veeegc smithi111 running (8m) 6s ago 8m 3707M - 17.2.7-119-ge2143d99 f761b6e42225 31f794a388ab 2023-12-08T20:34:19.570 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi043.hqcdcm smithi043 *:8443,9283,8765 running (5m) 62s ago 13m 510M - 19.0.0-44-g9dcc13bb f28f2b94f153 14e91c1dac64 2023-12-08T20:34:19.570 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi111.mtcffu smithi111 *:8443,9283,8765 running (5m) 6s ago 11m 451M - 19.0.0-44-g9dcc13bb f28f2b94f153 56f4290c6db5 2023-12-08T20:34:19.570 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi043 smithi043 running (3m) 62s ago 13m 61.7M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 3597e3a60ebc 2023-12-08T20:34:19.570 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi111 smithi111 running (2m) 6s ago 11m 59.3M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 528aa182165f 2023-12-08T20:34:19.570 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi043 smithi043 *:9100 running (5m) 62s ago 12m 17.4M - 1.5.0 0da6a335fe13 0959b44d9972 2023-12-08T20:34:19.571 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi111 smithi111 *:9100 running (5m) 6s ago 11m 18.1M - 1.5.0 0da6a335fe13 10fe4fdb23d0 2023-12-08T20:34:19.571 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (2m) 62s ago 11m 121M 1570M 19.0.0-44-g9dcc13bb f28f2b94f153 298e9b98d7a4 2023-12-08T20:34:19.571 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi043 running (97s) 62s ago 10m 127M 1570M 19.0.0-44-g9dcc13bb f28f2b94f153 1ad10def08c3 2023-12-08T20:34:19.571 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi043 running (66s) 62s ago 10m 14.9M 1570M 19.0.0-44-g9dcc13bb f28f2b94f153 0b56e93b08fc 2023-12-08T20:34:19.571 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi111 running (36s) 6s ago 10m 132M 2592M 19.0.0-44-g9dcc13bb f28f2b94f153 75c0817b18fc 2023-12-08T20:34:19.571 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi111 running (8s) 6s ago 9m 12.5M 2592M 19.0.0-44-g9dcc13bb f28f2b94f153 b9e4953b16d6 2023-12-08T20:34:19.571 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi111 running (9m) 6s ago 9m 894M 2592M 17.2.7-119-ge2143d99 f761b6e42225 59a9ce8c1141 2023-12-08T20:34:19.571 INFO:teuthology.orchestra.run.smithi043.stdout:prometheus.smithi043 smithi043 *:9095 running (4m) 62s ago 12m 64.7M - 2.43.0 a07b618ecd1d d95914ec88d8 2023-12-08T20:34:19.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.569+0000 7f74a4976700 1 -- 172.21.15.43:0/514899880 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f748c06ce60 msgr2=0x7f748c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:19.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.569+0000 7f74a4976700 1 --2- 172.21.15.43:0/514899880 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f748c06ce60 0x7f748c06f310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7490007fd0 tx=0x7f7490009040 comp rx=0 tx=0).stop 2023-12-08T20:34:19.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.569+0000 7f74a4976700 1 -- 172.21.15.43:0/514899880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74a0104e00 msgr2=0x7f74a0115850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:19.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.569+0000 7f74a4976700 1 --2- 172.21.15.43:0/514899880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74a0104e00 0x7f74a0115850 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f748800b3b0 tx=0x7f7488009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:19.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.569+0000 7f74a4976700 1 -- 172.21.15.43:0/514899880 shutdown_connections 2023-12-08T20:34:19.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.569+0000 7f74a4976700 1 --2- 172.21.15.43:0/514899880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74a0104e00 0x7f74a0115850 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:19.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.569+0000 7f74a4976700 1 --2- 172.21.15.43:0/514899880 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f748c06ce60 0x7f748c06f310 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:19.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.569+0000 7f74a4976700 1 --2- 172.21.15.43:0/514899880 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74a01057a0 0x7f74a0115d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:19.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.569+0000 7f74a4976700 1 -- 172.21.15.43:0/514899880 >> 172.21.15.43:0/514899880 conn(0x7f74a00fa990 msgr2=0x7f74a00fc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:19.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.569+0000 7f74a4976700 1 -- 172.21.15.43:0/514899880 shutdown_connections 2023-12-08T20:34:19.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.569+0000 7f74a4976700 1 -- 172.21.15.43:0/514899880 wait complete. 2023-12-08T20:34:19.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.680+0000 7fce2d909700 1 -- 172.21.15.43:0/3826647069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce28103590 msgr2=0x7fce280fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:19.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.680+0000 7fce2d909700 1 --2- 172.21.15.43:0/3826647069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce28103590 0x7fce280fcc00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fce10004940 tx=0x7fce10009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:19.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.680+0000 7fce2d909700 1 -- 172.21.15.43:0/3826647069 shutdown_connections 2023-12-08T20:34:19.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.680+0000 7fce2d909700 1 --2- 172.21.15.43:0/3826647069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce28103590 0x7fce280fcc00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:19.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.680+0000 7fce2d909700 1 --2- 172.21.15.43:0/3826647069 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce28102bf0 0x7fce28102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:19.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.680+0000 7fce2d909700 1 -- 172.21.15.43:0/3826647069 >> 172.21.15.43:0/3826647069 conn(0x7fce280f87a0 msgr2=0x7fce280fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:19.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.680+0000 7fce2d909700 1 -- 172.21.15.43:0/3826647069 shutdown_connections 2023-12-08T20:34:19.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.680+0000 7fce2d909700 1 -- 172.21.15.43:0/3826647069 wait complete. 2023-12-08T20:34:19.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.681+0000 7fce2d909700 1 Processor -- start 2023-12-08T20:34:19.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.681+0000 7fce2d909700 1 -- start start 2023-12-08T20:34:19.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.681+0000 7fce2d909700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce28102bf0 0x7fce281136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:19.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.681+0000 7fce2d909700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce28103590 0x7fce28113be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:19.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.681+0000 7fce2d909700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce28114230 con 0x7fce28102bf0 2023-12-08T20:34:19.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.681+0000 7fce2d909700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2810d580 con 0x7fce28103590 2023-12-08T20:34:19.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.681+0000 7fce26ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce28102bf0 0x7fce281136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:19.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.681+0000 7fce26ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce28102bf0 0x7fce281136a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37342/0 (socket says 172.21.15.43:37342) 2023-12-08T20:34:19.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.681+0000 7fce26ffd700 1 -- 172.21.15.43:0/2500411232 learned_addr learned my addr 172.21.15.43:0/2500411232 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:34:19.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.682+0000 7fce267fc700 1 --2- 172.21.15.43:0/2500411232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce28103590 0x7fce28113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:19.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.682+0000 7fce26ffd700 1 -- 172.21.15.43:0/2500411232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce28103590 msgr2=0x7fce28113be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:19.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.682+0000 7fce26ffd700 1 --2- 172.21.15.43:0/2500411232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce28103590 0x7fce28113be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:19.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.682+0000 7fce26ffd700 1 -- 172.21.15.43:0/2500411232 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce10005040 con 0x7fce28102bf0 2023-12-08T20:34:19.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.682+0000 7fce26ffd700 1 --2- 172.21.15.43:0/2500411232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce28102bf0 0x7fce281136a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fce18002a50 tx=0x7fce180046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:19.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.682+0000 7fce1f7fe700 1 -- 172.21.15.43:0/2500411232 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce18007cc0 con 0x7fce28102bf0 2023-12-08T20:34:19.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.682+0000 7fce1f7fe700 1 -- 172.21.15.43:0/2500411232 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fce1800f040 con 0x7fce28102bf0 2023-12-08T20:34:19.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.682+0000 7fce2d909700 1 -- 172.21.15.43:0/2500411232 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce2810d860 con 0x7fce28102bf0 2023-12-08T20:34:19.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.682+0000 7fce1f7fe700 1 -- 172.21.15.43:0/2500411232 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce18009540 con 0x7fce28102bf0 2023-12-08T20:34:19.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.682+0000 7fce2d909700 1 -- 172.21.15.43:0/2500411232 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce2810dda0 con 0x7fce28102bf0 2023-12-08T20:34:19.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.683+0000 7fce2d909700 1 -- 172.21.15.43:0/2500411232 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce281050c0 con 0x7fce28102bf0 2023-12-08T20:34:19.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.684+0000 7fce1f7fe700 1 -- 172.21.15.43:0/2500411232 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fce180096a0 con 0x7fce28102bf0 2023-12-08T20:34:19.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.684+0000 7fce1f7fe700 1 --2- 172.21.15.43:0/2500411232 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fce1406ce60 0x7fce1406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:19.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.684+0000 7fce1f7fe700 1 -- 172.21.15.43:0/2500411232 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fce1808c0a0 con 0x7fce28102bf0 2023-12-08T20:34:19.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.684+0000 7fce267fc700 1 --2- 172.21.15.43:0/2500411232 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fce1406ce60 0x7fce1406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:19.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.685+0000 7fce267fc700 1 --2- 172.21.15.43:0/2500411232 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fce1406ce60 0x7fce1406f310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce1000b3b0 tx=0x7fce10009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:19.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.689+0000 7fce1f7fe700 1 -- 172.21.15.43:0/2500411232 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fce18059a60 con 0x7fce28102bf0 2023-12-08T20:34:19.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.988+0000 7fce2d909700 1 -- 172.21.15.43:0/2500411232 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fce2804bb80 con 0x7fce28102bf0 2023-12-08T20:34:19.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.988+0000 7fce1f7fe700 1 -- 172.21.15.43:0/2500411232 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7fce180595f0 con 0x7fce28102bf0 2023-12-08T20:34:19.991 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:34:19.991 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": { 2023-12-08T20:34:19.991 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:34:19.991 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:34:19.992 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": { 2023-12-08T20:34:19.992 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:34:19.992 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:34:19.992 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": { 2023-12-08T20:34:19.992 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 1, 2023-12-08T20:34:19.992 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 5 2023-12-08T20:34:19.992 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:34:19.992 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2023-12-08T20:34:19.992 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-08T20:34:19.992 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:34:19.992 INFO:teuthology.orchestra.run.smithi043.stdout: "overall": { 2023-12-08T20:34:19.992 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 5, 2023-12-08T20:34:19.992 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 9 2023-12-08T20:34:19.992 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-12-08T20:34:19.993 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:34:19.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.991+0000 7fce2d909700 1 -- 172.21.15.43:0/2500411232 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fce1406ce60 msgr2=0x7fce1406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:19.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.991+0000 7fce2d909700 1 --2- 172.21.15.43:0/2500411232 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fce1406ce60 0x7fce1406f310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce1000b3b0 tx=0x7fce10009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:19.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.991+0000 7fce2d909700 1 -- 172.21.15.43:0/2500411232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce28102bf0 msgr2=0x7fce281136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:19.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.991+0000 7fce2d909700 1 --2- 172.21.15.43:0/2500411232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce28102bf0 0x7fce281136a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fce18002a50 tx=0x7fce180046b0 comp rx=0 tx=0).stop 2023-12-08T20:34:19.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.991+0000 7fce2d909700 1 -- 172.21.15.43:0/2500411232 shutdown_connections 2023-12-08T20:34:19.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.991+0000 7fce2d909700 1 --2- 172.21.15.43:0/2500411232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce28102bf0 0x7fce281136a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:19.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.991+0000 7fce2d909700 1 --2- 172.21.15.43:0/2500411232 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fce1406ce60 0x7fce1406f310 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:19.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.991+0000 7fce2d909700 1 --2- 172.21.15.43:0/2500411232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce28103590 0x7fce28113be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:19.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.991+0000 7fce2d909700 1 -- 172.21.15.43:0/2500411232 >> 172.21.15.43:0/2500411232 conn(0x7fce280f87a0 msgr2=0x7fce280fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:19.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.991+0000 7fce2d909700 1 -- 172.21.15.43:0/2500411232 shutdown_connections 2023-12-08T20:34:19.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:19.991+0000 7fce2d909700 1 -- 172.21.15.43:0/2500411232 wait complete. 2023-12-08T20:34:20.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.104+0000 7f80070d6700 1 -- 172.21.15.43:0/908619101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8000065390 msgr2=0x7f8000065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:20.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.104+0000 7f80070d6700 1 --2- 172.21.15.43:0/908619101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8000065390 0x7f8000065800 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7fec004940 tx=0x7f7fec009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:20.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.104+0000 7f80070d6700 1 -- 172.21.15.43:0/908619101 shutdown_connections 2023-12-08T20:34:20.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.104+0000 7f80070d6700 1 --2- 172.21.15.43:0/908619101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8000065390 0x7f8000065800 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:20.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.104+0000 7f80070d6700 1 --2- 172.21.15.43:0/908619101 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8000102c20 0x7f8000102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:20.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.104+0000 7f80070d6700 1 -- 172.21.15.43:0/908619101 >> 172.21.15.43:0/908619101 conn(0x7f80000719b0 msgr2=0x7f8000071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:20.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.104+0000 7f80070d6700 1 -- 172.21.15.43:0/908619101 shutdown_connections 2023-12-08T20:34:20.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.104+0000 7f80070d6700 1 -- 172.21.15.43:0/908619101 wait complete. 2023-12-08T20:34:20.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.104+0000 7f80070d6700 1 Processor -- start 2023-12-08T20:34:20.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.104+0000 7f80070d6700 1 -- start start 2023-12-08T20:34:20.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.105+0000 7f80070d6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8000065390 0x7f8000113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:20.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.105+0000 7f80070d6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8000102c20 0x7f8000113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:20.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.105+0000 7f80070d6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8000114200 con 0x7f8000065390 2023-12-08T20:34:20.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.105+0000 7f80070d6700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800010d4f0 con 0x7f8000102c20 2023-12-08T20:34:20.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.105+0000 7f8004e72700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8000065390 0x7f8000113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:20.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.105+0000 7f8004e72700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8000065390 0x7f8000113630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37348/0 (socket says 172.21.15.43:37348) 2023-12-08T20:34:20.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.105+0000 7f8004e72700 1 -- 172.21.15.43:0/493033490 learned_addr learned my addr 172.21.15.43:0/493033490 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:34:20.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.105+0000 7f7ffffff700 1 --2- 172.21.15.43:0/493033490 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8000102c20 0x7f8000113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:20.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.105+0000 7f8004e72700 1 -- 172.21.15.43:0/493033490 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8000102c20 msgr2=0x7f8000113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:20.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.105+0000 7f8004e72700 1 --2- 172.21.15.43:0/493033490 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8000102c20 0x7f8000113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:20.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.105+0000 7f8004e72700 1 -- 172.21.15.43:0/493033490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec005040 con 0x7f8000065390 2023-12-08T20:34:20.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.105+0000 7f7ffffff700 1 --2- 172.21.15.43:0/493033490 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8000102c20 0x7f8000113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:34:20.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.106+0000 7f8004e72700 1 --2- 172.21.15.43:0/493033490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8000065390 0x7f8000113630 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400eb70 tx=0x7f7ff400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:20.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.106+0000 7f7ffd7fa700 1 -- 172.21.15.43:0/493033490 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ff4007cc0 con 0x7f8000065390 2023-12-08T20:34:20.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.106+0000 7f7ffd7fa700 1 -- 172.21.15.43:0/493033490 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7ff400f040 con 0x7f8000065390 2023-12-08T20:34:20.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.106+0000 7f80070d6700 1 -- 172.21.15.43:0/493033490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800010d720 con 0x7f8000065390 2023-12-08T20:34:20.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.106+0000 7f7ffd7fa700 1 -- 172.21.15.43:0/493033490 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ff40095f0 con 0x7f8000065390 2023-12-08T20:34:20.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.106+0000 7f80070d6700 1 -- 172.21.15.43:0/493033490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800010dc60 con 0x7f8000065390 2023-12-08T20:34:20.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.107+0000 7f80070d6700 1 -- 172.21.15.43:0/493033490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80000fff40 con 0x7f8000065390 2023-12-08T20:34:20.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.108+0000 7f7ffd7fa700 1 -- 172.21.15.43:0/493033490 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f7ff4009750 con 0x7f8000065390 2023-12-08T20:34:20.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.108+0000 7f7ffd7fa700 1 --2- 172.21.15.43:0/493033490 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7ff006ce60 0x7f7ff006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:20.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.108+0000 7f7ffd7fa700 1 -- 172.21.15.43:0/493033490 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f7ff408c140 con 0x7f8000065390 2023-12-08T20:34:20.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.108+0000 7f7ffffff700 1 --2- 172.21.15.43:0/493033490 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7ff006ce60 0x7f7ff006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:20.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.109+0000 7f7ffffff700 1 --2- 172.21.15.43:0/493033490 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7ff006ce60 0x7f7ff006f310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00b0d0 tx=0x7f7fec009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:20.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.112+0000 7f7ffd7fa700 1 -- 172.21.15.43:0/493033490 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7ff4059b60 con 0x7f8000065390 2023-12-08T20:34:20.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:19 smithi111 ceph-mon[182474]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:34:20.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:19 smithi111 ceph-mon[182474]: failed to encode map e75 with expected crc 2023-12-08T20:34:20.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:19 smithi111 ceph-mon[182474]: failed to encode map e75 with expected crc 2023-12-08T20:34:20.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:19 smithi111 ceph-mon[182474]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:34:20.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:19 smithi043 ceph-mon[219193]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:34:20.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:19 smithi043 ceph-mon[219193]: failed to encode map e75 with expected crc 2023-12-08T20:34:20.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:19 smithi043 ceph-mon[219193]: failed to encode map e75 with expected crc 2023-12-08T20:34:20.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:19 smithi043 ceph-mon[219193]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:34:20.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.368+0000 7f80070d6700 1 -- 172.21.15.43:0/493033490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f80000734d0 con 0x7f8000065390 2023-12-08T20:34:20.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.368+0000 7f7ffd7fa700 1 -- 172.21.15.43:0/493033490 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1855 (secure 0 0 0) 0x7f7ff40596f0 con 0x7f8000065390 2023-12-08T20:34:20.371 INFO:teuthology.orchestra.run.smithi043.stdout:e17 2023-12-08T20:34:20.371 INFO:teuthology.orchestra.run.smithi043.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-08T20:34:20.371 INFO:teuthology.orchestra.run.smithi043.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:34:20.371 INFO:teuthology.orchestra.run.smithi043.stdout:legacy client fscid: 1 2023-12-08T20:34:20.371 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:34:20.371 INFO:teuthology.orchestra.run.smithi043.stdout:Filesystem 'cephfs' (1) 2023-12-08T20:34:20.372 INFO:teuthology.orchestra.run.smithi043.stdout:fs_name cephfs 2023-12-08T20:34:20.372 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 17 2023-12-08T20:34:20.372 INFO:teuthology.orchestra.run.smithi043.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-08T20:34:20.372 INFO:teuthology.orchestra.run.smithi043.stdout:created 2023-12-08T20:25:41.527734+0000 2023-12-08T20:34:20.372 INFO:teuthology.orchestra.run.smithi043.stdout:modified 2023-12-08T20:32:04.068774+0000 2023-12-08T20:34:20.372 INFO:teuthology.orchestra.run.smithi043.stdout:tableserver 0 2023-12-08T20:34:20.372 INFO:teuthology.orchestra.run.smithi043.stdout:root 0 2023-12-08T20:34:20.372 INFO:teuthology.orchestra.run.smithi043.stdout:session_timeout 60 2023-12-08T20:34:20.372 INFO:teuthology.orchestra.run.smithi043.stdout:session_autoclose 300 2023-12-08T20:34:20.372 INFO:teuthology.orchestra.run.smithi043.stdout:max_file_size 1099511627776 2023-12-08T20:34:20.372 INFO:teuthology.orchestra.run.smithi043.stdout:max_xattr_size 65536 2023-12-08T20:34:20.372 INFO:teuthology.orchestra.run.smithi043.stdout:required_client_features {} 2023-12-08T20:34:20.372 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure 0 2023-12-08T20:34:20.372 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure_osd_epoch 0 2023-12-08T20:34:20.372 INFO:teuthology.orchestra.run.smithi043.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-08T20:34:20.373 INFO:teuthology.orchestra.run.smithi043.stdout:max_mds 2 2023-12-08T20:34:20.373 INFO:teuthology.orchestra.run.smithi043.stdout:in 0,1 2023-12-08T20:34:20.373 INFO:teuthology.orchestra.run.smithi043.stdout:up {0=14452,1=24315} 2023-12-08T20:34:20.373 INFO:teuthology.orchestra.run.smithi043.stdout:failed 2023-12-08T20:34:20.373 INFO:teuthology.orchestra.run.smithi043.stdout:damaged 2023-12-08T20:34:20.373 INFO:teuthology.orchestra.run.smithi043.stdout:stopped 2023-12-08T20:34:20.373 INFO:teuthology.orchestra.run.smithi043.stdout:data_pools [3] 2023-12-08T20:34:20.373 INFO:teuthology.orchestra.run.smithi043.stdout:metadata_pool 2 2023-12-08T20:34:20.373 INFO:teuthology.orchestra.run.smithi043.stdout:inline_data disabled 2023-12-08T20:34:20.373 INFO:teuthology.orchestra.run.smithi043.stdout:balancer 2023-12-08T20:34:20.373 INFO:teuthology.orchestra.run.smithi043.stdout:bal_rank_mask -1 2023-12-08T20:34:20.373 INFO:teuthology.orchestra.run.smithi043.stdout:standby_count_wanted 1 2023-12-08T20:34:20.373 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi043.pjmszb{0:14452} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.43:6826/441584552,v1:172.21.15.43:6827/441584552] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:34:20.373 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi111.veeegc{1:24315} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.111:6824/1990395192,v1:172.21.15.111:6825/1990395192] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:34:20.373 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:34:20.373 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:34:20.374 INFO:teuthology.orchestra.run.smithi043.stdout:Standby daemons: 2023-12-08T20:34:20.374 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:34:20.374 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi043.akrjef{-1:14466} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.43:6828/2926918083,v1:172.21.15.43:6829/2926918083] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:34:20.374 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.cephfs.smithi111.svpasm{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6826/2885759138,v1:172.21.15.111:6827/2885759138] compat {c=[1],r=[1],i=[7ff]}] 2023-12-08T20:34:20.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.370+0000 7f80070d6700 1 -- 172.21.15.43:0/493033490 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7ff006ce60 msgr2=0x7f7ff006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:20.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.370+0000 7f80070d6700 1 --2- 172.21.15.43:0/493033490 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7ff006ce60 0x7f7ff006f310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00b0d0 tx=0x7f7fec009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:20.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.370+0000 7f80070d6700 1 -- 172.21.15.43:0/493033490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8000065390 msgr2=0x7f8000113630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:20.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.370+0000 7f80070d6700 1 --2- 172.21.15.43:0/493033490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8000065390 0x7f8000113630 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400eb70 tx=0x7f7ff400b040 comp rx=0 tx=0).stop 2023-12-08T20:34:20.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.370+0000 7f80070d6700 1 -- 172.21.15.43:0/493033490 shutdown_connections 2023-12-08T20:34:20.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.370+0000 7f80070d6700 1 --2- 172.21.15.43:0/493033490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8000065390 0x7f8000113630 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:20.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.370+0000 7f80070d6700 1 --2- 172.21.15.43:0/493033490 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7ff006ce60 0x7f7ff006f310 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:20.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.370+0000 7f80070d6700 1 --2- 172.21.15.43:0/493033490 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8000102c20 0x7f8000113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:20.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.370+0000 7f80070d6700 1 -- 172.21.15.43:0/493033490 >> 172.21.15.43:0/493033490 conn(0x7f80000719b0 msgr2=0x7f80000fab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:20.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.371+0000 7f80070d6700 1 -- 172.21.15.43:0/493033490 shutdown_connections 2023-12-08T20:34:20.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.371+0000 7f80070d6700 1 -- 172.21.15.43:0/493033490 wait complete. 2023-12-08T20:34:20.375 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 17 2023-12-08T20:34:20.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.484+0000 7f953d0bf700 1 -- 172.21.15.43:0/2306157436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9538101b00 msgr2=0x7f9538101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:20.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.484+0000 7f953d0bf700 1 --2- 172.21.15.43:0/2306157436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9538101b00 0x7f9538101ed0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9528004940 tx=0x7f9528009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:20.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.484+0000 7f953d0bf700 1 -- 172.21.15.43:0/2306157436 shutdown_connections 2023-12-08T20:34:20.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.484+0000 7f953d0bf700 1 --2- 172.21.15.43:0/2306157436 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95380fbb40 0x7f95380fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:20.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.484+0000 7f953d0bf700 1 --2- 172.21.15.43:0/2306157436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9538101b00 0x7f9538101ed0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:20.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.484+0000 7f953d0bf700 1 -- 172.21.15.43:0/2306157436 >> 172.21.15.43:0/2306157436 conn(0x7f95380719b0 msgr2=0x7f9538071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:20.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.484+0000 7f953d0bf700 1 -- 172.21.15.43:0/2306157436 shutdown_connections 2023-12-08T20:34:20.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.484+0000 7f953d0bf700 1 -- 172.21.15.43:0/2306157436 wait complete. 2023-12-08T20:34:20.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.485+0000 7f953d0bf700 1 Processor -- start 2023-12-08T20:34:20.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.485+0000 7f953d0bf700 1 -- start start 2023-12-08T20:34:20.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.485+0000 7f953d0bf700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95380fbb40 0x7f9538113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:20.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.485+0000 7f953d0bf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9538101b00 0x7f9538113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:20.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.485+0000 7f953d0bf700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9538114200 con 0x7f95380fbb40 2023-12-08T20:34:20.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.485+0000 7f953d0bf700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953810d4f0 con 0x7f9538101b00 2023-12-08T20:34:20.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.485+0000 7f9536d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95380fbb40 0x7f9538113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:20.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.485+0000 7f9536d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95380fbb40 0x7f9538113630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57348/0 (socket says 172.21.15.43:57348) 2023-12-08T20:34:20.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.485+0000 7f9536d9d700 1 -- 172.21.15.43:0/785269289 learned_addr learned my addr 172.21.15.43:0/785269289 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:34:20.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.486+0000 7f953659c700 1 --2- 172.21.15.43:0/785269289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9538101b00 0x7f9538113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:20.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.486+0000 7f9536d9d700 1 -- 172.21.15.43:0/785269289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9538101b00 msgr2=0x7f9538113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:20.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.486+0000 7f9536d9d700 1 --2- 172.21.15.43:0/785269289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9538101b00 0x7f9538113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:20.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.486+0000 7f9536d9d700 1 -- 172.21.15.43:0/785269289 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9528005040 con 0x7f95380fbb40 2023-12-08T20:34:20.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.486+0000 7f953659c700 1 --2- 172.21.15.43:0/785269289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9538101b00 0x7f9538113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:34:20.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.486+0000 7f9536d9d700 1 --2- 172.21.15.43:0/785269289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95380fbb40 0x7f9538113630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9528009180 tx=0x7f9528009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:20.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.486+0000 7f952f7fe700 1 -- 172.21.15.43:0/785269289 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f952800e040 con 0x7f95380fbb40 2023-12-08T20:34:20.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.486+0000 7f952f7fe700 1 -- 172.21.15.43:0/785269289 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9528013420 con 0x7f95380fbb40 2023-12-08T20:34:20.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.486+0000 7f953d0bf700 1 -- 172.21.15.43:0/785269289 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f953810d720 con 0x7f95380fbb40 2023-12-08T20:34:20.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.486+0000 7f952f7fe700 1 -- 172.21.15.43:0/785269289 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f952801c630 con 0x7f95380fbb40 2023-12-08T20:34:20.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.486+0000 7f953d0bf700 1 -- 172.21.15.43:0/785269289 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f953810dc60 con 0x7f95380fbb40 2023-12-08T20:34:20.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.487+0000 7f953d0bf700 1 -- 172.21.15.43:0/785269289 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95380734d0 con 0x7f95380fbb40 2023-12-08T20:34:20.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.488+0000 7f952f7fe700 1 -- 172.21.15.43:0/785269289 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f95280139e0 con 0x7f95380fbb40 2023-12-08T20:34:20.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.488+0000 7f952f7fe700 1 --2- 172.21.15.43:0/785269289 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f952406ce60 0x7f952406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:20.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.488+0000 7f952f7fe700 1 -- 172.21.15.43:0/785269289 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f952808d510 con 0x7f95380fbb40 2023-12-08T20:34:20.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.488+0000 7f953659c700 1 --2- 172.21.15.43:0/785269289 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f952406ce60 0x7f952406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:20.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.489+0000 7f953659c700 1 --2- 172.21.15.43:0/785269289 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f952406ce60 0x7f952406f310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9520007fd0 tx=0x7f9520009f60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:20.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.493+0000 7f952f7fe700 1 -- 172.21.15.43:0/785269289 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f952805aff0 con 0x7f95380fbb40 2023-12-08T20:34:20.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.723+0000 7f953d0bf700 1 -- 172.21.15.43:0/785269289 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f953810ed20 con 0x7f952406ce60 2023-12-08T20:34:20.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.724+0000 7f952f7fe700 1 -- 172.21.15.43:0/785269289 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f953810ed20 con 0x7f952406ce60 2023-12-08T20:34:20.727 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:34:20.727 INFO:teuthology.orchestra.run.smithi043.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-08T20:34:20.727 INFO:teuthology.orchestra.run.smithi043.stdout: "in_progress": true, 2023-12-08T20:34:20.727 INFO:teuthology.orchestra.run.smithi043.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-08T20:34:20.727 INFO:teuthology.orchestra.run.smithi043.stdout: "services_complete": [ 2023-12-08T20:34:20.727 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2023-12-08T20:34:20.727 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr", 2023-12-08T20:34:20.728 INFO:teuthology.orchestra.run.smithi043.stdout: "mon" 2023-12-08T20:34:20.728 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2023-12-08T20:34:20.728 INFO:teuthology.orchestra.run.smithi043.stdout: "progress": "11/21 daemons upgraded", 2023-12-08T20:34:20.728 INFO:teuthology.orchestra.run.smithi043.stdout: "message": "Currently upgrading osd daemons", 2023-12-08T20:34:20.728 INFO:teuthology.orchestra.run.smithi043.stdout: "is_paused": false 2023-12-08T20:34:20.728 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:34:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.727+0000 7f953d0bf700 1 -- 172.21.15.43:0/785269289 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f952406ce60 msgr2=0x7f952406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.727+0000 7f953d0bf700 1 --2- 172.21.15.43:0/785269289 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f952406ce60 0x7f952406f310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9520007fd0 tx=0x7f9520009f60 comp rx=0 tx=0).stop 2023-12-08T20:34:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.727+0000 7f953d0bf700 1 -- 172.21.15.43:0/785269289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95380fbb40 msgr2=0x7f9538113630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.727+0000 7f953d0bf700 1 --2- 172.21.15.43:0/785269289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95380fbb40 0x7f9538113630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9528009180 tx=0x7f9528009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.727+0000 7f953d0bf700 1 -- 172.21.15.43:0/785269289 shutdown_connections 2023-12-08T20:34:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.727+0000 7f953d0bf700 1 --2- 172.21.15.43:0/785269289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95380fbb40 0x7f9538113630 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.727+0000 7f953d0bf700 1 --2- 172.21.15.43:0/785269289 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f952406ce60 0x7f952406f310 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.727+0000 7f953d0bf700 1 --2- 172.21.15.43:0/785269289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9538101b00 0x7f9538113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.727+0000 7f953d0bf700 1 -- 172.21.15.43:0/785269289 >> 172.21.15.43:0/785269289 conn(0x7f95380719b0 msgr2=0x7f95380653f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.727+0000 7f953d0bf700 1 -- 172.21.15.43:0/785269289 shutdown_connections 2023-12-08T20:34:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.727+0000 7f953d0bf700 1 -- 172.21.15.43:0/785269289 wait complete. 2023-12-08T20:34:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.840+0000 7f2e66a99700 1 -- 172.21.15.43:0/3034049425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e60102c20 msgr2=0x7f2e60102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.840+0000 7f2e66a99700 1 --2- 172.21.15.43:0/3034049425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e60102c20 0x7f2e60102ff0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2e54004940 tx=0x7f2e54009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.840+0000 7f2e66a99700 1 -- 172.21.15.43:0/3034049425 shutdown_connections 2023-12-08T20:34:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.840+0000 7f2e66a99700 1 --2- 172.21.15.43:0/3034049425 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2e60065390 0x7f2e60065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.840+0000 7f2e66a99700 1 --2- 172.21.15.43:0/3034049425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e60102c20 0x7f2e60102ff0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.840+0000 7f2e66a99700 1 -- 172.21.15.43:0/3034049425 >> 172.21.15.43:0/3034049425 conn(0x7f2e600719b0 msgr2=0x7f2e60071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.840+0000 7f2e66a99700 1 -- 172.21.15.43:0/3034049425 shutdown_connections 2023-12-08T20:34:20.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.840+0000 7f2e66a99700 1 -- 172.21.15.43:0/3034049425 wait complete. 2023-12-08T20:34:20.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.840+0000 7f2e66a99700 1 Processor -- start 2023-12-08T20:34:20.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.841+0000 7f2e66a99700 1 -- start start 2023-12-08T20:34:20.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.841+0000 7f2e66a99700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2e60065390 0x7f2e60113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:20.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.841+0000 7f2e66a99700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e60102c20 0x7f2e60113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:20.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.841+0000 7f2e66a99700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e60114220 con 0x7f2e60102c20 2023-12-08T20:34:20.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.841+0000 7f2e66a99700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6010d570 con 0x7f2e60065390 2023-12-08T20:34:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.841+0000 7f2e5ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e60102c20 0x7f2e60113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.841+0000 7f2e5ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e60102c20 0x7f2e60113bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57364/0 (socket says 172.21.15.43:57364) 2023-12-08T20:34:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.841+0000 7f2e5ffff700 1 -- 172.21.15.43:0/2872736028 learned_addr learned my addr 172.21.15.43:0/2872736028 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:34:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.841+0000 7f2e64835700 1 --2- 172.21.15.43:0/2872736028 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2e60065390 0x7f2e60113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.842+0000 7f2e5ffff700 1 -- 172.21.15.43:0/2872736028 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2e60065390 msgr2=0x7f2e60113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.842+0000 7f2e5ffff700 1 --2- 172.21.15.43:0/2872736028 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2e60065390 0x7f2e60113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.842+0000 7f2e5ffff700 1 -- 172.21.15.43:0/2872736028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e54005040 con 0x7f2e60102c20 2023-12-08T20:34:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.842+0000 7f2e64835700 1 --2- 172.21.15.43:0/2872736028 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2e60065390 0x7f2e60113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:34:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.842+0000 7f2e5ffff700 1 --2- 172.21.15.43:0/2872736028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e60102c20 0x7f2e60113bd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c002a50 tx=0x7f2e4c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.842+0000 7f2e5d7fa700 1 -- 172.21.15.43:0/2872736028 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e4c007cc0 con 0x7f2e60102c20 2023-12-08T20:34:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.842+0000 7f2e5d7fa700 1 -- 172.21.15.43:0/2872736028 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2e4c00f040 con 0x7f2e60102c20 2023-12-08T20:34:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.842+0000 7f2e66a99700 1 -- 172.21.15.43:0/2872736028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6010d850 con 0x7f2e60102c20 2023-12-08T20:34:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.842+0000 7f2e5d7fa700 1 -- 172.21.15.43:0/2872736028 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e4c009540 con 0x7f2e60102c20 2023-12-08T20:34:20.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.842+0000 7f2e66a99700 1 -- 172.21.15.43:0/2872736028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6010dd90 con 0x7f2e60102c20 2023-12-08T20:34:20.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.843+0000 7f2e66a99700 1 -- 172.21.15.43:0/2872736028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e600fff40 con 0x7f2e60102c20 2023-12-08T20:34:20.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.844+0000 7f2e5d7fa700 1 -- 172.21.15.43:0/2872736028 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f2e4c0096a0 con 0x7f2e60102c20 2023-12-08T20:34:20.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.844+0000 7f2e5d7fa700 1 --2- 172.21.15.43:0/2872736028 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f2e5006ce70 0x7f2e5006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:20.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.844+0000 7f2e5d7fa700 1 -- 172.21.15.43:0/2872736028 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f2e4c08c0a0 con 0x7f2e60102c20 2023-12-08T20:34:20.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.844+0000 7f2e64835700 1 --2- 172.21.15.43:0/2872736028 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f2e5006ce70 0x7f2e5006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.845+0000 7f2e64835700 1 --2- 172.21.15.43:0/2872736028 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f2e5006ce70 0x7f2e5006f320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400b3b0 tx=0x7f2e54009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:20.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:20.849+0000 7f2e5d7fa700 1 -- 172.21.15.43:0/2872736028 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2e4c059a60 con 0x7f2e60102c20 2023-12-08T20:34:21.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:21.146+0000 7f2e66a99700 1 -- 172.21.15.43:0/2872736028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2e600734d0 con 0x7f2e60102c20 2023-12-08T20:34:21.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:21.146+0000 7f2e5d7fa700 1 -- 172.21.15.43:0/2872736028 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+516 (secure 0 0 0) 0x7f2e4c0595f0 con 0x7f2e60102c20 2023-12-08T20:34:21.149 INFO:teuthology.orchestra.run.smithi043.stdout:HEALTH_WARN Degraded data redundancy: 18/357 objects degraded (5.042%), 6 pgs degraded 2023-12-08T20:34:21.149 INFO:teuthology.orchestra.run.smithi043.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 18/357 objects degraded (5.042%), 6 pgs degraded 2023-12-08T20:34:21.149 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2023-12-08T20:34:21.149 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.11 is active+undersized+degraded, acting [3,1] 2023-12-08T20:34:21.150 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2023-12-08T20:34:21.150 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2023-12-08T20:34:21.150 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2023-12-08T20:34:21.150 INFO:teuthology.orchestra.run.smithi043.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2023-12-08T20:34:21.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:21.148+0000 7f2e66a99700 1 -- 172.21.15.43:0/2872736028 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f2e5006ce70 msgr2=0x7f2e5006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:21.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:21.148+0000 7f2e66a99700 1 --2- 172.21.15.43:0/2872736028 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f2e5006ce70 0x7f2e5006f320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400b3b0 tx=0x7f2e54009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:21.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:21.148+0000 7f2e66a99700 1 -- 172.21.15.43:0/2872736028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e60102c20 msgr2=0x7f2e60113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:21.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:21.148+0000 7f2e66a99700 1 --2- 172.21.15.43:0/2872736028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e60102c20 0x7f2e60113bd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c002a50 tx=0x7f2e4c0046b0 comp rx=0 tx=0).stop 2023-12-08T20:34:21.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:21.149+0000 7f2e66a99700 1 -- 172.21.15.43:0/2872736028 shutdown_connections 2023-12-08T20:34:21.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:21.149+0000 7f2e66a99700 1 --2- 172.21.15.43:0/2872736028 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f2e5006ce70 0x7f2e5006f320 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:21.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:21.149+0000 7f2e66a99700 1 --2- 172.21.15.43:0/2872736028 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2e60065390 0x7f2e60113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:21.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:21.149+0000 7f2e66a99700 1 --2- 172.21.15.43:0/2872736028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e60102c20 0x7f2e60113bd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:21.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:21.149+0000 7f2e66a99700 1 -- 172.21.15.43:0/2872736028 >> 172.21.15.43:0/2872736028 conn(0x7f2e600719b0 msgr2=0x7f2e600fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:21.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:21.149+0000 7f2e66a99700 1 -- 172.21.15.43:0/2872736028 shutdown_connections 2023-12-08T20:34:21.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:21.149+0000 7f2e66a99700 1 -- 172.21.15.43:0/2872736028 wait complete. 2023-12-08T20:34:21.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:20 smithi111 ceph-mon[182474]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:34:21.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:20 smithi111 ceph-mon[182474]: pgmap v121: 65 pgs: 8 peering, 6 active+undersized+degraded, 6 active+undersized, 45 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18/357 objects degraded (5.042%) 2023-12-08T20:34:21.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:20 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/2500411232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:34:21.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:20 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/493033490' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-08T20:34:21.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:20 smithi043 ceph-mon[219193]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:34:21.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:20 smithi043 ceph-mon[219193]: pgmap v121: 65 pgs: 8 peering, 6 active+undersized+degraded, 6 active+undersized, 45 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18/357 objects degraded (5.042%) 2023-12-08T20:34:21.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:20 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/2500411232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:34:21.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:20 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/493033490' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-08T20:34:22.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:21 smithi111 ceph-mon[182474]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:34:22.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:21 smithi111 ceph-mon[182474]: Health check update: Degraded data redundancy: 18/357 objects degraded (5.042%), 6 pgs degraded (PG_DEGRADED) 2023-12-08T20:34:22.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:21 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/2872736028' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-08T20:34:22.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:21 smithi043 ceph-mon[219193]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:34:22.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:21 smithi043 ceph-mon[219193]: Health check update: Degraded data redundancy: 18/357 objects degraded (5.042%), 6 pgs degraded (PG_DEGRADED) 2023-12-08T20:34:22.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:21 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/2872736028' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-08T20:34:23.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:22 smithi111 ceph-mon[182474]: pgmap v122: 65 pgs: 8 peering, 57 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:23.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:22 smithi043 ceph-mon[219193]: pgmap v122: 65 pgs: 8 peering, 57 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:24.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:23 smithi111 ceph-mon[182474]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/357 objects degraded (5.042%), 6 pgs degraded) 2023-12-08T20:34:24.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:23 smithi111 ceph-mon[182474]: Cluster is now healthy 2023-12-08T20:34:24.255 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:23 smithi043 ceph-mon[219193]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/357 objects degraded (5.042%), 6 pgs degraded) 2023-12-08T20:34:24.255 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:23 smithi043 ceph-mon[219193]: Cluster is now healthy 2023-12-08T20:34:25.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:24 smithi111 ceph-mon[182474]: pgmap v123: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:25.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:24 smithi043 ceph-mon[219193]: pgmap v123: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:26.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:26 smithi111 ceph-mon[182474]: pgmap v124: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:27.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:26 smithi043 ceph-mon[219193]: pgmap v124: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:29.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:28 smithi043 ceph-mon[219193]: pgmap v125: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:29.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:28 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:29.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:28 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:34:29.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:28 smithi111 ceph-mon[182474]: pgmap v125: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:29.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:28 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:29.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:28 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:34:30.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:30 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:30.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:30 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:31.407 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:31 smithi111 ceph-mon[182474]: pgmap v126: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:31.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:31 smithi043 ceph-mon[219193]: pgmap v126: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:32.446 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:32 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-08T20:34:32.446 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:32 smithi111 ceph-mon[182474]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-08T20:34:32.446 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:32 smithi111 ceph-mon[182474]: Upgrade: osd.5 is safe to restart 2023-12-08T20:34:32.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:32 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-08T20:34:32.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:32 smithi043 ceph-mon[219193]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-08T20:34:32.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:32 smithi043 ceph-mon[219193]: Upgrade: osd.5 is safe to restart 2023-12-08T20:34:33.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:33 smithi111 ceph-mon[182474]: pgmap v127: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:33.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:33 smithi111 ceph-mon[182474]: Upgrade: Updating osd.5 2023-12-08T20:34:33.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:33 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:33.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:33 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-08T20:34:33.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:33 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:34:33.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:33 smithi111 ceph-mon[182474]: Deploying daemon osd.5 on smithi111 2023-12-08T20:34:33.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:33 smithi043 ceph-mon[219193]: pgmap v127: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:33.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:33 smithi043 ceph-mon[219193]: Upgrade: Updating osd.5 2023-12-08T20:34:33.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:33 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:33.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:33 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-08T20:34:33.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:33 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:34:33.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:33 smithi043 ceph-mon[219193]: Deploying daemon osd.5 on smithi111 2023-12-08T20:34:34.590 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:34 smithi111 systemd[1]: Stopping Ceph osd.5 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:34:34.967 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:34 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[143399]: 2023-12-08T20:34:34.587+0000 7fb004c64700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-08T20:34:34.968 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:34 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[143399]: 2023-12-08T20:34:34.587+0000 7fb004c64700 -1 osd.5 75 *** Got signal Terminated *** 2023-12-08T20:34:34.968 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:34 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[143399]: 2023-12-08T20:34:34.587+0000 7fb004c64700 -1 osd.5 75 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-08T20:34:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:35 smithi111 ceph-mon[182474]: pgmap v128: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:35.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:35 smithi111 ceph-mon[182474]: osd.5 marked itself down and dead 2023-12-08T20:34:35.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:35 smithi043 ceph-mon[219193]: pgmap v128: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:35.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:35 smithi043 ceph-mon[219193]: osd.5 marked itself down and dead 2023-12-08T20:34:35.967 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:35 smithi111 bash[206964]: ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5 2023-12-08T20:34:36.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:36 smithi111 ceph-mon[182474]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-08T20:34:36.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:36 smithi111 ceph-mon[182474]: osdmap e76: 6 total, 5 up, 6 in 2023-12-08T20:34:36.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:36 smithi043 ceph-mon[219193]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-08T20:34:36.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:36 smithi043 ceph-mon[219193]: osdmap e76: 6 total, 5 up, 6 in 2023-12-08T20:34:37.194 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:36 smithi111 systemd[1]: ceph-28476818-9607-11ee-95a3-87774f69a715@osd.5.service: Succeeded. 2023-12-08T20:34:37.194 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:36 smithi111 systemd[1]: Stopped Ceph osd.5 for 28476818-9607-11ee-95a3-87774f69a715. 2023-12-08T20:34:37.194 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:36 smithi111 systemd[1]: Starting Ceph osd.5 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:34:37.194 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:37 smithi111 ceph-mon[182474]: pgmap v130: 65 pgs: 13 stale+active+clean, 52 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:37.194 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:37 smithi111 ceph-mon[182474]: osdmap e77: 6 total, 5 up, 6 in 2023-12-08T20:34:37.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:37 smithi043 ceph-mon[219193]: pgmap v130: 65 pgs: 13 stale+active+clean, 52 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:37.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:37 smithi043 ceph-mon[219193]: osdmap e77: 6 total, 5 up, 6 in 2023-12-08T20:34:37.967 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:37 smithi111 bash[207231]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-08T20:34:37.967 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:37 smithi111 bash[207231]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-08T20:34:37.968 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:37 smithi111 bash[207231]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-08T20:34:37.968 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:37 smithi111 bash[207231]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-08T20:34:37.968 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:37 smithi111 bash[207231]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2023-12-08T20:34:37.968 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:37 smithi111 bash[207231]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-08T20:34:37.968 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:37 smithi111 bash[207231]: --> ceph-volume raw activate successful for osd ID: 5 2023-12-08T20:34:38.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:38 smithi111 ceph-mon[182474]: Health check failed: Degraded data redundancy: 8/357 objects degraded (2.241%), 3 pgs degraded (PG_DEGRADED) 2023-12-08T20:34:38.467 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:38 smithi111 ceph-osd[207548]: -- 172.21.15.111:0/2186370773 <== mon.1 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559c87f5f1e0 con 0x559c87f2f000 2023-12-08T20:34:38.468 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:38 smithi111 bash[207510]: 156555b2e09c7a5ed56dfac65f0ddd969a5fa42f01c69a716cc5e1d744ce5806 2023-12-08T20:34:38.468 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:38 smithi111 systemd[1]: Started Ceph osd.5 for 28476818-9607-11ee-95a3-87774f69a715. 2023-12-08T20:34:38.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:38 smithi043 ceph-mon[219193]: Health check failed: Degraded data redundancy: 8/357 objects degraded (2.241%), 3 pgs degraded (PG_DEGRADED) 2023-12-08T20:34:39.154 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:38 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:34:38.855+0000 7ff2aaf6a640 -1 Falling back to public interface 2023-12-08T20:34:39.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:39 smithi111 ceph-mon[182474]: pgmap v132: 65 pgs: 3 active+undersized+degraded, 7 stale+active+clean, 7 active+undersized, 48 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8/357 objects degraded (2.241%) 2023-12-08T20:34:39.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:39 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:39.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:39 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:39.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:39 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:34:39.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:39 smithi043 ceph-mon[219193]: pgmap v132: 65 pgs: 3 active+undersized+degraded, 7 stale+active+clean, 7 active+undersized, 48 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8/357 objects degraded (2.241%) 2023-12-08T20:34:39.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:39 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:39.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:39 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:39.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:39 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:34:41.415 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:41 smithi111 ceph-mon[182474]: pgmap v133: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 56/357 objects degraded (15.686%) 2023-12-08T20:34:41.415 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:41 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:41.415 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:41 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:41.415 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:41 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:41.415 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:41 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:41.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:41 smithi043 ceph-mon[219193]: pgmap v133: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 56/357 objects degraded (15.686%) 2023-12-08T20:34:41.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:41 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:41.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:41 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:41.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:41 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:41.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:41 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:43.468 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:43 smithi111 ceph-mon[182474]: pgmap v134: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 56/357 objects degraded (15.686%) 2023-12-08T20:34:43.468 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:43 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:34:43.337+0000 7ff2aaf6a640 -1 osd.5 0 read_superblock omap replica is missing. 2023-12-08T20:34:43.515 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:43 smithi043 ceph-mon[219193]: pgmap v134: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 56/357 objects degraded (15.686%) 2023-12-08T20:34:44.217 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:43 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:34:43.762+0000 7ff2aaf6a640 -1 osd.5 75 log_to_monitors true 2023-12-08T20:34:44.967 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:34:44.788+0000 7ff29b3d9700 -1 osd.5 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T20:34:44.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:44.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:44.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:34:44.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:34:44.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:44.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:34:44.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:34:44.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:34:44.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:34:44.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:34:44.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: Upgrade: Setting container_image for all osd 2023-12-08T20:34:44.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:44.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-08T20:34:44.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-08T20:34:44.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-08T20:34:44.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-08T20:34:44.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-08T20:34:44.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-08T20:34:44.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-08T20:34:44.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-08T20:34:44.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-08T20:34:44.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-08T20:34:44.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-08T20:34:44.969 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='osd.5 [v2:172.21.15.111:6816/2321927187,v1:172.21.15.111:6817/2321927187]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-08T20:34:44.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-08T20:34:44.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-08T20:34:44.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-08T20:34:44.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-08T20:34:44.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-08T20:34:44.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:44.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: pgmap v135: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 56/357 objects degraded (15.686%) 2023-12-08T20:34:44.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:34:44.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:34:44.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:34:44.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:44.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:44.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:34:45.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:45.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:45.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:34:45.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:34:45.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:45.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:34:45.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:34:45.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:34:45.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:34:45.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:34:45.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: Upgrade: Setting container_image for all osd 2023-12-08T20:34:45.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:45.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-08T20:34:45.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-08T20:34:45.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-08T20:34:45.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-08T20:34:45.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-08T20:34:45.015 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-08T20:34:45.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-08T20:34:45.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-08T20:34:45.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-08T20:34:45.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-08T20:34:45.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-08T20:34:45.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='osd.5 [v2:172.21.15.111:6816/2321927187,v1:172.21.15.111:6817/2321927187]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-08T20:34:45.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-08T20:34:45.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-08T20:34:45.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-08T20:34:45.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-08T20:34:45.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-08T20:34:45.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:45.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: pgmap v135: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 56/357 objects degraded (15.686%) 2023-12-08T20:34:45.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:34:45.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:34:45.016 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:34:45.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:45.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:45.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:34:45.017 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:44 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-mon-smithi043[219170]: 2023-12-08T20:34:44.774+0000 7f204647b700 -1 log_channel(cluster) log [ERR] : Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-08T20:34:46.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:45 smithi111 ceph-mon[182474]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-08T20:34:46.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:45 smithi111 ceph-mon[182474]: osdmap e78: 6 total, 5 up, 6 in 2023-12-08T20:34:46.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:45 smithi111 ceph-mon[182474]: from='osd.5 [v2:172.21.15.111:6816/2321927187,v1:172.21.15.111:6817/2321927187]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:34:46.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:45 smithi111 ceph-mon[182474]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:34:46.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:45 smithi111 ceph-mon[182474]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-08T20:34:46.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:45 smithi111 ceph-mon[182474]: Health check update: Degraded data redundancy: 56/357 objects degraded (15.686%), 14 pgs degraded (PG_DEGRADED) 2023-12-08T20:34:46.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:45 smithi043 ceph-mon[219193]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-08T20:34:46.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:45 smithi043 ceph-mon[219193]: osdmap e78: 6 total, 5 up, 6 in 2023-12-08T20:34:46.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:45 smithi043 ceph-mon[219193]: from='osd.5 [v2:172.21.15.111:6816/2321927187,v1:172.21.15.111:6817/2321927187]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:34:46.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:45 smithi043 ceph-mon[219193]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2023-12-08T20:34:46.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:45 smithi043 ceph-mon[219193]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-08T20:34:46.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:45 smithi043 ceph-mon[219193]: Health check update: Degraded data redundancy: 56/357 objects degraded (15.686%), 14 pgs degraded (PG_DEGRADED) 2023-12-08T20:34:47.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:46 smithi111 ceph-mon[182474]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-08T20:34:47.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:46 smithi111 ceph-mon[182474]: pgmap v137: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 56/357 objects degraded (15.686%) 2023-12-08T20:34:47.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:46 smithi111 ceph-mon[182474]: osd.5 [v2:172.21.15.111:6816/2321927187,v1:172.21.15.111:6817/2321927187] boot 2023-12-08T20:34:47.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:46 smithi111 ceph-mon[182474]: osdmap e79: 6 total, 6 up, 6 in 2023-12-08T20:34:47.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:46 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:34:47.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:46 smithi043 ceph-mon[219193]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-08T20:34:47.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:46 smithi043 ceph-mon[219193]: pgmap v137: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 56/357 objects degraded (15.686%) 2023-12-08T20:34:47.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:46 smithi043 ceph-mon[219193]: osd.5 [v2:172.21.15.111:6816/2321927187,v1:172.21.15.111:6817/2321927187] boot 2023-12-08T20:34:47.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:46 smithi043 ceph-mon[219193]: osdmap e79: 6 total, 6 up, 6 in 2023-12-08T20:34:47.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:46 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-08T20:34:48.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:47 smithi111 ceph-mon[182474]: osdmap e80: 6 total, 6 up, 6 in 2023-12-08T20:34:48.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:47 smithi043 ceph-mon[219193]: osdmap e80: 6 total, 6 up, 6 in 2023-12-08T20:34:49.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:48 smithi111 ceph-mon[182474]: pgmap v140: 65 pgs: 1 activating, 12 active+undersized+degraded, 12 active+undersized, 40 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/357 objects degraded (14.566%) 2023-12-08T20:34:49.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:48 smithi043 ceph-mon[219193]: pgmap v140: 65 pgs: 1 activating, 12 active+undersized+degraded, 12 active+undersized, 40 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/357 objects degraded (14.566%) 2023-12-08T20:34:50.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:50 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:50.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:50 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:51.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.273+0000 7f6306841700 1 -- 172.21.15.43:0/13772154 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63001057c0 msgr2=0x7f63000fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:51.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.273+0000 7f6306841700 1 --2- 172.21.15.43:0/13772154 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63001057c0 0x7f63000fee30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f62f4004940 tx=0x7f62f4009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:51.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.273+0000 7f6306841700 1 -- 172.21.15.43:0/13772154 shutdown_connections 2023-12-08T20:34:51.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.273+0000 7f6306841700 1 --2- 172.21.15.43:0/13772154 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63001057c0 0x7f63000fee30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:51.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.273+0000 7f6306841700 1 --2- 172.21.15.43:0/13772154 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6300104e20 0x7f63001051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:51.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.273+0000 7f6306841700 1 -- 172.21.15.43:0/13772154 >> 172.21.15.43:0/13772154 conn(0x7f63000fa990 msgr2=0x7f63000fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:51.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.273+0000 7f6306841700 1 -- 172.21.15.43:0/13772154 shutdown_connections 2023-12-08T20:34:51.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.273+0000 7f6306841700 1 -- 172.21.15.43:0/13772154 wait complete. 2023-12-08T20:34:51.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.273+0000 7f6306841700 1 Processor -- start 2023-12-08T20:34:51.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.274+0000 7f6306841700 1 -- start start 2023-12-08T20:34:51.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.274+0000 7f6306841700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6300104e20 0x7f63001158b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:51.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.274+0000 7f6306841700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63001057c0 0x7f6300115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:51.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.274+0000 7f6306841700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6300116440 con 0x7f6300104e20 2023-12-08T20:34:51.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.274+0000 7f6306841700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630010f770 con 0x7f63001057c0 2023-12-08T20:34:51.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.274+0000 7f62fffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6300104e20 0x7f63001158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:51.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.274+0000 7f62fffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6300104e20 0x7f63001158b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40610/0 (socket says 172.21.15.43:40610) 2023-12-08T20:34:51.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.274+0000 7f62fffff700 1 -- 172.21.15.43:0/2753106487 learned_addr learned my addr 172.21.15.43:0/2753106487 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:34:51.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.274+0000 7f62ff7fe700 1 --2- 172.21.15.43:0/2753106487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63001057c0 0x7f6300115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:51.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.274+0000 7f62fffff700 1 -- 172.21.15.43:0/2753106487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63001057c0 msgr2=0x7f6300115df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:51.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.274+0000 7f62fffff700 1 --2- 172.21.15.43:0/2753106487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63001057c0 0x7f6300115df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:51.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.274+0000 7f62fffff700 1 -- 172.21.15.43:0/2753106487 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f4005040 con 0x7f6300104e20 2023-12-08T20:34:51.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.275+0000 7f62fffff700 1 --2- 172.21.15.43:0/2753106487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6300104e20 0x7f63001158b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f62f0002a50 tx=0x7f62f00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:51.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.275+0000 7f62fcff9700 1 -- 172.21.15.43:0/2753106487 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62f0007cc0 con 0x7f6300104e20 2023-12-08T20:34:51.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.275+0000 7f62fcff9700 1 -- 172.21.15.43:0/2753106487 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f62f000f040 con 0x7f6300104e20 2023-12-08T20:34:51.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.275+0000 7f62fcff9700 1 -- 172.21.15.43:0/2753106487 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62f0009540 con 0x7f6300104e20 2023-12-08T20:34:51.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.275+0000 7f6306841700 1 -- 172.21.15.43:0/2753106487 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630010fa50 con 0x7f6300104e20 2023-12-08T20:34:51.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.275+0000 7f6306841700 1 -- 172.21.15.43:0/2753106487 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630010ff90 con 0x7f6300104e20 2023-12-08T20:34:51.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.276+0000 7f6306841700 1 -- 172.21.15.43:0/2753106487 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63001072f0 con 0x7f6300104e20 2023-12-08T20:34:51.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.277+0000 7f62fcff9700 1 -- 172.21.15.43:0/2753106487 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f62f00096a0 con 0x7f6300104e20 2023-12-08T20:34:51.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.277+0000 7f62fcff9700 1 --2- 172.21.15.43:0/2753106487 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f62e806ce60 0x7f62e806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:51.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.277+0000 7f62fcff9700 1 -- 172.21.15.43:0/2753106487 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f62f008bf90 con 0x7f6300104e20 2023-12-08T20:34:51.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.277+0000 7f62ff7fe700 1 --2- 172.21.15.43:0/2753106487 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f62e806ce60 0x7f62e806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:51.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.278+0000 7f62ff7fe700 1 --2- 172.21.15.43:0/2753106487 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f62e806ce60 0x7f62e806f310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f62f400b3b0 tx=0x7f62f4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:51.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.282+0000 7f62fcff9700 1 -- 172.21.15.43:0/2753106487 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f62f00599d0 con 0x7f6300104e20 2023-12-08T20:34:51.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:51 smithi111 ceph-mon[182474]: pgmap v141: 65 pgs: 1 activating, 5 active+undersized+degraded, 8 active+undersized, 51 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 17/357 objects degraded (4.762%) 2023-12-08T20:34:51.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:51 smithi111 ceph-mon[182474]: Health check update: Degraded data redundancy: 17/357 objects degraded (4.762%), 5 pgs degraded (PG_DEGRADED) 2023-12-08T20:34:51.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.511+0000 7f6306841700 1 -- 172.21.15.43:0/2753106487 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f630004bbf0 con 0x7f62e806ce60 2023-12-08T20:34:51.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:51 smithi043 ceph-mon[219193]: pgmap v141: 65 pgs: 1 activating, 5 active+undersized+degraded, 8 active+undersized, 51 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 17/357 objects degraded (4.762%) 2023-12-08T20:34:51.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:51 smithi043 ceph-mon[219193]: Health check update: Degraded data redundancy: 17/357 objects degraded (4.762%), 5 pgs degraded (PG_DEGRADED) 2023-12-08T20:34:51.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.512+0000 7f62fcff9700 1 -- 172.21.15.43:0/2753106487 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f630004bbf0 con 0x7f62e806ce60 2023-12-08T20:34:51.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.515+0000 7f6306841700 1 -- 172.21.15.43:0/2753106487 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f62e806ce60 msgr2=0x7f62e806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:51.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.515+0000 7f6306841700 1 --2- 172.21.15.43:0/2753106487 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f62e806ce60 0x7f62e806f310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f62f400b3b0 tx=0x7f62f4009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:51.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.515+0000 7f6306841700 1 -- 172.21.15.43:0/2753106487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6300104e20 msgr2=0x7f63001158b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:51.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.515+0000 7f6306841700 1 --2- 172.21.15.43:0/2753106487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6300104e20 0x7f63001158b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f62f0002a50 tx=0x7f62f00046b0 comp rx=0 tx=0).stop 2023-12-08T20:34:51.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.515+0000 7f6306841700 1 -- 172.21.15.43:0/2753106487 shutdown_connections 2023-12-08T20:34:51.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.515+0000 7f6306841700 1 --2- 172.21.15.43:0/2753106487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6300104e20 0x7f63001158b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:51.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.515+0000 7f6306841700 1 --2- 172.21.15.43:0/2753106487 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f62e806ce60 0x7f62e806f310 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:51.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.515+0000 7f6306841700 1 --2- 172.21.15.43:0/2753106487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63001057c0 0x7f6300115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:51.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.515+0000 7f6306841700 1 -- 172.21.15.43:0/2753106487 >> 172.21.15.43:0/2753106487 conn(0x7f63000fa990 msgr2=0x7f63000fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:51.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.515+0000 7f6306841700 1 -- 172.21.15.43:0/2753106487 shutdown_connections 2023-12-08T20:34:51.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.515+0000 7f6306841700 1 -- 172.21.15.43:0/2753106487 wait complete. 2023-12-08T20:34:51.528 INFO:teuthology.orchestra.run.smithi043.stdout:true 2023-12-08T20:34:51.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.628+0000 7ffb61f9c700 1 -- 172.21.15.43:0/2577832201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb5c101b00 msgr2=0x7ffb5c101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:51.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.628+0000 7ffb61f9c700 1 --2- 172.21.15.43:0/2577832201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb5c101b00 0x7ffb5c101ed0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c004940 tx=0x7ffb4c009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:51.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.628+0000 7ffb61f9c700 1 -- 172.21.15.43:0/2577832201 shutdown_connections 2023-12-08T20:34:51.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.628+0000 7ffb61f9c700 1 --2- 172.21.15.43:0/2577832201 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb5c0fbb40 0x7ffb5c0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:51.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.628+0000 7ffb61f9c700 1 --2- 172.21.15.43:0/2577832201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb5c101b00 0x7ffb5c101ed0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:51.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.628+0000 7ffb61f9c700 1 -- 172.21.15.43:0/2577832201 >> 172.21.15.43:0/2577832201 conn(0x7ffb5c0719b0 msgr2=0x7ffb5c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:51.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.628+0000 7ffb61f9c700 1 -- 172.21.15.43:0/2577832201 shutdown_connections 2023-12-08T20:34:51.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.628+0000 7ffb61f9c700 1 -- 172.21.15.43:0/2577832201 wait complete. 2023-12-08T20:34:51.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.629+0000 7ffb61f9c700 1 Processor -- start 2023-12-08T20:34:51.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.629+0000 7ffb61f9c700 1 -- start start 2023-12-08T20:34:51.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.629+0000 7ffb61f9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb5c0fbb40 0x7ffb5c10e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:51.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.629+0000 7ffb61f9c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb5c101b00 0x7ffb5c10eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:51.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.629+0000 7ffb61f9c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c10f120 con 0x7ffb5c0fbb40 2023-12-08T20:34:51.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.629+0000 7ffb61f9c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c10f290 con 0x7ffb5c101b00 2023-12-08T20:34:51.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.630+0000 7ffb5b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb5c0fbb40 0x7ffb5c10e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:51.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.630+0000 7ffb5b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb5c0fbb40 0x7ffb5c10e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40624/0 (socket says 172.21.15.43:40624) 2023-12-08T20:34:51.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.630+0000 7ffb5b7fe700 1 -- 172.21.15.43:0/4104333786 learned_addr learned my addr 172.21.15.43:0/4104333786 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:34:51.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.630+0000 7ffb5affd700 1 --2- 172.21.15.43:0/4104333786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb5c101b00 0x7ffb5c10eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:51.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.630+0000 7ffb5b7fe700 1 -- 172.21.15.43:0/4104333786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb5c101b00 msgr2=0x7ffb5c10eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:51.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.630+0000 7ffb5b7fe700 1 --2- 172.21.15.43:0/4104333786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb5c101b00 0x7ffb5c10eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:51.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.630+0000 7ffb5b7fe700 1 -- 172.21.15.43:0/4104333786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4c005040 con 0x7ffb5c0fbb40 2023-12-08T20:34:51.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.630+0000 7ffb5affd700 1 --2- 172.21.15.43:0/4104333786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb5c101b00 0x7ffb5c10eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:34:51.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.630+0000 7ffb5b7fe700 1 --2- 172.21.15.43:0/4104333786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb5c0fbb40 0x7ffb5c10e5e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00b3b0 tx=0x7ffb4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:51.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.630+0000 7ffb53fff700 1 -- 172.21.15.43:0/4104333786 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb4c00e040 con 0x7ffb5c0fbb40 2023-12-08T20:34:51.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.630+0000 7ffb53fff700 1 -- 172.21.15.43:0/4104333786 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffb4c00bc50 con 0x7ffb5c0fbb40 2023-12-08T20:34:51.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.630+0000 7ffb61f9c700 1 -- 172.21.15.43:0/4104333786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5c117580 con 0x7ffb5c0fbb40 2023-12-08T20:34:51.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.630+0000 7ffb53fff700 1 -- 172.21.15.43:0/4104333786 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb4c013420 con 0x7ffb5c0fbb40 2023-12-08T20:34:51.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.630+0000 7ffb61f9c700 1 -- 172.21.15.43:0/4104333786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5c117a60 con 0x7ffb5c0fbb40 2023-12-08T20:34:51.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.631+0000 7ffb61f9c700 1 -- 172.21.15.43:0/4104333786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5c103fb0 con 0x7ffb5c0fbb40 2023-12-08T20:34:51.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.632+0000 7ffb53fff700 1 -- 172.21.15.43:0/4104333786 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7ffb4c01c430 con 0x7ffb5c0fbb40 2023-12-08T20:34:51.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.632+0000 7ffb53fff700 1 --2- 172.21.15.43:0/4104333786 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7ffb4806ce60 0x7ffb4806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:51.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.632+0000 7ffb53fff700 1 -- 172.21.15.43:0/4104333786 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ffb4c08d010 con 0x7ffb5c0fbb40 2023-12-08T20:34:51.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.632+0000 7ffb5affd700 1 --2- 172.21.15.43:0/4104333786 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7ffb4806ce60 0x7ffb4806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:51.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.633+0000 7ffb5affd700 1 --2- 172.21.15.43:0/4104333786 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7ffb4806ce60 0x7ffb4806f310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffb44007fd0 tx=0x7ffb44009f60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:51.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.637+0000 7ffb53fff700 1 -- 172.21.15.43:0/4104333786 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ffb4c057110 con 0x7ffb5c0fbb40 2023-12-08T20:34:51.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.868+0000 7ffb61f9c700 1 -- 172.21.15.43:0/4104333786 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb5c065bd0 con 0x7ffb4806ce60 2023-12-08T20:34:51.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.869+0000 7ffb53fff700 1 -- 172.21.15.43:0/4104333786 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7ffb5c065bd0 con 0x7ffb4806ce60 2023-12-08T20:34:51.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.871+0000 7ffb61f9c700 1 -- 172.21.15.43:0/4104333786 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7ffb4806ce60 msgr2=0x7ffb4806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:51.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.871+0000 7ffb61f9c700 1 --2- 172.21.15.43:0/4104333786 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7ffb4806ce60 0x7ffb4806f310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffb44007fd0 tx=0x7ffb44009f60 comp rx=0 tx=0).stop 2023-12-08T20:34:51.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.871+0000 7ffb61f9c700 1 -- 172.21.15.43:0/4104333786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb5c0fbb40 msgr2=0x7ffb5c10e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:51.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.871+0000 7ffb61f9c700 1 --2- 172.21.15.43:0/4104333786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb5c0fbb40 0x7ffb5c10e5e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00b3b0 tx=0x7ffb4c009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:51.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.872+0000 7ffb61f9c700 1 -- 172.21.15.43:0/4104333786 shutdown_connections 2023-12-08T20:34:51.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.872+0000 7ffb61f9c700 1 --2- 172.21.15.43:0/4104333786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb5c0fbb40 0x7ffb5c10e5e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:51.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.872+0000 7ffb61f9c700 1 --2- 172.21.15.43:0/4104333786 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7ffb4806ce60 0x7ffb4806f310 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:51.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.872+0000 7ffb61f9c700 1 --2- 172.21.15.43:0/4104333786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb5c101b00 0x7ffb5c10eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:51.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.872+0000 7ffb61f9c700 1 -- 172.21.15.43:0/4104333786 >> 172.21.15.43:0/4104333786 conn(0x7ffb5c0719b0 msgr2=0x7ffb5c0faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:51.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.872+0000 7ffb61f9c700 1 -- 172.21.15.43:0/4104333786 shutdown_connections 2023-12-08T20:34:51.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:51.872+0000 7ffb61f9c700 1 -- 172.21.15.43:0/4104333786 wait complete. 2023-12-08T20:34:51.885 INFO:teuthology.orchestra.run.smithi043.stdout:"Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception" 2023-12-08T20:34:52.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:52 smithi043 ceph-mon[219193]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/357 objects degraded (4.762%), 5 pgs degraded) 2023-12-08T20:34:52.296 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph orch ps' 2023-12-08T20:34:52.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:52 smithi111 ceph-mon[182474]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/357 objects degraded (4.762%), 5 pgs degraded) 2023-12-08T20:34:52.599 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:34:53.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:53 smithi111 ceph-mon[182474]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:34:53.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:53 smithi111 ceph-mon[182474]: pgmap v142: 65 pgs: 1 activating, 64 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:53.467 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:53 smithi111 ceph-mon[182474]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:34:53.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:53 smithi043 ceph-mon[219193]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:34:53.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:53 smithi043 ceph-mon[219193]: pgmap v142: 65 pgs: 1 activating, 64 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:53.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:53 smithi043 ceph-mon[219193]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:34:53.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.793+0000 7fd252b46700 1 -- 172.21.15.43:0/3439333468 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24c102c20 msgr2=0x7fd24c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:53.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.793+0000 7fd252b46700 1 --2- 172.21.15.43:0/3439333468 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24c102c20 0x7fd24c102ff0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd23c004940 tx=0x7fd23c009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:53.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.793+0000 7fd252b46700 1 -- 172.21.15.43:0/3439333468 shutdown_connections 2023-12-08T20:34:53.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.793+0000 7fd252b46700 1 --2- 172.21.15.43:0/3439333468 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd24c065390 0x7fd24c065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:53.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.793+0000 7fd252b46700 1 --2- 172.21.15.43:0/3439333468 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24c102c20 0x7fd24c102ff0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:53.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.793+0000 7fd252b46700 1 -- 172.21.15.43:0/3439333468 >> 172.21.15.43:0/3439333468 conn(0x7fd24c0719b0 msgr2=0x7fd24c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:53.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.793+0000 7fd252b46700 1 -- 172.21.15.43:0/3439333468 shutdown_connections 2023-12-08T20:34:53.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.794+0000 7fd252b46700 1 -- 172.21.15.43:0/3439333468 wait complete. 2023-12-08T20:34:53.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.794+0000 7fd252b46700 1 Processor -- start 2023-12-08T20:34:53.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.794+0000 7fd252b46700 1 -- start start 2023-12-08T20:34:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.795+0000 7fd252b46700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24c065390 0x7fd24c113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.795+0000 7fd252b46700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd24c102c20 0x7fd24c113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.795+0000 7fd252b46700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c114220 con 0x7fd24c065390 2023-12-08T20:34:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.795+0000 7fd252b46700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c10d570 con 0x7fd24c102c20 2023-12-08T20:34:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.795+0000 7fd2508e2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24c065390 0x7fd24c113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.795+0000 7fd2508e2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24c065390 0x7fd24c113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40638/0 (socket says 172.21.15.43:40638) 2023-12-08T20:34:53.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.795+0000 7fd2508e2700 1 -- 172.21.15.43:0/337234690 learned_addr learned my addr 172.21.15.43:0/337234690 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:34:53.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.795+0000 7fd24bfff700 1 --2- 172.21.15.43:0/337234690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd24c102c20 0x7fd24c113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:53.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.795+0000 7fd2508e2700 1 -- 172.21.15.43:0/337234690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd24c102c20 msgr2=0x7fd24c113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:53.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.795+0000 7fd2508e2700 1 --2- 172.21.15.43:0/337234690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd24c102c20 0x7fd24c113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:53.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.795+0000 7fd2508e2700 1 -- 172.21.15.43:0/337234690 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c005040 con 0x7fd24c065390 2023-12-08T20:34:53.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.795+0000 7fd24bfff700 1 --2- 172.21.15.43:0/337234690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd24c102c20 0x7fd24c113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:34:53.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.796+0000 7fd2508e2700 1 --2- 172.21.15.43:0/337234690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24c065390 0x7fd24c113690 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009fd0 tx=0x7fd23c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:53.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.796+0000 7fd2497fa700 1 -- 172.21.15.43:0/337234690 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd23c00e040 con 0x7fd24c065390 2023-12-08T20:34:53.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.796+0000 7fd252b46700 1 -- 172.21.15.43:0/337234690 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24c10d7f0 con 0x7fd24c065390 2023-12-08T20:34:53.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.796+0000 7fd2497fa700 1 -- 172.21.15.43:0/337234690 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd23c00bc50 con 0x7fd24c065390 2023-12-08T20:34:53.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.796+0000 7fd2497fa700 1 -- 172.21.15.43:0/337234690 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd23c013ea0 con 0x7fd24c065390 2023-12-08T20:34:53.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.796+0000 7fd252b46700 1 -- 172.21.15.43:0/337234690 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24c10dd30 con 0x7fd24c065390 2023-12-08T20:34:53.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.797+0000 7fd252b46700 1 -- 172.21.15.43:0/337234690 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24c0fff40 con 0x7fd24c065390 2023-12-08T20:34:53.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.797+0000 7fd2497fa700 1 -- 172.21.15.43:0/337234690 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fd23c013420 con 0x7fd24c065390 2023-12-08T20:34:53.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.798+0000 7fd2497fa700 1 --2- 172.21.15.43:0/337234690 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fd23806ce70 0x7fd23806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:53.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.798+0000 7fd2497fa700 1 -- 172.21.15.43:0/337234690 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd23c08d7c0 con 0x7fd24c065390 2023-12-08T20:34:53.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.798+0000 7fd24bfff700 1 --2- 172.21.15.43:0/337234690 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fd23806ce70 0x7fd23806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:53.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.798+0000 7fd24bfff700 1 --2- 172.21.15.43:0/337234690 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fd23806ce70 0x7fd23806f320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd234009fd0 tx=0x7fd234009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:53.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:53.803+0000 7fd2497fa700 1 -- 172.21.15.43:0/337234690 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd23c05b180 con 0x7fd24c065390 2023-12-08T20:34:54.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:54.022+0000 7fd252b46700 1 -- 172.21.15.43:0/337234690 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd24c04bb80 con 0x7fd23806ce70 2023-12-08T20:34:54.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:54.034+0000 7fd2497fa700 1 -- 172.21.15.43:0/337234690 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd24c04bb80 con 0x7fd23806ce70 2023-12-08T20:34:54.036 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-08T20:34:54.037 INFO:teuthology.orchestra.run.smithi043.stdout:alertmanager.smithi043 smithi043 *:9093,9094 running (5m) 97s ago 13m 26.4M - 0.25.0 c8568f914cd2 d4a6cd00c86b 2023-12-08T20:34:54.037 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi043 smithi043 running (3m) 97s ago 13m 7482k - 19.0.0-44-g9dcc13bb f28f2b94f153 f570eddb8e8a 2023-12-08T20:34:54.037 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi111 smithi111 running (2m) 13s ago 12m 7448k - 19.0.0-44-g9dcc13bb f28f2b94f153 b2013e24b94e 2023-12-08T20:34:54.037 INFO:teuthology.orchestra.run.smithi043.stdout:grafana.smithi043 smithi043 *:3000 running (4m) 97s ago 12m 84.4M - 9.4.7 954c08fa6188 8f55491a980b 2023-12-08T20:34:54.037 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.akrjef smithi043 running (9m) 97s ago 9m 18.9M - 17.2.7-119-ge2143d99 f761b6e42225 1c0cb8d34ef8 2023-12-08T20:34:54.037 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.pjmszb smithi043 running (9m) 97s ago 9m 7154M - 17.2.7-119-ge2143d99 f761b6e42225 d7eee0c78093 2023-12-08T20:34:54.037 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.svpasm smithi111 running (9m) 13s ago 9m 17.0M - 17.2.7-119-ge2143d99 f761b6e42225 657d4d1cf4b2 2023-12-08T20:34:54.037 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.veeegc smithi111 running (9m) 13s ago 9m 3707M - 17.2.7-119-ge2143d99 f761b6e42225 31f794a388ab 2023-12-08T20:34:54.037 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi043.hqcdcm smithi043 *:8443,9283,8765 running (6m) 97s ago 14m 510M - 19.0.0-44-g9dcc13bb f28f2b94f153 14e91c1dac64 2023-12-08T20:34:54.037 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi111.mtcffu smithi111 *:8443,9283,8765 running (5m) 13s ago 12m 451M - 19.0.0-44-g9dcc13bb f28f2b94f153 56f4290c6db5 2023-12-08T20:34:54.037 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi043 smithi043 running (3m) 97s ago 14m 61.7M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 3597e3a60ebc 2023-12-08T20:34:54.037 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi111 smithi111 running (3m) 13s ago 12m 53.1M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 528aa182165f 2023-12-08T20:34:54.037 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi043 smithi043 *:9100 running (5m) 97s ago 13m 17.4M - 1.5.0 0da6a335fe13 0959b44d9972 2023-12-08T20:34:54.037 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi111 smithi111 *:9100 running (5m) 13s ago 12m 18.1M - 1.5.0 0da6a335fe13 10fe4fdb23d0 2023-12-08T20:34:54.037 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (2m) 97s ago 11m 121M 1570M 19.0.0-44-g9dcc13bb f28f2b94f153 298e9b98d7a4 2023-12-08T20:34:54.038 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi043 running (2m) 97s ago 11m 127M 1570M 19.0.0-44-g9dcc13bb f28f2b94f153 1ad10def08c3 2023-12-08T20:34:54.038 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi043 running (101s) 97s ago 11m 14.9M 1570M 19.0.0-44-g9dcc13bb f28f2b94f153 0b56e93b08fc 2023-12-08T20:34:54.038 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi111 running (70s) 13s ago 10m 141M 2592M 19.0.0-44-g9dcc13bb f28f2b94f153 75c0817b18fc 2023-12-08T20:34:54.038 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi111 running (43s) 13s ago 10m 123M 2592M 19.0.0-44-g9dcc13bb f28f2b94f153 b9e4953b16d6 2023-12-08T20:34:54.038 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi111 running (15s) 13s ago 10m 12.6M 2592M 19.0.0-44-g9dcc13bb f28f2b94f153 156555b2e09c 2023-12-08T20:34:54.038 INFO:teuthology.orchestra.run.smithi043.stdout:prometheus.smithi043 smithi043 *:9095 running (5m) 97s ago 12m 64.7M - 2.43.0 a07b618ecd1d d95914ec88d8 2023-12-08T20:34:54.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:54.037+0000 7fd252b46700 1 -- 172.21.15.43:0/337234690 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fd23806ce70 msgr2=0x7fd23806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:54.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:54.037+0000 7fd252b46700 1 --2- 172.21.15.43:0/337234690 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fd23806ce70 0x7fd23806f320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd234009fd0 tx=0x7fd234009ee0 comp rx=0 tx=0).stop 2023-12-08T20:34:54.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:54.037+0000 7fd252b46700 1 -- 172.21.15.43:0/337234690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24c065390 msgr2=0x7fd24c113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:54.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:54.037+0000 7fd252b46700 1 --2- 172.21.15.43:0/337234690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24c065390 0x7fd24c113690 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009fd0 tx=0x7fd23c009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:54.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:54.037+0000 7fd252b46700 1 -- 172.21.15.43:0/337234690 shutdown_connections 2023-12-08T20:34:54.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:54.037+0000 7fd252b46700 1 --2- 172.21.15.43:0/337234690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24c065390 0x7fd24c113690 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:54.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:54.037+0000 7fd252b46700 1 --2- 172.21.15.43:0/337234690 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fd23806ce70 0x7fd23806f320 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:54.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:54.037+0000 7fd252b46700 1 --2- 172.21.15.43:0/337234690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd24c102c20 0x7fd24c113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:54.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:54.037+0000 7fd252b46700 1 -- 172.21.15.43:0/337234690 >> 172.21.15.43:0/337234690 conn(0x7fd24c0719b0 msgr2=0x7fd24c0fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:54.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:54.037+0000 7fd252b46700 1 -- 172.21.15.43:0/337234690 shutdown_connections 2023-12-08T20:34:54.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:54.037+0000 7fd252b46700 1 -- 172.21.15.43:0/337234690 wait complete. 2023-12-08T20:34:54.420 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph orch upgrade status' 2023-12-08T20:34:54.726 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:34:55.249 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:55 smithi043 ceph-mon[219193]: pgmap v143: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:55.249 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:55 smithi043 ceph-mon[219193]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:34:55.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:55 smithi111 ceph-mon[182474]: pgmap v143: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:55.469 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:55 smithi111 ceph-mon[182474]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:34:56.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.098+0000 7fb38bfef700 1 -- 172.21.15.43:0/1447831678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3840fcee0 msgr2=0x7fb384109190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:56.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.098+0000 7fb38bfef700 1 --2- 172.21.15.43:0/1447831678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3840fcee0 0x7fb384109190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb374004940 tx=0x7fb374009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:56.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.098+0000 7fb38bfef700 1 -- 172.21.15.43:0/1447831678 shutdown_connections 2023-12-08T20:34:56.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.098+0000 7fb38bfef700 1 --2- 172.21.15.43:0/1447831678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3840fcee0 0x7fb384109190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:56.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.098+0000 7fb38bfef700 1 --2- 172.21.15.43:0/1447831678 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3840fc5d0 0x7fb3840fc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:56.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.098+0000 7fb38bfef700 1 -- 172.21.15.43:0/1447831678 >> 172.21.15.43:0/1447831678 conn(0x7fb3840719b0 msgr2=0x7fb384071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:56.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.098+0000 7fb38bfef700 1 -- 172.21.15.43:0/1447831678 shutdown_connections 2023-12-08T20:34:56.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.098+0000 7fb38bfef700 1 -- 172.21.15.43:0/1447831678 wait complete. 2023-12-08T20:34:56.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.098+0000 7fb38bfef700 1 Processor -- start 2023-12-08T20:34:56.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.099+0000 7fb38bfef700 1 -- start start 2023-12-08T20:34:56.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.099+0000 7fb38bfef700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3840fc5d0 0x7fb384115980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:56.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.099+0000 7fb38bfef700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3840fcee0 0x7fb384115ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:56.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.099+0000 7fb38bfef700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb384116510 con 0x7fb3840fc5d0 2023-12-08T20:34:56.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.099+0000 7fb38bfef700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38410f840 con 0x7fb3840fcee0 2023-12-08T20:34:56.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.099+0000 7fb389d8b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3840fc5d0 0x7fb384115980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:56.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.099+0000 7fb389d8b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3840fc5d0 0x7fb384115980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40658/0 (socket says 172.21.15.43:40658) 2023-12-08T20:34:56.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.099+0000 7fb389d8b700 1 -- 172.21.15.43:0/1683112384 learned_addr learned my addr 172.21.15.43:0/1683112384 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:34:56.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.099+0000 7fb38958a700 1 --2- 172.21.15.43:0/1683112384 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3840fcee0 0x7fb384115ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:56.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.099+0000 7fb389d8b700 1 -- 172.21.15.43:0/1683112384 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3840fcee0 msgr2=0x7fb384115ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:56.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.099+0000 7fb389d8b700 1 --2- 172.21.15.43:0/1683112384 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3840fcee0 0x7fb384115ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:56.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.099+0000 7fb389d8b700 1 -- 172.21.15.43:0/1683112384 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb374005040 con 0x7fb3840fc5d0 2023-12-08T20:34:56.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.100+0000 7fb389d8b700 1 --2- 172.21.15.43:0/1683112384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3840fc5d0 0x7fb384115980 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb380002a50 tx=0x7fb3800046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:56.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.100+0000 7fb37a7fc700 1 -- 172.21.15.43:0/1683112384 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb380007cc0 con 0x7fb3840fc5d0 2023-12-08T20:34:56.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.100+0000 7fb37a7fc700 1 -- 172.21.15.43:0/1683112384 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb38000f040 con 0x7fb3840fc5d0 2023-12-08T20:34:56.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.100+0000 7fb38bfef700 1 -- 172.21.15.43:0/1683112384 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb38410fb20 con 0x7fb3840fc5d0 2023-12-08T20:34:56.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.100+0000 7fb37a7fc700 1 -- 172.21.15.43:0/1683112384 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb38000d9c0 con 0x7fb3840fc5d0 2023-12-08T20:34:56.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.100+0000 7fb38bfef700 1 -- 172.21.15.43:0/1683112384 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb384110030 con 0x7fb3840fc5d0 2023-12-08T20:34:56.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.101+0000 7fb38bfef700 1 -- 172.21.15.43:0/1683112384 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3841068c0 con 0x7fb3840fc5d0 2023-12-08T20:34:56.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.101+0000 7fb37a7fc700 1 -- 172.21.15.43:0/1683112384 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fb38000db20 con 0x7fb3840fc5d0 2023-12-08T20:34:56.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.102+0000 7fb37a7fc700 1 --2- 172.21.15.43:0/1683112384 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb37006ce60 0x7fb37006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:56.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.102+0000 7fb37a7fc700 1 -- 172.21.15.43:0/1683112384 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb38008bec0 con 0x7fb3840fc5d0 2023-12-08T20:34:56.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.102+0000 7fb38958a700 1 --2- 172.21.15.43:0/1683112384 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb37006ce60 0x7fb37006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:56.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.102+0000 7fb38958a700 1 --2- 172.21.15.43:0/1683112384 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb37006ce60 0x7fb37006f310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb384110b70 tx=0x7fb374009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:56.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.107+0000 7fb37a7fc700 1 -- 172.21.15.43:0/1683112384 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb380059900 con 0x7fb3840fc5d0 2023-12-08T20:34:56.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.336+0000 7fb38bfef700 1 -- 172.21.15.43:0/1683112384 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb38404bb80 con 0x7fb37006ce60 2023-12-08T20:34:56.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.338+0000 7fb37a7fc700 1 -- 172.21.15.43:0/1683112384 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7fb38404bb80 con 0x7fb37006ce60 2023-12-08T20:34:56.339 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:34:56.340 INFO:teuthology.orchestra.run.smithi043.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ae709ca57b3946fa2c3aa0e660f64e3305f87cd32e48714f46a7a7751203b389", 2023-12-08T20:34:56.340 INFO:teuthology.orchestra.run.smithi043.stdout: "in_progress": true, 2023-12-08T20:34:56.340 INFO:teuthology.orchestra.run.smithi043.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-08T20:34:56.340 INFO:teuthology.orchestra.run.smithi043.stdout: "services_complete": [ 2023-12-08T20:34:56.340 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2023-12-08T20:34:56.340 INFO:teuthology.orchestra.run.smithi043.stdout: "osd", 2023-12-08T20:34:56.340 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr", 2023-12-08T20:34:56.340 INFO:teuthology.orchestra.run.smithi043.stdout: "mon" 2023-12-08T20:34:56.340 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2023-12-08T20:34:56.340 INFO:teuthology.orchestra.run.smithi043.stdout: "progress": "12/21 daemons upgraded", 2023-12-08T20:34:56.340 INFO:teuthology.orchestra.run.smithi043.stdout: "message": "Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception", 2023-12-08T20:34:56.340 INFO:teuthology.orchestra.run.smithi043.stdout: "is_paused": true 2023-12-08T20:34:56.340 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:34:56.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.340+0000 7fb38bfef700 1 -- 172.21.15.43:0/1683112384 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb37006ce60 msgr2=0x7fb37006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:56.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.340+0000 7fb38bfef700 1 --2- 172.21.15.43:0/1683112384 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb37006ce60 0x7fb37006f310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb384110b70 tx=0x7fb374009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:56.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.340+0000 7fb38bfef700 1 -- 172.21.15.43:0/1683112384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3840fc5d0 msgr2=0x7fb384115980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:56.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.340+0000 7fb38bfef700 1 --2- 172.21.15.43:0/1683112384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3840fc5d0 0x7fb384115980 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb380002a50 tx=0x7fb3800046b0 comp rx=0 tx=0).stop 2023-12-08T20:34:56.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.340+0000 7fb38bfef700 1 -- 172.21.15.43:0/1683112384 shutdown_connections 2023-12-08T20:34:56.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.340+0000 7fb38bfef700 1 --2- 172.21.15.43:0/1683112384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3840fc5d0 0x7fb384115980 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:56.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.340+0000 7fb38bfef700 1 --2- 172.21.15.43:0/1683112384 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb37006ce60 0x7fb37006f310 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:56.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.340+0000 7fb38bfef700 1 --2- 172.21.15.43:0/1683112384 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3840fcee0 0x7fb384115ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:56.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.340+0000 7fb38bfef700 1 -- 172.21.15.43:0/1683112384 >> 172.21.15.43:0/1683112384 conn(0x7fb3840719b0 msgr2=0x7fb3840fa770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:56.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.340+0000 7fb38bfef700 1 -- 172.21.15.43:0/1683112384 shutdown_connections 2023-12-08T20:34:56.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:56.340+0000 7fb38bfef700 1 -- 172.21.15.43:0/1683112384 wait complete. 2023-12-08T20:34:56.736 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:56 smithi043 ceph-mon[219193]: pgmap v144: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:56.769 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph health detail' 2023-12-08T20:34:56.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:56 smithi111 ceph-mon[182474]: pgmap v144: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:57.073 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:34:57.879 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:57 smithi043 ceph-mon[219193]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:34:57.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:57 smithi111 ceph-mon[182474]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:34:58.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.290+0000 7fa04694c700 1 -- 172.21.15.43:0/1509757542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0400fbb40 msgr2=0x7fa0400fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:58.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.290+0000 7fa04694c700 1 --2- 172.21.15.43:0/1509757542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0400fbb40 0x7fa0400fbfb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa034004940 tx=0x7fa034009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:58.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.290+0000 7fa04694c700 1 -- 172.21.15.43:0/1509757542 shutdown_connections 2023-12-08T20:34:58.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.290+0000 7fa04694c700 1 --2- 172.21.15.43:0/1509757542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0400fbb40 0x7fa0400fbfb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:58.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.290+0000 7fa04694c700 1 --2- 172.21.15.43:0/1509757542 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa040101b00 0x7fa040101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:58.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.290+0000 7fa04694c700 1 -- 172.21.15.43:0/1509757542 >> 172.21.15.43:0/1509757542 conn(0x7fa0400719b0 msgr2=0x7fa040071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:58.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.290+0000 7fa04694c700 1 -- 172.21.15.43:0/1509757542 shutdown_connections 2023-12-08T20:34:58.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.290+0000 7fa04694c700 1 -- 172.21.15.43:0/1509757542 wait complete. 2023-12-08T20:34:58.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.291+0000 7fa04694c700 1 Processor -- start 2023-12-08T20:34:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.291+0000 7fa04694c700 1 -- start start 2023-12-08T20:34:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.291+0000 7fa04694c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0400fbb40 0x7fa040115860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.291+0000 7fa04694c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa040101b00 0x7fa040115da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.291+0000 7fa04694c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0401163f0 con 0x7fa040101b00 2023-12-08T20:34:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.291+0000 7fa04694c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04010f720 con 0x7fa0400fbb40 2023-12-08T20:34:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.291+0000 7fa03f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa040101b00 0x7fa040115da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.291+0000 7fa03f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa040101b00 0x7fa040115da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40664/0 (socket says 172.21.15.43:40664) 2023-12-08T20:34:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.291+0000 7fa03f7fe700 1 -- 172.21.15.43:0/1324833397 learned_addr learned my addr 172.21.15.43:0/1324833397 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:34:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.291+0000 7fa03ffff700 1 --2- 172.21.15.43:0/1324833397 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0400fbb40 0x7fa040115860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:58.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.292+0000 7fa03f7fe700 1 -- 172.21.15.43:0/1324833397 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0400fbb40 msgr2=0x7fa040115860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:58.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.292+0000 7fa03f7fe700 1 --2- 172.21.15.43:0/1324833397 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0400fbb40 0x7fa040115860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:58.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.292+0000 7fa03f7fe700 1 -- 172.21.15.43:0/1324833397 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa034005040 con 0x7fa040101b00 2023-12-08T20:34:58.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.292+0000 7fa03ffff700 1 --2- 172.21.15.43:0/1324833397 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0400fbb40 0x7fa040115860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:34:58.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.292+0000 7fa03f7fe700 1 --2- 172.21.15.43:0/1324833397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa040101b00 0x7fa040115da0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa03400b3b0 tx=0x7fa034009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:58.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.292+0000 7fa03cff9700 1 -- 172.21.15.43:0/1324833397 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa03400e040 con 0x7fa040101b00 2023-12-08T20:34:58.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.292+0000 7fa04694c700 1 -- 172.21.15.43:0/1324833397 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04010f9a0 con 0x7fa040101b00 2023-12-08T20:34:58.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.292+0000 7fa03cff9700 1 -- 172.21.15.43:0/1324833397 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa034004290 con 0x7fa040101b00 2023-12-08T20:34:58.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.292+0000 7fa03cff9700 1 -- 172.21.15.43:0/1324833397 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa03401c3f0 con 0x7fa040101b00 2023-12-08T20:34:58.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.292+0000 7fa04694c700 1 -- 172.21.15.43:0/1324833397 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04010fee0 con 0x7fa040101b00 2023-12-08T20:34:58.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.293+0000 7fa04694c700 1 -- 172.21.15.43:0/1324833397 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0400734d0 con 0x7fa040101b00 2023-12-08T20:34:58.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.294+0000 7fa03cff9700 1 -- 172.21.15.43:0/1324833397 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fa03400bc50 con 0x7fa040101b00 2023-12-08T20:34:58.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.294+0000 7fa03cff9700 1 --2- 172.21.15.43:0/1324833397 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa02806ce60 0x7fa02806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:34:58.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.294+0000 7fa03cff9700 1 -- 172.21.15.43:0/1324833397 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa03408d740 con 0x7fa040101b00 2023-12-08T20:34:58.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.294+0000 7fa03ffff700 1 --2- 172.21.15.43:0/1324833397 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa02806ce60 0x7fa02806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:34:58.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.295+0000 7fa03ffff700 1 --2- 172.21.15.43:0/1324833397 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa02806ce60 0x7fa02806f310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa030009fd0 tx=0x7fa030009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:34:58.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.299+0000 7fa03cff9700 1 -- 172.21.15.43:0/1324833397 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa03405b180 con 0x7fa040101b00 2023-12-08T20:34:58.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.595+0000 7fa04694c700 1 -- 172.21.15.43:0/1324833397 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa04004bb80 con 0x7fa040101b00 2023-12-08T20:34:58.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.595+0000 7fa03cff9700 1 -- 172.21.15.43:0/1324833397 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+261 (secure 0 0 0) 0x7fa03405ad10 con 0x7fa040101b00 2023-12-08T20:34:58.597 INFO:teuthology.orchestra.run.smithi043.stdout:HEALTH_ERR Upgrade: failed due to an unexpected exception 2023-12-08T20:34:58.597 INFO:teuthology.orchestra.run.smithi043.stdout:[ERR] UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-08T20:34:58.597 INFO:teuthology.orchestra.run.smithi043.stdout: Unexpected exception occurred during upgrade process: osd require-osd-release failed: unrecognized release unknown retval: -22 2023-12-08T20:34:58.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.597+0000 7fa04694c700 1 -- 172.21.15.43:0/1324833397 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa02806ce60 msgr2=0x7fa02806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:58.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.597+0000 7fa04694c700 1 --2- 172.21.15.43:0/1324833397 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa02806ce60 0x7fa02806f310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa030009fd0 tx=0x7fa030009ee0 comp rx=0 tx=0).stop 2023-12-08T20:34:58.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.597+0000 7fa04694c700 1 -- 172.21.15.43:0/1324833397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa040101b00 msgr2=0x7fa040115da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:34:58.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.597+0000 7fa04694c700 1 --2- 172.21.15.43:0/1324833397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa040101b00 0x7fa040115da0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa03400b3b0 tx=0x7fa034009e30 comp rx=0 tx=0).stop 2023-12-08T20:34:58.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.597+0000 7fa04694c700 1 -- 172.21.15.43:0/1324833397 shutdown_connections 2023-12-08T20:34:58.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.597+0000 7fa04694c700 1 --2- 172.21.15.43:0/1324833397 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa02806ce60 0x7fa02806f310 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:58.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.597+0000 7fa04694c700 1 --2- 172.21.15.43:0/1324833397 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0400fbb40 0x7fa040115860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:58.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.597+0000 7fa04694c700 1 --2- 172.21.15.43:0/1324833397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa040101b00 0x7fa040115da0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:34:58.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.597+0000 7fa04694c700 1 -- 172.21.15.43:0/1324833397 >> 172.21.15.43:0/1324833397 conn(0x7fa0400719b0 msgr2=0x7fa0400654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:34:58.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.598+0000 7fa04694c700 1 -- 172.21.15.43:0/1324833397 shutdown_connections 2023-12-08T20:34:58.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:34:58.598+0000 7fa04694c700 1 -- 172.21.15.43:0/1324833397 wait complete. 2023-12-08T20:34:58.840 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:58 smithi043 ceph-mon[219193]: pgmap v145: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:58.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:58 smithi111 ceph-mon[182474]: pgmap v145: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:34:59.020 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph versions' 2023-12-08T20:34:59.321 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:34:59.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:59 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/1324833397' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-08T20:34:59.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:59 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:59.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:59 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:34:59.765 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:34:59 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:59.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:59 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/1324833397' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-08T20:34:59.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:59 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:34:59.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:59 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:34:59.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:34:59 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:35:00.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.487+0000 7fa828f2e700 1 -- 172.21.15.43:0/739901592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa824101b00 msgr2=0x7fa824101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:35:00.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.487+0000 7fa828f2e700 1 --2- 172.21.15.43:0/739901592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa824101b00 0x7fa824101ed0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa814004940 tx=0x7fa814009e30 comp rx=0 tx=0).stop 2023-12-08T20:35:00.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.487+0000 7fa828f2e700 1 -- 172.21.15.43:0/739901592 shutdown_connections 2023-12-08T20:35:00.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.487+0000 7fa828f2e700 1 --2- 172.21.15.43:0/739901592 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8240fbb40 0x7fa8240fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:35:00.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.487+0000 7fa828f2e700 1 --2- 172.21.15.43:0/739901592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa824101b00 0x7fa824101ed0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:35:00.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.487+0000 7fa828f2e700 1 -- 172.21.15.43:0/739901592 >> 172.21.15.43:0/739901592 conn(0x7fa8240719b0 msgr2=0x7fa824071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:35:00.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.487+0000 7fa828f2e700 1 -- 172.21.15.43:0/739901592 shutdown_connections 2023-12-08T20:35:00.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.487+0000 7fa828f2e700 1 -- 172.21.15.43:0/739901592 wait complete. 2023-12-08T20:35:00.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.488+0000 7fa828f2e700 1 Processor -- start 2023-12-08T20:35:00.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.488+0000 7fa828f2e700 1 -- start start 2023-12-08T20:35:00.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.488+0000 7fa828f2e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8240fbb40 0x7fa82410e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:35:00.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.488+0000 7fa828f2e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa824101b00 0x7fa82410ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:35:00.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.488+0000 7fa828f2e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82410f1c0 con 0x7fa824101b00 2023-12-08T20:35:00.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.488+0000 7fa828f2e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82410f300 con 0x7fa8240fbb40 2023-12-08T20:35:00.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.488+0000 7fa821d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa824101b00 0x7fa82410ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:35:00.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.488+0000 7fa821d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa824101b00 0x7fa82410ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43086/0 (socket says 172.21.15.43:43086) 2023-12-08T20:35:00.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.488+0000 7fa821d9b700 1 -- 172.21.15.43:0/3000754732 learned_addr learned my addr 172.21.15.43:0/3000754732 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:35:00.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.488+0000 7fa82259c700 1 --2- 172.21.15.43:0/3000754732 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8240fbb40 0x7fa82410e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:35:00.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.488+0000 7fa821d9b700 1 -- 172.21.15.43:0/3000754732 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8240fbb40 msgr2=0x7fa82410e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:35:00.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.488+0000 7fa821d9b700 1 --2- 172.21.15.43:0/3000754732 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8240fbb40 0x7fa82410e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:35:00.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.488+0000 7fa821d9b700 1 -- 172.21.15.43:0/3000754732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa814005040 con 0x7fa824101b00 2023-12-08T20:35:00.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.489+0000 7fa821d9b700 1 --2- 172.21.15.43:0/3000754732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa824101b00 0x7fa82410ec30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa818002a50 tx=0x7fa8180046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:35:00.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.489+0000 7fa812ffd700 1 -- 172.21.15.43:0/3000754732 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa818007cc0 con 0x7fa824101b00 2023-12-08T20:35:00.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.489+0000 7fa828f2e700 1 -- 172.21.15.43:0/3000754732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa824117660 con 0x7fa824101b00 2023-12-08T20:35:00.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.489+0000 7fa812ffd700 1 -- 172.21.15.43:0/3000754732 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa81800f040 con 0x7fa824101b00 2023-12-08T20:35:00.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.489+0000 7fa812ffd700 1 -- 172.21.15.43:0/3000754732 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa81800d9c0 con 0x7fa824101b00 2023-12-08T20:35:00.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.489+0000 7fa828f2e700 1 -- 172.21.15.43:0/3000754732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa824117b70 con 0x7fa824101b00 2023-12-08T20:35:00.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.490+0000 7fa828f2e700 1 -- 172.21.15.43:0/3000754732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa824103fb0 con 0x7fa824101b00 2023-12-08T20:35:00.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.490+0000 7fa812ffd700 1 -- 172.21.15.43:0/3000754732 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fa81800db20 con 0x7fa824101b00 2023-12-08T20:35:00.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.491+0000 7fa812ffd700 1 --2- 172.21.15.43:0/3000754732 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa80c06ce70 0x7fa80c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:35:00.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.491+0000 7fa812ffd700 1 -- 172.21.15.43:0/3000754732 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa81808bf90 con 0x7fa824101b00 2023-12-08T20:35:00.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.491+0000 7fa82259c700 1 --2- 172.21.15.43:0/3000754732 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa80c06ce70 0x7fa80c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:35:00.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.491+0000 7fa82259c700 1 --2- 172.21.15.43:0/3000754732 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa80c06ce70 0x7fa80c06f320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa8140043d0 tx=0x7fa814009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:35:00.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.496+0000 7fa812ffd700 1 -- 172.21.15.43:0/3000754732 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa818055ec0 con 0x7fa824101b00 2023-12-08T20:35:00.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.790+0000 7fa828f2e700 1 -- 172.21.15.43:0/3000754732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa8240734d0 con 0x7fa824101b00 2023-12-08T20:35:00.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.791+0000 7fa812ffd700 1 -- 172.21.15.43:0/3000754732 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7fa8180594e0 con 0x7fa824101b00 2023-12-08T20:35:00.793 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:35:00.793 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": { 2023-12-08T20:35:00.793 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:35:00.793 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:35:00.793 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": { 2023-12-08T20:35:00.793 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:35:00.793 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:35:00.793 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": { 2023-12-08T20:35:00.793 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 6 2023-12-08T20:35:00.793 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:35:00.793 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2023-12-08T20:35:00.793 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-08T20:35:00.793 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:35:00.793 INFO:teuthology.orchestra.run.smithi043.stdout: "overall": { 2023-12-08T20:35:00.794 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4, 2023-12-08T20:35:00.794 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 10 2023-12-08T20:35:00.794 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-12-08T20:35:00.794 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:35:00.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.793+0000 7fa828f2e700 1 -- 172.21.15.43:0/3000754732 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa80c06ce70 msgr2=0x7fa80c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:35:00.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.793+0000 7fa828f2e700 1 --2- 172.21.15.43:0/3000754732 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa80c06ce70 0x7fa80c06f320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa8140043d0 tx=0x7fa814009e30 comp rx=0 tx=0).stop 2023-12-08T20:35:00.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.793+0000 7fa828f2e700 1 -- 172.21.15.43:0/3000754732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa824101b00 msgr2=0x7fa82410ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:35:00.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.793+0000 7fa828f2e700 1 --2- 172.21.15.43:0/3000754732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa824101b00 0x7fa82410ec30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa818002a50 tx=0x7fa8180046b0 comp rx=0 tx=0).stop 2023-12-08T20:35:00.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.793+0000 7fa828f2e700 1 -- 172.21.15.43:0/3000754732 shutdown_connections 2023-12-08T20:35:00.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.793+0000 7fa828f2e700 1 --2- 172.21.15.43:0/3000754732 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fa80c06ce70 0x7fa80c06f320 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:35:00.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.793+0000 7fa828f2e700 1 --2- 172.21.15.43:0/3000754732 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8240fbb40 0x7fa82410e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:35:00.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.793+0000 7fa828f2e700 1 --2- 172.21.15.43:0/3000754732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa824101b00 0x7fa82410ec30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:35:00.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.793+0000 7fa828f2e700 1 -- 172.21.15.43:0/3000754732 >> 172.21.15.43:0/3000754732 conn(0x7fa8240719b0 msgr2=0x7fa8240fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:35:00.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.793+0000 7fa828f2e700 1 -- 172.21.15.43:0/3000754732 shutdown_connections 2023-12-08T20:35:00.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:35:00.793+0000 7fa828f2e700 1 -- 172.21.15.43:0/3000754732 wait complete. 2023-12-08T20:35:00.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:00 smithi111 ceph-mon[182474]: pgmap v146: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:00.973 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:00 smithi043 ceph-mon[219193]: pgmap v146: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:01.186 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2023-12-08T20:35:01.488 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:35:01.875 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:01 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/3000754732' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:35:01.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:01 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/3000754732' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:35:02.651 INFO:teuthology.orchestra.run.smithi043.stdout:wait for servicemap items w/ changing names to refresh 2023-12-08T20:35:02.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:02 smithi111 ceph-mon[182474]: pgmap v147: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:02.985 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:02 smithi043 ceph-mon[219193]: pgmap v147: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:03.021 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'sleep 60' 2023-12-08T20:35:03.324 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:35:05.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:04 smithi111 ceph-mon[182474]: pgmap v148: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:05.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:04 smithi043 ceph-mon[219193]: pgmap v148: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:06.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:06 smithi111 ceph-mon[182474]: pgmap v149: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:07.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:06 smithi043 ceph-mon[219193]: pgmap v149: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:09.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:08 smithi111 ceph-mon[182474]: pgmap v150: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:09.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:08 smithi043 ceph-mon[219193]: pgmap v150: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:11.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:10 smithi111 ceph-mon[182474]: pgmap v151: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:11.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:10 smithi043 ceph-mon[219193]: pgmap v151: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:13.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:12 smithi111 ceph-mon[182474]: pgmap v152: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:13.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:12 smithi043 ceph-mon[219193]: pgmap v152: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:15.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:14 smithi111 ceph-mon[182474]: pgmap v153: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:15.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:14 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:35:15.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:14 smithi043 ceph-mon[219193]: pgmap v153: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:15.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:35:16.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:16 smithi111 ceph-mon[182474]: pgmap v154: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:17.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:16 smithi043 ceph-mon[219193]: pgmap v154: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:19.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:18 smithi111 ceph-mon[182474]: pgmap v155: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:19.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:18 smithi043 ceph-mon[219193]: pgmap v155: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:21.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:20 smithi111 ceph-mon[182474]: pgmap v156: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:21.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:20 smithi043 ceph-mon[219193]: pgmap v156: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:23.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:22 smithi111 ceph-mon[182474]: pgmap v157: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:23.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:22 smithi043 ceph-mon[219193]: pgmap v157: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:25.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:24 smithi111 ceph-mon[182474]: pgmap v158: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:25.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:24 smithi043 ceph-mon[219193]: pgmap v158: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:26.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:26 smithi111 ceph-mon[182474]: pgmap v159: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:27.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:26 smithi043 ceph-mon[219193]: pgmap v159: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:29.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:28 smithi111 ceph-mon[182474]: pgmap v160: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:29.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:28 smithi043 ceph-mon[219193]: pgmap v160: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:30.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:29 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:35:30.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:29 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:35:31.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:30 smithi111 ceph-mon[182474]: pgmap v161: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:31.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:30 smithi043 ceph-mon[219193]: pgmap v161: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:33.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:32 smithi111 ceph-mon[182474]: pgmap v162: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:33.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:32 smithi043 ceph-mon[219193]: pgmap v162: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:35.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:34 smithi111 ceph-mon[182474]: pgmap v163: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:35.266 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:34 smithi043 ceph-mon[219193]: pgmap v163: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:36.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:36 smithi111 ceph-mon[182474]: pgmap v164: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:37.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:36 smithi043 ceph-mon[219193]: pgmap v164: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:39.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:38 smithi111 ceph-mon[182474]: pgmap v165: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:39.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:38 smithi043 ceph-mon[219193]: pgmap v165: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:41.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:40 smithi111 ceph-mon[182474]: pgmap v166: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:41.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:40 smithi043 ceph-mon[219193]: pgmap v166: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:43.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:42 smithi111 ceph-mon[182474]: pgmap v167: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:43.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:42 smithi043 ceph-mon[219193]: pgmap v167: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:45.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:44 smithi111 ceph-mon[182474]: pgmap v168: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:45.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:35:45.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:35:45.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:35:45.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:35:45.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:44 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:35:45.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:44 smithi043 ceph-mon[219193]: pgmap v168: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:45.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-08T20:35:45.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:35:45.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-08T20:35:45.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-08T20:35:45.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:44 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' 2023-12-08T20:35:46.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:46 smithi111 ceph-mon[182474]: pgmap v169: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:47.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:46 smithi043 ceph-mon[219193]: pgmap v169: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:49.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:48 smithi111 ceph-mon[182474]: pgmap v170: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:49.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:48 smithi043 ceph-mon[219193]: pgmap v170: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:51.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:50 smithi111 ceph-mon[182474]: pgmap v171: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:51.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:50 smithi043 ceph-mon[219193]: pgmap v171: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:53.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:52 smithi111 ceph-mon[182474]: pgmap v172: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:53.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:52 smithi043 ceph-mon[219193]: pgmap v172: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:55.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:54 smithi111 ceph-mon[182474]: pgmap v173: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:55.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:54 smithi043 ceph-mon[219193]: pgmap v173: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:56.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:56 smithi111 ceph-mon[182474]: pgmap v174: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:57.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:56 smithi043 ceph-mon[219193]: pgmap v174: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:59.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:58 smithi111 ceph-mon[182474]: pgmap v175: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:35:59.265 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:58 smithi043 ceph-mon[219193]: pgmap v175: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:36:00.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:35:59 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:36:00.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:35:59 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:36:01.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:00 smithi111 ceph-mon[182474]: pgmap v176: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:36:01.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:00 smithi043 ceph-mon[219193]: pgmap v176: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:36:03.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:02 smithi111 ceph-mon[182474]: pgmap v177: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:36:03.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:02 smithi043 ceph-mon[219193]: pgmap v177: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:36:05.018 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph orch ps' 2023-12-08T20:36:05.218 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:04 smithi111 ceph-mon[182474]: pgmap v178: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:36:05.264 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:04 smithi043 ceph-mon[219193]: pgmap v178: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:36:05.321 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:36:06.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.578+0000 7f0f408d6700 1 -- 172.21.15.43:0/2470059588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f3c1035a0 msgr2=0x7f0f3c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:06.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.578+0000 7f0f408d6700 1 --2- 172.21.15.43:0/2470059588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f3c1035a0 0x7f0f3c0fcc10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c004940 tx=0x7f0f2c009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:06.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.578+0000 7f0f408d6700 1 -- 172.21.15.43:0/2470059588 shutdown_connections 2023-12-08T20:36:06.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.578+0000 7f0f408d6700 1 --2- 172.21.15.43:0/2470059588 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f3c1035a0 0x7f0f3c0fcc10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:06.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.578+0000 7f0f408d6700 1 --2- 172.21.15.43:0/2470059588 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f3c102c00 0x7f0f3c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:06.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.578+0000 7f0f408d6700 1 -- 172.21.15.43:0/2470059588 >> 172.21.15.43:0/2470059588 conn(0x7f0f3c0f8790 msgr2=0x7f0f3c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:06.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.578+0000 7f0f408d6700 1 -- 172.21.15.43:0/2470059588 shutdown_connections 2023-12-08T20:36:06.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.578+0000 7f0f408d6700 1 -- 172.21.15.43:0/2470059588 wait complete. 2023-12-08T20:36:06.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.579+0000 7f0f408d6700 1 Processor -- start 2023-12-08T20:36:06.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.579+0000 7f0f408d6700 1 -- start start 2023-12-08T20:36:06.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.579+0000 7f0f408d6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f3c102c00 0x7f0f3c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:06.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.579+0000 7f0f408d6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f3c1035a0 0x7f0f3c0704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:06.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.579+0000 7f0f408d6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c070af0 con 0x7f0f3c102c00 2023-12-08T20:36:06.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.579+0000 7f0f408d6700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c070c60 con 0x7f0f3c1035a0 2023-12-08T20:36:06.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.579+0000 7f0f3a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f3c102c00 0x7f0f3c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:06.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.579+0000 7f0f3a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f3c102c00 0x7f0f3c06ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49948/0 (socket says 172.21.15.43:49948) 2023-12-08T20:36:06.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.579+0000 7f0f3a59c700 1 -- 172.21.15.43:0/3312351312 learned_addr learned my addr 172.21.15.43:0/3312351312 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:36:06.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.580+0000 7f0f39d9b700 1 --2- 172.21.15.43:0/3312351312 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f3c1035a0 0x7f0f3c0704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:06.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.580+0000 7f0f3a59c700 1 -- 172.21.15.43:0/3312351312 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f3c1035a0 msgr2=0x7f0f3c0704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:06.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.580+0000 7f0f3a59c700 1 --2- 172.21.15.43:0/3312351312 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f3c1035a0 0x7f0f3c0704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:06.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.580+0000 7f0f3a59c700 1 -- 172.21.15.43:0/3312351312 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2c005040 con 0x7f0f3c102c00 2023-12-08T20:36:06.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.580+0000 7f0f3a59c700 1 --2- 172.21.15.43:0/3312351312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f3c102c00 0x7f0f3c06ff40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0f24002a50 tx=0x7f0f240046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:06.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.580+0000 7f0f32ffd700 1 -- 172.21.15.43:0/3312351312 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f24007cc0 con 0x7f0f3c102c00 2023-12-08T20:36:06.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.580+0000 7f0f32ffd700 1 -- 172.21.15.43:0/3312351312 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0f2400f040 con 0x7f0f3c102c00 2023-12-08T20:36:06.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.580+0000 7f0f32ffd700 1 -- 172.21.15.43:0/3312351312 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f2400d9c0 con 0x7f0f3c102c00 2023-12-08T20:36:06.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.580+0000 7f0f408d6700 1 -- 172.21.15.43:0/3312351312 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3c119880 con 0x7f0f3c102c00 2023-12-08T20:36:06.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.580+0000 7f0f408d6700 1 -- 172.21.15.43:0/3312351312 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3c119dc0 con 0x7f0f3c102c00 2023-12-08T20:36:06.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.581+0000 7f0f408d6700 1 -- 172.21.15.43:0/3312351312 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3c1050d0 con 0x7f0f3c102c00 2023-12-08T20:36:06.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.582+0000 7f0f32ffd700 1 -- 172.21.15.43:0/3312351312 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f0f2400db20 con 0x7f0f3c102c00 2023-12-08T20:36:06.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.582+0000 7f0f32ffd700 1 --2- 172.21.15.43:0/3312351312 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f0f2806ce60 0x7f0f2806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:06.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.582+0000 7f0f32ffd700 1 -- 172.21.15.43:0/3312351312 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f0f2408bfb0 con 0x7f0f3c102c00 2023-12-08T20:36:06.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.582+0000 7f0f39d9b700 1 --2- 172.21.15.43:0/3312351312 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f0f2806ce60 0x7f0f2806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:06.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.583+0000 7f0f39d9b700 1 --2- 172.21.15.43:0/3312351312 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f0f2806ce60 0x7f0f2806f310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c071940 tx=0x7f0f2c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:06.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.587+0000 7f0f32ffd700 1 -- 172.21.15.43:0/3312351312 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0f24055ee0 con 0x7f0f3c102c00 2023-12-08T20:36:06.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:06 smithi043 ceph-mon[219193]: pgmap v179: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:36:06.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.806+0000 7f0f408d6700 1 -- 172.21.15.43:0/3312351312 --> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f3c071680 con 0x7f0f2806ce60 2023-12-08T20:36:06.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.818+0000 7f0f32ffd700 1 -- 172.21.15.43:0/3312351312 <== mgr.34104 v2:172.21.15.43:6800/2090372060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0f3c071680 con 0x7f0f2806ce60 2023-12-08T20:36:06.820 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-08T20:36:06.820 INFO:teuthology.orchestra.run.smithi043.stdout:alertmanager.smithi043 smithi043 *:9093,9094 running (6m) 2m ago 14m 26.4M - 0.25.0 c8568f914cd2 d4a6cd00c86b 2023-12-08T20:36:06.820 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi043 smithi043 running (4m) 2m ago 14m 7482k - 19.0.0-44-g9dcc13bb f28f2b94f153 f570eddb8e8a 2023-12-08T20:36:06.820 INFO:teuthology.orchestra.run.smithi043.stdout:crash.smithi111 smithi111 running (4m) 86s ago 13m 7448k - 19.0.0-44-g9dcc13bb f28f2b94f153 b2013e24b94e 2023-12-08T20:36:06.821 INFO:teuthology.orchestra.run.smithi043.stdout:grafana.smithi043 smithi043 *:3000 running (6m) 2m ago 14m 84.4M - 9.4.7 954c08fa6188 8f55491a980b 2023-12-08T20:36:06.821 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.akrjef smithi043 running (10m) 2m ago 10m 18.9M - 17.2.7-119-ge2143d99 f761b6e42225 1c0cb8d34ef8 2023-12-08T20:36:06.821 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi043.pjmszb smithi043 running (10m) 2m ago 10m 7154M - 17.2.7-119-ge2143d99 f761b6e42225 d7eee0c78093 2023-12-08T20:36:06.821 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.svpasm smithi111 running (10m) 86s ago 10m 17.0M - 17.2.7-119-ge2143d99 f761b6e42225 657d4d1cf4b2 2023-12-08T20:36:06.821 INFO:teuthology.orchestra.run.smithi043.stdout:mds.cephfs.smithi111.veeegc smithi111 running (10m) 86s ago 10m 3707M - 17.2.7-119-ge2143d99 f761b6e42225 31f794a388ab 2023-12-08T20:36:06.821 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi043.hqcdcm smithi043 *:8443,9283,8765 running (7m) 2m ago 15m 510M - 19.0.0-44-g9dcc13bb f28f2b94f153 14e91c1dac64 2023-12-08T20:36:06.821 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.smithi111.mtcffu smithi111 *:8443,9283,8765 running (7m) 86s ago 13m 451M - 19.0.0-44-g9dcc13bb f28f2b94f153 56f4290c6db5 2023-12-08T20:36:06.821 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi043 smithi043 running (5m) 2m ago 15m 61.7M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 3597e3a60ebc 2023-12-08T20:36:06.821 INFO:teuthology.orchestra.run.smithi043.stdout:mon.smithi111 smithi111 running (4m) 86s ago 13m 53.1M 2048M 19.0.0-44-g9dcc13bb f28f2b94f153 528aa182165f 2023-12-08T20:36:06.821 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi043 smithi043 *:9100 running (6m) 2m ago 14m 17.4M - 1.5.0 0da6a335fe13 0959b44d9972 2023-12-08T20:36:06.822 INFO:teuthology.orchestra.run.smithi043.stdout:node-exporter.smithi111 smithi111 *:9100 running (6m) 86s ago 13m 18.1M - 1.5.0 0da6a335fe13 10fe4fdb23d0 2023-12-08T20:36:06.822 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (3m) 2m ago 12m 121M 1570M 19.0.0-44-g9dcc13bb f28f2b94f153 298e9b98d7a4 2023-12-08T20:36:06.822 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi043 running (3m) 2m ago 12m 127M 1570M 19.0.0-44-g9dcc13bb f28f2b94f153 1ad10def08c3 2023-12-08T20:36:06.822 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi043 running (2m) 2m ago 12m 14.9M 1570M 19.0.0-44-g9dcc13bb f28f2b94f153 0b56e93b08fc 2023-12-08T20:36:06.822 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi111 running (2m) 86s ago 12m 141M 2592M 19.0.0-44-g9dcc13bb f28f2b94f153 75c0817b18fc 2023-12-08T20:36:06.822 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi111 running (116s) 86s ago 11m 123M 2592M 19.0.0-44-g9dcc13bb f28f2b94f153 b9e4953b16d6 2023-12-08T20:36:06.822 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi111 running (88s) 86s ago 11m 12.6M 2592M 19.0.0-44-g9dcc13bb f28f2b94f153 156555b2e09c 2023-12-08T20:36:06.822 INFO:teuthology.orchestra.run.smithi043.stdout:prometheus.smithi043 smithi043 *:9095 running (6m) 2m ago 13m 64.7M - 2.43.0 a07b618ecd1d d95914ec88d8 2023-12-08T20:36:06.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.820+0000 7f0f408d6700 1 -- 172.21.15.43:0/3312351312 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f0f2806ce60 msgr2=0x7f0f2806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:06.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.820+0000 7f0f408d6700 1 --2- 172.21.15.43:0/3312351312 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f0f2806ce60 0x7f0f2806f310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c071940 tx=0x7f0f2c009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:06.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.820+0000 7f0f408d6700 1 -- 172.21.15.43:0/3312351312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f3c102c00 msgr2=0x7f0f3c06ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:06.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.820+0000 7f0f408d6700 1 --2- 172.21.15.43:0/3312351312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f3c102c00 0x7f0f3c06ff40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0f24002a50 tx=0x7f0f240046b0 comp rx=0 tx=0).stop 2023-12-08T20:36:06.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.820+0000 7f0f408d6700 1 -- 172.21.15.43:0/3312351312 shutdown_connections 2023-12-08T20:36:06.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.820+0000 7f0f408d6700 1 --2- 172.21.15.43:0/3312351312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f3c102c00 0x7f0f3c06ff40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:06.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.820+0000 7f0f408d6700 1 --2- 172.21.15.43:0/3312351312 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f0f2806ce60 0x7f0f2806f310 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:06.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.820+0000 7f0f408d6700 1 --2- 172.21.15.43:0/3312351312 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f3c1035a0 0x7f0f3c0704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:06.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.820+0000 7f0f408d6700 1 -- 172.21.15.43:0/3312351312 >> 172.21.15.43:0/3312351312 conn(0x7f0f3c0f8790 msgr2=0x7f0f3c0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:06.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.820+0000 7f0f408d6700 1 -- 172.21.15.43:0/3312351312 shutdown_connections 2023-12-08T20:36:06.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:06.820+0000 7f0f408d6700 1 -- 172.21.15.43:0/3312351312 wait complete. 2023-12-08T20:36:06.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:06 smithi111 ceph-mon[182474]: pgmap v179: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:36:07.326 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph versions' 2023-12-08T20:36:07.631 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:36:07.760 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:07 smithi043 ceph-mon[219193]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:36:07.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:07 smithi111 ceph-mon[182474]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-08T20:36:08.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.737+0000 7fd33aa30700 1 -- 172.21.15.43:0/941052687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3340fbb40 msgr2=0x7fd3340fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:08.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.737+0000 7fd33aa30700 1 --2- 172.21.15.43:0/941052687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3340fbb40 0x7fd3340fbfb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd328004940 tx=0x7fd328009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:08.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.737+0000 7fd33aa30700 1 -- 172.21.15.43:0/941052687 shutdown_connections 2023-12-08T20:36:08.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.737+0000 7fd33aa30700 1 --2- 172.21.15.43:0/941052687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3340fbb40 0x7fd3340fbfb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:08.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.737+0000 7fd33aa30700 1 --2- 172.21.15.43:0/941052687 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd334101b00 0x7fd334101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:08.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.737+0000 7fd33aa30700 1 -- 172.21.15.43:0/941052687 >> 172.21.15.43:0/941052687 conn(0x7fd3340719b0 msgr2=0x7fd334071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:08.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.738+0000 7fd33aa30700 1 -- 172.21.15.43:0/941052687 shutdown_connections 2023-12-08T20:36:08.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.738+0000 7fd33aa30700 1 -- 172.21.15.43:0/941052687 wait complete. 2023-12-08T20:36:08.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.738+0000 7fd33aa30700 1 Processor -- start 2023-12-08T20:36:08.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.738+0000 7fd33aa30700 1 -- start start 2023-12-08T20:36:08.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.739+0000 7fd33aa30700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3340fbb40 0x7fd3340fdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:08.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.739+0000 7fd33aa30700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd334101b00 0x7fd3340fe0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.739+0000 7fd33aa30700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3340fe6a0 con 0x7fd3340fbb40 2023-12-08T20:36:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.739+0000 7fd33aa30700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3340fe810 con 0x7fd334101b00 2023-12-08T20:36:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.739+0000 7fd333fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3340fbb40 0x7fd3340fdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.739+0000 7fd333fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3340fbb40 0x7fd3340fdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49964/0 (socket says 172.21.15.43:49964) 2023-12-08T20:36:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.739+0000 7fd333fff700 1 -- 172.21.15.43:0/2019209233 learned_addr learned my addr 172.21.15.43:0/2019209233 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:36:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.739+0000 7fd3337fe700 1 --2- 172.21.15.43:0/2019209233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd334101b00 0x7fd3340fe0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.739+0000 7fd333fff700 1 -- 172.21.15.43:0/2019209233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd334101b00 msgr2=0x7fd3340fe0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.739+0000 7fd333fff700 1 --2- 172.21.15.43:0/2019209233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd334101b00 0x7fd3340fe0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.739+0000 7fd333fff700 1 -- 172.21.15.43:0/2019209233 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd328005040 con 0x7fd3340fbb40 2023-12-08T20:36:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.739+0000 7fd333fff700 1 --2- 172.21.15.43:0/2019209233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3340fbb40 0x7fd3340fdb60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd324002a50 tx=0x7fd3240046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.740+0000 7fd330ff9700 1 -- 172.21.15.43:0/2019209233 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd324007cc0 con 0x7fd3340fbb40 2023-12-08T20:36:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.740+0000 7fd33aa30700 1 -- 172.21.15.43:0/2019209233 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3341198e0 con 0x7fd3340fbb40 2023-12-08T20:36:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.740+0000 7fd330ff9700 1 -- 172.21.15.43:0/2019209233 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd32400f040 con 0x7fd3340fbb40 2023-12-08T20:36:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.740+0000 7fd330ff9700 1 -- 172.21.15.43:0/2019209233 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd32400d9c0 con 0x7fd3340fbb40 2023-12-08T20:36:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.740+0000 7fd33aa30700 1 -- 172.21.15.43:0/2019209233 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd334119d90 con 0x7fd3340fbb40 2023-12-08T20:36:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.741+0000 7fd33aa30700 1 -- 172.21.15.43:0/2019209233 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3340734d0 con 0x7fd3340fbb40 2023-12-08T20:36:08.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.741+0000 7fd330ff9700 1 -- 172.21.15.43:0/2019209233 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fd32400db20 con 0x7fd3340fbb40 2023-12-08T20:36:08.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.742+0000 7fd330ff9700 1 --2- 172.21.15.43:0/2019209233 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fd31c06ce60 0x7fd31c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:08.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.742+0000 7fd330ff9700 1 -- 172.21.15.43:0/2019209233 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd32408bfb0 con 0x7fd3340fbb40 2023-12-08T20:36:08.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.742+0000 7fd3337fe700 1 --2- 172.21.15.43:0/2019209233 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fd31c06ce60 0x7fd31c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:08.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.742+0000 7fd3337fe700 1 --2- 172.21.15.43:0/2019209233 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fd31c06ce60 0x7fd31c06f310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd3340ffc70 tx=0x7fd328009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:08.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:08.747+0000 7fd330ff9700 1 -- 172.21.15.43:0/2019209233 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd324055ee0 con 0x7fd3340fbb40 2023-12-08T20:36:08.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:08 smithi043 ceph-mon[219193]: pgmap v180: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:36:08.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:08 smithi111 ceph-mon[182474]: pgmap v180: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:36:09.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:09.041+0000 7fd33aa30700 1 -- 172.21.15.43:0/2019209233 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd3340ff3a0 con 0x7fd3340fbb40 2023-12-08T20:36:09.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:09.042+0000 7fd330ff9700 1 -- 172.21.15.43:0/2019209233 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7fd324059500 con 0x7fd3340fbb40 2023-12-08T20:36:09.044 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-12-08T20:36:09.044 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": { 2023-12-08T20:36:09.044 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:36:09.044 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:36:09.044 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": { 2023-12-08T20:36:09.044 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 2 2023-12-08T20:36:09.044 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:36:09.044 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": { 2023-12-08T20:36:09.044 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 6 2023-12-08T20:36:09.044 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:36:09.045 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2023-12-08T20:36:09.045 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4 2023-12-08T20:36:09.045 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-12-08T20:36:09.045 INFO:teuthology.orchestra.run.smithi043.stdout: "overall": { 2023-12-08T20:36:09.045 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 17.2.7-119-ge2143d99 (e2143d99877e7c4078bd3ef71a36a87e1b0058e4) quincy (stable)": 4, 2023-12-08T20:36:09.045 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph version 19.0.0-44-g9dcc13bb (9dcc13bb80dcc1cdea72b04d80505b4649a2b882) reef (dev)": 10 2023-12-08T20:36:09.045 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-12-08T20:36:09.045 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-12-08T20:36:09.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:09.044+0000 7fd33aa30700 1 -- 172.21.15.43:0/2019209233 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fd31c06ce60 msgr2=0x7fd31c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:09.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:09.044+0000 7fd33aa30700 1 --2- 172.21.15.43:0/2019209233 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fd31c06ce60 0x7fd31c06f310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd3340ffc70 tx=0x7fd328009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:09.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:09.044+0000 7fd33aa30700 1 -- 172.21.15.43:0/2019209233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3340fbb40 msgr2=0x7fd3340fdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:09.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:09.044+0000 7fd33aa30700 1 --2- 172.21.15.43:0/2019209233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3340fbb40 0x7fd3340fdb60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd324002a50 tx=0x7fd3240046b0 comp rx=0 tx=0).stop 2023-12-08T20:36:09.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:09.044+0000 7fd33aa30700 1 -- 172.21.15.43:0/2019209233 shutdown_connections 2023-12-08T20:36:09.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:09.044+0000 7fd33aa30700 1 --2- 172.21.15.43:0/2019209233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3340fbb40 0x7fd3340fdb60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:09.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:09.044+0000 7fd33aa30700 1 --2- 172.21.15.43:0/2019209233 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fd31c06ce60 0x7fd31c06f310 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:09.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:09.044+0000 7fd33aa30700 1 --2- 172.21.15.43:0/2019209233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd334101b00 0x7fd3340fe0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:09.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:09.044+0000 7fd33aa30700 1 -- 172.21.15.43:0/2019209233 >> 172.21.15.43:0/2019209233 conn(0x7fd3340719b0 msgr2=0x7fd3340ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:09.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:09.044+0000 7fd33aa30700 1 -- 172.21.15.43:0/2019209233 shutdown_connections 2023-12-08T20:36:09.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:09.044+0000 7fd33aa30700 1 -- 172.21.15.43:0/2019209233 wait complete. 2023-12-08T20:36:09.459 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2023-12-08T20:36:09.764 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/mon.smithi043/config 2023-12-08T20:36:09.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:09 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/2019209233' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:36:09.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:09 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/2019209233' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:36:10.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:10 smithi043 ceph-mon[219193]: pgmap v181: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:36:10.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:10 smithi111 ceph-mon[182474]: pgmap v181: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:36:11.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.131+0000 7fcb3578a700 1 -- 172.21.15.43:0/1068595428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb30101b00 msgr2=0x7fcb30101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:11.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.131+0000 7fcb3578a700 1 --2- 172.21.15.43:0/1068595428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb30101b00 0x7fcb30101ed0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcb20004940 tx=0x7fcb20009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:11.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.131+0000 7fcb3578a700 1 -- 172.21.15.43:0/1068595428 shutdown_connections 2023-12-08T20:36:11.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.131+0000 7fcb3578a700 1 --2- 172.21.15.43:0/1068595428 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb300fbb40 0x7fcb300fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:11.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.131+0000 7fcb3578a700 1 --2- 172.21.15.43:0/1068595428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb30101b00 0x7fcb30101ed0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:11.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.131+0000 7fcb3578a700 1 -- 172.21.15.43:0/1068595428 >> 172.21.15.43:0/1068595428 conn(0x7fcb300f76c0 msgr2=0x7fcb300f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:11.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.131+0000 7fcb3578a700 1 -- 172.21.15.43:0/1068595428 shutdown_connections 2023-12-08T20:36:11.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.131+0000 7fcb3578a700 1 -- 172.21.15.43:0/1068595428 wait complete. 2023-12-08T20:36:11.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.132+0000 7fcb3578a700 1 Processor -- start 2023-12-08T20:36:11.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.132+0000 7fcb3578a700 1 -- start start 2023-12-08T20:36:11.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.132+0000 7fcb3578a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb300fbb40 0x7fcb3010e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:11.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.132+0000 7fcb3578a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb30101b00 0x7fcb3010ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:11.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.133+0000 7fcb3578a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3010f150 con 0x7fcb300fbb40 2023-12-08T20:36:11.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.133+0000 7fcb3578a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3010f290 con 0x7fcb30101b00 2023-12-08T20:36:11.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.133+0000 7fcb2effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb300fbb40 0x7fcb3010e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:11.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.133+0000 7fcb2effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb300fbb40 0x7fcb3010e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58724/0 (socket says 172.21.15.43:58724) 2023-12-08T20:36:11.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.133+0000 7fcb2effd700 1 -- 172.21.15.43:0/721553644 learned_addr learned my addr 172.21.15.43:0/721553644 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:36:11.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.133+0000 7fcb2e7fc700 1 --2- 172.21.15.43:0/721553644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb30101b00 0x7fcb3010ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:11.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.133+0000 7fcb2effd700 1 -- 172.21.15.43:0/721553644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb30101b00 msgr2=0x7fcb3010ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:11.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.133+0000 7fcb2effd700 1 --2- 172.21.15.43:0/721553644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb30101b00 0x7fcb3010ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:11.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.133+0000 7fcb2effd700 1 -- 172.21.15.43:0/721553644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb20005040 con 0x7fcb300fbb40 2023-12-08T20:36:11.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.133+0000 7fcb2effd700 1 --2- 172.21.15.43:0/721553644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb300fbb40 0x7fcb3010e680 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcb20008d80 tx=0x7fcb20009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:11.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.133+0000 7fcb177fe700 1 -- 172.21.15.43:0/721553644 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb2000e030 con 0x7fcb300fbb40 2023-12-08T20:36:11.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.133+0000 7fcb3578a700 1 -- 172.21.15.43:0/721553644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb30117590 con 0x7fcb300fbb40 2023-12-08T20:36:11.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.133+0000 7fcb177fe700 1 -- 172.21.15.43:0/721553644 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcb20004290 con 0x7fcb300fbb40 2023-12-08T20:36:11.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.133+0000 7fcb177fe700 1 -- 172.21.15.43:0/721553644 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb2001cda0 con 0x7fcb300fbb40 2023-12-08T20:36:11.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.134+0000 7fcb3578a700 1 -- 172.21.15.43:0/721553644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb30117aa0 con 0x7fcb300fbb40 2023-12-08T20:36:11.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.134+0000 7fcb3578a700 1 -- 172.21.15.43:0/721553644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb30103fb0 con 0x7fcb300fbb40 2023-12-08T20:36:11.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.135+0000 7fcb177fe700 1 -- 172.21.15.43:0/721553644 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fcb2001c600 con 0x7fcb300fbb40 2023-12-08T20:36:11.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.136+0000 7fcb177fe700 1 --2- 172.21.15.43:0/721553644 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fcb1806ce70 0x7fcb1806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:11.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.136+0000 7fcb177fe700 1 -- 172.21.15.43:0/721553644 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fcb2008db80 con 0x7fcb300fbb40 2023-12-08T20:36:11.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.136+0000 7fcb2e7fc700 1 --2- 172.21.15.43:0/721553644 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fcb1806ce70 0x7fcb1806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:11.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.136+0000 7fcb2e7fc700 1 --2- 172.21.15.43:0/721553644 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fcb1806ce70 0x7fcb1806f320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcb300666c0 tx=0x7fcb2400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:11.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.141+0000 7fcb177fe700 1 -- 172.21.15.43:0/721553644 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fcb20057a90 con 0x7fcb300fbb40 2023-12-08T20:36:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.439+0000 7fcb3578a700 1 -- 172.21.15.43:0/721553644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcb30066400 con 0x7fcb300fbb40 2023-12-08T20:36:11.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.440+0000 7fcb177fe700 1 -- 172.21.15.43:0/721553644 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7fcb2005b0b0 con 0x7fcb300fbb40 2023-12-08T20:36:11.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.442+0000 7fcb3578a700 1 -- 172.21.15.43:0/721553644 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fcb1806ce70 msgr2=0x7fcb1806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:11.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.442+0000 7fcb3578a700 1 --2- 172.21.15.43:0/721553644 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fcb1806ce70 0x7fcb1806f320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcb300666c0 tx=0x7fcb2400b040 comp rx=0 tx=0).stop 2023-12-08T20:36:11.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.442+0000 7fcb3578a700 1 -- 172.21.15.43:0/721553644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb300fbb40 msgr2=0x7fcb3010e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:11.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.442+0000 7fcb3578a700 1 --2- 172.21.15.43:0/721553644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb300fbb40 0x7fcb3010e680 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcb20008d80 tx=0x7fcb20009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:11.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.442+0000 7fcb3578a700 1 -- 172.21.15.43:0/721553644 shutdown_connections 2023-12-08T20:36:11.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.442+0000 7fcb3578a700 1 --2- 172.21.15.43:0/721553644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb300fbb40 0x7fcb3010e680 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:11.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.442+0000 7fcb3578a700 1 --2- 172.21.15.43:0/721553644 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fcb1806ce70 0x7fcb1806f320 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:11.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.442+0000 7fcb3578a700 1 --2- 172.21.15.43:0/721553644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb30101b00 0x7fcb3010ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:11.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.442+0000 7fcb3578a700 1 -- 172.21.15.43:0/721553644 >> 172.21.15.43:0/721553644 conn(0x7fcb300f76c0 msgr2=0x7fcb300f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:11.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.442+0000 7fcb3578a700 1 -- 172.21.15.43:0/721553644 shutdown_connections 2023-12-08T20:36:11.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:11.442+0000 7fcb3578a700 1 -- 172.21.15.43:0/721553644 wait complete. 2023-12-08T20:36:11.456 INFO:teuthology.orchestra.run.smithi043.stdout:false 2023-12-08T20:36:11.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:11 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/721553644' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:36:11.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:36:11.850 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi043 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-08T20:36:11.931 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=33da4b1a555a4b6296cd3b8bf02c6493 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_ceph_ceph-c_9dcc13bb80dcc1cdea72b04d80505b4649a2b882/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi043 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-08T20:36:11.935 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-08T20:36:11.955 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-08T20:36:11.956 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-12-08T20:36:11.957 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T20:36:11.975 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:11 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/721553644' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-08T20:36:11.990 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-12-08T20:36:11.991 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T20:36:12.055 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T20:36:12.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.240+0000 7f7fe91fd700 1 -- 172.21.15.43:0/3822246045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fe4104eb0 msgr2=0x7f7fe4105280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:12.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.240+0000 7f7fe91fd700 1 --2- 172.21.15.43:0/3822246045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fe4104eb0 0x7f7fe4105280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4004940 tx=0x7f7fd4009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:12.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.240+0000 7f7fe91fd700 1 -- 172.21.15.43:0/3822246045 shutdown_connections 2023-12-08T20:36:12.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.240+0000 7f7fe91fd700 1 --2- 172.21.15.43:0/3822246045 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fe4105850 0x7f7fe40feec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:12.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.240+0000 7f7fe91fd700 1 --2- 172.21.15.43:0/3822246045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fe4104eb0 0x7f7fe4105280 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:12.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.240+0000 7f7fe91fd700 1 -- 172.21.15.43:0/3822246045 >> 172.21.15.43:0/3822246045 conn(0x7f7fe40faa00 msgr2=0x7f7fe40fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:12.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.240+0000 7f7fe91fd700 1 -- 172.21.15.43:0/3822246045 shutdown_connections 2023-12-08T20:36:12.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.240+0000 7f7fe91fd700 1 -- 172.21.15.43:0/3822246045 wait complete. 2023-12-08T20:36:12.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.241+0000 7f7fe91fd700 1 Processor -- start 2023-12-08T20:36:12.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.241+0000 7f7fe91fd700 1 -- start start 2023-12-08T20:36:12.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.241+0000 7f7fe91fd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fe4104eb0 0x7f7fe4115690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:12.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.241+0000 7f7fe91fd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fe4105850 0x7f7fe4115bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:12.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.241+0000 7f7fe91fd700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe4116220 con 0x7f7fe4105850 2023-12-08T20:36:12.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.241+0000 7f7fe91fd700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe410f780 con 0x7f7fe4104eb0 2023-12-08T20:36:12.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.241+0000 7f7fe259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fe4105850 0x7f7fe4115bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:12.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.241+0000 7f7fe259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fe4105850 0x7f7fe4115bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58756/0 (socket says 172.21.15.43:58756) 2023-12-08T20:36:12.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.241+0000 7f7fe259c700 1 -- 172.21.15.43:0/2686998796 learned_addr learned my addr 172.21.15.43:0/2686998796 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:36:12.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.241+0000 7f7fe2d9d700 1 --2- 172.21.15.43:0/2686998796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fe4104eb0 0x7f7fe4115690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:12.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.241+0000 7f7fe259c700 1 -- 172.21.15.43:0/2686998796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fe4104eb0 msgr2=0x7f7fe4115690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:12.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.241+0000 7f7fe259c700 1 --2- 172.21.15.43:0/2686998796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fe4104eb0 0x7f7fe4115690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:12.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.241+0000 7f7fe259c700 1 -- 172.21.15.43:0/2686998796 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd4005040 con 0x7f7fe4105850 2023-12-08T20:36:12.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.242+0000 7f7fe259c700 1 --2- 172.21.15.43:0/2686998796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fe4105850 0x7f7fe4115bd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8002a50 tx=0x7f7fd8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:12.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.242+0000 7f7fcb7fe700 1 -- 172.21.15.43:0/2686998796 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fd8007cc0 con 0x7f7fe4105850 2023-12-08T20:36:12.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.242+0000 7f7fe91fd700 1 -- 172.21.15.43:0/2686998796 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe410fa60 con 0x7f7fe4105850 2023-12-08T20:36:12.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.242+0000 7f7fcb7fe700 1 -- 172.21.15.43:0/2686998796 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7fd800f040 con 0x7f7fe4105850 2023-12-08T20:36:12.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.242+0000 7f7fcb7fe700 1 -- 172.21.15.43:0/2686998796 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fd800d920 con 0x7f7fe4105850 2023-12-08T20:36:12.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.242+0000 7f7fe91fd700 1 -- 172.21.15.43:0/2686998796 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe4110020 con 0x7f7fe4105850 2023-12-08T20:36:12.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.243+0000 7f7fe91fd700 1 -- 172.21.15.43:0/2686998796 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe41021c0 con 0x7f7fe4105850 2023-12-08T20:36:12.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.244+0000 7f7fcb7fe700 1 -- 172.21.15.43:0/2686998796 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f7fd8009680 con 0x7f7fe4105850 2023-12-08T20:36:12.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.244+0000 7f7fcb7fe700 1 --2- 172.21.15.43:0/2686998796 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7fcc06ce70 0x7f7fcc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:12.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.244+0000 7f7fcb7fe700 1 -- 172.21.15.43:0/2686998796 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f7fd808c6f0 con 0x7f7fe4105850 2023-12-08T20:36:12.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.244+0000 7f7fe2d9d700 1 --2- 172.21.15.43:0/2686998796 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7fcc06ce70 0x7f7fcc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:12.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.245+0000 7f7fe2d9d700 1 --2- 172.21.15.43:0/2686998796 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7fcc06ce70 0x7f7fcc06f320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400b3b0 tx=0x7f7fd4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:12.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.249+0000 7f7fcb7fe700 1 -- 172.21.15.43:0/2686998796 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7fd805a090 con 0x7f7fe4105850 2023-12-08T20:36:12.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.463+0000 7f7fe91fd700 1 -- 172.21.15.43:0/2686998796 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fe4063ea0 con 0x7f7fe4105850 2023-12-08T20:36:12.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.464+0000 7f7fcb7fe700 1 -- 172.21.15.43:0/2686998796 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16263 (secure 0 0 0) 0x7f7fd8059c20 con 0x7f7fe4105850 2023-12-08T20:36:12.466 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:36:12.467 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":80,"fsid":"28476818-9607-11ee-95a3-87774f69a715","created":"2023-12-08T20:20:31.669394+0000","modified":"2023-12-08T20:34:46.778471+0000","last_up_change":"2023-12-08T20:34:45.776816+0000","last_in_change":"2023-12-08T20:24:32.898273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:23:57.952150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-08T20:25:40.366334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-08T20:25:40.972845+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5c82b664-c209-4a61-8b21-c5d6a73af81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4101340685},{"type":"v1","addr":"172.21.15.43:6803","nonce":4101340685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4101340685},{"type":"v1","addr":"172.21.15.43:6805","nonce":4101340685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":4101340685},{"type":"v1","addr":"172.21.15.43:6809","nonce":4101340685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4101340685},{"type":"v1","addr":"172.21.15.43:6807","nonce":4101340685}]},"public_addr":"172.21.15.43:6803/4101340685","cluster_addr":"172.21.15.43:6805/4101340685","heartbeat_back_addr":"172.21.15.43:6809/4101340685","heartbeat_front_addr":"172.21.15.43:6807/4101340685","state":["exists","up"]},{"osd":1,"uuid":"301dfde9-c50a-4f73-856f-ae88dc2d2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":565859461},{"type":"v1","addr":"172.21.15.43:6811","nonce":565859461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":565859461},{"type":"v1","addr":"172.21.15.43:6813","nonce":565859461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":565859461},{"type":"v1","addr":"172.21.15.43:6817","nonce":565859461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":565859461},{"type":"v1","addr":"172.21.15.43:6815","nonce":565859461}]},"public_addr":"172.21.15.43:6811/565859461","cluster_addr":"172.21.15.43:6813/565859461","heartbeat_back_addr":"172.21.15.43:6817/565859461","heartbeat_front_addr":"172.21.15.43:6815/565859461","state":["exists","up"]},{"osd":2,"uuid":"bc7be655-1abc-4982-a674-b78d9f7dc1ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":242438115},{"type":"v1","addr":"172.21.15.43:6819","nonce":242438115}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":242438115},{"type":"v1","addr":"172.21.15.43:6821","nonce":242438115}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":242438115},{"type":"v1","addr":"172.21.15.43:6825","nonce":242438115}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":242438115},{"type":"v1","addr":"172.21.15.43:6823","nonce":242438115}]},"public_addr":"172.21.15.43:6819/242438115","cluster_addr":"172.21.15.43:6821/242438115","heartbeat_back_addr":"172.21.15.43:6825/242438115","heartbeat_front_addr":"172.21.15.43:6823/242438115","state":["exists","up"]},{"osd":3,"uuid":"0c0628df-2c6b-40ce-97e2-141d2057af11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":118153540},{"type":"v1","addr":"172.21.15.111:6801","nonce":118153540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":118153540},{"type":"v1","addr":"172.21.15.111:6803","nonce":118153540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":118153540},{"type":"v1","addr":"172.21.15.111:6807","nonce":118153540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":118153540},{"type":"v1","addr":"172.21.15.111:6805","nonce":118153540}]},"public_addr":"172.21.15.111:6801/118153540","cluster_addr":"172.21.15.111:6803/118153540","heartbeat_back_addr":"172.21.15.111:6807/118153540","heartbeat_front_addr":"172.21.15.111:6805/118153540","state":["exists","up"]},{"osd":4,"uuid":"87b65c6d-d7c2-44d7-b891-8477e5e891b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":552414651},{"type":"v1","addr":"172.21.15.111:6809","nonce":552414651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":552414651},{"type":"v1","addr":"172.21.15.111:6811","nonce":552414651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":552414651},{"type":"v1","addr":"172.21.15.111:6815","nonce":552414651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":552414651},{"type":"v1","addr":"172.21.15.111:6813","nonce":552414651}]},"public_addr":"172.21.15.111:6809/552414651","cluster_addr":"172.21.15.111:6811/552414651","heartbeat_back_addr":"172.21.15.111:6815/552414651","heartbeat_front_addr":"172.21.15.111:6813/552414651","state":["exists","up"]},{"osd":5,"uuid":"6a99cd97-6a80-4d01-bb37-a159803f7333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2321927187},{"type":"v1","addr":"172.21.15.111:6817","nonce":2321927187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2321927187},{"type":"v1","addr":"172.21.15.111:6819","nonce":2321927187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2321927187},{"type":"v1","addr":"172.21.15.111:6823","nonce":2321927187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2321927187},{"type":"v1","addr":"172.21.15.111:6821","nonce":2321927187}]},"public_addr":"172.21.15.111:6817/2321927187","cluster_addr":"172.21.15.111:6819/2321927187","heartbeat_back_addr":"172.21.15.111:6823/2321927187","heartbeat_front_addr":"172.21.15.111:6821/2321927187","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:23:11.583744+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:23:33.216409+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:23:54.174665+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:24:11.801925+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:24:29.476994+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:24:47.562110+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/1578286032":"2023-12-09T20:31:13.867849+0000","172.21.15.43:6801/2216649665":"2023-12-09T20:31:13.867849+0000","172.21.15.43:0/2638250357":"2023-12-09T20:31:13.867849+0000","172.21.15.43:6801/1561199606":"2023-12-09T20:21:27.333855+0000","172.21.15.43:6800/1561199606":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/2345173464":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/1958100424":"2023-12-09T20:27:21.191384+0000","172.21.15.111:0/1730171069":"2023-12-09T20:28:39.993505+0000","172.21.15.43:0/1298471102":"2023-12-09T20:21:01.600933+0000","172.21.15.43:0/3678520486":"2023-12-09T20:22:19.417857+0000","172.21.15.43:6800/2315465125":"2023-12-09T20:22:19.417857+0000","172.21.15.111:0/2899706571":"2023-12-09T20:28:39.993505+0000","172.21.15.43:0/392501150":"2023-12-09T20:22:19.417857+0000","172.21.15.43:0/940236816":"2023-12-09T20:31:13.867849+0000","172.21.15.111:6829/940639390":"2023-12-09T20:28:39.993505+0000","172.21.15.43:0/3758242596":"2023-12-09T20:21:27.333855+0000","172.21.15.43:6801/2195776328":"2023-12-09T20:21:01.600933+0000","172.21.15.43:0/3571683356":"2023-12-09T20:21:01.600933+0000","172.21.15.43:6800/2216649665":"2023-12-09T20:31:13.867849+0000","172.21.15.43:0/993195790":"2023-12-09T20:27:21.191384+0000","172.21.15.111:0/3272445197":"2023-12-09T20:28:39.993505+0000","172.21.15.111:0/3981107380":"2023-12-09T20:28:39.993505+0000","172.21.15.43:0/2976228612":"2023-12-09T20:21:01.600933+0000","172.21.15.43:6801/2315465125":"2023-12-09T20:22:19.417857+0000","172.21.15.43:0/3231089927":"2023-12-09T20:27:21.191384+0000","172.21.15.111:0/2497747504":"2023-12-09T20:28:39.993505+0000","172.21.15.111:6828/940639390":"2023-12-09T20:28:39.993505+0000","172.21.15.43:0/4033535283":"2023-12-09T20:22:19.417857+0000","172.21.15.43:0/4006048852":"2023-12-09T20:27:21.191384+0000","172.21.15.111:0/1498484547":"2023-12-09T20:28:39.993505+0000","172.21.15.43:0/2451027781":"2023-12-09T20:21:27.333855+0000","172.21.15.43:6800/2195776328":"2023-12-09T20:21:01.600933+0000","172.21.15.43:0/1875438884":"2023-12-09T20:31:13.867849+0000","172.21.15.43:6800/3959093322":"2023-12-09T20:27:21.191384+0000","172.21.15.43:6801/3959093322":"2023-12-09T20:27:21.191384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:36:12.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.466+0000 7f7fe91fd700 1 -- 172.21.15.43:0/2686998796 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7fcc06ce70 msgr2=0x7f7fcc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:12.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.466+0000 7f7fe91fd700 1 --2- 172.21.15.43:0/2686998796 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7fcc06ce70 0x7f7fcc06f320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400b3b0 tx=0x7f7fd4009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:12.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.466+0000 7f7fe91fd700 1 -- 172.21.15.43:0/2686998796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fe4105850 msgr2=0x7f7fe4115bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:12.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.466+0000 7f7fe91fd700 1 --2- 172.21.15.43:0/2686998796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fe4105850 0x7f7fe4115bd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8002a50 tx=0x7f7fd8004600 comp rx=0 tx=0).stop 2023-12-08T20:36:12.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.466+0000 7f7fe91fd700 1 -- 172.21.15.43:0/2686998796 shutdown_connections 2023-12-08T20:36:12.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.466+0000 7f7fe91fd700 1 --2- 172.21.15.43:0/2686998796 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7fcc06ce70 0x7f7fcc06f320 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:12.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.466+0000 7f7fe91fd700 1 --2- 172.21.15.43:0/2686998796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fe4104eb0 0x7f7fe4115690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:12.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.466+0000 7f7fe91fd700 1 --2- 172.21.15.43:0/2686998796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fe4105850 0x7f7fe4115bd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:12.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.467+0000 7f7fe91fd700 1 -- 172.21.15.43:0/2686998796 >> 172.21.15.43:0/2686998796 conn(0x7f7fe40faa00 msgr2=0x7f7fe40fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:12.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.467+0000 7f7fe91fd700 1 -- 172.21.15.43:0/2686998796 shutdown_connections 2023-12-08T20:36:12.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.467+0000 7f7fe91fd700 1 -- 172.21.15.43:0/2686998796 wait complete. 2023-12-08T20:36:12.483 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T20:23:57.952150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-08T20:25:40.366334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-08T20:25:40.972845+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T20:36:12.484 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T20:36:12.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.619+0000 7f1b58e19700 1 -- 172.21.15.43:0/2304385762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b54101ac0 msgr2=0x7f1b54101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:12.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.619+0000 7f1b58e19700 1 --2- 172.21.15.43:0/2304385762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b54101ac0 0x7f1b54101e90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1b44004940 tx=0x7f1b44009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:12.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.619+0000 7f1b58e19700 1 -- 172.21.15.43:0/2304385762 shutdown_connections 2023-12-08T20:36:12.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.619+0000 7f1b58e19700 1 --2- 172.21.15.43:0/2304385762 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b541023d0 0x7f1b540fba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:12.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.619+0000 7f1b58e19700 1 --2- 172.21.15.43:0/2304385762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b54101ac0 0x7f1b54101e90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:12.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.619+0000 7f1b58e19700 1 -- 172.21.15.43:0/2304385762 >> 172.21.15.43:0/2304385762 conn(0x7f1b54071970 msgr2=0x7f1b54071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:12.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.619+0000 7f1b58e19700 1 -- 172.21.15.43:0/2304385762 shutdown_connections 2023-12-08T20:36:12.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.619+0000 7f1b58e19700 1 -- 172.21.15.43:0/2304385762 wait complete. 2023-12-08T20:36:12.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.620+0000 7f1b58e19700 1 Processor -- start 2023-12-08T20:36:12.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.620+0000 7f1b58e19700 1 -- start start 2023-12-08T20:36:12.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.620+0000 7f1b58e19700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b54101ac0 0x7f1b54113340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:12.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.620+0000 7f1b58e19700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b541023d0 0x7f1b54113880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:12.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.620+0000 7f1b58e19700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b54113ed0 con 0x7f1b54101ac0 2023-12-08T20:36:12.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.620+0000 7f1b58e19700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5410d3f0 con 0x7f1b541023d0 2023-12-08T20:36:12.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.620+0000 7f1b5259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b54101ac0 0x7f1b54113340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:12.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.620+0000 7f1b5259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b54101ac0 0x7f1b54113340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58772/0 (socket says 172.21.15.43:58772) 2023-12-08T20:36:12.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.620+0000 7f1b5259c700 1 -- 172.21.15.43:0/3204554281 learned_addr learned my addr 172.21.15.43:0/3204554281 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:36:12.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.620+0000 7f1b51d9b700 1 --2- 172.21.15.43:0/3204554281 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b541023d0 0x7f1b54113880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:12.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.621+0000 7f1b5259c700 1 -- 172.21.15.43:0/3204554281 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b541023d0 msgr2=0x7f1b54113880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:12.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.621+0000 7f1b5259c700 1 --2- 172.21.15.43:0/3204554281 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b541023d0 0x7f1b54113880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:12.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.621+0000 7f1b5259c700 1 -- 172.21.15.43:0/3204554281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b44005040 con 0x7f1b54101ac0 2023-12-08T20:36:12.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.621+0000 7f1b51d9b700 1 --2- 172.21.15.43:0/3204554281 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b541023d0 0x7f1b54113880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:36:12.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.621+0000 7f1b5259c700 1 --2- 172.21.15.43:0/3204554281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b54101ac0 0x7f1b54113340 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009360 tx=0x7f1b44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:12.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.621+0000 7f1b42ffd700 1 -- 172.21.15.43:0/3204554281 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b4400e040 con 0x7f1b54101ac0 2023-12-08T20:36:12.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.621+0000 7f1b42ffd700 1 -- 172.21.15.43:0/3204554281 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1b4400bc50 con 0x7f1b54101ac0 2023-12-08T20:36:12.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.621+0000 7f1b42ffd700 1 -- 172.21.15.43:0/3204554281 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b4401c630 con 0x7f1b54101ac0 2023-12-08T20:36:12.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.621+0000 7f1b58e19700 1 -- 172.21.15.43:0/3204554281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b5410d670 con 0x7f1b54101ac0 2023-12-08T20:36:12.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.621+0000 7f1b58e19700 1 -- 172.21.15.43:0/3204554281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5410dc30 con 0x7f1b54101ac0 2023-12-08T20:36:12.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.622+0000 7f1b58e19700 1 -- 172.21.15.43:0/3204554281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b54064730 con 0x7f1b54101ac0 2023-12-08T20:36:12.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.623+0000 7f1b42ffd700 1 -- 172.21.15.43:0/3204554281 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f1b44013960 con 0x7f1b54101ac0 2023-12-08T20:36:12.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.623+0000 7f1b42ffd700 1 --2- 172.21.15.43:0/3204554281 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f1b3c06ce70 0x7f1b3c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:12.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.623+0000 7f1b42ffd700 1 -- 172.21.15.43:0/3204554281 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f1b4408d5b0 con 0x7f1b54101ac0 2023-12-08T20:36:12.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.623+0000 7f1b51d9b700 1 --2- 172.21.15.43:0/3204554281 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f1b3c06ce70 0x7f1b3c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:12.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.624+0000 7f1b51d9b700 1 --2- 172.21.15.43:0/3204554281 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f1b3c06ce70 0x7f1b3c06f320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1b48007fd0 tx=0x7f1b48009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:12.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.628+0000 7f1b42ffd700 1 -- 172.21.15.43:0/3204554281 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1b4405b090 con 0x7f1b54101ac0 2023-12-08T20:36:12.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:12 smithi043 ceph-mon[219193]: pgmap v182: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:36:12.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:12 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/2686998796' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-08T20:36:12.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.836+0000 7f1b58e19700 1 -- 172.21.15.43:0/3204554281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b54108a10 con 0x7f1b54101ac0 2023-12-08T20:36:12.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.837+0000 7f1b42ffd700 1 -- 172.21.15.43:0/3204554281 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b4405ac20 con 0x7f1b54101ac0 2023-12-08T20:36:12.839 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-12-08T20:36:12.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.839+0000 7f1b58e19700 1 -- 172.21.15.43:0/3204554281 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f1b3c06ce70 msgr2=0x7f1b3c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:12.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.839+0000 7f1b58e19700 1 --2- 172.21.15.43:0/3204554281 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f1b3c06ce70 0x7f1b3c06f320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1b48007fd0 tx=0x7f1b48009040 comp rx=0 tx=0).stop 2023-12-08T20:36:12.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.839+0000 7f1b58e19700 1 -- 172.21.15.43:0/3204554281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b54101ac0 msgr2=0x7f1b54113340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:12.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.839+0000 7f1b58e19700 1 --2- 172.21.15.43:0/3204554281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b54101ac0 0x7f1b54113340 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009360 tx=0x7f1b44009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:12.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.839+0000 7f1b58e19700 1 -- 172.21.15.43:0/3204554281 shutdown_connections 2023-12-08T20:36:12.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.839+0000 7f1b58e19700 1 --2- 172.21.15.43:0/3204554281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b54101ac0 0x7f1b54113340 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:12.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.839+0000 7f1b58e19700 1 --2- 172.21.15.43:0/3204554281 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f1b3c06ce70 0x7f1b3c06f320 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:12.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.839+0000 7f1b58e19700 1 --2- 172.21.15.43:0/3204554281 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b541023d0 0x7f1b54113880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:12.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.839+0000 7f1b58e19700 1 -- 172.21.15.43:0/3204554281 >> 172.21.15.43:0/3204554281 conn(0x7f1b54071970 msgr2=0x7f1b54064c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:12.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.840+0000 7f1b58e19700 1 -- 172.21.15.43:0/3204554281 shutdown_connections 2023-12-08T20:36:12.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.840+0000 7f1b58e19700 1 -- 172.21.15.43:0/3204554281 wait complete. 2023-12-08T20:36:12.855 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-08T20:36:12.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:12 smithi111 ceph-mon[182474]: pgmap v182: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:36:12.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:12 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/2686998796' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-08T20:36:12.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.989+0000 7f96ccfd3700 1 -- 172.21.15.43:0/2727492115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c8101aa0 msgr2=0x7f96c8101e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:12.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.989+0000 7f96ccfd3700 1 --2- 172.21.15.43:0/2727492115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c8101aa0 0x7f96c8101e70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f96b8004940 tx=0x7f96b8009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:12.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.989+0000 7f96ccfd3700 1 -- 172.21.15.43:0/2727492115 shutdown_connections 2023-12-08T20:36:12.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.989+0000 7f96ccfd3700 1 --2- 172.21.15.43:0/2727492115 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96c80fba60 0x7f96c80fbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:12.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.989+0000 7f96ccfd3700 1 --2- 172.21.15.43:0/2727492115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c8101aa0 0x7f96c8101e70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:12.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.989+0000 7f96ccfd3700 1 -- 172.21.15.43:0/2727492115 >> 172.21.15.43:0/2727492115 conn(0x7f96c80f7600 msgr2=0x7f96c80f9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:12.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.989+0000 7f96ccfd3700 1 -- 172.21.15.43:0/2727492115 shutdown_connections 2023-12-08T20:36:12.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.989+0000 7f96ccfd3700 1 -- 172.21.15.43:0/2727492115 wait complete. 2023-12-08T20:36:12.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.990+0000 7f96ccfd3700 1 Processor -- start 2023-12-08T20:36:12.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.990+0000 7f96ccfd3700 1 -- start start 2023-12-08T20:36:12.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.990+0000 7f96ccfd3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c80fba60 0x7f96c8112150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:12.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.990+0000 7f96ccfd3700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96c8101aa0 0x7f96c8112690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:12.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.990+0000 7f96ccfd3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c8112ce0 con 0x7f96c80fba60 2023-12-08T20:36:12.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.990+0000 7f96ccfd3700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c810c200 con 0x7f96c8101aa0 2023-12-08T20:36:12.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.990+0000 7f96c659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c80fba60 0x7f96c8112150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:12.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.990+0000 7f96c659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c80fba60 0x7f96c8112150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58790/0 (socket says 172.21.15.43:58790) 2023-12-08T20:36:12.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.990+0000 7f96c659c700 1 -- 172.21.15.43:0/58688751 learned_addr learned my addr 172.21.15.43:0/58688751 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:36:12.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.990+0000 7f96bdd9b700 1 --2- 172.21.15.43:0/58688751 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96c8101aa0 0x7f96c8112690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:12.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.991+0000 7f96c659c700 1 -- 172.21.15.43:0/58688751 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96c8101aa0 msgr2=0x7f96c8112690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:12.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.991+0000 7f96c659c700 1 --2- 172.21.15.43:0/58688751 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96c8101aa0 0x7f96c8112690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:12.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.991+0000 7f96c659c700 1 -- 172.21.15.43:0/58688751 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b8005040 con 0x7f96c80fba60 2023-12-08T20:36:12.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.991+0000 7f96bdd9b700 1 --2- 172.21.15.43:0/58688751 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96c8101aa0 0x7f96c8112690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T20:36:12.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.991+0000 7f96c659c700 1 --2- 172.21.15.43:0/58688751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c80fba60 0x7f96c8112150 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f96b8000c00 tx=0x7f96b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:12.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.991+0000 7f96bf7fe700 1 -- 172.21.15.43:0/58688751 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96b8021070 con 0x7f96c80fba60 2023-12-08T20:36:12.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.991+0000 7f96ccfd3700 1 -- 172.21.15.43:0/58688751 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c810c480 con 0x7f96c80fba60 2023-12-08T20:36:12.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.991+0000 7f96bf7fe700 1 -- 172.21.15.43:0/58688751 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f96b801c400 con 0x7f96c80fba60 2023-12-08T20:36:12.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.991+0000 7f96bf7fe700 1 -- 172.21.15.43:0/58688751 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96b800e070 con 0x7f96c80fba60 2023-12-08T20:36:12.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.991+0000 7f96ccfd3700 1 -- 172.21.15.43:0/58688751 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c810c9e0 con 0x7f96c80fba60 2023-12-08T20:36:12.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.992+0000 7f96ccfd3700 1 -- 172.21.15.43:0/58688751 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c8063ea0 con 0x7f96c80fba60 2023-12-08T20:36:12.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.992+0000 7f96bf7fe700 1 -- 172.21.15.43:0/58688751 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f96b801c9e0 con 0x7f96c80fba60 2023-12-08T20:36:12.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.993+0000 7f96bf7fe700 1 --2- 172.21.15.43:0/58688751 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f96b406ceb0 0x7f96b406f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:12.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.993+0000 7f96bf7fe700 1 -- 172.21.15.43:0/58688751 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f96b808d510 con 0x7f96c80fba60 2023-12-08T20:36:12.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.993+0000 7f96bdd9b700 1 --2- 172.21.15.43:0/58688751 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f96b406ceb0 0x7f96b406f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:12.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.993+0000 7f96bdd9b700 1 --2- 172.21.15.43:0/58688751 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f96b406ceb0 0x7f96b406f360 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f96b0004600 tx=0x7f96b000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:12.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:12.998+0000 7f96bf7fe700 1 -- 172.21.15.43:0/58688751 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f96b805aeb0 con 0x7f96c80fba60 2023-12-08T20:36:13.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.203+0000 7f96ccfd3700 1 -- 172.21.15.43:0/58688751 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f96c8108a20 con 0x7f96c80fba60 2023-12-08T20:36:13.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.204+0000 7f96bf7fe700 1 -- 172.21.15.43:0/58688751 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v80) v1 ==== 107+0+11 (secure 0 0 0) 0x7f96b805aa40 con 0x7f96c80fba60 2023-12-08T20:36:13.207 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-12-08T20:36:13.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.206+0000 7f96ccfd3700 1 -- 172.21.15.43:0/58688751 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f96b406ceb0 msgr2=0x7f96b406f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:13.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.206+0000 7f96ccfd3700 1 --2- 172.21.15.43:0/58688751 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f96b406ceb0 0x7f96b406f360 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f96b0004600 tx=0x7f96b000b040 comp rx=0 tx=0).stop 2023-12-08T20:36:13.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.206+0000 7f96ccfd3700 1 -- 172.21.15.43:0/58688751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c80fba60 msgr2=0x7f96c8112150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:13.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.206+0000 7f96ccfd3700 1 --2- 172.21.15.43:0/58688751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c80fba60 0x7f96c8112150 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f96b8000c00 tx=0x7f96b8009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:13.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.207+0000 7f96ccfd3700 1 -- 172.21.15.43:0/58688751 shutdown_connections 2023-12-08T20:36:13.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.207+0000 7f96ccfd3700 1 --2- 172.21.15.43:0/58688751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c80fba60 0x7f96c8112150 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:13.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.207+0000 7f96ccfd3700 1 --2- 172.21.15.43:0/58688751 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f96b406ceb0 0x7f96b406f360 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:13.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.207+0000 7f96ccfd3700 1 --2- 172.21.15.43:0/58688751 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96c8101aa0 0x7f96c8112690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:13.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.207+0000 7f96ccfd3700 1 -- 172.21.15.43:0/58688751 >> 172.21.15.43:0/58688751 conn(0x7f96c80f7600 msgr2=0x7f96c80f8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:13.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.207+0000 7f96ccfd3700 1 -- 172.21.15.43:0/58688751 shutdown_connections 2023-12-08T20:36:13.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.207+0000 7f96ccfd3700 1 -- 172.21.15.43:0/58688751 wait complete. 2023-12-08T20:36:13.223 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-08T20:36:13.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.358+0000 7f63a2ab6700 1 -- 172.21.15.43:0/397932018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f639c102bb0 msgr2=0x7f639c102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:13.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.358+0000 7f63a2ab6700 1 --2- 172.21.15.43:0/397932018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f639c102bb0 0x7f639c102f80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f638c004940 tx=0x7f638c009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:13.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.358+0000 7f63a2ab6700 1 -- 172.21.15.43:0/397932018 shutdown_connections 2023-12-08T20:36:13.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.358+0000 7f63a2ab6700 1 --2- 172.21.15.43:0/397932018 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f639c064bb0 0x7f639c065000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:13.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.358+0000 7f63a2ab6700 1 --2- 172.21.15.43:0/397932018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f639c102bb0 0x7f639c102f80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:13.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.358+0000 7f63a2ab6700 1 -- 172.21.15.43:0/397932018 >> 172.21.15.43:0/397932018 conn(0x7f639c071970 msgr2=0x7f639c071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:13.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.358+0000 7f63a2ab6700 1 -- 172.21.15.43:0/397932018 shutdown_connections 2023-12-08T20:36:13.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.358+0000 7f63a2ab6700 1 -- 172.21.15.43:0/397932018 wait complete. 2023-12-08T20:36:13.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.359+0000 7f63a2ab6700 1 Processor -- start 2023-12-08T20:36:13.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.359+0000 7f63a2ab6700 1 -- start start 2023-12-08T20:36:13.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.359+0000 7f63a2ab6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f639c064bb0 0x7f639c113300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:13.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.359+0000 7f63a2ab6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f639c102bb0 0x7f639c113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:13.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.359+0000 7f63a2ab6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639c113e90 con 0x7f639c064bb0 2023-12-08T20:36:13.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.359+0000 7f63a2ab6700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639c10d3b0 con 0x7f639c102bb0 2023-12-08T20:36:13.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.359+0000 7f63a0852700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f639c064bb0 0x7f639c113300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:13.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.359+0000 7f63a0852700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f639c064bb0 0x7f639c113300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58808/0 (socket says 172.21.15.43:58808) 2023-12-08T20:36:13.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.359+0000 7f63a0852700 1 -- 172.21.15.43:0/250303272 learned_addr learned my addr 172.21.15.43:0/250303272 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:36:13.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.360+0000 7f63a0852700 1 -- 172.21.15.43:0/250303272 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f639c102bb0 msgr2=0x7f639c113840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:13.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.360+0000 7f639bfff700 1 --2- 172.21.15.43:0/250303272 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f639c102bb0 0x7f639c113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:13.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.360+0000 7f63a0852700 1 --2- 172.21.15.43:0/250303272 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f639c102bb0 0x7f639c113840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:13.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.360+0000 7f63a0852700 1 -- 172.21.15.43:0/250303272 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c005040 con 0x7f639c064bb0 2023-12-08T20:36:13.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.360+0000 7f639bfff700 1 --2- 172.21.15.43:0/250303272 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f639c102bb0 0x7f639c113840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T20:36:13.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.360+0000 7f63a0852700 1 --2- 172.21.15.43:0/250303272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f639c064bb0 0x7f639c113300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f638c009180 tx=0x7f638c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:13.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.360+0000 7f63997fa700 1 -- 172.21.15.43:0/250303272 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f638c00e040 con 0x7f639c064bb0 2023-12-08T20:36:13.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.360+0000 7f63997fa700 1 -- 172.21.15.43:0/250303272 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f638c013420 con 0x7f639c064bb0 2023-12-08T20:36:13.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.360+0000 7f63a2ab6700 1 -- 172.21.15.43:0/250303272 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639c10d630 con 0x7f639c064bb0 2023-12-08T20:36:13.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.360+0000 7f63997fa700 1 -- 172.21.15.43:0/250303272 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f638c01c630 con 0x7f639c064bb0 2023-12-08T20:36:13.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.360+0000 7f63a2ab6700 1 -- 172.21.15.43:0/250303272 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f639c10db70 con 0x7f639c064bb0 2023-12-08T20:36:13.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.361+0000 7f63a2ab6700 1 -- 172.21.15.43:0/250303272 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f639c064730 con 0x7f639c064bb0 2023-12-08T20:36:13.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.362+0000 7f63997fa700 1 -- 172.21.15.43:0/250303272 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f638c0139e0 con 0x7f639c064bb0 2023-12-08T20:36:13.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.362+0000 7f63997fa700 1 --2- 172.21.15.43:0/250303272 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f638806ce60 0x7f638806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:13.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.362+0000 7f63997fa700 1 -- 172.21.15.43:0/250303272 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f638c08d530 con 0x7f639c064bb0 2023-12-08T20:36:13.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.362+0000 7f639bfff700 1 --2- 172.21.15.43:0/250303272 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f638806ce60 0x7f638806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:13.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.363+0000 7f639bfff700 1 --2- 172.21.15.43:0/250303272 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f638806ce60 0x7f638806f310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6384009b80 tx=0x7f638400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:13.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.367+0000 7f63997fa700 1 -- 172.21.15.43:0/250303272 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f638c05b010 con 0x7f639c064bb0 2023-12-08T20:36:13.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.575+0000 7f63a2ab6700 1 -- 172.21.15.43:0/250303272 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f639c109ab0 con 0x7f639c064bb0 2023-12-08T20:36:13.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.576+0000 7f63997fa700 1 -- 172.21.15.43:0/250303272 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v80) v1 ==== 107+0+11 (secure 0 0 0) 0x7f638c05aba0 con 0x7f639c064bb0 2023-12-08T20:36:13.579 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-12-08T20:36:13.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.578+0000 7f63a2ab6700 1 -- 172.21.15.43:0/250303272 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f638806ce60 msgr2=0x7f638806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:13.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.578+0000 7f63a2ab6700 1 --2- 172.21.15.43:0/250303272 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f638806ce60 0x7f638806f310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6384009b80 tx=0x7f638400b040 comp rx=0 tx=0).stop 2023-12-08T20:36:13.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.578+0000 7f63a2ab6700 1 -- 172.21.15.43:0/250303272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f639c064bb0 msgr2=0x7f639c113300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:13.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.578+0000 7f63a2ab6700 1 --2- 172.21.15.43:0/250303272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f639c064bb0 0x7f639c113300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f638c009180 tx=0x7f638c009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:13.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.578+0000 7f63a2ab6700 1 -- 172.21.15.43:0/250303272 shutdown_connections 2023-12-08T20:36:13.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.578+0000 7f63a2ab6700 1 --2- 172.21.15.43:0/250303272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f639c064bb0 0x7f639c113300 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:13.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.578+0000 7f63a2ab6700 1 --2- 172.21.15.43:0/250303272 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f638806ce60 0x7f638806f310 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:13.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.578+0000 7f63a2ab6700 1 --2- 172.21.15.43:0/250303272 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f639c102bb0 0x7f639c113840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:13.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.578+0000 7f63a2ab6700 1 -- 172.21.15.43:0/250303272 >> 172.21.15.43:0/250303272 conn(0x7f639c071970 msgr2=0x7f639c0fa930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:13.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.578+0000 7f63a2ab6700 1 -- 172.21.15.43:0/250303272 shutdown_connections 2023-12-08T20:36:13.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.578+0000 7f63a2ab6700 1 -- 172.21.15.43:0/250303272 wait complete. 2023-12-08T20:36:13.594 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T20:36:13.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.725+0000 7f5209ddf700 1 -- 172.21.15.43:0/694142824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5204101ac0 msgr2=0x7f5204101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:13.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.725+0000 7f5209ddf700 1 --2- 172.21.15.43:0/694142824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5204101ac0 0x7f5204101e90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f51f8004940 tx=0x7f51f8009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:13.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.725+0000 7f5209ddf700 1 -- 172.21.15.43:0/694142824 shutdown_connections 2023-12-08T20:36:13.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.725+0000 7f5209ddf700 1 --2- 172.21.15.43:0/694142824 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52041023d0 0x7f52040fba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:13.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.725+0000 7f5209ddf700 1 --2- 172.21.15.43:0/694142824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5204101ac0 0x7f5204101e90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:13.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.725+0000 7f5209ddf700 1 -- 172.21.15.43:0/694142824 >> 172.21.15.43:0/694142824 conn(0x7f5204071970 msgr2=0x7f5204071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:13.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.725+0000 7f5209ddf700 1 -- 172.21.15.43:0/694142824 shutdown_connections 2023-12-08T20:36:13.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.725+0000 7f5209ddf700 1 -- 172.21.15.43:0/694142824 wait complete. 2023-12-08T20:36:13.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.726+0000 7f5209ddf700 1 Processor -- start 2023-12-08T20:36:13.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.726+0000 7f5209ddf700 1 -- start start 2023-12-08T20:36:13.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.726+0000 7f5209ddf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5204101ac0 0x7f520410c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:13.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.726+0000 7f5209ddf700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52041023d0 0x7f520410c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:13.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.726+0000 7f5209ddf700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5204065ad0 con 0x7f52041023d0 2023-12-08T20:36:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.726+0000 7f5209ddf700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520410cca0 con 0x7f5204101ac0 2023-12-08T20:36:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.726+0000 7f5202ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52041023d0 0x7f520410c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.726+0000 7f5202ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52041023d0 0x7f520410c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58834/0 (socket says 172.21.15.43:58834) 2023-12-08T20:36:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.726+0000 7f5202ffd700 1 -- 172.21.15.43:0/2958034913 learned_addr learned my addr 172.21.15.43:0/2958034913 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:36:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.727+0000 7f52037fe700 1 --2- 172.21.15.43:0/2958034913 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5204101ac0 0x7f520410c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.727+0000 7f5202ffd700 1 -- 172.21.15.43:0/2958034913 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5204101ac0 msgr2=0x7f520410c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.727+0000 7f5202ffd700 1 --2- 172.21.15.43:0/2958034913 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5204101ac0 0x7f520410c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.727+0000 7f5202ffd700 1 -- 172.21.15.43:0/2958034913 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f8005040 con 0x7f52041023d0 2023-12-08T20:36:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.727+0000 7f5202ffd700 1 --2- 172.21.15.43:0/2958034913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52041023d0 0x7f520410c760 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f51f4002a50 tx=0x7f51f4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:13.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.727+0000 7f51ebfff700 1 -- 172.21.15.43:0/2958034913 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51f4007cc0 con 0x7f52041023d0 2023-12-08T20:36:13.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.727+0000 7f5209ddf700 1 -- 172.21.15.43:0/2958034913 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520410cf30 con 0x7f52041023d0 2023-12-08T20:36:13.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.727+0000 7f51ebfff700 1 -- 172.21.15.43:0/2958034913 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f51f400f040 con 0x7f52041023d0 2023-12-08T20:36:13.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.727+0000 7f51ebfff700 1 -- 172.21.15.43:0/2958034913 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51f400d990 con 0x7f52041023d0 2023-12-08T20:36:13.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.727+0000 7f5209ddf700 1 -- 172.21.15.43:0/2958034913 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5204119b20 con 0x7f52041023d0 2023-12-08T20:36:13.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.728+0000 7f5209ddf700 1 -- 172.21.15.43:0/2958034913 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52040fece0 con 0x7f52041023d0 2023-12-08T20:36:13.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.729+0000 7f51ebfff700 1 -- 172.21.15.43:0/2958034913 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f51f4009710 con 0x7f52041023d0 2023-12-08T20:36:13.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.729+0000 7f51ebfff700 1 --2- 172.21.15.43:0/2958034913 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f51ec06ce60 0x7f51ec06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:13.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.729+0000 7f51ebfff700 1 -- 172.21.15.43:0/2958034913 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f51f408c120 con 0x7f52041023d0 2023-12-08T20:36:13.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.729+0000 7f52037fe700 1 --2- 172.21.15.43:0/2958034913 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f51ec06ce60 0x7f51ec06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:13.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.730+0000 7f52037fe700 1 --2- 172.21.15.43:0/2958034913 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f51ec06ce60 0x7f51ec06f310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f51f800b3b0 tx=0x7f51f8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:13.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.734+0000 7f51ebfff700 1 -- 172.21.15.43:0/2958034913 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f51f40597b0 con 0x7f52041023d0 2023-12-08T20:36:13.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.963+0000 7f5209ddf700 1 -- 172.21.15.43:0/2958034913 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5204064730 con 0x7f52041023d0 2023-12-08T20:36:13.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.963+0000 7f51ebfff700 1 -- 172.21.15.43:0/2958034913 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v80) v1 ==== 81+0+2069 (secure 0 0 0) 0x7f51f40595d0 con 0x7f52041023d0 2023-12-08T20:36:13.965 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1578286032 2023-12-09T20:31:13.867849+0000 2023-12-08T20:36:13.965 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/2216649665 2023-12-09T20:31:13.867849+0000 2023-12-08T20:36:13.966 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2638250357 2023-12-09T20:31:13.867849+0000 2023-12-08T20:36:13.966 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/1561199606 2023-12-09T20:21:27.333855+0000 2023-12-08T20:36:13.966 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/1561199606 2023-12-09T20:21:27.333855+0000 2023-12-08T20:36:13.966 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2345173464 2023-12-09T20:21:27.333855+0000 2023-12-08T20:36:13.966 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1958100424 2023-12-09T20:27:21.191384+0000 2023-12-08T20:36:13.967 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.111:0/1730171069 2023-12-09T20:28:39.993505+0000 2023-12-08T20:36:13.967 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1298471102 2023-12-09T20:21:01.600933+0000 2023-12-08T20:36:13.967 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3678520486 2023-12-09T20:22:19.417857+0000 2023-12-08T20:36:13.967 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/2315465125 2023-12-09T20:22:19.417857+0000 2023-12-08T20:36:13.967 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.111:0/2899706571 2023-12-09T20:28:39.993505+0000 2023-12-08T20:36:13.967 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/392501150 2023-12-09T20:22:19.417857+0000 2023-12-08T20:36:13.967 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/940236816 2023-12-09T20:31:13.867849+0000 2023-12-08T20:36:13.968 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.111:6829/940639390 2023-12-09T20:28:39.993505+0000 2023-12-08T20:36:13.968 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3758242596 2023-12-09T20:21:27.333855+0000 2023-12-08T20:36:13.968 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/2195776328 2023-12-09T20:21:01.600933+0000 2023-12-08T20:36:13.968 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3571683356 2023-12-09T20:21:01.600933+0000 2023-12-08T20:36:13.968 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/2216649665 2023-12-09T20:31:13.867849+0000 2023-12-08T20:36:13.968 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/993195790 2023-12-09T20:27:21.191384+0000 2023-12-08T20:36:13.968 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.111:0/3272445197 2023-12-09T20:28:39.993505+0000 2023-12-08T20:36:13.968 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.111:0/3981107380 2023-12-09T20:28:39.993505+0000 2023-12-08T20:36:13.968 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2976228612 2023-12-09T20:21:01.600933+0000 2023-12-08T20:36:13.969 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/2315465125 2023-12-09T20:22:19.417857+0000 2023-12-08T20:36:13.969 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3231089927 2023-12-09T20:27:21.191384+0000 2023-12-08T20:36:13.969 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.111:0/2497747504 2023-12-09T20:28:39.993505+0000 2023-12-08T20:36:13.969 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.111:6828/940639390 2023-12-09T20:28:39.993505+0000 2023-12-08T20:36:13.969 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/4033535283 2023-12-09T20:22:19.417857+0000 2023-12-08T20:36:13.969 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/4006048852 2023-12-09T20:27:21.191384+0000 2023-12-08T20:36:13.969 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.111:0/1498484547 2023-12-09T20:28:39.993505+0000 2023-12-08T20:36:13.969 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2451027781 2023-12-09T20:21:27.333855+0000 2023-12-08T20:36:13.969 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/2195776328 2023-12-09T20:21:01.600933+0000 2023-12-08T20:36:13.970 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1875438884 2023-12-09T20:31:13.867849+0000 2023-12-08T20:36:13.970 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/3959093322 2023-12-09T20:27:21.191384+0000 2023-12-08T20:36:13.970 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/3959093322 2023-12-09T20:27:21.191384+0000 2023-12-08T20:36:13.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:13 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/3204554281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-08T20:36:13.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:13 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/58688751' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-08T20:36:13.971 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:13 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/250303272' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-08T20:36:13.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.966+0000 7f5209ddf700 1 -- 172.21.15.43:0/2958034913 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f51ec06ce60 msgr2=0x7f51ec06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:13.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.966+0000 7f5209ddf700 1 --2- 172.21.15.43:0/2958034913 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f51ec06ce60 0x7f51ec06f310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f51f800b3b0 tx=0x7f51f8009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:13.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.966+0000 7f5209ddf700 1 -- 172.21.15.43:0/2958034913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52041023d0 msgr2=0x7f520410c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:13.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.966+0000 7f5209ddf700 1 --2- 172.21.15.43:0/2958034913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52041023d0 0x7f520410c760 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f51f4002a50 tx=0x7f51f4004600 comp rx=0 tx=0).stop 2023-12-08T20:36:13.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.966+0000 7f5209ddf700 1 -- 172.21.15.43:0/2958034913 shutdown_connections 2023-12-08T20:36:13.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.966+0000 7f5209ddf700 1 --2- 172.21.15.43:0/2958034913 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f51ec06ce60 0x7f51ec06f310 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:13.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.966+0000 7f5209ddf700 1 --2- 172.21.15.43:0/2958034913 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5204101ac0 0x7f520410c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:13.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.966+0000 7f5209ddf700 1 --2- 172.21.15.43:0/2958034913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52041023d0 0x7f520410c760 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:13.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.966+0000 7f5209ddf700 1 -- 172.21.15.43:0/2958034913 >> 172.21.15.43:0/2958034913 conn(0x7f5204071970 msgr2=0x7f52040faf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:13.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.966+0000 7f5209ddf700 1 -- 172.21.15.43:0/2958034913 shutdown_connections 2023-12-08T20:36:13.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:13.966+0000 7f5209ddf700 1 -- 172.21.15.43:0/2958034913 wait complete. 2023-12-08T20:36:13.973 INFO:teuthology.orchestra.run.smithi043.stderr:listed 35 entries 2023-12-08T20:36:13.981 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:13 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/3204554281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-08T20:36:13.981 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:13 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/58688751' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-08T20:36:13.982 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:13 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/250303272' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-08T20:36:13.983 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-08T20:36:13.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:36:13.983 DEBUG:teuthology.orchestra.run.smithi043:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-08T20:36:14.022 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2023-12-08T20:36:14.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:36:14.023 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T20:36:14.129 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-12-08T20:36:14.129 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T20:36:14.210 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2023-12-08T20:36:14.210 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T20:36:14.310 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T20:36:14.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.452+0000 7f7adeca4700 1 -- 172.21.15.43:0/3344822094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ad81019b0 msgr2=0x7f7ad8101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:14.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.452+0000 7f7adeca4700 1 --2- 172.21.15.43:0/3344822094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ad81019b0 0x7f7ad8101d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8004940 tx=0x7f7ac8009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:14.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.452+0000 7f7adeca4700 1 -- 172.21.15.43:0/3344822094 shutdown_connections 2023-12-08T20:36:14.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.452+0000 7f7adeca4700 1 --2- 172.21.15.43:0/3344822094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ad80fb970 0x7f7ad80fbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:14.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.452+0000 7f7adeca4700 1 --2- 172.21.15.43:0/3344822094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ad81019b0 0x7f7ad8101d80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:14.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.452+0000 7f7adeca4700 1 -- 172.21.15.43:0/3344822094 >> 172.21.15.43:0/3344822094 conn(0x7f7ad80756d0 msgr2=0x7f7ad80f99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:14.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.452+0000 7f7adeca4700 1 -- 172.21.15.43:0/3344822094 shutdown_connections 2023-12-08T20:36:14.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.452+0000 7f7adeca4700 1 -- 172.21.15.43:0/3344822094 wait complete. 2023-12-08T20:36:14.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.452+0000 7f7adeca4700 1 Processor -- start 2023-12-08T20:36:14.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.452+0000 7f7adeca4700 1 -- start start 2023-12-08T20:36:14.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.453+0000 7f7adeca4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ad80fb970 0x7f7ad810e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:14.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.453+0000 7f7adeca4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ad81019b0 0x7f7ad810e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:14.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.453+0000 7f7adeca4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad810ecf0 con 0x7f7ad80fb970 2023-12-08T20:36:14.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.453+0000 7f7adeca4700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad810ee30 con 0x7f7ad81019b0 2023-12-08T20:36:14.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.453+0000 7f7adca40700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ad80fb970 0x7f7ad810e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:14.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.453+0000 7f7adca40700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ad80fb970 0x7f7ad810e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58856/0 (socket says 172.21.15.43:58856) 2023-12-08T20:36:14.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.453+0000 7f7adca40700 1 -- 172.21.15.43:0/2270459909 learned_addr learned my addr 172.21.15.43:0/2270459909 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:36:14.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.453+0000 7f7ad7fff700 1 --2- 172.21.15.43:0/2270459909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ad81019b0 0x7f7ad810e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:14.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.453+0000 7f7adca40700 1 -- 172.21.15.43:0/2270459909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ad81019b0 msgr2=0x7f7ad810e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:14.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.453+0000 7f7adca40700 1 --2- 172.21.15.43:0/2270459909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ad81019b0 0x7f7ad810e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:14.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.453+0000 7f7adca40700 1 -- 172.21.15.43:0/2270459909 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac8005040 con 0x7f7ad80fb970 2023-12-08T20:36:14.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.453+0000 7f7ad7fff700 1 --2- 172.21.15.43:0/2270459909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ad81019b0 0x7f7ad810e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T20:36:14.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.454+0000 7f7adca40700 1 --2- 172.21.15.43:0/2270459909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ad80fb970 0x7f7ad810e270 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8000c00 tx=0x7f7ac8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:14.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.454+0000 7f7ad57fa700 1 -- 172.21.15.43:0/2270459909 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ac8021070 con 0x7f7ad80fb970 2023-12-08T20:36:14.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.454+0000 7f7ad57fa700 1 -- 172.21.15.43:0/2270459909 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7ac801c400 con 0x7f7ad80fb970 2023-12-08T20:36:14.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.454+0000 7f7adeca4700 1 -- 172.21.15.43:0/2270459909 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad810f0b0 con 0x7f7ad80fb970 2023-12-08T20:36:14.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.454+0000 7f7ad57fa700 1 -- 172.21.15.43:0/2270459909 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ac800e070 con 0x7f7ad80fb970 2023-12-08T20:36:14.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.454+0000 7f7adeca4700 1 -- 172.21.15.43:0/2270459909 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad8117680 con 0x7f7ad80fb970 2023-12-08T20:36:14.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.455+0000 7f7adeca4700 1 -- 172.21.15.43:0/2270459909 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad8064730 con 0x7f7ad80fb970 2023-12-08T20:36:14.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.455+0000 7f7ad57fa700 1 -- 172.21.15.43:0/2270459909 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f7ac801c970 con 0x7f7ad80fb970 2023-12-08T20:36:14.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.456+0000 7f7ad57fa700 1 --2- 172.21.15.43:0/2270459909 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7ac406ce60 0x7f7ac406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:14.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.456+0000 7f7ad57fa700 1 -- 172.21.15.43:0/2270459909 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f7ac808d390 con 0x7f7ad80fb970 2023-12-08T20:36:14.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.456+0000 7f7ad7fff700 1 --2- 172.21.15.43:0/2270459909 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7ac406ce60 0x7f7ac406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:14.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.456+0000 7f7ad7fff700 1 --2- 172.21.15.43:0/2270459909 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7ac406ce60 0x7f7ac406f310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8065430 tx=0x7f7ac000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:14.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.461+0000 7f7ad57fa700 1 -- 172.21.15.43:0/2270459909 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7ac8057340 con 0x7f7ad80fb970 2023-12-08T20:36:14.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.672+0000 7f7adeca4700 1 -- 172.21.15.43:0/2270459909 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ad8117870 con 0x7f7ad80fb970 2023-12-08T20:36:14.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.673+0000 7f7ad57fa700 1 -- 172.21.15.43:0/2270459909 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16263 (secure 0 0 0) 0x7f7ac805a960 con 0x7f7ad80fb970 2023-12-08T20:36:14.676 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-12-08T20:36:14.676 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":80,"fsid":"28476818-9607-11ee-95a3-87774f69a715","created":"2023-12-08T20:20:31.669394+0000","modified":"2023-12-08T20:34:46.778471+0000","last_up_change":"2023-12-08T20:34:45.776816+0000","last_in_change":"2023-12-08T20:24:32.898273+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T20:23:57.952150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-08T20:25:40.366334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-08T20:25:40.972845+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5c82b664-c209-4a61-8b21-c5d6a73af81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":4101340685},{"type":"v1","addr":"172.21.15.43:6803","nonce":4101340685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":4101340685},{"type":"v1","addr":"172.21.15.43:6805","nonce":4101340685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":4101340685},{"type":"v1","addr":"172.21.15.43:6809","nonce":4101340685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":4101340685},{"type":"v1","addr":"172.21.15.43:6807","nonce":4101340685}]},"public_addr":"172.21.15.43:6803/4101340685","cluster_addr":"172.21.15.43:6805/4101340685","heartbeat_back_addr":"172.21.15.43:6809/4101340685","heartbeat_front_addr":"172.21.15.43:6807/4101340685","state":["exists","up"]},{"osd":1,"uuid":"301dfde9-c50a-4f73-856f-ae88dc2d2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":565859461},{"type":"v1","addr":"172.21.15.43:6811","nonce":565859461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":565859461},{"type":"v1","addr":"172.21.15.43:6813","nonce":565859461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":565859461},{"type":"v1","addr":"172.21.15.43:6817","nonce":565859461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":565859461},{"type":"v1","addr":"172.21.15.43:6815","nonce":565859461}]},"public_addr":"172.21.15.43:6811/565859461","cluster_addr":"172.21.15.43:6813/565859461","heartbeat_back_addr":"172.21.15.43:6817/565859461","heartbeat_front_addr":"172.21.15.43:6815/565859461","state":["exists","up"]},{"osd":2,"uuid":"bc7be655-1abc-4982-a674-b78d9f7dc1ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":242438115},{"type":"v1","addr":"172.21.15.43:6819","nonce":242438115}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":242438115},{"type":"v1","addr":"172.21.15.43:6821","nonce":242438115}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":242438115},{"type":"v1","addr":"172.21.15.43:6825","nonce":242438115}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":242438115},{"type":"v1","addr":"172.21.15.43:6823","nonce":242438115}]},"public_addr":"172.21.15.43:6819/242438115","cluster_addr":"172.21.15.43:6821/242438115","heartbeat_back_addr":"172.21.15.43:6825/242438115","heartbeat_front_addr":"172.21.15.43:6823/242438115","state":["exists","up"]},{"osd":3,"uuid":"0c0628df-2c6b-40ce-97e2-141d2057af11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":118153540},{"type":"v1","addr":"172.21.15.111:6801","nonce":118153540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":118153540},{"type":"v1","addr":"172.21.15.111:6803","nonce":118153540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":118153540},{"type":"v1","addr":"172.21.15.111:6807","nonce":118153540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":118153540},{"type":"v1","addr":"172.21.15.111:6805","nonce":118153540}]},"public_addr":"172.21.15.111:6801/118153540","cluster_addr":"172.21.15.111:6803/118153540","heartbeat_back_addr":"172.21.15.111:6807/118153540","heartbeat_front_addr":"172.21.15.111:6805/118153540","state":["exists","up"]},{"osd":4,"uuid":"87b65c6d-d7c2-44d7-b891-8477e5e891b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":552414651},{"type":"v1","addr":"172.21.15.111:6809","nonce":552414651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":552414651},{"type":"v1","addr":"172.21.15.111:6811","nonce":552414651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":552414651},{"type":"v1","addr":"172.21.15.111:6815","nonce":552414651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":552414651},{"type":"v1","addr":"172.21.15.111:6813","nonce":552414651}]},"public_addr":"172.21.15.111:6809/552414651","cluster_addr":"172.21.15.111:6811/552414651","heartbeat_back_addr":"172.21.15.111:6815/552414651","heartbeat_front_addr":"172.21.15.111:6813/552414651","state":["exists","up"]},{"osd":5,"uuid":"6a99cd97-6a80-4d01-bb37-a159803f7333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2321927187},{"type":"v1","addr":"172.21.15.111:6817","nonce":2321927187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2321927187},{"type":"v1","addr":"172.21.15.111:6819","nonce":2321927187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2321927187},{"type":"v1","addr":"172.21.15.111:6823","nonce":2321927187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2321927187},{"type":"v1","addr":"172.21.15.111:6821","nonce":2321927187}]},"public_addr":"172.21.15.111:6817/2321927187","cluster_addr":"172.21.15.111:6819/2321927187","heartbeat_back_addr":"172.21.15.111:6823/2321927187","heartbeat_front_addr":"172.21.15.111:6821/2321927187","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:23:11.583744+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:23:33.216409+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:23:54.174665+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:24:11.801925+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:24:29.476994+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T20:24:47.562110+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/1578286032":"2023-12-09T20:31:13.867849+0000","172.21.15.43:6801/2216649665":"2023-12-09T20:31:13.867849+0000","172.21.15.43:0/2638250357":"2023-12-09T20:31:13.867849+0000","172.21.15.43:6801/1561199606":"2023-12-09T20:21:27.333855+0000","172.21.15.43:6800/1561199606":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/2345173464":"2023-12-09T20:21:27.333855+0000","172.21.15.43:0/1958100424":"2023-12-09T20:27:21.191384+0000","172.21.15.111:0/1730171069":"2023-12-09T20:28:39.993505+0000","172.21.15.43:0/1298471102":"2023-12-09T20:21:01.600933+0000","172.21.15.43:0/3678520486":"2023-12-09T20:22:19.417857+0000","172.21.15.43:6800/2315465125":"2023-12-09T20:22:19.417857+0000","172.21.15.111:0/2899706571":"2023-12-09T20:28:39.993505+0000","172.21.15.43:0/392501150":"2023-12-09T20:22:19.417857+0000","172.21.15.43:0/940236816":"2023-12-09T20:31:13.867849+0000","172.21.15.111:6829/940639390":"2023-12-09T20:28:39.993505+0000","172.21.15.43:0/3758242596":"2023-12-09T20:21:27.333855+0000","172.21.15.43:6801/2195776328":"2023-12-09T20:21:01.600933+0000","172.21.15.43:0/3571683356":"2023-12-09T20:21:01.600933+0000","172.21.15.43:6800/2216649665":"2023-12-09T20:31:13.867849+0000","172.21.15.43:0/993195790":"2023-12-09T20:27:21.191384+0000","172.21.15.111:0/3272445197":"2023-12-09T20:28:39.993505+0000","172.21.15.111:0/3981107380":"2023-12-09T20:28:39.993505+0000","172.21.15.43:0/2976228612":"2023-12-09T20:21:01.600933+0000","172.21.15.43:6801/2315465125":"2023-12-09T20:22:19.417857+0000","172.21.15.43:0/3231089927":"2023-12-09T20:27:21.191384+0000","172.21.15.111:0/2497747504":"2023-12-09T20:28:39.993505+0000","172.21.15.111:6828/940639390":"2023-12-09T20:28:39.993505+0000","172.21.15.43:0/4033535283":"2023-12-09T20:22:19.417857+0000","172.21.15.43:0/4006048852":"2023-12-09T20:27:21.191384+0000","172.21.15.111:0/1498484547":"2023-12-09T20:28:39.993505+0000","172.21.15.43:0/2451027781":"2023-12-09T20:21:27.333855+0000","172.21.15.43:6800/2195776328":"2023-12-09T20:21:01.600933+0000","172.21.15.43:0/1875438884":"2023-12-09T20:31:13.867849+0000","172.21.15.43:6800/3959093322":"2023-12-09T20:27:21.191384+0000","172.21.15.43:6801/3959093322":"2023-12-09T20:27:21.191384+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T20:36:14.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.676+0000 7f7adeca4700 1 -- 172.21.15.43:0/2270459909 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7ac406ce60 msgr2=0x7f7ac406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:14.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.676+0000 7f7adeca4700 1 --2- 172.21.15.43:0/2270459909 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7ac406ce60 0x7f7ac406f310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8065430 tx=0x7f7ac000b040 comp rx=0 tx=0).stop 2023-12-08T20:36:14.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.676+0000 7f7adeca4700 1 -- 172.21.15.43:0/2270459909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ad80fb970 msgr2=0x7f7ad810e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:14.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.676+0000 7f7adeca4700 1 --2- 172.21.15.43:0/2270459909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ad80fb970 0x7f7ad810e270 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8000c00 tx=0x7f7ac8009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:14.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.676+0000 7f7adeca4700 1 -- 172.21.15.43:0/2270459909 shutdown_connections 2023-12-08T20:36:14.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.676+0000 7f7adeca4700 1 --2- 172.21.15.43:0/2270459909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ad80fb970 0x7f7ad810e270 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.676+0000 7f7adeca4700 1 --2- 172.21.15.43:0/2270459909 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f7ac406ce60 0x7f7ac406f310 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.676+0000 7f7adeca4700 1 --2- 172.21.15.43:0/2270459909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ad81019b0 0x7f7ad810e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.676+0000 7f7adeca4700 1 -- 172.21.15.43:0/2270459909 >> 172.21.15.43:0/2270459909 conn(0x7f7ad80756d0 msgr2=0x7f7ad80728a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.676+0000 7f7adeca4700 1 -- 172.21.15.43:0/2270459909 shutdown_connections 2023-12-08T20:36:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.676+0000 7f7adeca4700 1 -- 172.21.15.43:0/2270459909 wait complete. 2023-12-08T20:36:14.692 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T20:23:57.952150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-08T20:25:40.366334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-08T20:25:40.972845+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T20:36:14.693 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T20:36:14.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.828+0000 7fb314dc9700 1 -- 172.21.15.43:0/3153565461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb310101c50 msgr2=0x7fb310102020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:14.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.828+0000 7fb314dc9700 1 --2- 172.21.15.43:0/3153565461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb310101c50 0x7fb310102020 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb300004940 tx=0x7fb300009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:14.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.828+0000 7fb314dc9700 1 -- 172.21.15.43:0/3153565461 shutdown_connections 2023-12-08T20:36:14.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.828+0000 7fb314dc9700 1 --2- 172.21.15.43:0/3153565461 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3101025f0 0x7fb3100fbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:14.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.828+0000 7fb314dc9700 1 --2- 172.21.15.43:0/3153565461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb310101c50 0x7fb310102020 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:14.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.828+0000 7fb314dc9700 1 -- 172.21.15.43:0/3153565461 >> 172.21.15.43:0/3153565461 conn(0x7fb3100f77a0 msgr2=0x7fb3100f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:14.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.828+0000 7fb314dc9700 1 -- 172.21.15.43:0/3153565461 shutdown_connections 2023-12-08T20:36:14.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.828+0000 7fb314dc9700 1 -- 172.21.15.43:0/3153565461 wait complete. 2023-12-08T20:36:14.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.829+0000 7fb314dc9700 1 Processor -- start 2023-12-08T20:36:14.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.829+0000 7fb314dc9700 1 -- start start 2023-12-08T20:36:14.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.829+0000 7fb314dc9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb310101c50 0x7fb310113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:14.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.829+0000 7fb314dc9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3101025f0 0x7fb310113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:14.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.829+0000 7fb314dc9700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb310114090 con 0x7fb3101025f0 2023-12-08T20:36:14.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.829+0000 7fb314dc9700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31010d5d0 con 0x7fb310101c50 2023-12-08T20:36:14.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.829+0000 7fb30dd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3101025f0 0x7fb310113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:14.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.829+0000 7fb30e59c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb310101c50 0x7fb310113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:14.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.829+0000 7fb30dd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3101025f0 0x7fb310113a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58878/0 (socket says 172.21.15.43:58878) 2023-12-08T20:36:14.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.829+0000 7fb30dd9b700 1 -- 172.21.15.43:0/3625814747 learned_addr learned my addr 172.21.15.43:0/3625814747 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:36:14.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.830+0000 7fb30dd9b700 1 -- 172.21.15.43:0/3625814747 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb310101c50 msgr2=0x7fb310113500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:14.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.830+0000 7fb30dd9b700 1 --2- 172.21.15.43:0/3625814747 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb310101c50 0x7fb310113500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:14.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.830+0000 7fb30dd9b700 1 -- 172.21.15.43:0/3625814747 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb300005040 con 0x7fb3101025f0 2023-12-08T20:36:14.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.830+0000 7fb30e59c700 1 --2- 172.21.15.43:0/3625814747 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb310101c50 0x7fb310113500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T20:36:14.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.830+0000 7fb30dd9b700 1 --2- 172.21.15.43:0/3625814747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3101025f0 0x7fb310113a40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800eb40 tx=0x7fb2f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:14.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.830+0000 7fb306ffd700 1 -- 172.21.15.43:0/3625814747 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2f8007cc0 con 0x7fb3101025f0 2023-12-08T20:36:14.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.830+0000 7fb306ffd700 1 -- 172.21.15.43:0/3625814747 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb2f800f040 con 0x7fb3101025f0 2023-12-08T20:36:14.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.830+0000 7fb314dc9700 1 -- 172.21.15.43:0/3625814747 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb31010d850 con 0x7fb3101025f0 2023-12-08T20:36:14.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.830+0000 7fb306ffd700 1 -- 172.21.15.43:0/3625814747 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2f800c8f0 con 0x7fb3101025f0 2023-12-08T20:36:14.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.830+0000 7fb314dc9700 1 -- 172.21.15.43:0/3625814747 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31010de10 con 0x7fb3101025f0 2023-12-08T20:36:14.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.831+0000 7fb314dc9700 1 -- 172.21.15.43:0/3625814747 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb310064b80 con 0x7fb3101025f0 2023-12-08T20:36:14.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.832+0000 7fb306ffd700 1 -- 172.21.15.43:0/3625814747 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fb2f80090d0 con 0x7fb3101025f0 2023-12-08T20:36:14.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.832+0000 7fb306ffd700 1 --2- 172.21.15.43:0/3625814747 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb2fc06ce70 0x7fb2fc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:14.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.832+0000 7fb306ffd700 1 -- 172.21.15.43:0/3625814747 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb2f808bbe0 con 0x7fb3101025f0 2023-12-08T20:36:14.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.832+0000 7fb30e59c700 1 --2- 172.21.15.43:0/3625814747 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb2fc06ce70 0x7fb2fc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:14.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.833+0000 7fb30e59c700 1 --2- 172.21.15.43:0/3625814747 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb2fc06ce70 0x7fb2fc06f320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb300009fd0 tx=0x7fb300009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:14.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:14.837+0000 7fb306ffd700 1 -- 172.21.15.43:0/3625814747 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb2f80596d0 con 0x7fb3101025f0 2023-12-08T20:36:14.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:14 smithi111 ceph-mon[182474]: pgmap v183: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:36:14.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:14 smithi111 ceph-mon[182474]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:36:14.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:14 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/2958034913' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-08T20:36:15.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:14 smithi043 ceph-mon[219193]: pgmap v183: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-08T20:36:15.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:14 smithi043 ceph-mon[219193]: from='mgr.34104 172.21.15.43:0/362845004' entity='mgr.smithi043.hqcdcm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-08T20:36:15.014 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:14 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/2958034913' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-08T20:36:15.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.048+0000 7fb314dc9700 1 -- 172.21.15.43:0/3625814747 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb31010eae0 con 0x7fb3101025f0 2023-12-08T20:36:15.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.048+0000 7fb306ffd700 1 -- 172.21.15.43:0/3625814747 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2f8019020 con 0x7fb3101025f0 2023-12-08T20:36:15.051 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-12-08T20:36:15.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.051+0000 7fb314dc9700 1 -- 172.21.15.43:0/3625814747 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb2fc06ce70 msgr2=0x7fb2fc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:15.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.051+0000 7fb314dc9700 1 --2- 172.21.15.43:0/3625814747 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb2fc06ce70 0x7fb2fc06f320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb300009fd0 tx=0x7fb300009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:15.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.051+0000 7fb314dc9700 1 -- 172.21.15.43:0/3625814747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3101025f0 msgr2=0x7fb310113a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:15.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.051+0000 7fb314dc9700 1 --2- 172.21.15.43:0/3625814747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3101025f0 0x7fb310113a40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800eb40 tx=0x7fb2f800b040 comp rx=0 tx=0).stop 2023-12-08T20:36:15.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.051+0000 7fb314dc9700 1 -- 172.21.15.43:0/3625814747 shutdown_connections 2023-12-08T20:36:15.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.051+0000 7fb314dc9700 1 --2- 172.21.15.43:0/3625814747 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7fb2fc06ce70 0x7fb2fc06f320 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:15.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.051+0000 7fb314dc9700 1 --2- 172.21.15.43:0/3625814747 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb310101c50 0x7fb310113500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:15.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.051+0000 7fb314dc9700 1 --2- 172.21.15.43:0/3625814747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3101025f0 0x7fb310113a40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:15.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.051+0000 7fb314dc9700 1 -- 172.21.15.43:0/3625814747 >> 172.21.15.43:0/3625814747 conn(0x7fb3100f77a0 msgr2=0x7fb310065ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:15.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.051+0000 7fb314dc9700 1 -- 172.21.15.43:0/3625814747 shutdown_connections 2023-12-08T20:36:15.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.051+0000 7fb314dc9700 1 -- 172.21.15.43:0/3625814747 wait complete. 2023-12-08T20:36:15.067 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-08T20:36:15.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.201+0000 7f0e9aeda700 1 -- 172.21.15.43:0/3066144542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e940fba80 msgr2=0x7f0e940fbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:15.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.201+0000 7f0e9aeda700 1 --2- 172.21.15.43:0/3066144542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e940fba80 0x7f0e940fbef0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0e80004940 tx=0x7f0e80009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:15.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.201+0000 7f0e9aeda700 1 -- 172.21.15.43:0/3066144542 shutdown_connections 2023-12-08T20:36:15.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.201+0000 7f0e9aeda700 1 --2- 172.21.15.43:0/3066144542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e940fba80 0x7f0e940fbef0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:15.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.201+0000 7f0e9aeda700 1 --2- 172.21.15.43:0/3066144542 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0e94101ac0 0x7f0e94101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:15.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.201+0000 7f0e9aeda700 1 -- 172.21.15.43:0/3066144542 >> 172.21.15.43:0/3066144542 conn(0x7f0e940f7600 msgr2=0x7f0e940f9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:15.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.201+0000 7f0e9aeda700 1 -- 172.21.15.43:0/3066144542 shutdown_connections 2023-12-08T20:36:15.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.201+0000 7f0e9aeda700 1 -- 172.21.15.43:0/3066144542 wait complete. 2023-12-08T20:36:15.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.202+0000 7f0e9aeda700 1 Processor -- start 2023-12-08T20:36:15.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.202+0000 7f0e9aeda700 1 -- start start 2023-12-08T20:36:15.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.202+0000 7f0e9aeda700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e940fba80 0x7f0e94113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:15.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.202+0000 7f0e9aeda700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0e94101ac0 0x7f0e94113870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:15.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.202+0000 7f0e9aeda700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e94113ec0 con 0x7f0e940fba80 2023-12-08T20:36:15.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.202+0000 7f0e9aeda700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9410d3e0 con 0x7f0e94101ac0 2023-12-08T20:36:15.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.202+0000 7f0e98c76700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e940fba80 0x7f0e94113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:15.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.202+0000 7f0e98c76700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e940fba80 0x7f0e94113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58904/0 (socket says 172.21.15.43:58904) 2023-12-08T20:36:15.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.202+0000 7f0e98c76700 1 -- 172.21.15.43:0/3860214715 learned_addr learned my addr 172.21.15.43:0/3860214715 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:36:15.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.203+0000 7f0e93fff700 1 --2- 172.21.15.43:0/3860214715 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0e94101ac0 0x7f0e94113870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:15.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.203+0000 7f0e98c76700 1 -- 172.21.15.43:0/3860214715 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0e94101ac0 msgr2=0x7f0e94113870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:15.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.203+0000 7f0e98c76700 1 --2- 172.21.15.43:0/3860214715 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0e94101ac0 0x7f0e94113870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:15.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.203+0000 7f0e98c76700 1 -- 172.21.15.43:0/3860214715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e80005040 con 0x7f0e940fba80 2023-12-08T20:36:15.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.203+0000 7f0e98c76700 1 --2- 172.21.15.43:0/3860214715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e940fba80 0x7f0e94113330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800c8c0 tx=0x7f0e880044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:15.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.203+0000 7f0e917fa700 1 -- 172.21.15.43:0/3860214715 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e8800a980 con 0x7f0e940fba80 2023-12-08T20:36:15.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.203+0000 7f0e9aeda700 1 -- 172.21.15.43:0/3860214715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9410d6c0 con 0x7f0e940fba80 2023-12-08T20:36:15.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.203+0000 7f0e917fa700 1 -- 172.21.15.43:0/3860214715 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0e8800ce60 con 0x7f0e940fba80 2023-12-08T20:36:15.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.203+0000 7f0e917fa700 1 -- 172.21.15.43:0/3860214715 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e880113a0 con 0x7f0e940fba80 2023-12-08T20:36:15.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.203+0000 7f0e9aeda700 1 -- 172.21.15.43:0/3860214715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9410dba0 con 0x7f0e940fba80 2023-12-08T20:36:15.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.204+0000 7f0e9aeda700 1 -- 172.21.15.43:0/3860214715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e94063ea0 con 0x7f0e940fba80 2023-12-08T20:36:15.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.205+0000 7f0e917fa700 1 -- 172.21.15.43:0/3860214715 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f0e88012400 con 0x7f0e940fba80 2023-12-08T20:36:15.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.205+0000 7f0e917fa700 1 --2- 172.21.15.43:0/3860214715 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f0e8406ce60 0x7f0e8406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:15.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.206+0000 7f0e93fff700 1 --2- 172.21.15.43:0/3860214715 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f0e8406ce60 0x7f0e8406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:15.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.206+0000 7f0e917fa700 1 -- 172.21.15.43:0/3860214715 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f0e8808c390 con 0x7f0e940fba80 2023-12-08T20:36:15.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.206+0000 7f0e93fff700 1 --2- 172.21.15.43:0/3860214715 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f0e8406ce60 0x7f0e8406f310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e80004f90 tx=0x7f0e80009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:15.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.211+0000 7f0e917fa700 1 -- 172.21.15.43:0/3860214715 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0e88059dd0 con 0x7f0e940fba80 2023-12-08T20:36:15.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.421+0000 7f0e9aeda700 1 -- 172.21.15.43:0/3860214715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f0e94108a40 con 0x7f0e940fba80 2023-12-08T20:36:15.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.422+0000 7f0e917fa700 1 -- 172.21.15.43:0/3860214715 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v80) v1 ==== 107+0+11 (secure 0 0 0) 0x7f0e94108a40 con 0x7f0e940fba80 2023-12-08T20:36:15.424 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-12-08T20:36:15.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.424+0000 7f0e9aeda700 1 -- 172.21.15.43:0/3860214715 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f0e8406ce60 msgr2=0x7f0e8406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:15.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.424+0000 7f0e9aeda700 1 --2- 172.21.15.43:0/3860214715 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f0e8406ce60 0x7f0e8406f310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e80004f90 tx=0x7f0e80009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:15.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.424+0000 7f0e9aeda700 1 -- 172.21.15.43:0/3860214715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e940fba80 msgr2=0x7f0e94113330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:15.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.424+0000 7f0e9aeda700 1 --2- 172.21.15.43:0/3860214715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e940fba80 0x7f0e94113330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800c8c0 tx=0x7f0e880044c0 comp rx=0 tx=0).stop 2023-12-08T20:36:15.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.424+0000 7f0e9aeda700 1 -- 172.21.15.43:0/3860214715 shutdown_connections 2023-12-08T20:36:15.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.424+0000 7f0e9aeda700 1 --2- 172.21.15.43:0/3860214715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e940fba80 0x7f0e94113330 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:15.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.424+0000 7f0e9aeda700 1 --2- 172.21.15.43:0/3860214715 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f0e8406ce60 0x7f0e8406f310 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:15.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.424+0000 7f0e9aeda700 1 --2- 172.21.15.43:0/3860214715 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0e94101ac0 0x7f0e94113870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:15.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.424+0000 7f0e9aeda700 1 -- 172.21.15.43:0/3860214715 >> 172.21.15.43:0/3860214715 conn(0x7f0e940f7600 msgr2=0x7f0e94065910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:15.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.424+0000 7f0e9aeda700 1 -- 172.21.15.43:0/3860214715 shutdown_connections 2023-12-08T20:36:15.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.424+0000 7f0e9aeda700 1 -- 172.21.15.43:0/3860214715 wait complete. 2023-12-08T20:36:15.440 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-08T20:36:15.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.574+0000 7f4c8fcac700 1 -- 172.21.15.43:0/1432964564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c880fb8d0 msgr2=0x7f4c880fbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:15.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.574+0000 7f4c8fcac700 1 --2- 172.21.15.43:0/1432964564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c880fb8d0 0x7f4c880fbca0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009ce0 tx=0x7f4c78004d10 comp rx=0 tx=0).stop 2023-12-08T20:36:15.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.575+0000 7f4c8fcac700 1 -- 172.21.15.43:0/1432964564 shutdown_connections 2023-12-08T20:36:15.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.575+0000 7f4c8fcac700 1 --2- 172.21.15.43:0/1432964564 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c880fc1e0 0x7f4c88108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:15.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.575+0000 7f4c8fcac700 1 --2- 172.21.15.43:0/1432964564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c880fb8d0 0x7f4c880fbca0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:15.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.575+0000 7f4c8fcac700 1 -- 172.21.15.43:0/1432964564 >> 172.21.15.43:0/1432964564 conn(0x7f4c880f7600 msgr2=0x7f4c880f9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:15.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.575+0000 7f4c8fcac700 1 -- 172.21.15.43:0/1432964564 shutdown_connections 2023-12-08T20:36:15.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.575+0000 7f4c8fcac700 1 -- 172.21.15.43:0/1432964564 wait complete. 2023-12-08T20:36:15.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.575+0000 7f4c8fcac700 1 Processor -- start 2023-12-08T20:36:15.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.575+0000 7f4c8fcac700 1 -- start start 2023-12-08T20:36:15.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.575+0000 7f4c8fcac700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c880fb8d0 0x7f4c881155e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:15.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.575+0000 7f4c8fcac700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c880fc1e0 0x7f4c88115b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:15.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.575+0000 7f4c8fcac700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c88116170 con 0x7f4c880fb8d0 2023-12-08T20:36:15.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.575+0000 7f4c8fcac700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8810f6b0 con 0x7f4c880fc1e0 2023-12-08T20:36:15.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.576+0000 7f4c8da48700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c880fb8d0 0x7f4c881155e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:15.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.576+0000 7f4c8da48700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c880fb8d0 0x7f4c881155e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58912/0 (socket says 172.21.15.43:58912) 2023-12-08T20:36:15.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.576+0000 7f4c8da48700 1 -- 172.21.15.43:0/1639876006 learned_addr learned my addr 172.21.15.43:0/1639876006 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:36:15.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.576+0000 7f4c8d247700 1 --2- 172.21.15.43:0/1639876006 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c880fc1e0 0x7f4c88115b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:15.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.576+0000 7f4c8da48700 1 -- 172.21.15.43:0/1639876006 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c880fc1e0 msgr2=0x7f4c88115b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:15.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.576+0000 7f4c8da48700 1 --2- 172.21.15.43:0/1639876006 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c880fc1e0 0x7f4c88115b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:15.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.576+0000 7f4c8da48700 1 -- 172.21.15.43:0/1639876006 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c78009940 con 0x7f4c880fb8d0 2023-12-08T20:36:15.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.576+0000 7f4c8da48700 1 --2- 172.21.15.43:0/1639876006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c880fb8d0 0x7f4c881155e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009360 tx=0x7f4c78004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:15.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.576+0000 7f4c867fc700 1 -- 172.21.15.43:0/1639876006 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c7800e040 con 0x7f4c880fb8d0 2023-12-08T20:36:15.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.576+0000 7f4c867fc700 1 -- 172.21.15.43:0/1639876006 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4c78004610 con 0x7f4c880fb8d0 2023-12-08T20:36:15.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.576+0000 7f4c8fcac700 1 -- 172.21.15.43:0/1639876006 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8810f930 con 0x7f4c880fb8d0 2023-12-08T20:36:15.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.576+0000 7f4c867fc700 1 -- 172.21.15.43:0/1639876006 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c78012b80 con 0x7f4c880fb8d0 2023-12-08T20:36:15.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.576+0000 7f4c8fcac700 1 -- 172.21.15.43:0/1639876006 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8810fef0 con 0x7f4c880fb8d0 2023-12-08T20:36:15.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.577+0000 7f4c8fcac700 1 -- 172.21.15.43:0/1639876006 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c88106670 con 0x7f4c880fb8d0 2023-12-08T20:36:15.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.578+0000 7f4c867fc700 1 -- 172.21.15.43:0/1639876006 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f4c7801c830 con 0x7f4c880fb8d0 2023-12-08T20:36:15.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.578+0000 7f4c867fc700 1 --2- 172.21.15.43:0/1639876006 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f4c7006ce70 0x7f4c7006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:15.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.579+0000 7f4c8d247700 1 --2- 172.21.15.43:0/1639876006 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f4c7006ce70 0x7f4c7006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:15.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.579+0000 7f4c867fc700 1 -- 172.21.15.43:0/1639876006 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f4c7808e5b0 con 0x7f4c880fb8d0 2023-12-08T20:36:15.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.579+0000 7f4c8d247700 1 --2- 172.21.15.43:0/1639876006 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f4c7006ce70 0x7f4c7006f320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c004600 tx=0x7f4c7c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:15.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.584+0000 7f4c867fc700 1 -- 172.21.15.43:0/1639876006 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4c7805bf50 con 0x7f4c880fb8d0 2023-12-08T20:36:15.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:15 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/2270459909' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-08T20:36:15.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:15 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/3625814747' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-08T20:36:15.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:15 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/3860214715' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-08T20:36:15.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.793+0000 7f4c8fcac700 1 -- 172.21.15.43:0/1639876006 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f4c88110bc0 con 0x7f4c880fb8d0 2023-12-08T20:36:15.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.793+0000 7f4c867fc700 1 -- 172.21.15.43:0/1639876006 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v80) v1 ==== 107+0+11 (secure 0 0 0) 0x7f4c7805bae0 con 0x7f4c880fb8d0 2023-12-08T20:36:15.796 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-12-08T20:36:15.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.796+0000 7f4c8fcac700 1 -- 172.21.15.43:0/1639876006 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f4c7006ce70 msgr2=0x7f4c7006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:15.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.796+0000 7f4c8fcac700 1 --2- 172.21.15.43:0/1639876006 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f4c7006ce70 0x7f4c7006f320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c004600 tx=0x7f4c7c00b040 comp rx=0 tx=0).stop 2023-12-08T20:36:15.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.796+0000 7f4c8fcac700 1 -- 172.21.15.43:0/1639876006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c880fb8d0 msgr2=0x7f4c881155e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:15.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.796+0000 7f4c8fcac700 1 --2- 172.21.15.43:0/1639876006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c880fb8d0 0x7f4c881155e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009360 tx=0x7f4c78004d10 comp rx=0 tx=0).stop 2023-12-08T20:36:15.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.796+0000 7f4c8fcac700 1 -- 172.21.15.43:0/1639876006 shutdown_connections 2023-12-08T20:36:15.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.796+0000 7f4c8fcac700 1 --2- 172.21.15.43:0/1639876006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c880fb8d0 0x7f4c881155e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:15.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.796+0000 7f4c8fcac700 1 --2- 172.21.15.43:0/1639876006 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f4c7006ce70 0x7f4c7006f320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:15.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.796+0000 7f4c8fcac700 1 --2- 172.21.15.43:0/1639876006 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c880fc1e0 0x7f4c88115b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:15.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.796+0000 7f4c8fcac700 1 -- 172.21.15.43:0/1639876006 >> 172.21.15.43:0/1639876006 conn(0x7f4c880f7600 msgr2=0x7f4c880f8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:15.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.796+0000 7f4c8fcac700 1 -- 172.21.15.43:0/1639876006 shutdown_connections 2023-12-08T20:36:15.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.796+0000 7f4c8fcac700 1 -- 172.21.15.43:0/1639876006 wait complete. 2023-12-08T20:36:15.812 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T20:36:15.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.943+0000 7f3bf8eef700 1 -- 172.21.15.43:0/1533958475 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf4102bb0 msgr2=0x7f3bf4102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:15.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.943+0000 7f3bf8eef700 1 --2- 172.21.15.43:0/1533958475 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf4102bb0 0x7f3bf4102f80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3be4004940 tx=0x7f3be4009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:15.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.944+0000 7f3bf8eef700 1 -- 172.21.15.43:0/1533958475 shutdown_connections 2023-12-08T20:36:15.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.944+0000 7f3bf8eef700 1 --2- 172.21.15.43:0/1533958475 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bf4064bb0 0x7f3bf4065000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:15.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.944+0000 7f3bf8eef700 1 --2- 172.21.15.43:0/1533958475 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf4102bb0 0x7f3bf4102f80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:15.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.944+0000 7f3bf8eef700 1 -- 172.21.15.43:0/1533958475 >> 172.21.15.43:0/1533958475 conn(0x7f3bf4071970 msgr2=0x7f3bf4071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:15.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.944+0000 7f3bf8eef700 1 -- 172.21.15.43:0/1533958475 shutdown_connections 2023-12-08T20:36:15.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.944+0000 7f3bf8eef700 1 -- 172.21.15.43:0/1533958475 wait complete. 2023-12-08T20:36:15.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.944+0000 7f3bf8eef700 1 Processor -- start 2023-12-08T20:36:15.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.944+0000 7f3bf8eef700 1 -- start start 2023-12-08T20:36:15.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.944+0000 7f3bf8eef700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf4064bb0 0x7f3bf4113340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:15.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.944+0000 7f3bf8eef700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bf4102bb0 0x7f3bf4113880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:15.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.944+0000 7f3bf8eef700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf4113ed0 con 0x7f3bf4064bb0 2023-12-08T20:36:15.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.944+0000 7f3bf8eef700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf410d3f0 con 0x7f3bf4102bb0 2023-12-08T20:36:15.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.945+0000 7f3bf259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf4064bb0 0x7f3bf4113340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:15.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.945+0000 7f3bf259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf4064bb0 0x7f3bf4113340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58936/0 (socket says 172.21.15.43:58936) 2023-12-08T20:36:15.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.945+0000 7f3bf259c700 1 -- 172.21.15.43:0/186205700 learned_addr learned my addr 172.21.15.43:0/186205700 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-12-08T20:36:15.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.945+0000 7f3bf1d9b700 1 --2- 172.21.15.43:0/186205700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bf4102bb0 0x7f3bf4113880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:15.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.945+0000 7f3bf259c700 1 -- 172.21.15.43:0/186205700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bf4102bb0 msgr2=0x7f3bf4113880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:15.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.945+0000 7f3bf259c700 1 --2- 172.21.15.43:0/186205700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bf4102bb0 0x7f3bf4113880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:15.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.945+0000 7f3bf259c700 1 -- 172.21.15.43:0/186205700 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be4005040 con 0x7f3bf4064bb0 2023-12-08T20:36:15.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.945+0000 7f3bf259c700 1 --2- 172.21.15.43:0/186205700 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf4064bb0 0x7f3bf4113340 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3be400b3b0 tx=0x7f3be4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:15.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.945+0000 7f3be2ffd700 1 -- 172.21.15.43:0/186205700 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3be400e040 con 0x7f3bf4064bb0 2023-12-08T20:36:15.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.945+0000 7f3bf8eef700 1 -- 172.21.15.43:0/186205700 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf410d670 con 0x7f3bf4064bb0 2023-12-08T20:36:15.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.945+0000 7f3be2ffd700 1 -- 172.21.15.43:0/186205700 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3be400bc50 con 0x7f3bf4064bb0 2023-12-08T20:36:15.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.945+0000 7f3be2ffd700 1 -- 172.21.15.43:0/186205700 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3be4013420 con 0x7f3bf4064bb0 2023-12-08T20:36:15.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.945+0000 7f3bf8eef700 1 -- 172.21.15.43:0/186205700 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf410dc30 con 0x7f3bf4064bb0 2023-12-08T20:36:15.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.946+0000 7f3bf8eef700 1 -- 172.21.15.43:0/186205700 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf4064730 con 0x7f3bf4064bb0 2023-12-08T20:36:15.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.947+0000 7f3be2ffd700 1 -- 172.21.15.43:0/186205700 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 40) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f3be401c430 con 0x7f3bf4064bb0 2023-12-08T20:36:15.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.947+0000 7f3be2ffd700 1 --2- 172.21.15.43:0/186205700 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f3bdc06ce60 0x7f3bdc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T20:36:15.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.947+0000 7f3be2ffd700 1 -- 172.21.15.43:0/186205700 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f3be408d020 con 0x7f3bf4064bb0 2023-12-08T20:36:15.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.947+0000 7f3bf1d9b700 1 --2- 172.21.15.43:0/186205700 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f3bdc06ce60 0x7f3bdc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T20:36:15.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.948+0000 7f3bf1d9b700 1 --2- 172.21.15.43:0/186205700 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f3bdc06ce60 0x7f3bdc06f310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3bf410ebe0 tx=0x7f3be800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T20:36:15.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:15.952+0000 7f3be2ffd700 1 -- 172.21.15.43:0/186205700 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3be405ab10 con 0x7f3bf4064bb0 2023-12-08T20:36:15.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:15 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/2270459909' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-08T20:36:15.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:15 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/3625814747' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-08T20:36:15.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:15 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/3860214715' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-08T20:36:16.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:16.181+0000 7f3bf8eef700 1 -- 172.21.15.43:0/186205700 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3bf4109ab0 con 0x7f3bf4064bb0 2023-12-08T20:36:16.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:16.181+0000 7f3be2ffd700 1 -- 172.21.15.43:0/186205700 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v80) v1 ==== 81+0+2069 (secure 0 0 0) 0x7f3be405a6a0 con 0x7f3bf4064bb0 2023-12-08T20:36:16.184 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1578286032 2023-12-09T20:31:13.867849+0000 2023-12-08T20:36:16.184 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/2216649665 2023-12-09T20:31:13.867849+0000 2023-12-08T20:36:16.184 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2638250357 2023-12-09T20:31:13.867849+0000 2023-12-08T20:36:16.184 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/1561199606 2023-12-09T20:21:27.333855+0000 2023-12-08T20:36:16.184 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/1561199606 2023-12-09T20:21:27.333855+0000 2023-12-08T20:36:16.184 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2345173464 2023-12-09T20:21:27.333855+0000 2023-12-08T20:36:16.184 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1958100424 2023-12-09T20:27:21.191384+0000 2023-12-08T20:36:16.185 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.111:0/1730171069 2023-12-09T20:28:39.993505+0000 2023-12-08T20:36:16.185 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1298471102 2023-12-09T20:21:01.600933+0000 2023-12-08T20:36:16.185 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3678520486 2023-12-09T20:22:19.417857+0000 2023-12-08T20:36:16.185 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/2315465125 2023-12-09T20:22:19.417857+0000 2023-12-08T20:36:16.185 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.111:0/2899706571 2023-12-09T20:28:39.993505+0000 2023-12-08T20:36:16.185 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/392501150 2023-12-09T20:22:19.417857+0000 2023-12-08T20:36:16.185 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/940236816 2023-12-09T20:31:13.867849+0000 2023-12-08T20:36:16.185 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.111:6829/940639390 2023-12-09T20:28:39.993505+0000 2023-12-08T20:36:16.185 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3758242596 2023-12-09T20:21:27.333855+0000 2023-12-08T20:36:16.186 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/2195776328 2023-12-09T20:21:01.600933+0000 2023-12-08T20:36:16.186 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3571683356 2023-12-09T20:21:01.600933+0000 2023-12-08T20:36:16.186 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/2216649665 2023-12-09T20:31:13.867849+0000 2023-12-08T20:36:16.186 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/993195790 2023-12-09T20:27:21.191384+0000 2023-12-08T20:36:16.186 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.111:0/3272445197 2023-12-09T20:28:39.993505+0000 2023-12-08T20:36:16.186 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.111:0/3981107380 2023-12-09T20:28:39.993505+0000 2023-12-08T20:36:16.186 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2976228612 2023-12-09T20:21:01.600933+0000 2023-12-08T20:36:16.186 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/2315465125 2023-12-09T20:22:19.417857+0000 2023-12-08T20:36:16.186 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3231089927 2023-12-09T20:27:21.191384+0000 2023-12-08T20:36:16.187 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.111:0/2497747504 2023-12-09T20:28:39.993505+0000 2023-12-08T20:36:16.187 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.111:6828/940639390 2023-12-09T20:28:39.993505+0000 2023-12-08T20:36:16.187 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/4033535283 2023-12-09T20:22:19.417857+0000 2023-12-08T20:36:16.187 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/4006048852 2023-12-09T20:27:21.191384+0000 2023-12-08T20:36:16.187 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.111:0/1498484547 2023-12-09T20:28:39.993505+0000 2023-12-08T20:36:16.187 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2451027781 2023-12-09T20:21:27.333855+0000 2023-12-08T20:36:16.187 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/2195776328 2023-12-09T20:21:01.600933+0000 2023-12-08T20:36:16.188 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1875438884 2023-12-09T20:31:13.867849+0000 2023-12-08T20:36:16.188 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/3959093322 2023-12-09T20:27:21.191384+0000 2023-12-08T20:36:16.188 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/3959093322 2023-12-09T20:27:21.191384+0000 2023-12-08T20:36:16.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:16.184+0000 7f3bf8eef700 1 -- 172.21.15.43:0/186205700 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f3bdc06ce60 msgr2=0x7f3bdc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:16.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:16.184+0000 7f3bf8eef700 1 --2- 172.21.15.43:0/186205700 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f3bdc06ce60 0x7f3bdc06f310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3bf410ebe0 tx=0x7f3be800b040 comp rx=0 tx=0).stop 2023-12-08T20:36:16.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:16.184+0000 7f3bf8eef700 1 -- 172.21.15.43:0/186205700 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf4064bb0 msgr2=0x7f3bf4113340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T20:36:16.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:16.184+0000 7f3bf8eef700 1 --2- 172.21.15.43:0/186205700 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf4064bb0 0x7f3bf4113340 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3be400b3b0 tx=0x7f3be4009e30 comp rx=0 tx=0).stop 2023-12-08T20:36:16.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:16.184+0000 7f3bf8eef700 1 -- 172.21.15.43:0/186205700 shutdown_connections 2023-12-08T20:36:16.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:16.184+0000 7f3bf8eef700 1 --2- 172.21.15.43:0/186205700 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf4064bb0 0x7f3bf4113340 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:16.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:16.184+0000 7f3bf8eef700 1 --2- 172.21.15.43:0/186205700 >> [v2:172.21.15.43:6800/2090372060,v1:172.21.15.43:6801/2090372060] conn(0x7f3bdc06ce60 0x7f3bdc06f310 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:16.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:16.184+0000 7f3bf8eef700 1 --2- 172.21.15.43:0/186205700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bf4102bb0 0x7f3bf4113880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T20:36:16.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:16.184+0000 7f3bf8eef700 1 -- 172.21.15.43:0/186205700 >> 172.21.15.43:0/186205700 conn(0x7f3bf4071970 msgr2=0x7f3bf40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T20:36:16.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:16.184+0000 7f3bf8eef700 1 -- 172.21.15.43:0/186205700 shutdown_connections 2023-12-08T20:36:16.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-12-08T20:36:16.184+0000 7f3bf8eef700 1 -- 172.21.15.43:0/186205700 wait complete. 2023-12-08T20:36:16.190 INFO:teuthology.orchestra.run.smithi043.stderr:listed 35 entries 2023-12-08T20:36:16.200 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-08T20:36:16.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:36:16.200 DEBUG:teuthology.orchestra.run.smithi111:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-08T20:36:16.252 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi111.front.sepia.ceph.com 2023-12-08T20:36:16.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:36:16.253 DEBUG:teuthology.orchestra.run.smithi111:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T20:36:16.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:36:16.307 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2023-12-08T20:36:16.399 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T20:36:16.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:36:16.400 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T20:36:16.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:36:16.460 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2023-12-08T20:36:16.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:36:16.537 DEBUG:teuthology.orchestra.run.smithi111:> ip netns list 2023-12-08T20:36:16.555 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-08T20:36:16.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:36:16.556 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T20:36:16.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T20:36:16.653 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link delete ceph-brx 2023-12-08T20:36:16.728 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-12-08T20:36:16.740 INFO:tasks.cephadm:Teardown begin 2023-12-08T20:36:16.741 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-08T20:36:16.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:16 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/1639876006' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-08T20:36:16.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:16 smithi043 ceph-mon[219193]: pgmap v184: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-08T20:36:16.764 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:16 smithi043 ceph-mon[219193]: from='client.? 172.21.15.43:0/186205700' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-08T20:36:16.778 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-08T20:36:16.809 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-12-08T20:36:16.809 DEBUG:teuthology.orchestra.run.smithi043:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-08T20:36:16.842 DEBUG:teuthology.orchestra.run.smithi111:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-08T20:36:16.867 INFO:tasks.cephadm:Stopping all daemons... 2023-12-08T20:36:16.871 INFO:tasks.cephadm.mon.smithi043:Stopping mon.smithi043... 2023-12-08T20:36:16.871 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-28476818-9607-11ee-95a3-87774f69a715@mon.smithi043 2023-12-08T20:36:16.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:16 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/1639876006' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-08T20:36:16.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:16 smithi111 ceph-mon[182474]: pgmap v184: 65 pgs: 65 active+clean; 301 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-08T20:36:16.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:16 smithi111 ceph-mon[182474]: from='client.? 172.21.15.43:0/186205700' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-08T20:36:17.130 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:16 smithi043 systemd[1]: Stopping Ceph mon.smithi043 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:36:17.130 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:17 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-mon-smithi043[219170]: 2023-12-08T20:36:17.126+0000 7f2049481700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi043 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-08T20:36:17.130 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:17 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-mon-smithi043[219170]: 2023-12-08T20:36:17.126+0000 7f2049481700 -1 mon.smithi043@0(leader) e3 *** Got Signal Terminated *** 2023-12-08T20:36:17.514 INFO:journalctl@ceph.mon.smithi043.smithi043.stdout:Dec 08 20:36:17 smithi043 bash[256539]: ceph-28476818-9607-11ee-95a3-87774f69a715-mon-smithi043 2023-12-08T20:36:17.613 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28476818-9607-11ee-95a3-87774f69a715@mon.smithi043.service' 2023-12-08T20:36:17.680 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-08T20:36:17.680 INFO:tasks.cephadm.mon.smithi043:Stopped mon.smithi043 2023-12-08T20:36:17.680 INFO:tasks.cephadm.mon.smithi111:Stopping mon.smithi111... 2023-12-08T20:36:17.680 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-28476818-9607-11ee-95a3-87774f69a715@mon.smithi111 2023-12-08T20:36:17.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:17 smithi111 systemd[1]: Stopping Ceph mon.smithi111 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:36:17.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:17 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-mon-smithi111[182452]: 2023-12-08T20:36:17.905+0000 7f38053a2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi111 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-08T20:36:17.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:17 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-mon-smithi111[182452]: 2023-12-08T20:36:17.905+0000 7f38053a2700 -1 mon.smithi111@1(peon) e3 *** Got Signal Terminated *** 2023-12-08T20:36:18.284 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Dec 08 20:36:18 smithi111 bash[213818]: ceph-28476818-9607-11ee-95a3-87774f69a715-mon-smithi111 2023-12-08T20:36:18.291 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28476818-9607-11ee-95a3-87774f69a715@mon.smithi111.service' 2023-12-08T20:36:18.348 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-08T20:36:18.349 INFO:tasks.cephadm.mon.smithi111:Stopped mon.smithi111 2023-12-08T20:36:18.349 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-12-08T20:36:18.349 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-28476818-9607-11ee-95a3-87774f69a715@osd.0 2023-12-08T20:36:18.764 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:36:18 smithi043 systemd[1]: Stopping Ceph osd.0 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:36:18.764 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:36:18 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-0[232925]: 2023-12-08T20:36:18.591+0000 7f4ee5aab700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-08T20:36:18.764 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:36:18 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-0[232925]: 2023-12-08T20:36:18.591+0000 7f4ee5aab700 -1 osd.0 80 *** Got signal Terminated *** 2023-12-08T20:36:18.765 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:36:18 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-0[232925]: 2023-12-08T20:36:18.591+0000 7f4ee5aab700 -1 osd.0 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-08T20:36:24.514 INFO:journalctl@ceph.osd.0.smithi043.stdout:Dec 08 20:36:24 smithi043 bash[256694]: ceph-28476818-9607-11ee-95a3-87774f69a715-osd-0 2023-12-08T20:36:25.487 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28476818-9607-11ee-95a3-87774f69a715@osd.0.service' 2023-12-08T20:36:25.539 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-08T20:36:25.539 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-12-08T20:36:25.540 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-12-08T20:36:25.540 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-28476818-9607-11ee-95a3-87774f69a715@osd.1 2023-12-08T20:36:25.764 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:36:25 smithi043 systemd[1]: Stopping Ceph osd.1 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:36:26.264 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:36:25 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-1[239460]: 2023-12-08T20:36:25.783+0000 7fb2f0dde700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-08T20:36:26.264 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:36:25 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-1[239460]: 2023-12-08T20:36:25.783+0000 7fb2f0dde700 -1 osd.1 80 *** Got signal Terminated *** 2023-12-08T20:36:26.264 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:36:25 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-1[239460]: 2023-12-08T20:36:25.783+0000 7fb2f0dde700 -1 osd.1 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-08T20:36:31.764 INFO:journalctl@ceph.osd.1.smithi043.stdout:Dec 08 20:36:31 smithi043 bash[256954]: ceph-28476818-9607-11ee-95a3-87774f69a715-osd-1 2023-12-08T20:36:32.804 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28476818-9607-11ee-95a3-87774f69a715@osd.1.service' 2023-12-08T20:36:32.856 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-08T20:36:32.856 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-12-08T20:36:32.857 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-12-08T20:36:32.857 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-28476818-9607-11ee-95a3-87774f69a715@osd.2 2023-12-08T20:36:33.088 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:36:32 smithi043 systemd[1]: Stopping Ceph osd.2 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:36:33.514 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:36:33 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-2[246780]: 2023-12-08T20:36:33.086+0000 7f87b6377700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-08T20:36:33.515 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:36:33 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-2[246780]: 2023-12-08T20:36:33.086+0000 7f87b6377700 -1 osd.2 80 *** Got signal Terminated *** 2023-12-08T20:36:33.515 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:36:33 smithi043 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-2[246780]: 2023-12-08T20:36:33.086+0000 7f87b6377700 -1 osd.2 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-08T20:36:39.014 INFO:journalctl@ceph.osd.2.smithi043.stdout:Dec 08 20:36:38 smithi043 bash[257221]: ceph-28476818-9607-11ee-95a3-87774f69a715-osd-2 2023-12-08T20:36:40.111 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28476818-9607-11ee-95a3-87774f69a715@osd.2.service' 2023-12-08T20:36:40.162 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-08T20:36:40.162 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-12-08T20:36:40.163 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-12-08T20:36:40.163 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-28476818-9607-11ee-95a3-87774f69a715@osd.3 2023-12-08T20:36:40.467 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:36:40 smithi111 systemd[1]: Stopping Ceph osd.3 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:36:40.468 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:36:40 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-3[194713]: 2023-12-08T20:36:40.386+0000 7f8cedc43700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-08T20:36:40.468 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:36:40 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-3[194713]: 2023-12-08T20:36:40.386+0000 7f8cedc43700 -1 osd.3 80 *** Got signal Terminated *** 2023-12-08T20:36:40.468 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:36:40 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-3[194713]: 2023-12-08T20:36:40.386+0000 7f8cedc43700 -1 osd.3 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-08T20:36:46.218 INFO:journalctl@ceph.osd.3.smithi111.stdout:Dec 08 20:36:45 smithi111 bash[213966]: ceph-28476818-9607-11ee-95a3-87774f69a715-osd-3 2023-12-08T20:36:46.718 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:36:46 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4[200783]: 2023-12-08T20:36:46.507+0000 7fbf12a3a700 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2023-12-08T20:36:23.064680+0000 front 2023-12-08T20:36:23.064572+0000 (oldest deadline 2023-12-08T20:36:45.964612+0000) 2023-12-08T20:36:47.071 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28476818-9607-11ee-95a3-87774f69a715@osd.3.service' 2023-12-08T20:36:47.112 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-08T20:36:47.112 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-12-08T20:36:47.113 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-12-08T20:36:47.113 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-28476818-9607-11ee-95a3-87774f69a715@osd.4 2023-12-08T20:36:47.378 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:36:47 smithi111 systemd[1]: Stopping Ceph osd.4 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:36:47.718 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:36:47 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4[200783]: 2023-12-08T20:36:47.375+0000 7fbf15c3e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-08T20:36:47.718 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:36:47 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4[200783]: 2023-12-08T20:36:47.375+0000 7fbf15c3e700 -1 osd.4 80 *** Got signal Terminated *** 2023-12-08T20:36:47.719 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:36:47 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4[200783]: 2023-12-08T20:36:47.375+0000 7fbf15c3e700 -1 osd.4 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-08T20:36:47.719 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:36:47 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4[200783]: 2023-12-08T20:36:47.530+0000 7fbf12a3a700 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2023-12-08T20:36:23.064680+0000 front 2023-12-08T20:36:23.064572+0000 (oldest deadline 2023-12-08T20:36:45.964612+0000) 2023-12-08T20:36:48.967 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:36:48 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4[200783]: 2023-12-08T20:36:48.508+0000 7fbf12a3a700 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2023-12-08T20:36:23.064680+0000 front 2023-12-08T20:36:23.064572+0000 (oldest deadline 2023-12-08T20:36:45.964612+0000) 2023-12-08T20:36:49.967 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:36:49 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4[200783]: 2023-12-08T20:36:49.495+0000 7fbf12a3a700 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2023-12-08T20:36:23.064680+0000 front 2023-12-08T20:36:23.064572+0000 (oldest deadline 2023-12-08T20:36:45.964612+0000) 2023-12-08T20:36:50.467 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:50 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:50.002+0000 7ff29cbdc700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2023-12-08T20:36:22.880298+0000 front 2023-12-08T20:36:22.880504+0000 (oldest deadline 2023-12-08T20:36:49.880848+0000) 2023-12-08T20:36:50.967 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:36:50 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4[200783]: 2023-12-08T20:36:50.512+0000 7fbf12a3a700 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2023-12-08T20:36:23.064680+0000 front 2023-12-08T20:36:23.064572+0000 (oldest deadline 2023-12-08T20:36:45.964612+0000) 2023-12-08T20:36:51.467 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:51 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:51.030+0000 7ff29cbdc700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2023-12-08T20:36:22.880298+0000 front 2023-12-08T20:36:22.880504+0000 (oldest deadline 2023-12-08T20:36:49.880848+0000) 2023-12-08T20:36:51.967 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:36:51 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4[200783]: 2023-12-08T20:36:51.549+0000 7fbf12a3a700 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2023-12-08T20:36:23.064680+0000 front 2023-12-08T20:36:23.064572+0000 (oldest deadline 2023-12-08T20:36:45.964612+0000) 2023-12-08T20:36:52.468 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:52 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:52.073+0000 7ff29cbdc700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2023-12-08T20:36:22.880298+0000 front 2023-12-08T20:36:22.880504+0000 (oldest deadline 2023-12-08T20:36:49.880848+0000) 2023-12-08T20:36:53.082 INFO:journalctl@ceph.osd.4.smithi111.stdout:Dec 08 20:36:52 smithi111 bash[214234]: ceph-28476818-9607-11ee-95a3-87774f69a715-osd-4 2023-12-08T20:36:53.366 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:53 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:53.079+0000 7ff29cbdc700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2023-12-08T20:36:22.880298+0000 front 2023-12-08T20:36:22.880504+0000 (oldest deadline 2023-12-08T20:36:49.880848+0000) 2023-12-08T20:36:54.061 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28476818-9607-11ee-95a3-87774f69a715@osd.4.service' 2023-12-08T20:36:54.101 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-08T20:36:54.101 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-12-08T20:36:54.101 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-12-08T20:36:54.101 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-28476818-9607-11ee-95a3-87774f69a715@osd.5 2023-12-08T20:36:54.352 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:54 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:54.093+0000 7ff29cbdc700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2023-12-08T20:36:22.880298+0000 front 2023-12-08T20:36:22.880504+0000 (oldest deadline 2023-12-08T20:36:49.880848+0000) 2023-12-08T20:36:54.352 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:54 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:54.093+0000 7ff29cbdc700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.43:6814 osd.1 since back 2023-12-08T20:36:29.881435+0000 front 2023-12-08T20:36:29.881387+0000 (oldest deadline 2023-12-08T20:36:53.381231+0000) 2023-12-08T20:36:54.352 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:54 smithi111 systemd[1]: Stopping Ceph osd.5 for 28476818-9607-11ee-95a3-87774f69a715... 2023-12-08T20:36:54.352 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:54 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:54.349+0000 7ff2a0de2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-08T20:36:54.717 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:54 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:54.349+0000 7ff2a0de2700 -1 osd.5 80 *** Got signal Terminated *** 2023-12-08T20:36:54.717 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:54 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:54.349+0000 7ff2a0de2700 -1 osd.5 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-08T20:36:55.467 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:55 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:55.074+0000 7ff29cbdc700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2023-12-08T20:36:22.880298+0000 front 2023-12-08T20:36:22.880504+0000 (oldest deadline 2023-12-08T20:36:49.880848+0000) 2023-12-08T20:36:55.468 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:55 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:55.074+0000 7ff29cbdc700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.43:6814 osd.1 since back 2023-12-08T20:36:29.881435+0000 front 2023-12-08T20:36:29.881387+0000 (oldest deadline 2023-12-08T20:36:53.381231+0000) 2023-12-08T20:36:56.467 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:56 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:56.035+0000 7ff29cbdc700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2023-12-08T20:36:22.880298+0000 front 2023-12-08T20:36:22.880504+0000 (oldest deadline 2023-12-08T20:36:49.880848+0000) 2023-12-08T20:36:56.468 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:56 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:56.035+0000 7ff29cbdc700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.43:6814 osd.1 since back 2023-12-08T20:36:29.881435+0000 front 2023-12-08T20:36:29.881387+0000 (oldest deadline 2023-12-08T20:36:53.381231+0000) 2023-12-08T20:36:57.467 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:57 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:57.010+0000 7ff29cbdc700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2023-12-08T20:36:22.880298+0000 front 2023-12-08T20:36:22.880504+0000 (oldest deadline 2023-12-08T20:36:49.880848+0000) 2023-12-08T20:36:57.468 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:57 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:57.010+0000 7ff29cbdc700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.43:6814 osd.1 since back 2023-12-08T20:36:29.881435+0000 front 2023-12-08T20:36:29.881387+0000 (oldest deadline 2023-12-08T20:36:53.381231+0000) 2023-12-08T20:36:58.468 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:58 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:58.038+0000 7ff29cbdc700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2023-12-08T20:36:22.880298+0000 front 2023-12-08T20:36:22.880504+0000 (oldest deadline 2023-12-08T20:36:49.880848+0000) 2023-12-08T20:36:58.468 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:58 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:58.038+0000 7ff29cbdc700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.43:6814 osd.1 since back 2023-12-08T20:36:29.881435+0000 front 2023-12-08T20:36:29.881387+0000 (oldest deadline 2023-12-08T20:36:53.381231+0000) 2023-12-08T20:36:59.467 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:59 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:59.037+0000 7ff29cbdc700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2023-12-08T20:36:22.880298+0000 front 2023-12-08T20:36:22.880504+0000 (oldest deadline 2023-12-08T20:36:49.880848+0000) 2023-12-08T20:36:59.468 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:59 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:59.037+0000 7ff29cbdc700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.43:6814 osd.1 since back 2023-12-08T20:36:29.881435+0000 front 2023-12-08T20:36:29.881387+0000 (oldest deadline 2023-12-08T20:36:53.381231+0000) 2023-12-08T20:36:59.468 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:36:59 smithi111 ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5[207524]: 2023-12-08T20:36:59.037+0000 7ff29cbdc700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.43:6822 osd.2 since back 2023-12-08T20:36:37.882597+0000 front 2023-12-08T20:36:37.882563+0000 (oldest deadline 2023-12-08T20:36:58.982525+0000) 2023-12-08T20:37:00.468 INFO:journalctl@ceph.osd.5.smithi111.stdout:Dec 08 20:37:00 smithi111 bash[214494]: ceph-28476818-9607-11ee-95a3-87774f69a715-osd-5 2023-12-08T20:37:01.301 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-28476818-9607-11ee-95a3-87774f69a715@osd.5.service' 2023-12-08T20:37:01.341 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-08T20:37:01.342 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-12-08T20:37:01.342 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 28476818-9607-11ee-95a3-87774f69a715 --force --keep-logs 2023-12-08T20:37:16.430 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 28476818-9607-11ee-95a3-87774f69a715 --force --keep-logs 2023-12-08T20:37:29.530 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-08T20:37:29.571 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-08T20:37:29.602 INFO:tasks.cephadm:Archiving crash dumps... 2023-12-08T20:37:29.604 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/crash to /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484168/remote/smithi043/crash 2023-12-08T20:37:29.604 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/crash -- . 2023-12-08T20:37:29.645 INFO:teuthology.orchestra.run.smithi043.stderr:tar: /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/crash: Cannot open: No such file or directory 2023-12-08T20:37:29.645 INFO:teuthology.orchestra.run.smithi043.stderr:tar: Error is not recoverable: exiting now 2023-12-08T20:37:29.647 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/crash to /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484168/remote/smithi111/crash 2023-12-08T20:37:29.648 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/crash -- . 2023-12-08T20:37:29.674 INFO:teuthology.orchestra.run.smithi111.stderr:tar: /var/lib/ceph/28476818-9607-11ee-95a3-87774f69a715/crash: Cannot open: No such file or directory 2023-12-08T20:37:29.674 INFO:teuthology.orchestra.run.smithi111.stderr:tar: Error is not recoverable: exiting now 2023-12-08T20:37:29.675 INFO:tasks.cephadm:Checking cluster log for badness... 2023-12-08T20:37:29.675 DEBUG:teuthology.orchestra.run.smithi043:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-08T20:37:29.725 INFO:teuthology.orchestra.run.smithi043.stderr:grep: /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph.log: No such file or directory 2023-12-08T20:37:29.727 INFO:tasks.cephadm:Compressing logs... 2023-12-08T20:37:29.727 DEBUG:teuthology.orchestra.run.smithi043:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-08T20:37:29.769 DEBUG:teuthology.orchestra.run.smithi111:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-08T20:37:29.796 INFO:teuthology.orchestra.run.smithi111.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-12-08T20:37:29.797 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-08T20:37:29.797 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mon.smithi111.log 2023-12-08T20:37:29.797 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-volume.log 2023-12-08T20:37:29.797 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mon.smithi111.log: gzip -5 --verbose -- /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-osd.3.log 2023-12-08T20:37:29.797 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi111.veeegc.log 2023-12-08T20:37:29.797 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-osd.4.log 2023-12-08T20:37:29.798 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi111.veeegc.log: gzip -5 --verbose -- /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mgr.smithi111.mtcffu.log 2023-12-08T20:37:29.798 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-osd.4.log: /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mgr.smithi111.mtcffu.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-08T20:37:29.801 INFO:teuthology.orchestra.run.smithi043.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-08T20:37:29.802 INFO:teuthology.orchestra.run.smithi043.stderr:: No such file or directory 2023-12-08T20:37:29.802 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-volume.log 2023-12-08T20:37:29.803 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-osd.2.log 2023-12-08T20:37:29.803 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mgr.smithi043.hqcdcm.log 2023-12-08T20:37:29.803 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-osd.0.log 2023-12-08T20:37:29.804 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-osd.5.log 2023-12-08T20:37:29.804 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi111.svpasm.log 2023-12-08T20:37:29.804 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-osd.2.log: /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mgr.smithi043.hqcdcm.log: gzip -5 --verbose -- /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mon.smithi043.log 2023-12-08T20:37:29.807 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi111.svpasm.log: 91.1% -- replaced with /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-volume.log.gz 2023-12-08T20:37:29.808 INFO:teuthology.orchestra.run.smithi111.stderr: 94.3% -- replaced with /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi111.svpasm.log.gz 2023-12-08T20:37:29.808 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-osd.0.log: /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mon.smithi043.log: gzip -5 --verbose -- /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi043.akrjef.log 2023-12-08T20:37:29.813 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi043.akrjef.log: 90.4% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-08T20:37:29.813 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi043.pjmszb.log 2023-12-08T20:37:29.813 INFO:teuthology.orchestra.run.smithi043.stderr: 94.3% -- replaced with /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi043.akrjef.log.gz 2023-12-08T20:37:29.814 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-osd.1.log 2023-12-08T20:37:29.819 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi043.pjmszb.log: /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-osd.1.log: 90.9% -- replaced with /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-volume.log.gz 2023-12-08T20:37:29.842 INFO:teuthology.orchestra.run.smithi111.stderr: 88.6% -- replaced with /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mgr.smithi111.mtcffu.log.gz 2023-12-08T20:37:30.015 INFO:teuthology.orchestra.run.smithi111.stderr: 92.5% -- replaced with /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mon.smithi111.log.gz 2023-12-08T20:37:30.121 INFO:teuthology.orchestra.run.smithi043.stderr: 88.2% -- replaced with /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mgr.smithi043.hqcdcm.log.gz 2023-12-08T20:37:30.419 INFO:teuthology.orchestra.run.smithi043.stderr: 90.7% -- replaced with /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mon.smithi043.log.gz 2023-12-08T20:37:33.565 INFO:teuthology.orchestra.run.smithi111.stderr: 93.4% -- replaced with /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-osd.4.log.gz 2023-12-08T20:37:33.921 INFO:teuthology.orchestra.run.smithi043.stderr: 93.5% -- replaced with /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-osd.2.log.gz 2023-12-08T20:37:34.498 INFO:teuthology.orchestra.run.smithi043.stderr: 93.4% -- replaced with /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-osd.0.log.gz 2023-12-08T20:37:34.949 INFO:teuthology.orchestra.run.smithi111.stderr: 93.5% -- replaced with /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-osd.5.log.gz 2023-12-08T20:37:35.228 INFO:teuthology.orchestra.run.smithi043.stderr: 93.5% -- replaced with /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-osd.1.log.gz 2023-12-08T20:37:35.313 INFO:teuthology.orchestra.run.smithi111.stderr: 93.5% -- replaced with /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-osd.3.log.gz 2023-12-08T20:37:58.224 INFO:teuthology.orchestra.run.smithi111.stderr: 93.2% -- replaced with /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi111.veeegc.log.gz 2023-12-08T20:37:58.225 INFO:teuthology.orchestra.run.smithi111.stderr: 2023-12-08T20:37:58.226 INFO:teuthology.orchestra.run.smithi111.stderr:real 0m28.439s 2023-12-08T20:37:58.226 INFO:teuthology.orchestra.run.smithi111.stderr:user 0m41.643s 2023-12-08T20:37:58.226 INFO:teuthology.orchestra.run.smithi111.stderr:sys 0m1.454s 2023-12-08T20:38:32.315 INFO:teuthology.orchestra.run.smithi043.stderr: 92.9% -- replaced with /var/log/ceph/28476818-9607-11ee-95a3-87774f69a715/ceph-mds.cephfs.smithi043.pjmszb.log.gz 2023-12-08T20:38:32.316 INFO:teuthology.orchestra.run.smithi043.stderr: 2023-12-08T20:38:32.316 INFO:teuthology.orchestra.run.smithi043.stderr:real 1m2.527s 2023-12-08T20:38:32.316 INFO:teuthology.orchestra.run.smithi043.stderr:user 1m14.951s 2023-12-08T20:38:32.316 INFO:teuthology.orchestra.run.smithi043.stderr:sys 0m2.624s 2023-12-08T20:38:32.317 INFO:tasks.cephadm:Archiving logs... 2023-12-08T20:38:32.317 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484168/remote/smithi043/log 2023-12-08T20:38:32.318 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-08T20:38:43.531 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484168/remote/smithi111/log 2023-12-08T20:38:43.532 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-08T20:38:50.047 INFO:tasks.cephadm:Removing cluster... 2023-12-08T20:38:50.047 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 28476818-9607-11ee-95a3-87774f69a715 --force 2023-12-08T20:38:50.660 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 28476818-9607-11ee-95a3-87774f69a715 --force 2023-12-08T20:38:51.167 INFO:tasks.cephadm:Removing cephadm ... 2023-12-08T20:38:51.168 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-08T20:38:51.193 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-08T20:38:51.211 INFO:tasks.cephadm:Teardown complete 2023-12-08T20:38:51.212 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-08T20:38:51.223 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-08T20:38:51.223 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-08T20:38:51.236 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-08T20:38:51.332 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-08T20:38:51.344 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-08T20:38:51.345 DEBUG:teuthology.orchestra.run.smithi043:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T20:38:51.347 DEBUG:teuthology.orchestra.run.smithi111:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T20:38:51.364 INFO:teuthology.orchestra.run.smithi111.stderr:bash: ntpq: command not found 2023-12-08T20:38:51.367 INFO:teuthology.orchestra.run.smithi043.stderr:bash: ntpq: command not found 2023-12-08T20:38:51.369 INFO:teuthology.orchestra.run.smithi111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-08T20:38:51.369 INFO:teuthology.orchestra.run.smithi111.stdout:=============================================================================== 2023-12-08T20:38:51.369 INFO:teuthology.orchestra.run.smithi111.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 18 +2774us[+2774us] +/- 72ms 2023-12-08T20:38:51.369 INFO:teuthology.orchestra.run.smithi111.stdout:^* hv02.front.sepia.ceph.com 3 6 377 19 -1194us[-1168us] +/- 58ms 2023-12-08T20:38:51.369 INFO:teuthology.orchestra.run.smithi111.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 -1082us[-1082us] +/- 68ms 2023-12-08T20:38:51.369 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T20:38:51.372 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-08T20:38:51.372 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2023-12-08T20:38:51.372 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 17 +2800us[+2800us] +/- 72ms 2023-12-08T20:38:51.372 INFO:teuthology.orchestra.run.smithi043.stdout:^* hv02.front.sepia.ceph.com 3 7 377 82 -1177us[ -933us] +/- 57ms 2023-12-08T20:38:51.373 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 -1062us[-1062us] +/- 68ms 2023-12-08T20:38:51.373 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T20:38:51.374 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-08T20:38:51.385 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-08T20:38:51.386 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-08T20:38:51.400 DEBUG:teuthology.orchestra.run.smithi043:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-08T20:38:51.532 DEBUG:teuthology.orchestra.run.smithi111:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-08T20:38:51.627 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-08T20:38:51.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:38:51.666 DEBUG:teuthology.orchestra.run.smithi111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-08T20:38:51.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:38:51.699 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-08T20:38:51.713 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-08T20:38:51.725 INFO:teuthology.task.internal:Duration was 1888.737938 seconds 2023-12-08T20:38:51.725 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-08T20:38:51.738 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-08T20:38:51.738 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-08T20:38:51.741 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-08T20:38:51.787 INFO:teuthology.orchestra.run.smithi111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-08T20:38:51.798 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-08T20:38:52.029 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-08T20:38:52.030 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi043.front.sepia.ceph.com 2023-12-08T20:38:52.030 DEBUG:teuthology.orchestra.run.smithi043:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-08T20:38:52.059 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi111.front.sepia.ceph.com 2023-12-08T20:38:52.059 DEBUG:teuthology.orchestra.run.smithi111:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-08T20:38:52.083 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-08T20:38:52.083 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-08T20:38:52.102 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-08T20:38:52.172 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-08T20:38:52.172 DEBUG:teuthology.orchestra.run.smithi043:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-08T20:38:52.174 DEBUG:teuthology.orchestra.run.smithi111:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-08T20:38:52.302 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-08T20:38:52.319 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-08T20:38:52.320 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-08T20:38:52.351 DEBUG:teuthology.orchestra.run.smithi111:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-08T20:38:52.379 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-08T20:38:52.391 DEBUG:teuthology.orchestra.run.smithi043:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-08T20:38:52.394 DEBUG:teuthology.orchestra.run.smithi111:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-08T20:38:52.424 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = core 2023-12-08T20:38:52.446 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = core 2023-12-08T20:38:52.458 DEBUG:teuthology.orchestra.run.smithi043:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-08T20:38:52.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:38:52.502 DEBUG:teuthology.orchestra.run.smithi111:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-08T20:38:52.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T20:38:52.519 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-08T20:38:52.533 INFO:teuthology.task.internal:Transferring archived files... 2023-12-08T20:38:52.534 DEBUG:teuthology.misc:Transferring archived files from smithi043:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484168/remote/smithi043 2023-12-08T20:38:52.535 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-08T20:38:52.594 DEBUG:teuthology.misc:Transferring archived files from smithi111:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484168/remote/smithi111 2023-12-08T20:38:52.595 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-08T20:38:52.637 INFO:teuthology.task.internal:Removing archive directory... 2023-12-08T20:38:52.638 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-08T20:38:52.644 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-08T20:38:52.688 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-08T20:38:52.703 INFO:teuthology.task.internal:Not uploading archives. 2023-12-08T20:38:52.703 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-08T20:38:52.715 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-08T20:38:52.715 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-08T20:38:52.718 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-08T20:38:52.738 INFO:teuthology.orchestra.run.smithi043.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 8 20:38 /home/ubuntu/cephtest 2023-12-08T20:38:52.745 INFO:teuthology.orchestra.run.smithi111.stdout: 525357 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 8 20:38 /home/ubuntu/cephtest 2023-12-08T20:38:52.747 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-08T20:38:52.766 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-08T20:38:52.795 INFO:teuthology.nuke:Checking targets against current locks 2023-12-08T20:38:52.819 DEBUG:teuthology.nuke:shortname: smithi043 2023-12-08T20:38:52.820 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-08T20:38:52.845 DEBUG:teuthology.nuke:shortname: smithi111 2023-12-08T20:38:52.845 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-08T20:38:52.852 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484168', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 19:58:28.274975', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPrwPV6DYglaqh1SdLWVkFsLXrG//LCHieKepShKZJRUV6I6jHociio4y/9mNE+ygF54LXTeFuuuunJZYy8hyf4='} 2023-12-08T20:38:52.875 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-08_19:31:32-fs-main-distro-default-smithi/7484168', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 19:58:28.276149', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB6xfdZQU+57M8fY+TkjLceDtOSkAcJrrKN9zpb9MCs6gs+/7LQURdiyWZvBCM6jZwff8OUFjzJ3u+Hh1Mj1ckg='} 2023-12-08T20:38:52.914 INFO:teuthology.orchestra.console.smithi043:Power off 2023-12-08T20:38:52.915 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-08T20:38:52.932 INFO:teuthology.orchestra.console.smithi111:Power off 2023-12-08T20:38:52.932 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-08T20:38:52.947 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off 2023-12-08T20:38:52.948 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T20:38:52.963 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2023-12-08T20:38:52.964 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T20:38:52.978 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2023-12-08T20:38:52.992 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-12-08T20:38:56.979 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T20:38:56.993 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T20:38:57.095 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2023-12-08T20:38:57.108 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-12-08T20:39:01.100 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T20:39:01.109 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T20:39:01.211 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-12-08T20:39:01.222 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-12-08T20:39:01.312 INFO:teuthology.orchestra.console.smithi043:Power off completed 2023-12-08T20:39:05.226 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T20:39:05.337 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-12-08T20:39:05.438 INFO:teuthology.orchestra.console.smithi111:Power off completed 2023-12-08T20:39:05.544 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1888.7379376888275 failure_reason: 'Command failed on smithi043 with status 1: ''sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 28476818-9607-11ee-95a3-87774f69a715 -e sha1=9dcc13bb80dcc1cdea72b04d80505b4649a2b882 -- bash -c \''ceph versions | jq -e \''"\''"\''.overall | length == 1\''"\''"\''\''''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=33da4b1a555a4b6296cd3b8bf02c6493 status: fail success: false 2023-12-08T20:39:05.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T20:39:05.632 INFO:teuthology.run:FAIL