| lists.openwall.net | lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC | |
|
Open Source and information security mailing list archives
| ||
|
Message-ID: <39C96BD2-7DED-4E31-BDCF-D81863D37827@nutanix.com>
Date: Tue, 29 Oct 2024 01:41:19 +0000
From: Jon Kohler <jon@...anix.com>
To: "linux-kernel@...r.kernel.org" <linux-kernel@...r.kernel.org>
CC: Peter Zijlstra <peterz@...radead.org>, Ingo Molnar <mingo@...hat.com>
Subject: BUG_ON in Kernel 5.10.205 pick_next_rt_entity kernel/sched/rt.c:1616
Hi all, reaching out with a bug report for a kernel BUG_ON assert
with version 5.10.205.
The crash occurs at BUG_ON(idx >= MAX_RT_PRIO).
We've been encountering the following rt.c crash within our fleet and
are having a difficult time reproducing it in a targeted manner.
However, we see these crashes and core dumps with a fair frequency
across fleet machines.
I did a spot check of 5.10.205 vs 5.10.223 and did not see any commits
into rt.c since .205 that appear to address this issue, so I believe
we'd also see this issue in 5.10.223.
This particular fleet runs a collection of processes with various RT
priorities. This crash appears to be correlated with a moderate, but
not extreme, amount of load when there is context switching between one
group of threads with RT priority 10 and another with RT priority 5.
We have primarily seen the assert trigger when RT priority is 5. That
said, we've seen this trigger when the current process has both RT
priority 10 and RT priority 0 in the case of the provided crash data
below.
I do not think the absolute value of priority 10 or 5 is causal, but
it may contribute to the rate at which this can trigger.
I've included various excerpts from the core dump below, but there are
definitely some oddities here that have us scratching our heads.
Namely, to get to this assert, the call chain roughly needs to look
like this in the most minimal way:
pick_next_task_rt
sched_rt_runnable == true (i.e. rq->rt.rt_queued > 0)
// NOTE: in all of the crash dumps I've analyzed on this issue
// rt_queued seems to consistently be zero (0) by the time the
// crash dump records the value.
// This is odd because this would indicated that we shouldn't
// have taken this branch at all, but yet we did.
_pick_next_task_rt
pick_next_rt_entity
idx = sched_find_first_bit(array->bitmap);
BUG_ON(idx >= MAX_RT_PRIO); <<< this must be 100 or higher
// NOTE: value of bitmap at this point in crash dump is
// bitmap = {0, 68719476736}.
Based on the value of rt_queued being zero at crash dump time, but must
be 1 or higher at runtime, we thought there might be some sort of
mem barrier issue, locking, or other data race, so we did run with both
lockdep and kcsan for extended periods, but were unable to have that
machinery pick up the issue here.
Past that:
The general fingerprint here is that we see highest_prio.curr == 100,
and based on one of the crash dump analysis, we believe there is the
possibility that this value of 100 will flow into set_bit for array
bitmap in such a way that the only valid value at the time of the
assert in question may be 100, causing the assert to fire.
Note, we do see that in 5.11, there appears to be an unrelated commit
that would have clamped setting highest_prio.curr to MAX_RT_PRIO-1:
Patch in question with related commits
b13772f8135 sched/cpupri: Add CPUPRI_HIGHER
934fc3314b3 sched/cpupri: Remap CPUPRI_NORMAL to MAX_RT_PRIO-1 <<< patch in question
1b08782ce31 sched/cpupri: Remove pri_to_cpu[1]
5e054bca44f sched/cpupri: Remove pri_to_cpu[CPUPRI_IDLE]
I believe that clamping the MAX_RT_PRIO with the patch series above
should plug this pinhole-esque bug, and would love any ideas anyone
on the list has on how I might be able to minimize such reproduction to
tickle this assert in a more narrow way (its been driving me nuts!)
Thank you for your help in advance,
Jon Kohler
// Possible callchain on how we might get highest_prio.curr to be 100
// and have that flow into array->bitmap
futex_wait
futex_wait_queue_me
schedule
__schedule
prev = rq->curr;
rq_lock(rq, &rf);
smp_mb__after_spinlock();
if (!preempt && prev->state && !signal_pending_state)
deactivate_task(rq, prev);
next = pick_next_task(rq, prev, &rf); // We're dying here
// Switch to call chain below
core.c -> pick_next_task
put_prev_task_balance(rq, prev, rf);
// Possibly runs pull_rt_task, which with NO_RT_PUSH_IPI can
// activate_task() on current CPU RQ
// Switch to call chain below, specifically to activate_task
// HOWEVER, we have seen this issue with BOTH RT_PUSH_IPI and
// NO_RT_PUSH_IPI
Call from either enqueue_rt_entity or dequeue_rt_entity
activate_task
deactivate_task
dequeue_rt_stack
__dequeue_rt_entity
rt_se->on_rq = 0;
dec_rt_tasks
// Decrements rt_nr_running and rr_nr_running to zero
dec_rt_prio
if (rt_rq->rt_nr_running == 0)
rt_rq->highest_prio.curr = MAX_RT_PRIO; // 100
// This is fixed in 5.11 as noted in analysis
dec_rt_migration
rt_nr_total--;
rt_nr_migratory--;
update_rt_migration
// Call from enqueue_rt_entity
for_each_sched_rt_entity(rt_se)
__enqueue_rt_entity(rt_se, flags);
// See call chain below where highest_prio.curr could be set to 100
__enqueue_rt_entity
if (move_entity(flags))
__set_bit(rt_rq->highest_prio.curr, array->bitmap);
// This may potentially set bit to 100 if highest_prio.curr == 100,
// which is what we see in crash dump
WARN_ON(!rt_prio(prio)); // We've seen this warning fire
// Switch back to core.c -> pick_next_task call chain below
core.c -> pick_next_task
// Return from balance_rt and pull_rt_task + activate_task
class->pick_next_task(rq) // We eventually die in here
pick_next_task_rt
if (!sched_rt_runnable(rq)) // rq->rt.rt_queued > 0 == true
return NULL;
// Note: we proceed so this must be observed at 1 > 0 at runtime
// But in the crash dump we see this as zero.
_pick_next_task_rt
pick_next_rt_entity
idx = sched_find_first_bit(array->bitmap);
BUG_ON(idx >= MAX_RT_PRIO); // We die here as idx >= 100
// CRASH EXCERPTS //
crash> bt
PID: 0 TASK: ffff8d2b402d1640 CPU: 8 COMMAND: "swapper/8"
#0 [ffffa63ec00b7bb8] machine_kexec at ffffffffb005440b
#1 [ffffa63ec00b7c10] __crash_kexec at ffffffffb01236fa
#2 [ffffa63ec00b7cd0] crash_kexec at ffffffffb0124501
#3 [ffffa63ec00b7ce8] oops_end at ffffffffb002e268
#4 [ffffa63ec00b7d08] do_trap at ffffffffb002af05
#5 [ffffa63ec00b7d50] do_error_trap at ffffffffb002b034
#6 [ffffa63ec00b7d90] exc_invalid_op at ffffffffb0b4cfbc
#7 [ffffa63ec00b7db0] asm_exc_invalid_op at ffffffffb0c00ae2
[exception RIP: pick_next_task_rt+110]
RIP: ffffffffb00c0d4e RSP: ffffa63ec00b7e68 RFLAGS: 00010002
RAX: 0000000000000064 RBX: ffff8d36efc2f400 RCX: 0000000000000000
RDX: ffff8d36efc2f640 RSI: ffff8d2b402d1640 RDI: ffff8d36efc2f400
RBP: ffff8d36efc2f400 R8: 00044d8c1d8cde4d R9: ffff8d2b40242148
R10: 0000000000000000 R11: ffffa63ec2c27e80 R12: ffff8d2b402d1640
R13: 0000000000000000 R14: ffff8d36efc2f400 R15: ffff8d2b402d1c90
ORIG_RAX: ffffffffffffffff CS: 0010 SS: 0018
#8 [ffffa63ec00b7e80] __schedule at ffffffffb0b58a1b
#9 [ffffa63ec00b7ee0] schedule_idle at ffffffffb0b58ede
#10 [ffffa63ec00b7ee8] do_idle at ffffffffb00b0e9e
#11 [ffffa63ec00b7f28] cpu_startup_entry at ffffffffb00b10c9
#12 [ffffa63ec00b7f38] start_secondary at ffffffffb004a2d7
#13 [ffffa63ec00b7f50] secondary_startup_64_no_verify at ffffffffb00000f5
KERNEL: ... 5.10.205 ...
DUMPFILE: ...
CPUS: 16
DATE: Sun Oct 27 13:23:00 UTC 2024
UPTIME: 13 days, 16:43:10
LOAD AVERAGE: 31.53, 32.69, 29.71
TASKS: 2013
NODENAME: ...
RELEASE: ... 5.10.205 ...
VERSION: #1 SMP Wed Jun 19 04:58:21 UTC 2024
MACHINE: x86_64 (4093 Mhz)
MEMORY: 48 GB
PANIC: "kernel BUG at kernel/sched/rt.c:1616!"
PID: 0
COMMAND: "swapper/8"
TASK: ffff8d2b402d1640 (1 of 16) [THREAD_INFO: ffff8d2b402d1640]
CPU: 8
STATE: TASK_RUNNING (PANIC)
crash> struct task_struct ffff8d2b402d1640
struct task_struct {
thread_info = {
flags = 16520,
status = 0
},
state = 0,
stack = 0xffffa63ec00b4000,
usage = {
refs = {
counter = 1
}
},
flags = 2097218,
ptrace = 0,
on_cpu = 1,
wake_entry = {
llist = {
next = 0x0
},
{
u_flags = 48,
a_flags = {
counter = 48
}
},
src = 0,
dst = 0
},
cpu = 8,
wakee_flips = 2,
wakee_flip_decay_ts = 5478057266,
last_wakee = 0xffff8d340ccf2c80,
recent_used_cpu = 8,
wake_cpu = 8,
on_rq = 1,
prio = 120,
static_prio = 120,
normal_prio = 120,
rt_priority = 0,
sched_class = 0xffffffffb17c60e0,
se = {
load = {
weight = 1048576,
inv_weight = 4194304
},
run_node = {
__rb_parent_color = 1,
rb_right = 0x0,
rb_left = 0x0
},
group_node = {
next = 0xffff8d2b402d16e8,
prev = 0xffff8d2b402d16e8
},
on_rq = 0,
exec_start = 260043972,
sum_exec_runtime = 0,
vruntime = 0,
prev_sum_exec_runtime = 0,
nr_migrations = 0,
statistics = {
wait_start = 0,
wait_max = 0,
wait_count = 0,
wait_sum = 0,
iowait_count = 0,
iowait_sum = 0,
sleep_start = 0,
sleep_max = 0,
sum_sleep_runtime = 0,
block_start = 0,
block_max = 0,
exec_max = 0,
slice_max = 0,
nr_migrations_cold = 0,
nr_failed_migrations_affine = 0,
nr_failed_migrations_running = 0,
nr_failed_migrations_hot = 0,
nr_forced_migrations = 0,
nr_wakeups = 0,
nr_wakeups_sync = 0,
nr_wakeups_migrate = 0,
nr_wakeups_local = 0,
nr_wakeups_remote = 0,
nr_wakeups_affine = 0,
nr_wakeups_affine_attempts = 0,
nr_wakeups_passive = 0,
nr_wakeups_idle = 0
},
depth = 0,
parent = 0x0,
cfs_rq = 0xffff8d36efc2f480,
my_q = 0x0,
runnable_weight = 0,
avg = {
last_update_time = 0,
load_sum = 0,
runnable_sum = 0,
util_sum = 0,
period_contrib = 0,
load_avg = 1024,
runnable_avg = 0,
util_avg = 0,
util_est = {
enqueued = 0,
ewma = 0
}
}
},
rt = {
run_list = {
next = 0xffff8d2b402d1880,
prev = 0xffff8d2b402d1880
},
timeout = 0,
watchdog_stamp = 0,
time_slice = 100,
on_rq = 0,
on_list = 0,
back = 0x0,
parent = 0x0,
rt_rq = 0xffff8d36efc2f640,
my_q = 0x0
},
sched_task_group = 0xffffffffb2b49240,
dl = {
rb_node = {
__rb_parent_color = 18446617815632648400,
rb_right = 0x0,
rb_left = 0x0
},
dl_runtime = 0,
dl_deadline = 0,
dl_period = 0,
dl_bw = 0,
dl_density = 0,
runtime = 0,
deadline = 0,
flags = 0,
dl_throttled = 0,
dl_yielded = 0,
dl_non_contending = 0,
dl_overrun = 0,
dl_timer = {
node = {
node = {
__rb_parent_color = 18446617815632648488,
rb_right = 0x0,
rb_left = 0x0
},
expires = 0
},
_softexpires = 0,
function = 0xffffffffb00c6fd0,
base = 0xffff8d36efa22b00,
state = 0 '\000',
is_rel = 0 '\000',
is_soft = 0 '\000',
is_hard = 1 '\001'
},
inactive_timer = {
node = {
node = {
__rb_parent_color = 18446617815632648552,
rb_right = 0x0,
rb_left = 0x0
},
expires = 0
},
_softexpires = 0,
function = 0xffffffffb00c5280,
base = 0xffff8d36efa22b00,
state = 0 '\000',
is_rel = 0 '\000',
is_soft = 0 '\000',
is_hard = 1 '\001'
},
pi_se = 0xffff8d2b402d18d0
},
preempt_notifiers = {
first = 0x0
},
btrace_seq = 0,
policy = 0,
nr_cpus_allowed = 1,
cpus_ptr = 0xffff8d2b402d19d0,
cpus_mask = {
bits = {256, 0, 0, 0}
},
trc_reader_nesting = 0,
trc_ipi_to_cpu = 0,
trc_reader_special = {
b = {
blocked = 0 '\000',
need_qs = 0 '\000',
exp_hint = 0 '\000',
need_mb = 0 '\000'
},
s = 0
},
trc_reader_checked = true,
trc_holdout_list = {
next = 0xffff8d2b402d1a00,
prev = 0xffff8d2b402d1a00
},
sched_info = {
pcount = 0,
run_delay = 0,
last_arrival = 0,
last_queued = 0
},
tasks = {
next = 0xffff8d2b40249a30,
prev = 0xffffffffb1c13d30
},
pushable_tasks = {
prio = 140,
prio_list = {
next = 0xffff8d2b402d1a48,
prev = 0xffff8d2b402d1a48
},
node_list = {
next = 0xffff8d2b402d1a58,
prev = 0xffff8d2b402d1a58
}
},
pushable_dl_tasks = {
__rb_parent_color = 18446617815632648808,
rb_right = 0x0,
rb_left = 0x0
},
mm = 0x0,
active_mm = 0xffff8d2bab11b300,
vmacache = {
seqnum = 0,
vmas = {0x0, 0x0, 0x0, 0x0}
},
rss_stat = {
events = 0,
count = {0, 0, 0, 0}
},
exit_state = 0,
exit_code = 0,
exit_signal = 0,
pdeath_signal = 0,
jobctl = 0,
personality = 0,
sched_reset_on_fork = 0,
sched_contributes_to_load = 1,
sched_migrated = 0,
sched_remote_wakeup = 0,
in_execve = 0,
in_iowait = 0,
restore_sigmask = 0,
in_user_fault = 0,
no_cgroup_migration = 0,
frozen = 0,
use_memdelay = 0,
atomic_flags = 0,
restart_block = {
fn = 0xffffffffb0084800,
{
futex = {
uaddr = 0x0,
val = 0,
flags = 0,
bitset = 0,
time = 0,
uaddr2 = 0x0
},
nanosleep = {
clockid = 0,
type = TT_NONE,
{
rmtp = 0x0,
compat_rmtp = 0x0
},
expires = 0
},
poll = {
ufds = 0x0,
nfds = 0,
has_timeout = 0,
tv_sec = 0,
tv_nsec = 0
}
}
},
pid = 0,
tgid = 0,
stack_canary = 11200344866084499968,
real_parent = 0xffff8d2b40248000,
parent = 0xffffffffb1c13940,
children = {
next = 0xffff8d2b402d1b50,
prev = 0xffff8d2b402d1b50
},
sibling = {
next = 0xffff8d2b402d1b60,
prev = 0xffff8d2b402d1b60
},
group_leader = 0xffff8d2b402d1640,
ptraced = {
next = 0xffff8d2b40248538,
prev = 0xffff8d2b40248538
},
ptrace_entry = {
next = 0xffff8d2b40248548,
prev = 0xffff8d2b40248548
},
thread_pid = 0xffffffffb1c49180,
pid_links = {{
next = 0x0,
pprev = 0x0
}, {
next = 0x0,
pprev = 0x0
}, {
next = 0x0,
pprev = 0x0
}, {
next = 0x0,
pprev = 0x0
}},
thread_group = {
next = 0xffff8d2b402d1be0,
prev = 0xffff8d2b402d1be0
},
thread_node = {
next = 0xffff8d2b4026de90,
prev = 0xffff8d2b4026de90
},
vfork_done = 0x0,
set_child_tid = 0x0,
clear_child_tid = 0x0,
pf_io_worker = 0x0,
utime = 0,
stime = 28532720612,
gtime = 0,
prev_cputime = {
utime = 0,
stime = 0,
lock = {
raw_lock = {
{
val = {
counter = 0
},
{
locked = 0 '\000',
pending = 0 '\000'
},
{
locked_pending = 0,
tail = 0
}
}
}
}
},
vtime = {
seqcount = {
sequence = 2
},
starttime = 260044102,
state = VTIME_IDLE,
cpu = 8,
utime = 0,
stime = 0,
gtime = 0
},
tick_dep_mask = {
counter = 0
},
nvcsw = 0,
nivcsw = 4848458348,
start_time = 104691263,
start_boottime = 104691263,
min_flt = 0,
maj_flt = 0,
posix_cputimers = {
bases = {{
nextevt = 18446744073709551615,
tqhead = {
rb_root = {
rb_root = {
rb_node = 0x0
},
rb_leftmost = 0x0
}
}
}, {
nextevt = 18446744073709551615,
tqhead = {
rb_root = {
rb_root = {
rb_node = 0x0
},
rb_leftmost = 0x0
}
}
}, {
nextevt = 18446744073709551615,
tqhead = {
rb_root = {
rb_root = {
rb_node = 0x0
},
rb_leftmost = 0x0
}
}
}},
timers_active = 0,
expiry_active = 0
},
posix_cputimers_work = {
work = {
next = 0x0,
func = 0xffffffffb010ca70
},
mutex = {
owner = {
counter = 0
},
wait_lock = {
{
rlock = {
raw_lock = {
{
val = {
counter = 0
},
{
locked = 0 '\000',
pending = 0 '\000'
},
{
locked_pending = 0,
tail = 0
}
}
}
}
}
},
osq = {
tail = {
counter = 0
}
},
wait_list = {
next = 0xffff8d2b402d1d28,
prev = 0xffff8d2b402d1d28
}
},
scheduled = 0
},
ptracer_cred = 0x0,
real_cred = 0xffff8d2b40250fc0,
cred = 0xffff8d2b40250fc0,
cached_requested_key = 0x0,
comm = "swapper/8\000\000\000\000\000\000",
nameidata = 0x0,
sysvsem = {
undo_list = 0x0
},
sysvshm = {
shm_clist = {
next = 0xffff8d2b402d1d80,
prev = 0xffff8d2b402d1d80
}
},
last_switch_count = 0,
last_switch_time = 0,
fs = 0xffff8d2b402871c0,
files = 0xffff8d2b40259600,
io_uring = 0x0,
nsproxy = 0xffffffffb1c49460,
signal = 0xffff8d2b4026de80,
sighand = 0xffff8d2b402cb180,
blocked = {
sig = {0}
},
real_blocked = {
sig = {0}
},
saved_sigmask = {
sig = {0}
},
pending = {
list = {
next = 0xffff8d2b402d1de8,
prev = 0xffff8d2b402d1de8
},
signal = {
sig = {0}
}
},
sas_ss_sp = 0,
sas_ss_size = 0,
sas_ss_flags = 2,
task_works = 0x0,
audit_context = 0xffff8d2b4012e800,
loginuid = {
val = 4294967295
},
sessionid = 4294967295,
seccomp = {
mode = 0,
filter_count = {
counter = 0
},
filter = 0x0
},
parent_exec_id = 0,
self_exec_id = 0,
alloc_lock = {
{
rlock = {
raw_lock = {
{
val = {
counter = 0
},
{
locked = 0 '\000',
pending = 0 '\000'
},
{
locked_pending = 0,
tail = 0
}
}
}
}
}
},
pi_lock = {
raw_lock = {
{
val = {
counter = 0
},
{
locked = 0 '\000',
pending = 0 '\000'
},
{
locked_pending = 0,
tail = 0
}
}
}
},
wake_q = {
next = 0x0
},
pi_waiters = {
rb_root = {
rb_node = 0x0
},
rb_leftmost = 0x0
},
pi_top_task = 0x0,
pi_blocked_on = 0x0,
journal_info = 0x0,
bio_list = 0x0,
plug = 0x0,
reclaim_state = 0x0,
backing_dev_info = 0x0,
io_context = 0x0,
capture_control = 0x0,
ptrace_message = 0,
last_siginfo = 0x0,
ioac = {
rchar = 0,
wchar = 0,
syscr = 0,
syscw = 0,
read_bytes = 0,
write_bytes = 0,
cancelled_write_bytes = 0
},
acct_rss_mem1 = 0,
acct_vm_mem1 = 0,
acct_timexpd = 0,
mems_allowed = {
bits = {1, 0}
},
mems_allowed_seq = {
seqcount = {
sequence = 0
}
},
cpuset_mem_spread_rotor = -1,
cpuset_slab_spread_rotor = -1,
cgroups = 0xffffffffb235ff60,
cg_list = {
next = 0xffff8d2b402d1f40,
prev = 0xffff8d2b402d1f40
},
robust_list = 0x0,
compat_robust_list = 0x0,
pi_state_list = {
next = 0xffff8d2b402d1f60,
prev = 0xffff8d2b402d1f60
},
pi_state_cache = 0x0,
futex_exit_mutex = {
owner = {
counter = 0
},
wait_lock = {
{
rlock = {
raw_lock = {
{
val = {
counter = 0
},
{
locked = 0 '\000',
pending = 0 '\000'
},
{
locked_pending = 0,
tail = 0
}
}
}
}
}
},
osq = {
tail = {
counter = 0
}
},
wait_list = {
next = 0xffff8d2b402d1f88,
prev = 0xffff8d2b402d1f88
}
},
futex_state = 0,
perf_event_ctxp = {0x0, 0x0},
perf_event_mutex = {
owner = {
counter = 0
},
wait_lock = {
{
rlock = {
raw_lock = {
{
val = {
counter = 0
},
{
locked = 0 '\000',
pending = 0 '\000'
},
{
locked_pending = 0,
tail = 0
}
}
}
}
}
},
osq = {
tail = {
counter = 0
}
},
wait_list = {
next = 0xffff8d2b402d1fc0,
prev = 0xffff8d2b402d1fc0
}
},
perf_event_list = {
next = 0xffff8d2b402d1fd0,
prev = 0xffff8d2b402d1fd0
},
mempolicy = 0xffff8d2b401f1140,
il_prev = 0,
pref_node_fork = 0,
numa_scan_seq = 0,
numa_scan_period = 1000,
numa_scan_period_max = 0,
numa_preferred_nid = -1,
numa_migrate_retry = 0,
node_stamp = 0,
last_task_numa_placement = 0,
last_sum_exec_runtime = 0,
numa_work = {
next = 0xffff8d2b402d2020,
func = 0xffffffffb00b2aa0
},
numa_group = 0x0,
numa_faults = 0x0,
total_numa_faults = 0,
numa_faults_locality = {0, 0, 0},
numa_pages_migrated = 0,
rseq = 0x0,
rseq_sig = 0,
rseq_event_mask = 5,
tlb_ubc = {
arch = {
cpumask = {
bits = {0, 0, 0, 0}
}
},
flush_required = false,
writable = false
},
{
rcu_users = {
refs = {
counter = 2
}
},
rcu = {
next = 0x2,
func = 0x0
}
},
splice_pipe = 0x0,
task_frag = {
page = 0x0,
offset = 0,
size = 0
},
delays = 0xffff8d2b401f76e0,
nr_dirtied = 0,
nr_dirtied_pause = 32,
dirty_paused_when = 0,
timer_slack_ns = 50000,
default_timer_slack_ns = 50000,
curr_ret_stack = -1,
curr_ret_depth = -1,
ret_stack = 0x0,
ftrace_timestamp = 0,
trace_overrun = {
counter = 0
},
tracing_graph_pause = {
counter = 0
},
trace = 0,
trace_recursion = 0,
memcg_in_oom = 0x0,
memcg_oom_gfp_mask = 0,
memcg_oom_order = 0,
memcg_nr_pages_over_high = 0,
active_memcg = 0x0,
throttle_queue = 0x0,
utask = 0x0,
pagefault_disabled = 0,
oom_reaper_list = 0x0,
oom_reaper_timer = {
entry = {
next = 0x0,
pprev = 0x0
},
expires = 0,
function = 0x0,
flags = 0
},
stack_vm_area = 0xffff8d2b40256f40,
stack_refcount = {
refs = {
counter = 1
}
},
security = 0x0,
thread = {
tls_array = {{
limit0 = 0,
base0 = 0,
base1 = 0,
type = 0,
s = 0,
dpl = 0,
p = 0,
limit1 = 0,
avl = 0,
l = 0,
d = 0,
g = 0,
base2 = 0
}, {
limit0 = 0,
base0 = 0,
base1 = 0,
type = 0,
s = 0,
dpl = 0,
p = 0,
limit1 = 0,
avl = 0,
l = 0,
d = 0,
g = 0,
base2 = 0
}, {
limit0 = 0,
base0 = 0,
base1 = 0,
type = 0,
s = 0,
dpl = 0,
p = 0,
limit1 = 0,
avl = 0,
l = 0,
d = 0,
g = 0,
base2 = 0
}},
sp = 18446645387173002832,
es = 0,
ds = 0,
fsindex = 0,
gsindex = 0,
fsbase = 0,
gsbase = 0,
ptrace_bps = {0x0, 0x0, 0x0, 0x0},
virtual_dr6 = 0,
ptrace_dr7 = 0,
cr2 = 0,
trap_nr = 6,
error_code = 0,
io_bitmap = 0x0,
iopl_emul = 0,
iopl_warn = 0,
sig_on_uaccess_err = 0,
fpu = {
last_cpu = 4294967295,
avx512_timestamp = 0,
state = {
fsave = {
cwd = 0,
swd = 0,
twd = 0,
fip = 0,
fcs = 0,
foo = 0,
fos = 0,
st_space = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
status = 0
},
fxsave = {
cwd = 0,
swd = 0,
twd = 0,
fop = 0,
{
{
rip = 0,
rdp = 0
},
{
fip = 0,
fcs = 0,
foo = 0,
fos = 0
}
},
mxcsr = 0,
mxcsr_mask = 0,
st_space = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
xmm_space = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
padding = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
{
padding1 = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
sw_reserved = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0}
}
},
soft = {
cwd = 0,
swd = 0,
twd = 0,
fip = 0,
fcs = 0,
foo = 0,
fos = 0,
st_space = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
ftop = 0 '\000',
changed = 0 '\000',
lookahead = 0 '\000',
no_update = 0 '\000',
rm = 0 '\000',
alimit = 0 '\000',
info = 0x0,
entry_eip = 0
},
xsave = {
i387 = {
cwd = 0,
swd = 0,
twd = 0,
fop = 0,
{
{
rip = 0,
rdp = 0
},
{
fip = 0,
fcs = 0,
foo = 0,
fos = 0
}
},
mxcsr = 0,
mxcsr_mask = 0,
st_space = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
xmm_space = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
padding = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
{
padding1 = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
sw_reserved = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0}
}
},
header = {
xfeatures = 0,
xcomp_bv = 9223372036854776551,
reserved = {0, 0, 0, 0, 0, 0}
},
extended_state_area = 0xffff8d2b402d2500 ""
},
__padding = "\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000"...
}
}
}
crash> runq
CPU 0 RUNQUEUE: ffff8d36efa2f400
CURRENT: PID: 3165237 TASK: ffff8d3259262c80 COMMAND: "counters_collec"
RT PRIO_ARRAY: ffff8d36efa2f640
[no tasks queued]
CFS RB_ROOT: ffff8d36efa2f4b0
[no tasks queued]
CPU 1 RUNQUEUE: ffff8d36efa6f400
CURRENT: PID: 36992 TASK: ffff8d2b52d99640 COMMAND: "ScanPrefetchExe"
RT PRIO_ARRAY: ffff8d36efa6f640
[ 94] PID: 36992 TASK: ffff8d2b52d99640 COMMAND: "ScanPrefetchExe"
CFS RB_ROOT: ffff8d36efa6f4b0
[no tasks queued]
CPU 2 RUNQUEUE: ffff8d36efaaf400
CURRENT: PID: 928131 TASK: ffff8d33d909c2c0 COMMAND: "Incoming TCP - "
RT PRIO_ARRAY: ffff8d36efaaf640
[ 89] PID: 886837 TASK: ffff8d2b7d79d900 COMMAND: "epoll_1"
[ 94] PID: 928131 TASK: ffff8d33d909c2c0 COMMAND: "Incoming TCP - "
CFS RB_ROOT: ffff8d36efaaf4b0
[139] PID: 1982614 TASK: ffff8d2b53095900 COMMAND: "grep"
CPU 3 RUNQUEUE: ffff8d36efaef400
CURRENT: PID: 886898 TASK: ffff8d33af83d900 COMMAND: "rocksdb:low3"
RT PRIO_ARRAY: ffff8d36efaef640
[ 89] PID: 886898 TASK: ffff8d33af83d900 COMMAND: "rocksdb:low3"
CFS RB_ROOT: ffff8d36efaef4b0
[no tasks queued]
CPU 4 RUNQUEUE: ffff8d36efb2f400
CURRENT: PID: 886822 TASK: ffff8d2bbb2142c0 COMMAND: "control_5"
RT PRIO_ARRAY: ffff8d36efb2f640
[ 89] PID: 886822 TASK: ffff8d2bbb2142c0 COMMAND: "control_5"
CFS RB_ROOT: ffff8d36efb2f4b0
[no tasks queued]
CPU 5 RUNQUEUE: ffff8d36efb6f400
CURRENT: PID: 886945 TASK: ffff8d32b209c2c0 COMMAND: "spdk_epoll0"
RT PRIO_ARRAY: ffff8d36efb6f640
[ 89] PID: 886945 TASK: ffff8d32b209c2c0 COMMAND: "spdk_epoll0"
CFS RB_ROOT: ffff8d36efb6f4b0
[139] PID: 1982558 TASK: ffff8d2bb2189640 COMMAND: "links"
CPU 6 RUNQUEUE: ffff8d36efbaf400
CURRENT: PID: 886817 TASK: ffff8d2b7bbb42c0 COMMAND: "control_0"
RT PRIO_ARRAY: ffff8d36efbaf640
[ 89] PID: 886817 TASK: ffff8d2b7bbb42c0 COMMAND: "control_0"
CFS RB_ROOT: ffff8d36efbaf4b0
[no tasks queued]
CPU 7 RUNQUEUE: ffff8d36efbef400
CURRENT: PID: 887871 TASK: ffff8d325714ac80 COMMAND: "oplog_disk_55"
RT PRIO_ARRAY: ffff8d36efbef640
[ 89] PID: 887871 TASK: ffff8d325714ac80 COMMAND: "oplog_disk_55"
[ 94] PID: 41031 TASK: ffff8d2b91705900 COMMAND: "HTTP_PROTO_STAG"
CFS RB_ROOT: ffff8d36efbef4b0
[139] PID: 1982573 TASK: ffff8d33b23cc2c0 COMMAND: "links"
CPU 8 RUNQUEUE: ffff8d36efc2f400
CURRENT: PID: 0 TASK: ffff8d2b402d1640 COMMAND: "swapper/8"
RT PRIO_ARRAY: ffff8d36efc2f640
[no tasks queued]
CFS RB_ROOT: ffff8d36efc2f4b0
[no tasks queued]
CPU 9 RUNQUEUE: ffff8d36efc6f400
CURRENT: PID: 1501707 TASK: ffff8d340bd18000 COMMAND: "kworker/9:3"
RT PRIO_ARRAY: ffff8d36efc6f640
[ 89] PID: 1501707 TASK: ffff8d340bd18000 COMMAND: "kworker/9:3"
CFS RB_ROOT: ffff8d36efc6f4b0
[no tasks queued]
CPU 10 RUNQUEUE: ffff8d36efcaf400
CURRENT: PID: 1982567 TASK: ffff8d340a668000 COMMAND: "lsof"
RT PRIO_ARRAY: ffff8d36efcaf640
[no tasks queued]
CFS RB_ROOT: ffff8d36efcaf4b0
[120] PID: 47685 TASK: ffff8d33d784ac80 COMMAND: "medusa_1"
[120] PID: 47684 TASK: ffff8d2b65dfac80 COMMAND: "medusa_0"
[120] PID: 47688 TASK: ffff8d33d784c2c0 COMMAND: "cass_epd0"
CPU 11 RUNQUEUE: ffff8d36efcef400
CURRENT: PID: 0 TASK: ffff8d2b402d5900 COMMAND: "swapper/11"
RT PRIO_ARRAY: ffff8d36efcef640
[no tasks queued]
CFS RB_ROOT: ffff8d36efcef4b0
[no tasks queued]
CPU 12 RUNQUEUE: ffff8d36efd2f400
CURRENT: PID: 886825 TASK: ffff8d33d8a55900 COMMAND: "control_8"
RT PRIO_ARRAY: ffff8d36efd2f640
[ 89] PID: 886825 TASK: ffff8d33d8a55900 COMMAND: "control_8"
CFS RB_ROOT: ffff8d36efd2f4b0
[no tasks queued]
CPU 13 RUNQUEUE: ffff8d36efd6f400
CURRENT: PID: 886843 TASK: ffff8d340da72c80 COMMAND: "epoll_7"
RT PRIO_ARRAY: ffff8d36efd6f640
[ 89] PID: 886843 TASK: ffff8d340da72c80 COMMAND: "epoll_7"
CFS RB_ROOT: ffff8d36efd6f4b0
[no tasks queued]
CPU 14 RUNQUEUE: ffff8d36efdaf400
CURRENT: PID: 0 TASK: ffff8d2b402dac80 COMMAND: "swapper/14"
RT PRIO_ARRAY: ffff8d36efdaf640
[no tasks queued]
CFS RB_ROOT: ffff8d36efdaf4b0
[no tasks queued]
CPU 15 RUNQUEUE: ffff8d36efdef400
CURRENT: PID: 1982592 TASK: ffff8d2b53e51640 COMMAND: "python3.9"
RT PRIO_ARRAY: ffff8d36efdef640
[no tasks queued]
CFS RB_ROOT: ffff8d36efdef4b0
[no tasks queued]
crash> struct rt_rq ffff8d36efc2f640
struct rt_rq {
active = {
bitmap = {0, 68719476736},
queue = {{
next = 0xffff8d36efc2f650,
prev = 0xffff8d36efc2f650
}, {
next = 0xffff8d36efc2f660,
prev = 0xffff8d36efc2f660
}, {
next = 0xffff8d36efc2f670,
prev = 0xffff8d36efc2f670
}, {
next = 0xffff8d36efc2f680,
prev = 0xffff8d36efc2f680
}, {
next = 0xffff8d36efc2f690,
prev = 0xffff8d36efc2f690
}, {
next = 0xffff8d36efc2f6a0,
prev = 0xffff8d36efc2f6a0
}, {
next = 0xffff8d36efc2f6b0,
prev = 0xffff8d36efc2f6b0
}, {
next = 0xffff8d36efc2f6c0,
prev = 0xffff8d36efc2f6c0
}, {
next = 0xffff8d36efc2f6d0,
prev = 0xffff8d36efc2f6d0
}, {
next = 0xffff8d36efc2f6e0,
prev = 0xffff8d36efc2f6e0
}, {
next = 0xffff8d36efc2f6f0,
prev = 0xffff8d36efc2f6f0
}, {
next = 0xffff8d36efc2f700,
prev = 0xffff8d36efc2f700
}, {
next = 0xffff8d36efc2f710,
prev = 0xffff8d36efc2f710
}, {
next = 0xffff8d36efc2f720,
prev = 0xffff8d36efc2f720
}, {
next = 0xffff8d36efc2f730,
prev = 0xffff8d36efc2f730
}, {
next = 0xffff8d36efc2f740,
prev = 0xffff8d36efc2f740
}, {
next = 0xffff8d36efc2f750,
prev = 0xffff8d36efc2f750
}, {
next = 0xffff8d36efc2f760,
prev = 0xffff8d36efc2f760
}, {
next = 0xffff8d36efc2f770,
prev = 0xffff8d36efc2f770
}, {
next = 0xffff8d36efc2f780,
prev = 0xffff8d36efc2f780
}, {
next = 0xffff8d36efc2f790,
prev = 0xffff8d36efc2f790
}, {
next = 0xffff8d36efc2f7a0,
prev = 0xffff8d36efc2f7a0
}, {
next = 0xffff8d36efc2f7b0,
prev = 0xffff8d36efc2f7b0
}, {
next = 0xffff8d36efc2f7c0,
prev = 0xffff8d36efc2f7c0
}, {
next = 0xffff8d36efc2f7d0,
prev = 0xffff8d36efc2f7d0
}, {
next = 0xffff8d36efc2f7e0,
prev = 0xffff8d36efc2f7e0
}, {
next = 0xffff8d36efc2f7f0,
prev = 0xffff8d36efc2f7f0
}, {
next = 0xffff8d36efc2f800,
prev = 0xffff8d36efc2f800
}, {
next = 0xffff8d36efc2f810,
prev = 0xffff8d36efc2f810
}, {
next = 0xffff8d36efc2f820,
prev = 0xffff8d36efc2f820
}, {
next = 0xffff8d36efc2f830,
prev = 0xffff8d36efc2f830
}, {
next = 0xffff8d36efc2f840,
prev = 0xffff8d36efc2f840
}, {
next = 0xffff8d36efc2f850,
prev = 0xffff8d36efc2f850
}, {
next = 0xffff8d36efc2f860,
prev = 0xffff8d36efc2f860
}, {
next = 0xffff8d36efc2f870,
prev = 0xffff8d36efc2f870
}, {
next = 0xffff8d36efc2f880,
prev = 0xffff8d36efc2f880
}, {
next = 0xffff8d36efc2f890,
prev = 0xffff8d36efc2f890
}, {
next = 0xffff8d36efc2f8a0,
prev = 0xffff8d36efc2f8a0
}, {
next = 0xffff8d36efc2f8b0,
prev = 0xffff8d36efc2f8b0
}, {
next = 0xffff8d36efc2f8c0,
prev = 0xffff8d36efc2f8c0
}, {
next = 0xffff8d36efc2f8d0,
prev = 0xffff8d36efc2f8d0
}, {
next = 0xffff8d36efc2f8e0,
prev = 0xffff8d36efc2f8e0
}, {
next = 0xffff8d36efc2f8f0,
prev = 0xffff8d36efc2f8f0
}, {
next = 0xffff8d36efc2f900,
prev = 0xffff8d36efc2f900
}, {
next = 0xffff8d36efc2f910,
prev = 0xffff8d36efc2f910
}, {
next = 0xffff8d36efc2f920,
prev = 0xffff8d36efc2f920
}, {
next = 0xffff8d36efc2f930,
prev = 0xffff8d36efc2f930
}, {
next = 0xffff8d36efc2f940,
prev = 0xffff8d36efc2f940
}, {
next = 0xffff8d36efc2f950,
prev = 0xffff8d36efc2f950
}, {
next = 0xffff8d36efc2f960,
prev = 0xffff8d36efc2f960
}, {
next = 0xffff8d36efc2f970,
prev = 0xffff8d36efc2f970
}, {
next = 0xffff8d36efc2f980,
prev = 0xffff8d36efc2f980
}, {
next = 0xffff8d36efc2f990,
prev = 0xffff8d36efc2f990
}, {
next = 0xffff8d36efc2f9a0,
prev = 0xffff8d36efc2f9a0
}, {
next = 0xffff8d36efc2f9b0,
prev = 0xffff8d36efc2f9b0
}, {
next = 0xffff8d36efc2f9c0,
prev = 0xffff8d36efc2f9c0
}, {
next = 0xffff8d36efc2f9d0,
prev = 0xffff8d36efc2f9d0
}, {
next = 0xffff8d36efc2f9e0,
prev = 0xffff8d36efc2f9e0
}, {
next = 0xffff8d36efc2f9f0,
prev = 0xffff8d36efc2f9f0
}, {
next = 0xffff8d36efc2fa00,
prev = 0xffff8d36efc2fa00
}, {
next = 0xffff8d36efc2fa10,
prev = 0xffff8d36efc2fa10
}, {
next = 0xffff8d36efc2fa20,
prev = 0xffff8d36efc2fa20
}, {
next = 0xffff8d36efc2fa30,
prev = 0xffff8d36efc2fa30
}, {
next = 0xffff8d36efc2fa40,
prev = 0xffff8d36efc2fa40
}, {
next = 0xffff8d36efc2fa50,
prev = 0xffff8d36efc2fa50
}, {
next = 0xffff8d36efc2fa60,
prev = 0xffff8d36efc2fa60
}, {
next = 0xffff8d36efc2fa70,
prev = 0xffff8d36efc2fa70
}, {
next = 0xffff8d36efc2fa80,
prev = 0xffff8d36efc2fa80
}, {
next = 0xffff8d36efc2fa90,
prev = 0xffff8d36efc2fa90
}, {
next = 0xffff8d36efc2faa0,
prev = 0xffff8d36efc2faa0
}, {
next = 0xffff8d36efc2fab0,
prev = 0xffff8d36efc2fab0
}, {
next = 0xffff8d36efc2fac0,
prev = 0xffff8d36efc2fac0
}, {
next = 0xffff8d36efc2fad0,
prev = 0xffff8d36efc2fad0
}, {
next = 0xffff8d36efc2fae0,
prev = 0xffff8d36efc2fae0
}, {
next = 0xffff8d36efc2faf0,
prev = 0xffff8d36efc2faf0
}, {
next = 0xffff8d36efc2fb00,
prev = 0xffff8d36efc2fb00
}, {
next = 0xffff8d36efc2fb10,
prev = 0xffff8d36efc2fb10
}, {
next = 0xffff8d36efc2fb20,
prev = 0xffff8d36efc2fb20
}, {
next = 0xffff8d36efc2fb30,
prev = 0xffff8d36efc2fb30
}, {
next = 0xffff8d36efc2fb40,
prev = 0xffff8d36efc2fb40
}, {
next = 0xffff8d36efc2fb50,
prev = 0xffff8d36efc2fb50
}, {
next = 0xffff8d36efc2fb60,
prev = 0xffff8d36efc2fb60
}, {
next = 0xffff8d36efc2fb70,
prev = 0xffff8d36efc2fb70
}, {
next = 0xffff8d36efc2fb80,
prev = 0xffff8d36efc2fb80
}, {
next = 0xffff8d36efc2fb90,
prev = 0xffff8d36efc2fb90
}, {
next = 0xffff8d36efc2fba0,
prev = 0xffff8d36efc2fba0
}, {
next = 0xffff8d36efc2fbb0,
prev = 0xffff8d36efc2fbb0
}, {
next = 0xffff8d36efc2fbc0,
prev = 0xffff8d36efc2fbc0
}, {
next = 0xffff8d36efc2fbd0,
prev = 0xffff8d36efc2fbd0
}, {
next = 0xffff8d36efc2fbe0,
prev = 0xffff8d36efc2fbe0
}, {
next = 0xffff8d36efc2fbf0,
prev = 0xffff8d36efc2fbf0
}, {
next = 0xffff8d36efc2fc00,
prev = 0xffff8d36efc2fc00
}, {
next = 0xffff8d36efc2fc10,
prev = 0xffff8d36efc2fc10
}, {
next = 0xffff8d36efc2fc20,
prev = 0xffff8d36efc2fc20
}, {
next = 0xffff8d36efc2fc30,
prev = 0xffff8d36efc2fc30
}, {
next = 0xffff8d36efc2fc40,
prev = 0xffff8d36efc2fc40
}, {
next = 0xffff8d36efc2fc50,
prev = 0xffff8d36efc2fc50
}, {
next = 0xffff8d36efc2fc60,
prev = 0xffff8d36efc2fc60
}, {
next = 0xffff8d36efc2fc70,
prev = 0xffff8d36efc2fc70
}, {
next = 0xffff8d36efc2fc80,
prev = 0xffff8d36efc2fc80
}}
},
rt_nr_running = 0,
rr_nr_running = 0,
highest_prio = {
curr = 100,
next = 89
},
rt_nr_migratory = 0,
rt_nr_total = 0,
overloaded = 0,
pushable_tasks = {
node_list = {
next = 0xffff8d36efc2fcb8,
prev = 0xffff8d36efc2fcb8
}
},
rt_queued = 0,
rt_throttled = 0,
rt_time = 360210300,
rt_runtime = 1000000000,
rt_runtime_lock = {
raw_lock = {
{
val = {
counter = 0
},
{
locked = 0 '\000',
pending = 0 '\000'
},
{
locked_pending = 0,
tail = 0
}
}
}
},
rt_nr_boosted = 0,
rq = 0xffff8d36efc2f400,
tg = 0xffffffffb2b49240
}
Powered by blists - more mailing lists