[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-ID: <20081121171537.GA12370@sgi.com>
Date: Fri, 21 Nov 2008 11:15:37 -0600
From: Dimitri Sivanich <sivanich@....com>
To: "H. Peter Anvin" <hpa@...or.com>,
Andrew Morton <akpm@...ux-foundation.org>, mingo@...e.hu
Cc: tglx@...utronix.de, linux-kernel@...r.kernel.org,
john stultz <johnstul@...ibm.com>
Subject: Re: [PATCH 2/2 v3] SGI RTC: add generic timer system interrupt
On Thu, Nov 20, 2008 at 03:19:49PM -0800, H. Peter Anvin wrote:
> Andrew Morton wrote:
> >>
> >> Refreshing this to use 0xed as the vector. Have repackaged it to be more
> >> generic.
> >>
>
> What happened to the concept of using normal IRQs for this, via a custom
> irqchip? Adding more reserved vectors really sucks, and it affects
> non-SGI platforms, which could potentially run out of vectors as a result.
There are basically two issues with using 'normal IRQs' in cases like this:
- Using normal IRQs would mean we would have an IRQ per cpu. The current
hard coded maximum, NR_IRQS, is 4352 (NR_VECTORS + (32 * MAX_IO_APICS)).
On machines with large numbers of cpus and an irq per cpu for each desired
interrupt, that's a lot of IRQs. In addition, the GRU, will need 2 such
IRQs per cpu. On 4096 cpu systems, you've already used up more than the
limit just for that. Until some sort of infrastructure change takes place
that would potentially allow this to be dynamically increased, such as
Yinghai Lu's "sparse_irq aka dyn_irq v14" patch, this problem will exist.
Furthermore, the actual runtime limit, nr_irqs, is set to 96 by
probe_nr_irqs for our configuration. This is because that code assumes all
vectors are io-apic vectors, not cpu centric vectors like the ones I'm
talking about. With the current, scheme, even on a 128 cpu system, I'm out
of IRQs immediately.
- The current infrastructure for requesting vector/IRQ combinations doesn't
allow one to request an interrupt priority higher than i/o device interrupt
priorities. Clock event (high resolution timer) code should run at higher
interrupt priority.
I labeled the system vector as generic to indicate that this is available to
other platforms.
Given the above issues, do you have any suggestions as to how I might best
resolve this?
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
Powered by blists - more mailing lists