[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-Id: <200907161714.37928.borntraeger@de.ibm.com>
Date: Thu, 16 Jul 2009 17:14:36 +0200
From: Christian Bornträger <borntraeger@...ibm.com>
To: Mike Snitzer <snitzer@...hat.com>
Cc: Alasdair G Kergon <agk@...hat.com>,
LKML <linux-kernel@...r.kernel.org>,
"Rafael J. Wysocki" <rjw@...k.pl>
Subject: Re: regression post 2.6.30: device mapper fails on some logical volumes
Am Donnerstag 16 Juli 2009 16:44:39 schrieben Sie:
> On Thu, Jul 16 2009 at 1:36am -0400,
> These "target device dasde1 is misaligned" warnings are a function of
> device-mapper now being topology-aware. This means that your LVs are
> likely misaligned relative to the underlying hardware.
>
> Moving forward it would likely be wise if we were to add a bit more
> contextual information to the warning so we'd know _why_ a device was
> deemed "misaligned".
>
> So you know these dasd devices to use an internal (aka
> physical_block_size) of 512 bytes? And a logical_block_size (aka hard
> sect size) of 4096 bytes? That would be strange; I'm only aware of the
> opposite being possible (physical_block_size=4096,
> logical_block_size=512).
No, the physical block size and the logical block size is 4k for dasds.
> In any case, the reason for your "aisaligned" warnings could be that
> you're using partitions with start offsets into the underlying dasd
> device that aren't aligned on a 4k boundary.
> Please provide the output from the following commands:
>
> pvs -o +pe_start /dev/dasdf1
[root@...lp34 ~]# pvs -o +pe_start /dev/dasdf1
PV VG Fmt Attr PSize PFree 1st PE
/dev/dasdf1 space lvm2 a- 22.49G 12.00M 192.00K
> I'm not sure of the /sys/block/ device names that are associated with
> /dev/dasdf1, maybe dasdf is the entire device and dasdf1 is a partition?
Yes, dasdf is a device with up to 3 partitions and dasdf1 is the first
partition:
> So along the lines of these commands (relative to sda6):
> cat /sys/block/sda/sda6/alignment_offset
> cat /sys/block/sda/queue/physical_block_size
> cat /sys/block/sda/queue/logical_block_size
>
> maybe these are applicable to dasdf1?:
> cat /sys/block/dasdf/dasdf1/alignment_offset
0
> cat /sys/block/dasdf/queue/physical_block_size
4096
> cat /sys/block/dasdf/queue/logical_block_size
4096
>
> It would also be great if you could provide the "dmsetup table"
> output associated the dasdf1 device. Are you just using linear DM
> mappings?
If you look down the logs, all 4 pv are affected, so I am posting the complete
dmsetup table output. dasdf1 is 94:21.
space-s17: 0 819200 striped 2 128 94:21 27148672 94:17 27148672
space-r5: 0 819200 striped 2 128 94:21 16908672 94:17 16908672
space-r16: 0 819200 striped 2 128 94:21 25919872 94:17 25919872
space-s16: 0 819200 striped 2 128 94:21 26329472 94:17 26329472
space-s9: 0 819200 striped 2 128 94:21 20595072 94:17 20595072
space-r4: 0 819200 striped 2 128 94:21 16089472 94:17 16089472
space-r15: 0 819200 striped 2 128 94:21 25100672 94:17 25100672
space-s15: 0 819200 striped 2 128 94:21 25510272 94:17 25510272
space-s8: 0 819200 striped 2 128 94:21 19775872 94:17 19775872
space-r3: 0 819200 striped 2 128 94:21 15270272 94:17 15270272
space-r29: 0 819200 striped 2 128 94:9 7471488 94:17 45482368
space-r14: 0 819200 striped 2 128 94:21 24281472 94:17 24281472
space-s29: 0 819200 striped 2 128 94:9 7881088 94:17 45891968
space-s14: 0 819200 striped 2 128 94:21 24691072 94:17 24691072
space-s7: 0 819200 striped 2 128 94:21 18956672 94:17 18956672
space-r2: 0 819200 striped 2 128 94:21 14451072 94:17 14451072
space-r28: 0 819200 striped 2 128 94:9 6652288 94:17 44663168
space-r13: 0 819200 striped 2 128 94:21 23462272 94:17 23462272
space-usr: 0 6291456 striped 2 128 94:21 10486144 94:17 10486144
space-s28: 0 819200 striped 2 128 94:9 7061888 94:17 45072768
space-s13: 0 819200 striped 2 128 94:21 23871872 94:17 23871872
space-s6: 0 819200 striped 2 128 94:21 18137472 94:17 18137472
space-r1: 0 819200 striped 2 128 94:21 13631872 94:17 13631872
space-r27: 0 819200 striped 2 128 94:9 5833088 94:17 43843968
space-r12: 0 819200 striped 2 128 94:21 22643072 94:17 22643072
space-test: 0 6291456 striped 2 128 94:21 33292672 94:17 33292672
space-test: 6291456 2441216 striped 2 128 94:9 8290688 94:13 8388992
space-test: 8732672 1490944 striped 2 128 94:17 46301568 94:21 46399872
space-s27: 0 819200 striped 2 128 94:9 6242688 94:17 44253568
space-s12: 0 819200 striped 2 128 94:21 23052672 94:17 23052672
space-s5: 0 819200 striped 2 128 94:21 17318272 94:17 17318272
space-r26: 0 819200 striped 2 128 94:9 5013888 94:17 43024768
space-r11: 0 819200 striped 2 128 94:21 21823872 94:17 21823872
space-s26: 0 819200 striped 2 128 94:9 5423488 94:17 43434368
space-s11: 0 819200 striped 2 128 94:21 22233472 94:17 22233472
space-s4: 0 819200 striped 2 128 94:21 16499072 94:17 16499072
space-r25: 0 819200 striped 2 128 94:9 4194688 94:17 42205568
space-home: 0 10485760 striped 2 128 94:21 36962688 94:17 36962688
space-r10: 0 819200 striped 2 128 94:21 21004672 94:17 21004672
space-s25: 0 819200 striped 2 128 94:9 4604288 94:17 42615168
space-s10: 0 819200 striped 2 128 94:21 21414272 94:17 21414272
space-s3: 0 819200 striped 2 128 94:21 15679872 94:17 15679872
space-r24: 0 819200 striped 2 128 94:21 32473472 94:17 32473472
space-base: 0 8388608 striped 2 128 94:9 384 94:13 4194688
space-s24: 0 819200 striped 2 128 94:21 32883072 94:17 32883072
space-s2: 0 819200 striped 2 128 94:21 14860672 94:17 14860672
space-r23: 0 819200 striped 2 128 94:21 31654272 94:17 31654272
space-r9: 0 819200 striped 2 128 94:21 20185472 94:17 20185472
space-s23: 0 819200 striped 2 128 94:21 32063872 94:17 32063872
space-s1: 0 819200 striped 2 128 94:21 14041472 94:17 14041472
space-r22: 0 819200 striped 2 128 94:21 30835072 94:17 30835072
space-space: 0 20971520 striped 2 128 94:21 384 94:17 384
space-root: 0 1048576 striped 2 128 94:21 36438400 94:17 36438400
space-r8: 0 819200 striped 2 128 94:21 19366272 94:17 19366272
space-s22: 0 819200 striped 2 128 94:21 31244672 94:17 31244672
space-r19: 0 819200 striped 2 128 94:21 28377472 94:17 28377472
space-r21: 0 819200 striped 2 128 94:21 30015872 94:17 30015872
space-s19: 0 819200 striped 2 128 94:21 28787072 94:17 28787072
space-r7: 0 819200 striped 2 128 94:21 18547072 94:17 18547072
space-s21: 0 819200 striped 2 128 94:21 30425472 94:17 30425472
space-r18: 0 819200 striped 2 128 94:21 27558272 94:17 27558272
space-r20: 0 819200 striped 2 128 94:21 29196672 94:17 29196672
space-s18: 0 819200 striped 2 128 94:21 27967872 94:17 27967872
space-r6: 0 819200 striped 2 128 94:21 17727872 94:17 17727872
space-ccache: 0 8388608 striped 2 128 94:13 384 94:21 42205568
space-s20: 0 819200 striped 2 128 94:21 29606272 94:17 29606272
space-r17: 0 819200 striped 2 128 94:21 26739072 94:17 26739072
PLease note that most of the LVs are fine, only test and home dont come up.
Maybe the following information is of some use:
[root@...lp34 ~]# lvdisplay --maps /dev/mapper/space-home
--- Logical volume ---
LV Name /dev/space/home
VG Name space
LV UUID zqzWBR-orl5-c4N0-XNcP-hqtr-e3qa-TCwNLe
LV Write Access read/write
LV Status available
# open 1
LV Size 5.00 GB
Current LE 1280
Segments 1
Allocation inherit
Read ahead sectors auto
- currently set to 256
Block device 253:51
--- Segments ---
Logical extent 0 to 1279:
Type striped
Stripes 2
Stripe size 64 KB
Stripe 0:
Physical volume /dev/dasdf1
Physical extents 4512 to 5151
Stripe 1:
Physical volume /dev/dasde1
Physical extents 4512 to 5151
> p.s. I'm out of the office for a few more days but when I'm back I can
> look to try to reproduce on dasd devices on s390 hardware (if we're
> unable to make progress with you sharing the above info).
Well, next week I am going to leave for my wedding and my honeymoon, so we have
some kine of overlap here. I know that redhat has an s390, but I can also
reproduce and test in the middle of august ;-)
Is it possible that the lvm tools created logical volumes in a wrong way, and
the old kernel never detected a misaligment? (After all, the old code always
passed 0 to blk_stack_limits)
Christian
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
Powered by blists - more mailing lists