compaq dl380 G2 and smart array 3200, cac problems

From: Carson Harding <harding(at)motd.ca>
Date: Wed Jan 15 2003 - 21:08:29 EST

I'm having problems with the cac driver c***ing out on me.

I've got a Compaq DL380 G2 I'm trying to set up. I've disabled the embedded Smart Array 5i that OpenBSD doesn't recognize and installed a Smart Array 3200. I initially had some issues with the way memory was recognized, but have got past that now (see mickey's commit yesterday to /src/sys/arch/i386/i386/machdep.c).

I can install the OS fine, but when I go to do something disk intensive, I get a limited way along and then:

cac0: unable to alloc CCB
cac0: unable to alloc CCB
sd0: not queued, error 5
sd0: not queued, error 5
cac0: unable to alloc CCB
cac0: unable to alloc CCB
sd0: not queued, error 5
sd0: not queued, error 5

Before fixing the memory, this was followed by a panic in get_pool(); but now that has gone away and the machine simply hangs on all disk access. The farthest I've gotten is the source extracted, "make obj" done, and then a hang in "make depend" (which should have been
"make build" but that has nothing to do with the problem....).

There's a note from 21 Jul 2002 that seems to be very much the same problem. (google groups for "smart array 3200 openbsd pool_put"), with the suggestion from art to try sysctl -w kern.splassert=2. I tried this, but got no more diagnostics.

So before I go much farther with this, is anyone running:

1. a machine with a smart array 3200 that works;
2. a DL380 specifically with this controller that works?

Could this be a hardware problem?

Dmesgs below (note the first is GENERIC, the second is compiled with DEBUG as I was trying the memory fix. I get the same cac errors with either, but it interesting to look at the real, avail, and buffer memory lines. Note also kernel is 3.2-stable; the same thing happens the GENERIC kernel from the 3.2 release cds...)

Suggestions much appreciated. If someone really wants debugger output from the get_pool() crash, I'll try to get a serial console on the thing and make it crash from the stock GENERIC kernel, but that'll take a a day or two to arrange.

Thanks,
Carson

1. ---------------

OpenBSD 3.2-stable (GENERIC) #1: Tue Jan 14 10:59:47 MST 2003

    harding@jeffry:/usr/src/sys/arch/i386/compile/GENERIC cpu0: Intel Pentium III (Tualatin) ("GenuineIntel" 686-class) 1.40 GHz cpu0: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,SYS,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SIMD real mem = 267988992 (261708K)
avail mem = 27807744 (27156K)
using 4278 buffers containing 228249600 bytes (222900K) of memory User Kernel Config
UKC> q
Unknown command, try help
UKC> quit
Continuing...
mainbus0 (root)
bios0 at mainbus0: AT/286+(00) BIOS, date 12/31/99, BIOS32 rev. 0 @ 0xf0000 pcibios0 at bios0: rev. 2.1 @ 0xf0000/0x2000

pcibios0: PCI BIOS has 9 Interrupt Routing table entries
pcibios0: no compatible PCI ICU found
pcibios0: Warning, unable to fix up PCI interrupt routing
pcibios0: PCI bus #0 is the last bus

bios0: ROM list: 0xc0000/0x8000 0xc8000/0x4000 0xcc000/0x1800 0xee000/0x2000! pci0 at mainbus0 bus 0: configuration mode 1 (no bios) pchb0 at pci0 dev 0 function 0 "ServerWorks CNB20HE Host" rev 0x23 pci1 at pchb0 bus 1

pchb1 at pci0 dev 0 function 1 "ServerWorks CNB20HE Host" rev 0x01
pchb2 at pci0 dev 0 function 2 "ServerWorks I/O Bridge" rev 0x01
pchb3 at pci0 dev 0 function 3 "ServerWorks I/O Bridge" rev 0x01

pci2 at pchb3 bus 7
ppb0 at pci2 dev 4 function 0 "IBM 82351 PCI-PCI" rev 0x07 pci3 at ppb0 bus 8
cac0 at pci3 dev 0 function 0 "Compaq SMART2P RAID" rev 0x03: irq 5 Compaq Smart Array 3200 scsibus0 at cac0: 1 targets
sd0 at scsibus0 targ 0 lun 0: <Compaq, RAID0 volume #0, > SCSI2 0/direct fixed sd0: 34727MB, 8716 cyl, 255 head, 32 sec, 512 bytes/sec, 71122560 sec total vendor "Compaq", unknown product 0xa0f7 (class system, subclass PCI Hot-Plug, rev 0x12) at pci2 dev 7 function 0 not configured fxp0 at pci0 dev 2 function 0 "Intel 82557" rev 0x08: irq 3, address 00:08:02:b3:6c:19 inphy0 at fxp0 phy 1: i82555 10/100 media interface, rev. 4 fxp1 at pci0 dev 4 function 0 "Intel 82557" rev 0x08: irq 7, address 00:08:02:b3:6c:18 inphy1 at fxp1 phy 1: i82555 10/100 media interface, rev. 4 vga1 at pci0 dev 5 function 0 "ATI Rage XL" rev 0x27 wsdisplay0 at vga1: console (80x25, vt100 emulation) wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
"Compaq Netelligent ASMC" rev 0x00 at pci0 dev 6 function 0 not configured
pcib0 at pci0 dev 15 function 0 "ServerWorks ROSB4 SouthBridge" rev 0x51 pciide0 at pci0 dev 15 function 1 "ServerWorks OSB4 IDE" rev 0x00: DMA atapiscsi0 at pciide0 channel 0 drive 0
scsibus1 at atapiscsi0: 2 targets
cd0 at scsibus1 targ 0 lun 0: <COMPAQ, CD-224E, A.8D> SCSI0 5/cdrom removable cd0(pciide0:0:0): using PIO mode 4, DMA mode 2 ohci0 at pci0 dev 15 function 2 "ServerWorks OSB4/CSB5 USB" rev 0x04: irq 11, OHCI version 1.0, legacy support usb0 at ohci0: USB revision 1.0
uhub0 at usb0
uhub0: vendor 0x0000 OHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub0: 4 ports with 4 removable, self powered isa0 at pcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0 pms0 at pckbc0 (aux slot)
pckbc0: using irq 12 for aux slot
wsmouse0 at pms0 mux 0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
sysbeep0 at pcppi0
npx0 at isa0 port 0xf0/16: using exception 16 pccom0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec biomask c860 netmask c8e8 ttymask d8ea
pctr: 686-class user-level performance counters enabled mtrr: Pentium Pro MTRR support
dkcsum: sd0 matched BIOS disk 80
root on sd0a
rootdev=0x400 rrootdev=0xd00 rawdev=0xd02 WARNING: /mnt was not properly unmounted

2) ---------------

OpenBSD 3.2-stable (GENERIC_DEBUG) #1: Tue Jan 14 16:34:32 MST 2003

    harding@jeffry:/usr/src/sys/arch/i386/compile/GENERIC_DEBUG cpu0: Intel Pentium III (Tualatin) ("GenuineIntel" 686-class) 1.40 GHz cpu0: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,SYS,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SIMD real mem = 268005376 (261724K)
avail mem = 242712576 (237024K)
using 3297 buffers containing 13504512 bytes (13188K) of memory mainbus0 (root)
bios0 at mainbus0: AT/286+(00) BIOS, date 12/31/99, BIOS32 rev. 0 @ 0xf0000 pcibios0 at bios0: rev. 2.1 @ 0xf0000/0x2000

pcibios0: PCI BIOS has 9 Interrupt Routing table entries
pcibios0: no compatible PCI ICU found
pcibios0: Warning, unable to fix up PCI interrupt routing
pcibios0: PCI bus #0 is the last bus

bios0: ROM list: 0xc0000/0x8000 0xc8000/0x4000 0xcc000/0x1800 0xee000/0x2000! pci0 at mainbus0 bus 0: configuration mode 1 (no bios) pchb0 at pci0 dev 0 function 0 "ServerWorks CNB20HE Host" rev 0x23 pci1 at pchb0 bus 1

pchb1 at pci0 dev 0 function 1 "ServerWorks CNB20HE Host" rev 0x01
pchb2 at pci0 dev 0 function 2 "ServerWorks I/O Bridge" rev 0x01
pchb3 at pci0 dev 0 function 3 "ServerWorks I/O Bridge" rev 0x01

pci2 at pchb3 bus 7
ppb0 at pci2 dev 4 function 0 "IBM 82351 PCI-PCI" rev 0x07 pci3 at ppb0 bus 8
cac0 at pci3 dev 0 function 0 "Compaq SMART2P RAID" rev 0x03: irq 5 Compaq Smart Array 3200 scsibus0 at cac0: 1 targets
sd0 at scsibus0 targ 0 lun 0: <Compaq, RAID0 volume #0, > SCSI2 0/direct fixed sd0: 34727MB, 8716 cyl, 255 head, 32 sec, 512 bytes/sec, 71122560 sec total vendor "Compaq", unknown product 0xa0f7 (class system, subclass PCI Hot-Plug, rev 0x12) at pci2 dev 7 function 0 not configured fxp0 at pci0 dev 2 function 0 "Intel 82557" rev 0x08: irq 3, address 00:08:02:b3:6c:19 inphy0 at fxp0 phy 1: i82555 10/100 media interface, rev. 4 fxp1 at pci0 dev 4 function 0 "Intel 82557" rev 0x08: irq 7, address 00:08:02:b3:6c:18 inphy1 at fxp1 phy 1: i82555 10/100 media interface, rev. 4 vga1 at pci0 dev 5 function 0 "ATI Rage XL" rev 0x27 wsdisplay0 at vga1: console (80x25, vt100 emulation) wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
"Compaq Netelligent ASMC" rev 0x00 at pci0 dev 6 function 0 not configured
pcib0 at pci0 dev 15 function 0 "ServerWorks ROSB4 SouthBridge" rev 0x51 pciide0 at pci0 dev 15 function 1 "ServerWorks OSB4 IDE" rev 0x00: DMA atapiscsi0 at pciide0 channel 0 drive 0
scsibus1 at atapiscsi0: 2 targets
cd0 at scsibus1 targ 0 lun 0: <COMPAQ, CD-224E, A.8D> SCSI0 5/cdrom removable cd0(pciide0:0:0): using PIO mode 4, DMA mode 2 ohci0 at pci0 dev 15 function 2 "ServerWorks OSB4/CSB5 USB" rev 0x04: irq 11, OHCI version 1.0, legacy support usb0 at ohci0: USB revision 1.0
uhub0 at usb0
uhub0: vendor 0x0000 OHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub0: 4 ports with 4 removable, self powered isa0 at pcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0 pmsiprobe: intellimode -> 6
pms0 at pckbc0 (aux slot)
pckbc0: using irq 12 for aux slot
wsmouse0 at pms0 mux 0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
sysbeep0 at pcppi0

lpt_isa_probe: mask ff data 55 failed
lpt_isa_probe: mask ff data 55 failed
lpt_isa_probe: mask ff data 55 failed

npx0 at isa0 port 0xf0/16: using exception 16 pccom0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec biomask c860 netmask c8e8 ttymask d8ea
pctr: 686-class user-level performance counters enabled mtrr: Pentium Pro MTRR support

dkcsum: checksum of sd0 is 498486c5
dkcsum: attempting to match with BIOS drive 80 csum 498486c5
dkcsum: sd0 matched BIOS disk 80

root on sd0a
rootdev=0x400 rrootdev=0xd00 rawdev=0xd02 WARNING: /mnt was not properly unmounted init: copying out path `/sbin/init' 11

-- 
Carson Harding - harding@motd.ca

Received on Wed Jan 15 21:49:22 2003