[GH-ISSUE #34] enclosure compatibility problem #31

Closed
opened 2026-05-05 03:31:52 -06:00 by gitea-mirror · 3 comments
Owner

Originally created by @darklinkworker on GitHub (Jul 5, 2020).
Original GitHub issue: https://github.com/ewwhite/zfs-ha/issues/34

So me and a few of my coworkers have been trying to get this ha zfs system running and we keep having drives drop out randomly and the drives are new so there shouldn't be anything wrong with them. After some testing it seem like the enclosures were the problem. It's a holiday weekend so everyone is taking a break right now but after digging in some more I am wondering if we just have the wrong hardware altogether. The enclosure don't seem to have a model number but the modules on them do. They are HP ap844b. It seems to only match hp P2000 enclosures so I am assuming that is what we got. We got a used HP storage once B6200 rack so everything was pre cables for HA, servers came with lots of RAM and 2 hba plus 2 10g nic cards. We assume this prebuilt rack from HP would work. I found a few people online say not every dual port enclosure will work. Wondering now if I can switch out the modules for one that will work. Sent on phone, did not reread to check for spelling or grammar

Originally created by @darklinkworker on GitHub (Jul 5, 2020). Original GitHub issue: https://github.com/ewwhite/zfs-ha/issues/34 So me and a few of my coworkers have been trying to get this ha zfs system running and we keep having drives drop out randomly and the drives are new so there shouldn't be anything wrong with them. After some testing it seem like the enclosures were the problem. It's a holiday weekend so everyone is taking a break right now but after digging in some more I am wondering if we just have the wrong hardware altogether. The enclosure don't seem to have a model number but the modules on them do. They are HP ap844b. It seems to only match hp P2000 enclosures so I am assuming that is what we got. We got a used HP storage once B6200 rack so everything was pre cables for HA, servers came with lots of RAM and 2 hba plus 2 10g nic cards. We assume this prebuilt rack from HP would work. I found a few people online say not every dual port enclosure will work. Wondering now if I can switch out the modules for one that will work. Sent on phone, did not reread to check for spelling or grammar
Author
Owner

@ewwhite commented on GitHub (Jul 5, 2020):

Hello,

The P2000 LFF expansion chassis (AP843B) and associated modules (AP844B) aren't intended for this purpose.
These are meant to be cascaded expansion for the P2000 SAN array. They may or may not work with what you're doing.

If you're having drive drop-outs, there would certainly be SAS and SCSI bus errors. Look at the output of dmesg or include relevant logs.

Also, what specific disks are being used?

<!-- gh-comment-id:653844503 --> @ewwhite commented on GitHub (Jul 5, 2020): Hello, The P2000 LFF expansion chassis (AP843B) and associated modules (AP844B) aren't intended for this purpose. These are meant to be cascaded expansion for the P2000 SAN array. They may or may not work with what you're doing. If you're having drive drop-outs, there would certainly be SAS and SCSI bus errors. Look at the output of `dmesg` or include relevant logs. Also, what specific disks are being used?
Author
Owner

@darklinkworker commented on GitHub (Jul 5, 2020):

Thanks for the quick reply. I am still out in a lake cabin and had to borrow a laptop from one of my nephews to grab this data.
The disks we are using are SEAGATE ST4000NM0023. so this HP storage rack we got came from a Data center that was pull by a local vendor who breaks down the racks and resells them on ebay. Well we got this rack before they broke it down so all the HP tags are on them from when it was new. There are 16 enclosures with all the modules beingAP844B. The were 4 servers group in two. the top two servers are connected to the top 8 enclosures and process repeats for the bottom half of the rack. These are messages we got on some of the drives that drop out of the zfs array
image

image

I though all enclosures were all the same. That there just a bunch of disks for a host bus adatper to read but after doing some digging I guess they are not the same. Wondering would I be able to switch out the modules for ones that would support this zfs HA system or do I need to replace the whole enclosure with D2600/D2700?

<!-- gh-comment-id:653906165 --> @darklinkworker commented on GitHub (Jul 5, 2020): Thanks for the quick reply. I am still out in a lake cabin and had to borrow a laptop from one of my nephews to grab this data. The disks we are using are SEAGATE ST4000NM0023. so this HP storage rack we got came from a Data center that was pull by a local vendor who breaks down the racks and resells them on ebay. Well we got this rack before they broke it down so all the HP tags are on them from when it was new. There are 16 enclosures with all the modules beingAP844B. The were 4 servers group in two. the top two servers are connected to the top 8 enclosures and process repeats for the bottom half of the rack. These are messages we got on some of the drives that drop out of the zfs array ![image](https://user-images.githubusercontent.com/13208519/86536679-20f98880-beaf-11ea-8b89-58af2017d752.png) ![image](https://user-images.githubusercontent.com/13208519/86536576-59e52d80-beae-11ea-8a50-ed2a92fbeaea.png) I though all enclosures were all the same. That there just a bunch of disks for a host bus adatper to read but after doing some digging I guess they are not the same. Wondering would I be able to switch out the modules for ones that would support this zfs HA system or do I need to replace the whole enclosure with D2600/D2700?
Author
Owner

@darklinkworker commented on GitHub (Aug 5, 2020):

Figure I would give an update. We ended up replacing the enclosures with HP D2600 and are problems went away. Drives didn't drop out any more and the system has been stable for a few weeks now.

<!-- gh-comment-id:669318621 --> @darklinkworker commented on GitHub (Aug 5, 2020): Figure I would give an update. We ended up replacing the enclosures with HP D2600 and are problems went away. Drives didn't drop out any more and the system has been stable for a few weeks now.
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/zfs-ha#31
No description provided.