带内核的高效linux debian 7服务器
3.2.0-4-amd64#1 SMP Debian 3.2.68-1 deb7u2 x86_64 GNU / Linux
制造商:Supermicro
产品名称:X10SLL-F
版本:1.02
SATA控制器:英特尔公司Lynx Point 6端口SATA控制器1 [AHCI模式](转速04)
2x SSD,2x硬盘
每个驱动器都可以做Sata Rev3(6.0Gb / s)
hdparm -I /dev/sd[a-d]|egrep "Model|speed|Transport" Model Number: TOSHIBA THNSNH128GBST Transport: Serial,ATA8-AST,SATA 1.0a,SATA II Extensions,SATA Rev 2.5,SATA Rev 2.6,SATA Rev 3.0 * Gen1 signaling speed (1.5Gb/s) * Gen2 signaling speed (3.0Gb/s) * Gen3 signaling speed (6.0Gb/s) * SMART Command Transport (SCT) feature set Model Number: TOSHIBA THNSNH128GBST Transport: Serial,SATA Rev 3.0 * Gen1 signaling speed (1.5Gb/s) * Gen2 signaling speed (3.0Gb/s) * Gen3 signaling speed (6.0Gb/s) * SMART Command Transport (SCT) feature set Model Number: ST2000VX000-1CU164 Transport: Serial,SATA Rev 3.0 * Gen1 signaling speed (1.5Gb/s) * Gen2 signaling speed (3.0Gb/s) * Gen3 signaling speed (6.0Gb/s) * SMART Command Transport (SCT) feature set
内核消息(至少对我来说)建议所有4个驱动器都存在问题,这让我相信它是可能有问题的SATA控制器.
ata1: exception Emask 0x50 SAct 0x0 SErr 0x4090800 action 0xe frozen ata1: irq_stat 0x00400040,connection status changed ata1: SError: { HostInt PHYRdyChg 10B8B DevExch } ata1: hard resetting link ata2: exception Emask 0x50 SAct 0x0 SErr 0x4090800 action 0xe frozen ata2: irq_stat 0x00400040,connection status changed ata2: SError: { HostInt PHYRdyChg 10B8B DevExch } ata2: hard resetting link ata4: exception Emask 0x50 SAct 0x0 SErr 0x4090800 action 0xe frozen ata4: irq_stat 0x00400040,connection status changed ata4: SError: { HostInt PHYRdyChg 10B8B DevExch } ata4: hard resetting link ata3: exception Emask 0x50 SAct 0x0 SErr 0x4090800 action 0xe frozen ata3: irq_stat 0x00400040,connection status changed ata3: SError: { HostInt PHYRdyChg 10B8B DevExch } ata3: hard resetting link ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 310) ata2: SATA link up 1.5 Gbps (SStatus 113 SControl 310) ata4: SATA link up 1.5 Gbps (SStatus 113 SControl 310) ata1: SATA link up 1.5 Gbps (SStatus 113 SControl 310) ata4.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out ata4.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out ata2.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out ata2.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out ata1.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out ata1.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out ata3.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out ata3.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out ata2.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out ata2.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out ata1.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out ata1.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out ata2.00: configured for UDMA/33 ata2: EH complete ata1.00: configured for UDMA/33 ata1: EH complete ata3.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out ata3.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out ata4.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out ata4.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out ata3.00: configured for UDMA/33 ata3: EH complete ata4.00: configured for UDMA/33 ata4: EH complete
我已经弄清楚了什么(或者相信已经弄明白了)
命令SECURITY FREEZE LOCK和DEVICE CONFIGURATION OVERLAY对此问题并不重要.
在阅读大约20个bug报告和大量文档时,一些链接的人建议禁用NCQ,我做了.
首先是一个设备,等待1天后检查错误是否重复它再次发生,我为所有4个设备禁用它
echo "1" >/sys/block/sdc/device/queue_depth
情况没有明显变化.
https://ata.wiki.kernel.org/index.php/Libata_error_messages
https://wiki.archlinux.org/index.php/Solid_State_Drives#Resolving_NCQ_errors
其他人建议使用sata电缆,甚至是电路板驱动器之间不兼容.
然而,因为我似乎要么在一个驱动器上有问题,这填充到所有4个,或直接在所有4个设备上问题我无法进一步查明问题.
因为这是一个生产服务器,可以将此服务器放下来进行维护(也就是bios /内核参数更改),但我想尽可能防止这种情况发生.
据主持人说,这可能与电源管理有关:
https://bugzilla.kernel.org/show_bug.cgi?id=74961
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1318218
echo "medium_power" >/sys/class/scsi_host/host0/link_power_management_policy
在更改之前,这被设置为max_performance.
这也没有帮助.
HDD / SDD的智能值是可以的,没什么太明显的.
请注意,UDMA值现在似乎只有33.
在启动服务器时,这是sata链接速度值:
[ 3.161850] ata6: SATA link down (SStatus 0 SControl 300) [ 3.161867] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 3.161882] ata4: SATA link up 3.0 Gbps (SStatus 123 SControl 300) [ 3.161894] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 3.161907] ata5: SATA link down (SStatus 0 SControl 300)
这种情况可能只发生在HDD的高负载上,我没有测试,因为它会明显影响服务器性能.
SSD上没有负载,它们已安装但未被任何进程使用.
据我所知,RAM是ECC.
dmidecode -t 17 # dmidecode 2.11 SMBIOS 2.7 present. Handle 0x0023,DMI type 17,34 bytes Memory Device Array Handle: 0x0022 Error Information Handle: Not Provided Total Width: 72 bits Data Width: 64 bits Size: 8192 MB Form Factor: DIMM Set: None Locator: P1-DIMMA1 Bank Locator: P0_Node0_Channel0_Dimm0 Type: DDR3 Type Detail: Synchronous Speed: 1600 MHz Manufacturer: Samsung Serial Number: 373A6427 Asset Tag: 9876543210 Part Number: M391B1G73QH0-CK0 Rank: 2 Configured Clock Speed: 1600 MHz
如果我能提供额外的信息,请告诉我,因为我缺乏想法下一步该做什么.