<HEAD>
<META content="MSHTML 6.00.2900.2914" name=GENERATOR></HEAD>
<BODY>
<DIV>What filesystem are you using? Is it ReiserFS? Also have you considered ext3 with a journal volume or jfs? JFS is much more reliable, especially if you move to using separate journal files instead of inlining. It helps to know what type of FS you are using to determine the problem. I have had significant issues with ReiserFS in the past. It is a fast FS, but tends to loose links to inodes on occasions. Ext3 seems to be pretty stable. Also what distro are you using? Hopefully you are not on Suse 9.1 (workstation edition essentially). Suse has been know it introduce some nasty bugs on occasions in their releases. Redhat seems to be a bit cleaner on enterprise hardware. You may also want to consider alternatives like Veritas FS, IBM's JFS package, or at least thelinux LVM since it sounds like you are doing enterprise Linux stuff. If you are at the LUG meeting tonight, we can discuss this further. </DIV>
<DIV> </DIV>
<DIV>Thanks,</DIV>
<DIV>John<BR><BR><BR></DIV>
<BLOCKQUOTE style="PADDING-LEFT: 5px; MARGIN-LEFT: 0px; BORDER-LEFT: #0000ff 2px solid">-----Original Message----- <BR>From: Phil Thayer <PHIL.THAYER@VITALSITE.COM><BR>Sent: Sep 6, 2006 2:05 PM <BR>To: Kclug@kclug.org <BR>Subject: File System Corruption <BR><BR><ZZZHTML><ZZZHEAD><ZZZMETA content="text/html; charset=us-ascii" http-equiv="Content-Type"><ZZZMETA content="MSHTML 6.00.2900.2963" name="GENERATOR"></ZZZHEAD><ZZZBODY>
<DIV><FONT face=Arial size=2><SPAN class=214125418-06092006>I ran into a problem where a file system was corrupted beyond repair and wondered if anyone has seen anything like this before or has a reasonable explanation. Here is the scenario:</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=214125418-06092006></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=214125418-06092006>Linux was running on an Intel X64 system with two local drives mirrored in Linux containing the swap file system.</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=214125418-06092006>The system was booting off a SAN drive where the rest of Linux was loaded.</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=214125418-06092006>There were three other SAN LUN's being used that were:</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=214125418-06092006> 1. 500 GB</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=214125418-06092006> 2. 150 GB</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=214125418-06092006> 3. 35 GB (Linux LUN.)</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=214125418-06092006></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=214125418-06092006>We swapped the system hardware to a different box and changed the HBA to be on the new box so the HBA Bios was still allowing the Boot from SAN.</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=214125418-06092006>The new box had two local drives but they were mirrored at the hardware level with RAID 1 (so Linux would have only seen one drive drive.)</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=214125418-06092006>The system was rebooted and crashed with numerous file system corruption errors.</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=214125418-06092006>The 500 GB LUN on the SAN got severely corrupted on the reboot of Linux from the SAN with the new hardware to the point where it could not be repaired.</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=214125418-06092006></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=214125418-06092006>What I am wondering is, What caused the system to get corrupted?</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=214125418-06092006></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=214125418-06092006>Is it possible that the lack of a swap file system mounted would have caused this to happen? Or is it because the /dev devices were not the same as they were in the first configuration?</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=214125418-06092006></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=214125418-06092006>Any ideas?</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV><?xml:namespace prefix = o ns = "urn:schemas-microsoft-com:office:office" /><o:SmartTagType name="place" namespaceuri="urn:schemas-microsoft-com:office:smarttags"></o:SmartTagType><o:SmartTagType name="PostalCode" namespaceuri="urn:schemas-microsoft-com:office:smarttags"></o:SmartTagType><o:SmartTagType name="State" namespaceuri="urn:schemas-microsoft-com:office:smarttags"></o:SmartTagType><o:SmartTagType name="City" namespaceuri="urn:schemas-microsoft-com:office:smarttags"></o:SmartTagType><o:SmartTagType name="Street" namespaceuri="urn:schemas-microsoft-com:office:smarttags"></o:SmartTagType><o:SmartTagType name="address" namespaceuri="urn:schemas-microsoft-com:office:smarttags"></o:SmartTagType>
<STYLE>
st1\:*{behavior:url(#ieooui) }
</STYLE>
<STYLE>
<ZZZ!--
/* Font Definitions */
@font-face
{font-family:"French Script MT";
panose-1:3 2 4 2 4 6 7 4 6 5;
mso-font-charset:0;
mso-generic-font-family:ZZZscript;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:"Times New Roman";
mso-fareast-font-family:"Times New Roman";}
@page Section1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.Section1
{page:Section1;}
-->
</STYLE>
<DIV class=Section1><SPAN class=214125418-06092006><FONT face=Arial size=2>Phillip Thayer</FONT></SPAN></DIV></ZZZBODY></ZZZHTML></BLOCKQUOTE></BODY>