tag:blogger.com,1999:blog-3156578562014006371.post3596566988744249006..comments2023-09-23T18:48:06.541+02:00Comments on NTFS-3G for Mac OS X: NTFS-3G 1.2712Erikhttp://www.blogger.com/profile/18326970669258666618noreply@blogger.comBlogger30125tag:blogger.com,1999:blog-3156578562014006371.post-22311616379675925142008-08-20T09:21:00.000+02:002008-08-20T09:21:00.000+02:00NTFS-3G for Mac OS X 1.2812 has been released.NTFS-3G for Mac OS X 1.2812 has been released.Erikhttps://www.blogger.com/profile/18326970669258666618noreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-61303412139678428112008-08-18T09:13:00.000+02:002008-08-18T09:13:00.000+02:00Raymond:I've had a hard disk crash on my mac, so I...Raymond:<BR/><BR/>I've had a hard disk crash on my mac, so I'm in the process of restoring my system to a new drive.<BR/>I may update the package later today, if I'm up and running by then.Erikhttps://www.blogger.com/profile/18326970669258666618noreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-91667190682206375282008-08-17T23:57:00.000+02:002008-08-17T23:57:00.000+02:00ntfs-3g 1.2812 releasedntfs-3g 1.2812 releasedAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-56154479751598663422008-08-09T09:28:00.000+02:002008-08-09T09:28:00.000+02:00Phil:You don't even need rEFIt, you can just hold ...Phil:<BR/><BR/>You don't even need rEFIt, you can just hold the option key at startup.Erikhttps://www.blogger.com/profile/18326970669258666618noreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-19508613641637613332008-08-08T18:31:00.000+02:002008-08-08T18:31:00.000+02:00Hey guys,Just wanted to let you know that even if ...Hey guys,<BR/><BR/>Just wanted to let you know that even if all NTFS drives are removed from the startup prefpane, using a bootmenu like rEFIt http://refit.sourceforge.net/ will allow you to boot into Windows anyways.<BR/><BR/>Hope that helps.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-1093085163646145052008-07-31T17:08:00.000+02:002008-07-31T17:08:00.000+02:00Yeah, I know. But I don't think there's anything i...Yeah, I know. But I don't think there's anything interesting in there. <BR/>Folder: /Flo/flo/ <BR/>Copied that to a HFS+ partition (with finder), then checked file/folder counts and computed total size. (also work for most subirectories, though not all subirectories I think, but most) So I can't really tell what got lost (which is my problem) I just know file counts and sizes are different. Though I tried to use a tool like unsion, and it finds differences, but using it for the complete folder structure might make the mac unusable for days.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-68207037310188865912008-07-31T06:06:00.000+02:002008-07-31T06:06:00.000+02:00flo:I'll check it out. The rapidshare way worked o...flo:<BR/><BR/>I'll check it out. The rapidshare way worked out fine, although if your NTFS tree structure contains any information that you wouldn't want to share with the whole world, well... you just did. :)<BR/><BR/>Could you specify which folder the internal NTFS driver sees as a file, and give an example where content got lost while copying, so I know what to test?Erikhttps://www.blogger.com/profile/18326970669258666618noreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-52834869964064121762008-07-31T02:21:00.000+02:002008-07-31T02:21:00.000+02:00Ok, the work around with zfs worked. I uploaded th...Ok, the work around with zfs worked. I uploaded the bz2 to rapidshare, hope that's ok.<BR/>http://rapidshare.com/files/133704932/ntfsmeta.img.bz2.html<BR/>It's only 4 MB now, but most files are rather big, so there's not that much metadata maybe. Also took really long, so the archie better be good :)<BR/>Would be nice if you could keep me updated about your investigation with the archive.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-42702145375823933082008-07-30T19:10:00.000+02:002008-07-30T19:10:00.000+02:00bzip2ing now ... takes ages.OT: You or anyone know...bzip2ing now ... takes ages.<BR/>OT: You or anyone know whether activity monitor's cpu graphs (for example the 2 bars you can set it to show in the dock) accurately depict cpu load across cores? Because that would explain a lot of sluggishness sometimes, if processes are delegated to one core only.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-85862963977623610462008-07-29T10:15:00.000+02:002008-07-29T10:15:00.000+02:00flo:Okay, I can reproduce. Something is fishy abou...flo:<BR/><BR/>Okay, I can reproduce. Something is fishy about NTFS-3G sparse files. This will be investigated...<BR/><BR/>In the meantime, this is my workaround:<BR/>An alternative choice for an alternative file system which supports sparse files is ZFS, which now works on OS X.<BR/>Go to <A HREF="http://zfs.macosforge.org/trac/wiki/downloads" REL="nofollow">the ZFS download page</A> and grab the latest binaries, and follow the instruction on that page.<BR/><BR/>Now, go to Disk Utility and create a normal read/write disk image for holding the ZFS file system (on any drive). For my 60 GiB NTFS file system the sparse metadata image needed about 1.5 GiB of actual space. I made a 10 GiB disk image to be sure.<BR/>You can't initialize the disk image with ZFS in Disk Utility (at least I couldn't), so make it a HFS+ image, and then go to the Terminal to put the last bits together:<BR/><BR/>> sudo diskutil partitiondisk /dev/diskX GPTFormat ZFS %noformat% 100%<BR/>(diskX replaced by the disk id of your disk image... don't make a mistake here!)<BR/><BR/>> sudo zpool create ZFSSparseTest /dev/diskXs2<BR/>(if the ZFS partition is number 2, which it was for me... partition 1 became an EFI partition)<BR/><BR/>Now you should have /Volumes/ZFSSparseTest mounted and available. Store the metadata image there (worked for me). When ntfsclone is finished, bzip2 the sparse metadata image. I ended up with 14 MiB of bz2 compressed data from the 60 GiB (1.5 GiB actual content) sparse file.<BR/><BR/>Good luck.Erikhttps://www.blogger.com/profile/18326970669258666618noreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-29729304257132545212008-07-29T07:10:00.000+02:002008-07-29T07:10:00.000+02:00flo:That sounds strange. Perhaps you just found a ...flo:<BR/><BR/>That sounds strange. Perhaps you just found a bug in ntfs-3g? I'll do some testing on my own and then I'll get back to you.Erikhttps://www.blogger.com/profile/18326970669258666618noreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-82726963773601882008-07-28T21:24:00.000+02:002008-07-28T21:24:00.000+02:00Thanks so far, that seemed to work at first, but a...Thanks so far, that seemed to work at first, but at 9.7 percent it stopped with an error:<BR/>"ERROR(57): Write failed: Socket is not connected"<BR/>A big enough file had been created on the additional ntfs-3g drive, but because it exited with an error I deleted it and tried again, which led to "ERROR(20): Couldn't access '/Volumes/Backup/ntfsmeta.img': Not a directory" This is kinda strange, cause I can access the drive with finder, just when try to ls its contents in terminal, it gives an error like "ls: backup: Device not configured"<BR/>After unmounting and remounting though, I could repeat the above, but with the same results. I tried compressing the incomplete file but got the "bzip2: Can't open input file /Volumes/Backup/ntfsmeta.img: Not a directory." error.<BR/>The drive this was copied on should be fine, it was checked on a windows machine before. So, any ideas on this?Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-29548074795246170532008-07-28T20:31:00.000+02:002008-07-28T20:31:00.000+02:00flo:Yes, uhm... that's because ntfsclone depends o...flo:<BR/><BR/>Yes, uhm... that's because ntfsclone depends on sparse files, which isn't supported by HFS+. You'd be better off storing the metadata image on another NTFS-3G mounted file system, if possible, since NTFS-3G supports sparse files.Erikhttps://www.blogger.com/profile/18326970669258666618noreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-56224157250838276062008-07-28T20:22:00.000+02:002008-07-28T20:22:00.000+02:00O.k., I will try to get you the metadata image. Ra...O.k., I will try to get you the metadata image. Ran into the following problem. I always get an error like this "ERROR(28): ftruncate failed for file '/Volumes/Media/ntfsmeta.img': No space left on device<BR/>" There is like 70 GB free on that device, unfortunately source volume is more like 250 GB. So am i guessing correctly that it checks for available space before it actually does anything, and needs the actual space taken up the data, even if it only reads zeros? I tried piping through stdout to bzip2, but it says that's not supported.<BR/>command used (for normal output, not piping): "/usr/local/sbin/ntfsclone --metadata --output /Volumes/Media/ntfsmeta.img /dev/disk2s1"<BR/>It would be quite a hassle to free up 250+ GB, so if you can think of something else or tell me if I used the wrong command? Thanks in advance, florianAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-65965806909513966862008-07-28T19:37:00.000+02:002008-07-28T19:37:00.000+02:00flo:The sluggishness may be due to the USB impleme...flo:<BR/><BR/>The sluggishness may be due to the USB implementation in OS X. USB transfers always puts a lot higher burden on the system than FireWire or the internal/external SATA/IDE interfaces.<BR/>This might get amplified by the way ntfs-3g does I/O... I should do some performance testing to see if that's the case.<BR/><BR/>If you could provide me with a metadata image of the drive with that directory structure that won't copy properly, I could do some testing on my own. ntfsclone, which is included in this package, has this functionality. Read the man page ("man ntfsclone") for more info.<BR/><BR/>As a sidenote, which is not going to help you with this particular problem, I have written a piece of software called HFSExplorer ( http://hem.bredband.net/catacombae/ ) that provides a free way of accessing your files (read-only) on a HFS+ drive from within Windows (or other OS's).Erikhttps://www.blogger.com/profile/18326970669258666618noreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-31445914704188520102008-07-28T00:54:00.000+02:002008-07-28T00:54:00.000+02:00Hey thanks for the reply.Build used: stableMacFuse...Hey thanks for the reply.<BR/>Build used: stable<BR/>MacFuse Core: 10.5-1.7.1 (I think)<BR/>OS version: OS X 10.5.4 with all latest updates<BR/>Maybe I should refine the part about cpu usage: If I connect the 2 drives and let them do stuff, and generally try to do something else the system gets really sluggish. (by something else I mean Firefox, maybe itunes, so no cpu intensive stuff) Then when I look at activity monitor, ntfs-3g isn't always on top, and it doesn't totally flood (for lack of a better word) the cpu, but gets at least up to 40/60 % i think sometimes.<BR/>Connection: Yes, I'm connecting it exclusively over the usb port, cause the mac book air lacks a firewire port (always used that on my old windows notebook) and has only one usb port.<BR/>About the os x driver: Yeah sure, I know it's strange ... you know how I might be able to check for that? I have access to a windows systems, but that doesn't really help for copying data, because win doesn't know hfs and wifi is way too slow.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-81392326279147348532008-07-27T23:35:00.000+02:002008-07-27T23:35:00.000+02:00flo:"Insane" CPU usage is *not* normal, and indica...flo:<BR/><BR/>"Insane" CPU usage is *not* normal, and indicates that something is out of the ordinary. ntfs-3g very rarely eats more than 10% CPU, and that's in extreme load situations tested on my first revision MacBook (less powerful than your equipment).<BR/><BR/>You didn't specify which build you are using... stable or ublio. The hardware specifications of a MacBook Air are quite well known so there's no point in asking about that, but what OS X version, MacFUSE version are you using?<BR/>Are you exclusively using USB2 as the connection method between the WD drive and your computer?<BR/><BR/>Also it seems strange that OS X's NTFS driver sees your folder as a file. Maybe it's because of unsupported features such as reparse points, junctions, symlinks... something like that.Erikhttps://www.blogger.com/profile/18326970669258666618noreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-3994884421793678772008-07-27T22:47:00.000+02:002008-07-27T22:47:00.000+02:00Update: Checked and I should have the latest versi...Update: Checked and I should have the latest version.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-35030350292686002242008-07-27T22:43:00.000+02:002008-07-27T22:43:00.000+02:00Hey ... just switching all my data from an NTFS dr...Hey ... just switching all my data from an NTFS drive to an hfs drive. (also an Western Digital MyBook as above) apart from cpu usage always being insane (though i guess it's ok if you don't use it regularly) I have some weird behaviour. I copy some folder (let's say 40 G, some less, some more) and afterwards I check the file/folder numbers and the size. Sometimes there's wuite a difference (at least 300 -400 MB, 20-40 files or so) Any idea how I can make sure all file are there?<BR/>Sidenotes: Maybe I'm using one version older than this, have to check. Also, you might say "Why not use apples driver for copying?" Well, turns out apples driver sees on of the folders only as a file, not as a folder. I checked the drive multiple times under windows, it's fine, also, I did not knowingly enable compression/encryption or stuff like that.<BR/>Hardware: This is my first mac, (Mac Book air) so I'm not sure, but hardware wise it should be more than able to copy files, even with the ntfs driver, right? This of course means that both drives are connected to the same usb port. Could this cause an issue? I really just wanna finish moving my files to hfs cause ntfs-3g is eating cpu cycles for breakfast ... any help greatly appreciated.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-65205826577738504672008-07-21T17:48:00.000+02:002008-07-21T17:48:00.000+02:00When ublio is enabled then data is cached in memor...When ublio is enabled then data is cached in memory and the disk can power down during this time and then the OS can indeed report an IO error later on. <BR/><BR/>This is one of the most common device driver and disk problem with some version of Seagate and WD disks. That's why I suggested you to check the log files because usually OSes report such errors, like the ones listed on http://ntfs-3g.org/support.html#ioerrorAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-87058645935041190892008-07-21T12:45:00.000+02:002008-07-21T12:45:00.000+02:00Hi,I did some more testing this morning, with ubli...Hi,<BR/><BR/>I did some more testing this morning, with ublio disabled I copied approx. 13GB of data to the disk without any error (albeit with a lower transfer rate). <BR/><BR/>Is it possible that the ublio enabled NTFS-3g is prone to timeouts, i.e. if the source hdd has a high load (many files open for reading/writing) and delivers data to slowly ublio enabled NTFS-3g reckons that as an error?<BR/><BR/>In my opinion it's either related to that or a freak PPC/ublio bug not reported yet.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-48071761123938328562008-07-21T11:29:00.000+02:002008-07-21T11:29:00.000+02:00Tom: Check your logs for the reason for the I/O er...Tom: Check your logs for the reason for the I/O error. It will tell if it's hardware related or not.<BR/><BR/>Also, if the IO errors happen at random time then it's quite probably hardware error. If you can reliable reproduce the same error (e.g. when coping the same directory then the error always happen exactly at the same place) then it's probably a software error unless you have some media/hardware faults on a certain used place on the disk.<BR/><BR/>Errors during higher CPU usage are also a sign of hardware error because it stresses the hardware better.<BR/><BR/>An ublio related, big-endian (PPC) bug is also possible since I think not many people are having it. Otherwise there would be much more such bug report.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-18370443732173061262008-07-20T15:46:00.000+02:002008-07-20T15:46:00.000+02:00Hi,I just did some rudimentary testing. I copied a...Hi,<BR/><BR/>I just did some rudimentary testing. I copied a folder with 10GB content to the FW disk (ublio enabled), everything went fine. I copied another folder (650MB), no error again. The third folder however (670MB) produced a -43 error halfway through the process. I deleted the folder, tried again and got a -36 error (deleted the folder again). Then I unmounted the device, run the "disable caching" command and remounted the disk. Then I copied the third folder again, no errors this time. The data transfer with ublio enabled is way faster, something around 70% (depending). CPU usage with ublio enabled for ntfs-3g is in the range 16% to 20%, when ublio is disabled it sometimes drops to 10%, but mainly stays in the 16% to 20% range too. I hope that helps a little bit.<BR/>I don't think it's a hardware error related to the WD MyBook drive, as these errors happen only when accessing the NTFS fs with NTFS-3g, not on XP with native support, nor on linux when accessing the ext3 partition. The internal hdd in my mac doesn't show any errors too and I run S.M.A.R.T. tests on a regular basis.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-74100824066650107022008-07-19T01:07:00.000+02:002008-07-19T01:07:00.000+02:00Error -36 is 'I/O error" and the -43 is typically ...Error -36 is 'I/O error" and the -43 is typically a consequence of this one. They are documented on http://developer.apple.com/documentation/Carbon/Reference/File_Manager/Reference/reference.html#//apple_ref/doc/uid/TP30000107-CH5g-RCM0037<BR/><BR/>The most common reasons for the 'I/O' errors are documented on http://ntfs-3g.org/support.html#ioerror<BR/><BR/>Especially check out WD MyBook part and the referring links there. Many people are complaining about dying WD MyBook drives. Not only on OS X but on Linux and Windows too. It seems to be a serious disk manufacturing error coupled.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-3156578562014006371.post-48635485711961110422008-07-18T13:22:00.000+02:002008-07-18T13:22:00.000+02:00Tom:Just to ensure there are no misunderstandings:...Tom:<BR/><BR/>Just to ensure there are no misunderstandings:<BR/>Make sure that you still use the same build, the ublio build, but with ublio disabled. The stable build has always worked fine in this regard.<BR/>If you're unsure, execute the command "/usr/bin/ntfs-3g --help" in the Terminal and check the first lines for the message about USE_UBLIO and USE_ALIGNED_IO, which indicates that you're using the ublio build.<BR/><BR/>Thanks for helping out with testing. :)Erikhttps://www.blogger.com/profile/18326970669258666618noreply@blogger.com