how to convert large file (90+ Mb) from gb2312 to utf-8

[Guest alexkos]

Hi!

The problem is that iconv, the main tool for converting files can not process files of such a big size!

PS I'm using a Mac, so any UNIX solutions will work + can emulate WinXP

[imron]

Open the file in vi. Type the following commands:

:set encoding=gb2312

:set fileencoding=utf8

:w myfile.utf8

:q

Vi will be using iconv to do the conversions, but it will possibly be doing it line by line so iconv should be able to handle it. Make sure you save to a different filename than the original, just in case something goes wrong and the original 90mb file is lost.

[c_redman]

perl -MEncode -ne "binmode STDOUT, ':utf8'; print decode('euc-cn', $_)" < test.gb > test.u8

[Guest alexkos]

非常感谢！！！

thanks a lot!

Another solution is: open the file using Wenlin... surprisingly, it can handle 90 mb files