|
-
Nov 18th, 2011, 08:52 PM
#1
Thread Starter
Addicted Member
[RESOLVED] Fastest way to read in a large text file (4GB+)
Hi
I seem to be hitting some limits on the Get statement when reading in a text file > 2GB in binary.
eg. Get #ff, byte position/number, buffer
When byte position is > 2,147,000,000 I get the error bad record number, I presume as the Get function was built using something similar to a long to hold the the byte number which has a maximum value of 2,147,000,000.
Unfortunately, I need to be able to read in large text files fast, and line input is just not up to the job due to speed issues, and byte arrays seem to max out >400MB and <500MB. Are there any other options?
All men have an inherent right to life, the right to self determination including freedom from forced or compulsory labour, a right to hold opinions and the freedom of expression, and the right to a fair trial and freedom from torture. Be aware that these rights are universal and inalienable (cannot be given, taken or otherwise transferred or removed) although you do risk losing the aforementioned rights should you fail to uphold them e.g Charles Taylor; United Nations sources: http://www.un.org/en/documents/udhr/, http://www.ohchr.org/EN/Professional...ages/CCPR.aspx. Also Charles I was beheaded on the 30th of January of 1649 for trying to replace parliamentary democracy with an absolute monarchy, the same should happen to Dr Phil and Stephen Fry; source: http://www.vbforums.com/showthread.p...ute-Monarchism.
The plural of sun is stars you Catholic turkeys.
Posting Permissions
- You may not post new threads
- You may not post replies
- You may not post attachments
- You may not edit your posts
-
Forum Rules
|
Click Here to Expand Forum to Full Width
|