GCarnegi
Apr 20th, 2006, 04:44 AM
I have a csv file with 480,000 rows of data which I need to be able to open in Excel.
I have written a csv parser which ONLY loads the row into the Excel spreadsheet if the data has changed from the previous row by more than a user defined "deviation limit". This should VASTLY reduce the number of rows loaded into the spreadsheet.
My problem is that my code simply stops checking the file when it gets to 32767 rows. I take it this is a limitation of the "signed integer" file-position pointer (although I fail to see why it has to be signed - who ever heard of a file pointer pointing to the "minus 32678th" record.
How can I create a filesystemobject which will allow me to analyse the rows on a text file of unlimited size? or at least a miliion or so rows.
thanks
Guy
I have written a csv parser which ONLY loads the row into the Excel spreadsheet if the data has changed from the previous row by more than a user defined "deviation limit". This should VASTLY reduce the number of rows loaded into the spreadsheet.
My problem is that my code simply stops checking the file when it gets to 32767 rows. I take it this is a limitation of the "signed integer" file-position pointer (although I fail to see why it has to be signed - who ever heard of a file pointer pointing to the "minus 32678th" record.
How can I create a filesystemobject which will allow me to analyse the rows on a text file of unlimited size? or at least a miliion or so rows.
thanks
Guy