[2005] ASP.NET and Excel

[Blakk_Majik]

Hi all,

I "inherited" an ASP.NET page that reads in an excel sheet. However, I want to know the most effecient way to check for duplicate rows.

I was told I should sort the spreadsheet by a unique column, and then do my comparison. I would then compare the first row to the 2nd row, the 2nd row to the third row, and so on. I need to handle about 10,000 rows at once. Therefore, I am very concerned about timeout issues.

Is this the right approach? And if so, what resource can I look at to get started on it. If it's not the right approach, can someone give me an idea of what would be best?

Thanks

[Kasracer]

I was told I should sort the spreadsheet by a unique column, and then do my comparison. I would then compare the first row to the 2nd row, the 2nd row to the third row, and so on.

That actually wouldn't find duplicates unless they were next to each other. The way that should have been explained would be "compare the first row to the 2nd row, the 1st row to the 3rd row, etc).

Now on to the problem at hand. Do you have any control over how or when the data is loaded? If so then this can easily be solved by calling a different SQL query (if it's SQL) and doing a DISTINCT. If you don't have control over it, then what is it being loaded into? A DataGrid? If it's a DataGrid you may be able to do a SQL query into it with DISTINCT.

Other than that I'm not sure of a more efficient way. I like to take care of this before the data hits the application.

[Blakk_Majik]

When a user uploads a spreadsheet, it is held in a temporary folder while the application reads it. Once the application is done reading the data, the sheet is deleted from the temporary folder and the collection of data from the sheet is bound to a datagrid.

[mendhak]

Might be faster if you read from the Excel file (as a data source) into a dataset, then loop through the dataset instead.

[Blakk_Majik]

Do you know of any resources I can look at to do what you suggested?

[mendhak]

VB.NET?


How To Use ADO.NET to Retrieve and Modify Records in an Excel Workbook With Visual Basic .NET

How To Query and Display Excel Data by Using ASP.NET, ADO.NET, and Visual Basic .NET