Database And System Resources

[MattJH]

I am transferring data from one database to another, there is 125,000 records and I am using DataSets and DataAdapters etc. to connect to the database and hold information.

When I run the program after around 160 records the program stops responding, so I decided to look at the processes and the instance of my program was in there, it was using nearly 100Mb of memory and absolutly tanning the CPU at 94% Usage.

What could be the cause of this????

Is it because I am putting all the 125,000 records in the dataset??? Although I am upgrading this program from VB6 to VB.NET and I never had that problem before using the ADODB.Recordset.

Any help/advice would be great.

Cheers.


Matt.

[moinkhan]

If you are just reading data from a database and copying to another.. then you don't need to use DataSet on the reading part.. use DataReader instead..
and try to filter the data as much as possible..
Fetch the filtered data..
copy them
and fetch the filtered data.. and so on...

Your program is hanging because Dataset creates a disconnected version of all the 125,000 records....