[re-Resolved] Access not using enough CPU?

[Ecniv]

Hi,

I'm processing large text files and dumping them into tables (1.7gb of files spread over around 10-20 files).

I would expect Access to eat most of the CPU power.

It doesn't. It seems to peak at 35% (via task manager) then drop back to 0.

I am using API calls to open and read the text file (as this was a hell of a lot faster than using Access functions/methods or VBA open file commands).

Would there be some setting on Xp to slow it down?
Or is this something Access usually does?
Has anyone come across this before?

I would prefer a higher cpu usage as that would mean (I hope) that the files would be process faster.

Comments please

[Frans C]

It can only use CPU if it has something to do for the processor.
Probably it is waiting for File I/O.

[Ecniv]

So that would be that the network is stuffed rather than access not using cpu?
That would also apply via Api calls to an open file - correct?

[Frans C]

It applies to everything that needs to read from a hard disk.

[Ecniv]

Ok... Hmmm.

I'm trying on the C Drive now, maxed at 50% CPU.
Can't believe it would affect that much though.

Besides, previously I used to do processing on large amounts of data in Access (which must be continually accessing a harddrive to store changes) and that didn't seem to matter as the cpu hit 99% no problem.

Ok so there is an opinion here that MS have added in a max cpu limit, so that the computer doesn't look like it has hung. Which is possible I guess. Also allows the apps to share all cpu power and allow the user to do other things whilst its processing.

I dunno - just was wondering if I can crank out a little more performance. I guess I'll have to check my code and try to re-write it faster.

Thanks for your reply

[Ecniv]

Just to let you know I am writing to a shared drive but it appears to be really slow - CPU time max 10% average 3%.

Is there anyway to increase the speed or decrease the waiting time of the file in/out ?

Is there anyway to test a network connection on the hd for filein/out waiting times?
I guess this would hammer the network though, but I would like to cover all aspects/ideas

[asmdev]

hi,
i guess microsoft implement different measurement method for CPU usage in Windows NT, windows XP.

you might try your app in windows NT, windows 2000 and windows XP. i guess the CPU usage might raise higher in windows NT.

imho, the windows XP doesn't really provide accurate CPU usage, coz i tried running VMware in my windows XP SP2 laptop, well, it only use 22%... which make me think why so minimal?

[Br1an_g]

Ecniv,

i can demonstrate teh exact symtpoms that you are decribing.

my issue seems to be related to network limitations, CPU is sitting about 5% average, with network usage at 75% (probably limited)

havent looked at improving this performance as i figure there isnt a lot i can do about our infrastructure..

not much help i know..

[Ecniv]

Brian,

Looks like you are right.
Test results this morning...
(FTP) Text File -> Process -> Access
250mb 8.20 - 10 mins
380mb 9.00 - 2hrs 30mins

This was to a shared drive.

Since killing the task, copying all required files to the C Drive of the local machine.
Current file 480mb - 95% started at 11.40 (now 12.05).

So looks like a duff network/network drive :/
Only option probably would be to upgrade the drive, but I do not think that is likely to happen

Thanks for the input - I'll re-resolve this