dcsimg
Results 1 to 3 of 3

Thread: Read Entire Table

  1. #1

    Thread Starter
    Powered By Medtronic dbasnett's Avatar
    Join Date
    Dec 2007
    Location
    Pointless Forest 38.517,-92.023
    Posts
    9,214

    Lightbulb Read Entire Table

    We have a table that represents the index for all of the laws for the state of Missouri. It has roughly 200,000 entries as a linked list. The table is being moved from an AS400 to MSSQL.

    As I was updating the DB calls I could see that having the entire table in memory would make things easier.

    Much to my surprise I could read the entire table into memory, convert the rows to objects and add them to a list in about 4 seconds. Memory usage topped out at about 200MB.

    If I pursue this I understand the obvious issues, but what am I missing? Have you ever done anything similar?

    Your opinions matter to me.
    My First Computer -- Documentation Link (RT?M) -- Using the Debugger -- Prime Number Sieve
    Counting Bits -- Subnet Calculator -- UI Guidelines -- >> SerialPort Answer <<

    "Those who use Application.DoEvents have no idea what it does and those who know what it does never use it." John Wein

  2. #2
    Super Moderator Shaggy Hiker's Avatar
    Join Date
    Aug 2002
    Location
    Idaho
    Posts
    33,985

    Re: Read Entire Table

    I'm surprised that you were surprised

    Actually, I'm surprised that "the index for all of the laws of the State of Missouri" was that small. 200,000 just doesn't seem large enough, but having that take up 200MB doesn't seem unreasonable. If it works, then that seems like a fine approach. If it was too much memory usage, then you'd be forced to chunk it up, but doing it all in one pass certainly is the easiest design.
    My usual boring signature: Nothing

  3. #3

    Thread Starter
    Powered By Medtronic dbasnett's Avatar
    Join Date
    Dec 2007
    Location
    Pointless Forest 38.517,-92.023
    Posts
    9,214

    Re: Read Entire Table

    It is several thousand pages long.
    My First Computer -- Documentation Link (RT?M) -- Using the Debugger -- Prime Number Sieve
    Counting Bits -- Subnet Calculator -- UI Guidelines -- >> SerialPort Answer <<

    "Those who use Application.DoEvents have no idea what it does and those who know what it does never use it." John Wein

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  



Featured


Click Here to Expand Forum to Full Width