Database using files

[EltonHenley]

What I want to do is write a database program that is independent of SQL, MySQL, Access, etc...

I don't want to use Access due to file size limitations and speed decrease. I don't want to use SQL due to expense and licensing. I looked at MySQL, but I don't want to purchase it for commercial use, which is what I would have to do since my project is not open-source.

So...I plan on using files.

I have a program that currently works off of files. It has several functions to load the file to memory as a string, set fields, write the string back to file, etc...and it all works fast.

However, I am trying to think long-term and how it will work in terms of speed as the database grows and more files are added.

So, it would help if I knew how SQL and other databases work. I assume they make use of memory, since it is a lot faster than accessing from the hard drive. Also, I assume there is some indexing going on or something that makes it so fast.

My question for you guys is can anyone offer some ideas that would help me make this a reality?

Thanks!

[mendhak]

Hmm... Ambitious.

Have you considered using XML? It's a standard, and there are classes that let you work with it efficiently enough to meet your needs.

[EltonHenley]

mendhak: I have not. Can you point me in the direction of a good tutorial on using XML in this regard?

Thanks you very much!

[Asgorath]

Hi

You could also use MSDE its free has 2 limitations maximum over Sql Server dababase size is 2gb and a maximun number of users limited to 5.

Regards
Jorge

[Mike Hildner]

Asgorath, you sure about the maximum number of users is five? I have not tested, that's why I'm asking, but according to Microsoft's paper on the workload governor , it allows 32,767 connections.

[mendhak]

Originally posted by EltonHenley
mendhak: I have not. Can you point me in the direction of a good tutorial on using XML in this regard?

Thanks you very much!

VB6 or VB.NET?

[Asgorath]

What i mean is 5 paralel queries running at the same time.

Regards
Jorge

[Mike Hildner]

ok, and I hope I don't appear belligerant, thing is I don't really know from experience, just what I've read. According to that paper, the workload governor slows things down when you have 8 active "operations" at the same time. And then it just slows things down, does not deny another operation.

Have you experience differently?

[Asgorath]

Originally posted by Mike Hildner
ok, and I hope I don't appear belligerant, thing is I don't really know from experience, just what I've read. According to that paper, the workload governor slows things down when you have 8 active "operations" at the same time. And then it just slows things down, does not deny another operation.

Have you experience differently?

No i haven't, the performance is decreased but there query are executed.

[Dave Sell]

I know most modern database managers use a B-Tree to store data.

[EltonHenley]

Mendhak: VB6

Sorry about the delayed answer! Now I'm gonna go read the rest of the posts.

[EltonHenley]

Dave: B-Tree? Hrm...that's a new one on me. I'll have to google it.

[Dave Sell]

Make sure to include the text data structure in your search:

http://lesk.com/mlesk/sciam84/sciam84.html

[mendhak]

VB6 + XML links:

http://www.xml.com/pub/a/2000/07/12/...b_and_xml.html

http://www.xmlwriter.net/books/sampl...contents.shtml

[EltonHenley]

Excellent! Thanks a lot, guys!

[Dave Sell]

If you do decide to go the route of XML, make sure you take The XML Litmus Test:

http://msdn.microsoft.com/library/de...ml10202004.asp