Printable View
Hi!
How much work is it in making a search engine for the web? What I want is an engine which sorts hardware-webpages by price, simply to find out which webpage got the cheapest hardware you search for.
Does anyone know about software doing this already? Or can anyone make such an engine?
Thanks for your help!
Easy as Pie.. yumm....
Does that mean it is very difficult?:rolleyes:
Well, you would need to gather info from every web page on the internet and store them in a database. Then so searches on said info. Doing the searches is easy. Gathering the info is the hard part.
yep.. and doing the searches might be easy, but unless you have lots of powerful clustered servers or are one of the worlds top database experts, then dont expect your search to take less than a few hours.
Well, the engine is supposed to search through a set of self-chosen websitesn not all the sites .. I've seen something like this on www.hardware.no. It searches numerous norwegian sites for the specified product and shows you the lowest price...
Hehe...are you from norway...:D...why do you want to make an engine like that when there are sites that does it for you....wasn't that just said?
Yes I am from Norway.. Because I want it on my forum, but can't find any software/scripts doing it.. This engine isn't supposed to search for hardware but something else.. Where can I get it? Please help!?:(
I don't think this is the right section to ask that question....since it is not a VB question.
BTW what is it supposed to search for?
Sorry.. Just thought maybe someone here have made something like that or know anything about it... Many talented people browsing this forum.. It is supposed to search for nutrition-prices...
Yeah but it is better to make that kind of script in PHP or something and not in VB...you can't run VB on internet....of course you could use VB Script but that will only work in IE....
Hmm! You could use winsock/inet control to get the srource of webpages and crawl through them and extract any info you want. Not sure if scripting language such as php or asp would be ideal.Quote:
Originally posted by NoteMe
Yeah but it is better to make that kind of script in PHP or something and not in VB...you can't run VB on internet....of course you could use VB Script but that will only work in IE....
Mutuz if you asked this quesion in ASP, VB Script, Internet and Network Development forum where we deal with similar problem some time,yould probably get a better result.
Anyhow if you are searching through few web site then it would be realistic to use VB other wise it would too slow.
I have put together a web crawler(example) using Inet control which you can modify to your purpuse if you wish. PM me with your email, i will send it to you.
One issue i am not sure about is how you will extract the price information from a html file, unless you know how each site structures their html page. If you have any ideas then i can help you implement it.
Hope this helps.
Danial