PDA

Click to See Complete Forum and Search --> : [RESOLVED] Hello Please Help, I need an Need A.L.I.C.E Web page Spider


tyademosu
Jun 16th, 2006, 08:04 PM
See link below --- I can even pay a little for a complete soln. I'm trying in VB6

http://www.nabble.com/Help%2C-Need-...r-t1720827.html

I need a spider created that will crawl a webpage and grammatically parse the page and create AIML (Artificial Inelligence Markup Language) data. This data will be saved into an AIML file and used to teach a chatterbot the contents of the web page.

The way we see it working is:

1. The spider crawls a page examining the text of each sentence.

2. Then using a grammatic parser it will reformulate that sentence data into possible patterns and responses to be entered as data in the AIML file.

3. Then it will format this into a standard AIML file and allow you to save this code or copy and paste it to another source

This will require someone experience in AIML as well as grammatic sentence parsing.

The idea for this project is to get the stand-alone script, possibilities of this being a desktop VB script. But I hear that existing perl and php extensions may make this easier. Open to other suggestions. Preferably a desktop application to start

colonel720
Jul 14th, 2006, 08:34 AM
This sounds interesting. I am in the midst of my own NLP project, a chatbot using neural networks as its associative power. I do plan on incorporating a feature where the bot goes online and just reads. I guess what i'll do is use VB.NET's objects for browsing web pages to extract text, and then feed the text into my system. sights will be found by doing random google searches with things in its memory. As this is a learning bot, no previous grammatical structuring is required.

tyademosu
Jul 18th, 2006, 06:37 PM
View this thread to see progress. I have a prototype working, unfortunately it only gives random sentences from the webpage and I'm not sure how to make it smarter yet.

http://www.vbforums.com/showthread.php?t=411801