Results 1 to 4 of 4

Thread: [VB6] Neural Network

  1. #1

    Thread Starter
    Fanatic Member
    Join Date
    Sep 2010
    Location
    Italy
    Posts
    678

    [VB6] Neural Network

    Since a neural network is missing in the codebank
    here is my version:

    It's very simple.

    It initializes with "CREATE"
    Code:
      NN.CREATE Array (2, 2, 1), 0.25, 4
    -Where Array indicates the NN topology
    Array (N of Inputs, Hidden layer neurons, ..., Hidden layer neurons, N of outputs)
    -The second term is the Learning Rate.
    -The third is the initial range of connections. (this value, together with the Learning Rate is very important and can drastically change the learning outcomes)

    To get the output just call RUN with an array of inputs as arguments,
    Return the Outputs Array

    For learning (which is supervided) just call TRAIN.
    The arguments are an array of Inputs and an array of expected Outputs
    The learning process is done by backpropagation, the code is taken (and modified) by an article by Paras Chopra.

    Neurons Index "Zero" [0] of each Layer is used for Bias. It is always 1 (The Biases are the weights of connections from 0-indexs neurons to next layer neurons) [Still not sure this way is correct tough]

    Inputs and outputs range is from -1 to 1
    the Activation function used is TANH.

    Probably I'll put it on Github.

    Enjoy

    And, as always, anyone has ideas to improve it, is welcome

  2. #2

    Thread Starter
    Fanatic Member
    Join Date
    Sep 2010
    Location
    Italy
    Posts
    678

    Re: [VB6] Neural Network

    Hi
    I added a Genetic Algorithm.

    The NN now can be trained by Backpropagation or with GA (NN+GA = Neuroevolution)

    Neuroevolution is very useful when can't use Backpropagation

    Here is an example of what one can do with Neuroevolution



    If you want to have fun with Evolving Creatures you can download here the Portable Zipped App.
    Attached Files Attached Files

  3. #3
    Addicted Member
    Join Date
    Feb 2014
    Location
    USA
    Posts
    128

    Re: [VB6] Neural Network

    I don’t know how I ever missed this, but it’s incredible.

  4. #4

    Thread Starter
    Fanatic Member
    Join Date
    Sep 2010
    Location
    Italy
    Posts
    678

    Re: [VB6] Neural Network

    For those interested in the topic I share these goodies.

    An interesting interview with a co-author of NEAT's "Neuroevolution of augmenting topologies"



    - Here is a video describing NEAT. In the description of it there is a link to the related PDF.

    - A more advanced version of NEAT on Github: neataptic and The neuro-evolution algorithm used.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  



Click Here to Expand Forum to Full Width