Posts

Showing posts with the label Neural Nets

Evolution and Neural Systems

What is the purpose of a brain and how does that effect the evolution of design? Survival It is obvious that the reason any animals have neural systems is because the neural system provides a survival advantage. How does a brain provide an advantage? The simplest neural systems are in effect hard-wired with little or no learning. These simple systems provide reactions or reflexes to environment changes that may be harmful or beneficial.  Attraction toward food or mates, and fleeing from predators is very valuable. As neural systems become more complex and have learning on can ask: What is being learned? The answer is often stated as "better behaviors" and such. A better formulation would be: Brain impart a survival advantage by predicting the future state of the  environment  and pre-reacting to the environment. Here are several examples at varying levels of intelligence: A mouse is hungry and predicts a future state that includes food, and...

Cortical Neuron Model - SRS

In a Subsumptive Regular System (SRS  here )  the  regular array of neurons (cortex) that has the goal of predicting the future state of the subsumptive (cerebrum) system . If the match is strong on the present state of the subsumptive system then the stimulus of the subsumptive system into the predicted state is strong.  In the event of sudden changes in the actual external environment one wants to ignore the predicted state and react to the immediate environment. This has an evolutionary advantage of pre-reacting to the environment and getting a jump on surviving the future state. This document calls out the various axis of selection for algorithms.  Research has yet to show where the decision points are optimal. There are several decision points on the algorithms to select: Connectivity from the Subsumptive to the Cortex The subsumptive part of the SRS is hard-wired to take inputs, compute concept mappings (abstractions) of the external environment an...

Cognate and NuTank Status

Got the ConceptMap editor working such that one can create Concept Maps, drag connections and make connections.  Also have the ImageInputDrive (a sub-class of Concept Map) pretty much working. Got stuck for a bit in some WinForm layout issues and scrolling the editing area.

Subsumption and Neural Hiding - The 'Object Oriented Paradigm' of Artificial Intelligence

In computer programming Object Oriented Programming (OOP) gave programmers a neat way to compartmentalize programs, rather than having a mess of disorganized code and data.  One can neatly make an object, treat it as a black-box and reduce the cognitive load on the programmer.  Nifty. In reactive neural networks where one is taking world inputs and generating response outputs Subsumption vastly simplifies the work of designing the neural processing. From dictionary.com: verb (used with object),   sub·sumed,   sub·sum·ing. to  consider  or  include  (an  idea,   term,   proposition,   etc.)  as  part  of a  more   comprehensive   one. to  bring  (a  case,   instance,   etc.)   under  a  rule. to  take  up  into  a  more   inclusive   classification. Subsumption in the context of neural networks is where some ...

Musings on Value vs. Pulsed Neurons and Locality of Reference

Neural systems in the style of Convolutional Neural Networks et. al. use matrix math and tensors to simulate the overall activity level of neurons. The reason for "overall activity level" rather than individual pulses from neurons is that the overall activity is simply the integration over time of what would be pulses in real neurons. Overall activity also is amenable to calculus with derivatives for back propagation. The reason for matrix math is locality of memory reference and simplicity of written equations for what the system is doing. Microprocessors have local CPU memory cache, and main memory. Getting data from main memory to local cache is very slow relative to processor instruction times. Matrix math tends to make operations happen in address sequential order so is efficient in cache.  Also GPU design favors sequential and matrix operation and is ultra-fast. All the above makes tensor style processing for AI efficient. Pulsed neurons are more object oriented, s...

Working on Editor

Working on the editor.  Writing in C# so using WinForm style UI code. Got Concept Map all draggable as a UI element.  In the middle of Connections in the UI.

A little progress on Cognate and NuTank

So, I got past the hurdle in the ConceptMap and ConnectionDef code where one N-Dimensional map can be connected to another N-Dimensional map. The connection can have source and destination ranges of map points on any and all dimensions, with weights interpolated forward or backward on all dimensions.  This ends up being a nasty confusion of interpolation, except if you make single dimensional iterators. Then you nest the iterators and it works. Next is getting a first cut UI working in Win Forms C# to edit maps and connections, and visually show activation levels and firing 'sparkle'.

Start where you are

A blog.  YAB (Yet Another Blog) I lost any ability to login or recover ownership of my blog Thunderfist Podium . Oh well. The intent of this blog is to flesh out some ideas on Machine Learning, Artificial Cognition, Neural Nets, Spike Neurons, and probably some philosophy thrown in for good measure. Waaaaay back in 1985 I published some peer reviewed work on Artificial Cognition. Also I made a program/experiment/game called NuTank written for DOS VGA in Turbo C. I still have the source and NuTank.exe and it even runs in DosBox . Now computers have caught up in power to actually try solving the problem. Now I am rewriting the core libraries and the whole system in C# and .Net as several packages. Cognate - The core Concept Map and Cognition/Neural Net/Pulsed Neuron Model. This has the run-time code and the ability to load/store cognitive systems, and the design level definitions.  And much more. NuTank - A (Steam platform?) C# game, multiplayer where 'tanks' battle...