Cognate and NuTank switch from .Net to Python

So,
Looking again at choices of language for NuTank and Cognate I have decided to switch from .Net C# to Python, TensorFlow, and PyQt5.

There are several overall concerns.

Performance

Multithreading all CPUs or GPUs, getting speed for Cognate Concept Map processing.
I had chosen C# and .Net due to the full threading model in the language.  Python does not do real CPU threads. But, TensorFlow does use all CPUs and GPUs in its underlying C code so is in fact ultra fast at matrix math.
I will need to write custom code into TensorFlow for tensor weighted interpolated transfer (TWIT).  I already wrote that in C# so it should port pretty well. How such code eventually gets into C, C++, or GPU code is to be seen.  I think I can do the C code pretty easily.  I also may discover a way to encode the TWIT as existing matrix functions.

Graphics

NuTank graphics were line vector graphics (GDI ancient graphics routines for DOS). In the new NuTank I want better graphics.  It does not need to be full-on Unreal engine level.  Also the world will be 2D from an overhead view.  Going full 3D can either be just for looks, or can be actual 3D for the Neural Tanks and Neural Processing (Brains).  3D increases the processing burden by large amounts as the neural systems have to deal with a volume instead of a plane.
Possibly in the future NuTank will go full 3D. Or maybe have 3D as a mode.
Meanwhile I want to be able to use pictures with transparency for things like rocks.  I also want the visual sensors to pick up the pixel color around the edge of the rock from the image of the rock.
C#/.Net and Python with Qt are about equal on this level of graphics.  Both can also handle full 3D if needed.
Unreal engine has a python plugin so is still a later option.

Academia

One major goal in Cognate, and to a lesser degree NuTank, is to publish papers and advance the state of AI with the SRS design. This is best done in TensorFlow.

Game World

I want to publish on Steam and both C# and Python have Steam API wrappers.

Programming Efficiency

A major concern is just getting a lot of code written and debugged quickly.  Python and C# are about on par for productivity but I think Python has a small edge.  More importantly for me is that my day job is in python and C++ so not having yet another language to switch between on a daily basis is better. 


Comments

Post a Comment

Popular posts from this blog

UE4 Asset Directory Listing Blueprint

Image
So I needed to be able to, in game, get listing of asset directories and assets in a folder style.  The purpose is to let me make on-the-fly menu selections of something like 10000 assets in game and do it fast. Turns out in UE4.25 you can do all of this in blueprints. The low level problem is that assets get packaged into .pak files when you ship the game.  Regular C++ style file and directory operations will not find any assets.  Instead there is the Asset Manager. Assets are bundled as assets and are not in a directory structure in the pak file.  The path to an asset is in effect just a string.  So the over all flow is... Load all the assets under one or more asset directories.  When the game is packaged what was something like Content/DefaultObjects/Trees becomes /Game/DefaultObjects/Trees. When you want to ask "What sub directories and assets are in /Game/DefaultObject/Trees you call my blueprint node.  It returns a result structure with a list of string for subdir
Read more

Subsumption and Neural Hiding - The 'Object Oriented Paradigm' of Artificial Intelligence

In computer programming Object Oriented Programming (OOP) gave programmers a neat way to compartmentalize programs, rather than having a mess of disorganized code and data.  One can neatly make an object, treat it as a black-box and reduce the cognitive load on the programmer.  Nifty. In reactive neural networks where one is taking world inputs and generating response outputs Subsumption vastly simplifies the work of designing the neural processing. From dictionary.com: verb (used with object),   sub·sumed,   sub·sum·ing. to  consider  or  include  (an  idea,   term,   proposition,   etc.)  as  part  of a  more   comprehensive   one. to  bring  (a  case,   instance,   etc.)   under  a  rule. to  take  up  into  a  more   inclusive   classification. Subsumption in the context of neural networks is where some reflex is designed as a response to inputs or other neurons and overrides 'lower level' reflexes.  Then some other reflex is desired so that can then be des
Read more

Self Cycling Asynchronous Neural Systems

Current neural network systems have a general paradigm of being given some input, and then producing a resulting output. A true general AI should act like a biological system and be self-sequencing. The neural system should just free-run, responding to inputs and creating outputs and learning. One method I am experimenting with in Cognate and NuTank is having a hard-wired set of concept maps (a N-dimensional set of neurons used to embody a concept, e.g. foveolar edge angles.) that take inputs from the external world and produce hard-wired reactions as outputs to control a real or simulated robot. Such a system also uses subsumption to aid in much easier design. This is the Concept Map System (CMS) for the purposes of this post. For now lets ignore the idea that the hard-wired concept map system might also be adapting and evolving over time simulating neroplasticity. One then has a large 3D array of neurons that are in acting as a pattern matcher on the entire CMS.  What this 3D a
Read more