Hello ND4J

I haven’t blogged in over 4 years so I’ve decided to kick-things off again by doing a series on DeepLearning4J which I’m using more and more of recently. DL4J is great because there’s no need to translate the models to something else for production. You deploy them to production by just using them inside a Tomcat web app or inside Camel pipeline right along side what you are deploying today. It’s also very ops friendly, since they can monitor the apps with JMX like they are
used to.

Neural networks are a different kind of beast than the other machine learning algorithms. If you’ve ever played around with them, chances are that they almost always failed compared to other algorithms. There’s a lot of technique that goes into training a neural network effectively. Luckily Deep Learning frameworks have been giving us access to these techniques by name. When you know what the name of the thing you are looking for it’s much easier than doing the matrix math by hand but it’s daunting to newcomers. The basics of the matrix math isn’t too bad however, and it’s worth being familiar with it.

Let’s start this series in the spirit of hello-tensorflow (and also borrowing heavily from this great tutorial). I’m going to make a single neuron and try and train it to output 1 when I input 0 and output 0 when I input 1. Only instead of numpy or tensorflow, I’m going to use ND4J (the matrix library that DL4J is built on top of) so that I can use Scala.

Deep Learning is almost synonymous with GPUs but since we have only a single neuron it’ll run best on a CPU. First you need to create a build.sbt file and put it in an empty directory. It should look something like the following:

name := "hello-nd4j"

version := "1.0"

scalaVersion := "2.11.8"

libraryDependencies ++= Seq(
  "org.nd4j" % "nd4j-native-platform" % "0.7.2",

Next create a main class. You can just put a scala file in the same folder as build.sbt:

object HelloND4J extends App {
  println("hello world")

Now run sbt run and make sure it runs.

Next add some imports:

import org.nd4j.linalg.api.ndarray.INDArray
import org.nd4j.linalg.factor.Nd4j._
import org.nd4j.linalg.ops.transforms._

Now you should be able to do the same matrix operations that you can with Octave/Matlab and Numpy! Time to make some artificial neurons. First, lets create the input data and the outputs we want to learn. (Note: I’m embedding the bias into the input arrays as a constant 1.0 in the last position.)

val input1 = create(Array(0.0, 1.0))
val input2 = create(Array(1.0, 1.0))
val inputs = Array(input1, input2)

val label1 = create(Array(1.0))
val label2 = create(Array(0.0))
val labels = Array(label1, label2)

Again, in this trivial example, we are trying to learn the NOT function using only multiply and add instead of boolean instructions or if statements. Let’s make the computer figure out what values it needs to make it work.

A neuron is usually defined as some a function that takes an input, multiplies it by a set of weights adds a bias and outputs the value of applying the result through some sort of activation function. Lets define the weights and biases:

var W = create(Array(0.8, 0.5))

Since there is only one input, we only need a single weight and a single bias. I’ve initialized them to something random.

Next lets define a function that does the computation I mentioned above:

def forward(input: INDArray, w: INDArray) =
  sigmoid(input mmul w.transpose())

I’m using sigmoid as the activation function here but it could be something else. I encourage you to give it a try. You can now use this to make predictions like so:

val prediction1 = forward(input1, W) // 0.62
val prediction2 = forward(input2, W) // 0.79

It gives us 0.62 when we input a 0, which is closer to 1 than 0 but 0.79 when we input a 1, which is not what we want. To get the computer to figure out what it needs to change we need to measure how wrong it is. There are many
different ways to do this but for this example I’m going to use simplest; the difference between the right answer and the prediction:

def loss(prediction: INDArray, label: INDArray) =
  label sub prediction

Now we need a way to use the information about how wrong it is to find out what direction we need to change W to get a more correct answer. Just like you can use derivatives in physics to get the acceleration of a ball from a start and an end point, you can use the derivative of our forward function to get the acceleration between the right answer and our prediction. Tensorflow can figure out the derivatives for you, but since we are doing things manually we’ll just define it in a function which for sigmoid it’s simply x * (1 – x):

def backward(out: INDArray) =
  out mul (out add (-1))

Calling backward will give you a delta for W that you can multiply by the right answer to get a better W. This delta is only for a single sample. The W for the current input might not be the right W for the other inputs. For that reason, you usually multiply the delta by a small learning rate, so that you inch closer to the right answer for all the inputs.

Now you can put everything together to make a training routine by wrapping it in a for loop like so:

val learningRate = 0.1
for (i <- 0 until 10000) {
  val pred = forward(inputs(i % 2), W)
  val error = loss(pred, labels(i % 2))
  val deltaW = backward(pred)
  val updateW = error mul deltaW

  W = W sub ((inputs(i % 2).transpose() mmul updateW) mul learningRate)

After running through each example about 5000 times calling forward on should be really close to the answer we want:

println(s"0.00 => ${forward(input1, W)}") // 0.00 => 0.94
println(s"1.00 => ${forward(input2, W)}") // 1.00 => 0.05

Now if we look at W we can see the values you need to do NOT without an if statement:


Which should show you -5.67 and 2.72 if you’ve been following along.

In the next part of the series I’ll go over how to use DL4J’s higher level API to define more complex neural networks.

What worries me about Scala

I’ve recently been rediscovering podcasts.  I’m particularly fond of the NodeUp podcast, but I also listen to podcasts about Rails, Clojure, and Scala.  The Scala podcast is by far the most academic; taking a shot every time they say the word “type” makes for a pretty nice drinking game.

I must admit I like academic and theoretical discussion as much as the next guy, but I worry about how little attention is paid to practical matters.  NodeUp on the other-hand is almost completely about practical things: libraries, frameworks, scaling, deployment, etc.  I’ve found them all to be pretty informative.  The Rails podcast is also fairly practical, but they do tend to cover object-oriented design patterns from time to time.  I admit that JavaScript and Ruby aren’t exactly paradigm-shifting languages, but still, programming is about more than just the mathematics.

For example, the Scala world has two great web frameworks: Lift and Play.  It would be nice to hear how they feel, not just about how type safe they are.  Granted type safety is one of the main reasons I’m interested in Scala over node/ruby, but programming is about tradeoffs.  Things like programmer productivity anecdotes are really worth something to new-comers and are a great fit for a discussion-centric medium like a podcast.

If Scala is going to become a mainstream language, there needs to be more discussion on these touchy-feely and practical subjects. If you know any, please let me know in the comments.  Podcasts about Scala are really hard to find.

My first Arduino

Yesterday my wife decided to buy yet another sewing pattern book and I decided to tag along.  As a Kindle user, there’s usually very little for me to do at a bookstore.  I usually just look around the IT section of the magazine rack and thumb through the amazing Ubuntu magazine, or Nikkei Linux.  This time though, a magazine called “Otona no Kagaku” caught my eye.



“Otona no Kagaku” is magazine that comes with some kind of sience related device inside that you can put together.  There were all kinds of projects from synthesizers to airplanes, all sorts of fun.  Kids today are so lucky, I wish I had a magazine like that when I was a kid.

Anyway I’m too old for most of them to be interesting but one of them came with an Arduino board (branded as “Japanino”).  Since the magazine cost about as much as a new pre-assembled Arduino + shipping I decided to buy it.  The magazine is filled with a bunch of projects other than the one on the cover and explains how to go about doing them.  It’s amazing all the cool things people are doing with the Arduino. One guy uses an array of Arduinos to electricute himself in the face it seems.  To each his own I guess.


The Persistence of Vision project was really simple to set up.  Just a few screws and the website had all the software you needed already.  Here’s what the finished product looks like.


The IDE is really simple.  It’s amazing how low the bar is to get code onto these things.  Way back when (circa 2005) I still had to build a cross-compiler environment.  The language is like a C version of Processing, which is really intuitive and gets rid of having to write a boiler-plate event-loop in the main function.

Now I’m thinking about what to do next.  At work I’ve been experimenting with a presence system based on bluetooth which automatically locks the computer when I’m out of range.  Unfortunately Bluetooth has a pretty long range.  I wonder if there’s any NFC shields for the Arduino.  It’d be pretty cool if you could use your phone as a smart-card via NFC.



How To Get etags Working in Emacs

You’ve been using Emacs for how long and you haven’t figured this out yet?

Yup.  Up until now I’ve never really needed to actually get etags working in Emacs.  I remember trying to figure it out long ago as a newbie and giving up.  It’s initially difficult because it’s not as simple as just saying “etags my-src-dir”, though once you have a couple of UNIX tools on your utility belt though, it’s practically as simple as “etags my-src-dir”.

Just show me the code.

Although there might be other more correct ways to do this, the following works fine for PHP:

    cd ~/src-code-top
    find . -name '*.php' -print | xargs etags

Woah find and xargs?

etags (unfortunately) only works on files and not directories.  Those files also have to be arguments and not stdin.  So we need to use find to give us a list of file names and xargs to convert each filename into an argument for etags.

Explain find.

find is a swiss army knife of file search but mostly you can just memorize “find . -name ‘*.filetype‘ -print”.  find needs 3 arguments, the directory to start looking in, some condition, and some action. The “.” tells it to look starting from the current directory. The “-name” part means find matching filenames (We use the single-quotes to keep bash from expanding). Finally -print tells it to print what it found one line at a time.

Explain xargs.

xargs takes lines from stdin and supplies it as the arguments to some other program.  Just what we need for etags. Although xargs is as versitile as find we don’t need to supply it with anything, the default behavior is fine.

Ok, now how do I use it in Emacs?

Just use M-x visit-tags-file and point it to your newly minted TAGS file.  After that you can easily find out where the hell that class/function is hiding just by doing “M-.” (You can also return to the file you came from by pressing M-*).  Of course “M-.” and “M-*” work in a stack like manner so you can keep “M-.”ing to dig as deep as you need to and easy get back by pressing “M-*” and equal number of times.

Copyright Infringed

So the author of Listen has taken code from Quod Libet (including code from my lyrics plugin) and ripped the copyright section (and my name) out and used it in his software. Now the code is GPL so I’m completely fine with him using it, it’s why I write open-source code, but removing my name from it is not cool. Unlike Joe I’m not mad at him, I’m sure he was just confused on how this all works. I’m really glad the Listen author didn’t make a big scene over the thing and started fixing it. I know Joe’s language in his open letter was pretty harsh, but that’s the way he is–Especially when he’s mad. He’s called me a moron on countless occasions because I was being a moron. In Abaakouk Mehdi’s case, Joe called his program ugly, and to be frank it is. One of my friends (Julie) looked at a screenshot of Listen and said “That music player looks way too busy and complicated for me.” and she’s by no means a computer illiterate. I don’t mean that comment to be stop-energy I mean it as a constructive comment. From the screenshots Listen looks like it can be a very cool program. The iPod support is definitly something I’d like to check out.
I think the reason Joe brought this up in an open letter was to shed some light on the whole GPL version 3 issue. Joe, Linus and many others don’t like it. So it’s really important to nab this problem of GPLv2 and GPLv2 and up issue while it’s still small. The licenses are the foundation of our comunity, and have a tremendous power to change the world. It’s a bigger issue than most of the people who commented on Joe’s blog realize.

Quod Libet

Quod Libet is the music player I use and occasionally hack on. In the current revision in SVN my lyrics plugin has been integrated into the main player. I also added a feature to the album list view so that you could access the plugins menu from it. Since I’ve been in Japan for nearly 6 months now and stuck with an iBook and iTunes. It feels really good to be working on a program that kicks so much ass it’s on the top ten list in Gnome Files. I can’t wait for the next few releases. There’s going to be a change to Gstreamer 0.10 and hopefully support for a hard drive based music player. From that I can probably work on iPod support.

Component Object Model

So after getting the new laptop, and installing the Microsoft Retail Management System software I learn that the plugin system is based on legacy code, and not .NET code like I was told. I became very annoyed that my uncle didn’t know about this earlier because if I had known I was going to be using COM I would have refused. C++ is a very ugly languge and making COM components is a messy process. Luckily for me, PyWin32 exists and makes it very easy to write COM components in Python. And since Python is the least painful languagae for me to code in at the moment, I think I’ll survive.

In Linux, Bonobo (GNOME’s Component Object Model), seems to be pretty much dead, but I know that lots of GNOME programs still use it, especially gnome-panel for it’s panel applets.  So it’s strange how dead Bonobo’s development seems.

I need no conclusion!


PlayStation.com – PSP

The PSP is like the Ring of Power. At first I bought it saying that I’d sell it after I played a couple of games. Unfortunately every time I try to send the PSP back into the fires of Mt. Doom. We wants it.

That being said. I have found a couple of practical uses for my PSP because it comes with a Mozilla web-browser. Since my house has wireless internet I use it in the morning to check the news and the weather. When I switch my website to TurboGears later this year I’m want to make a nice PSP portal site with a couple of little web-apps (Todo-list, iCal compatible callendar?, weather and news agregator) And I especially want to make a way I can syncronize my computer with the portal. I also wonder if in the future I can make a program for my treo that’ll download the information from the portal and synchronize it with the palm applications.

I probably wont even do half of all that, knowing myself. The to-do list, bookmarks and feed agregrator maybe. Computer/Palm syncronizing probably not.


Lately I’ve felt pretty unmotivated to do any programming. A couple of weeks ago I felt like I could code everything, and now I barely have the motivation to finish my Quod Libet plugins. I’ve also been thinking of what type of programming interests me the most. I’m not really sure, I guess web programming is the most interesting right now.

Since I haven’t really been doing any programming I’ve tried to spend more time studying Kanji and brushing up on my Japanese. I really wish I could find someone to practice with over here in Puerto Rico. I heard long ago that the University of Puerto Rico has a Japanese club/class that meets once a week. I should ask Ms. Quesada where I can find them.

I ordered my new laptop from Sharp yesterday, The Actius MM20. It’s really small (10.4″) and light, and I ordered the 9 hour battery too. It has a Transmeta processor at 1GHz and 512 MB of RAM, 20GB HD, and integrated wireless. A nice step-up from my current laptop (PII 300MHz, 288 MB RAM, 6GB HD.) Online I found that it’ll run just fine with a slightly modified kernel. I hope I can manage without a custom kernel because keeping track of kernel security fixes on one’s own is a pain. I’m still not sure what kind of Internet connection I can expect at my host family’s house. Doug is convinced every person in Japan has direct 1-10mbps connections to the Internet. I hear that in Japan you have to pay per minute no matter what call it is, even local so It’d make sense if everyone in Japan had DSL/Cable. Even if there’s no Internet in my host family’s house, there should be at the school.

I recommend http://athome.nime.ac.jp/ to everyone going to do a home-stay in Japan. Especially part 3 with the journals. I hope I learn enough that I can avoid a couple of mistakes.

Upgraded once more

Now I’m running 1.5.1.

I got Adelphia Cable internet today, I’m not impressed, but it works… kind of. The main problem is how slow it is sometimes. Like if it had some strange QoS rule that makes http slower than anything else. There’s also the terrible ping times, my 56k had better ping times! (this is also sometimes.) In general it’s pretty un-reliable at least today. Big Jesus tells me that Adelphia is experiencing network problems, I hope so because I can’t play bzflag and that doesn’t make me happy. 😦

I’m going to really really try to be productive without using my medication, hopefully my brain will get used to it. Currently my plans are to fix my lyrics plug-in for Quod Libet and work on Background Channels. I love the idea of Background Channels because I’m always looking for good background pictures and just leaving my background on a channel would free me from looking for good ones.

I’m also going to have to find a job soon. My dad wants me to work for him probably pulling cables and stuff. Although it would be a good way to get exercise I really want a job where I can practice my Japanese. That’s nearly impossible here though.