I've just pushed the first bits of code!

high speed screen capture on osx

I'm on osx so pretty much all of this code is osx specific platform layer stuff. I've written some code to hook into an osx api that you can pass a callback function that gets called every time the screen is updated and lets you access the framebuffer. It's not the greatest api, since you pass it a callback which it calls on one of it's own threads so communicating the data back to my main program required a threadsafe buffer. I built one using atomics but I don't have much experience doing that so if anybody wants to take a look and give any feedback that would be great.

Another small optimization that seems to speed things up a lot is that I take advantage of the fact that the game has pixel art and compress the data to be 1 actual pixel per logical art pixel. I'm not sure if this will work in all cases but vie

Aissac is a first experiment in writing programs that can play video games. The program should watch the screen and submit user input the same way that a human player would and not have any direct access to the game's internal state. It will be written from scratch in a handmade style with minimal libraries. This is definitely a program I do not know how to write so much of the experience will be learning and I hope to write about problems and solutions as they come up. I chose "The Binding of Isaac" as a first game because I understand how to play it well. It is not however a toy example but as a real time action game will hopefully hit many of the topics I wish to dig into such as AI/planning, constraint solving, control theory and machine vision all with the necessity of real time performance. Hopefully in the future we can expand into other games, 3d games, puzzle games, different genres, etc. And who knows, maybe the tech we develop will be useful in other areas for other