As an homage to the MIT open courseware and in the spirit of openness, I am making a scheme language method which takes the MIT course and analyzes the video to produce an ogg soundtrack synchronized to a synthetic video which is OpenGL implementation of the movement of the professor and synchronized with the audio. The stick man is my SVG stick man that I use for my comics. I have considered texturing the face with the image of the prof, but decided against adding extra bandwidth. The net bandwidth to have the course on video is very small and since it is XML scripted, it is editable to create a new video with a text editor. By chunking and connecting sentences to explanations it is possible to slice and dice the whole thing and use glrotate, glscalef, gltranslate and other functions to coordinate the synchronization of video and audio with models. Using a WebGL like interface it is possible to simply pipe commands like pan and zoom or fade. Actually it could be viewed as 3D over the web or piped to blender. Just some fun while trying out some more complicated scheme scripts.
This image is from the book "Structure and Interpretation of Computer Programs". It is the founder of MIT, William Barton Rogers.
This is just for grins and it is a merger of MakeHuman and a WebGL with Python template for a plasmoid which communicates a synthetic video and uses espeak with a scripted character activated by openGL modified vertices.
0 comments:
Post a Comment