AVI files in DX9, 10, 11, and XAudio2

[Hieran_Del8]

I've been working on a DirectShow to DirectX renderer so that videos can be rendered to a DirectX texture, and sound to an audio buffer manipulated by the app.

It's been a fun project! The objective was to take an AVI file and render it to a DirectX9 texture, and play the audio through a default DirectSound renderer on the system. The goal was exceeded, allowing any video stream, either from a video file, or a webcam, etc., and rendering it to either DirectX9, 10, or 11 textures. Also, the audio can be rendered into an app's XAudio2 system, allowing 3d transformations to be applied on the sound.

The project is now called the DSDX Library, and represents the pinnacle of all my achievements so far in programming. It is truly COM-based, which requires the COM classes to register in the windows registry. The DSDX Library has helper functions for all these details.

If you'd like to try out streaming AVI files right away in your DirectX app, go to http://www.crazyleafgames.com to download it and see a pseudo app describing usage.

The release is alpha, and I haven't tested the DX10 and DX11 components fully yet. I need help in testing these modules out. Please try it! Thanks!

[Hieran_Del8]

I was talking to my dad on what's possible with this technology, and it became clear that a brief demo should be made to showcase the possibilities. Here's a demo picture of what's possible. Note, the webcam run was done at a school I teach at--I don't paint my walls orange. And my head isn't normally that big (dynamic surface undulating over different shapes).

The three streaming videos are all avi file sources. One sample is from a fraps recording of Tank Universal, another is from Oblivion, and the webcam was pre-recorded. It is possible to run a live webcam--better performance, actually. Also, I'm intrigued how well a tv-tuner would work on the graphics card. Ah well, I don't really care to put that together right now.

[lp rob1]

another is from Oblivion,

W00t! Oblivion! One of the best games once you've pumped it up with mods. Did you record all the samples yourself, and if so, do you still play Oblivion?

[Hieran_Del8]

Did you record all the samples yourself, and if so, do you still play Oblivion?

Yes, I used Fraps and a Gateway webcam recorder. I actually haven't played Oblivion for over a year, but it was a lot of fun. I never got through the story (really just randomly explored environments and created characters.) I've a friend who's intent on accomplishing everything, but his ps3 copy is bugged. He's also accomplished Morrowind 100% except for that one spot you have to choose between the Theives guild and the Fighters guild.

Oblivion represents much of what I've wished to create in programming: lush environments that were procedurally built with 100-year weathering calculated; npc's that have daily schedules, but that may "on a whim" travel to another city depending on disposition; the beautiful rendering of sky, flora, and creatures; and music that puts you in the environment.

[Lonewolff]

Awesome job! The posibilities for this are huge.

[joemc]

nice co-worker

edit: oh yeah the code is nice too.

[Hieran_Del8]

Awesome job! The posibilities for this are huge.

Thanks! It was one of the tangent projects while working for the easy interfaces on cp1. Man, these tangents are fun!

nice co-worker

edit: oh yeah the code is nice too.

Thanks! And I'll forward the complement to my sister.

[lp rob1]

Oblivion represents much of what I've wished to create in programming: lush environments that were procedurally built with 100-year weathering calculated; npc's that have daily schedules, but that may "on a whim" travel to another city depending on disposition; the beautiful rendering of sky, flora, and creatures; and music that puts you in the environment.

Well, much of what Oblivion SHOULD have been was implemented in mods, I am running near 200 of them. A completely moddable game is a good design goal - I would really like to make a game which can be modded like the Elder Scrolls games.

[Hieran_Del8]

I'm moving this project to sourceforge.net. There's absolutely no documentation on usage right now, but there are files...

Over the next few days I'll be setting up the site with basic necessary interfaces, like a bug tracker, a feature request tracker, an svn repository, a help forum, etc.

The site is: https://sourceforge.net/projects/dsdxlibrary/.

You can subscribe to a mailing list there to receive notifications when the repository is updated. Alternatively, you can also get the rss feed on the "News" to be alerted to any stable releases.