How to Enable Using the Binding Builder in WPF and Silverlight Applications

In VS2010, when the Data Sources Window is used to generate the UI, the generated XAML injects design-time information so that the Binding Builder can be used to create bindings for the UI controls. But if your application was written in Visual Studio 2005 or 2008, or you used the XAML Editor, the Designer or Expression Blend without the Data Sources Window, your coding style is to assign the DataContext in code and not data bind to CollectionViewSources in your XAML, then you won’t be able to take advantage of the new Binding Builder. How to Enable Using the Binding Builder in WPF and Silverlight Applications by Karl Shifflett to the rescue – it demonstrates the simple requirements to enable you to use the new Binding Builder in a variety of scenarios like the ones mentioned above.

Today’s Sites/Blogs

  • Started to “bump” into the Smashing Magazine quite often nowadays. Usually it collects interesting Internet resources related to web development (notably CSS, HTML, AJAX, etc.) and design (user interfaces, fonts, new ideas, etc.), and also has some tutorial-like or how-to-like posts (e.g. about PNG optimization, common mistakes, etc.). Really nice! Webdesigner Depot, Line25 Web Design Blog, and Presidia Creative all have similar concept.
  • Windows Presentation Foundation SDK by Windows Presentation Foundation SDK writers and editors. Might be more interesting, but OK nevertheless.
  • Expression Blend and Design – The team blog of the Expression Blend and Design products

WPF Video Playback Problems

There is one severe problem with video playback in WPF/Silverlight that, for some reasons unknown to me, is getting very little (almost none) attention from both the community and Microsoft. Basically, it boils down to WPF being absolutely unable to properly play video content. Let me explain by using the following diagram:

WPF Video Playback Poblems

First line shows video frames as they are in the video content. Second line depicts variable frame rate of the WPF renderer – as you know, WPF is changing the frame rate dynamically, and CPU load will affect frame rate too. There are two possible outcomes:

  1. WPF is using vsync (version 1), i.e. it synchronizing rendering to the screen with the screen refresh frequency. This is what you will get on Vista, and sometimes on XP (normally XP video drivers are not using vsync). The resulting video shown on the screen will have variable duration of frames, and the viewer will be present with artifacts like skipped video frames, “jerky” playback, where motion is not “smooth”/uniform, etc.
  2. WPF is not using vsync (version 2). It is the case normally seen on XP. The resulting video is even worse, as there is the tearing effect present now – upper and lower parts of the displayed video frame are not matching. This problem is not present on some XP machines, e.g. I do not see it on my home PC, while it is present on 100% of other machines.

This is a bit oversimplified picture, but good enough for our purpose. In reality, the resulting on-screen picture will depend also on the screen refresh frequency, but artifacts will be more or less the same. In both cases the video playback it totally unacceptable though.

The issue is very serious, and, unfortunately, it is unsolvable in terms of today’s WPF. I think it will be not solved in the near future either, as solving it would require WPF to adopt constant-frame rate rendering paradigm, and synchronizing it with the display refresh rate. This is not likely to happen, as it is a drastic change to the fundamentals of WPF, and, at the same time, it will waste resources in non-video related applications (now WPF can decide what frame rate it will use, and can dynamically change it, e.g. dropping frame rate for “still” scenes and increasing it when animations start).

In our software we had to go through a lot of extra pain to “overcome” this issue – we render video using DirectShow by incorporating Win32 host into our WPF application and implement all kinds of “tricks” to allow WPF content to get into the video window airspace (to display OSD’s, menus, etc.) by using e.g. clipping regions (say Goodbye! to transparency though). There are a few third party projects out there (WPF MediaKit by Jeremiah Morrill is an excellent example) that allow one to mix DirectShow and WPF, but none of them will fix the above mentioned issues, as the resulting picture is rendered by WPF renderer and all the artifacts will be there still.

Probably, for majority of people this is not really an issue (at least until you point them to it; after that they can see it on their own and they become very annoyed), especially if you are playing some kind of home-made content from the YouTube (although YouTube has HD content nowadays too), but it is completely unacceptable for people at least somehow concerned about the video playback quality. DVD/DivX player costing $30 will not have these problems, so it is difficult to explain why $1000 machine (33 times more expensive!!!) cannot produce even remotely as good video playback on $2000 HD TV set.

In addition to these video playback problems, WPF on XP suffers from the tearing issue not only during video playback, but also during “normal” WPF animations. And this has even more profound effect, as it makes it impossible to implement animated WPF applications on XP.

Microsoft’s reaction to the tearing issue on XP is problematic. We have tried to approach them via all possible channels – Microsoft Connect program, Microsoft Metro program, newsgroups, personal contacts, everything. They either deny the issue, or say that it is unsolvable for XP in general case, so they are not going to solve it (but they could easily solve it for something like 95% of all XP installations by solving it at least for ATI and Nvidia cards), or they say that they will not solve it for XP anymore, as XP is not available so nobody cares. And this last reaction is problematic again, as the issue is present not only on Windows XP Home/Pro, but on Windows XP Embedded and Windows Embedded Standard as well. These OS’s will be around for some time still, and Windows 7 Embedded will not come before 2010 and, being Vista-based, will be a resource hog – something not necessarily good for embedded system.

JavaFX

It seems that Sun can say now, “rumors about my death were greatly exaggerated”. Recently they rather quietly released JavaFX – a rich client platform (what has happened to thin client dreams of Sun and alike? huh? ;) for creating and delivering rich Internet experiences across “all the screens of your life” (they are using this phrase all over the place, and it sucks, to be honest, but go figure).

From what they show in their videos, it looks rather like WPF/Silverlight for Java. In other words, it is the presentation layer for the Java platform. Performance-wise it looks rather good (OK, no idea what hardware was running those demos). For example, they were playing 9 (yes, nine!) video streams simultaneously, but then, who the f#$k needs 9 videos playing at the same time!? It is the same f#$*%ng old useless BS that Microsoft is showing all the time! Of course, it remains to be seen if it can play all this video content without framerate issues that plaque WPF/Silverlight. JavaFX Script is a declarative scripting language behind JavaFX.

Sun is promising to make JavaFX multiplatform, capable of running on desktop, mobile, TV and other Java-enabled consumer platforms, but so far they have desktop version only. Then, as far as I understand, development tools are not necessarily ready yet (judging from their sentence “JavaFX technology will provide a suite of tools and authoring solutions that enable unprecedented collaboration between designers and developers”). If they will deliver all these promises, Microsoft might get into deep trouble with WPF, as Java’s inability to provide good UIs were one of the main reasons why many were choosing .NET over Java on the client side (I am not discussing platforms – .NET 3.5 vs Java 6 – just presentation parts). What Sun has already made right, in my opinion, is their selection of Adobe PhotoShop and Illustrator as a designer tools, as these are light-years ahead of Microsoft Expression Designer.

Future will show, what will come out of all this, but the good point is that Microsoft will get some competition in this field, and might eventually do something to fix its platform’s shortcoming (though unlikely – so far they are taking extremely defensive and ignorant stance regarding WPF/Silverlight problems).

.NET/WPF Obfuscators

We have recently purchased PreEmptive Solutions Dotfuscator (which sounded like a good idea when we were making decision about it), but to be honest I am not very happy about it: it cannot properly handle WPF projects and you have to perform a lot of “voo-doo dances” to get at least some protection there (and all that while costing s|-|1t-load of money). This pushed me to do a new round of evaluations of competing products, and I have found few that are really interesting:

  • .NET Reactor (about 150€) is a really powerful tool with lots of features (code and resource protection, code encryption, support for .NET 1.1, 2.0, 3.0, 3.5, CF 1.0 and 2.0, ASP.NET, Mono, can merge assemblies, remove IL code, generate native executables, etc., etc., etc.). Additionaly there is a licensing system, but I have not tried it yet. Despite it claims supporting .NET 3.5 I did not manage to protect our WPF assemblies with it, but all other assemblies were protected like a charm.
  • DeepSea Obfuscator (about 200€). This obfuscator’s list of features is not much shorter, but few outstanding points are support for WPF assemblies, and declarative obfuscation, where the obfuscation process can be controlled by applying obfuscation-related attributes to your code. I managed to protect our WPF assembly with it, but resulting assembly is crashing when I’m entering one specific screen. I guess this crash can be eliminated by using attribute-based obfuscation and removing some properties/classes from the protection process (which is not that good, to be honest, as it means extra work, howewer small it is).
  • {smartassembly} (about 350€-650€, depending on version) looks really impressive as well. It was able to protect WPF assembly and, it seems that the abovementioned crash is not present here; well, it is with certain settings related to obfuscation, but it can be easily eliminated by tweaking settings. Control flow obfuscation seems to be much stronger than that of the DeepSea, and there are some additional protection settings that make lives of Reflector, ILDASM and others really miserable (e.g. invalid metadata streams).

It seems that to get decent level of protection we will have to use either {smartassembly}, or both .NET Reactor and {smartassembly} (in case {smartassembly} would be not able to provide the same protection level for “normal”=non-WPF assemblies as .NET Reactor does – remains to be seen).

Webcam Control with WPF

Webcam control with WPF or how to create high framerate player with DirectShow by using InteropBitmap in WPF application by Tamir Khason shows how to do exaclty what it claims to show :) in a way alternative to what Jeremiah Morrill is proposing (now, I do not have an opinion as of which is better or worse – they both have their uses).

Side Note Unfortunately, you cannot play decent quality video in WPF application (meaning in WPF “airspace”) no matter what you do – it has to do with non-constantness of the WPF rendering frame rate (and, on XP, add here WPF tearing artefacts), and I do not see how it can be fixed in the future as this problem is rooted extremely deeply in the core of WPF rendering pipeline. Microsoft knows about this issue, but does nothing to fix it.

Crack.NET

Crack.NET is a runtime debugging and scripting tool that gives you access to the internals of a WPF or Windows Forms application running on your computer. It nicely rounds the Snoop and Mole for Visual Studio group, as it allows you to “walk” the managed heap of another .NET application, and inspect all values on all objects and types. In addition, you are able to write and execute IronPython scripts that run inside the target application.

Josh Smith is the author, and has a nice introductory page for the tool.

Expression Blend 2 SP1 RC Preview

Had no time to blog – work really takes all my time nowadays (and “nowanights” too :)…

Microsoft has finally released a newer version of Expression Blend. Now it is called Expression Blend 2 SP1 Preview or Expression Blend 2 SP1 RC Preview, depending on where on Microsoft’s site you are reading it, hinting that we will likely get the final release version rather sooner than later (in a month or two, who knows?). This is the version that marks the end of Expression Blend 2.5 CTP – Microsoft will not release newer versions of 2.5 CTP anymore; instead, all 2.5 features migrated to Blend 2 SP1, which is not bad IMHO.

I had not much time to play with it so far, but what I have seen looks really promising. For example, Blend finally stopped crashing all the time in case there were errors in XAMLs (or rather in code-behind); now it is displaying meaningful error messages about these problems, so you finally get a chance to fix it. Of course, there are still many problems which Microsoft most likely will not fix in this release anymore. For example, the Resources pane really sucks big time: if you have many resource files (and you have them if you are skinning your app), it is virtually impossible to navigate in them – they are sorted in weird order known only to Microsoft itself (or, maybe, it is just random?), and there is no way to do anything about it, e.g. sort them in alpha order.

In any case, it is really big step in the right direction. I would recommend to move to 2.0 SP1 ASAP in case you are using 2.5 CTP and developing WPF applications (cannot say about Silverlight/Silverlight 2 as I am not using those).

Today’s Sites/Blogs

Today’s Sites/Blogs

WPF Blogs

WPF blogs from Microsoft and ex-Microsoft guys/gals primarily (as well as guys that know their way around the Microsoft):

And here are blogs by ex-Microsoft people (sad, that they are not at MS anymore):

  • notstatic.com by Robby Ingebretsen – nice things. Has not been updated recently, but now it is picking up again. Check his Kaxaml replacement of XamlPad.
  • fortes.com by Filipe Fortes – few demos and screencasts, mostly mix06-related
  • jfo’s coding by Jessica Fosler – many samples, snippets, tips, etc.

Channel 9

Other blogs:

  • 2008.07.10 WPFopoly by Matt Duffin: guy is creating a game similar but unrelated to Monopoly – from scratch. A lot of panels-related things.
  • 2008.07.10 Pixel in Gene by Pavan Podila (?) – mostly related to 3D
  • 2008.07.10 sachabarber.net by Sacha Barber – I guess no need to introduce this guy :)
  • 2008.07.10 Andrew Smith
  • 2008.07.10 Alan Le’s Vertigo Blog – a lot of info about resources and WPF/Silverlight
  • 2008.07.10 Karl on WPF by Karl Shifflett
  • 2007.08.26 Nick Thuesen has few interesting articles about panels and other WPF and non-WPF things
  • 2007.08.26 the WPF way… – Pavan Podila’s blog has interesting stuff, but very little code (its title says “‘the Approach, rather than the Solution”)
  • Josh Smith on WPF (and the old blog) – great blog about all kinds of things like “smart” ResourceDictionaries, controls’ customization, etc.
  • theWPFblog by Lee Brimelow – a lot of samples and nice ideas
  • Sheva’s TechSpace’s Blog by Yong Zhou (aka Sheva, footballism on MSDN forums). His blog is great and guy knows a lot.
  • On .Net Client Stuff by [?] – not a bad blog with lots of goodies about Vista gandets, WPF/ActiveX interoperability, tips, etc.
  • Jan-Cornelius Molnar – quite cool blog with some nice tips about Dispatcher.Invoke (obvious, but still), customizing WPF window border (like in Max), etc.
  • dotnet mania by Eric Burke – PanelLayoutAnimator, some XAML snippets
  • Chaz by [?] – a bit outdated, but a lot of nice ideas and samples (skinning, SkewTransform, Elliptic Control, etc.)
  • Ruurd Boeke: Enterprise development and techno babble by Ruurd Boeke – some interesting posts about databinding
  • XamlXaml.com by Michael Emmons – nice snippets and bits…
  • Douglas Stockwell’s WebLog – interesting things about WPF, generics, DWM Thumbnails in WPF, dynamic method generation, Impossible WPF, …
  • DeveloperZen.com by Eran Kampf – tons of interesting resources about WPF and not only
  • Laurent Bugnion (GalaSoft) - nice blog about WPF, .NET, Web Services, etc.