{"id":484,"date":"2010-11-29T21:00:40","date_gmt":"2010-11-30T05:00:40","guid":{"rendered":"http:\/\/www.pagetable.com\/?p=484"},"modified":"2010-11-29T21:00:40","modified_gmt":"2010-11-30T05:00:40","slug":"progressive-futurama","status":"publish","type":"post","link":"https:\/\/www.pagetable.com\/?p=484","title":{"rendered":"Comparing Digital Video Downloads of Interlaced TV Shows"},"content":{"rendered":"

In the days of CRT monitors, TV shows used to be broadcast in interlaced mode, which is unsupported by modern flat-panel displays. All online streaming services and video stores provide progressive video, so they must deinterlace the data first. This article compares the deinterlacing strategies of Apple iTunes, Netflix, Microsoft Zune, Amazon VoD and Hulu by comparing their respective encodings of a Futurama episode.<\/p>\n

If you have dealt with video formats before, you probably know about interlacing<\/a>, a 1930s trick to achieve both high spatial and temporal resolution at half the (analog) data rate: In NTSC countries, there are 60 fields per second (PAL: 50), and every field is half the vertical resolution of a full frame. When film footage at 24 frames per second has to be played at 30 fps (NTSC), every frame has to be shown 1.25 times – in other words, every fourth frame has to be shown twice. This introduces jerky motion (judder), but it can be improved by using the 60 Hz temporal resolution: Frame A gets shown for 2 fields, frame B for 3 fields, frame C for 2 fields, and so on. This way, every source frame gets shown for 2.5 fields, i.e. 1.25 frames – this method is called a telecine 2:3 pulldown<\/a>.<\/p>\n

A lot of TV material is produced at 24 fps and telecined, for several reasons: Standard movie cameras can be used instead of TV cameras, 24 fps can be converted to 25 fps PAL more easily than 30 fps NTSC, and for cartoons, this means that only 24 (or 12) frames have to be drawn for every second.<\/p>\n

Unfortunately, interlacing only works with ancient CRT TVs – modern LCD screens can only show progressive video. And while DVDs are specified to encode interlaced video, more modern formats like MPEG-4\/H.264 and VC-1 usually carry progressive data. So when playing DVDs, the DVD player or the TV have to deal with the interlacing problem, and in case of modern file formats, it’s the job of the converter\/encoder.<\/p>\n

The naive way of converting an interlaced source to progressive is to combine every two fields into a frame. This works great if the original source material was 30 fps progressive (which is rare for NTSC but common for PAL), but for telecined video, since two out of every six frames are combined from two different fields, this leads to ugly combing<\/a> effects.<\/p>\n

If the source material was 24 fps, an inverse telecine can be done, recovering the original 24 frames per second. Unfortunately, it is not always this easy, since interlaced video may switch between methods, and sometimes use different methods at the same time, e.g. overlaying 30 fps interlaced captions on top of a 24 fps telecined picture, or compositing two telecined streams with a different phase. “Star Trek: The Next Generation<\/a>” is a famous offender in this category – just single-step through the title…<\/p>\n

In the following paragraphs, let us look at an episode of Futurama<\/a> and how the deinterlacing was done by the different providers of the show. Futurama was produced in 24 fps and telecined. Some of the editing seems to have been done on the resulting interlaced video, so the telecine pattern is not 100% consistent.<\/p>\n

NTSC DVD<\/h2>\n

The NTSC DVD is basically just an MPEG-2-compressed version of the US CCIR 601<\/a> broadcast master. It encodes 720×480 anamorphic pixels (which can be displayed as 640×480 or 720×540) and has all the original interlacing intact. This is a frame at 640×480 and properly inverse telecined:<\/p>\n

\"DVD\"<\/a><\/p>\n

Hulu<\/h2>\n

\"Hulu\"<\/a><\/p>\n

Hulu (480p version) took the original image without doing any cropping on the sides. You can clearly see this picture is only half the vertical resolution, meaning one of the fields got discarded. It seems this was Hulu’s deinterlacing strategy, since throughout the complete video, everything is half the vertical resolution, whether there is motion or not. This also keeps the video at 30 fps, and effectively shows every fourth frame twice, introducing stronger judder.<\/p>\n

iTunes<\/h2>\n

\"iTunes\"<\/a><\/p>\n

iTunes crops the picture to get rid of the black pixels in the overscan area and scales it to 640×480. They run a full-blown 60 Hz deinterlace filter on the video. Such a filter is meant to take a live television signal as an input, with a temporal resolution of 60 Hz. While this looks fine on frames with no or little motion, vertical resolution is halved as soon as there is motion. Basically, it is the wrong filter. Like Hulu, iTunes preserves the 30 fps, introducing a stronger judder. (The video encoding is H.264 at 1500 kbit\/sec.)<\/p>\n

Netflix<\/h2>\n

\"Netflix\"<\/a><\/p>\n

Netflix seems to do the same as iTunes – maybe they even got the data from iTunes? The image is cropped and scaled to 640×480, they run a deinterlace-filter and retain the 30 fps, leading to halved resolution when there is motion, and stronger judder.<\/p>\n

Amazon Video on Demand<\/h2>\n

\"Amazon<\/a><\/p>\n

Amazon Video on Demand with its horribly inconvenient Unbox Player (Windows only, requires 1 GB of extra downloads and two reboots) did a better job. Like Netflix and iTunes, they cropped the picture and scaled it to 640×480, but they actually did a real inverse telecine. In some segments (like the end credits), the algorithm failed because of inconsistencies of the original telecine, so it reverted to half the vertical resolution. And like the others, Amazon also encodes at 30 fps, i.e. judder. (The video encoding is VC-1 at 2600 kbit\/sec.)<\/p>\n

Zune<\/h2>\n

\"Zune\"<\/a><\/p>\n

Microsoft’s Zune Store provides a cropped video at 640×480 at the original 24 fps and with a bitrate of 1500 kbit\/sec (VC-1). Looking through it frame by frame reveals that they used a brilliant detelecine\/deinterlace algorithm. On the DVD, the panning at the beginning of the “Robot Hell” song is very tricky: It breaks the standard telecine pattern (PPPIIPPPII becomes PPPIPPPI), it seems every fifth frame was removed.<\/p>\n

\n
\n
\n
\n\n<\/p>\n

The pan consists of a pattern of three progressive frames, and then one interlaced frame, which is composed of the previous frame and the current frame. Consequently, every fourth frame has half its resolution wasted by the repeated lines of the previous frame, i.e. every fourth frame only exists at half resolution in the DVD master material.<\/p>\n

Hulu discards half the vertical resolution for every frame anyway, and the deinterlacing algorithms of iTunes and Netflix discard half the resolution whenever there is motion. The Amazon algorithm does a good job when the telecine pattern is correct, but in this case, it gets confused and encodes all frames of the pan in half resolution. The Zune algorithm does a brilliant job here: The progressive frames stay at full resolution, and it extracts the half-resolution picture out of every fourth frame:<\/p>\n

\n
\n
\n
\n\n<\/p>\n

This is the fourth picture at full size – you can see half the vertical resolution is missing (it was never there in the first place!), but the algorithm did a very good interpolation job:<\/p>\n

\"Robot<\/a><\/p>\n

The Zune video is almost perfect. It recombines all fields correctly and recovers all single fields, scaling them up so that it’s hardly visible there is information missing. If you ignore the 720 vs. 640 horizontal pixels, the resulting 24 fps video contains all information of the DVD version, but with all interlacing removed, and with zero judder. Too bad it’s not H.264<\/a>, but DRMed<\/a> and only plays on Windows (XP+), Zune and Windows Phone 7<\/a>.<\/p>\n

Summary<\/h2>\n\n\n\n\n\n\n\n\n
Provider<\/b><\/td>\nCropping<\/b><\/td>\nResolution<\/b><\/td>\nDeinterlacing<\/b><\/td>\nfps<\/b><\/td>\nEncoder<\/b><\/td>\nBitrate (kbits\/sec)<\/b><\/td>\n<\/tr>\n
NTSC DVD<\/td>\nno<\/td>\n720×480<\/td>\nnone<\/td>\n30<\/td>\nMPEG-2<\/td>\n6500<\/td>\n<\/tr>\n
Hulu<\/td>\nno<\/td>\n640×480<\/td>\ndiscard<\/td>\n30<\/td>\nH.264?<\/td>\n?<\/td>\n<\/tr>\n
iTunes<\/td>\nyes<\/td>\n640×480<\/td>\n30 Hz deinterlace<\/td>\n30<\/td>\nH.264<\/td>\n1500<\/td>\n<\/tr>\n
Netflix<\/td>\nyes<\/td>\n640×480<\/td>\n30 Hz deinterlace<\/td>\n30<\/td>\nH.264\/VC-1<\/td>\n?<\/td>\n<\/tr>\n
Amazon VoD<\/td>\nyes<\/td>\n640×480<\/td>\ndetelecine+decomb<\/td>\n30<\/td>\nVC-1<\/td>\n2600<\/td>\n<\/tr>\n
Zune<\/td>\nyes<\/td>\n640×480<\/td>\nfuzzy detelecine<\/td>\n24<\/td>\nVC-1<\/td>\n1500<\/td>\n<\/tr>\n<\/table>\n

Note: H.264 and VC-1 compress significantly better than MPEG-2; a rule of thumb is to divide the MPEG-2 bitrate by 2.3 to get a comparable H.264\/VC-1 bitrate. So the Amazon bitrate is fine and the video is about the same quality (sharp picture, no compression artefacts) as the DVD, but the iTunes and Zune versions are not (artifacts can be seen on single frames).<\/p>\n

It is scary how little effort seems to be going into video conversion\/encoding at major players like iTunes, Netflix and Hulu. Amazon did a kind of okay job converting the source material properly, and only Microsoft did an excellent job. The NTSC DVDs still give you the maximum quality – but of course, if you watch them on an LCD, the burden of deinterlacing is on your side. Handbrake<\/a> with “detelecine” (for the bulk of it) and “decomb” (for exceptions) turned on, and with a target framerate of “same as source” will generate a rather good MP4 video similar to Amazon’s, but without the judder.<\/p>\n

Are there any stores I missed? Can someone check the PAL DVD as well as digital PAL and NTSC broadcasts? What is the magical detelecine\/deinterlace program Microsoft uses?<\/i><\/p>\n

See also: Comparing Bittorrent Files of Interlaced TV Shows<\/a><\/b><\/p>\n","protected":false},"excerpt":{"rendered":"

In the days of CRT monitors, TV shows used to be broadcast in interlaced mode, which is unsupported by modern flat-panel displays. All online streaming services and video stores provide progressive video, so they must deinterlace the data first. This article compares the deinterlacing strategies of Apple iTunes, Netflix, Microsoft Zune, Amazon VoD and Hulu … Read more<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[10,36],"tags":[],"class_list":["post-484","post","type-post","status-publish","format-standard","hentry","category-digital-video","category-whines"],"_links":{"self":[{"href":"https:\/\/www.pagetable.com\/index.php?rest_route=\/wp\/v2\/posts\/484","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.pagetable.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.pagetable.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.pagetable.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.pagetable.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=484"}],"version-history":[{"count":0,"href":"https:\/\/www.pagetable.com\/index.php?rest_route=\/wp\/v2\/posts\/484\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.pagetable.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=484"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.pagetable.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=484"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.pagetable.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=484"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}