We all take for granted that buying a better video display will result in a better home cinema experience. Ditto speakers and sound processors and amps and control systems and so on. But for some reason, even in an era where streaming has pretty much taken over as the dominant source of AV entertainment, we talk about services like Netflix as if the hardware delivering them doesn’t really matter.
This realization has been at the forefront of my mind recently, as I’ve had discussions with videophiles on Facebook and in the comments section of Home Theater Review about the quality of the streamed video experience. Even folks with roughly the same internet speeds as me, similar quality home networks, and comparable displays seem to be watching a wholly different Netflix than the one I enjoy.
This absolutely baffled me for the longest time. My first inclination was to write it off as pure bias. Or maybe even ignorance. But then I started asking about a variable we videophiles rarely discuss when we talk about streaming: “How, exactly, are you accessing Netflix?” (By the way, I’m using “Netflix” a bit like “Kleenex” here, as a synecdoche for high-performance streaming
video across the board. You could just as easily plug in your high-quality streaming service of choice, be it Vudu or Amazon or what have you. But none of this necessarily applies to lower-quality streaming apps like CBS All Access, etc.)
What I found is that almost none of the commenters who bemoan the quality of Netflix watch it the same way I do, via Roku Ultra. Some use cable or satellite boxes. Some rely on the smart apps built into their TVs. Some even have their laptops plugged into their TVs via HDMI.
This makes a difference. Way more than you would think. Way more than I would have ever imagined until I actually sat down for some exhaustive comparisons between the exact same Netflix programming streamed to the exact same display.
The first thing I discovered is just how substantially different loading times are between devices. I did all of this testing on my 75-inch UHD TV, installed just above my credenza, which houses my Roku Ultra, Dish Network satellite receiver, Kaleidescape Strato, and my other AV components. All are plugged into the same enterprise-grade, gigabit Cisco network switch, and as such have access to the exact same level of connectivity. If you’re a numbers nerd, you can check the “Netflix by the Numbers” sidebar below for a breakdown of exactly how long it took each device to load the Netflix app (after a hardware reboot), begin playing a title, and reach full UHD resolution and full bandwidth.
None of the above is even slightly shocking. What was shocking, though, is just how different Netflix looked via these different devices. Cueing up my recent favorite, Our Planet, I couldn’t help but notice that via the app built into my smart TV, this gorgeous nature doc looked a bit less gorgeous. A bit smeared. A bit noisy. A good bit less refined. A closer inspection of the screen revealed the cause: Numerous video compression artifacts, pretty much right in line with what all of the streaming detractors have been hollering at me about on Facebook.
Switching inputs to the Roku Ultra—again, via the same network connection—I was a little staggered to discover a complete lack of compression artifacts. Ignore, by the way, the subtle swirling bands of brightness fluctuation in the image below. Those are a result of moiré, a misalignment of pixels between my TV and the digital sensor in my cell phone.
Ignore too the slight softness in the upper row of leopard spots. This frame is from about half a second later than the one above, and as such the cheetah is moving a little faster, so there’s some motion blur. Also, don’t focus on differences in color—my smart TV’s integrated Netflix app is delivering the program in Dolby Vision, whereas my Roku Ultra only supports HDR10, but the camera in my smart phone can’t capture the gamut of either format. This image was also taken a few inches away from the TV, so what you’re seeing is a tiny fraction of the screen, blown up way larger than life-size.
But I think what’s clear here is that via the Roku Ultra, Our Planet’s image is virtually artifact-free. (As I mentioned in my review of the program, the only compression artifact I could find in the series’ entire run, at least from any reasonable seating distance, was about a second-and-a-half of very minor, almost imperceptible color banding in one early episode.)
I sent a series of images to colleague Andrew Robinson, since he and I have been discussing the geeky particulars of compression a lot recently. He immediately started poking holes in my methodology, at my request.
“Are you using the same picture profiles?”
“Are you letting the smart TV buffer up to full resolution?”
“Is your Roku running through the video processing of your AV preamp?”
Nope. I bypassed my preamp and ran the Roku straight into HDMI 1 on my TV.
I’ve done my darnedest to think of any reason why the same UHD/HDR program would look so rough via one streaming device and so flawless via another connected to the exact same network switch in the same room, running the same
streaming service from the same account. The only thing I can come up with is something Andrew touched on in his most recent piece about compression: HEVC (aka H.265), the video codec Netflix uses to deliver UHD/HDR, is very processor intensive. The cost of shoving such high-quality video through such a small pipe is that it makes the device on the playback end do a lot of heavy number crunching. And if those numbers can’t be crunched quickly enough, the results look a lot like the top screen shot above.
My guess here is that my Roku Ultra has the horsepower to deliver Netflix practically flawlessly, whereas my smart TV simply doesn’t. (And as gorgeous as the TV is with native 4K video, its middling performance in upscaling lower-resolution video to 4K is further evidence of this. That’s why I use my AV preamp to upscale video.)
And look, none of this is intended to be an advertisement for Roku. It may be my streaming player of choice because it consistently delivers the best performance for the streaming apps I use most. But I haven’t tested every single media streamer on the market to compare their video quality. (As our own John Sciacca has reported, though, even the highly lauded Apple TV 4K sometimes struggles on the audio front, and Andrew reported anecdotally in our most recent conversation that he noticed a significant improvement in video quality when he switched to Roku.) Nor do I have a representative sample of smart TVs to confirm that all of their built-in Netflix apps render such poor video performance.
NETFLIX BY THE NUMBERS
A nuts & bolts comparison of different streaming devices
I started with a simple load-time test, to see how long it would take for Netflix to launch to the user-select screen via devices that had just been powered up. All of these numbers are, of course, influenced by the speed of my internet connection (500 mbps) and the quality of my home network.
Roku Ultra 3.05 seconds on average from the time I selected the Netflix app until it loaded to the user-select screen
Dish Network Hopper DVR 4.41 seconds on average
Smart TV 22.38 seconds on average
I then selected three different Netflix programs (Our Planet, Love, Death + Robots, and Test Patterns) and ran numerous tests to find the average time it took each device to start playing the program after it was selected.
Roku Ultra 3.20 seconds on average, from the time I pressed Select until the program started playing
Dish Network Hopper 9.64 seconds on average
Smart TV 13.15 seconds on average
Lastly, I cued up the Test Patterns again, specifically the pattern labeled “YCBrCr 10-bit Linearity Chart: 3840×2160, 23.976fps.” This test gives you a bitrate meter at the top of the screen, and also displays playback resolution, which let me gauge how long it would take each device to reach full bandwidth (16 mbps) and full resolution/color bit-depth.
Roku Ultra Played at UHD 10-bit immediately, although it did start at 12 megabits per second and took 4.15 seconds on average to report full 16 mbps bandwidth
Dish Network Hopper DVR Switched from 1920 x 1080 resolution to full 3840 x 2160 resolution after 15.62 seconds on average, and took an average of 46.26 seconds to reach full 16 mbps bandwidth
Smart TV Took 47.18 seconds on average to switch from HD to UHD resolution, and didn’t reach full 16 mbps bandwidth until an average of 142.54 seconds into the stream
All I can say for certain is that the device you use to access Netflix and all of the other streaming services you subscribe to does matter. And it matters way more than I would have predicted just a week ago. Simply put, if you’re streaming Netflix in your luxury entertainment system and notice that the picture isn’t up to snuff, don’t blame Netflix. Start pointing your finger at the device you’re using to access the app.
Dennis Burger is an avid Star Wars scholar, Tolkien fanatic, and Corvette enthusiast
who somehow also manages to find time for technological passions including high-
end audio, home automation, and video gaming. He lives in the armpit of Alabama with
his wife Bethany and their four-legged child Bruno, a 75-pound American Staffordshire
Terrier who thinks he’s a Pomeranian.