the official website of the dallas final cut pro user group

Random header image... Refresh for more!

Squeeze It!


As I’ve written about previously our department is undergoing a massive re-encode, about 1600 files. We were previously using Sorenson Squeeze 4.5.7. It’s main problem revolved around the time it took to transcode a Quicktime movie into a .mp4. To create one mp4 took about three hours. And for each Quicktime file we need to output two mp4’s and one mp3. Now 6+ hours to get through one file is just rediculous.

It became important to take advantage of our multi-core machines, which Squeeze 4.5.7 wasn’t doing. We decided to take the plunge and upgrade to Squeeze 5 because of it’s claims to utilizing multiple cores. Come to find out that it does and it doesn’t. It does utilize multi-core machines, but only in certain instances. For example, if you important files manually it can use all the cores you have. If, however, you use a watch folder to encode files you only get one core of fun. Now that seems pretty short sighted. Watch folders, in a multi editor studio is of the utmost importance. Since everything we do is in a networked envirnoment watch folders make the encoding process much simplier.

For those who may be unaware of what or how a watch folder works, let me explain. A watch folder is a designated folder that is “watched” by the encoding software. Whenever a file of an appropriate type, say a Quicktime .mov, is placed into the folder the encoding software will transcode the file into whatever settings are specified. So from one watch folder you may have five different output formats. In other words, one .mov goes in and out comes a mp3, mp4, wmv, flv, and mpeg-2. This makes repetative tasks easily managable. And it makes repetitative taks that come from multiple editors easily mangable through one piece of software.

The upside to Squeeze 5 is when it does take advantage of your multiple cores it allows you to rock ‘n roll. Instead of doing 5 files in a 24 hour period, my 8 core machine was cranking through 26 files in the same time. Now that’s a serious time saver! My recommendation to Sorenson is to tweak their programming so that multi-core encodes happen whether you import manually or setup watch folders. The software has an extremely intuitive interface with simple, easy-to-use plugins. For the price point and its feature set, not much can touch it. Overall, I give squeeze a 7 out of 10.

So now that I’m utilizing all my cores I’ll keep ya posted on how long it takes to transcode 1600 files! Maybe one day we’ll have a faster solution to these kinds of tasks….but until then….

June 28, 2008   4 Comments

Meeting Notes from 6/12/08

Last night’s FCPUG meeting went off without a hitch. We met at AMS at 7:00 – ajourned sometime after 9:00 PM – then went to Two Rows for dinner. We had about 40 people in attendance.

www.DallasFCPUG.org : Wayne Walker gave us an introduction to our new website. We are going to start using a new discussion forum for communication. Please everyone – sign in and give us feedback. Thanks to Jønny ReVøl†! for design ideas!

Color : Ryan Holmes gave us a real world workflow example using Color to correct and grade poorly shot video. Ryan showed how to take media from Final Cut – to Color, grade it, render it, and send it back to Final Cut. Check our Ryan’s video podcast (Studio006) for color training – as well as other production applications.

Viewzi – Steve DeVoll introduced us to a new way to graphically view web search results. Steve was one of the founding members of our FCPUG and is now the CTO of a great new company. Viewzi takes the best of web search results (Google, MSN, Yahoo, Ask and others) and delivers those results in a radically new way. You’ve never seen your search results look so good. Who though web searches could be fun again?

ShotPut Express – Ned Soltz gave us a demo of this utility used to copy media from your Sony SxS card (from the Sony EX1 XDCam) to an external Firewire, a usb drive, or your internal drive. After you shoot – you need a quick way to empty the card so you can keep rolling.

Matrox – A rep from Matrox came to visit us and gave us a demo of the MXO and MXO2. He led a fun discussion of these two products. The MXO is an output device – that enables you to output from your computer – in the correct color space to a standard DVI LCD monitor (or SDI, Component, or composite). The MXO2 is an IO box. It is not codec dependent. You can use it to import and export over SDI, Component, Composite, SVideo, or HDMI. It can be powered by a 12 volt source, and lists for $1595.
It used your express34 slot – thus will only work with Intel based macs. Very lightweight and compact. It competes with the AJA IO HD.

Thanks guys – I’m sure discussion will kick up quickly in the forum. Please remember to leave us feedback about the site. What do you want to see her?

~Wayne

June 13, 2008   No Comments

h.264 solution…


Final Cut Pro to the rescueLast week I posted how we were in the midst of searching for a way to adequately encode almost 2000 files using the h.264 codec into some sort of wrapper. The problem was deciding what type of wrapper to use. Should we use .mp4, .mov, or .m4a?

The problem centered around how long it took Sorenson Squeeze (our transcoding software) to create a mp4 from our full quality mov. What I failed to consider was how much unnecessary work Squeeze was doing. For instance, we exported from Final Cut Pro a DV25 720×480 interlaced timeline. Squeeze had to resize the file down to our output resolution of 640×480, deinterlace the footage because we were delivering via web (and you don’t put interlaced material on a progressive display like a LCD or Plasma), and then create a new mp4 file. So Squeeze took anywhere from 4-6 hours just to do 1 file. That just isn’t going to work. I’ve seen mud move faster. Hence our dilemma.

We looked at Compressor as a solution, but it didn’t offer a mp4 file using the h.264 codec. If we want h.264 it either meant wrapping it as a m4v or as a mov. The solution: stick with Squeeze but take some work off the programs shoulders, force FCP to do much of the grunt work upfront. So when we batch export from FCP our sequences were manipulated from FCP into our target resolution (640×480) and deinterlaced. Encoding a file that Squeeze no longer has to resize and deinterlace took the transcoding time down to 1-2 hours. Much better. Still not light speed, but not as slow as molasses either.

What we learned: sometimes its easier to let FCP do the grunt work, like resizing or deinterlacing, and then let a secondary software, like Squeeze, do what it’s made to do, namely, transcode.

June 5, 2008   3 Comments

h.264 Anyone?


Here’s the goal: you want to use the H.264 codec to distribute video content via Amazon S3, used inside a Flash player, and playable on any iPod/iPhone. Sounds simple enough right? Wrong!

The question is what kind of wrapper you want to encase the H.264 in, mov, mp4, or the arbitrary Apple standard of m4v (to distinguish it from m4a). We have adopted a .mp4 standard at our studio. So there’s 2 ways to go about producing a .mp4 video either QuickTime Pro or stand alone encoding software (Cleaner, Squeeze, Episode, etc.)

“Not so fast,”you say! Just use Compressor. It comes with every version of Final Cut Studio…you’ll be good to go. The problem is that Compressor only creates .m4v or .mov using the H.264 codec. If you create a .mp4 you get stuck with the generic mp4 codec

“O.K. Well just change the extension when it comes out,” you say. Well the problem is that the mp4/m4v/mov gets data written into the header of the file to specify what format it is. If it gets changed QT Pro cannot recognize it

We use Sorenson Squeeze (version 4.5.7) at our production studio to encode video. Squeeze only does the H.264 codec in a mp4 wrapper. So no .m4v (Apple’s iWhatever approved format) or .mov. Plus version 4.5 of Squeeze takes about 1.5-2 hours to encode one twenty minute file on a four-core machine (that’s too many numbers for one sentence). Now consider this: we have almost 2000 videos to encode. Not the fastest solution

So we could change our format from .mp4 (what we currently use) to .m4v and just use Compressor. The trouble with Compressor is that the settings in Compressor only go down to 1000kbps. That’s almost 4 times our current data rate (275kbps). What’s a boy to do

No solution has of yet, revealed itself. I continue to research how to make a H.264 .mp4 file with speed and efficiency (Sorenson is the best option so far). Oh and in case you were wondering….QT Pro can create mp4 files with the H.264 codec, but they aren’t compatible with the iPod/iPhone. In fact there’s a specific setting inside of QT Pro for the iPod or the iPhone (it creates a .m4v file)

Bottom line: too many formats within just this one standard. This doesn’t even begin to delve into the .wmv, .mov, .flv race. It’s a jungle out there. Can we please simplify this….and soon?!!

June 2, 2008   3 Comments

Hello world!

The Dallas Final Cut Pro User Group (man that’s a lot to say) has been in existence for a number of years. The Yahoo Group has been somewhat sufficient to handle simple user interaction.

As we migrate to newer technology, a real website, and a real discussion forum – what should this site include?

Please post your opinions in the comments of this post.

May 27, 2008   No Comments

Quick Update on Ultimate Raid

Highpoint Technology has updated the firmware for the RocketRaid 3522 to allow booting from Mac OS X 10.5. Now, this is not quite as significant to the video editor since we would not be capturing to a startup volume, but it is a significant advance in the evolution of the RocketRaid card for those users who require large start-up volumes.

This is one impressive raid card. Bootable (for those whose applications need bootable raids), easily updated via firmware patches, ethernet port for remote control of raid and computer functions, multiple raid levels, optional battery backup, but most importantly its Intel IOP 81341 on-board processor. It is a true hardware raid controller with all of the speed, security and management capabilities that any editing installation would demand.

May 2, 2008   No Comments

Work In Progress— The Ultimate Raid

I've been writing quite a bit about storage over the past couple of years going all the way back to this first roll your own raid article to a more recent review of an 8-drive array from Dulce Systems with more general storage articles (check all of the out on www.dv.com).

Currently waiting for publication is a review of the 3Ware Sidecar.

This time I wanted to build an ultimate raid. But just what does an editor need? Well, what I needed was a single workstation unit with lots of capacity, with redundancy and with the speed to handle capture and playback of 10 bit uncompressed HD. 2K capabilities would be a nice bonus but I really only see myself working in 2K just in technology demo rather than production at the moment.

I had built a Raid 1+0 based upon the CalDigit eSata card for my MacPro and a Sonnet card in my PowerMac G5, connecting to a 5 enclosure port-multiplier box I bought from CoolDrives.com.

The CalDigit and Sonnet cards are software based, utilizing port multiplier chips from Silicon Image but with the raid itself configured and managed through the OS (in my case, MacOS X) and SoftRaid, a superb management utility.

I wanted to go the hardware route this time, so I chose to create a solution based upon Highpoint Technology's RocketRaid 3522 card (note-- this is the Mac page, but it works as well with XP and Vista-based PC's) and and the Enhance Technology E8 MS enclosure.

The Highpoint RocketRaid card is hardware based with an onboard Intel IOP 81341 processor with 2 external mini-SAS ports, each capable of supporting 4 drives in Raid 0, 1, 3, 5, 6, 10, 50 and JBOD. It is a PCIe 8x card which works as well in a 4x PCIe slot and includes browser-based raid management. It will work with any enclosure and with SAS or SATA drives.

An added bonus with the Highpoint card is an ethernet port which allows remote access to the card to configure the raid or even initiate rebuilding remotely in the event of failure.

Hardware raid means, in brief, that all processing is performed by the card's processor taking load off the computer's processors. Hardware raid level 5 represents a good compromise between speed, capacity and redundancy. Effectively, parity is spread across all drives and the raid capacity is reduced by the size of one drive. Raid 5 allows for the failure of one drive, while raid 6 allows for two drive failures.

The Enhance E8 MS enclosure allows easy mounting and removal of drives and has two miniSAS connectors. It will accept either SAS or SATA I/II drives.

I have been testing with 8 Seagate 7200.11 1 tb drives as well as with 8 1 tb Samsung F1 drives. Stay tuned for the detailed comparison of these drives but catch a sneak preview below.

Preliminary testing is very favorable with some amazing speeds, 3-4 layers of 10 bit uncompressed HD without rendering and seemless playback of 7 layers of 10 bit uncompressed. This can be attributed not just to the quantity of fast drives but in great measure to the Highpoint card.

One problem so far-- my MacPro (early 2008) dual 3.2 will not recognize the RocketRaid card in Slot 2 (the 16x slot). In fact, it will not recognize any card in Slot 2 other than a 16x video card. I suspect there are some issues with this machine on Apple's end and I look forward to solutions from Apple. I suspect that I will obtain even faster results once the card works in the 16x slot. Hurry up and fix the incompatibility, Apple.

Meanwhile, here are some AJA System Test results for both the Seagate (first graphic) and Samsung drives.





Not bad, eh?

Oh, and the cost to create all of this: About $550 for RocketRaid 3522; $650 for Enhance E8 MS; $250 each for 1 TB Seagate or Samsung drives. Total-- around $3200. Compare that to pre-configured 8 tb turnkey systems costing over $8000.

The upside-- you save money. The downside-- assembly required (but a lot easier than your kid's bicycle), configuration required and no unified support. There remains a great deal to be said for buying a turnkey system from a storage vendor like Dulce Systems, Sonnet or CalDigit (just to name three which I have evaluated recently). Roll your own, though, does have its place in the market.

Stay tuned.. more coming on this site and eventually in print.

April 11, 2008   No Comments

Rolling Shutter Effect In Sony EX-1

In the April, 2008 issue of DV Magazine I reviewed Sony's EX-1 camera.

I love the camera, warts and all, and it is high on my post-NAB purchase list. This is coming, you understand, from an unabashed user of the Panasonic HVX200 and long-GOP skeptic.

But one of the concerns that many users have raised about the EX-1 is its CMOS "rolling shutter" which effectively scans the entire image progressively rather than buffers the image as does a CCD-based device.

This rolling shutter effect can produced partially-exposed frames under certain conditions, primary among them being strobing or flash photography.

I was able to reproduce this in my testing subsequent to the article. I'm shooting at night at the Rockefeller Center ice rink using existing light (those half-inch chips really do well in low light situations). Of course, every parent needs to snap their kid doing multiple axils.

Take a look first at a single frame before the flash.








Now, the next two frames contain the flash.





Can you see the rolling shutter effect? Look at "The Concourse..." You can see that the area is normally exposed in frame 1 and brighter in frame 2. So, the flash effectively "rolled" from the bottom of the frame to the top.

But does it really make any difference in this scenario?

Take a look at a 4 second clip shot 720p24 at 60 fps for a slow-mo effect. The flash occurs about 3 seconds into the clip.




The flash is certainly visible but even when played at full HD resolution the shot still holds together.

I'll keep trying to break the rolling shutter. Stay tuned...

April 11, 2008   No Comments