Not hard at all. I could do one in probably 30 minutes. A first timer, plan on 2-3 hours. Basic hand tools.
Remove the entire intake up to the turbo. Remove the CAC pipe on the passenger side (metal intercooler tube that feeds from the turbo to the intercooler). Loosen the clamp on the downpipe and pop the downpipe off. Loosen the clamp on the up-pipe. Remove the turbo feed line (one bolt) and move it out of the way. Now on your 06, there are 3 bolts that hold the turbo to the pedistal. Two are in front and are horizontal to the ground. The third is in the back on the drivers side and is vertical. If you lay down on the passenger side of the engine and look behind the turbo you might be able to see it. The easiest way to get this bolt is find the exact height of extension socket that allows you to go over the top of the downpipe and down to the bolt. It will give you ample room to work the ratchet. This is the trickiest part. Once you find the right combo and length of extensions, it will be super easy and you'll see how you can cut a bunch of time off next time you take one out. You can also use this time to upgrade the turbo drain and turbo feed (I find the turbo drain line is far more important than the feed line myself, and it's also cheaper. So at a min, do the drain).To actually pull the turbo out, you'll need to sort of rotate it as you pull it out, it will come right you, you'll see. An extra set of hands will help too.
Updated oil drain: 6C3Z-9T515-A
Updated oil feed (for 05+ turbo): 3C3Z-9T516-A
When reinstalling the new turbo, rest the turbo into position, just start the mounting bolts but don't tighten them up yet. Tighten up the up-pipe connection FIRST. Then the downpipe. It is important to do these connections first since they are more rigid than any of the air side connections, and those V-band clamps will not pull the two pieces together. Once those are tight, then tighten up the turbo mount bolts, then put your CAC tube back on, and your intake. Do not forget the filter minder on the back side of the air filter, this is left off too commonly.