Original Footage

For this scene, I wanted to add additional buildings into the background of the source footage and change the sky to make it more interesting and dynamic. First, I had to track the shot by using a program call Synth Eyes. In Synth Eyes, I set it to track the shot by placing markers on the buildings where they exist in the frame. Once the tracking was done in Synth Eyes, I then exported the tracker data into Autodesk Maya. In Maya, I used the tracking data to help me build 3d models of those buildings. Once I had the 3d models done, I then exported the models for use in Nuke. In Nuke I set rotoscope nodes to isolate the buildings and the ground from the sky. With those elements isolated, I was able to project the buildings and the ground onto the 3d models I made in Maya. Once they were projected, I was able to replace the sky from the original shot with a more dramatic one. I then added in additional buildings and plants to detail the shot. I also added some finish detail like the flock of birds moving through the sky. I made color adjustments by inserting some grade nodes and color correct nodes. This helped blend the additional elements into the shot. For the final look, I added a few last details including an increased grain into the overall footage and an added lens distortion node for greater realism.