59°F
weather icon Partly Cloudy

Digital effects rewinding the clock for actors

LONDON — With Martin Scorsese’s “The Irishman” expected to battle “Once Upon a Time in… Hollywood” and “1917” for the best picture Oscar in February, all eyes are on the special effects team that made the sprawling crime epic possible.

“The Irishman” unfolds over decades, with the 76-year-old Robert De Niro and his co-stars playing their characters from their 30s into retirement age, a feat that’s made the film one of 2019’s most acclaimed movies.

It’s all possible through new digital de-aging techniques that in the past year in cinemas have shaved decades from Samuel L. Jackson’s face and turned back the clock to the 1990s for Will Smith. When Monday’s Academy Award nominations are announced, “Captain Marvel” and “Gemini Man” could see their names called along with “The Irishman” in the visual effects category.

Each film has arrived at its reverse aging trick through a different technique, leading some to call 2019 a monumental year for de-aging in film.

To many, “The Irishman” stands out from the field, thanks to its complete avoidance of “tracking markers” — dots painted onto actors faces which allow computers to mathematically replicate facial movements and manipulate them as the director sees fit.

The youthful transitions of “The Irishman” are the work of Pablo Helman, visual effects supervisor at Industrial Light and Magic, who’s an Oscar nominee for his work on “Star Wars: Episode II – Attack of the Clones” and “War of the Worlds.”

Helman says the decision to forgo tracking markers came directly from Scorsese and De Niro.

“He’s not going to wear a helmet with little cameras in there,” says Helman. “He’s going to want to be in the moment with Joe Pesci and Al Pacino on set, with no markers on him. So, if you’re going to capture the performance, how are you going to do that?”

Enter the “three-headed monster,” a unique camera rig that has a director camera in the center and two “witness” cameras on either side shooting infrared footage. That allowed Helman to eliminate shadows created by on-set lighting. The shadows could potentially interfere with the geometric facial shapes constructed by de-aging software.

“You’re not interrupting the director’s thread of thinking,” explains Helman. “You’re not changing the light on set, but the computer can see in a different spectrum.”

While the team at Industrial Light and Magic was working on “The Irishman,” another group of technical wizards were experimenting with de-aging at director Peter Jackson’s Weta Workshop in New Zealand, creating an entirely digital, 23-year-old version of Smith for the action movie “Gemini Man.”

“Since I started visual FX 25 years ago it’s been the Holy Grail,” says Bill Westenhofer, one of the film’s VFX supervisors.

“You have that many years of expertise of looking at a human face and knowing what’s wrong. So, to try and get all the different things together and get it to pull off right, that’s been the challenge.”

To create the character of Junior — a younger clone of Smith’s assassin Henry Brogan — the superstar wore the traditional gray tracksuit, complimented by a head rig with two cameras capturing his facial expressions via tracking markers.

“We decided (on) a ground up approach to build everything from scratch — from the skull all the way to the skin pores, all the way to the animation and the final kind of oil in the eyes was really the best approach we could take,” says Stu Adcock, head of facial motion at Weta.

Before filming commenced on both “Gemini Man” and “The Irishman,” the teams at ILM and Weta drew up test footage to show the films’ directors that what they were suggesting was possible.

For “Gemini Man” it was a clip from the 1995 movie “Bad Boys” into which they inserted two shots of their new, digital Will Smith and asked Ang Lee to spot the “fake.”

For “The Irishman,” De Niro also returned to the 1990s, performing the Pink Cadillac scene from “Goodfellas” before being de-aged in post-production — convincing an initially skeptical Scorsese that he could bring the long-gestating project to life.

Helman and his team then spent two years looking through old movies and cataloging the targeted ages that De Niro, Pacino and Pesci would appear in “The Irishman.” They created a program — similar to that used to create online “deepfake” videos where one actor’s face is swapped for another’s — which would check their work on the movie was heading in the right direction, with the system “spewing out” hundreds of images for cross-referencing.

Creating Junior required Smith to spend time in a photogrammetry booth where multiple cameras captured his likeness as numerous lights fired in different sequences, giving a base scan of the actor and analyzing the structure of his face from a skin pore level.

Ironically, considering Scorsese’s vocal criticism of Marvel movies as “not cinema,” a similar system was used to de-age Jackson in “Captain Marvel.” A young Nick Fury was created by comparing footage from old Jackson movies with the work the actor did on set — again, using tracking markers.

“I looked at that face as, you know, maybe ‘The Negotiator’ face,” says Jackson, referring to his 1998 movie of the same name, “Fortunately for them and for me, I had enough stuff from that period in my life that they could use a bunch of different facial expressions and films to put that face together that made sense to people who knew me from that time.”

Darren Hendler, director of the Digital Human Group at Digital Domain and the man responsible for turning Josh Brolin into “Avengers” supervillain Thanos, was impressed by Jackson’s appearance in the movie.

“That’s more of a 2D-image based approach where they’re taking the actor’s performance and then they’re painting and tracking certain frames. They’re still using some of the actor’s performance directly, but they’re modifying it. It was very believable. It may not have been exactly what the young Samuel Jackson looked like, but it definitely looked de-aged.”

“The de-aging of Samuel L. Jackson is absolutely fantastic,” agrees Weta’s Guy Williams, adding, “different approaches suit different requirements. It’s not a one-size-fits-all kind of situation.”

That’s a sentiment echoed by Helman, who believes that 2019 was a watershed year for VFX.

“It’s not by chance that we have several movies that have motion capture performance, facial performance, in three or four different ways. That shows that we’re all thinking about digital humans.

“I mean, we all stand on each other’s shoulders,” Helman says. “I can’t wait for somebody to pick this up and do something else with it, you know?”

Don't miss the big stories. Like us on Facebook.
Entertainment Videos
Making lobster and avocado flatbread at Vanderpump Cocktail Garden in Las Vegas
Josh Grimes, chef de cuisine at Vanderpump Cocktail Garden at Caesars Palace in Las Vegas, created a lobster and avocado flatbread that also has avocado-creme fraiche spread, yellow tomatoes, red onion and Hearts On Fire microgreens. (Heidi Knapp Rinella/Las Vegas Review-Journal)
Riding the new 15-minute "Star Wars" ride at Disneyland
What it's like to ride the new 15-minute "Star Wars" ride At Disneyland (Janna Karel Las Vegas Review-Journal)
Main St. Provisions is coming to the Arts District - VIDEO
Kim Owens talks about her new Arts District restaurant, Main Street Provisions, which is under construction. (Al Mancini/Las Vegas Review-Journal)
Artist Wayne Littlejohn on “Spin Baby” - VIDEO
Wayne Littlejohn’s sculpture celebrates Las Vegas entertainers. (John Przybys/Las Vegas Review-Journal)
Tiësto headlines CES 2020 closing party at Hakkasan Nightclub - VIDEO
Tiesto performs for CES conventioneers and clubgoers during the DreamlandXR Closing Night Party at Hakkasan Nightclub at the MGM Grand on the Las Vegas Strip in the early hours of Friday, Jan. 10, 2020. (K.M. Cannon/Las Vegas Review-Journal) @KMCannonPhoto
Locals cheer on James Holzhauer at 'Jeopardy!' watch party - VIDEO
Imitation is the sincerest form of flattery. But James Holzhauer would have a better chance at winning “Jeopardy! The Greatest of All Time” tournament if Ken Jennings would stop copying his aggressive betting strategy. (James Schaeffer / Las Vegas Review-Journal)
Drake's first show of 2020 at XS Nightclub in Las Vegas - VIDEO
Drake performs at the indoor/outdoor XS and Encore Beach Club at Wynn Las Vegas on the Las Vegas Strip in the early morning hours of Thursday, Jan. 9, 2020. (K.M. Cannon/Las Vegas Review-Journal) @KMCannonPhoto
Ceremony held for Elvis artist Trent Carlini - VIDEO
A ceremony was held for Elvis impersonator Trent Carlini on Wednesday night at The Space in Las Vegas. (James Schaeffer / Las Vegas Review-Journal)
CES 2020: Small appliances unveiled in Las Vegas - VIDEO
The small appliances on show at Sands Expo at CES 2020 in Las Vegas include a Keurig cocktail maker, autonomous cooking system, nitrogen coffee ampules and more. (Heidi Knapp Rinella/Las Vegas Review-Journal)
CES 2020: Impossible Foods debuts Impossible Pork in Las Vegas - VIDEO
Before a packed press conference at Mandalay Bay in Las Vegas, Impossible Foods executives introduced Impossible Pork, its newest product. (Heidi Knapp Rinella/Las Vegas Review-Journal)
Lady Gaga joins her band leader at his after-hours show - VIDEO
After finishing her “Jazz + Piano” show at Park Theater, Lady Gaga joined her band leader Brian Newman for a rousing version of "Fly Me to the Moon" during his show at NoMad Restaurant at Park MGM on the Las Vegas Strip after midnight on New Year's Day, 2020. (K.M. Cannon/Las Vegas Review-Journal) @KMCannonPhoto
Brian Newman rings in 2020 at NoMad at Park MGM - VIDEO
Brian Newman, bandleader for Lady Gaga, performs at NoMad Restaurant at Park MGM on the Las Vegas Strip on New Year's Eve 2019. (K.M. Cannon/Las Vegas Review-Journal) @KMCannonPhoto
New Year’s Fireworks on the Las Vegas Strip - VIDEO
Fireworks explode over the Las Vegas Strip to celebrate the new year of 2020. (James Schaeffer / Las Vegas Review-Journal)
Kats hits Las Vegas Strip on New Year's Eve - VIDEO
Man-about-town columnist John Katsilometes covers entertainment on the Strip on New Year's Eve Tuesday, Dec. 31, 2019. Mayfair Supper Club overlooking Bellagio fountains. (K.M. Cannon/Las Vegas Review-Journal) @KMCannonPhoto
RJ LIVE from Drai's nightclub on the Las Vegas Strip - VIDEO
Aaron Drawhorn live from Drai's nightclub on the Las Vegas Strip across from the Bellagio fountains on New Year's Eve.
Ayesha Curry and Michael Mina talk about opening International Smoke
Ayesha Curry and Michael Mina, partners in International Smoke, admit things don't always admit things don’t always work the first time. (Al Mancini/Las Vegas Review-Journal)
Unravel the story of House of Eternal Return at Meow Wolf - VIDEO
New Mexico art collective Meow Wolf created the House of Eternal Return in 2016. The group is opening an original immersive experience in Las Vegas next year. (Meow Wolf)
Story behind Spago’s two-pound truffle - VIDEO
Spago chef Mark Andelbradt shares the story of a truffle hunter who found the truffle. (Al Mancini/Las Vegas Review-Journal)
Ayesha Curry preps for International Smoke opening
Ayesha Curry talks about preparing for the opening of International Smoke, her collaboration with Michael Mina at MGM Grand in Las Vegas (Al Mancini/Las Vegas Review-Journal)
Making the French Onion Burger at Topgolf in Las Vegas - VIDEO
Kreg Klaver, executive chef at Topgolf at MGM Grand in Las Vegas, makes the French Onion Burger by topping a 7-ounce beef patty with horseradish-Dijon, caramelized onions, Gruyere and crispy onions, on a pretzel bun. (Heidi Knapp Rinella/Las Vegas Review-Journal)
Mayfair Supper Club preview
The finishing touches are still being put on Bellagio’s new Mayfair Supper club, which is set to open on New Year’s Eve. But the creative team behind the experience gave members of the media a little preview on Thursday in a rehearsal space they’ve been using at Park MGM. (Al Mancini/Las Vegas Review-Journal)
Holiday Honey Toast at Sake Rok in Las Vegas
Bill Lee, executive sous chef at Sake Rok at The Park in Las Vegas, makes Holiday Honey Toast by hollowing out soft white pain de mie bread, coating it in butter, honey and sugar, toasting it and topping with three scoops of mint-chocolate chip ice cream, more honey-butter, gumdrops, candy canes, powdered sugar and cinnamon. (Heidi Knapp Rinella/Las Vegas Review-Journal)
New lunch menu at Momofuku Las Vegas
Chef Michael Rubinstein talks about the new lunch menu at Momofuku. (Al Mancini/Las Vegas Review-Journal)
The Cube by Nanotak at Intersect Festival - VIDEO
The cube synced with driving electronic music and glowed with LEDs that twinkled along the cube’s lines. (Janna Karel Las Vegas Review-Journal)
Elvis Presley tribute artist Trent Carlini dies - VIDEO
Trent Carlini, a renowned Elvis Presley tribute artist who performed at several Las Vegas resorts for almost 30 years, has died. Clark County officials confirmed Carlini died on Sunday, Dec. 8, 2019, at a Las Vegas hospital. (Las Vegas Review-Journal)
Intersect drone light show - VIDEO
The Intersect Music Festival in Las Vegas featured a special drone light show. (Samia DeCubas)
Shirley Chung is “coming home” for Paired dinner
Celebrity chef Shirley Chung is back in Las Vegas to co-host a sold out collaborative dinner Saturday night at Red Plate in The Cosmopolitan of Las Vegas. (Al Mancini/Las Vegas Review-Journal)
Dandelion Chocolate opening at The Venetian
San Francisco’s Dandelion Chocolate will open its first Las Vegas café and retail store in The Venetian on Saturday. To celebrate, they’ll be offering guests free hot chocolate. (Al Mancini/Las Vegas Review-Journal)
Lbertine Social’s Pastrami Feast
Libertine Social's massive, house-made short-rib pastrami for $175 latter consists of three bones of short rib brined for seven days, smoked for six hours and cooked sous vide for two days before it’s finished in the restaurant’s pizza oven to give it a bark. It’s then carved and presented tableside with an assortment of sides and lettuce for making wraps. What’s “leftover” is then returned to the kitchen and prepared as Reuben sandwiches.
Ellis Island unveils The Front Yard
Ellis Island’s marketing director Christina Ellis talks about the new addition of the Front Yard. (Al Mancini/Las Vegas Review-Journal)
THE LATEST
Things to do this week in Las Vegas

Looking for something to do in the Las Vegas Valley? We’ve got you covered. Check out our best bets for the weekend and week ahead.

 
‘Joker’ tops Oscar nominations with 11; 3 other movies get 10

Female filmmakers were shut out, “Parasite” made history and “The Joker” just edged out “The Irishman,” “1917” and “Once Upon a Time … in Hollywood” in Monday’s Oscar nominations.

Oscar nominations to be revealed Monday, here’s what to expect

The nominations, to be read by Issa Rae and John Cho, will be live streamed on Oscar.com, Oscars.org and the academy’s digital social platforms. The second wave of nominees will begin at 5:30 a.m. PST and be carried live on “Good Morning America.”

‘1917’ races past ‘Star Wars’ to claim top spot in box office

Director Sam Mendes’ World War I story “1917” brought in $36.5 million in its first weekend of wide release, easily topping the box office and ending the three-week reign of “Star Wars: The Rise of Skywalker,” which brought in $15 million

Things to do this week

Looking for something to do in the Las Vegas Valley? We’ve got you covered. Check out our best bets for the weekend and week ahead.