Artificial intelligence pioneer says humans must teach machines

Updated August 21, 2017 - 11:38 am

PALO ALTO, Calif. — Andrew Ng has led teams at Google and Baidu that have gone on to create self-learning computer programs used by hundreds of millions of people, including email spam filters and touch-screen keyboards that make typing easier by predicting what you might want to say next.

As a way to get machines to learn without supervision, he has trained them to recognize cats in YouTube videos without being told what cats were. And he revolutionized this field, known as artificial intelligence, by adopting graphics chips meant for video games.

To push the boundaries of artificial intelligence further, one of the world’s most renowned researchers in the field says many more humans need to get involved. So his focus now is on teaching the next generation of AI specialists to teach the machines.

Nearly 2 million people around the globe have taken Ng’s online course on machine learning. In his videos, the lanky, 6-foot-1 Briton of Hong Kong and Singaporean upbringing speaks with a difficult-to-place accent. He often tries to get students comfortable with mind-boggling concepts by acknowledging up front, in essence, that “hey, this stuff is tough.”

Ng sees AI as a way to “free humanity from repetitive mental drudgery.” He has said he sees AI changing virtually every industry, and any task that takes less than a second of thought will eventually be done by machines. He once said famously that the only job that might not be changed is his hairdresser’s — to which a friend of his responded that in fact, she could get a robot to do his hair.

At the end of a 90-minute interview in his sparse office in Palo Alto, California, he reveals what’s partially behind his ambition.

“Life is shockingly short,” the 41-year-old computer scientist says, swiveling his laptop into view. He’s calculated in a Chrome browser window how many days we have from birth to death: a little more than 27,000. “I don’t want to waste that many days.”

Building brains as a teen

An upstart programmer by age 6, Ng learned coding early from his father, a medical doctor who tried to program a computer to diagnose patients using data. “At his urging,” Ng says, he fiddled with these concepts on his home computer. At age 16, he wrote a program to calculate trigonometric functions like sine and cosine using a “neural network” — the core computing engine of artificial intelligence modeled on the human brain.

“It seemed really amazing that you could write a few lines of code and have it learn to do interesting things,” he said.

After graduating high school from Singapore’s Raffles Institution, Ng made the rounds of Carnegie Mellon, MIT and Berkeley before taking up residence as a professor at Stanford University.

There, he taught robotic helicopters to do aerial acrobatics after being trained by an expert pilot. The work was “inspiring and exciting,” recalls Pieter Abbeel, then one of Ng’s doctoral students and now a computer scientist at Berkeley.

Abbeel says he once crashed a $10,000 helicopter drone, but Ng brushed it off. “Andrew was always like, ‘If these things are too simple, everybody else could do them.’”

The mark of Ng

Ng’s standout AI work involved finding a new way to supercharge neural networks using chips most often found in video-game machines.

Until then, computer scientists had mostly relied on general-purpose processors — like the Intel chips that still run many PCs. Such chips can handle only a few computing tasks simultaneously, but make up for it with blazing speed. Neural networks, however, work much better if they can run thousands of calculations simultaneously. That turned out to be a task eminently suited for a different class of chips called graphics processing units, or GPUs.

So when graphics chip maker Nvidia opened up its GPUs for general purposes beyond video games in 2007, Ng jumped on the technology. His Stanford team began publishing papers on the technique a year later, speeding up machine learning by as much as 70 times.

Geoffrey Hinton, whose University of Toronto team wowed peers by using a neural network to win the prestigious ImageNet competition in 2012, credits Ng with persuading him to use the technique. That win spawned a flurry of copycats, giving birth to the rise of modern AI.

“Several different people suggested using GPUs,” Hinton says by email. But the work by Ng’s team, he says, “was what convinced me.”

 

Teaching how to teach computers

Ng’s fascination with AI was paralleled by a desire to share his knowledge with students. As online education took off earlier this decade, Ng discovered a natural outlet.

His “Machine Learning” course, which kicked off Stanford’s online learning program alongside two other courses in 2011, immediately signed up 100,000 people without any marketing effort.

A year later, he co-founded the online-learning startup Coursera. More recently, he left his high-profile job at Baidu to launch deeplearning.ai , a startup that produces AI-training courses.

Every time he’s started something big, whether it’s Coursera, the Google Brain deep learning unit, or Baidu’s AI lab, he has left once he felt the teams he has built can carry on without him.

“Then you go, ‘Great. It’s thriving with or without me,’” says Ng, who continues to teach at Stanford while working in private industry.

For Ng, one of his next challenges might include having a child with his roboticist wife, Carol Reiley. “I wish we knew how children (or even a pet dog) learns,” Ng says in an email follow-up. “None of us today know how to get computers to learn with the speed and flexibility of a child.”

News
Nature Conservancy Ranch
The Nature Conservancy just bought the 900-acre 7J Ranch at the headwaters of the Amargosa River, north of Beatty. The property could become a research station, though ranching will continue.
Swift water rescue at Durango Wash in Las Vegas
On Thursday, February 14, 2019, at approximately 8:42 a.m., the Clark County Fire Department responded to a report of a swift water incident where people were trapped in the Durango wash which is located near 8771 Halcon Ave. Personnel found one person who was trapped in the flood channel. The individual was transported to the hospital in stable condition. Video by Clark County Fire & Rescue.
Flooding at E Cheyenne in N. Las Vegas Blvd.
Quick Weather Around the Strip
Rain hits Las Vegas, but that doesn't stop people from heading out to the Strip. (Mat Luschek/Review-Journal)
Aaron Semas, professional bull rider, talks about his traumatic brain injuries
Aaron Semas, professional bull rider, talks about his traumatic brain injuries. The Cleveland Clinic will begin researching the brains of retired bull riders to understand the impact traumatic brain injuries have on cognition. (Bizuayehu Tesfaye/ Las Vegas Review-Journal) @bizutesfaye
Matt Stutzman shoots arrows with his feet
Matt Stutzman who was born without arms shoots arrows with his feet and hits the bullseye with remarkable accuracy. (Bizuayehu Tesfaye/Las Vegas Review-Journal) @bizutesfaye
Secretary of Air Force Emphasizes the Importance of Nellis AFB
US Secretary of the Air Force Heather Wilson visited Nellis Air Force Base during Red Flag training and described how important the base is to the military.
Former Northwest Academy student speaks out
Tanner Reynolds, 13, with his mother Angela McDonald, speaks out on his experience as a former student of Northwest Academy in Amargosa Valley, which includes abuse by staff member Caleb Michael Hill. Hill, 29, was arrested Jan. 29 by the Nye County Sheriff’s Office on suspicion of child abuse.
Former Northwest Academy students speak out
Tristan Groom, 15, and his brother Jade Gaastra, 23, speak out on their experiences as former students of Northwest Academy in Amargosa Valley, which includes abuse by staff and excessive medication.
Disruption At Metro PD OIS Presser
A man claiming to be part of the press refused to leave a press conference at Metro police headquarters, Wednesday January 30, 2019. Officers were forced to physically remove the man. (Mat Luschek/Review-Journal)
Clients at Las Vegas’ Homeless Courtyard talk about their experience
Clients at Las Vegas’ Homeless Courtyard talk about their experience after the city began operating around the clock. (Bizuayehu Tesfaye/Las Vegas Review-Journal) @bizutesfaye
Las Vegas parts ways with operator of homeless courtyard
Jocelyn Bluitt-Fisher discusses the transition between operators of the homeless courtyard in Las Vegas, Thursday Jan. 24, 2019.(Caroline Brehman/Las Vegas Review-Journal)
Las Vegas police and Raiders partner with SafeNest
Las Vegas police and the Raiders partner with SafeNest on Project Safe 417 (the police code for domestic violence is 417). The program partners trained SafeNest volunteer advocates with Metropolitan Police Department officers dispatched to domestic violence calls, allowing advocates to provide immediate crisis advocacy to victims at the scene of those calls. (K.M. Cannon/Las Vegas Review-Journal) @KMCannonPhoto
North Las Vegas police chief discusses officer-involved shooting
North Las Vegas police chief Pamela Ojeda held a press conference Thursday, Jan. 24, regarding an officer-involved shooting that took place on Jan. 21. The incident resulted in the killing of suspect Horacio Ruiz-Rodriguez. (Mat Luschek/Las Vegas Review-Journal)
Volunteers gather for annual Clark County homeless count
Volunteers gather for the annual Southern Nevada Homeless Census, Tuesday, Jan. 22, 2019. (Chase Stevens/Las Vegas Review-Journal)
Who can understand hospital price lists?
Lists of costs for procedures, drugs and devices are now posted the websites of hospitals to comply with a new federal rule designed to provide additional consumer transparency. Good luck figuring out what they mean.
People in Mesquite deal with a massive power outage
People in Mesquite respond to a major power outage in the area on Monday, Jan. 21, 2019. (Mat Luschek/Las Vegas Review-Journal)
Group helping stranded motorists during power outage
A group of Good Samaritans are offering free gas to people in need at the Glendale AM/PM, during a massive power outage near Mesquite on Monday, Jan. 21, 2019. (Mat Luschek/Las Vegas Review-Journal)
U.S. Sen. Jacky Rosen falls at Las Vegas parade
U.S. Sen. Jacky Rosen of Nevada fell and injured her wrist at the Martin Luther King Day parade in Las Vegas on Monday, Jan. 21, 2019. (Nathan Asselin/Las Vegas Review-Journal)
Local astronomers host super blood wolf moon viewing
The Las Vegas Astronomical Society paired with the College of Southern Nevada to host a lunar eclipse viewing Sunday night. Known as the super blood wolf moon, the astronomical event won't occur for another 18 years. (Rachel Aston/Las Vegas Review-Journal) @rookie__rae
Tate Elementary shows academic progress after categorical funding
Students at Tate Elementary in Las Vegas has benefited from a program to boost education funding in targeted student populations, known as categorical funding. One program called Zoom helps students who have fallen below grade level in reading. (K.M. Cannon/Las Vegas Review-Journal) @KMCannonPhoto
The third annual Women’s March in Las Vegas
The third annual Women’s March in Las Vegas. (Bizuayehu Tesfaye/Las Vegas Review-Journal) @btesfaye
First former felon to work for Nevada Department of Corrections
After his father died, Michael Russell struggled for years with drug addiction. When he finally decided to change for good, he got sober and worked for years to help others. Now he is the first former felon to be hired by the Nevada Department of Corrections. (Rachel Aston/Las Vegas Review-Journal) @rookie__rae
Three Square helps TSA workers
Three Square Food Bank donated over 400 care bags to TSA workers affected by the government shutdown Wednesday, filled with food, personal hygiene products and water.
Las Vegas furniture store donates to Clark County firehouses
Walker Furniture donated new mattresses to all 30 Clark County firehouses in the Las Vegas Valley, starting today with Station 22. (Mat Luschek/Las Vegas Review-Journal)
Mount Charleston Gets Heavy Snow, Fog
Mount Charleston saw heavy snow today, and fog in lower elevations as a cold front swept across the Las Vegas Valley. (Benjamin Hager/Las Vegas Review-Journal)
Krystal Whipple arrested in Arizona
Krystal Whipple, charged in the killing of a Las Vegas nail salon manager over a $35 manicure, is expected to return to Nevada to face a murder charge.
Holocaust survivor on acceptance
Holocaust survivor Celina Karp Biniaz, who was the youngest person on Schindler’s List, talks about the most important message for people to understand from her life and experiences.
Holocaust survivor speaks about telling her story
Holocaust survivor Celina Karp Biniaz, who was the youngest person on Schindler’s List, tells of opening up about her experiences during Sunday’s event at Temple Sinai.
Jesus Jara State of the Schools address
Clark County School District Superintendent Jesus Jara delivers his State of the Schools address on Friday, Jan. 11, 2019. (Amelia Pak-Harvey/Las Vegas Review-Journal)
ad-high_impact_4
TOP NEWS
News Headlines
Home Front Page Footer Listing
You May Like

You May Like