How to pronounce "badges"

Khan Academy is most known for its collection of videos,

so before I go any further,

let me show you a little bit of a montage.

(Video) Salman Khan: So the hypotenuse is now going to be five.

This animal's fossils are only found in this area of South America --

a nice clean band here --

and this part of Africa.

We can integrate over the surface,

and the notation usually is a capital sigma.

National Assembly: They create the Committee of Public Safety,

which sounds like a very nice committee.

Notice, this is an aldehyde, and it's an alcohol.

Start differentiating into effector and memory cells.

A galaxy. Hey! There's another galaxy. Oh, look! There's another galaxy.

And for dollars, is their 30 million,

plus the 20 million dollars from the American manufacturer.

If this does not blow your mind,

then you have no emotion.

(Laughter)

(Applause)

(Live) SK: We now have on the order of 2,200 videos,

covering everything from basic arithmetic, all the way to vector calculus,

and some of the stuff that you saw up there.

We have a million students a month using the site,

watching on the order of 100 to 200,000 videos a day.

But what we're going to talk about in this is how we're going to the next level.

But before I do that,

I want to talk a little bit about really just how I got started.

And some of you all might know,

about five years ago, I was an analyst at a hedge fund,

and I was in Boston,

and I was tutoring my cousins in New Orleans, remotely.

And I started putting the first YouTube videos up,

really just as a kind of nice-to-have,

just kind of a supplement for my cousins,

something that might give them a refresher or something.

And as soon as I put those first YouTube videos up,

something interesting happened.

Actually, a bunch of interesting things happened.

The first was the feedback from my cousins.

They told me that they preferred me on YouTube than in person.

(Laughter)

And once you get over the backhanded nature of that,

there was actually something very profound there.

They were saying that they preferred the automated version of their cousin

to their cousin.

At first it's very unintuitive,

but when you think about it from their point of view, it makes a ton of sense.

You have this situation where now they can pause and repeat their cousin,

without feeling like they're wasting my time.

If they have to review something

that they should have learned a couple of weeks ago,

or maybe a couple of years ago,

they don't have to be embarrassed and ask their cousin.

They can just watch those videos; if they're bored, they can go ahead.

They can watch at their own time and pace.

Probably the least-appreciated aspect of this

is the notion that the very first time

that you're trying to get your brain around a new concept,

the very last thing you need

is another human being saying, "Do you understand this?"

And that's what was happening

with the interaction with my cousins before,

and now they can just do it in the intimacy of their own room.

The other thing that happened is --

I put them on YouTube just --

I saw no reason to make it private,

so I let other people watch it,

and then people started stumbling on it,

and I started getting some comments and some letters

and all sorts of feedback

from random people around the world.

These are just a few.

This is actually from one of the original calculus videos.

Someone wrote it on YouTube, it was a YouTube comment:

"First time I smiled doing a derivative."

(Laughter)

Let's pause here.

This person did a derivative,

and then they smiled.

(Laughter)

In response to that same comment --

this is on the thread, you can go on YouTube and look at the comments --

someone else wrote: "Same thing here.

I actually got a natural high and a good mood for the entire day,

since I remember seeing all of this matrix text in class,

and here I'm all like, 'I know kung fu.'"

(Laughter)

We get a lot of feedback along those lines.

This clearly was helping people.

But then, as the viewership kept growing and kept growing,

I started getting letters from people,

and it was starting to become clear

that it was more than just a nice-to-have.

This is just an excerpt from one of those letters:

"My 12 year-old son has autism,

and has had a terrible time with math.

We have tried everything,

viewed everything, bought everything.

We stumbled on your video on decimals, and it got through.

Then we went on to the dreaded fractions.

Again, he got it.

We could not believe it.

He is so excited."

And so you can imagine,

here I was, an analyst at a hedge fund --

it was very strange for me to do something of social value.

(Laughter)

(Applause)

But I was excited, so I kept going.

And then a few other things started to dawn on me;

that not only would it help my cousins right now,

or these people who were sending letters,

but that this content will never grow old,

that it could help their kids or their grandkids.

If Isaac Newton had done YouTube videos on calculus,

I wouldn't have to.

(Laughter)

Assuming he was good. We don't know.

(Laughter)

The other thing that happened -- and even at this point, I said,

"OK, maybe it's a good supplement. It's good for motivated students.

It's good for maybe home-schoolers."

But I didn't think it would somehow penetrate the classroom.

Then I started getting letters from teachers,

and the teachers would write, saying,

"We've used your videos to flip the classroom.

You've given the lectures, so now what we do --"

And this could happen in every classroom in America tomorrow --

"what I do is I assign the lectures for homework,

and what used to be homework,

I now have the students doing in the classroom."

And I want to pause here --

(Applause)

I want to pause here, because there's a couple of interesting things.

One, when those teachers are doing that,

there's the obvious benefit --

the benefit that now their students

can enjoy the videos in the way that my cousins did,

they can pause, repeat at their own pace, at their own time.

But the more interesting thing -- and this is the unintuitive thing

when you talk about technology in the classroom --

by removing the one-size-fits-all lecture from the classroom,

and letting students have a self-paced lecture at home,

then when you go to the classroom,

letting them do work, having the teacher walk around,

having the peers actually be able to interact with each other,

these teachers have used technology to humanize the classroom.

They took a fundamentally dehumanizing experience --

30 kids with their fingers on their lips,

not allowed to interact with each other.

A teacher, no matter how good,

has to give this one-size-fits-all lecture to 30 students --

blank faces, slightly antagonistic --

and now it's a human experience,

now they're actually interacting with each other.

So once the Khan Academy --

I quit my job,

and we turned into a real organization --

we're a not-for-profit --

the question is, how do we take this to the next level?

How do we take what those teachers were doing to its natural conclusion?

And so, what I'm showing over here,

these are actual exercises

that I started writing for my cousins.

The ones I started were much more primitive.

This is a more competent version of it.

But the paradigm here is, we'll generate as many questions as you need,

until you get that concept, until you get 10 in a row.

And the Khan Academy videos are there.

You get hints, the actual steps for that problem,

if you don't know how to do it.

The paradigm here seems like a very simple thing:

10 in a row, you move on.

But it's fundamentally different

than what's happening in classrooms right now.

In a traditional classroom,

you have homework, lecture, homework, lecture,

and then you have a snapshot exam.

And that exam, whether you get a 70 percent, an 80 percent,

a 90 percent or a 95 percent,

the class moves on to the next topic.

And even that 95 percent student --

what was the five percent they didn't know?

Maybe they didn't know what happens when you raise something to the zeroth power.

Then you build on that in the next concept.

That's analogous to -- imagine learning to ride a bicycle.

Maybe I give you a lecture ahead of time,

and I give you a bicycle for two weeks, then I come back after two weeks,

and say, "Well, let's see. You're having trouble taking left turns.

You can't quite stop. You're an 80 percent bicyclist."

So I put a big "C" stamp on your forehead --

(Laughter)

and then I say, "Here's a unicycle."

(Laughter)

But as ridiculous as that sounds,

that's exactly what's happening in our classrooms right now.

And the idea is you fast forward

and good students start failing algebra all of the sudden,

and start failing calculus all of the sudden,

despite being smart, despite having good teachers,

and it's usually because they have these Swiss cheese gaps

that kept building throughout their foundation.

So our model is: learn math the way you'd learn anything,

like riding a bicycle.

Stay on that bicycle. Fall off that bicycle.

Do it as long as necessary, until you have mastery.

The traditional model,

it penalizes you for experimentation and failure,

but it does not expect mastery.

We encourage you to experiment. We encourage you to fail.

But we do expect mastery.

This is just another one of the modules.

This is trigonometry.

This is shifting and reflecting functions.

And they all fit together.

We have about 90 of these right now.

You can go to the site right now,

it's all free, not trying to sell anything.

But the general idea is that they all fit into this knowledge map.

That top node right there, that's literally single-digit addition,

it's like one plus one is equal to two.

The paradigm is, once you get 10 in a row on that,

it keeps forwarding you to more and more advanced modules.

Further down the knowledge map,

we're getting into more advanced arithmetic.

Further down, you start getting into pre-algebra and early algebra.

Further down, you start getting into algebra one, algebra two,

a little bit of precalculus.

And the idea is, from this we can actually teach everything --

well, everything that can be taught in this type of a framework.

So you can imagine -- and this is what we are working on --

from this knowledge map, you have logic, you have computer programming,

you have grammar, you have genetics,

all based off of that core of, if you know this and that,

now you're ready for this next concept.

Now that can work well for an individual learner,

and I encourage you to do it with your kids,

but I also encourage everyone in the audience to do it yourself.

It'll change what happens at the dinner table.

But what we want to do

is use the natural conclusion of the flipping of the classroom

that those early teachers had emailed me about.

And so what I'm showing you here,

this is data from a pilot in the Los Altos school district,

where they took two fifth-grade classes and two seventh-grade classes,

and completely gutted their old math curriculum.

These kids aren't using textbooks, or getting one-size-fits-all lectures.

They're doing Khan Academy, that software, for roughly half of their math class.

I want to be clear: we don't view this as a complete math education.

What it does is -- this is what's happening in Los Altos --

it frees up time -- it's the blocking and tackling,

making sure you know how to move through a system of equations,

and it frees up time for the simulations, for the games,

for the mechanics, for the robot-building,

for the estimating how high that hill is based on its shadow.

And so the paradigm is the teacher walks in every day,

every kid works at their own pace --

this is actually a live dashboard from the Los Altos school district --

and they look at this dashboard.

Every row is a student.

Every column is one of those concepts.

Green means the student's already proficient.

Blue means they're working on it -- no need to worry.

Red means they're stuck.

And what the teacher does is literally just say,

"Let me intervene on the red kids."

Or even better, "Let me get one of the green kids,

who are already proficient in that concept,

to be the first line of attack, and actually tutor their peer."

(Applause)

Now, I come from a very data-centric reality,

so we don't want that teacher to even go and intervene

and have to ask the kid awkward questions:

"What don't you understand? What do you understand?" and all the rest.

So our paradigm is to arm teachers with as much data as possible --

data that, in any other field, is expected,

in finance, marketing, manufacturing --

so the teachers can diagnose what's wrong with the students

so they can make their interaction as productive as possible.

Now teachers know exactly what the students have been up to,

how long they've spent each day, what videos they've watched,

when did they pause the videos, what did they stop watching,

what exercises are they using, what have they focused on?

The outer circle shows what exercises they were focused on.

The inner circle shows the videos they're focused on.

The data gets pretty granular,

so you can see the exact problems the student got right or wrong.

Red is wrong, blue is right.

The leftmost question is the first one the student attempted.

They watched the video over there.

And you can see, eventually they were able to get 10 in a row.

It's almost like you can see them learning over those last 10 problems.

They also got faster -- the height is how long it took them.

When you talk about self-paced learning, it makes sense for everyone --

in education-speak, "differentiated learning" --

but it's kind of crazy, what happens when you see it in a classroom.

Because every time we've done this, in every classroom we've done,

over and over again, if you go five days into it,

there's a group of kids who've raced ahead

and a group who are a little bit slower.

In a traditional model, in a snapshot assessment,

you say, "These are the gifted kids, these are the slow kids.

Maybe they should be tracked differently.

Maybe we should put them in different classes."

But when you let students work at their own pace --

we see it over and over again --

you see students who took a little bit extra time

on one concept or the other,

but once they get through that concept,

they just race ahead.

And so the same kids that you thought were slow six weeks ago,

you now would think are gifted.

And we're seeing it over and over again.

It makes you really wonder

how much all of the labels maybe a lot of us have benefited from

were really just due to a coincidence of time.

Now as valuable as something like this is in a district like Los Altos,

our goal is to use technology

to humanize, not just in Los Altos, but on a global scale,

what's happening in education.

And that brings up an interesting point.

A lot of the effort in humanizing the classroom

is focused on student-to-teacher ratios.

In our mind, the relevant metric is:

student-to-valuable-human-time- with-the-teacher ratio.

So in a traditional model, most of the teacher's time

is spent doing lectures and grading and whatnot.

Maybe five percent of their time is sitting next to students

and working with them.

Now, 100 percent of their time is.

So once again, using technology, not just flipping the classroom,

you're humanizing the classroom, I'd argue,

by a factor of five or 10.

As valuable as that is in Los Altos,

imagine what it does to the adult learner,

who's embarrassed to go back and learn stuff

they should have known before going back to college.

Imagine what it does to a street kid in Calcutta,

who has to help his family during the day,

and that's the reason he or she can't go to school.

Now they can spend two hours a day and remediate,

or get up to speed and not feel embarrassed

about what they do or don't know.

Now imagine what happens where --

we talked about the peers teaching each other

inside of a classroom.

But this is all one system.

There's no reason why you can't have that peer-to-peer tutoring

beyond that one classroom.

Imagine what happens if that student in Calcutta

all of the sudden can tutor your son,

or your son can tutor that kid in Calcutta.

And I think what you'll see emerging

is this notion of a global one-world classroom.

And that's essentially what we're trying to build.

Thank you.

(Applause)

Bill Gates: I'll ask about two or three questions.

Salman Khan: Oh, OK.

(Applause continues)

(Applause ends)

BG: I've seen some things you're doing in the system,

that have to do with motivation and feedback --

energy points, merit badges.

Tell me what you're thinking there.

SK: Oh yeah. No, we have an awesome team working on it.

I have to be clear, it's not just me anymore.

I'm still doing all the videos,

but we have a rock-star team doing the software.

We've put a bunch of game mechanics in there, where you get badges,

we're going to start having leader boards by area, you get points.

It's actually been pretty interesting.

Just the wording of the badging,

or how many points you get for doing something,

we see on a system-wide basis,

like tens of thousands of fifth-graders or sixth-graders

going one direction or another, depending what badge you give them.

(Laughter)

BG: And the collaboration you're doing with Los Altos,

how did that come about?

SK: Los Altos, it was kind of crazy.

Once again, I didn't expect it to be used in classrooms.

Someone from their board came and said,

"What would you do if you had carte Blanche in a classroom?"

I said, "Well, every student would work at their own pace,

on something like this, we'd give a dashboard."

They said, "This is kind of radical. We have to think about it."

Me and the rest of the team were like, "They're never going to want to do this."

But literally the next day they were like, "Can you start in two weeks?"

(Laughter)

BG: So fifth-grade math is where that's going on right now?

SK: It's two fifth-grade classes and two seventh-grade classes.

They're doing it at the district level.

I think what they're excited about is they can follow these kids,

not only in school; on Christmas, we saw some of the kids were doing it.

We can track everything, track them as they go through the entire district.

Through the summers, as they go from one teacher to the next,

you have this continuity of data that even at the district level, they can see.

BG: So some of those views we saw were for the teacher

to go in and track actually what's going on with those kids.

So you're getting feedback on those teacher views

to see what they think they need?

SK: Oh yeah. Most of those were specs by the teachers.

We made some of those for students so they could see their data,

but we have a very tight design loop with the teachers themselves.

And they're saying, "Hey, this is nice, but --"

Like that focus graph, a lot of the teachers said,

"I have a feeling a lot of the kids are jumping around

and not focusing on one topic."

So we made that focus diagram.

So it's all been teacher-driven. It's been pretty crazy.

BG: Is this ready for prime time?

Do you think a lot of classes next school year should try this thing out?

SK: Yeah, it's ready.

We've got a million people on the site already,

so we can handle a few more.

(Laughter)

No, no reason why it really can't happen

in every classroom in America tomorrow.

BG: And the vision of the tutoring thing.

The idea there is, if I'm confused about a topic,

somehow right in the user interface,

I'd find people who are volunteering,

maybe see their reputation,

and I could schedule and connect up with those people?

SK: Absolutely. And this is something I recommend everyone in this audience do.

Those dashboards the teachers have, you can go log in right now

and you can essentially become a coach

for your kids, your nephews, your cousins,

or maybe some kids at the Boys and Girls Club.

And yeah, you can start becoming a mentor, a tutor,

really immediately.

But yeah, it's all there.

BG: Well, it's amazing.

I think you just got a glimpse of the future of education.

BG: Thank you. SK: Thank you.

(Applause)