Active Learning

The Basic Idea

Although at first glance it may appear as though artificial intelligence (AI) automatically knows everything, this couldn’t be further from the truth. Just like humans, AI goes through a rigorous learning process known as machine learning. Yes, computers have to do homework too. 

There are three different types of machine learning: supervised learning, unsupervised learning, and reinforcement learning. Active learning is a type of iterative supervised learning in which a learning algorithm can request a human user to label data with the desired outputs.

Unlike traditional supervised learning approaches, where the algorithm learns from a static dataset, active learning involves dynamically selecting instances (individual data points) from a larger pool of unlabeled data for annotation or labeling by an oracle (usually a human expert). Active learning is a type of human-in-the-loop model because it relies on human interaction and input. 

Ghassemi, F. (2023, June 26). Active Learning (ultimate guide). Medium. https://medium.com/@farnazgh73/ultimate-guide-for-active-learning-main-approaches-3cf53ce207f0

Let’s look at a simple example. Imagine you’re teaching a computer to recognize cats in pictures. Normally, you’d show the computer lots of labeled pictures of cats and non-cats so it can learn. But what if labeling those pictures is too time-consuming or expensive?

Active learning is like having a smart system that already knows which pictures would teach the computer the most. Instead of just showing random pictures, the system identifies ones it’s unsure about and asks a human to label only those. The computer then learns from those labeled examples and gets better at recognizing cats.

So, active learning helps the computer learn faster and with less effort by focusing on the most helpful examples for learning, similar to a tutor who knows exactly which questions to ask to help a student understand better.

The fundamental principle behind active learning is that the machine learning algorithm learns better and with less training when it gets to choose the data from which it wants to learn. In other words, by being active, curious, and exploratory.

It’s a bit like a child independently deciding which books or websites they explore in learning about the planets and outer space. Not all educational resources are useful or desirable to a child; an adult encyclopedia is useless to a pre-schooler who prefers to learn from an interactive app. The same idea can be applied to active learning; not all data points are equally important for training a model.  

In fact, active learning in AI follows the same principles as inquiry-based learning in human education. Based on American educator John Dewey’s philosophy that education begins with the curiosity of the learner,1 inquiry-based learning aims to spark inquisitiveness in the learner. The inquiry-based approach encourages students to ask questions, explore new ideas, and conduct independent research, all with the objective of enhancing engagement and information retention. Just like a child might ask their teacher questions about a new topic, active learning queries a human oracle when it encounters unknown data. 

So, what’s the end goal of all this? The main objective of both human inquiry-based learning and AI active learning is that the student—be it a nine-year-old girl or a computer—eventually has the ability to learn on their own without outside help. In other words, to produce independent learners

“Learning is not the product of teaching. Learning is the product of the activity of learners.”


John Dewey

About the Author

Dr. Lauren Braithwaite

Dr. Lauren Braithwaite

Dr. Lauren Braithwaite is a Social and Behaviour Change Design and Partnerships consultant working in the international development sector. Lauren has worked with education programmes in Afghanistan, Australia, Mexico, and Rwanda, and from 2017–2019 she was Artistic Director of the Afghan Women’s Orchestra. Lauren earned her PhD in Education and MSc in Musicology from the University of Oxford, and her BA in Music from the University of Cambridge. When she’s not putting pen to paper, Lauren enjoys running marathons and spending time with her two dogs.

About us

We are the leading applied research & innovation consultancy

Our insights are leveraged by the most ambitious organizations

Image

I was blown away with their application and translation of behavioral science into practice. They took a very complex ecosystem and created a series of interventions using an innovative mix of the latest research and creative client co-creation. I was so impressed at the final product they created, which was hugely comprehensive despite the large scope of the client being of the world's most far-reaching and best known consumer brands. I'm excited to see what we can create together in the future.

Heather McKee

BEHAVIORAL SCIENTIST

GLOBAL COFFEEHOUSE CHAIN PROJECT

OUR CLIENT SUCCESS

$0M

Annual Revenue Increase

By launching a behavioral science practice at the core of the organization, we helped one of the largest insurers in North America realize $30M increase in annual revenue.

0%

Increase in Monthly Users

By redesigning North America's first national digital platform for mental health, we achieved a 52% lift in monthly users and an 83% improvement on clinical assessment.

0%

Reduction In Design Time

By designing a new process and getting buy-in from the C-Suite team, we helped one of the largest smartphone manufacturers in the world reduce software design time by 75%.

0%

Reduction in Client Drop-Off

By implementing targeted nudges based on proactive interventions, we reduced drop-off rates for 450,000 clients belonging to USA's oldest debt consolidation organizations by 46%

Read Next

Notes illustration

Eager to learn about how behavioral science can help your organization?