Recommending Movies Using Affinity Analysis | Learning Data Mining with Python

Sign In Start Free Trial

Book Overview & Buying
Table Of Contents
Feedback & Rating

Learning Data Mining with Python

By : Robert Layton

3.7 (7)

Learning Data Mining with Python

3.7 (7)

By: Robert Layton

Overview of this book

If you are a programmer who wants to get started with data mining, then this book is for you.

Learning Data Mining with Python

Learning Data Mining with Python

Credits

Credits

About the Author

About the Author

About the Reviewers

About the Reviewers

www.PacktPub.com

www.PacktPub.com

Preface

Preface

Free Chapter

Getting Started with Data Mining

Getting Started with Data Mining

Introducing data mining

Using Python and the IPython Notebook

A simple affinity analysis example

A simple classification example

What is classification?

Summary

Classifying with scikit-learn Estimators

Classifying with scikit-learn Estimators

scikit-learn estimators

Preprocessing using pipelines

Pipelines

Summary

Predicting Sports Winners with Decision Trees

Predicting Sports Winners with Decision Trees

Loading the dataset

Decision trees

Sports outcome prediction

Random forests

Summary

Recommending Movies Using Affinity Analysis

Recommending Movies Using Affinity Analysis

Affinity analysis

The movie recommendation problem

The Apriori implementation

Extracting association rules

Summary

Extracting Features with Transformers

Extracting Features with Transformers

Feature extraction

Feature selection

Feature creation

Creating your own transformer

Summary

Social Media Insight Using Naive Bayes

Social Media Insight Using Naive Bayes

Disambiguation

Text transformers

Naive Bayes

Application

Summary

Discovering Accounts to Follow Using Graph Mining

Discovering Accounts to Follow Using Graph Mining

Loading the dataset

Finding subgraphs

Summary

Beating CAPTCHAs with Neural Networks

Beating CAPTCHAs with Neural Networks

Artificial neural networks

Creating the dataset

Training and classifying

Improving accuracy using a dictionary

Summary

Authorship Attribution

Authorship Attribution

Attributing documents to authors

Function words

Support vector machines

Character n-grams

Using the Enron dataset

Summary

Clustering News Articles

Clustering News Articles

Obtaining news articles

Extracting text from arbitrary websites

Grouping news articles

Clustering ensembles

Online learning

Summary

Classifying Objects in Images Using Deep Learning

Classifying Objects in Images Using Deep Learning

Object classification

Application scenario and goals

Deep neural networks

GPU optimization

Setting up the environment

Application

Summary

Working with Big Data

Working with Big Data

Big data

Application scenario and goals

MapReduce

Application

Summary

Next Steps…

Next Steps…

Chapter 1 – Getting Started with Data Mining

Chapter 2 – Classifying with scikit-learn Estimators

Chapter 3: Predicting Sports Winners with Decision Trees

Chapter 4 – Recommending Movies Using Affinity Analysis

Chapter 5 – Extracting Features with Transformers

Chapter 6 – Social Media Insight Using Naive Bayes

Chapter 7 – Discovering Accounts to Follow Using Graph Mining

Chapter 8 – Beating CAPTCHAs with Neural Networks

Chapter 9 – Authorship Attribution

Chapter 10 – Clustering News Articles

Chapter 11: Classifying Objects in Images Using Deep Learning

Chapter 12 – Working with Big Data

More resources

Index

Index

Customer Reviews

3.7 (7)

5 star

28.6%

4 star

28.6%

3 star

28.6%

2 star

14.3%

1 star

0

The Apriori implementation

The goal of this chapter is to produce rules of the following form: if a person recommends these movies, they will also recommend this movie. We will also discuss extensions where a person recommends a set of movies is likely to recommend another particular movie.

To do this, we first need to determine if a person recommends a movie. We can do this by creating a new feature Favorable, which is True if the person gave a favorable review to a movie:

all_ratings["Favorable"] = all_ratings["Rating"] > 3

We can see the new feature by viewing the dataset:

all_ratings[10:15]

	UserID	MovieID	Rating	Datetime	Favorable
10	62	257	2	1997-11-12 22:07:14	False
11	286	1014	5	1997-11-17 15:38:45	True
12	200	222	5	1997-10-05 09:05:40	True
13	210	40	3	1998-03-27 21:59:54	False
14	224	29	3	1998-02-21 23:40:57	False

We will sample our dataset to form a training dataset. This also helps reduce the size of the dataset that will be searched...

Search

Your notes and bookmarks