Training a Binary Classifier with the Quantum Adiabatic Algorithm
Description
This paper describes how to make the problem of binary classification amenable to
quantum computing. A formulation is employed in which the binary classifier is
constructed as a thresholded linear superposition of a set of weak classifiers. The
weights in the superposition are optimized in a learning process that strives to min-
imize the training error as well as the number of weak classifiers used. No efficient
solution to this problem is known. To bring it into a format that allows the applica-
tion of adiabatic quantum computing (AQC), we first show that the bit-precision
with which the weights need to be represented only grows logarithmically with the
ratio of the number of training examples to the number of weak classifiers. This
allows to effectively formulate the training process as a binary optimization prob-
lem. Solving it with heuristic solvers such as tabu search, we find that the resulting
classifier outperforms a widely used state-of-the-art method, AdaBoost, on a va-
riety of benchmark problems. Moreover, we discovered the interesting fact that
bit-constrained learning machines often exhibit lower generalization error rates.
Changing the loss function that measures the training error from 0-1 loss to least
squares maps the training to quadratic unconstrained binary optimization. This
corresponds to the format required by D-Wave’s implementation of AQC. Simu-
lations with heuristic solvers again yield results better than those obtained with
boosting approaches. Since the resulting quadratic binary program is NP-hard,
additional gains can be expected from applying the actual quantum processor.
| Slides | |
| 0:00 | Training a Binary Classifier with the Quantum Adiabatic Algorithm |
| 0:05 | Outline |
| 0:25 | Solving hard optimization problems using adiabatic quantum computing - 1 |
| 2:30 | Solving hard optimization problems using adiabatic quantum computing - 2 |
| 4:07 | The adiabatic theorem |
| 5:46 | Why bother using AQC? |
| 6:06 | D-Wave’s hardware - 1 |
| 7:22 | D-Wave’s hardware - 2 |
| 9:13 | Training a binary classifier |
| 10:54 | Hyperplanes |
| 11:17 | Hyperplanes in N = 3 |
| 12:42 | Modifications I: reduce bits to represent weights |
| 14:01 | Modifications II: quadratic loss |
| 14:57 | Implementation details: dictionaries |
| 15:48 | Implementation details: classical optimization methods |
| 17:19 | Experiments I: Synthetic data |
| 18:00 | Results for synthetic data with order 1 dictionary |
| 19:27 | Results for synthetic data with order 2 dictionary |
| 19:41 | Experiments II: Natural data |
| 20:10 | Conclusions |
Lecture rating
| People found this lecture: | ||
| Worth seeing | ||
| because it is: | ||
| Valuable and informative | ||
| Well presented | ||
| Easily understandable | ||
| Acceptably recorded | ||
| You need to login to cast your vote. | ||
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Related content
SEE ALSO:
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !




Ze 'excited state' schrinks ze more "th" is pronaunsd "z".