A Framework for Deep Quantification Learning

• Published in: Machine Learning and Knowledge Discovery in Databases Vol. 12457; pp. 232 - 248
• Main Authors: Qi, Lei, Khaleel, Mohammed, Tavanapong, Wallapak, Sukul, Adisak, Peterson, David
• Format: Book Chapter
• Language: English
• Published: Switzerland Springer International Publishing AG 2021; Springer International Publishing
• Series: Lecture Notes in Computer Science
• Subjects: Class distribution estimate; Deep learning; Quantification learning
• ISBN: 9783030676575; 3030676579
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-030-67658-2_14

A quantification learning task estimates class ratios or class distribution given a test set. Quantification learning is useful for a variety of application domains such as commerce, public health, and politics. For instance, it is desirable to automatically estimate the proportion of customer satisfaction in different aspects from product reviews to improve customer relationships. We formulate the quantification learning problem as a maximum likelihood problem and propose the first end-to-end Deep Quantification Network (DQN) framework. DQN jointly learns quantification feature representations and directly predicts the class distribution. Compared to classification-based quantification methods, DQN avoids three separate steps: classification of individual instances, calculation of the predicted class ratios, and class ratio adjustment to account for classification errors. We evaluated DQN on four public datasets, ranging from movie and product reviews to multi-class news. We compared DQN against six existing quantification methods and conducted a sensitivity analysis of DQN performance. Compared to the best existing method in our study, (1) DQN reduces Mean Absolute Error (MAE) by about 35%. (2) DQN uses around 40% less training samples to achieve a comparable MAE.