Efficiency and Effectiveness in Large-Scale Learning

Date:

Thesis Proposal

Efficiency and Effectiveness in Large-Scale Learning

Authors

Bingyu Wang

Abstract

In the past decade, the data have grown faster than ever across many domains. For example, in survival analysis, there are more than 60 million Medicare beneficiaries across 40 thousand ZIP Code areas in United States from 2000 to 2012, which is up to 5.7 billion person-months of follow-up. In multi-label classification, Wikipedia data contains more than 500 thousand labels, millions of features and instances. For many of such datasets, machine learning models are facing unprecedented challenges associated with effectiveness and efficiency in both time and memory. This thesis aims to develop learning models that scale well on large data while being able to maintain or even increase its level of performance based on the inherent structures of the dataset and learning algorithms. By working on the following key questions for each model: 1) how to adapt to the intrinsic structure of the dataset and 2) how to take into account the special design of the learning formula and algorithm, we develop state-of-the-art algorithms for both regression and classification problems, and scale such algorithms well on multiple real-world datasets, such as millions of Medicare enrollees in survival analysis, Wikipedia articles and Amazon products categorization in multi-label classification.

Thesis Committee

Javed A. Aslam (Advisor)

Javed Aslam is Bingyu’s PhD thesis advisor.

Virgil Pavlu (Faculty member)

Virgil Pavlu has expertise in machine learning, the subject of Bingyu’s proposed dissertation work, and he co-advises Bingyu.

Jennifer G. Dy (Faculty member)

Jennifer Dy (Professor of Electrical and Computer Engineering, Northeastern University) has deep expertise in machine learning, and she holds a courtesy appointment in Khoury College.

Helen H. Suh (External member from Tufts University)

Helen Suh (Professor of Civil and Environmental Engineering, Tufts University) has expertise in epidemiology, one of the application areas of Bingyu’s proposed dissertation work.