Multi-Task Learning in Click-through-Probability (Multi-CTP) Prediction for Real-World Digital Content Recommendation

Author(s)

Tu T, Chen L, Wang Y, Jin H, He W
IQVIA, Shanghai, China

Presentation Documents

OBJECTIVES: To develop a predictive deep learning model structure (Multi-CTP) to handle extreme sparse data, for the start stage of content recommendation in healthcare digital marketing and education. The multi-task learning approach alleviates the learning pressure and improves the performance of the recommendation system, by using existing data to build auxiliary tasks and models to provide better feature representations of the main task.

METHODS: The multi-task learning scheme involves (1) constructing two models based on the same dataset through different task scenarios, i.e., click-or-not and viewing time, to maximize the use of variables; (2) providing enhanced embedding layer for multi-CTP by parameter sharing, to further resolve the model learning difficulty due to data sparsity and reduce the risk of overfitting given the commonly imbalanced sample.

The input data is the digital marketing data provided by one pharmaceutical manufacturer, including historical article readership behaviors of each physician, and the main topics of the articles. Factorization machine transfers the physician’s behavioral data such as viewing time, and key characteristics of the articles, into an embedding layer. Combined with this embedding layer, the neural network model is developed to generate the click-through probability for each article and physician, and filter the high-ranked articles as the recommendation.

RESULTS: Our model generates a 25.3% precision score on the number of hits in the top 10 digital domain articles, based on the real-world of physician’s click-and-view content data. The baseline models are rule-based and content-based recommendation systems, where the precision is 3% and 4.5%, respectively.

CONCLUSIONS: By applying the Multi-CTP approach, we can employ customized content recommendations even when the input is too sparse to perform well with a popular content-based model. We envision that this algorithm can accomplish a number of goals, including commercial targeting and educational purposes.

Conference/Value in Health Info

2022-05, ISPOR 2022, Washington, DC, USA

Value in Health, Volume 25, Issue 6, S1 (June 2022)

Code

MSR54

Topic

Methodological & Statistical Research

Topic Subcategory

Artificial Intelligence, Machine Learning, Predictive Analytics

Disease

No Additional Disease & Conditions/Specialized Treatment Areas

Explore Related HEOR by Topic


Your browser is out-of-date

ISPOR recommends that you update your browser for more security, speed and the best experience on ispor.org. Update my browser now

×