Multi-Task Learning in Click-through-Probability (Multi-CTP) Prediction for Real-World Digital Content Recommendation
Author(s)
Tu T, Chen L, Wang Y, Jin H, He W
IQVIA, Shanghai, China
Presentation Documents
OBJECTIVES: To develop a predictive deep learning model structure (Multi-CTP) to handle extreme sparse data, for the start stage of content recommendation in healthcare digital marketing and education. The multi-task learning approach alleviates the learning pressure and improves the performance of the recommendation system, by using existing data to build auxiliary tasks and models to provide better feature representations of the main task.
METHODS: The multi-task learning scheme involves (1) constructing two models based on the same dataset through different task scenarios, i.e., click-or-not and viewing time, to maximize the use of variables; (2) providing enhanced embedding layer for multi-CTP by parameter sharing, to further resolve the model learning difficulty due to data sparsity and reduce the risk of overfitting given the commonly imbalanced sample.
The input data is the digital marketing data provided by one pharmaceutical manufacturer, including historical article readership behaviors of each physician, and the main topics of the articles. Factorization machine transfers the physician’s behavioral data such as viewing time, and key characteristics of the articles, into an embedding layer. Combined with this embedding layer, the neural network model is developed to generate the click-through probability for each article and physician, and filter the high-ranked articles as the recommendation.RESULTS: Our model generates a 25.3% precision score on the number of hits in the top 10 digital domain articles, based on the real-world of physician’s click-and-view content data. The baseline models are rule-based and content-based recommendation systems, where the precision is 3% and 4.5%, respectively.
CONCLUSIONS: By applying the Multi-CTP approach, we can employ customized content recommendations even when the input is too sparse to perform well with a popular content-based model. We envision that this algorithm can accomplish a number of goals, including commercial targeting and educational purposes.
Conference/Value in Health Info
Value in Health, Volume 25, Issue 6, S1 (June 2022)
Code
MSR54
Topic
Methodological & Statistical Research
Topic Subcategory
Artificial Intelligence, Machine Learning, Predictive Analytics
Disease
No Additional Disease & Conditions/Specialized Treatment Areas