Call For Papers

The First Workshop on User Engagement Optimization at the 22nd ACM International Conference on Information and Knowledge Management (CIKM 2013)

November 1, 2013 (tentative)
San Francisco, USA

Paper submissions: due July 10, 2013 (Extended Deadline)

Online user engagement plays a central role in the business success of many industry companies that own or operate Web sites, apps, and other online systems, including major Web search engines, Web portals, social networking websites, e-commerce systems, and numerous mobile/Web app owners. The key idea of online engagement optimization is to discover and leverage collected knowledge about the behavioral patterns of online engagement and provide features, functionality and experiences accordingly to attract users’ involvement, facilitate their interaction and enhance the long-term satisfaction. Study on this topic raises tremendous challenges to many disciplines, yet most of which we believe have to date been under-explored. For instance, how to measure user engagement and its quality (both short-term and long-term) based on online user traffic? What’re good metrics for different tasks (e.g., monitoring, control and intervention)? What is the guideline for metric design? How to discover reliable knowledge about the users, their interests and behavioral patterns and provide customized features or resources that are tailored or targeted towards their specific needs? How to develop models, algorithms and implementations that are effective in handling online user engagement data that are noisy, sparse and incomplete in nature and in the same time scalable to the extensive availability and scale of such data. How to tune, test and validate a specific intervention or design decision based on time-drifting online traffic? How to mitigate the effects of exogenous factors? How to make sense or discover insights from user engagement data to facilitate the design of an intervention, to justify the outcome of a particular intervention or design decision, etc?

This workshop aims to connect academic researchers and industrial practitioners who are working on or interested in online engagement optimization. The goal is to provide a forum for industrial practitioners to expose real-world challenges to academic communities and for academic researchers to popularize state-of-art research outcomes to industrial practitioners, and foster collaboration between the two. The workshop will be a full-day events consisting of invited talks of academic research advances and industrial technical showcases on related topics followed with a poster-and-demo session.

The workshop topics include but are not limited to:

  • Online experiments
    • Controlled experiment design
    • Hypothesis test on online engagement data
    • Applications of controlled online experiments
  • Metrics and measurements
    • Guidelines for user engagement metric design
    • Short-term and long-term engagement metrics
    • Metrics and measurements for controlled experiments and significance testing
    • Psychological, sociological, and cultural factors in metrics
  • User modeling, personalization and targeting
    • Scalable machine learning techniques for personalization
    • User behavioral/interests models
    • Recommendation and personalization algorithms
    • Behavior targeting
    • Recommendation justification, sense-making and persuasion
    • Applications
  • Machine learning for streaming data
    • Online learning
    • Streaming algorithms
    • Novel large-scale learning frameworks
  • Visualization and interpretation
    • Algorithms and tools for visualization of engagement data
    • General patterns / characteristics of online user engagement
    • Mining user engagement data
    • Factor analysis, correlation interpretation and causality identification
    • Successful applications

The workshop includes invited speeches by top-experts from academia as well as leading companies in the field (Facebook, Twitter, LinkedIn, Google, Yahoo!, Microsoft and Netflix), and a poster/demo session. The schedule will provide time for both organized and open discussion.

Submission Instructions
The submissions are intent for the poster/demo session. Papers should be no longer than 4 pages (2-column), including all references, figures and appendices. Papers describing work in progress are explicitly encouraged. Please submit your papers through

Submissions should follow the ACM SIG proceedings format (Option 2). The review process will be single-blind and the authors do *not* need to anonymize their submission.

All papers must be in Adobe Portable Document Format (PDF). Please ensure that any special fonts used are included in the submitted documents. All papers must be original and must not be under review or have been published elsewhere.

At least one author of each accepted paper will be required to present their work at the poster session. Accepted workshop papers will be published in the CIKM workshop proceedings, which will be printed on CD only and indexed in the ACM digital library, together with the main CIKM 2013 proceedings.

Important Dates
Papers submission Deadline: July 10, 2013 (Extended Deadline)
Notification of acceptance July 26, 2013
Camera-ready submission: August 25, 2013
Workshop date: Nov 1, 2013
All due dates are defined in terms of times before 11:59pm, Hawaii time (i.e., GMT – 10 hours) of the due date.

Organizing Committee
Liangjie Hong, Research Scientist — Yahoo! Labs
Shuang-Hong Yang, Research Scientist — Twitter Inc.