All posts filed under “user study

Frappé: Paper on arXiv & Context-Aware App Usage Dataset Release

During my last few months in Telefonica Research in 2013 I worked with wonderful colleagues and RecSys gurus Linas Baltrunas and Alexandros Karatzoglou along with scientific director Nuria Oliver on a context-aware mobile app recommendation service called Frappé. Frappé was specifically designed to support novel app discovery experiences. In order to assess it’s effectiveness we deployed Frappé in-the-wild on Google Play and ran a smaller-scale user study with 33 users designed to evaluate user perceptions of using and engaging with an app recommendation service.

Yes, it’s been a while since working on this specific project, however, I have 2 very exciting announcements to share about Frappé.

  • Firstly, a paper describing the Frappé application, our large-scale Google Play deployment and insights from our smaller scale user study has been published on arXiv. In particular we describe actionable lessons learned related to designing, deploying and evaluating mobile context-aware recommender systems in-the-wild with real users. Details and PDF are available here.
  • Secondly, we have released the anonymized Frappé data set!! It can be downloaded from Linas’s website HERE. The dataset contains 96,202 records by 957 users for 4,082 apps. We’re very excited to see what the RecSys and Mobile HCI communities end up doing with this rich dataset, in particular in terms of pushing the envelop in the context-aware recommender systems domain.

If you end up using the data, we ask that you please cite the following paper:

@Article{frappe15,
title={Frappe: Understanding the Usage and Perception of Mobile App Recommendations In-The-Wild},
author = {Linas Baltrunas, Karen Church, Alexandros Karatzoglou, Nuria Oliver},
date={2015},
urldate={2015-05-12},
eprinttype={arxiv},
eprint={arXiv:1505.03014}
}

Happy researching folks!!!

CHI 2015 Work-in-progress (WIP) Accepted – Location Requirements in Local Search


We have just had a CHI WIP accepted for presented in Seoul, Korea in April 2015! WooHoo 🙂 This work-in-progress paper was conducted with Henriette Cramer in which we conducted a large-scale survey via Mechanical Turk to shed light on what factors of location are important when choosing a target place of interest in a local search scenario, namely restaurant search.

The survey was deployed in December 2013 and collected a range of demographic information as well as details regarding participants’ current and most recent locations. The core of the survey was a local restaurant search scenario in which participants were asked to provide freeform textual responses to the following question: Read More

CHI 2015 Paper Accepted! An In-Situ Study on Mobile App & Mobile Search Interactions


We recently discovered that all our hard word has paid off! This past summer, JP Carrascal (a PhD candidate from UPF, Barcelona) and I worked together on a study to understand more about if and how mobile search and mobile app usage interacts. And a full CHI paper reporting our findings has been accepted for publication at CHI 2015 in Korea!

The motivation behind this work is that smartphone users spend much of their time transitioning between mobile search engines and mobile apps (and vice versa) when trying to find information. The figure below helps highlight this fact. The figure shows the timeline of mobile device interactions for a 1 hour period of a single day for an actual participant in our study, showing sequences of mobile device interactions in the form of mobile app launches, home screen interactions and mobile searches. Read More

What’s up with Whatsapp? Best Paper Nominee @ MobileHCI 2013

Our paper entitled What’s up with whatsapp?: comparing mobile instant messaging behaviors with traditional SMS was nominated for a best paper award at this years MobileHCI conference in Munich 🙂 And we are delighted to have been nominated.

The paper describes an interview and survey study that explores how a popular mobile instant messaging app called WhatsApp has been adopted and appropriated, focusing on key motivators of use compared to more traditional SMS. The work was done in collaboration with my past colleague at Telefonica ResearchRodrigo de Oliveria. The full paper can be found here and below is the presentation we gave at the MobileHCI 2013 conference. As always feedback or questions are very welcome.


What’s up with WhatsApp? Comparing Mobile Instant Messaging Behaviors with Traditional SMS – Accepted!

Our full paper exploring how people are using WhatsApp compared to traditional SMS/text messaging has been accepted for publication at this years MobileHCI in Munich! The paper, which is joint work with past Telefonica Research colleague Rodrigo de Oliveira was conducted earlier this year. Rodrigo… Read more