Social Signals: Any Impacts in Search?

HAL Id: hal-03154387

https://hal.archives-ouvertes.fr/hal-03154387

Submitted on 28 Feb 2021

HAL is a multi-disciplinary open access

archive for the deposit and dissemination of sci-entific research documents, whether they are pub-lished or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers.

L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

Social Signals: Any Impacts in Search?

Ismail Badache, Mohand Boughanem

To cite this version:

Ismail Badache, Mohand Boughanem. Social Signals: Any Impacts in Search?. Journée “La science des données à l’IRIT” 2016, Apr 2016, Toulouse, France. �hal-03154387�

3. Signals Diversity

Social Signals: Any Impacts in Search?

Information Retrieval, Social Signals, Popularity, Reputation, Freshness, Diversity, Ranking

►Context:

 Exploiting social signals to enhance a search.

 Do the quality, temporality and diversity of signals matter to capture relevant

documents?

► Research Questions:

 How to estimate the

popularity

and

reputation

of a resource using social signals?

 What is the impact of

signals diversity

and

signals freshness

on IR system?

 How to normalize signals with

resource age

?

1. Introduction

Temporality

Diversity

Origin

Nature

Rating

5

4

3

2

1

Signification

Ismail Badache and Mohand Boughanem

IRIS Team - IRIT - Paul Sabatier University, Toulouse

{Badache, Boughanem}@irit.fr

►Signals freshness in a resource

►Signals normalization with resource age

4. Time-Aware Signals

2. Signals and Properties

5. Experimental Evaluation

Baselines

0,0487

0,0517

0,05

Lucene Solr

BM25

ML.Hiemstra

Facebook

0,0689 0,0711 0,0678

0,0559 0,0531

Like

Share

Comment

Rating

Tag

Social Signals Individually

+23% +27% +21%

+11% +5%

Social Signals Grouped

0,0791

0,078

0,0801

0,0787

0,0888

TotalFB

Popularity

Reputation

AllCriteria

AllProperties

+55%

+41%

+41%

+38%

+43%

Reputation

AllProperties

Resource Age

0,0708

0,0796

0,0711 0,0695

0,058

Like

Share

Comment

Rating

Tag

+5%

+19%

+4%

+12%

+3%

Date of Signal

0,0732

Rating

+31%

0,1223

0,11

0,1114

0,1301

Naïve Bayes (CFS)

Naïve Bayes (WRP)

SVM (SVM)

J48 (RLF)

+132%

+99%

+96%

+118%

Machine Learning (Signals)

Time-Aware Signals

0,084

0,0862

0,0891

0,0915

0,0976

TotalFB

Popularity

Reputation

AllCriteria

AllProperties

Signals Diversity

+11%

+10%

+16%

► Dataset:

- INEX Social Book Search 2015.

- 208 INEX SBS Topics and their relevance judgments.

Property

Social signal

Social Network

Popularity

Number of

Comment

Facebook

Number of

Share

Facebook

Number of

Tag

Amazon/LT

Reputation

Number of

Like

Facebook

Number of

Rating

Amazon/LT