Quelle IA pour les données structurées ?
Graph Kernels
Romain Raveaux
[email protected] Maître de conférences
Université de Tours
Laboratoire d’informatique (LIFAT) Equipe RFAI
1
Outline
• Graph kernel
• Definition
• Kernel trick
• Examples of graph kernels:
• Simple
• Random walk kernels
• Application
2
Previous episode
• Graph Neural Networks
• http://romain.raveaux.free.fr/document/graph%20neural%20networks%20ro main%20raveaux.pdf
3
Graph kernel
Taxonomy:
Graph embedding
Explicit embedding Implicit embedding
Graph kernel Graph space
4
A kernel
Kernel Trick
9
Kernel Trick
10
Kernel Trick
11
Kernel Trick
12
Graph kernel : theoretical issues
• To design a kernel taking the whole graph structure into account
amounts to build a complete graph kernel that distinguishes between 2 graphs only if they are not isomorphic
• Complete graph kernel design is theoretically possible … but practically infeasible (NP-hard)
13
Graph Kernel Families
• Diffusion kernels (from similarity matrix)
• Convolution kernel
• Walk kernel (from adjacency matrix)
14
Graph embedding
15
16
17
𝑘𝑥 𝐺, 𝐺′ =
𝑖,𝑗=1
|𝑉𝑥|
[
𝑘=0
∞
𝜆𝑘𝐴𝑘𝑥]
𝑖𝑗
18
19
20
21
22
23
24
25
26
Some experiments
• Comparison between graph kernels and graph neural networks.
• Taken from :
• How Powerful are Graph Neural Networks? (2018)
• Keyulu Xu, Weihua Hu, Jure Leskovec, Stefanie Jegelka
27
28
29
Summary on graph kernels
• Comparing paths of two different graphs is polynomial
• Comparing subgraphs of two different graphs optimally is not guaranteed in polynomial time.
• Kernels that take into account numeric attributes are more challenging.
30