R ENDICONTI
del
S EMINARIO M ATEMATICO
della
U NIVERSITÀ DI P ADOVA
F RANCESCO B ARIOLI
Decreasing diagonal elements in completely positive matrices
Rendiconti del Seminario Matematico della Università di Padova, tome 100 (1998), p. 13-25
<http://www.numdam.org/item?id=RSMUP_1998__100__13_0>
© Rendiconti del Seminario Matematico della Università di Padova, 1998, tous droits réservés.
L’accès aux archives de la revue « Rendiconti del Seminario Matematico della Università di Padova » (http://rendiconti.math.unipd.it/) implique l’accord avec les conditions générales d’utilisation (http://www.numdam.org/conditions).
Toute utilisation commerciale ou impression systématique est constitutive d’une infraction pénale. Toute copie ou impression de ce fichier doit conte- nir la présente mention de copyright.
Article numérisé dans le cadre du programme Numérisation de documents anciens mathématiques
http://www.numdam.org/
in Completely Positive Matrices.
FRANCESCO
BARIOLI (*)
All matrices considered in this paper are real matrices
(~).
It is well known that a
diagonally
dominantsymmetric
matrix withnonnegative diagonal
elements ispositive semidefinite; actually,
this factis an immediate consequence of the
Gerschgorin
circles theorem.An
analogous result,
notequally
wellknown,
holds forcompletely
po- sitivematrices,
i.e. for those matrices A that can be factorized in the form A = where V is anonnegative
matrix. In factKaykobad [4]
proved
that anonnegative symmetric diagonally
dominant matrix iscompletely positive.
Hence,
if thediagonal
elements of asymmetric
matrix A have suffi-ciently large positive values,
then A ispositive
semidefiniteand,
if A isnonnegative,
it iscompletely positive.
In this paper we consider the
question arising by assuming
the oppo- sitepoint
of view. Let A be apositive
semidefinite or acompletely positi-
ve
matrix;
then we will consider thefollowing question:
how much a di-agonal
element of A can be decreased whilepreserving
the semidefinitepositivity
or,respectively,
thecomplete positivity
of A?We will answer this
question concerning positive
semidefinite matri-ces in Section
2;
the answer issimple
and follows from an inductive test(*) Indirizzo dell’A.: Dipartimento di Matematica Pura e
Applicata,
Universi-ta di Padova, Via Belzoni 7, 35131 Padova,
Italy.
(1)
This paper is part of the doctoral dissertation under the supervision of Prof.Luigi
Salce.for semidefinite
positivity (see [7],
Cor.1.3]),
which involves the Moore- Penrosepseudo-inverse
matrix of a maximalprincipal
submatrix.As to
completely positive
matrices the answer arises from the con-nection of the above
question
with theproperty
PLSS(positivity
of leastsquare
solutions)
introduced in[7].
Moreprecisely,
we will consider in Section 3 i-minimizabLe matrices(1 ~
i ~ n, where n is the order of the consideredmatrix),
which are thosecompletely positive
matrices such that the minimal value of thei th diagonal
elementmaking
the matrix po- sitive semidefinite makes the matrixcompletely positive
too. We willshow that
1-minimizability
isequivalent
toproperty PLSS,
thatsingular completely positive
matrices are i-minimizable for somei,
and that com-pletely positive
matrices withcompletely positive
associatedgraph (see [5])
are z-minimizable for all i.Recent results
(see [1])
show thatcompletely positive
matrices withcyclic graph
of oddlenght
are not i-minimizable for any i.Conversely,
itfollows from results
by
Berman and Grone[2]
thatcompletely positive
matrices with
cyclic graph
of evenlenght
are i-minimizable for all i.Thus the
following problem
arises: to findexamples
ofcompletely positi-
ve matrices with more
complicate
behaviour withrespct
tominimizability.
In Section 4 we will
investigate
excellentcompletely positive
matri-ces,
already
introduced in[1],
and defined in terms of theirgraphs,
which are «almost»
completely positive.
We willgive
a characterization of excellent 1-minimizablecompletely positive matrices,
which enablesus to
produce
severalexamples
of excellent matrices with different be- haviour with therespect
tominimizability.
2. - Minimized
positive
semidefinite matrices.We recall the
following
definitions. Asymmetric
matrix A of order n ispositive semidefinite
if 0 for all vectors x The matrix A isdoubly nonnegative
if it is both semidefinite and(entrywise)
nonnega-tive ;
it iscompletely positive
if there exist anonnegative (not necessarily square)
matrix V such that A =VVT.
It is well known that a
completely positive
matrix isdoubly
nonnega- tive and that the converse is notgenerally
true for matrices of orderlarger
than four.We will denote
by R(A)
the column space(range)
of the matrixA, by
A+ its Moore-Penrose
pseudo-inverse
andby rk (A)
its rank. For unex-plained
notation we refer to[6].
Let A be a
symmetric
semidefinite matrix of order n > 1 in bordered formIn
[7]
thefollowing result,
whichprovides
an inductive test forsemidefinite
positivity,
wasproved:
LEMMA 2.1. The
symmetric
matrix A in(1)
ispositive
semi-definite if
andonly if Al
ispositive semidefinite,
bE R(A1 )
anda >
bTA1+
b.It follows from Lemma 2.1 that the minimal value of t E R such that the matrix
is
positive
semidefinite is we will denote itby
a,. The matrixis called the 1-minimized of A. We say that A itself is 1-minimized if A =
A~ .
If 1 ~ i ~ n, the i-minimized of A is the matrix wherePi
is thepermutation
matrix obtained from theidentity
matrixby
trans-posing
the first and thei th
row. The matrix A is said to be i-minirnized ifPiTAPi = (PTiAPi)03BC.
A 1-minimized
(or,
moregenerally,
ani-minimized)
matrix issingu-
lar. This fact is trivial if
Al
issingular,
otherwise it follows from theequality Det (A )
=applied
to A= A,~ .
The converse is not
generally
true, as the trivialexample
shows.
Howewer,
we have thefollowing
result:THEOREM 2.2. A
singular positive semidefinite
matrixn-by-n
is i-minimized
for
some i ~ n.In order to prove the
preceding theorem,
we need twolemmas,
whosestraightforward proofs
aregiven
for sake ofcompleteness.
LEMMA 2.3. Let A be a
positive semidefinite n-by-n
matrix. Then its rank coincides with the maximum orderof
anon-singular principal
submatrix.
PROOF. Let rk
(A)
= k. Since A ispositive semidefinite,
there existsa real
n-by-k
matrix W such that A = Since rk( W)
= ktoo,
wecan find a
non-singular
submatrix of W. Let itWl. Finally
A’ =
WI Wi
is anon-singular principal
submatrix of A of order k. m The second result that we need is thefollowing:
LEMMA 2.4. Let A be a
positive semidefinite
matrix in borderedform ( 1 ),
withrk (A 1 )
=k,
and let M anon-singular principal
subma-trix
of A, of order
k. Then a, = where c is the vector obtainedby taking
the coordinatesof
bcorresponding
to the rowsof
M.PROOF. The existence of M is ensured
by
Lemma 2.3. There is noloss of
generality
if we consider A in the formThere exists a matrix
W,
of rank k such thatA1= W, Wi
andclearly A~,
=VVW T
for( W1+ b Wf),
because~ =
bTAl+b
= =Wi+6
Thus
rk (A~ )
= k and theprincipal
submatrixis
singular
andpositive semidefinite,
thusby
Lem-ma 2.1. 1
We are now able to
give
thePROOF OF THEOREM 2.2 Let B the
singular positive
semidefinite ma-trix, k = rk (B).
There exists apermutation
matrix of the formPi
forsome
i ~ n,
such that written in bordered form(1),
hasrk (A 1 ) = k.
By
Lemma2.4,
there exists anon-singular principal
submatrix M of order k ofAi ,
so that A iscogredient
to the matrixWe will show that this matrix is
1-minimized,
hence the matrix B will be i-minimized. Theprincipal
submatrixis
singular,
hence aand, by
Lemma2.4,
this is the minimal value that makes A *positive
semidefinite.From the
preceding
results weget
thefollowing
COROLLARY 2.5. Let A be a
singular positive semidefinite
matrixin bordered
form (1).
Then A is 1-minimizedif
andonly if
rk(A) =
= rk (Ai ).
PROOF. Assume A 1-minimized. The
proof
of Lemma 2.4 shows thatW has the same number of columns as
Wi,
hencerk (A)
=rk (Ai ).
Con-versely,
ifrk (A) = rk (A1 ),
in theproof
of Theorem2.2,
M can be choosen as a submatrix ofAl
withoutusing
thepermutation
matrixPi ,
and one can conclude that A itself is 1-minimized.
3. - Minimizable
completely positive
matrices.Let A be a
completely positive
matrix of order n in bordered form(1).
An immediate consequence of the fact that the class of the
completely positive
matrices of order n is closed in the class of thesymmetric
matri-ces of the same order
(see [3])
is that there exists a minimal value a, E Rsuch that the matrix
is
completely positive; obviously ae ;
a, . The matrixA,
is called the 1-ex- tremized of A. A itself is called an 1-extreme matrix if A =Ae .
If i n, the i-extremized of A is the 1-extremized ofP T APi
and A itself is ani-extreme matrix if
PTAPI
is 1-extreme.DEFINITION.
We say that acompletely positive
matrix A in bordered form(1)
is i-minimizable if the i-minimized matrix of A is alsocomplete- ly positive,
i.e. if(PiT APi)e.
DEFINITION. We say that a
completely positive
matrix A in borderedform
(1)
istotally
minimizable if it is i-minimizable for all i ~ n;equiva- lently,
if all the matricescogredient
to A are 1-minimizable.The
apparently
new notion of 1-minimizablecompletely positive
ma-trix is
equivalent
to the notion of«property
PLSS»already
introducedin
[7],
andsimply
called«property (P)»
in[6].
Recall that the sym- metricnon-negative
matrix A in bordered form(1)
satisfiesproperty
PLSS if there exists a
nonnegative
matrixVI
such thatAl
=VI V(
and
Vl’
0.PROPOSITION 3.1. A
completely positive
matrix A in borderedform (1)
is 1-minimizabLeif
andonLy if
itsatisfies
theproperty
PLSS.PROOF. Let A
satisfy
theproperty
PLSS. ThenA~
also satisfies thisproperty; hence, by ([7],
Theorem2.1), A~
iscompletely positive.
Conversely,
let A be 1-minimizable.By ([7], Proposition 1.2),
thereexists a
nonnegative
matrixVI
and anonnegative
vector v suchthat:
From the
equalities
and from the
uniqueness
of the least square solution of the linearsystem
V1 x
=b,
there followsthat v
=Vl+ b.
ThusVl+ b ~ 0
andproperty
PLSSholds. 0
The class of
totally
minimizable matrices isquite large,
as the follow-ing
result shows. Recall that agraph
T is calledcompLetely positive
ifevery
doubly nonnegative
matrix A whose associatedgraph T(A ) equals
r is
completely positive. Kogan
and Berman[5] proved
that agraph
iscompletely positive
if andonly
if it does not contain acycle
of oddlength larger
than three.PROPOSITION 3.2. The class
of totally
minimizabte matrices con-tains all the
completely positive
matrices withcompletely positive graphs.
PROOF. Let A be a
completely positive
matrix such that itsgraph r(A)
iscompletely positive.
Let B the i-minimized matrix of A for somei ~ n.
Obviously r(B)
iscompletely positive,
thusB,
which isobviously doubly nonnegative,
iscompletely positive.
The connection between
singularity
andminimizability
is illustrated in thefollowing
PROPOSITION 3.3. Let A be a
singular completely positive
matrixin bordered
form (1).
Then A is i-minimizabLefor
some i ~ n and is1-minimizable
if rk (A )
=rk (Ai ).
PROOF.
By
Theorem2.2,
A is i-minimized for a certaini;
let A * =PTAPI.
A * iscompletely positive
and1-minimized,
so it isobviously 1-minimizable,
hence A is i-minimizable.Furthermore,
ifrk (A ) _
= rk (Ai ), by Corollary
2.5 it follows that A is 1-minimizable.We conclude this section with a result
providing
the construction of acompletely positive singular
matrix(hence
i-minimizable for some i ~n)
which fails to be1-minimizable;
this matrix is obtainedby bordering
in asuitable way a
non-singular
not 1-minimizablecompletely positive
ma-trix. Such a matrix does exists
(see Example 4.6).
PROPOSITION 3.4. Let C be a
non-singular completely positive
ma-trix
of
order n > 1 in borderedform
which is not 1-minimizable. Then there exists a
completely positive
matrix A obtained
by suitably bordering
the matrix Cwhich is not
1-minimizacble,
but is i-minimizacbLefor
some 1 i ~ n.PROOF. There exists a matrix V ~ 0 such that Let
VT =
= (vi Vi ).
Thenrk (kJ
=rk ( C)
= n andrk ( V1 )
=rk(Ci)
= n - 1. LetW T
=(vi Vi v), where v
is anonnegative
vector of the column spaceObviously rk (WT)
= n. Let now A =IVIV .
Then A iscompletely positive
of order n + 1 andrank n,
and has the form(11)
for d = d =and e =
vT v. By Proposition 3.3,
A is i-minimizable for some i. As- sume,by
way ofcontraddiction,
that A is1-minimizable;
then the 1-mini-mized matrix
All
of A iscompletely positive,
hence the its submatrixis
completely positive
too.By
Lemma2.4,
all = hence we reach thecontraddiction,
since C is not 1-minimizable.4. -
Minimizability
of excellentcompletely positive
matrices.A
cycle
of evenlength
is abipartite graph,
hence it is acompletely positive graph; therefore,
in view ofProposition 3.2,
acyclic completely positive
matrix of even order istotally
minimizable.Cyclic doubly nonnegative
matrices of odd order which are not com-pletely positive
can beeasily produced (see [3]).
In[1]
it isproved
that adoubly nonnegative cyclic
matrix A of odd order iscompletely positive
ifand
only
if Det(A ) ; 4 hl h2 ... hn ,
where thehi’s
are the non-zero ele-ments over the main
diagonal.
It follows that such a matrix cannot besingular
andconsequently, given
anyi ~ n,
it is not i-minimizable.In this section we
study
afamily
ofcompletely positive matrices,
con-taining
thecyclic
ones, whichprovides
moreinteresting examples
withrespect
tominimizability.
In
[1] doubly nonnegative
matrices A = in bordered form(1)
have been consideredsatisfying
thefollowing properties:
3)
Thegraph T(A1 )
associated toAl
iscompletely positive.
The
graph T(A )
associated to the matrix A is obtained from thegraph 7"(Ai) by adding
one morevertex,
connected withonly
two vertices ofT(A1 ),
which are not connected each other. We will say that such agraph
is an excellent
graph,
and that adoubly nonnegative
matrix Asatisfying
the
preceding properties
is an excellent matrix.In the
preceding notation,
let us denoteby
A - the matrix obtainedfrom A
by substituting equivalently, substituting
the vec-tor b
by
the vectorQ1 - !!.2,
wherebl
= 0 0 ... andb2 - - ( 0
0 ... 0 In[1], part
of thefollowing
result wasproved.
THEOREM 4.1. Let A be an excellent
doubly nonnegative n-by-n
matrix with n > 2 in bordered
form (1),
with b =(~i 2
0 0... O ~3 n )T .
Thefollowing facts
areequivalent:
1)
A iscompletely positive;
2)
A - ispositive semidefinite;
3)
The vector(10...00)~q/’R~’~
1belongs
to the column spaceR(A1 ) of A1
anda ; a~ - 4~3 2 ~i n a,
where a is the element in thefirst
rowaud last colurrzn
of A1+ .
PROOF. For
1)
~2)
see[1].
For2)
~3),
observethat, by
Lemma2.1,
A - is
positive
semidefinite if andonly
ifb1 -
and a a~ (bi - bT ) A1+ (bl - !!.2).
But since b =bl
+Q2 E b
ER(A1 )
ifand
only
ifb1 E R(A1 ) (or equivalently
if andonly
if.
Moreover,
we have:We must remark that it is not
possible
to eliminate in Theorem 4.1 thehypothesis
that A isdoubly nonnegative,
since there aresymmetric nonnegative
matrices A withAl positive
semidefinite and beR(A1),
which fail to be
positive semidefinite,
and such that A - ispositive
semidefinite. This
happens (by using
thepreceding
notation and with A in bordered form(2.1))
when a > 0 and > a >On the other
hand,
in thehypothsis
of Theorema4.1,
if a ~0,
the condi- tion a > a, - isautomatically verified,
since a ~ a, . An immedi-ate consequence of this remark is the
following
COROLLARY 4.2. Let A be an excellent
completely positive
matrixod order n > 1 in bordered
form (1),
with b =(fi 2
0 0 ... 013 n)T,
and leta be the element in the
first
row and Last coLumnof
Then1)
2)
A is 1-minimizableif
andonLy if
a ; 0.PROOF.
1)
is an immediate consequence of Theorem 4.1.2)
If A is1-minimizable,
then ae = a~ , hence a ~ 0by point 1).
Con-versely
a ~ 0 andpoint 1) imply
a, = a, 0We
give
now someexamples
of excellent matrices with different be- haviour withrespect
to1-minimizability.
EXAMPLE 4.3. Consider the
following symmetric
matrix with excel- lent associatedgraph
The
principal
submatrixAl (obtained
from the last four rows andcolumns)
issingular
andcompletely positive,
and the vector b =- ( 1 0 0 eR(A1),
henceA(a)
isdoubly nonnegative
for a ~bT A1+
b.Howewer,
the matrixA(a)
is notcompletely positive
for any value of a,since, according
to Theorem 4 the vector( 1 0 0 0 )T
does notbelong
toR(A1 ).
EXAMPLE 4.4. Consider the
following symmetric
matrix with excel- lent associatedgraph
In this case the
principal
submatrixAl
isnon-singular
andcomplete- ly positive,
so the vectorsb = ( 1 0 0 1 )T
andbl
=(1
0 0belong
toR(A1 ),
henceA(a)
isdoubly nonnegative
for a ; = 7.Moreover,
the element a in the first row and last column
of A1+ equals 1,
henceA(a)
iscompletely positive
and 1-minimizable for all a ~ 7. If 7 > a ~ 3 == 7 - 4 ~ 2 ~i n a, A
is notdoubly nonnegative
and A - ispositive
semidefi-nite.
EXAMPLE 4.5. Consider the
following symmetric
matrix with excel- lent associatedgraph
In this case
Al
isnon-singular
andcompletely positive,
so b =- ( 1 0 0 1 )T and bl = ( 1 0 0 Of belong
to henceA(a)
isdoubly
non-negative
for a ~ = 3. Moreover a= -1,
henceA(a)
iscompletely positive
if andonly if a ~ a~ - 4 a = 7
and one can conclude that A is not1-minimizable.
EXAMPLE 4.6. Consider the
following completely positive cyclic
ma-trix of order 5
which is not i-minimizable for any i. A factorization of C =
W T
is ob- tained forUsing Proposition 3.4,
one can seethat, setting W T
= whereb =
(0
0 01 1 )T,
thefollowing completely positive
matrixis
singular,
hence i-minimizable forsome i,
but it is not 1-minimiz- able.REFERENCES
[1] F. BARIOLI,
Completely positive
matrices with abook-graph,
LinearAlgebra
and its
Applications,
277 (1998), pp. 11-31.[2] A. BERMAN - R. GRONE,
Bipartite completely positive
matrices, Proc. Cam-bridge
Phil. Soc., 103 (1988), pp. 269-276.[3] A. BERMAN - D. HERSHKOWITZ, Combinatorial results on
completely positive
matrices, LinearAlgebra
and itsApplications,
95 (1987), pp. 111-125.[4] M. KAYKOBAD, On
nonnegative factorization of
matrices, LinearAlgebra
andits
Applications,
96 (1988), pp. 27-33.[5] N. KOGAN - A. BERMAN, Characterization
of completely positive graphs,
Dis-crete Math., 114 (1993), pp. 287-299.
[6] L. SALCE, Lezioni sulle Matrici, Decibel-Zanichelli, Padova (1993).
[7] L. SALCE - P. ZANARDO,
Completely positive
matrices andpositivity of
leastsquare solutions, Linear
Algebra
and itsApplications,
178 (1993), pp.201-216.
Manoscritto pervenuto in redazione il 9