
tripleC 7(2): 208-213, 2009 209
CC: Creative Commons License, 2009.
are Multimedia Content Analysis and
Multimedia Information Retrieval (K-Space
D3.1, 2006) (Lew et al. 2006) (Hare et al.,
2006.) The set of processes and techniques
used by these disciplines concentrate on the
extraction of significant objects at different
levels: from the lowest, concerning the
physical components of the content, to the
highest, concerning semantic states and
objects. All these techniques are based on a
wide variety of mathematical treatments
oriented to obtain the most precise results
possible.
1.1. The semantic gap
Once the content transmission system is
framed theoretically within the MTC, and the
appropriate methods for the identification of
meaningful elements selected, the extraction
of information is the culminating point in the
pyramid of events whose final obstacle is the
so-called semantic gap. In Hare (2006) we
can find a compilation of procedures used to
overcome this gap, which help to make this
concept more precise. Thus, Smeulders (2000
p. 1349-1380) tells us that the semantic gap is
described as
“… the lack of coincidence between the
information that can be extracted from the
visual data and the interpretation that the
same data have for a user in a certain
situation.”
The obtaining of significant information is,
however, not a new problem, and it isnot
associated solely to the present formulation.
Even if, because of the novel character of the
study field, the problem appears to have a
special relevance, the question of assigning
meaning to a data set, as well as its variability
depending on the reference situation, is as
old, one could said, as communication. Facing
the semantic gap forces us to clarify some
concepts such as those of data, information or
knowledge. To do that, we resort to their
mathematical representation. In order to deal
with the challenge of the extraction of
knowledge from the significant elements of
audiovisual contents, we use the
mathematical formulation of Situation Theory.
By means of this formulation, we identify the
elements extracted through multimedia
analysis processes as elements of situation
ontology. This allows us to give theoretical
support to the process of extraction of
information.
1.2. Infons
Following Smeulders’ characterization of
the semantic gap, we use the mathematical
development of Situation Theory by Keith
Devlin (1994) to face the third part of our job.
We present this approach as a possible
alternative when it comes to formulating the
mechanisms of data processing in audiovisual
contents.
Situation Theory is an attempt to provide a
mathematical formulation for Barwise’s and
Perry’s (1983) Situation Semantics. In Logic
and Information, Keith Devlin (1991) supplied
Situation Theory with a mathematically
coherent apparatus. The basic ontology of
Situation Theory is constituted by the entities
that a cognitive agent is able to individualize
and/or discriminate, given its limitations. This
refers us to the results we obtain using the
methods of Multimedia Content Analysis and
Multimedia Information Retrieval. These
systems provide us with individualizations,
elements that are discerned from others in the
context of general content. Among the
objects, also known as uniformities (or
regularities), of situation ontology, we find
individuals, relations, spatial locations,
temporary locations, situations, types and
parameters. The framework, relative to the
agent, that gathers the ontology is known as
“individualization scheme” (it is the
appropriate one for the study of the flow of
information pertaining to the agent). The
information must always concern a particular
situation, and it is represented through
discreet items known as “infons”. An infon is
an object of the form:
1 ,,,, ,R,0 ,,,, ,R
2121 nn
aaaaaa
where R is the relation established among
n objects (a
1
,…, a
n
), and the last element (1 or
0) is called “polarity”, and shows the veracity:
or falseness:
of the instantiation of R in (a
1
,…, a
n
).