User-directed method for operating on an object

United States Patent [191
[11]
Patent Number:
Stone et al.
[45]
Date of Patent:
MODEL DATA STRUCTURE THROUGH A
SECOND CONTEXTUAL IMAGE
[75] Inventors: Maureen C. Stone, Los Altos; Eric A.
Bier, Mountain View, both of Calif.;
Anthony DeRose, Seattle, Wash.
538715A2 10/1992
0544509
5,467,441.
G06F 15/72
European Pat. Off. .
European Search Report, EP 94 30 5295. l, The Hague, Nov.
13, 1995.
The term of this patent shall not extend
beyond the expiration date of Pat. No.
European Pat. Off.
6/1993
OTHER PUBLICATIONS
[73] Assignee: Xerox Corporation, Stamford, Conn.
‘
(List continued on next page.)
Primary Examiner-Raymond J. Bayerl
Assistant Examiner-Crescelle N. dela Torre
Attorney, Agent, or Firm-Judith C. Bares
[57]
[21] Appl. No.: 587,890
[22] Filed:
*Mar. 17, 1998
FOREIGN PATENT DOCUMENTS
[54] USER-DIRECTED METHOD FOR
OPERATING ON AN OBJECT-BASED
[* ] Notice:
5,729,704
ABSTRACT
A user-directed method for operating a processor-controlled
Jan. 16, 1996
machine permits a user to operate on an object-based model
Related US. Application Data
[63]
data structure from which a ?rst image has been produced in
Continuation of Ser. No. 95,974, Jul. 21, 1993, abandoned.
[51]
Int. c1.6 ................................................... .. GMT 11/00
[52]
us. or. ........................ .. 395/346; 395/339; 395/133;
395/134
[58]
Field ofSearch ................................... .. 395/155, 161,
395/157, 133, 134, 135, 346,339,348,
961, 333, 334, 335, 340, 326; 345/113,
118, 119
[56]
References Cited
order to produce a second image for display in the spatial
context of the ?rst image, and then to interact with objects
in the displayed second image. The method is cooperates as
cooperating with the functionality of an application
program, such as a graphical object editor. The user requests
the display of a viewing operation region (VOR) coexten
sively with a ?rst image segment of the ?rst displayed
image. In response to the user’s request signal, a viewing
operation associated with the VOR operates on the object
based model data structure that produced the ?rst image to
produce an output model data structure from which is
produced a second view, or image, of the portion of the ?rst
image coextensively positioned with the VOR, displaying
U.S. PATENT DOCUMENTS
the second view in the VOR. The second image includes an
4,800,379
1/1989 Yeomans ............................... .. 345/127
4,809,201
2/1989
Keklak
. . . . . . . . . . .. .
5,021,976
6/1991 Wexelblat et al.
5,222,159
6/1993
5,241,624
. . . . . ..
3951135
395/333 X
output object that represents data item in the output model
that is mapped from and linked to a ?rst object data item in
..... .. 382/283
the original object-based model. Then, the user is permitted
8/1993 Tones ............ ..
395/129
to access the ?rst object data item in the original model data
5,278,954
1/1994 Hohlfeld et a1. ..
395/507
5,283,560
2/1994 Bartlett ........... ..
345/113
Kawamura et a1. ..
by interacting directly with the output display object in the
second image via the functionality of the application pro
5,307,457
4/1994 Beitel et a1. .
..... .. 395/348
gram that produced the ?rst image. The method provides
5,329,613
7/1994 Brase et a1. ..
395/133 X
spatially de?ned access to information in a complex model
5,341,465
5,425,137
5,459,832
5,485,174
3/1994
Goto
. .. . . ... .. . ..
. . . . . ..
395/134
6/1995 Mohan et al.
..... .. 395/133
10/1995 Wolf et a1. ..... ..
395/346 X
1/1996 Henshaw et a1. ..................... .. 345/123
in an intuitive and easy to use manner.
22 Claims, 40 Drawing Sheets
186
5,729,704
Page 2
OTHER PUBLICATIONS
E. Bier, M. Stone, K. Pier, W. Buxton and T. DeRose,
PC Paintbrush IV Plus‘!M User Manual, ZSoft Corp, 1989,
1990, pp. v-x, 21-24, 72, 79,—-80, 95-96, 139-148.
‘Toolglass and Magic Lenses:The See-Through Interface”,
Computer Graphics Proceedings, SIGGRAPH 93, pp.
Broderbund “Spelunx” Software Program Guide, pp. 1-2,
73-80, 1993.
C. Ottino, “User Interface in the 1990’s”, ISA Transactions,
right 1992, 1993 by Broderbund Software, Inc. and Cyan.
21 and 24; four(4) screen display images of Tumnus room;
one (1) screen display on software copyright notice; Copy
Jul. 1993, vol. 32, No. 2, pp. 95-121.
Bier, E. and Freeman, 5., “MMM: A User Interface Archi
LaLonde, Wilf & Pugh, John, “Graphics Through the Look
ing Glass”, in Journal of Object Oriented Programming,
AugJSep., 1988, pp. 52-58.
Interface Software and Technology (Hilton Head, SC, Nov.
Krasner, Glenn E., and Pope, Stephen T., “A Cookbook for
Using the Model-View-Controller User Interface Paradigm
D. Swinehart et al., “A Structural View of the Cedar Pro
in Smalltalk-80”, in Journal of Object Oriented Program
ming, Aug./Sep., 1988, pp. 26-49.
Fairchild, Kim, Meredith, Greg, and Wexelblat, Alan, “A
tecture for Shared Editors on a Single Screen” in the
Proceedings of the ACM SIGGRAPH Symposium on User
11-13, 1991), ACM, New York, 1991, pp. 79-86.
gramming Environment”, ACM Transactions on Program
ming Languages and Systems, vol. 8, No. 4, Oct. 1986, pp.
419-490.
Formal Structure for Automatic Icons”, in Interacting With
Computers, vol. 1, No. 2 (1989), pp. 131-140.
Lin, Jin-Kun, “MediaMosaic-A Multimedia Editing Envi
ronment”, in Proceedings of the ACM Symposium on User
Interface Software and Technology (UIST), Nov. 15, 1992,
Teitelman, W., “A Tour Through Cedar”, IEEE Software,
vol. 1, No. 2, Apr., 1984, pp. 44-73.
pp. 135-141.
(Nice, France, April), Cambridge University Press, 1988, pp.
Weyer, Stephen and Borning, Alan, “A Prototype Electronic
Encyclopedia”, in ACM Transactions on Oj?ce Information
Systems, vol. 3, No. 1, Jan. 1985, pp. 63-88.
K. Pier et al., “An Introduction to Gargoyle: An interactive
lllustration Tool”, Proceedings of the Intl. Con)‘. on Elec
tronic Publishing, Document Manipulation and Typography,
223-238.
Sarkar, M., and Brown, M., “Graphical Fisheye Views of
“Kaleida Launches Alliance”, in Digital Media, Mar.
29-Apr. 26, 1993, pp. 12-16.
Graphs”, in ACM Conference on Human Factors in Com
Beck, K., Becher, J. and Liu, Zaide, “Integrating Pro?ling
puting Systems (CHI), May 1992, pp. 83-91.
into Debugging”, 1991 International Conference on Paral
Spence, R. and Apperly, M., “Data base navigation: on o?ice
environment for the professional”, in Behaviour and Infor
mation Technology, 1982, V01. 1, N0. 1, pp. 43-54.
lel Processing, vol. 11, Software, H. Schwetman, ed., Penn
State University, CRC Press, Aug. 12-16 1991, pp.
1I-284-1I-285.
US. Patent
Mar. 17, 1998
Sheet 1 of 40
Receive displa request to display
Output Pro ucing Region co
extensive with first image segment
i
In response to display request,
produce human perceptible output
using ?rst image model data
structure; provide human
erceptible output to output
utilization device at same time as
the first image is being displayed
Fig. 1
Receive dis play request to display
Viewing Operation Region co
extensive with first image segment
i
In response to display request.
produce image definition data
defining second image using first
image data item of ?rst model
data structure; provide second
image for presentation in Viewing
Operation Region at the same time
as the first image is being displayed
Fig. 2
5,729,704
US. Patent
Mar. 17, 1998
5,729,704
Sheet 2 of 40
Receive display request to
display Viewing Operation
Re ion co-extensive with
irst image segment
34
V
Obtain new attribute value
for the display feature
attribute data item
l
32
Produce second image
using new attribute value
for the display feature
attribute data item
l
Provide second image inclu
ding modi?ed first display
feature for presentation in
Viewing Operation Region at
the same time as the first
image is being displayed
Fig. 3
182
/
K180
181
184
Fig. 4A
US. Patent
Mar. 17, 1998
5,729,704
Sheet 3 of 40
182
/ /
180
-——272
Magic Lenses
Fig. 5A
274
US. Patent
874
876
'
/
‘L
O
‘Display object
(card. Inform.
Display Object
~Coord. Inform.
=
i/
a I"
l‘S‘Jliiim
,,
I
,,
‘1'
i
\m
5,729,704
Sheet 4 0f 40
Mar. 17, 1998
_
870
oo0
_
50nd
-o0
ii
64
878
68
Fig. 6
Receive display request to
display viewing operation
region (VOR) co-extensive
with ?rst image segment
40
V
Obtain first object data item
from first image model data
structure (FIMDS) using position
of VOR in display area and
object coordinate data item
42
l
Produce second image using
the first object data item
Y
Provide second image for
presentation in Viewing
Operation Region at the
same time as the first
image is being displayed
Fig. 6A
w
880
U.S. Patent
Mar. 17, 1998
5,729,704
Sheet 5 0f 40
Receive display request to
display viewing operation
region (VOR) co-extensive
with first image segment
——----—v
1
Obtain first object data item
from first ima e model data
structure (FIMD ) using position
/
of VOR in display area and
object coordinate data item
60
K.
Obtain new attribute value
for the display feature attribute
data item indicated by
the ?rst object data item
All object
No
)4
64
data items for al
display objects in VOR
obtained from
FlMDS?
Produce second image usin
the new attribute value an
the first object data items
i
Provide second image inclu-
ding modified first display
feature for presentation in
Viewing Operation Region
at the same time as the first
image is being displayed
Fig. 7
38
US. Patent
Mar. 17, 1998
Sheet 6 0f 40
I?!) K180
\194
Fig. 8
190
/ K
180
5,729,704
US. Patent
Mar. 17, 1998
5,729,704
Sheet 7 0f 40
12
Receive display request to display
viewing operation region (VOR)
co-extensive with first image segment
i
72
Access criteria selection data
Item indicating object
selection criteria information
at
Obtain object data item
from first ima e model data
structure (FIMD ) using position
of VOR in display area and
object coordinate data item
l
Select object data item as selected
90
object data item when object
description information of object
data item matches object selection
criteria information indicated
by criteria selection data item
l
Obtain new attribute value
for the display feature attribute
data item indicated by the
selected object data Item
64
display objects in VOR
obtained from
FIMDS?
Producesecond image using the
new attribute values for all object
data items selected from FIMDS
l
Provide second image including
modified display feature(s) for
presentation in Viewing Operation
Region at the same time as the
first image is being displayed
US. Patent
Mar. 17, 1998
Fig. 14 \
Sheet 8 of 40
5,729,704
US. Patent
Mar. 17, 1998
K72
f 12
Receive display request to
Access criteria selection data
Item indicating ob|ect_
display viewing operation
region (VOR) co-extensive
selection criteria information
with ?rst image segment
80
5,729,704
Sheet 9 0f 40
62
Obtain object data item
from ?rst ima e model data
structure (FIMD ) using position
of VOR in display area and
object coordinate data item
l
Select object data item as
selected object data item when
object description information
matches object selection criteria
information indicated by
criteria selection data item
K94
92
Obtain present attribute
value for nonselected display
feature attribute data item
indicated by object data item
96
Object
Selected?
K74
Obtain new attribute value
obects in van
accessed m
FIMDS?
For all display objects
appearing in VOR. produce
second image using new
attribute values for selected
objects and using present
attribute values for
non-selected objects
l
Present second image
in VOR at the same
time as the ?rst image
is being displayed
for display feature attribute
data item indicated by
selected ?rst object data ltem
U.S. Patent
Mar. 17, 1998
Sheet 10 of 40
5,729,704
180
J
190
Fig. 1 6
194
180
m\
\
Fig. 1 7
194
192
190
Fig. 18
U.S. Patent
Mar. 17, 1998
Sheet 11 of 40
5,729,704
J”
200
Fig. 19
186
US. Patent
Mar. 17, 1998
Sheet 12 0f 40
5,729,704
198
/
180
/
197200’“
. 0
—-- 196
Fig.22
J30
)96
200
197\
\
186
/
180
k
200
-
US. Patent
Sheet 13 0f 40
Mar. 17, 1998
5,729,704
From Box 62
(Fig.10 or Fig.15)
Select object data item
when object description
information of ?rst object
data item matches
object selection criteria
information indicated by
criteria selection data item
1
302
Obtain second data item
indicated by selected
object data item
l
Select object data item as
selected object data item
when object characteristic
information matches
object characteristic criteria
information indicated by
criteria selection data item
To Box 92
To Box 74
(FIG. 10)
°'
Fig. 25
(FIG. 1 5)
304
US. Patent
Mar. 17, 1998
Sheet 14 of 40
5,729,704
120
Application
/
Operation
Viewing
Operation
152 \
om..um m_1
Input
Circuitry
.mgu_?A‘l.v
l
we
m.
..m.»m.»_8 __\
0H
W3
_
M
\
_
154\
User Interaction
J...
Device(s)
Fig. 26
Apphcatlon
OperatIon
Viewing
Operation
Window
Management
System
Fig. 26A
_
ou
0
fy
tCmmD.Wkm.
0. h
11
“w
6U2 1
04|0
US. Patent
Mar.’ 17, 1998
Sheet 15 0f 40
5,729,704
2_L0
212
214
f
216
218
Fig. 27
U.S. Patent
Mar. 17, 1998
Sheet 16 of 40
5,729,704
40
Display Viewing Operation
Region (VOR) on Screen
simultaneously w! First Image
Receive user signal
indicating movement 0
VOR over flrst image
segment
(or movement
0 image under VOR)
41
,.
l
l
l
I
I
I
I
l
l
I
I
I
I
I
mp
erodmda pMa 'Oeddenieu58I1m5-dlcmtataongi a H."5-e0 wtru:fslcfm .t?nawm dna
llr
St
O
I
l
l
l
I
I
I
l
I
l
I
I
.PaO.m wdmbg .lm?nSrabgwQdsimegndtmewst.dmnhkm.dre- Fmu?w.mapsuwrmt
I
aw m UaV. e?tI
deuR
l
Fig. 29
ev.
J02
US. Patent
Mar. 17, 1998
5,729,704
Sheet 17 of 40
424
Obtain a new attribute
value for the display
feature attribute data Item
l
428
Copy first image model data
structure to a copied ?rst image
model data structure (CFIMD )
l
430
Obtain all object data items
in CFIMDS represented by
display objects in first image
l
434
Obtain copied dis lay feature
attribute data item or each object
data item in CFIMDS represented
by display object in ?rst image
l
438
Replace copied display feature
attribute data item for each object
data item with new attribute value
l
Produce image definition
data de?nin second image
using mo l?ed CFlMDS
Y
Clip image definition data
defining second image to size and
position of VOR. using present
viewing position of VOR
To Box 460
Fig. 30
US. Patent
Mar. 17, 1998
Sheet 18 of 40
180
180
\rss
Fig. 32
5,729,704
Download PDF
Similar pages
Sony TCM-200DV
PNL-tec Vort-X
Tacens Mars Gaming MC4
be.ez LE rush En Ville
be.ez LE rush En Ville
90 9 @ 9 0 9
RadRecorder - Techerific LLC
Guideline
Pyle PVR200 User's Manual