“Mg 2. A )4.
USOO7856240B2
(12) Unlted States Patent
(10) Patent N0.:
Gunn et a].
(54)
(45) Date of Patent:
DISTRIBUTED SOUND ENHANCEMENT
(56)
U'S' PATENT DOCUMENTS
MI (US); MichaelA-Hayes, Bloom?eld
Hills, MI (US)
_
_
_
ASSlgneei Clarlty Technologles, 1119-, Troy, MI
(21)
Notice:
4/1999 Klayman ..................... .. 381/1
7/2003 Klayman ..................... .. 381/1
7,039,179 B1*
5/2006
Gerhardt 6t a1. ...... ..
379/390.02
7,283,635 B1* 10/2007 Andersonetal. ........... ..381/74
Subject to any disclaimer, the term of this
2003/0130016 A1*
7/2003
2004/0005063 A1*
1/2004 Klayman ..................... .. 381/1
patent is extended or adjusted under 35
2004/0015775 A1*
U_S_C_154(b)by1917days_
2005/0286713 A1*
2007/0053522 A1*
APPLNO': 10/896300
_
(22) Filed:
5,892,830 A *
6,597,791 B1*
7,136,684 B2* 11/2006 Matsuura 6161. ....... .. 455/5752
(Us)
(*)
Dec. 21, 2010
References Cited
(75) Inventors: Raymond W. Gunn, Shelby Township,
(73)
US 7,856,240 B2
Matsuuraetal. .... ..
455/569
1/2004 Simske et a1. ............. .. 715/500
12/2005
3/2007
Gunn etal. ..... ..
Murrayetal.
. 379/406.04
.... .. 381/71.6
2007/0147633 A1*
6/2007 Burger ........... ..
. 381/92
2008/0013741 A1 *
1/2008 Klayman
2008/0103776 A1 *
5/2008
Kumar et a1.
381/1
............. .. 704/270
Jul. 21, 2004
FOREIGN PATENT DOCUMENTS
(65)
Prior Publication Data
US 2005/0286713 A1
JP
Dec. 29, 2005
2004303349 A
10/2004
* Cited by examiner
Related US. Application Data
Primary ExamineriMattheW D Anderson
Assistant ExamineriApril G Gonzales
(74) Attorney Agent] or FirmiBrOOks Kushman RC'
(60)
Provisional application No. 60/577,631, ?led on Jun.
7, 2004.
(51)
Int. Cl.
H04B 7/00
(200601)
Sound quality is enhanced in a sound system including hand
(52)
us. Cl. ................. .. 455/509; 455/631; 455/569.1;
455/5752, 455/41'2 4556561, 37969004,
sets and headsets- Handset sound enhancing algorithms are
implemented in a handset. The handset automatically deter
(57)
379/406 0’4_ 379/38’7 01_ 381/163_ 381/71 6?
' ’
nliines 12131111011, ifany, ofaplpragiity ofheadset soundenhanlfirlilg
381/74; 381/92; 381/98; 704/270; 715/255
hag-hdset. The handset determines hoW to use the handset
'
(58)
ABSTRACT
’
'
’
’
a
orit
s are active in a
ea set in communication Wit
t e
Field of Classi?cation Search .............. .. 455/63.1,
sound enhancing algorithms in a sound processing Channel
455/569-1, 575-2, 412, 556-1; 379/390-2,
379/406.04, 387.01, 390.04; 381/1, 71.6,
based on Which of the headset sound enhancing algorithms
are active in the headset.
381/74, 92, 98, 103; 704/270; 715/255
See application ?le for complete search history.
16 Claims, 6 Drawing Sheets
38
28 55
t
ak/fg 8% 24
SET DEFAULT
ALGORH'I'DVIS
38
K
“Mg 2. A )4.
20/
USE ALGORITHM m
HEADSET
USE ALGORITHM 1N
HANDSET
_____l______|
US. Patent
Dec. 21, 2010
Sheet 1 0f6
US 7,856,240 B2
38
38
20/
US. Patent
Dec. 21, 2010
Sheet 3 0f6
US 7,856,240 B2
START
NO
DETECT
HEADSET?
130
K134
NO
DETECT DISTRIBUTED
HEADSET?
SET DEFAULT
ALGORITHMS
1 32
ANY
REMAINING?
‘
136
HEADSET
SUPPORT MODE?
138
NO
YES
SUPERCEDE
HEADSET MODE?
142
“K
USE ALGORITI-HVI IN
HEADSET
Fig. 3
YES
144
v/
USE ALGORITHM IN
HANDSET
140
US. Patent
Dec. 21, 2010
Sheet 4 0f 6
US 7,856,240 B2
HEADSET A
HANDSET
80x
150
152
104
f
154
158
156
160
Fig. 4a
HANDSET
HEADSET B
/- 104
150
I
162
152
154
156
164
FEX
US. Patent
Dec. 21, 2010
Sheet 5 0f6
US 7,856,240 B2
/20
54
K- 72
[-172
SEND-SIDE
PROCESSING
SIGNAL
GENERATOR
[-170
VOCODER
SEND-SIDE
PROCESSING
f- 78
E]
r- 178
RECEIVE-SIDE
SIGNAL
EXTRACTOR
PROCESSING
‘DECODER
176
1?
60
RECEIVE-SIDE
PROCESSING
1 02
Fig. 5
US. Patent
Dec. 21, 2010
Sheet 6 0f6
START
190
DIVIDE SOUND
ENHANCEMENT INTO
COOPERATING SOUND
PROCESSING ALGORITHMS
1 92
CHARGE FOR USE OF SOUND
PROCESSING ALGORITHMS
IN HEADSETS
1 94
FREELY DISTRIBUTE SOUND
PROCESSING ALGORITHMS
FOR USE IN HANDSETS
END
Fig. 6
US 7,856,240 B2
US 7,856,240 B2
1
2
DISTRIBUTED SOUND ENHANCEMENT
enhancement algorithm in the suite can be either placed in
channel for sound processing or removed from in-channel
sound processing. Any of a plurality of headsets can commu
nicate With the handset. Each headset implements a headset
CROSS-REFERENCE TO RELATED
APPLICATIONS
suite of cooperating sound enhancement algorithms. Differ
This application claims the bene?t of US. provisional
application Ser. No. 60/577,631 ?led Jun. 7, 2004, titled
“Distributed Sound Enhancement,” Which is hereby incorpo
rated by reference in its entirety.
sound quality and cost in the headset market. When commu
nicating With a handset, each headset noti?es the handset of
BACKGROUND OF THE INVENTION
its headset suite. The handset selectively places each handset
sound enhancement algorithm in-channel based on receiving
ent headsets are capable of implementing different suites of
sound enhancement algorithms, permitting different levels
noti?cation of the headset suite for a headset in communica
tion With the handset.
1. Field of the Invention
The present invention relates to enhancing sound along
communication channels in multiple communication
In an embodiment of the present invention, at least one
headset does not implement a suite of cooperating sound
devices.
enhancement algorithms. The handset, When in communica
2. Background Art
Telecommunication devices are increasing in number,
tion With one of these headsets, is able to recognize that the
headset does not implement a suite of cooperating sound
functionality, portability and options provided. Telephones
may be interconnected by any combination of traditional
enhancement algorithms and to then selectively place prede
20
telephone Wires, Wireless radio signals, the Internet, satel
lites, and the like. Devices such as computers, personal digital
assistants (PDAs), entertainment systems, and the like, are
increasingly taking on communication functions traditionally
assigned to telephones. For example, automotive vehicles
incorporate telematics to provide communication services to
25
occupants including telephone calls, driver assistance, emer
gency location, entertainment, and the like.
Telecommunication devices operate in a Wide range of
environments. These environments can degrade or corrupt
enhancement algorithms from in-channel processing and/or
30
are implemented in a handset. Each handset sound enhancing
algorithm may be used in a sound processing channel. The
to bandWidth limitations, nonlinearities, line echo, sampling,
35
Many telecommunication devices incorporate sound
sound degrading effects. Often, the optimal place to locate
sound enhancement processing is as close to the end of the
40
is more optimally placed nearer to the source of the sound or
at the beginning of the communication channel. Still other
sound enhancing algorithms are active in the headset. Thus,
duplicative sound enhancement processing in both the hand
set and the headset is avoided.
In an embodiment of the present invention, the method
sound processing techniques are better placed Within the
further includes selectively enabling, disabling or modifying
45
the parameters of at least one headset sound enhancing algo
rithm in the headset based on a signal received from the
handset.
A method of reducing duplicative sound enhancement pro
ers. As telecommunication devices are made more complex
and powerful there is an increasing tendency to incorporate
handset automatically determines Which, if any, of a plurality
of headset sound enhancing algorithms are active in a headset
in communication With the handset. The handset determines
Which handset sound enhancing algorithms to use in the
sound processing channel based on Which of the headset
enhancement processing to correct or compensate for various
communication channel itself.
The proliferation of telecommunication devices has cre
ated a desire to mix and match various equipment. For
example, Wired and Wireless headsets are available for use
With many different types of telecommunications transceiv
signal transmitted from the handset.
A method for enhancing sound quality in a communication
system is also provided. Handset sound enhancing algorithms
transmission channel itself may distort the sound signal due
communication channel as possible. Some sound processing
based on the recognition.
In another embodiment of the present invention, each head
set in at least a subset of the headsets can either selectively
place at least one of the headset sound enhancement algo
rithms in the headset suite of cooperating sound enhancement
algorithms in-channel, remove the at least one sound
adjust at least one parameter in at least one headset algorithm.
This selection, removal and/ or adjustment may be based on a
sound quality through distortion of the sound signal, addition
of unwanted noise, acoustic echo, and the like. In addition, the
and the like.
termined handset sound enhancement algorithms in-channel
50
sound enhancement processing on each device. Thus it is
likely that sound enhancement efforts Will be duplicated on
cessing in a communication channel implemented in a hand
set and a headset in communication With the handset is also
provided. Sound enhancement processing is divided into a
plurality of cooperating algorithms. At least a subset of the
cooperating algorithms are implemented in the headset. An
indication of the implemented subset is transmitted from the
interconnected telecommunication devices that form a com
mon communication channel.
55
SUMMARY OF THE INVENTION
headset to the handset. This allows the handset to selectively
determine a second subset of the cooperating algorithms to
use in processing the communication channel so as to avoid
The present invention avoids duplicating sound enhance
repeating sound enhancement processing implemented in the
ment processing by selectively determining in Which device
devices include sound transducing devices, typically includ
headset.
In an embodiment of the present invention, a control signal
is received in the headset from the handset. At least one of the
ing one or more microphones and/ or speakers, and interface
cooperating algorithms in the headset is selectively disabled
devices capable of communicating over intercommunication
or adjusted based on the received control signal.
various sound enhancement algorithms Will be used. These
60
systems.
The present invention includes a system for enhancing
sound quality. A handset implements a handset suite of coop
erating sound enhancement algorithms. Each handset sound
65
A method of marketing sound enhancement technology is
also provided. The sound enhancement technology is divided
into a plurality of cooperating sound processing algorithms.
Each sound processing algorithm is capable of being selec
US 7,856,240 B2
3
4
tively added or removed from a sound processing channel. A
charge is collected for the use in at least one headset of at least
as personal digital assistants 36, personal computers 34,
headset in communication with the handset and selectively
entertainment systems such as MP3 players, hands-free kit in
vehicle 32, and the like.
Headsets 38 are typically designed to operate with a wide
variety of handset devices. Wired headsets 38 typically
include a standardized connector for plugging into, for
adds or removes each sound processing algorithm from a
example, wireless phone 30. Increasingly popular are hand
sound processing channel implemented within the handset
sets that include wireless link 40 for connection with headsets
38. The wireless link 40 may utilize infrared light, as speci?ed
in standards such as IrDA, or may utilize radio frequency
radiation, as speci?ed in standards such as Bluetooth, IEEE
802.11, IEEE 802.15, and the like.
a subset of the cooperating sound processing algorithms. The
plurality of sound processing algorithms are freely offered for
use in handsets. Each handset receives information from a
based on the received information.
The above objects and other objects, features, and advan
tages of the present invention are readily apparent from the
following detailed description of the best mode for carrying
Headsets 38 increasingly include functionality to improve
sound quality. This functionality may include sound enhance
out the invention when taken in connection with the accom
panying drawings.
ment processing such as acoustic echo canceling, noise can
cellation, frequency extension, dynamic audibility enhance
BRIEF DESCRIPTION OF THE DRAWINGS
ment, acoustic shock protection, and the like. Since headsets
38 are designed to work with various handsets, and since
these handsets may also implement sound enhancement pro
FIG. 1 is a block diagram illustrating a telecommunication
system capable of implementing the present invention;
20
FIG. 2 is a block diagram illustrating a handset and a
headset according to an embodiment of the present invention;
FIG. 3 is a ?ow diagram illustrating selecting sound
enhancement algorithms for processing according to an
embodiment of the present invention;
tion that often leads to poorer perceived sound quality than if
no enhancement processing had been performed. Therefore,
25
FIGS. 4a and 4b are block diagrams illustrating channel
?ow for different headsets according to an embodiment of the
present invention.
include adjusting parameters between corresponding algo
30
quality, shown generally by 50, includes a handset, shown
generally by 52, and a headset, shown generally by 38. Hand
set 52 typically includes at least one microphone 54 for con
headset 38 typically includes at least one microphone 58 and
at least one speaker 60. However, as will be recognized by one
of ordinary skill in the art, either device may include more
EMBODIMENT(S)
40
telecommunication system capable of implementing the
shown generally by 20, including interconnection system 22.
Interconnection system 22 can include one or more of wired
45
over IP, satellite communication, and the like. Telecommuni
cation devices connect to interconnection system 22 through
wireline connections 24 and/or wireless connections 26. Tele
communication devices include traditional wireline set 28,
necting handset 52 with interconnection system 22 through
wireline connection 24 or wireless connection 26. The
50
as MP3 players, hands-free kit in vehicle 32, and the like. For
simplicity, such devices will be referred to as handsets. Some
telecommunication devices connect to handsets via wired or
55
increased privacy, stereo audio reproduction, improved
microphones, improved speakers, and the like. For simplicity,
such devices will be referred to headsets 38.
Headset 38 typically includes at least one microphone and
at least one speaker. Multiple microphones may be included
for certain functionality, such as noise cancellation. Multiple
speakers may be included to provide stereo sound, provide
acoustic transducers with different frequency characteristics,
and the like. In addition to traditional microphone and
speaker combinations, headsets 38 may include any telecom
munications device receiving sound or producing sound, such
neither microphones nor speakers. As another example, head
set 38 may have multiple microphones for improved noise
cancellation.
Handset 52 typically includes system interface 62 for con
34, personal digital assistant 36, entertainment systems such
wireless links for the purpose of providing additional func
tionality such as hands free operation, increased mobility,
than one microphone, more than one speaker, no micro
phones or no speakers. For example, if system 50 is an enter
tainment system, such as an MP3 player, headset 38 may have
two speakers and no microphones and handset 52 may have
present invention is shown. A telecommunication system,
wireless set 30, telematics in vehicle 32, personal computer
verting sound into electrical signals and at least one speaker
56 for converting electrical signals into sound. Likewise,
DETAILED DESCRIPTION OF THE PREFERRED
telephone connections, wireless telephone connections, voice
handset and a headset according to an embodiment of the
present invention is shown. A system for enhancing sound
35
Referring now to FIG. 1, a block diagram illustrating a
in order to gain the fullest effects of headset and handset
interchangeability, control over which devices will apply
various enhancement algorithms is needed. This control may
rithms in the handset and headset.
Referring now to FIG. 2, a block diagram illustrating a
present invention;
FIG. 5 is a block diagram illustrating end-to-end commu
nication implementing sound enhancement according to an
embodiment of the present invention; and
FIG. 6 is a ?ow diagram illustrating sound enhancement
technology distribution according to an embodiment of the
cessing, duplication of sound processing functionality may
occur. This duplication can result in overprocessing, a condi
present invention will work with standard telecommunication
systems 22 for carrying voice and data as well as with systems
22 designed to carry only data or only voice signals. Handset
52 also includes wireless interface 63 for wirelessly commu
nicating with headset 38 over wireless link 40. As will be
recognized by one of ordinary skill in the art, wireless inter
face 63 may be replaced or augmented with a port for wired
connection to headset 38.
Handset 52 implements a collection of sound enhancement
60
algorithms. In the embodiment illustrated in FIG. 2, sound
enhancement is implemented on both send channel 64, initi
ated at microphone 54, and receive channel 66, terminated at
speaker 56. For send channel 64, sound signals are ?rst con
verted to electrical signals by microphone 54. Send-side con
ditioning 68, which may include ?lters, ampli?ers, an analog
65
to-digital converter (ADC), a time-to-frequency converter
(such as an FFT algorithm) and the like, prepare the micro
phone signal for send-side processing. Send side processing
US 7,856,240 B2
5
6
may include acoustic echo cancellation (ABC) 70, which
processes the outgoing and incoming signals to reduce acous
tic echoes caused by the environment in which handset 52 is
operating. Additional send-side processing 72 may include
automatic level tuning (ALT), noise cancellation (NC), com
Headset 38 includes wireless interface 90 for communicat
ing with wireless interface 63 on handset 52. Headset 38 may
also be connected to handset 52 with a wired connection. In
the embodiment of headset 38 illustrated in FIG. 2, wireless
interface 90 supports both send-side channel 64 and receive
side channel 66 within headset 38. Headset send-side channel
pression, spectral shaping, encoding, and the like.
64 includes send-side conditioning electronics 92 receiving
input from microphone 58. Headset ABC 94 reduces echoes
produced by the environment in which headset 38 is operat
ing. Additional headset send-side processing 96 may include
automatic level tuning (ALT), noise cancellation (NC), com
Handset receive-side channel 66 converts an analog elec
trical signal to sound using speaker 56. Receive-side condi
tioning 74 generates the analog signal using elements which
may include ?lters, ampli?ers, a digital-to-analog converter
(DAC), a frequency-to-time converter (such as an IFFT algo
rithm) and the like. Receive side processing may include
pression, spectral shaping, encoding, and the like. Headset
receive-side channel 66 drives headset speaker 60 from head
set receive-side conditioning 98. Headset FEX 100 provides
frequency expander 76 (FEX) for generating frequency com
ponents lost or attenuated by transmission through limited
bandwidth interconnection system 22. Additional receive
side processing 78 may include acoustic shock protection
(ASP), dynamic audibility enhancement (DAE), noise can
cellation (NC), automatic level tuning (ALT), decompres
sion, spectral shaping, decoding, and the like.
Together, send-side algorithms 70, 72 and receive-side
frequency expansion. Additional headset receive-side pro
cessing 102 may include acoustic shock protection (ASP),
dynamic audibility enhancement (DAE), noise cancellation
(NC), automatic level tuning (ALT), decompression, spectral
shaping, decoding, and the like. Collectively, sound enhance
20
ment algorithms 94, 96, 100, 102 make up a headset suite of
algorithms, shown generally by 104, which cooperate to
algorithms 76, 78 comprise a set or suite of handset sound
enhance one or both of send-side channel 64 and receive-side
enhancement algorithms, shown generally by 80, that coop
erate to improve the quality of sound generated by speaker 56
and/or received from microphone 54. Preferably, handset
suite 80 is implemented by a digital signal processor within
channel 66 in headset 38.
Various headsets 38 may be interfaced with handset 52.
25
handset 52. However, as will be recognized by one of ordinary
skill in the art, algorithms within suite 80 may be imple
mented by one or more of software executing on a processor,
discrete analog components, discrete digital components,
programmable logic devices, custom integrated circuits, and
the like. As will be described in greater detail below, algo
rithms within suite 80 may be selectively placed into or
removed from channels 64, 66. This switching may be
accomplished by various ?ow control commands in software
or by analog or digital switches in hardware, as is known in
the art. Switching includes the possibility of selecting
between algorithms within suite 80 for accomplishing the
same task. For example, suite 80 may implement different
noise cancellation algorithms for single microphone input,
dual microphone inputs and array microphone inputs.
headset 38 may implement a different noise cancellation
30
35
system as a whole. For example, sound quality drops when
40
45
50
side channel 64 from headset 38, or both over link 40. Typi
cally, receive-side channel 66 is sent either to speaker 56 in
handset 52 or over link 40 to speaker 60 on headset 38. Also,
55
microphone 54 on handset 52 or from microphone 58 on
60
54 on handset 52 and microphone 58 on headset 38 such as,
for example, to provide multiple microphones for noise can
cellation. In such systems, it may be desirable to locate
switches 82, 84 such that ABC 70 and FEX 76 do not affect
signals communicated between handset 52 and headset 38.
nels 64, 66 within handset 52 based on headset suite 104. In
the embodiment shown, wireless interface 90 on headset 38
noti?es wireless interface 63 on handset 52 over link 40 as to
mitting receive-side channel 66 to headset 38, receiving send
headset 38 over link 40. This selection is illustrated by logical
receive-side switch 82 and logical send-side switch 84,
respectively. However, it is possible to con?gure handset 52
for driving speaker 56 on handset 52 and speaker 60 on
headset 38 simultaneously. It is also possible to con?gure
handset 52 for receiving sound signals from both microphone
either or both of channels 64, 66 are over processed, resulting
in a perceived signal that is worse than if no sound enhance
ment processing had occurred at all.
To overcome the possibility of overprocessing while ?ex
ibly allowing various types of headsets 38 to be used with
handset 52, the present invention selectively processes chan
be set include time-domain ?lter coef?cients, frequency-do
typically, send-side channel 64 receives signals either from
include any elements of headset suite 104. The ?exibility of
placing different sound processing in headsets 38 and hand
sets 52 results in a potential performance cost. In particular,
the use of headset 38 together with handset 52 may duplicate
various sound enhancement operations. This duplication of
operations can have a sever impact on the performance of the
Switching also includes setting parameter values within one
the like.
Handset 64 includes wireless interface 63 capable of trans
algorithm than is implemented in handset 52. It is also pos
sible that some headsets 38 for use with handset 52 may not
or more algorithms of suite 80. Parameter values which may
main equalization coe?icients, noise cancellation decay fac
tors, weighting factors in signal summers, sampling rates,
number of frequency bins, ranges of frequency bins, time
window lengths, envelope shape coe?icients, bit rates, and
Each headset 38 may have different components making up
its headset suite 104. Also, different algorithms may be used
for corresponding elements in handset suite 80 and headset
suite 104 and amongst various headsets 38. For example,
65
the makeup of headset suite 104. Wireless interface 63 then
generates control signals 110 which selectively include or
exclude elements of handset suite 80 for processing channels
64 and 66 within handset 52.
Various schemes for notifying handset 52 about headset
suite 104 are possible. For example, each of a limited number
of con?gurations for headset suite 104 can be assigned an
identi?er which is transmitted over link 40. In another pos
sible scheme, a model number describing headset 38: is trans
mitted over link 40. Yet another scheme involves assigning
each algorithm class or mode a unique code. This code is
transmitted together with an identi?er for the speci?c algo
rithm within the mode. For example, noise cancellation,
acoustic shock protection and automatic level tuning are all
possible modes. Additional information may accompany
each code, such as version number, algorithm parameters,
sensed environmental parameters, sensed signal parameters,
and the like.
Various techniques for transmitting the noti?cation infor
mation from headset 38 to handset 52 are also possible. In
US 7,856,240 B2
7
8
band signaling may be used. For example, one or more low
38 or both, such as personal digital assistants, personal com
power watermark signals may be added to send-side channel
puters, personal entertainment systems, automotive electron
ics, and the like.
64 by headset wireless interface 90. These watermark signals
are read and, possibly, removed by wireless interface 63 in
handset 52. Another possibility is out-of-band signaling. This
Referring now to FIG. 3, a ?ow diagram illustrating select
ing sound enhancement algorithms for processing according
can include side bands or orthogonally modulated signals
to an embodiment of the present invention is shown. As will
transmitted over link 40, as is known in the art.
be appreciated by one of ordinary skill in the art, the opera
tions illustrated are not necessarily sequential operations. The
order of steps may be modi?ed within the spirit and scope of
the present invention and the order shown here is for logical
presentation. Also, the method illustrated may be imple
Another technique for transmitting noti?cation informa
tion utilizes the discovery process for establishing link 40
between headset 38 and handset 52. For example, the Blue
tooth standard includes a Service Discovery Application Pro
?le de?ning a Service Discovery Protocol (SDP). Handset 52
mented by any combination of hardware, software, ?rmware,
and the like, at one location or distributed. The present inven
functions as a Bluetooth local device and headset 38 as a
tion transcends any particular implementation and an
embodiment is shown in sequential ?ow chart form for ease of
illustration.
Bluetooth remote device. In these roles, handset 52 initiates a
service discovery procedure. Headset 38 responds to service
inquiries by supplying data from a service records database,
A check is made to determine if a headset is detected, as in
block 13 0. If the headset connects to the handset via a wireline
which may be implemented in nonvolatile memory within
headset wireless interface 90. Bluetooth supports various sce
narios including search for services by service class, search
for services by service attributes, and service browsing by
link, a jack switch may be used to determine the presence of
20
handset 52.
In addition to controlling algorithms in handset suite 80,
handset wireless interface 63 may also control operation of
algorithms in headset suite 104. Wireless interface 90 gener
ates control signals 112 for selectively controlling algorithms
repeats checking. This process may be implemented by poll
ing, interrupt processing, or the like.
25
in headset suite 104. After receiving information from head
set 38 about the contents of headset suit 104, handset wireless
interface 63 generates commands over link 40 instructing
headset wireless interface 90 as to which algorithms in head
set suite 104 to activate. This control may be used, for
example, to deactivate algorithms in headset suite 104 if
handset 52 determines handset suite 80 can provide superior
sound processing due to better algorithms, increased process
ing power, better information about the environment, and the
30
example, on the assumption that a linked headset that does not
support distributed sound enhancement processing performs
35
enhancement processing due to changes in conditions within
40
45
manner, wireless interface 63 may provide an indication as to
which algorithms in suite 80 and/or in suite 104 are being
used for sound enhancement. This indication can then be
sets 52 through interconnection system 22.
The embodiment illustrated in FIG. 2 shows two devices,
handset 52 and headset 38. However, the present invention
will work with various con?gurations. For example, a hands
free kit that accepts a wireless telephone can communicate
with a wearable headset. The hands-free kit could function as
handset 52, headset 38 or both. If the ?rst case, the hands-free
kit could interface a telephone that does not implement the
set mode, as in block 142. The handset may decide to use a
55
handset algorithm even if a corresponding headset algorithm
exists in the linked handset. This may occur, for example, if
the handset determines that the handset algorithm is superior,
that the handset possesses greater processing power, that the
handset algorithm is better matched to other sound enhance
ment algorithms selected for use, that the headset is low on
power, that the handset has better input signals for processing,
60
quality. In the second case, the hands-free kit could function
as a headset by supplying or connecting to one or more
Similarly, other devices may operate as handset 52, headset
or the like. If the handset mode supercedes the headset mode,
the corresponding handset algorithm is used, as in block 140.
If not, the corresponding headset algorithm is used, as in
block 144.
Referring now to FIGS. 4a and 4b, block diagrams illus
trating channel ?ow for different headsets according to an
embodiment of the present invention are shown. FIG. 4a
menting the present invention to interactively improve sound
microphones and speakers. The hands-free kit sends the tele
if the headset supports the mode, as in block 138. Typically,
the headset supports a mode if the headset signals an algo
rithm implementing the mode is executable on the headset. If
the headset does not support the mode, a corresponding hand
set algorithm is used, as in block 140.
If the headset supports the considered mode, a check is
made to determine if the handset should supercede the head
50
present invention or work together with a telephone imple
phone information about its sound processing capabilities.
modes are supported. This check is represented by the do
while loop implemented by block 136. Once all modes are
checked, sound enhancement initialization is complete and
coordinated sound processing may continue.
For each enhancement mode, a check is made to determine
and headset 38.
Handset wireless interface 63 may also communicate with
relayed through interconnection system 22 for end-to-end
setup of sound enhancement processing. Other information,
such as algorithm parameters, equipment identi?ers, operat
ing conditions, and the like, may also be sent between hand
no signi?cant sound enhancement processing.
If the linked headset supports distributed sound processing,
a check is made to determine which algorithm classes or
38 based on low battery indication signal 114. Control may
telephone system interface 62 overparameter link 116. In this
headset supports the present invention based on signals
received from the headset. If the headset does not support
distributed sound enhancement processing, the handset sets
its algorithms to a predetermined default con?guration, as in
block 134. This default con?guration may be based, for
headset 38 such as, for example, to conserve power in headset
headset suite 104. This may be used, for example, to permit
partial processing of the same type or mode in both handset 52
A check is made to determine if the connected headset
supports distributed sound enhancement processing, as in
block 132. The handset determines whether or not a linked
like. Handset 52 may also take over some or all sound
also be used to adjust parameters of one or more algorithms in
a headset. If the headset and the handset are wirelessly con
nectable, the presence of a wireless link to a headset provides
the necessary indication. If no headset is detected, the method
65
depicts handset suite 80 including algorithms for handset
acoustic shock prevention (ASP) 150, handset dynamic audi
bility enhancement (DAE) 152, handset noise cancellation
US 7,856,240 B2
9
10
(NC) 152 and handset frequency extension (FEX) 156. FIG.
411 also depicts Headset A suite 104 including algorithms for
cessing 102. Decoder 176 and signal extractor 178 may be
Headset A ASP 158 and Headset A FEX 160. Following
initialization, receive-side channel 66 is con?gured to drive
HeadsetA speaker 60 with a signal processed by handset ASP
face 63, or as separate components. In other implementations,
some or all of the functionality of decoder 176 and signal
extractor 178 may be implemented in headset 38.
150, handset DAE 152, Headset A NC 158 and Headset A
FEX 160. This con?guration results in noise cancellation and
performs one or more algorithms for noise removal tuned to
implemented in telephone system interface 62, wireless inter
In an exemplary application, send-side processing 72, 96
frequency extension being processed only at Headset A,
optimize the performance of vocoder 170, multi-band com
avoiding duplicative processing.
pression, time domain compression, spectral shaping for fre
quency band equalization, and/or other optimal pre-vocoder
processing. A recipe designator transmitted through intercon
nection system 22 characterizes pre-vocoder processing
FIG. 4b depicts the same handset suite 80 coupled with
headset suit 104 belonging to a different headset, Headset B.
Headset B suite 104 includes Headset BASP 162 and Headset
B FEX 164. In this case, following initialization, receive-side
channel 66 is con?gured to drive Headset B speaker 60 with
10
applied to the audio signal. Signal extractor 178 detects the
transmitted pre-vocoder processing recipe designator and
a signal processed by handset DAE 152, handset NC 154,
generates one or both of control signals 180, 182.
Headset B ASP 162 and Headset B FEX 164. Duplicative
Receive-side processing 78, 102 undertakes speci?c modi
?cations to produce a post-vocoder (and post transmission)
processing of acoustic shock prevention and frequency exten
sion is avoided by disabling these components in handset
suite 80.
Referring now to FIG. 5, a block diagram illustrating end
20
to-end communication implementing sound enhancement
according to an embodiment of the present invention is
shown. Experiments with both telephony vocoders and auto
mated voice recognition systems show that such systems can
be adversely affected by noise and that sound processing can
25
processing recipe that will be more optimal for a human
listener. For example, receive-side processing 78, 102 can
supply a small amount of additional noise removal, but with
out adding a great amount of additional noise reduction which
would be objectionable to a human listener. Other possibili
ties are that receive-side processing might completely or par
tially undo the multi-band compression, time domain com
pression, spectral shaping, and/or other pre-vocoder
improve the performance of such systems. However, optimal
processing applied to optimize performance of vocoder 170.
sound processing algorithms, such as noise cancellation, for
The present invention permits one or both of optimize the
signal for vocoding and transmission on the send side as well
as optimizing the received signal for human comfort on the
receive side. Additional bene?t may be achieved in duplex
use with automated recognition systems and vocoders may
differ from optimal algorithms for use with human listeners.
Furthermore, what is optimal prior to transmission over inter
connection channel 22, which may perform its own process
30
interconnection channels 22 by communicating receive-side
processing 78, 102 to the receive side for affecting send-side
ing, may differ from what is optimal after such transmission.
Transmission over interconnection system 22 is improved by
using information about send-side processing 72, 96 in deter
mining one or both of receive-side processing 78 and receive
processing 72, 96, permitting appropriate corrective and/or
enhancement processing.
40
Referring now to FIG. 6, a ?ow diagram illustrating sound
enhancement technology distribution according to an
embodiment of the present invention is shown. Once again,
the operations illustrated are not necessarily sequential opera
tions. The order of steps may be modi?ed within the spirit and
scope of the present invention and the order shown here is for
45
particular implementation and an embodiment is shown in
sequential ?ow chart form for ease of illustration.
Bene?ts of the present invention are most fully realized if
both handset manufacturers and headset manufacturers agree
35
side processing 102.
In an embodiment, handset 52 includes vocoder 170
encoding signals generated from one or both of handset
microphone 54 and headset microphone 58. Signal generator
172 generates a signal indicative of handset send-side pro
logical presentation. The present invention transcends any
cessing 72 and, if used, headset send-side processing 96. The
output of signal generator 172 may be, for example, a pro
cessed audio signal including one or more low power water
mark signals indicating the processing performed, indicated
by intercommunication signal 174. Signal generator 172 may
also use out-of-band signaling and/or signaling used in initi
on implementation details such as suite contents, format and
ating a connection over interconnection system 22. With ref
erence as well to FIG. 2, signal generator 172 may be imple
methodology of information exchanged between handsets 52
and headsets 38, and the like. Handset manufacturers domi
nate the market, often setting standards independently or as
mented as part of telephone system interface 62, wireless
interface 63 or as a separate component. Signal generator 172
may receive information about one or both of handset send
50
subsets of the entire industry. While it is possible to imple
ment different standards within each headset 38 to support
side processing 72 and headset send-side processing 96 from
each handset manufacturer, cost and complexity will be
wireless interface 63. It is also possible to locate some or all
reduced if common implementation details are adopted.
One initial step is to divide sound enhancement into coop
of the functionality of signal generator 172 and vocoder 170
in headset 38.
In the embodiment shown in FIG. 5, intercommunication
55
signal 174 is received by decoder 176 and signal extractor 178
erating sound processing algorithms, as in block 190. Sound
enhancement may be partitioned based on functionality, such
in a receiving handset 52. Decoder 176 decodes intercommu
nication signal 174. Signal extractor 178 extracts information
as noise cancellation, acoustic shock prevention, echo can
cellation, and the like. Sound enhancement may also be par
titioned based on implementation, such as those algorithms
about send-side processing 72, 96 from intercommunication
implemented analogly or in particular processors. Still
signal 174. Signal extractor 178 uses information about send
side processing 72, 96 to determine handset receive-side pro
another set of partitions may be based on cost or performance
thresholds. For example, a base headset may have no built-in
cessing 78 and, if applicable, headset receive-side processing
processing. The next level up may include only echo cancel
lation. The next level up might add noise cancellation and
frequency extension. The next level up might add acoustic
102. Signal extractor 178 generates control signal 180 indi
cation the operation of handset receive-side processing 78.
Signal extractor 178 generates control signal 182, sent over
link 40, indicating the operation of headset receive-side pro
65
shock protection. Once partitioning is decided, sound
enhancement processing suites can be developed.
US 7,856,240 B2
11
12
A charge Will be included for the use of sound processing
algorithms in headsets, as in block 192. Headsets 38 includ
ing sound enhancement suites 104 according to the present
communication With the handset for controlling selectively
placing or removing the at least one headset sound enhancing
invention Will provide superior sound quality and ?exibility
5. A system for enhancing sound quality as in claim 1
Wherein the handset is further operative to adjust the opera
algorithm.
to users. Users Will recognize these bene?ts and absorb the
tion of the handset suite based on a signal received from the
cost of implementing the present invention.
Sound processing algorithms for use in handsets Will be
freely distributed, as in block 194. If freely available, handset
manufacturers Will incorporate the present invention into
handsets 52 since handset suite 80 Will improve the perfor
headset describing an operating condition of the headset.
6. A system for enhancing sound quality as in claim 1
Wherein the handset is a ?rst handset, the system further
comprising a second handset in communication With the ?rst
handset, the ?rst handset further operative to transmit infor
mation to the second handset indicative of each handset sound
mance of handset 52 Whether or not handset 52 is connected
to headset 38. In addition, the inclusion of handset suite 80
Will provide increased ?exibility for use of handset 52 With a
enhancement algorithm placed in-channel.
Wider variety of headsets 38.
While embodiments of the invention have been illustrated
and described, it is not intended that these embodiments
illustrate and describe all possible forms of the invention.
Rather, the words used in the speci?cation are words of
description rather than limitation, and it is understood that
various changes may be made Without departing from the
spirit and scope of the invention.
20
7. A system for enhancing sound quality as in claim 6
Wherein the second handset is operative to determine opera
tion of receive-side sound enhancement processing based on
the information transmitted from the ?rst handset.
8. A system for enhancing sound quality as in claim 6
Wherein the second handset is operative to determine opera
tion of send-side sound enhancement processing based on the
information transmitted from the ?rst handset.
9. A system for enhancing sound quality, the system com
prising:
What is claimed is:
a handset implementing a handset suite of cooperating
1. A system for enhancing sound quality comprising:
sound enhancement algorithms, each handset sound
enhancement algorithm in the suite of handset sound
a handset implementing a handset suite of cooperating
enhancement algorithms operative to be either placed
sound enhancement algorithms, each handset sound
enhancement algorithm in the suite of handset sound
enhancement algorithms operative to be either placed
in-channel for sound processing or removed from in
30
channel sound processing; and
a plurality of headsets, each headset of the plurality of
headsets capable of operating in communication With
the handset, each headset implementing a headset suite
of cooperating sound enhancement algorithms that is
cooperating sound enhancement algorithms, the headset
operative to notify the handset of its headset suite of
cooperating sound enhancement algorithms; and
the handset operative to selectively place each handset
different from a second suite of cooperating sound
enhancement algorithms implemented in a different
headset, each headset operative to notify the handset of
its headset suite of cooperating sound enhancement
40
a second headset capable of operating in communication
With the handset, the second headset not implementing a
the handset operative to selectively place each handset
one headset that does not implement a suite of cooperating
sound enhancement algorithm in-channel based on
receiving noti?cation of the headset suite for the headset
in communication With the handset.
10. A system for enhancing sound quality as in claim 9
further comprising:
algorithms;
sound enhancement algorithm in-channel based on
receiving noti?cation of the headset suite for each of the
plurality of headsets in communication With the handset.
2. A system for enhancing sound quality as in claim 1
Wherein the plurality of headsets further comprises at least
channel sound processing;
a headset capable of operating in communication With the
handset, the headset implementing a headset suite of
in-channel for sound processing or removed from in
45
suite of cooperating sound enhancement algorithms;
and
the handset, When in communication With the second head
set, being further operative to recognize that the second
headset does not implement a suite of cooperating sound
50
enhancement algorithms and to selectively place prede
sound enhancement algorithms and Wherein the handset,
termined handset sound enhancement algorithms
When in communication With the at least one headset, is
further operative to recognize that the at least one headset
does not implement a suite of cooperating sound enhance
in-channel based on the recognition.
11. A system for enhancing sound quality as in claim 9
Wherein the headset is operative to either selectively place at
least one of the headset sound enhancement algorithms in the
ment algorithms and to selectively place predetermined hand
55
set sound enhancement algorithms in-channel based on the
headset suite of cooperating sound enhancement algorithms
recognition.
in-channel or to selectively remove the at least one of the
3. A system for enhancing sound quality as in claim 1
Wherein, for at least a subset of the plurality of headsets, each
headset is operative to either selectively place at least one of
the headset sound enhancement algorithms in the headset
headset sound enhancement algorithms from in-channel pro
cessing.
60
12. A system for enhancing sound quality as in claim 11
Wherein the handset is further operative to transmit a signal to
suite of cooperating sound enhancement algorithms in-chan
the headset for controlling selectively placing or removing
nel or to selectively remove the at least one headset sound
the at least one headset sound enhancing algorithm.
13. A system for enhancing sound quality as in claim 9
Wherein the handset is further operative to adjust the opera
tion of the handset suite based on a signal received from the
headset describing an operating condition of the headset.
enhancement algorithms from in-channel processing.
4. A system for enhancing sound quality as in claim 3
Wherein the handset is further operative to transmit a signal to
each headset in the subset of the plurality of headsets in
65
US 7,856,240 B2
13
14
14. A system for enhancing sound quality as in claim 9
wherein the handset is a ?rst handset, the system further
comprising a second handset in communication With the ?rst
handset, the ?rst handset further operative to transmit infor
mation to the second handset indicative of each handset sound
tion of receive-side sound enhancement processing based on
the information transmitted from the ?rst handset.
16. A system for enhancing sound quality as in claim 14
Wherein the second handset is operative to determine opera
tion of send-side sound enhancement processing based on the
information transmitted from the ?rst handset.
enhancement algorithm placed in-channel.
15. A system for enhancing sound quality as in claim 14
Wherein the second handset is operative to determine opera
Was this manual useful for you? yes no
Thank you for your participation!

* Your assessment is very important for improving the work of artificial intelligence, which forms the content of this project

Download PDF

advertisement