“Mg 2. A )4.
(12) Unlted States Patent
Gunn et a].
(10) Patent N0.: US 7,856,240 B2
(45) Date of Patent: Dec. 21, 2010
(54) DISTRIBUTED SOUND ENHANCEMENT
(75) Inventors: Raymond W. Gunn, Shelby Township,
MI (US); MichaelA-Hayes, Bloom?eld
Hills, MI (US)
_ _ _
(73) ASSlgneei Clarlty Technologles, 1119-, Troy, MI
(*) Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35
(21) APPLNO': 10/896300
(22) Filed: Jul. 21, 2004
(56) References Cited
U'S' PATENT DOCUMENTS
5,892,830 A * 4/1999 Klayman ..................... .. 381/1
6,597,791 B1* 7/2003 Klayman ..................... .. 381/1
7,039,179 B1* 5/2006 Gerhardt 6t a1. ...... .. 379/390.02
7,136,684 B2* 11/2006 Matsuura 6161. ....... .. 455/5752
7,283,635 B1* 10/2007 Andersonetal. ........... ..381/74
2003/0130016 A1* 7/2003 Matsuuraetal. .... .. 455/569
2004/0005063 A1* 1/2004 Klayman ..................... .. 381/1
2004/0015775 A1* 1/2004 Simske et a1. ............. .. 715/500
2005/0286713 A1* 12/2005 Gunn etal. ..... .. . 379/406.04
2007/0053522 A1* 3/2007 Murrayetal. .... .. 381/71.6
2007/0147633 A1* 6/2007 Burger ........... ..
2008/0013741 A1 * 1/2008 Klayman
2008/0103776 A1 * 5/2008 Kumar et a1. ............. .. 704/270
FOREIGN PATENT DOCUMENTS
2004303349 A 10/2004
* Cited by examiner
(65) Prior Publication Data
US 2005/0286713 A1 Dec. 29, 2005
Related US. Application Data
(60) Provisional application No. 60/577,631, ?led on Jun. (74) Attorney Agent] or FirmiBrOOks Kushman RC'
(51) Int. Cl.
H04B 7/00 (200601) Sound quality is enhanced in a sound system including hand
(52) us. Cl. ................. .. 455/509; 455/631; 455/569.1; sets and headsets- Handset sound enhancing algorithms are
455/5752, 455/41'2 4556561, 37969004, implemented in a handset. The handset automatically deter
379/406 0’4_ 379/38’7 01_ 381/163_ 381/71 6? nliines 12131111011, ifany, ofaplpragiity ofheadset soundenhanlfirlilg
' ’ ' ’ ’ ' ’ a orit s are active in a ea set in communication
381/74; 381/92; 381/98; 704/270; 715/255 hag-hdset. The handset determines hoW to use the handset
(58) Field of Classi?cation Search .............. .. 455/63.1, sound enhancing algorithms in a sound processing Channel
455/569-1, 575-2, 412, 556-1; 379/390-2, based on Which of the headset sound enhancing algorithms
379/406.04, 387.01, 390.04; 381/1, 71.6, are active in the headset.
381/74, 92, 98, 103; 704/270; 715/255
See application ?le for complete search history. 16 Claims, 6 Drawing Sheets
28 55 ak/fg 8% 24
“Mg 2. A )4.
USE ALGORITHM m
USE ALGORITHM 1N
US. Patent Dec. 21, 2010 Sheet 1 0f6
US 7,856,240 B2
US. Patent Dec. 21, 2010 Sheet 3 0f6
US 7,856,240 B2
USE ALGORITI-HVI IN
USE ALGORITHM IN
Dec. 21, 2010
Sheet 4 0f 6
US 7,856,240 B2
US. Patent Dec. 21, 2010 Sheet 5 0f6
54 K- 72
US 7,856,240 B2
60 1 02
US. Patent Dec. 21, 2010 Sheet 6 0f6
CHARGE FOR USE OF SOUND
US 7,856,240 B2
FREELY DISTRIBUTE SOUND
FOR USE IN HANDSETS
US 7,856,240 B2
1 2 enhancement algorithm in the suite can be either placed in channel for sound processing or removed from in-channel sound processing. Any of a plurality of headsets can commu CROSS-REFERENCE TO RELATED
APPLICATIONS nicate With the handset. Each headset implements a headset suite of cooperating sound enhancement algorithms. Differ
This application claims the bene?t of US. provisional application Ser. No. 60/577,631 ?led Jun. 7, 2004, titled
“Distributed Sound Enhancement,” Which is hereby incorpo rated by reference in its entirety.
BACKGROUND OF THE INVENTION ent headsets are capable of implementing different suites of sound enhancement algorithms, permitting different levels sound quality and cost in the headset market. When commu nicating With a handset, each headset noti?es the handset of its headset suite. The handset selectively places each handset sound enhancement algorithm in-channel based on receiving noti?cation of the headset suite for a headset in communica
1. Field of the Invention
The present invention relates to enhancing sound along communication channels in multiple communication tion With the handset.
In an embodiment of the present invention, at least one headset does not implement a suite of cooperating sound devices.
2. Background Art enhancement algorithms. The handset, When in communica tion With one of these headsets, is able to recognize that the
Telecommunication devices are increasing in number,
functionality, portability and options provided. Telephones
headset does not implement a suite of cooperating sound
enhancement algorithms and to then selectively place prede
may be interconnected by any combination of traditional
telephone Wires, Wireless radio signals, the Internet, satel
lites, and the like. Devices such as computers, personal digital
20 termined handset sound enhancement algorithms in-channel based on the recognition. assistants (PDAs), entertainment systems, and the like, are increasingly taking on communication functions traditionally assigned to telephones. For example, automotive vehicles incorporate telematics to provide communication services to
occupants including telephone calls, driver assistance, emer
gency location, entertainment, and the like.
Telecommunication devices operate in a Wide range of environments. These environments can degrade or corrupt
30 sound quality through distortion of the sound signal, addition of unwanted noise, acoustic echo, and the like. In addition, the transmission channel itself may distort the sound signal due
In another embodiment of the present invention, each head set in at least a subset of the headsets can either selectively
25 place at least one of the headset sound enhancement algo rithms in the headset suite of cooperating sound enhancement algorithms in-channel, remove the at least one sound enhancement algorithms from in-channel processing and/or adjust at least one parameter in at least one headset algorithm.
This selection, removal and/ or adjustment may be based on a signal transmitted from the handset.
system is also provided. Handset sound enhancing algorithms
are implemented in a handset. Each handset sound enhancing to bandWidth limitations, nonlinearities, line echo, sampling, and the like.
Many telecommunication devices incorporate sound enhancement processing to correct or compensate for various sound degrading effects. Often, the optimal place to locate sound enhancement processing is as close to the end of the
35 algorithm may be used in a sound processing channel. The handset automatically determines Which, if any, of a plurality of headset sound enhancing algorithms are active in a headset in communication With the handset. The handset determines
Which handset sound enhancing algorithms to use in the sound processing channel based on Which of the headset communication channel as possible. Some sound processing
40 is more optimally placed nearer to the source of the sound or at the beginning of the communication channel. Still other sound enhancing algorithms are active in the headset. Thus, duplicative sound enhancement processing in both the hand set and the headset is avoided. sound processing techniques are better placed Within the communication channel itself.
The proliferation of telecommunication devices has cre
In an embodiment of the present invention, the method
further includes selectively enabling, disabling or modifying
the parameters of at least one headset sound enhancing algo ated a desire to mix and match various equipment. For example, Wired and Wireless headsets are available for use
With many different types of telecommunications transceiv ers. As telecommunication devices are made more complex and powerful there is an increasing tendency to incorporate sound enhancement processing on each device. Thus it is likely that sound enhancement efforts Will be duplicated on
50 set and a headset in communication With the handset is also provided. Sound enhancement processing is divided into a plurality of cooperating algorithms. At least a subset of the interconnected telecommunication devices that form a com cessing in a communication channel implemented in a hand cooperating algorithms are implemented in the headset. An mon communication channel. rithm in the headset based on a signal received from the handset.
55 indication of the implemented subset is transmitted from the headset to the handset. This allows the handset to selectively determine a second subset of the cooperating algorithms to
The present invention avoids duplicating sound enhance
ment processing by selectively determining in Which device
various sound enhancement algorithms Will be used. These
60 devices include sound transducing devices, typically includ ing one or more microphones and/ or speakers, and interface devices capable of communicating over intercommunication
The present invention includes a system for enhancing
65 use in processing the communication channel so as to avoid
repeating sound enhancement processing implemented in the
In an embodiment of the present invention, a control signal is received in the headset from the handset. At least one of the cooperating algorithms in the headset is selectively disabled or adjusted based on the received control signal. erating sound enhancement algorithms. Each handset sound also provided. The sound enhancement technology is divided into a plurality of cooperating sound processing algorithms.
Each sound processing algorithm is capable of being selec
US 7,856,240 B2
3 tively added or removed from a sound processing channel. A a subset of the cooperating sound processing algorithms. The plurality of sound processing algorithms are freely offered for use in handsets. Each handset receives information from a headset in communication with the handset and selectively adds or removes each sound processing algorithm from a sound processing channel implemented within the handset based on the received information.
as personal digital assistants 36, personal computers 34,
entertainment systems such as MP3 players, hands-free kit in vehicle 32, and the like.
Headsets 38 are typically designed to operate with a wide variety of handset devices. Wired headsets 38 typically include a standardized connector for plugging into, for example, wireless phone 30. Increasingly popular are hand sets that include wireless link 40 for connection with headsets
The above objects and other objects, features, and advan tages of the present invention are readily apparent from the following detailed description of the best mode for carrying out the invention when taken in connection with the accom panying drawings.
BRIEF DESCRIPTION OF THE DRAWINGS in standards such as IrDA, or may utilize radio frequency radiation, as speci?ed in standards such as Bluetooth, IEEE
802.11, IEEE 802.15, and the like.
Headsets 38 increasingly include functionality to improve sound quality. This functionality may include sound enhance ment processing such as acoustic echo canceling, noise can
cellation, frequency extension, dynamic audibility enhance
ment, acoustic shock protection, and the like. Since headsets
FIG. 1 is a block diagram illustrating a telecommunication
system capable of implementing the present invention;
38 are designed to work with various handsets, and since these handsets may also implement sound enhancement pro
cessing, duplication of sound processing functionality may
FIG. 2 is a block diagram illustrating a handset and a occur. This duplication can result in overprocessing, a condi headset according to an embodiment of the present invention; tion that often leads to poorer perceived sound quality than if
FIG. 3 is a ?ow diagram illustrating selecting sound no enhancement processing had been performed. Therefore, enhancement algorithms for processing according to an in order to gain the fullest effects of headset and handset embodiment of the present invention;
25 interchangeability, control over which devices will apply
FIGS. 4a and 4b are block diagrams illustrating channel
?ow for different headsets according to an embodiment of the various enhancement algorithms is needed. This control may
include adjusting parameters between corresponding algo present invention;
rithms in the handset and headset.
FIG. 5 is a block diagram illustrating end-to-end commu nication implementing sound enhancement according to an
Referring now to FIG. 2, a block diagram illustrating a handset and a headset according to an embodiment of the embodiment of the present invention; and present invention is shown. A system for enhancing sound
quality, shown generally by 50, includes a handset, shown
FIG. 6 is a ?ow diagram illustrating sound enhancement generally by 52, and a headset, shown generally by 38. Hand technology distribution according to an embodiment of the set 52 typically includes at least one microphone 54 for con present invention.
35 verting sound into electrical signals and at least one speaker
DETAILED DESCRIPTION OF THE PREFERRED
56 for converting electrical signals into sound. Likewise, headset 38 typically includes at least one microphone 58 and at least one speaker 60. However, as will be recognized by one
Referring now to FIG. 1, a block diagram illustrating a
telecommunication system capable of implementing the
present invention is shown. A telecommunication system, of ordinary skill in the art, either device may include more than one microphone, more than one speaker, no micro phones or no speakers. For example, if system 50 is an enter
shown generally by 20, including interconnection system 22.
Interconnection system 22 can include one or more of wired two speakers and no microphones and handset 52 may have neither microphones nor speakers. As another example, head
telephone connections, wireless telephone connections, voice
45 over IP, satellite communication, and the like. Telecommuni set 38 may have multiple microphones for improved noise cation devices connect to interconnection system 22 through cancellation.
Handset 52 typically includes system interface 62 for con wireline connections 24 and/or wireless connections 26. Tele necting handset 52 with interconnection system 22 through communication devices include traditional wireline set 28, wireline connection 24 or wireless connection 26. The wireless set 30, telematics in vehicle 32, personal computer
34, personal digital assistant 36, entertainment systems such
present invention will work with standard telecommunication systems 22 for carrying voice and data as well as with systems as MP3 players, hands-free kit in vehicle 32, and the like. For
22 designed to carry only data or only voice signals. Handset simplicity, such devices will be referred to as handsets. Some
52 also includes wireless interface 63 for wirelessly commu telecommunication devices connect to handsets via wired or nicating with headset 38 over wireless link 40. As will be wireless links for the purpose of providing additional func
55 recognized by one of ordinary skill in the art, wireless inter tionality such as hands free operation, increased mobility,
increased privacy, stereo audio reproduction, improved
face 63 may be replaced or augmented with a port for wired connection to headset 38.
microphones, improved speakers, and the like. For simplicity,
Handset 52 implements a collection of sound enhancement such devices will be referred to headsets 38. algorithms. In the embodiment illustrated in FIG. 2, sound
Headset 38 typically includes at least one microphone and
60 at least one speaker. Multiple microphones may be included for certain functionality, such as noise cancellation. Multiple speakers may be included to provide stereo sound, provide enhancement is implemented on both send channel 64, initi ated at microphone 54, and receive channel 66, terminated at speaker 56. For send channel 64, sound signals are ?rst con verted to electrical signals by microphone 54. Send-side con acoustic transducers with different frequency characteristics, and the like. In addition to traditional microphone and
65 ditioning 68, which may include ?lters, ampli?ers, an analog to-digital converter (ADC), a time-to-frequency converter speaker combinations, headsets 38 may include any telecom munications device receiving sound or producing sound, such
(such as an FFT algorithm) and the like, prepare the micro
phone signal for send-side processing. Send side processing
US 7,856,240 B2
5 6 may include acoustic echo cancellation (ABC) 70, which processes the outgoing and incoming signals to reduce acous
Headset 38 includes wireless interface 90 for communicat ing with wireless interface 63 on handset 52. Headset 38 may tic echoes caused by the environment in which handset 52 is also be connected to handset 52 with a wired connection. In operating. Additional send-side processing 72 may include automatic level tuning (ALT), noise cancellation (NC), com the embodiment of headset 38 illustrated in FIG. 2, wireless interface 90 supports both send-side channel 64 and receive
pression, spectral shaping, encoding, and the like.
side channel 66 within headset 38. Headset send-side channel
64 includes send-side conditioning electronics 92 receiving
Handset receive-side channel 66 converts an analog elec input from microphone 58. Headset ABC 94 reduces echoes trical signal to sound using speaker 56. Receive-side condi produced by the environment in which headset 38 is operat
tioning 74 generates the analog signal using elements which
ing. Additional headset send-side processing 96 may include may include ?lters, ampli?ers, a digital-to-analog converter
(DAC), a frequency-to-time converter (such as an IFFT algo rithm) and the like. Receive side processing may include automatic level tuning (ALT), noise cancellation (NC), com
pression, spectral shaping, encoding, and the like. Headset
receive-side channel 66 drives headset speaker 60 from head
frequency expander 76 (FEX) for generating frequency com
set receive-side conditioning 98. Headset FEX 100 provides ponents lost or attenuated by transmission through limited frequency expansion. Additional headset receive-side pro bandwidth interconnection system 22. Additional receive side processing 78 may include acoustic shock protection cessing 102 may include acoustic shock protection (ASP),
dynamic audibility enhancement (DAE), noise cancellation
(ASP), dynamic audibility enhancement (DAE), noise can cellation (NC), automatic level tuning (ALT), decompres
(NC), automatic level tuning (ALT), decompression, spectral
shaping, decoding, and the like. Collectively, sound enhance
sion, spectral shaping, decoding, and the like.
Together, send-side algorithms 70, 72 and receive-side
20 ment algorithms 94, 96, 100, 102 make up a headset suite of
algorithms, shown generally by 104, which cooperate to
algorithms 76, 78 comprise a set or suite of handset sound enhance one or both of send-side channel 64 and receive-side
enhancement algorithms, shown generally by 80, that coop
channel 66 in headset 38. erate to improve the quality of sound generated by speaker 56 and/or received from microphone 54. Preferably, handset
Various headsets 38 may be interfaced with handset 52.
Each headset 38 may have different components making up suite 80 is implemented by a digital signal processor within its headset suite 104. Also, different algorithms may be used handset 52. However, as will be recognized by one of ordinary skill in the art, algorithms within suite 80 may be imple for corresponding elements in handset suite 80 and headset suite 104 and amongst various headsets 38. For example, mented by one or more of software executing on a processor, headset 38 may implement a different noise cancellation
discrete analog components, discrete digital components, programmable logic devices, custom integrated circuits, and
30 the like. As will be described in greater detail below, algo rithms within suite 80 may be selectively placed into or algorithm than is implemented in handset 52. It is also pos sible that some headsets 38 for use with handset 52 may not include any elements of headset suite 104. The ?exibility of placing different sound processing in headsets 38 and hand removed from channels 64, 66. This switching may be accomplished by various ?ow control commands in software
35 or by analog or digital switches in hardware, as is known in the art. Switching includes the possibility of selecting between algorithms within suite 80 for accomplishing the sets 52 results in a potential performance cost. In particular, the use of headset 38 together with handset 52 may duplicate various sound enhancement operations. This duplication of operations can have a sever impact on the performance of the system as a whole. For example, sound quality drops when same task. For example, suite 80 may implement different
noise cancellation algorithms for single microphone input, dual microphone inputs and array microphone inputs.
40 either or both of channels 64, 66 are over processed, resulting in a perceived signal that is worse than if no sound enhance
Switching also includes setting parameter values within one ment processing had occurred at all.
To overcome the possibility of overprocessing while ?ex or more algorithms of suite 80. Parameter values which may ibly allowing various types of headsets 38 to be used with be set include time-domain ?lter coef?cients, frequency-do main equalization coe?icients, noise cancellation decay fac tors, weighting factors in signal summers, sampling rates, number of frequency bins, ranges of frequency bins, time
window lengths, envelope shape coe?icients, bit rates, and
the like. handset 52, the present invention selectively processes chan nels 64, 66 within handset 52 based on headset suite 104. In the embodiment shown, wireless interface 90 on headset 38 noti?es wireless interface 63 on handset 52 over link 40 as to the makeup of headset suite 104. Wireless interface 63 then generates control signals 110 which selectively include or
Handset 64 includes wireless interface 63 capable of trans mitting receive-side channel 66 to headset 38, receiving send side channel 64 from headset 38, or both over link 40. Typi cally, receive-side channel 66 is sent either to speaker 56 in
50 exclude elements of handset suite 80 for processing channels handset 52 or over link 40 to speaker 60 on headset 38. Also, typically, send-side channel 64 receives signals either from
55 microphone 54 on handset 52 or from microphone 58 on headset 38 over link 40. This selection is illustrated by logical
64 and 66 within handset 52.
Various schemes for notifying handset 52 about headset suite 104 are possible. For example, each of a limited number of con?gurations for headset suite 104 can be assigned an identi?er which is transmitted over link 40. In another pos sible scheme, a model number describing headset 38: is trans mitted over link 40. Yet another scheme involves assigning each algorithm class or mode a unique code. This code is receive-side switch 82 and logical send-side switch 84, respectively. However, it is possible to con?gure handset 52 for driving speaker 56 on handset 52 and speaker 60 on
60 headset 38 simultaneously. It is also possible to con?gure handset 52 for receiving sound signals from both microphone
54 on handset 52 and microphone 58 on headset 38 such as, for example, to provide multiple microphones for noise can cellation. In such systems, it may be desirable to locate
65 switches 82, 84 such that ABC 70 and FEX 76 do not affect transmitted together with an identi?er for the speci?c algo rithm within the mode. For example, noise cancellation, acoustic shock protection and automatic level tuning are all possible modes. Additional information may accompany each code, such as version number, algorithm parameters, sensed environmental parameters, sensed signal parameters, and the like.
Various techniques for transmitting the noti?cation infor signals communicated between handset 52 and headset 38. mation from headset 38 to handset 52 are also possible. In
US 7,856,240 B2
7 8 band signaling may be used. For example, one or more low power watermark signals may be added to send-side channel
38 or both, such as personal digital assistants, personal com puters, personal entertainment systems, automotive electron ics, and the like.
64 by headset wireless interface 90. These watermark signals are read and, possibly, removed by wireless interface 63 in handset 52. Another possibility is out-of-band signaling. This
Referring now to FIG. 3, a ?ow diagram illustrating select
ing sound enhancement algorithms for processing according
can include side bands or orthogonally modulated signals transmitted over link 40, as is known in the art.
Another technique for transmitting noti?cation informa tion utilizes the discovery process for establishing link 40 between headset 38 and handset 52. For example, the Blue tooth standard includes a Service Discovery Application Pro
?le de?ning a Service Discovery Protocol (SDP). Handset 52 functions as a Bluetooth local device and headset 38 as a to an embodiment of the present invention is shown. As will be appreciated by one of ordinary skill in the art, the opera tions illustrated are not necessarily sequential operations. The order of steps may be modi?ed within the spirit and scope of the present invention and the order shown here is for logical presentation. Also, the method illustrated may be imple mented by any combination of hardware, software, ?rmware, and the like, at one location or distributed. The present inven tion transcends any particular implementation and an embodiment is shown in sequential ?ow chart form for ease of
Bluetooth remote device. In these roles, handset 52 initiates a service discovery procedure. Headset 38 responds to service illustration. inquiries by supplying data from a service records database, which may be implemented in nonvolatile memory within block 13 0. If the headset connects to the handset via a wireline headset wireless interface 90. Bluetooth supports various sce narios including search for services by service class, search
for services by service attributes, and service browsing by
20 nectable, the presence of a wireless link to a headset provides handset 52. link, a jack switch may be used to determine the presence of a headset. If the headset and the handset are wirelessly con
In addition to controlling algorithms in handset suite 80, the necessary indication. If no headset is detected, the method
repeats checking. This process may be implemented by poll
handset wireless interface 63 may also control operation of ing, interrupt processing, or the like. algorithms in headset suite 104. Wireless interface 90 gener
ates control signals 112 for selectively controlling algorithms
A check is made to determine if the connected headset supports distributed sound enhancement processing, as in in headset suite 104. After receiving information from head block 132. The handset determines whether or not a linked set 38 about the contents of headset suit 104, handset wireless headset supports the present invention based on signals interface 63 generates commands over link 40 instructing headset wireless interface 90 as to which algorithms in head
30 received from the headset. If the headset does not support distributed sound enhancement processing, the handset sets set suite 104 to activate. This control may be used, for its algorithms to a predetermined default con?guration, as in example, to deactivate algorithms in headset suite 104 if block 134. This default con?guration may be based, for handset 52 determines handset suite 80 can provide superior example, on the assumption that a linked headset that does not sound processing due to better algorithms, increased process ing power, better information about the environment, and the like. Handset 52 may also take over some or all sound
support distributed sound enhancement processing performs
no signi?cant sound enhancement processing.
If the linked headset supports distributed sound processing, enhancement processing due to changes in conditions within a check is made to determine which algorithm classes or headset 38 such as, for example, to conserve power in headset modes are supported. This check is represented by the do
38 based on low battery indication signal 114. Control may also be used to adjust parameters of one or more algorithms in headset suite 104. This may be used, for example, to permit
40 while loop implemented by block 136. Once all modes are checked, sound enhancement initialization is complete and coordinated sound processing may continue.
For each enhancement mode, a check is made to determine and headset 38. if the headset supports the mode, as in block 138. Typically,
Handset wireless interface 63 may also communicate with telephone system interface 62 overparameter link 116. In this
45 manner, wireless interface 63 may provide an indication as to the headset supports a mode if the headset signals an algo rithm implementing the mode is executable on the headset. If the headset does not support the mode, a corresponding hand which algorithms in suite 80 and/or in suite 104 are being set algorithm is used, as in block 140. used for sound enhancement. This indication can then be relayed through interconnection system 22 for end-to-end setup of sound enhancement processing. Other information, such as algorithm parameters, equipment identi?ers, operat
If the headset supports the considered mode, a check is made to determine if the handset should supercede the head set mode, as in block 142. The handset may decide to use a handset algorithm even if a corresponding headset algorithm ing conditions, and the like, may also be sent between hand sets 52 through interconnection system 22. exists in the linked handset. This may occur, for example, if the handset determines that the handset algorithm is superior,
The embodiment illustrated in FIG. 2 shows two devices, handset 52 and headset 38. However, the present invention
55 will work with various con?gurations. For example, a hands free kit that accepts a wireless telephone can communicate that the handset possesses greater processing power, that the handset algorithm is better matched to other sound enhance ment algorithms selected for use, that the headset is low on power, that the handset has better input signals for processing, with a wearable headset. The hands-free kit could function as handset 52, headset 38 or both. If the ?rst case, the hands-free kit could interface a telephone that does not implement the
60 or the like. If the handset mode supercedes the headset mode, the corresponding handset algorithm is used, as in block 140.
If not, the corresponding headset algorithm is used, as in block 144. present invention or work together with a telephone imple menting the present invention to interactively improve sound quality. In the second case, the hands-free kit could function as a headset by supplying or connecting to one or more
Referring now to FIGS. 4a and 4b, block diagrams illus trating channel ?ow for different headsets according to an embodiment of the present invention are shown. FIG. 4a microphones and speakers. The hands-free kit sends the tele
phone information about its sound processing capabilities.
Similarly, other devices may operate as handset 52, headset
65 depicts handset suite 80 including algorithms for handset
acoustic shock prevention (ASP) 150, handset dynamic audi
bility enhancement (DAE) 152, handset noise cancellation
US 7,856,240 B2
(NC) 152 and handset frequency extension (FEX) 156. FIG.
Headset A ASP 158 and Headset A FEX 160. Following initialization, receive-side channel 66 is con?gured to drive
HeadsetA speaker 60 with a signal processed by handset ASP cessing 102. Decoder 176 and signal extractor 178 may be implemented in telephone system interface 62, wireless inter face 63, or as separate components. In other implementations, some or all of the functionality of decoder 176 and signal
150, handset DAE 152, Headset A NC 158 and Headset A
FEX 160. This con?guration results in noise cancellation and
frequency extension being processed only at Headset A,
avoiding duplicative processing.
FIG. 4b depicts the same handset suite 80 coupled with
10 extractor 178 may be implemented in headset 38.
In an exemplary application, send-side processing 72, 96 performs one or more algorithms for noise removal tuned to optimize the performance of vocoder 170, multi-band com
pression, time domain compression, spectral shaping for fre quency band equalization, and/or other optimal pre-vocoder
headset suit 104 belonging to a different headset, Headset B.
nection system 22 characterizes pre-vocoder processing
B FEX 164. In this case, following initialization, receive-side channel 66 is con?gured to drive Headset B speaker 60 with a signal processed by handset DAE 152, handset NC 154,
Headset B ASP 162 and Headset B FEX 164. Duplicative processing of acoustic shock prevention and frequency exten sion is avoided by disabling these components in handset suite 80. applied to the audio signal. Signal extractor 178 detects the
transmitted pre-vocoder processing recipe designator and
generates one or both of control signals 180, 182.
Receive-side processing 78, 102 undertakes speci?c modi
?cations to produce a post-vocoder (and post transmission) processing recipe that will be more optimal for a human listener. For example, receive-side processing 78, 102 can
Referring now to FIG. 5, a block diagram illustrating end to-end communication implementing sound enhancement
20 supply a small amount of additional noise removal, but with out adding a great amount of additional noise reduction which according to an embodiment of the present invention is shown. Experiments with both telephony vocoders and auto would be objectionable to a human listener. Other possibili ties are that receive-side processing might completely or par mated voice recognition systems show that such systems can be adversely affected by noise and that sound processing can
improve the performance of such systems. However, optimal
tially undo the multi-band compression, time domain com
pression, spectral shaping, and/or other pre-vocoder
processing applied to optimize performance of vocoder 170.
sound processing algorithms, such as noise cancellation, for use with automated recognition systems and vocoders may differ from optimal algorithms for use with human listeners.
Furthermore, what is optimal prior to transmission over inter
The present invention permits one or both of optimize the signal for vocoding and transmission on the send side as well as optimizing the received signal for human comfort on the
30 receive side. Additional bene?t may be achieved in duplex connection channel 22, which may perform its own process ing, may differ from what is optimal after such transmission.
Transmission over interconnection system 22 is improved by using information about send-side processing 72, 96 in deter interconnection channels 22 by communicating receive-side processing 78, 102 to the receive side for affecting send-side
processing 72, 96, permitting appropriate corrective and/or enhancement processing.
mining one or both of receive-side processing 78 and receive side processing 102.
In an embodiment, handset 52 includes vocoder 170
Referring now to FIG. 6, a ?ow diagram illustrating sound enhancement technology distribution according to an embodiment of the present invention is shown. Once again, the operations illustrated are not necessarily sequential opera encoding signals generated from one or both of handset
microphone 54 and headset microphone 58. Signal generator
172 generates a signal indicative of handset send-side pro cessing 72 and, if used, headset send-side processing 96. The
40 output of signal generator 172 may be, for example, a pro tions. The order of steps may be modi?ed within the spirit and scope of the present invention and the order shown here is for logical presentation. The present invention transcends any particular implementation and an embodiment is shown in cessed audio signal including one or more low power water
mark signals indicating the processing performed, indicated
sequential ?ow chart form for ease of illustration.
Bene?ts of the present invention are most fully realized if by intercommunication signal 174. Signal generator 172 may
45 also use out-of-band signaling and/or signaling used in initi ating a connection over interconnection system 22. With ref both handset manufacturers and headset manufacturers agree on implementation details such as suite contents, format and methodology of information exchanged between handsets 52 erence as well to FIG. 2, signal generator 172 may be imple mented as part of telephone system interface 62, wireless interface 63 or as a separate component. Signal generator 172
50 and headsets 38, and the like. Handset manufacturers domi nate the market, often setting standards independently or as subsets of the entire industry. While it is possible to imple may receive information about one or both of handset send side processing 72 and headset send-side processing 96 from ment different standards within each headset 38 to support each handset manufacturer, cost and complexity will be wireless interface 63. It is also possible to locate some or all of the functionality of signal generator 172 and vocoder 170 in headset 38.
55 reduced if common implementation details are adopted.
One initial step is to divide sound enhancement into coop erating sound processing algorithms, as in block 190. Sound enhancement may be partitioned based on functionality, such In the embodiment shown in FIG. 5, intercommunication signal 174 is received by decoder 176 and signal extractor 178 in a receiving handset 52. Decoder 176 decodes intercommu as noise cancellation, acoustic shock prevention, echo can cellation, and the like. Sound enhancement may also be par titioned based on implementation, such as those algorithms nication signal 174. Signal extractor 178 extracts information about send-side processing 72, 96 from intercommunication signal 174. Signal extractor 178 uses information about send implemented analogly or in particular processors. Still side processing 72, 96 to determine handset receive-side pro
cessing 78 and, if applicable, headset receive-side processing
102. Signal extractor 178 generates control signal 180 indi cation the operation of handset receive-side processing 78.
Signal extractor 178 generates control signal 182, sent over link 40, indicating the operation of headset receive-side pro
65 thresholds. For example, a base headset may have no built-in processing. The next level up may include only echo cancel lation. The next level up might add noise cancellation and frequency extension. The next level up might add acoustic shock protection. Once partitioning is decided, sound enhancement processing suites can be developed.
US 7,856,240 B2
11 12 communication With the handset for controlling selectively algorithms in headsets, as in block 192. Headsets 38 includ ing sound enhancement suites 104 according to the present placing or removing the at least one headset sound enhancing algorithm.
invention Will provide superior sound quality and ?exibility
5. A system for enhancing sound quality as in claim 1 to users. Users Will recognize these bene?ts and absorb the
Wherein the handset is further operative to adjust the opera cost of implementing the present invention. tion of the handset suite based on a signal received from the
Sound processing algorithms for use in handsets Will be headset describing an operating condition of the headset. freely distributed, as in block 194. If freely available, handset
6. A system for enhancing sound quality as in claim 1 manufacturers Will incorporate the present invention into
Wherein the handset is a ?rst handset, the system further handsets 52 since handset suite 80 Will improve the perfor comprising a second handset in communication With the ?rst mance of handset 52 Whether or not handset 52 is connected handset, the ?rst handset further operative to transmit infor mation to the second handset indicative of each handset sound to headset 38. In addition, the inclusion of handset suite 80
Will provide increased ?exibility for use of handset 52 With a
enhancement algorithm placed in-channel.
Wider variety of headsets 38.
7. A system for enhancing sound quality as in claim 6
While embodiments of the invention have been illustrated
Wherein the second handset is operative to determine opera tion of receive-side sound enhancement processing based on and described, it is not intended that these embodiments the information transmitted from the ?rst handset. illustrate and describe all possible forms of the invention.
Rather, the words used in the speci?cation are words of
20 description rather than limitation, and it is understood that various changes may be made Without departing from the
8. A system for enhancing sound quality as in claim 6
Wherein the second handset is operative to determine opera tion of send-side sound enhancement processing based on the spirit and scope of the invention. information transmitted from the ?rst handset. prising:
What is claimed is:
1. A system for enhancing sound quality comprising:
a handset implementing a handset suite of cooperating sound enhancement algorithms, each handset sound enhancement algorithm in the suite of handset sound enhancement algorithms operative to be either placed
30 in-channel for sound processing or removed from in channel sound processing; and a plurality of headsets, each headset of the plurality of headsets capable of operating in communication With the handset, each headset implementing a headset suite of cooperating sound enhancement algorithms that is its headset suite of cooperating sound enhancement algorithms;
2. A system for enhancing sound quality as in claim 1
Wherein the plurality of headsets further comprises at least one headset that does not implement a suite of cooperating
50 sound enhancement algorithms and Wherein the handset,
When in communication With the at least one headset, is a handset implementing a handset suite of cooperating sound enhancement algorithms, each handset sound enhancement algorithm in the suite of handset sound enhancement algorithms operative to be either placed in-channel for sound processing or removed from in channel sound processing; a headset capable of operating in communication With the handset, the headset implementing a headset suite of cooperating sound enhancement algorithms, the headset operative to notify the handset of its headset suite of
cooperating sound enhancement algorithms; and
the handset operative to selectively place each handset sound enhancement algorithm in-channel based on different from a second suite of cooperating sound enhancement algorithms implemented in a different headset, each headset operative to notify the handset of
40 the handset operative to selectively place each handset sound enhancement algorithm in-channel based on
45 receiving noti?cation of the headset suite for each of the plurality of headsets in communication With the handset. receiving noti?cation of the headset suite for the headset in communication With the handset.
10. A system for enhancing sound quality as in claim 9
a second headset capable of operating in communication
With the handset, the second headset not implementing a suite of cooperating sound enhancement algorithms; and the handset, When in communication With the second head set, being further operative to recognize that the second headset does not implement a suite of cooperating sound
enhancement algorithms and to selectively place prede
termined handset sound enhancement algorithms in-channel based on the recognition. further operative to recognize that the at least one headset does not implement a suite of cooperating sound enhance ment algorithms and to selectively place predetermined hand set sound enhancement algorithms in-channel based on the recognition.
11. A system for enhancing sound quality as in claim 9
Wherein the headset is operative to either selectively place at least one of the headset sound enhancement algorithms in the headset suite of cooperating sound enhancement algorithms in-channel or to selectively remove the at least one of the
3. A system for enhancing sound quality as in claim 1
Wherein, for at least a subset of the plurality of headsets, each headset is operative to either selectively place at least one of
60 the headset sound enhancement algorithms in the headset headset sound enhancement algorithms from in-channel pro cessing.
12. A system for enhancing sound quality as in claim 11
Wherein the handset is further operative to transmit a signal to suite of cooperating sound enhancement algorithms in-chan nel or to selectively remove the at least one headset sound the headset for controlling selectively placing or removing the at least one headset sound enhancing algorithm.
enhancement algorithms from in-channel processing.
4. A system for enhancing sound quality as in claim 3
Wherein the handset is further operative to transmit a signal to
13. A system for enhancing sound quality as in claim 9
Wherein the handset is further operative to adjust the opera tion of the handset suite based on a signal received from the each headset in the subset of the plurality of headsets in headset describing an operating condition of the headset.
US 7,856,240 B2
14. A system for enhancing sound quality as in claim 9 wherein the handset is a ?rst handset, the system further comprising a second handset in communication With the ?rst handset, the ?rst handset further operative to transmit infor mation to the second handset indicative of each handset sound
enhancement algorithm placed in-channel.
15. A system for enhancing sound quality as in claim 14
Wherein the second handset is operative to determine opera
14 tion of receive-side sound enhancement processing based on the information transmitted from the ?rst handset.
16. A system for enhancing sound quality as in claim 14
Wherein the second handset is operative to determine opera tion of send-side sound enhancement processing based on the information transmitted from the ?rst handset.
* Your assessment is very important for improving the work of artificial intelligence, which forms the content of this project