“Mg 2. A )4.

USOO7856240B2

(12) Unlted States Patent

Gunn et a].

(10) Patent N0.: US 7,856,240 B2

(45) Date of Patent: Dec. 21, 2010

(54) DISTRIBUTED SOUND ENHANCEMENT

(75) Inventors: Raymond W. Gunn, Shelby Township,

MI (US); MichaelA-Hayes, Bloom?eld

Hills, MI (US)

_ _ _

(73) ASSlgneei Clarlty Technologles, 1119-, Troy, MI

(Us)

(*) Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35

U_S_C_154(b)by1917days_

(21) APPLNO': 10/896300

_

(22) Filed: Jul. 21, 2004

(56) References Cited

U'S' PATENT DOCUMENTS

5,892,830 A * 4/1999 Klayman ..................... .. 381/1

6,597,791 B1* 7/2003 Klayman ..................... .. 381/1

7,039,179 B1* 5/2006 Gerhardt 6t a1. ...... .. 379/390.02

7,136,684 B2* 11/2006 Matsuura 6161. ....... .. 455/5752

7,283,635 B1* 10/2007 Andersonetal. ........... ..381/74

2003/0130016 A1* 7/2003 Matsuuraetal. .... .. 455/569

2004/0005063 A1* 1/2004 Klayman ..................... .. 381/1

2004/0015775 A1* 1/2004 Simske et a1. ............. .. 715/500

2005/0286713 A1* 12/2005 Gunn etal. ..... .. . 379/406.04

2007/0053522 A1* 3/2007 Murrayetal. .... .. 381/71.6

2007/0147633 A1* 6/2007 Burger ........... ..

2008/0013741 A1 * 1/2008 Klayman

. 381/92

381/1

2008/0103776 A1 * 5/2008 Kumar et a1. ............. .. 704/270

JP

FOREIGN PATENT DOCUMENTS

2004303349 A 10/2004

* Cited by examiner

(65) Prior Publication Data

US 2005/0286713 A1 Dec. 29, 2005

Related US. Application Data

(60) Provisional application No. 60/577,631, ?led on Jun. (74) Attorney Agent] or FirmiBrOOks Kushman RC'

7, 2004.

(57) ABSTRACT

(51) Int. Cl.

H04B 7/00 (200601) Sound quality is enhanced in a sound system including hand

(52) us. Cl. ................. .. 455/509; 455/631; 455/569.1; sets and headsets- Handset sound enhancing algorithms are

455/5752, 455/41'2 4556561, 37969004, implemented in a handset. The handset automatically deter

379/406 0’4_ 379/38’7 01_ 381/163_ 381/71 6? nliines 12131111011, ifany, ofaplpragiity ofheadset soundenhanlfirlilg

' ’ ' ’ ’ ' ’ a orit s are active in a ea set in communication

381/74; 381/92; 381/98; 704/270; 715/255 hag-hdset. The handset determines hoW to use the handset

(58) Field of Classi?cation Search .............. .. 455/63.1, sound enhancing algorithms in a sound processing Channel

455/569-1, 575-2, 412, 556-1; 379/390-2, based on Which of the headset sound enhancing algorithms

379/406.04, 387.01, 390.04; 381/1, 71.6, are active in the headset.

381/74, 92, 98, 103; 704/270; 715/255

See application ?le for complete search history. 16 Claims, 6 Drawing Sheets

28 55 ak/fg 8% 24

38

K

38 t

“Mg 2. A )4.

SET DEFAULT

ALGORH'I'DVIS

20/

USE ALGORITHM m

HEADSET

USE ALGORITHM 1N

HANDSET

_____l______|

US. Patent Dec. 21, 2010 Sheet 1 0f6

38

US 7,856,240 B2

20/

38

US. Patent Dec. 21, 2010 Sheet 3 0f6

START

US 7,856,240 B2

NO

DETECT

HEADSET?

130

1 32

DETECT DISTRIBUTED

HEADSET?

NO

K134

SET DEFAULT

ALGORITHMS

ANY

REMAINING? ‘

136

138

HEADSET

SUPPORT MODE?

YES

NO

YES SUPERCEDE

HEADSET MODE?

142

144

“K

USE ALGORITI-HVI IN

HEADSET

140

v/

USE ALGORITHM IN

HANDSET

Fig. 3

US. Patent

Dec. 21, 2010

80x

150

HANDSET

Sheet 4 0f 6

HEADSET A

US 7,856,240 B2

152

154

156

104 f

158

160

Fig. 4a

150

HANDSET

I

152

154

156

FEX

HEADSET B

162

164

US. Patent Dec. 21, 2010 Sheet 5 0f6

54 K- 72

SEND-SIDE

PROCESSING

US 7,856,240 B2

/20

[-172

SIGNAL

GENERATOR

[-170

VOCODER

SEND-SIDE

PROCESSING

f- 78

RECEIVE-SIDE

E] PROCESSING

SIGNAL

EXTRACTOR

‘DECODER

176

1?

RECEIVE-SIDE

PROCESSING

60 1 02

Fig. 5

US. Patent Dec. 21, 2010 Sheet 6 0f6

START

190

DIVIDE SOUND

ENHANCEMENT INTO

COOPERATING SOUND

PROCESSING ALGORITHMS

1 92

CHARGE FOR USE OF SOUND

PROCESSING ALGORITHMS

IN HEADSETS

US 7,856,240 B2

1 94

FREELY DISTRIBUTE SOUND

PROCESSING ALGORITHMS

FOR USE IN HANDSETS

END

Fig. 6

US 7,856,240 B2

1 2 enhancement algorithm in the suite can be either placed in channel for sound processing or removed from in-channel sound processing. Any of a plurality of headsets can commu CROSS-REFERENCE TO RELATED

APPLICATIONS nicate With the handset. Each headset implements a headset suite of cooperating sound enhancement algorithms. Differ

This application claims the bene?t of US. provisional application Ser. No. 60/577,631 ?led Jun. 7, 2004, titled

“Distributed Sound Enhancement,” Which is hereby incorpo rated by reference in its entirety.

BACKGROUND OF THE INVENTION ent headsets are capable of implementing different suites of sound enhancement algorithms, permitting different levels sound quality and cost in the headset market. When commu nicating With a handset, each headset noti?es the handset of its headset suite. The handset selectively places each handset sound enhancement algorithm in-channel based on receiving noti?cation of the headset suite for a headset in communica

1. Field of the Invention

The present invention relates to enhancing sound along communication channels in multiple communication tion With the handset.

In an embodiment of the present invention, at least one headset does not implement a suite of cooperating sound devices.

2. Background Art enhancement algorithms. The handset, When in communica tion With one of these headsets, is able to recognize that the

Telecommunication devices are increasing in number,

functionality, portability and options provided. Telephones

headset does not implement a suite of cooperating sound

enhancement algorithms and to then selectively place prede

may be interconnected by any combination of traditional

telephone Wires, Wireless radio signals, the Internet, satel

lites, and the like. Devices such as computers, personal digital

20 termined handset sound enhancement algorithms in-channel based on the recognition. assistants (PDAs), entertainment systems, and the like, are increasingly taking on communication functions traditionally assigned to telephones. For example, automotive vehicles incorporate telematics to provide communication services to

occupants including telephone calls, driver assistance, emer

gency location, entertainment, and the like.

Telecommunication devices operate in a Wide range of environments. These environments can degrade or corrupt

30 sound quality through distortion of the sound signal, addition of unwanted noise, acoustic echo, and the like. In addition, the transmission channel itself may distort the sound signal due

In another embodiment of the present invention, each head set in at least a subset of the headsets can either selectively

25 place at least one of the headset sound enhancement algo rithms in the headset suite of cooperating sound enhancement algorithms in-channel, remove the at least one sound enhancement algorithms from in-channel processing and/or adjust at least one parameter in at least one headset algorithm.

This selection, removal and/ or adjustment may be based on a signal transmitted from the handset.

system is also provided. Handset sound enhancing algorithms

are implemented in a handset. Each handset sound enhancing to bandWidth limitations, nonlinearities, line echo, sampling, and the like.

Many telecommunication devices incorporate sound enhancement processing to correct or compensate for various sound degrading effects. Often, the optimal place to locate sound enhancement processing is as close to the end of the

35 algorithm may be used in a sound processing channel. The handset automatically determines Which, if any, of a plurality of headset sound enhancing algorithms are active in a headset in communication With the handset. The handset determines

Which handset sound enhancing algorithms to use in the sound processing channel based on Which of the headset communication channel as possible. Some sound processing

40 is more optimally placed nearer to the source of the sound or at the beginning of the communication channel. Still other sound enhancing algorithms are active in the headset. Thus, duplicative sound enhancement processing in both the hand set and the headset is avoided. sound processing techniques are better placed Within the communication channel itself.

The proliferation of telecommunication devices has cre

45

In an embodiment of the present invention, the method

further includes selectively enabling, disabling or modifying

the parameters of at least one headset sound enhancing algo ated a desire to mix and match various equipment. For example, Wired and Wireless headsets are available for use

With many different types of telecommunications transceiv ers. As telecommunication devices are made more complex and powerful there is an increasing tendency to incorporate sound enhancement processing on each device. Thus it is likely that sound enhancement efforts Will be duplicated on

50 set and a headset in communication With the handset is also provided. Sound enhancement processing is divided into a plurality of cooperating algorithms. At least a subset of the interconnected telecommunication devices that form a com cessing in a communication channel implemented in a hand cooperating algorithms are implemented in the headset. An mon communication channel. rithm in the headset based on a signal received from the handset.

55 indication of the implemented subset is transmitted from the headset to the handset. This allows the handset to selectively determine a second subset of the cooperating algorithms to

The present invention avoids duplicating sound enhance

ment processing by selectively determining in Which device

various sound enhancement algorithms Will be used. These

60 devices include sound transducing devices, typically includ ing one or more microphones and/ or speakers, and interface devices capable of communicating over intercommunication

systems.

The present invention includes a system for enhancing

65 use in processing the communication channel so as to avoid

repeating sound enhancement processing implemented in the

headset.

In an embodiment of the present invention, a control signal is received in the headset from the handset. At least one of the cooperating algorithms in the headset is selectively disabled or adjusted based on the received control signal. erating sound enhancement algorithms. Each handset sound also provided. The sound enhancement technology is divided into a plurality of cooperating sound processing algorithms.

Each sound processing algorithm is capable of being selec

US 7,856,240 B2

3 tively added or removed from a sound processing channel. A a subset of the cooperating sound processing algorithms. The plurality of sound processing algorithms are freely offered for use in handsets. Each handset receives information from a headset in communication with the handset and selectively adds or removes each sound processing algorithm from a sound processing channel implemented within the handset based on the received information.

4

as personal digital assistants 36, personal computers 34,

entertainment systems such as MP3 players, hands-free kit in vehicle 32, and the like.

Headsets 38 are typically designed to operate with a wide variety of handset devices. Wired headsets 38 typically include a standardized connector for plugging into, for example, wireless phone 30. Increasingly popular are hand sets that include wireless link 40 for connection with headsets

The above objects and other objects, features, and advan tages of the present invention are readily apparent from the following detailed description of the best mode for carrying out the invention when taken in connection with the accom panying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS in standards such as IrDA, or may utilize radio frequency radiation, as speci?ed in standards such as Bluetooth, IEEE

802.11, IEEE 802.15, and the like.

Headsets 38 increasingly include functionality to improve sound quality. This functionality may include sound enhance ment processing such as acoustic echo canceling, noise can

cellation, frequency extension, dynamic audibility enhance

ment, acoustic shock protection, and the like. Since headsets

FIG. 1 is a block diagram illustrating a telecommunication

system capable of implementing the present invention;

20

38 are designed to work with various handsets, and since these handsets may also implement sound enhancement pro

cessing, duplication of sound processing functionality may

FIG. 2 is a block diagram illustrating a handset and a occur. This duplication can result in overprocessing, a condi headset according to an embodiment of the present invention; tion that often leads to poorer perceived sound quality than if

FIG. 3 is a ?ow diagram illustrating selecting sound no enhancement processing had been performed. Therefore, enhancement algorithms for processing according to an in order to gain the fullest effects of headset and handset embodiment of the present invention;

25 interchangeability, control over which devices will apply

FIGS. 4a and 4b are block diagrams illustrating channel

?ow for different headsets according to an embodiment of the various enhancement algorithms is needed. This control may

include adjusting parameters between corresponding algo present invention;

rithms in the handset and headset.

FIG. 5 is a block diagram illustrating end-to-end commu nication implementing sound enhancement according to an

30

Referring now to FIG. 2, a block diagram illustrating a handset and a headset according to an embodiment of the embodiment of the present invention; and present invention is shown. A system for enhancing sound

quality, shown generally by 50, includes a handset, shown

FIG. 6 is a ?ow diagram illustrating sound enhancement generally by 52, and a headset, shown generally by 38. Hand technology distribution according to an embodiment of the set 52 typically includes at least one microphone 54 for con present invention.

35 verting sound into electrical signals and at least one speaker

DETAILED DESCRIPTION OF THE PREFERRED

EMBODIMENT(S)

56 for converting electrical signals into sound. Likewise, headset 38 typically includes at least one microphone 58 and at least one speaker 60. However, as will be recognized by one

Referring now to FIG. 1, a block diagram illustrating a

40

telecommunication system capable of implementing the

present invention is shown. A telecommunication system, of ordinary skill in the art, either device may include more than one microphone, more than one speaker, no micro phones or no speakers. For example, if system 50 is an enter

shown generally by 20, including interconnection system 22.

Interconnection system 22 can include one or more of wired two speakers and no microphones and handset 52 may have neither microphones nor speakers. As another example, head

telephone connections, wireless telephone connections, voice

45 over IP, satellite communication, and the like. Telecommuni set 38 may have multiple microphones for improved noise cation devices connect to interconnection system 22 through cancellation.

Handset 52 typically includes system interface 62 for con wireline connections 24 and/or wireless connections 26. Tele necting handset 52 with interconnection system 22 through communication devices include traditional wireline set 28, wireline connection 24 or wireless connection 26. The wireless set 30, telematics in vehicle 32, personal computer

50

34, personal digital assistant 36, entertainment systems such

present invention will work with standard telecommunication systems 22 for carrying voice and data as well as with systems as MP3 players, hands-free kit in vehicle 32, and the like. For

22 designed to carry only data or only voice signals. Handset simplicity, such devices will be referred to as handsets. Some

52 also includes wireless interface 63 for wirelessly commu telecommunication devices connect to handsets via wired or nicating with headset 38 over wireless link 40. As will be wireless links for the purpose of providing additional func

55 recognized by one of ordinary skill in the art, wireless inter tionality such as hands free operation, increased mobility,

increased privacy, stereo audio reproduction, improved

face 63 may be replaced or augmented with a port for wired connection to headset 38.

microphones, improved speakers, and the like. For simplicity,

Handset 52 implements a collection of sound enhancement such devices will be referred to headsets 38. algorithms. In the embodiment illustrated in FIG. 2, sound

Headset 38 typically includes at least one microphone and

60 at least one speaker. Multiple microphones may be included for certain functionality, such as noise cancellation. Multiple speakers may be included to provide stereo sound, provide enhancement is implemented on both send channel 64, initi ated at microphone 54, and receive channel 66, terminated at speaker 56. For send channel 64, sound signals are ?rst con verted to electrical signals by microphone 54. Send-side con acoustic transducers with different frequency characteristics, and the like. In addition to traditional microphone and

65 ditioning 68, which may include ?lters, ampli?ers, an analog to-digital converter (ADC), a time-to-frequency converter speaker combinations, headsets 38 may include any telecom munications device receiving sound or producing sound, such

(such as an FFT algorithm) and the like, prepare the micro

phone signal for send-side processing. Send side processing

US 7,856,240 B2

5 6 may include acoustic echo cancellation (ABC) 70, which processes the outgoing and incoming signals to reduce acous

Headset 38 includes wireless interface 90 for communicat ing with wireless interface 63 on handset 52. Headset 38 may tic echoes caused by the environment in which handset 52 is also be connected to handset 52 with a wired connection. In operating. Additional send-side processing 72 may include automatic level tuning (ALT), noise cancellation (NC), com the embodiment of headset 38 illustrated in FIG. 2, wireless interface 90 supports both send-side channel 64 and receive

pression, spectral shaping, encoding, and the like.

side channel 66 within headset 38. Headset send-side channel

64 includes send-side conditioning electronics 92 receiving

Handset receive-side channel 66 converts an analog elec input from microphone 58. Headset ABC 94 reduces echoes trical signal to sound using speaker 56. Receive-side condi produced by the environment in which headset 38 is operat

tioning 74 generates the analog signal using elements which

ing. Additional headset send-side processing 96 may include may include ?lters, ampli?ers, a digital-to-analog converter

(DAC), a frequency-to-time converter (such as an IFFT algo rithm) and the like. Receive side processing may include automatic level tuning (ALT), noise cancellation (NC), com

pression, spectral shaping, encoding, and the like. Headset

receive-side channel 66 drives headset speaker 60 from head

frequency expander 76 (FEX) for generating frequency com

set receive-side conditioning 98. Headset FEX 100 provides ponents lost or attenuated by transmission through limited frequency expansion. Additional headset receive-side pro bandwidth interconnection system 22. Additional receive side processing 78 may include acoustic shock protection cessing 102 may include acoustic shock protection (ASP),

dynamic audibility enhancement (DAE), noise cancellation

(ASP), dynamic audibility enhancement (DAE), noise can cellation (NC), automatic level tuning (ALT), decompres

(NC), automatic level tuning (ALT), decompression, spectral

shaping, decoding, and the like. Collectively, sound enhance

sion, spectral shaping, decoding, and the like.

Together, send-side algorithms 70, 72 and receive-side

20 ment algorithms 94, 96, 100, 102 make up a headset suite of

algorithms, shown generally by 104, which cooperate to

algorithms 76, 78 comprise a set or suite of handset sound enhance one or both of send-side channel 64 and receive-side

enhancement algorithms, shown generally by 80, that coop

channel 66 in headset 38. erate to improve the quality of sound generated by speaker 56 and/or received from microphone 54. Preferably, handset

25

Various headsets 38 may be interfaced with handset 52.

Each headset 38 may have different components making up suite 80 is implemented by a digital signal processor within its headset suite 104. Also, different algorithms may be used handset 52. However, as will be recognized by one of ordinary skill in the art, algorithms within suite 80 may be imple for corresponding elements in handset suite 80 and headset suite 104 and amongst various headsets 38. For example, mented by one or more of software executing on a processor, headset 38 may implement a different noise cancellation

discrete analog components, discrete digital components, programmable logic devices, custom integrated circuits, and

30 the like. As will be described in greater detail below, algo rithms within suite 80 may be selectively placed into or algorithm than is implemented in handset 52. It is also pos sible that some headsets 38 for use with handset 52 may not include any elements of headset suite 104. The ?exibility of placing different sound processing in headsets 38 and hand removed from channels 64, 66. This switching may be accomplished by various ?ow control commands in software

35 or by analog or digital switches in hardware, as is known in the art. Switching includes the possibility of selecting between algorithms within suite 80 for accomplishing the sets 52 results in a potential performance cost. In particular, the use of headset 38 together with handset 52 may duplicate various sound enhancement operations. This duplication of operations can have a sever impact on the performance of the system as a whole. For example, sound quality drops when same task. For example, suite 80 may implement different

noise cancellation algorithms for single microphone input, dual microphone inputs and array microphone inputs.

40 either or both of channels 64, 66 are over processed, resulting in a perceived signal that is worse than if no sound enhance

Switching also includes setting parameter values within one ment processing had occurred at all.

To overcome the possibility of overprocessing while ?ex or more algorithms of suite 80. Parameter values which may ibly allowing various types of headsets 38 to be used with be set include time-domain ?lter coef?cients, frequency-do main equalization coe?icients, noise cancellation decay fac tors, weighting factors in signal summers, sampling rates, number of frequency bins, ranges of frequency bins, time

45

window lengths, envelope shape coe?icients, bit rates, and

the like. handset 52, the present invention selectively processes chan nels 64, 66 within handset 52 based on headset suite 104. In the embodiment shown, wireless interface 90 on headset 38 noti?es wireless interface 63 on handset 52 over link 40 as to the makeup of headset suite 104. Wireless interface 63 then generates control signals 110 which selectively include or

Handset 64 includes wireless interface 63 capable of trans mitting receive-side channel 66 to headset 38, receiving send side channel 64 from headset 38, or both over link 40. Typi cally, receive-side channel 66 is sent either to speaker 56 in

50 exclude elements of handset suite 80 for processing channels handset 52 or over link 40 to speaker 60 on headset 38. Also, typically, send-side channel 64 receives signals either from

55 microphone 54 on handset 52 or from microphone 58 on headset 38 over link 40. This selection is illustrated by logical

64 and 66 within handset 52.

Various schemes for notifying handset 52 about headset suite 104 are possible. For example, each of a limited number of con?gurations for headset suite 104 can be assigned an identi?er which is transmitted over link 40. In another pos sible scheme, a model number describing headset 38: is trans mitted over link 40. Yet another scheme involves assigning each algorithm class or mode a unique code. This code is receive-side switch 82 and logical send-side switch 84, respectively. However, it is possible to con?gure handset 52 for driving speaker 56 on handset 52 and speaker 60 on

60 headset 38 simultaneously. It is also possible to con?gure handset 52 for receiving sound signals from both microphone

54 on handset 52 and microphone 58 on headset 38 such as, for example, to provide multiple microphones for noise can cellation. In such systems, it may be desirable to locate

65 switches 82, 84 such that ABC 70 and FEX 76 do not affect transmitted together with an identi?er for the speci?c algo rithm within the mode. For example, noise cancellation, acoustic shock protection and automatic level tuning are all possible modes. Additional information may accompany each code, such as version number, algorithm parameters, sensed environmental parameters, sensed signal parameters, and the like.

Various techniques for transmitting the noti?cation infor signals communicated between handset 52 and headset 38. mation from headset 38 to handset 52 are also possible. In

US 7,856,240 B2

7 8 band signaling may be used. For example, one or more low power watermark signals may be added to send-side channel

38 or both, such as personal digital assistants, personal com puters, personal entertainment systems, automotive electron ics, and the like.

64 by headset wireless interface 90. These watermark signals are read and, possibly, removed by wireless interface 63 in handset 52. Another possibility is out-of-band signaling. This

Referring now to FIG. 3, a ?ow diagram illustrating select

ing sound enhancement algorithms for processing according

can include side bands or orthogonally modulated signals transmitted over link 40, as is known in the art.

Another technique for transmitting noti?cation informa tion utilizes the discovery process for establishing link 40 between headset 38 and handset 52. For example, the Blue tooth standard includes a Service Discovery Application Pro

?le de?ning a Service Discovery Protocol (SDP). Handset 52 functions as a Bluetooth local device and headset 38 as a to an embodiment of the present invention is shown. As will be appreciated by one of ordinary skill in the art, the opera tions illustrated are not necessarily sequential operations. The order of steps may be modi?ed within the spirit and scope of the present invention and the order shown here is for logical presentation. Also, the method illustrated may be imple mented by any combination of hardware, software, ?rmware, and the like, at one location or distributed. The present inven tion transcends any particular implementation and an embodiment is shown in sequential ?ow chart form for ease of

Bluetooth remote device. In these roles, handset 52 initiates a service discovery procedure. Headset 38 responds to service illustration. inquiries by supplying data from a service records database, which may be implemented in nonvolatile memory within block 13 0. If the headset connects to the handset via a wireline headset wireless interface 90. Bluetooth supports various sce narios including search for services by service class, search

for services by service attributes, and service browsing by

20 nectable, the presence of a wireless link to a headset provides handset 52. link, a jack switch may be used to determine the presence of a headset. If the headset and the handset are wirelessly con

In addition to controlling algorithms in handset suite 80, the necessary indication. If no headset is detected, the method

repeats checking. This process may be implemented by poll

handset wireless interface 63 may also control operation of ing, interrupt processing, or the like. algorithms in headset suite 104. Wireless interface 90 gener

ates control signals 112 for selectively controlling algorithms

25

A check is made to determine if the connected headset supports distributed sound enhancement processing, as in in headset suite 104. After receiving information from head block 132. The handset determines whether or not a linked set 38 about the contents of headset suit 104, handset wireless headset supports the present invention based on signals interface 63 generates commands over link 40 instructing headset wireless interface 90 as to which algorithms in head

30 received from the headset. If the headset does not support distributed sound enhancement processing, the handset sets set suite 104 to activate. This control may be used, for its algorithms to a predetermined default con?guration, as in example, to deactivate algorithms in headset suite 104 if block 134. This default con?guration may be based, for handset 52 determines handset suite 80 can provide superior example, on the assumption that a linked headset that does not sound processing due to better algorithms, increased process ing power, better information about the environment, and the like. Handset 52 may also take over some or all sound

35

support distributed sound enhancement processing performs

no signi?cant sound enhancement processing.

If the linked headset supports distributed sound processing, enhancement processing due to changes in conditions within a check is made to determine which algorithm classes or headset 38 such as, for example, to conserve power in headset modes are supported. This check is represented by the do

38 based on low battery indication signal 114. Control may also be used to adjust parameters of one or more algorithms in headset suite 104. This may be used, for example, to permit

40 while loop implemented by block 136. Once all modes are checked, sound enhancement initialization is complete and coordinated sound processing may continue.

For each enhancement mode, a check is made to determine and headset 38. if the headset supports the mode, as in block 138. Typically,

Handset wireless interface 63 may also communicate with telephone system interface 62 overparameter link 116. In this

45 manner, wireless interface 63 may provide an indication as to the headset supports a mode if the headset signals an algo rithm implementing the mode is executable on the headset. If the headset does not support the mode, a corresponding hand which algorithms in suite 80 and/or in suite 104 are being set algorithm is used, as in block 140. used for sound enhancement. This indication can then be relayed through interconnection system 22 for end-to-end setup of sound enhancement processing. Other information, such as algorithm parameters, equipment identi?ers, operat

50

If the headset supports the considered mode, a check is made to determine if the handset should supercede the head set mode, as in block 142. The handset may decide to use a handset algorithm even if a corresponding headset algorithm ing conditions, and the like, may also be sent between hand sets 52 through interconnection system 22. exists in the linked handset. This may occur, for example, if the handset determines that the handset algorithm is superior,

The embodiment illustrated in FIG. 2 shows two devices, handset 52 and headset 38. However, the present invention

55 will work with various con?gurations. For example, a hands free kit that accepts a wireless telephone can communicate that the handset possesses greater processing power, that the handset algorithm is better matched to other sound enhance ment algorithms selected for use, that the headset is low on power, that the handset has better input signals for processing, with a wearable headset. The hands-free kit could function as handset 52, headset 38 or both. If the ?rst case, the hands-free kit could interface a telephone that does not implement the

60 or the like. If the handset mode supercedes the headset mode, the corresponding handset algorithm is used, as in block 140.

If not, the corresponding headset algorithm is used, as in block 144. present invention or work together with a telephone imple menting the present invention to interactively improve sound quality. In the second case, the hands-free kit could function as a headset by supplying or connecting to one or more

Referring now to FIGS. 4a and 4b, block diagrams illus trating channel ?ow for different headsets according to an embodiment of the present invention are shown. FIG. 4a microphones and speakers. The hands-free kit sends the tele

phone information about its sound processing capabilities.

Similarly, other devices may operate as handset 52, headset

65 depicts handset suite 80 including algorithms for handset

acoustic shock prevention (ASP) 150, handset dynamic audi

bility enhancement (DAE) 152, handset noise cancellation

US 7,856,240 B2

9 10

(NC) 152 and handset frequency extension (FEX) 156. FIG.

Headset A ASP 158 and Headset A FEX 160. Following initialization, receive-side channel 66 is con?gured to drive

HeadsetA speaker 60 with a signal processed by handset ASP cessing 102. Decoder 176 and signal extractor 178 may be implemented in telephone system interface 62, wireless inter face 63, or as separate components. In other implementations, some or all of the functionality of decoder 176 and signal

150, handset DAE 152, Headset A NC 158 and Headset A

FEX 160. This con?guration results in noise cancellation and

frequency extension being processed only at Headset A,

avoiding duplicative processing.

FIG. 4b depicts the same handset suite 80 coupled with

10 extractor 178 may be implemented in headset 38.

In an exemplary application, send-side processing 72, 96 performs one or more algorithms for noise removal tuned to optimize the performance of vocoder 170, multi-band com

pression, time domain compression, spectral shaping for fre quency band equalization, and/or other optimal pre-vocoder

headset suit 104 belonging to a different headset, Headset B.

nection system 22 characterizes pre-vocoder processing

B FEX 164. In this case, following initialization, receive-side channel 66 is con?gured to drive Headset B speaker 60 with a signal processed by handset DAE 152, handset NC 154,

Headset B ASP 162 and Headset B FEX 164. Duplicative processing of acoustic shock prevention and frequency exten sion is avoided by disabling these components in handset suite 80. applied to the audio signal. Signal extractor 178 detects the

transmitted pre-vocoder processing recipe designator and

generates one or both of control signals 180, 182.

Receive-side processing 78, 102 undertakes speci?c modi

?cations to produce a post-vocoder (and post transmission) processing recipe that will be more optimal for a human listener. For example, receive-side processing 78, 102 can

Referring now to FIG. 5, a block diagram illustrating end to-end communication implementing sound enhancement

20 supply a small amount of additional noise removal, but with out adding a great amount of additional noise reduction which according to an embodiment of the present invention is shown. Experiments with both telephony vocoders and auto would be objectionable to a human listener. Other possibili ties are that receive-side processing might completely or par mated voice recognition systems show that such systems can be adversely affected by noise and that sound processing can

25

improve the performance of such systems. However, optimal

tially undo the multi-band compression, time domain com

pression, spectral shaping, and/or other pre-vocoder

processing applied to optimize performance of vocoder 170.

sound processing algorithms, such as noise cancellation, for use with automated recognition systems and vocoders may differ from optimal algorithms for use with human listeners.

Furthermore, what is optimal prior to transmission over inter

The present invention permits one or both of optimize the signal for vocoding and transmission on the send side as well as optimizing the received signal for human comfort on the

30 receive side. Additional bene?t may be achieved in duplex connection channel 22, which may perform its own process ing, may differ from what is optimal after such transmission.

Transmission over interconnection system 22 is improved by using information about send-side processing 72, 96 in deter interconnection channels 22 by communicating receive-side processing 78, 102 to the receive side for affecting send-side

processing 72, 96, permitting appropriate corrective and/or enhancement processing.

mining one or both of receive-side processing 78 and receive side processing 102.

In an embodiment, handset 52 includes vocoder 170

35

Referring now to FIG. 6, a ?ow diagram illustrating sound enhancement technology distribution according to an embodiment of the present invention is shown. Once again, the operations illustrated are not necessarily sequential opera encoding signals generated from one or both of handset

microphone 54 and headset microphone 58. Signal generator

172 generates a signal indicative of handset send-side pro cessing 72 and, if used, headset send-side processing 96. The

40 output of signal generator 172 may be, for example, a pro tions. The order of steps may be modi?ed within the spirit and scope of the present invention and the order shown here is for logical presentation. The present invention transcends any particular implementation and an embodiment is shown in cessed audio signal including one or more low power water

mark signals indicating the processing performed, indicated

sequential ?ow chart form for ease of illustration.

Bene?ts of the present invention are most fully realized if by intercommunication signal 174. Signal generator 172 may

45 also use out-of-band signaling and/or signaling used in initi ating a connection over interconnection system 22. With ref both handset manufacturers and headset manufacturers agree on implementation details such as suite contents, format and methodology of information exchanged between handsets 52 erence as well to FIG. 2, signal generator 172 may be imple mented as part of telephone system interface 62, wireless interface 63 or as a separate component. Signal generator 172

50 and headsets 38, and the like. Handset manufacturers domi nate the market, often setting standards independently or as subsets of the entire industry. While it is possible to imple may receive information about one or both of handset send side processing 72 and headset send-side processing 96 from ment different standards within each headset 38 to support each handset manufacturer, cost and complexity will be wireless interface 63. It is also possible to locate some or all of the functionality of signal generator 172 and vocoder 170 in headset 38.

55 reduced if common implementation details are adopted.

One initial step is to divide sound enhancement into coop erating sound processing algorithms, as in block 190. Sound enhancement may be partitioned based on functionality, such In the embodiment shown in FIG. 5, intercommunication signal 174 is received by decoder 176 and signal extractor 178 in a receiving handset 52. Decoder 176 decodes intercommu as noise cancellation, acoustic shock prevention, echo can cellation, and the like. Sound enhancement may also be par titioned based on implementation, such as those algorithms nication signal 174. Signal extractor 178 extracts information about send-side processing 72, 96 from intercommunication signal 174. Signal extractor 178 uses information about send implemented analogly or in particular processors. Still side processing 72, 96 to determine handset receive-side pro

cessing 78 and, if applicable, headset receive-side processing

102. Signal extractor 178 generates control signal 180 indi cation the operation of handset receive-side processing 78.

Signal extractor 178 generates control signal 182, sent over link 40, indicating the operation of headset receive-side pro

65 thresholds. For example, a base headset may have no built-in processing. The next level up may include only echo cancel lation. The next level up might add noise cancellation and frequency extension. The next level up might add acoustic shock protection. Once partitioning is decided, sound enhancement processing suites can be developed.

US 7,856,240 B2

11 12 communication With the handset for controlling selectively algorithms in headsets, as in block 192. Headsets 38 includ ing sound enhancement suites 104 according to the present placing or removing the at least one headset sound enhancing algorithm.

invention Will provide superior sound quality and ?exibility

5. A system for enhancing sound quality as in claim 1 to users. Users Will recognize these bene?ts and absorb the

Wherein the handset is further operative to adjust the opera cost of implementing the present invention. tion of the handset suite based on a signal received from the

Sound processing algorithms for use in handsets Will be headset describing an operating condition of the headset. freely distributed, as in block 194. If freely available, handset

6. A system for enhancing sound quality as in claim 1 manufacturers Will incorporate the present invention into

Wherein the handset is a ?rst handset, the system further handsets 52 since handset suite 80 Will improve the perfor comprising a second handset in communication With the ?rst mance of handset 52 Whether or not handset 52 is connected handset, the ?rst handset further operative to transmit infor mation to the second handset indicative of each handset sound to headset 38. In addition, the inclusion of handset suite 80

Will provide increased ?exibility for use of handset 52 With a

enhancement algorithm placed in-channel.

Wider variety of headsets 38.

7. A system for enhancing sound quality as in claim 6

While embodiments of the invention have been illustrated

Wherein the second handset is operative to determine opera tion of receive-side sound enhancement processing based on and described, it is not intended that these embodiments the information transmitted from the ?rst handset. illustrate and describe all possible forms of the invention.

Rather, the words used in the speci?cation are words of

20 description rather than limitation, and it is understood that various changes may be made Without departing from the

8. A system for enhancing sound quality as in claim 6

Wherein the second handset is operative to determine opera tion of send-side sound enhancement processing based on the spirit and scope of the invention. information transmitted from the ?rst handset. prising:

What is claimed is:

1. A system for enhancing sound quality comprising:

a handset implementing a handset suite of cooperating sound enhancement algorithms, each handset sound enhancement algorithm in the suite of handset sound enhancement algorithms operative to be either placed

30 in-channel for sound processing or removed from in channel sound processing; and a plurality of headsets, each headset of the plurality of headsets capable of operating in communication With the handset, each headset implementing a headset suite of cooperating sound enhancement algorithms that is its headset suite of cooperating sound enhancement algorithms;

2. A system for enhancing sound quality as in claim 1

Wherein the plurality of headsets further comprises at least one headset that does not implement a suite of cooperating

50 sound enhancement algorithms and Wherein the handset,

When in communication With the at least one headset, is a handset implementing a handset suite of cooperating sound enhancement algorithms, each handset sound enhancement algorithm in the suite of handset sound enhancement algorithms operative to be either placed in-channel for sound processing or removed from in channel sound processing; a headset capable of operating in communication With the handset, the headset implementing a headset suite of cooperating sound enhancement algorithms, the headset operative to notify the handset of its headset suite of

cooperating sound enhancement algorithms; and

the handset operative to selectively place each handset sound enhancement algorithm in-channel based on different from a second suite of cooperating sound enhancement algorithms implemented in a different headset, each headset operative to notify the handset of

40 the handset operative to selectively place each handset sound enhancement algorithm in-channel based on

45 receiving noti?cation of the headset suite for each of the plurality of headsets in communication With the handset. receiving noti?cation of the headset suite for the headset in communication With the handset.

10. A system for enhancing sound quality as in claim 9

further comprising:

a second headset capable of operating in communication

With the handset, the second headset not implementing a suite of cooperating sound enhancement algorithms; and the handset, When in communication With the second head set, being further operative to recognize that the second headset does not implement a suite of cooperating sound

enhancement algorithms and to selectively place prede

termined handset sound enhancement algorithms in-channel based on the recognition. further operative to recognize that the at least one headset does not implement a suite of cooperating sound enhance ment algorithms and to selectively place predetermined hand set sound enhancement algorithms in-channel based on the recognition.

55

11. A system for enhancing sound quality as in claim 9

Wherein the headset is operative to either selectively place at least one of the headset sound enhancement algorithms in the headset suite of cooperating sound enhancement algorithms in-channel or to selectively remove the at least one of the

3. A system for enhancing sound quality as in claim 1

Wherein, for at least a subset of the plurality of headsets, each headset is operative to either selectively place at least one of

60 the headset sound enhancement algorithms in the headset headset sound enhancement algorithms from in-channel pro cessing.

12. A system for enhancing sound quality as in claim 11

Wherein the handset is further operative to transmit a signal to suite of cooperating sound enhancement algorithms in-chan nel or to selectively remove the at least one headset sound the headset for controlling selectively placing or removing the at least one headset sound enhancing algorithm.

enhancement algorithms from in-channel processing.

4. A system for enhancing sound quality as in claim 3

Wherein the handset is further operative to transmit a signal to

65

13. A system for enhancing sound quality as in claim 9

Wherein the handset is further operative to adjust the opera tion of the handset suite based on a signal received from the each headset in the subset of the plurality of headsets in headset describing an operating condition of the headset.

US 7,856,240 B2

13

14. A system for enhancing sound quality as in claim 9 wherein the handset is a ?rst handset, the system further comprising a second handset in communication With the ?rst handset, the ?rst handset further operative to transmit infor mation to the second handset indicative of each handset sound

enhancement algorithm placed in-channel.

15. A system for enhancing sound quality as in claim 14

Wherein the second handset is operative to determine opera

14 tion of receive-side sound enhancement processing based on the information transmitted from the ?rst handset.

16. A system for enhancing sound quality as in claim 14

Wherein the second handset is operative to determine opera tion of send-side sound enhancement processing based on the information transmitted from the ?rst handset.

Was this manual useful for you? yes no
Thank you for your participation!

* Your assessment is very important for improving the work of artificial intelligence, which forms the content of this project

Download PDF

advertisement