USOO7856240B2 (12) Unlted States Patent (10) Patent N0.: Gunn et a]. (54) (45) Date of Patent: DISTRIBUTED SOUND ENHANCEMENT (56) U'S' PATENT DOCUMENTS MI (US); MichaelA-Hayes, Bloom?eld Hills, MI (US) _ _ _ ASSlgneei Clarlty Technologles, 1119-, Troy, MI (21) Notice: 4/1999 Klayman ..................... .. 381/1 7/2003 Klayman ..................... .. 381/1 7,039,179 B1* 5/2006 Gerhardt 6t a1. ...... .. 379/390.02 7,283,635 B1* 10/2007 Andersonetal. ........... ..381/74 Subject to any disclaimer, the term of this 2003/0130016 A1* 7/2003 2004/0005063 A1* 1/2004 Klayman ..................... .. 381/1 patent is extended or adjusted under 35 2004/0015775 A1* U_S_C_154(b)by1917days_ 2005/0286713 A1* 2007/0053522 A1* APPLNO': 10/896300 _ (22) Filed: 5,892,830 A * 6,597,791 B1* 7,136,684 B2* 11/2006 Matsuura 6161. ....... .. 455/5752 (Us) (*) Dec. 21, 2010 References Cited (75) Inventors: Raymond W. Gunn, Shelby Township, (73) US 7,856,240 B2 Matsuuraetal. .... .. 455/569 1/2004 Simske et a1. ............. .. 715/500 12/2005 3/2007 Gunn etal. ..... .. Murrayetal. . 379/406.04 .... .. 381/71.6 2007/0147633 A1* 6/2007 Burger ........... .. . 381/92 2008/0013741 A1 * 1/2008 Klayman 2008/0103776 A1 * 5/2008 Kumar et a1. 381/1 ............. .. 704/270 Jul. 21, 2004 FOREIGN PATENT DOCUMENTS (65) Prior Publication Data US 2005/0286713 A1 JP Dec. 29, 2005 2004303349 A 10/2004 * Cited by examiner Related US. Application Data Primary ExamineriMattheW D Anderson Assistant ExamineriApril G Gonzales (74) Attorney Agent] or FirmiBrOOks Kushman RC' (60) Provisional application No. 60/577,631, ?led on Jun. 7, 2004. (51) Int. Cl. H04B 7/00 (200601) Sound quality is enhanced in a sound system including hand (52) us. Cl. ................. .. 455/509; 455/631; 455/569.1; 455/5752, 455/41'2 4556561, 37969004, sets and headsets- Handset sound enhancing algorithms are implemented in a handset. The handset automatically deter (57) 379/406 0’4_ 379/38’7 01_ 381/163_ 381/71 6? ' ’ nliines 12131111011, ifany, ofaplpragiity ofheadset soundenhanlfirlilg 381/74; 381/92; 381/98; 704/270; 715/255 hag-hdset. The handset determines hoW to use the handset ' (58) ABSTRACT ’ ' ’ ’ a orit s are active in a ea set in communication Wit t e Field of Classi?cation Search .............. .. 455/63.1, sound enhancing algorithms in a sound processing Channel 455/569-1, 575-2, 412, 556-1; 379/390-2, 379/406.04, 387.01, 390.04; 381/1, 71.6, based on Which of the headset sound enhancing algorithms are active in the headset. 381/74, 92, 98, 103; 704/270; 715/255 See application ?le for complete search history. 16 Claims, 6 Drawing Sheets 38 28 55 t ak/fg 8% 24 SET DEFAULT ALGORH'I'DVIS 38 K “Mg 2. A )4. 20/ USE ALGORITHM m HEADSET USE ALGORITHM 1N HANDSET _____l______| US. Patent Dec. 21, 2010 Sheet 1 0f6 US 7,856,240 B2 38 38 20/ US. Patent Dec. 21, 2010 Sheet 3 0f6 US 7,856,240 B2 START NO DETECT HEADSET? 130 K134 NO DETECT DISTRIBUTED HEADSET? SET DEFAULT ALGORITHMS 1 32 ANY REMAINING? ‘ 136 HEADSET SUPPORT MODE? 138 NO YES SUPERCEDE HEADSET MODE? 142 “K USE ALGORITI-HVI IN HEADSET Fig. 3 YES 144 v/ USE ALGORITHM IN HANDSET 140 US. Patent Dec. 21, 2010 Sheet 4 0f 6 US 7,856,240 B2 HEADSET A HANDSET 80x 150 152 104 f 154 158 156 160 Fig. 4a HANDSET HEADSET B /- 104 150 I 162 152 154 156 164 FEX US. Patent Dec. 21, 2010 Sheet 5 0f6 US 7,856,240 B2 /20 54 K- 72 [-172 SEND-SIDE PROCESSING SIGNAL GENERATOR [-170 VOCODER SEND-SIDE PROCESSING f- 78 E] r- 178 RECEIVE-SIDE SIGNAL EXTRACTOR PROCESSING ‘DECODER 176 1? 60 RECEIVE-SIDE PROCESSING 1 02 Fig. 5 US. Patent Dec. 21, 2010 Sheet 6 0f6 START 190 DIVIDE SOUND ENHANCEMENT INTO COOPERATING SOUND PROCESSING ALGORITHMS 1 92 CHARGE FOR USE OF SOUND PROCESSING ALGORITHMS IN HEADSETS 1 94 FREELY DISTRIBUTE SOUND PROCESSING ALGORITHMS FOR USE IN HANDSETS END Fig. 6 US 7,856,240 B2 US 7,856,240 B2 1 2 DISTRIBUTED SOUND ENHANCEMENT enhancement algorithm in the suite can be either placed in channel for sound processing or removed from in-channel sound processing. Any of a plurality of headsets can commu nicate With the handset. Each headset implements a headset CROSS-REFERENCE TO RELATED APPLICATIONS suite of cooperating sound enhancement algorithms. Differ This application claims the bene?t of US. provisional application Ser. No. 60/577,631 ?led Jun. 7, 2004, titled “Distributed Sound Enhancement,” Which is hereby incorpo rated by reference in its entirety. sound quality and cost in the headset market. When commu nicating With a handset, each headset noti?es the handset of BACKGROUND OF THE INVENTION its headset suite. The handset selectively places each handset sound enhancement algorithm in-channel based on receiving ent headsets are capable of implementing different suites of sound enhancement algorithms, permitting different levels noti?cation of the headset suite for a headset in communica tion With the handset. 1. Field of the Invention The present invention relates to enhancing sound along communication channels in multiple communication In an embodiment of the present invention, at least one headset does not implement a suite of cooperating sound devices. enhancement algorithms. The handset, When in communica 2. Background Art Telecommunication devices are increasing in number, tion With one of these headsets, is able to recognize that the headset does not implement a suite of cooperating sound functionality, portability and options provided. Telephones may be interconnected by any combination of traditional enhancement algorithms and to then selectively place prede 20 telephone Wires, Wireless radio signals, the Internet, satel lites, and the like. Devices such as computers, personal digital assistants (PDAs), entertainment systems, and the like, are increasingly taking on communication functions traditionally assigned to telephones. For example, automotive vehicles incorporate telematics to provide communication services to 25 occupants including telephone calls, driver assistance, emer gency location, entertainment, and the like. Telecommunication devices operate in a Wide range of environments. These environments can degrade or corrupt enhancement algorithms from in-channel processing and/or 30 are implemented in a handset. Each handset sound enhancing algorithm may be used in a sound processing channel. The to bandWidth limitations, nonlinearities, line echo, sampling, 35 Many telecommunication devices incorporate sound sound degrading effects. Often, the optimal place to locate sound enhancement processing is as close to the end of the 40 is more optimally placed nearer to the source of the sound or at the beginning of the communication channel. Still other sound enhancing algorithms are active in the headset. Thus, duplicative sound enhancement processing in both the hand set and the headset is avoided. In an embodiment of the present invention, the method sound processing techniques are better placed Within the further includes selectively enabling, disabling or modifying 45 the parameters of at least one headset sound enhancing algo rithm in the headset based on a signal received from the handset. A method of reducing duplicative sound enhancement pro ers. As telecommunication devices are made more complex and powerful there is an increasing tendency to incorporate handset automatically determines Which, if any, of a plurality of headset sound enhancing algorithms are active in a headset in communication With the handset. The handset determines Which handset sound enhancing algorithms to use in the sound processing channel based on Which of the headset enhancement processing to correct or compensate for various communication channel itself. The proliferation of telecommunication devices has cre ated a desire to mix and match various equipment. For example, Wired and Wireless headsets are available for use With many different types of telecommunications transceiv signal transmitted from the handset. A method for enhancing sound quality in a communication system is also provided. Handset sound enhancing algorithms transmission channel itself may distort the sound signal due communication channel as possible. Some sound processing based on the recognition. In another embodiment of the present invention, each head set in at least a subset of the headsets can either selectively place at least one of the headset sound enhancement algo rithms in the headset suite of cooperating sound enhancement algorithms in-channel, remove the at least one sound adjust at least one parameter in at least one headset algorithm. This selection, removal and/ or adjustment may be based on a sound quality through distortion of the sound signal, addition of unwanted noise, acoustic echo, and the like. In addition, the and the like. termined handset sound enhancement algorithms in-channel 50 sound enhancement processing on each device. Thus it is likely that sound enhancement efforts Will be duplicated on cessing in a communication channel implemented in a hand set and a headset in communication With the handset is also provided. Sound enhancement processing is divided into a plurality of cooperating algorithms. At least a subset of the cooperating algorithms are implemented in the headset. An indication of the implemented subset is transmitted from the interconnected telecommunication devices that form a com mon communication channel. 55 SUMMARY OF THE INVENTION headset to the handset. This allows the handset to selectively determine a second subset of the cooperating algorithms to use in processing the communication channel so as to avoid The present invention avoids duplicating sound enhance repeating sound enhancement processing implemented in the ment processing by selectively determining in Which device devices include sound transducing devices, typically includ headset. In an embodiment of the present invention, a control signal is received in the headset from the handset. At least one of the ing one or more microphones and/ or speakers, and interface cooperating algorithms in the headset is selectively disabled devices capable of communicating over intercommunication or adjusted based on the received control signal. various sound enhancement algorithms Will be used. These 60 systems. The present invention includes a system for enhancing sound quality. A handset implements a handset suite of coop erating sound enhancement algorithms. Each handset sound 65 A method of marketing sound enhancement technology is also provided. The sound enhancement technology is divided into a plurality of cooperating sound processing algorithms. Each sound processing algorithm is capable of being selec US 7,856,240 B2 3 4 tively added or removed from a sound processing channel. A charge is collected for the use in at least one headset of at least as personal digital assistants 36, personal computers 34, headset in communication with the handset and selectively entertainment systems such as MP3 players, hands-free kit in vehicle 32, and the like. Headsets 38 are typically designed to operate with a wide variety of handset devices. Wired headsets 38 typically include a standardized connector for plugging into, for adds or removes each sound processing algorithm from a example, wireless phone 30. Increasingly popular are hand sound processing channel implemented within the handset sets that include wireless link 40 for connection with headsets 38. The wireless link 40 may utilize infrared light, as speci?ed in standards such as IrDA, or may utilize radio frequency radiation, as speci?ed in standards such as Bluetooth, IEEE 802.11, IEEE 802.15, and the like. a subset of the cooperating sound processing algorithms. The plurality of sound processing algorithms are freely offered for use in handsets. Each handset receives information from a based on the received information. The above objects and other objects, features, and advan tages of the present invention are readily apparent from the following detailed description of the best mode for carrying Headsets 38 increasingly include functionality to improve sound quality. This functionality may include sound enhance out the invention when taken in connection with the accom panying drawings. ment processing such as acoustic echo canceling, noise can cellation, frequency extension, dynamic audibility enhance BRIEF DESCRIPTION OF THE DRAWINGS ment, acoustic shock protection, and the like. Since headsets 38 are designed to work with various handsets, and since these handsets may also implement sound enhancement pro FIG. 1 is a block diagram illustrating a telecommunication system capable of implementing the present invention; 20 FIG. 2 is a block diagram illustrating a handset and a headset according to an embodiment of the present invention; FIG. 3 is a ?ow diagram illustrating selecting sound enhancement algorithms for processing according to an embodiment of the present invention; tion that often leads to poorer perceived sound quality than if no enhancement processing had been performed. Therefore, 25 FIGS. 4a and 4b are block diagrams illustrating channel ?ow for different headsets according to an embodiment of the present invention. include adjusting parameters between corresponding algo 30 quality, shown generally by 50, includes a handset, shown generally by 52, and a headset, shown generally by 38. Hand set 52 typically includes at least one microphone 54 for con headset 38 typically includes at least one microphone 58 and at least one speaker 60. However, as will be recognized by one of ordinary skill in the art, either device may include more EMBODIMENT(S) 40 telecommunication system capable of implementing the shown generally by 20, including interconnection system 22. Interconnection system 22 can include one or more of wired 45 over IP, satellite communication, and the like. Telecommuni cation devices connect to interconnection system 22 through wireline connections 24 and/or wireless connections 26. Tele communication devices include traditional wireline set 28, necting handset 52 with interconnection system 22 through wireline connection 24 or wireless connection 26. The 50 as MP3 players, hands-free kit in vehicle 32, and the like. For simplicity, such devices will be referred to as handsets. Some telecommunication devices connect to handsets via wired or 55 increased privacy, stereo audio reproduction, improved microphones, improved speakers, and the like. For simplicity, such devices will be referred to headsets 38. Headset 38 typically includes at least one microphone and at least one speaker. Multiple microphones may be included for certain functionality, such as noise cancellation. Multiple speakers may be included to provide stereo sound, provide acoustic transducers with different frequency characteristics, and the like. In addition to traditional microphone and speaker combinations, headsets 38 may include any telecom munications device receiving sound or producing sound, such neither microphones nor speakers. As another example, head set 38 may have multiple microphones for improved noise cancellation. Handset 52 typically includes system interface 62 for con 34, personal digital assistant 36, entertainment systems such wireless links for the purpose of providing additional func tionality such as hands free operation, increased mobility, than one microphone, more than one speaker, no micro phones or no speakers. For example, if system 50 is an enter tainment system, such as an MP3 player, headset 38 may have two speakers and no microphones and handset 52 may have present invention is shown. A telecommunication system, wireless set 30, telematics in vehicle 32, personal computer verting sound into electrical signals and at least one speaker 56 for converting electrical signals into sound. Likewise, DETAILED DESCRIPTION OF THE PREFERRED telephone connections, wireless telephone connections, voice handset and a headset according to an embodiment of the present invention is shown. A system for enhancing sound 35 Referring now to FIG. 1, a block diagram illustrating a in order to gain the fullest effects of headset and handset interchangeability, control over which devices will apply various enhancement algorithms is needed. This control may rithms in the handset and headset. Referring now to FIG. 2, a block diagram illustrating a present invention; FIG. 5 is a block diagram illustrating end-to-end commu nication implementing sound enhancement according to an embodiment of the present invention; and FIG. 6 is a ?ow diagram illustrating sound enhancement technology distribution according to an embodiment of the cessing, duplication of sound processing functionality may occur. This duplication can result in overprocessing, a condi present invention will work with standard telecommunication systems 22 for carrying voice and data as well as with systems 22 designed to carry only data or only voice signals. Handset 52 also includes wireless interface 63 for wirelessly commu nicating with headset 38 over wireless link 40. As will be recognized by one of ordinary skill in the art, wireless inter face 63 may be replaced or augmented with a port for wired connection to headset 38. Handset 52 implements a collection of sound enhancement 60 algorithms. In the embodiment illustrated in FIG. 2, sound enhancement is implemented on both send channel 64, initi ated at microphone 54, and receive channel 66, terminated at speaker 56. For send channel 64, sound signals are ?rst con verted to electrical signals by microphone 54. Send-side con ditioning 68, which may include ?lters, ampli?ers, an analog 65 to-digital converter (ADC), a time-to-frequency converter (such as an FFT algorithm) and the like, prepare the micro phone signal for send-side processing. Send side processing US 7,856,240 B2 5 6 may include acoustic echo cancellation (ABC) 70, which processes the outgoing and incoming signals to reduce acous tic echoes caused by the environment in which handset 52 is operating. Additional send-side processing 72 may include automatic level tuning (ALT), noise cancellation (NC), com Headset 38 includes wireless interface 90 for communicat ing with wireless interface 63 on handset 52. Headset 38 may also be connected to handset 52 with a wired connection. In the embodiment of headset 38 illustrated in FIG. 2, wireless interface 90 supports both send-side channel 64 and receive side channel 66 within headset 38. Headset send-side channel pression, spectral shaping, encoding, and the like. 64 includes send-side conditioning electronics 92 receiving input from microphone 58. Headset ABC 94 reduces echoes produced by the environment in which headset 38 is operat ing. Additional headset send-side processing 96 may include automatic level tuning (ALT), noise cancellation (NC), com Handset receive-side channel 66 converts an analog elec trical signal to sound using speaker 56. Receive-side condi tioning 74 generates the analog signal using elements which may include ?lters, ampli?ers, a digital-to-analog converter (DAC), a frequency-to-time converter (such as an IFFT algo rithm) and the like. Receive side processing may include pression, spectral shaping, encoding, and the like. Headset receive-side channel 66 drives headset speaker 60 from head set receive-side conditioning 98. Headset FEX 100 provides frequency expander 76 (FEX) for generating frequency com ponents lost or attenuated by transmission through limited bandwidth interconnection system 22. Additional receive side processing 78 may include acoustic shock protection (ASP), dynamic audibility enhancement (DAE), noise can cellation (NC), automatic level tuning (ALT), decompres sion, spectral shaping, decoding, and the like. Together, send-side algorithms 70, 72 and receive-side frequency expansion. Additional headset receive-side pro cessing 102 may include acoustic shock protection (ASP), dynamic audibility enhancement (DAE), noise cancellation (NC), automatic level tuning (ALT), decompression, spectral shaping, decoding, and the like. Collectively, sound enhance 20 ment algorithms 94, 96, 100, 102 make up a headset suite of algorithms, shown generally by 104, which cooperate to algorithms 76, 78 comprise a set or suite of handset sound enhance one or both of send-side channel 64 and receive-side enhancement algorithms, shown generally by 80, that coop erate to improve the quality of sound generated by speaker 56 and/or received from microphone 54. Preferably, handset suite 80 is implemented by a digital signal processor within channel 66 in headset 38. Various headsets 38 may be interfaced with handset 52. 25 handset 52. However, as will be recognized by one of ordinary skill in the art, algorithms within suite 80 may be imple mented by one or more of software executing on a processor, discrete analog components, discrete digital components, programmable logic devices, custom integrated circuits, and the like. As will be described in greater detail below, algo rithms within suite 80 may be selectively placed into or removed from channels 64, 66. This switching may be accomplished by various ?ow control commands in software or by analog or digital switches in hardware, as is known in the art. Switching includes the possibility of selecting between algorithms within suite 80 for accomplishing the same task. For example, suite 80 may implement different noise cancellation algorithms for single microphone input, dual microphone inputs and array microphone inputs. headset 38 may implement a different noise cancellation 30 35 system as a whole. For example, sound quality drops when 40 45 50 side channel 64 from headset 38, or both over link 40. Typi cally, receive-side channel 66 is sent either to speaker 56 in handset 52 or over link 40 to speaker 60 on headset 38. Also, 55 microphone 54 on handset 52 or from microphone 58 on 60 54 on handset 52 and microphone 58 on headset 38 such as, for example, to provide multiple microphones for noise can cellation. In such systems, it may be desirable to locate switches 82, 84 such that ABC 70 and FEX 76 do not affect signals communicated between handset 52 and headset 38. nels 64, 66 within handset 52 based on headset suite 104. In the embodiment shown, wireless interface 90 on headset 38 noti?es wireless interface 63 on handset 52 over link 40 as to mitting receive-side channel 66 to headset 38, receiving send headset 38 over link 40. This selection is illustrated by logical receive-side switch 82 and logical send-side switch 84, respectively. However, it is possible to con?gure handset 52 for driving speaker 56 on handset 52 and speaker 60 on headset 38 simultaneously. It is also possible to con?gure handset 52 for receiving sound signals from both microphone either or both of channels 64, 66 are over processed, resulting in a perceived signal that is worse than if no sound enhance ment processing had occurred at all. To overcome the possibility of overprocessing while ?ex ibly allowing various types of headsets 38 to be used with handset 52, the present invention selectively processes chan be set include time-domain ?lter coef?cients, frequency-do typically, send-side channel 64 receives signals either from include any elements of headset suite 104. The ?exibility of placing different sound processing in headsets 38 and hand sets 52 results in a potential performance cost. In particular, the use of headset 38 together with handset 52 may duplicate various sound enhancement operations. This duplication of operations can have a sever impact on the performance of the Switching also includes setting parameter values within one the like. Handset 64 includes wireless interface 63 capable of trans algorithm than is implemented in handset 52. It is also pos sible that some headsets 38 for use with handset 52 may not or more algorithms of suite 80. Parameter values which may main equalization coe?icients, noise cancellation decay fac tors, weighting factors in signal summers, sampling rates, number of frequency bins, ranges of frequency bins, time window lengths, envelope shape coe?icients, bit rates, and Each headset 38 may have different components making up its headset suite 104. Also, different algorithms may be used for corresponding elements in handset suite 80 and headset suite 104 and amongst various headsets 38. For example, 65 the makeup of headset suite 104. Wireless interface 63 then generates control signals 110 which selectively include or exclude elements of handset suite 80 for processing channels 64 and 66 within handset 52. Various schemes for notifying handset 52 about headset suite 104 are possible. For example, each of a limited number of con?gurations for headset suite 104 can be assigned an identi?er which is transmitted over link 40. In another pos sible scheme, a model number describing headset 38: is trans mitted over link 40. Yet another scheme involves assigning each algorithm class or mode a unique code. This code is transmitted together with an identi?er for the speci?c algo rithm within the mode. For example, noise cancellation, acoustic shock protection and automatic level tuning are all possible modes. Additional information may accompany each code, such as version number, algorithm parameters, sensed environmental parameters, sensed signal parameters, and the like. Various techniques for transmitting the noti?cation infor mation from headset 38 to handset 52 are also possible. In US 7,856,240 B2 7 8 band signaling may be used. For example, one or more low 38 or both, such as personal digital assistants, personal com power watermark signals may be added to send-side channel puters, personal entertainment systems, automotive electron ics, and the like. 64 by headset wireless interface 90. These watermark signals are read and, possibly, removed by wireless interface 63 in handset 52. Another possibility is out-of-band signaling. This Referring now to FIG. 3, a ?ow diagram illustrating select ing sound enhancement algorithms for processing according can include side bands or orthogonally modulated signals to an embodiment of the present invention is shown. As will transmitted over link 40, as is known in the art. be appreciated by one of ordinary skill in the art, the opera tions illustrated are not necessarily sequential operations. The order of steps may be modi?ed within the spirit and scope of the present invention and the order shown here is for logical presentation. Also, the method illustrated may be imple Another technique for transmitting noti?cation informa tion utilizes the discovery process for establishing link 40 between headset 38 and handset 52. For example, the Blue tooth standard includes a Service Discovery Application Pro ?le de?ning a Service Discovery Protocol (SDP). Handset 52 mented by any combination of hardware, software, ?rmware, and the like, at one location or distributed. The present inven functions as a Bluetooth local device and headset 38 as a tion transcends any particular implementation and an embodiment is shown in sequential ?ow chart form for ease of illustration. Bluetooth remote device. In these roles, handset 52 initiates a service discovery procedure. Headset 38 responds to service inquiries by supplying data from a service records database, A check is made to determine if a headset is detected, as in block 13 0. If the headset connects to the handset via a wireline which may be implemented in nonvolatile memory within headset wireless interface 90. Bluetooth supports various sce narios including search for services by service class, search for services by service attributes, and service browsing by link, a jack switch may be used to determine the presence of 20 handset 52. In addition to controlling algorithms in handset suite 80, handset wireless interface 63 may also control operation of algorithms in headset suite 104. Wireless interface 90 gener ates control signals 112 for selectively controlling algorithms repeats checking. This process may be implemented by poll ing, interrupt processing, or the like. 25 in headset suite 104. After receiving information from head set 38 about the contents of headset suit 104, handset wireless interface 63 generates commands over link 40 instructing headset wireless interface 90 as to which algorithms in head set suite 104 to activate. This control may be used, for example, to deactivate algorithms in headset suite 104 if handset 52 determines handset suite 80 can provide superior sound processing due to better algorithms, increased process ing power, better information about the environment, and the 30 example, on the assumption that a linked headset that does not support distributed sound enhancement processing performs 35 enhancement processing due to changes in conditions within 40 45 manner, wireless interface 63 may provide an indication as to which algorithms in suite 80 and/or in suite 104 are being used for sound enhancement. This indication can then be sets 52 through interconnection system 22. The embodiment illustrated in FIG. 2 shows two devices, handset 52 and headset 38. However, the present invention will work with various con?gurations. For example, a hands free kit that accepts a wireless telephone can communicate with a wearable headset. The hands-free kit could function as handset 52, headset 38 or both. If the ?rst case, the hands-free kit could interface a telephone that does not implement the set mode, as in block 142. The handset may decide to use a 55 handset algorithm even if a corresponding headset algorithm exists in the linked handset. This may occur, for example, if the handset determines that the handset algorithm is superior, that the handset possesses greater processing power, that the handset algorithm is better matched to other sound enhance ment algorithms selected for use, that the headset is low on power, that the handset has better input signals for processing, 60 quality. In the second case, the hands-free kit could function as a headset by supplying or connecting to one or more Similarly, other devices may operate as handset 52, headset or the like. If the handset mode supercedes the headset mode, the corresponding handset algorithm is used, as in block 140. If not, the corresponding headset algorithm is used, as in block 144. Referring now to FIGS. 4a and 4b, block diagrams illus trating channel ?ow for different headsets according to an embodiment of the present invention are shown. FIG. 4a menting the present invention to interactively improve sound microphones and speakers. The hands-free kit sends the tele if the headset supports the mode, as in block 138. Typically, the headset supports a mode if the headset signals an algo rithm implementing the mode is executable on the headset. If the headset does not support the mode, a corresponding hand set algorithm is used, as in block 140. If the headset supports the considered mode, a check is made to determine if the handset should supercede the head 50 present invention or work together with a telephone imple phone information about its sound processing capabilities. modes are supported. This check is represented by the do while loop implemented by block 136. Once all modes are checked, sound enhancement initialization is complete and coordinated sound processing may continue. For each enhancement mode, a check is made to determine and headset 38. Handset wireless interface 63 may also communicate with relayed through interconnection system 22 for end-to-end setup of sound enhancement processing. Other information, such as algorithm parameters, equipment identi?ers, operat ing conditions, and the like, may also be sent between hand no signi?cant sound enhancement processing. If the linked headset supports distributed sound processing, a check is made to determine which algorithm classes or 38 based on low battery indication signal 114. Control may telephone system interface 62 overparameter link 116. In this headset supports the present invention based on signals received from the headset. If the headset does not support distributed sound enhancement processing, the handset sets its algorithms to a predetermined default con?guration, as in block 134. This default con?guration may be based, for headset 38 such as, for example, to conserve power in headset headset suite 104. This may be used, for example, to permit partial processing of the same type or mode in both handset 52 A check is made to determine if the connected headset supports distributed sound enhancement processing, as in block 132. The handset determines whether or not a linked like. Handset 52 may also take over some or all sound also be used to adjust parameters of one or more algorithms in a headset. If the headset and the handset are wirelessly con nectable, the presence of a wireless link to a headset provides the necessary indication. If no headset is detected, the method 65 depicts handset suite 80 including algorithms for handset acoustic shock prevention (ASP) 150, handset dynamic audi bility enhancement (DAE) 152, handset noise cancellation US 7,856,240 B2 9 10 (NC) 152 and handset frequency extension (FEX) 156. FIG. 411 also depicts Headset A suite 104 including algorithms for cessing 102. Decoder 176 and signal extractor 178 may be Headset A ASP 158 and Headset A FEX 160. Following initialization, receive-side channel 66 is con?gured to drive HeadsetA speaker 60 with a signal processed by handset ASP face 63, or as separate components. In other implementations, some or all of the functionality of decoder 176 and signal extractor 178 may be implemented in headset 38. 150, handset DAE 152, Headset A NC 158 and Headset A FEX 160. This con?guration results in noise cancellation and performs one or more algorithms for noise removal tuned to implemented in telephone system interface 62, wireless inter In an exemplary application, send-side processing 72, 96 frequency extension being processed only at Headset A, optimize the performance of vocoder 170, multi-band com avoiding duplicative processing. pression, time domain compression, spectral shaping for fre quency band equalization, and/or other optimal pre-vocoder processing. A recipe designator transmitted through intercon nection system 22 characterizes pre-vocoder processing FIG. 4b depicts the same handset suite 80 coupled with headset suit 104 belonging to a different headset, Headset B. Headset B suite 104 includes Headset BASP 162 and Headset B FEX 164. In this case, following initialization, receive-side channel 66 is con?gured to drive Headset B speaker 60 with 10 applied to the audio signal. Signal extractor 178 detects the transmitted pre-vocoder processing recipe designator and a signal processed by handset DAE 152, handset NC 154, generates one or both of control signals 180, 182. Headset B ASP 162 and Headset B FEX 164. Duplicative Receive-side processing 78, 102 undertakes speci?c modi ?cations to produce a post-vocoder (and post transmission) processing of acoustic shock prevention and frequency exten sion is avoided by disabling these components in handset suite 80. Referring now to FIG. 5, a block diagram illustrating end 20 to-end communication implementing sound enhancement according to an embodiment of the present invention is shown. Experiments with both telephony vocoders and auto mated voice recognition systems show that such systems can be adversely affected by noise and that sound processing can 25 processing recipe that will be more optimal for a human listener. For example, receive-side processing 78, 102 can supply a small amount of additional noise removal, but with out adding a great amount of additional noise reduction which would be objectionable to a human listener. Other possibili ties are that receive-side processing might completely or par tially undo the multi-band compression, time domain com pression, spectral shaping, and/or other pre-vocoder improve the performance of such systems. However, optimal processing applied to optimize performance of vocoder 170. sound processing algorithms, such as noise cancellation, for The present invention permits one or both of optimize the signal for vocoding and transmission on the send side as well as optimizing the received signal for human comfort on the receive side. Additional bene?t may be achieved in duplex use with automated recognition systems and vocoders may differ from optimal algorithms for use with human listeners. Furthermore, what is optimal prior to transmission over inter connection channel 22, which may perform its own process 30 interconnection channels 22 by communicating receive-side processing 78, 102 to the receive side for affecting send-side ing, may differ from what is optimal after such transmission. Transmission over interconnection system 22 is improved by using information about send-side processing 72, 96 in deter mining one or both of receive-side processing 78 and receive processing 72, 96, permitting appropriate corrective and/or enhancement processing. 40 Referring now to FIG. 6, a ?ow diagram illustrating sound enhancement technology distribution according to an embodiment of the present invention is shown. Once again, the operations illustrated are not necessarily sequential opera tions. The order of steps may be modi?ed within the spirit and scope of the present invention and the order shown here is for 45 particular implementation and an embodiment is shown in sequential ?ow chart form for ease of illustration. Bene?ts of the present invention are most fully realized if both handset manufacturers and headset manufacturers agree 35 side processing 102. In an embodiment, handset 52 includes vocoder 170 encoding signals generated from one or both of handset microphone 54 and headset microphone 58. Signal generator 172 generates a signal indicative of handset send-side pro logical presentation. The present invention transcends any cessing 72 and, if used, headset send-side processing 96. The output of signal generator 172 may be, for example, a pro cessed audio signal including one or more low power water mark signals indicating the processing performed, indicated by intercommunication signal 174. Signal generator 172 may also use out-of-band signaling and/or signaling used in initi on implementation details such as suite contents, format and ating a connection over interconnection system 22. With ref erence as well to FIG. 2, signal generator 172 may be imple methodology of information exchanged between handsets 52 and headsets 38, and the like. Handset manufacturers domi nate the market, often setting standards independently or as mented as part of telephone system interface 62, wireless interface 63 or as a separate component. Signal generator 172 may receive information about one or both of handset send 50 subsets of the entire industry. While it is possible to imple ment different standards within each headset 38 to support side processing 72 and headset send-side processing 96 from each handset manufacturer, cost and complexity will be wireless interface 63. It is also possible to locate some or all reduced if common implementation details are adopted. One initial step is to divide sound enhancement into coop of the functionality of signal generator 172 and vocoder 170 in headset 38. In the embodiment shown in FIG. 5, intercommunication 55 signal 174 is received by decoder 176 and signal extractor 178 erating sound processing algorithms, as in block 190. Sound enhancement may be partitioned based on functionality, such in a receiving handset 52. Decoder 176 decodes intercommu nication signal 174. Signal extractor 178 extracts information as noise cancellation, acoustic shock prevention, echo can cellation, and the like. Sound enhancement may also be par titioned based on implementation, such as those algorithms about send-side processing 72, 96 from intercommunication implemented analogly or in particular processors. Still signal 174. Signal extractor 178 uses information about send side processing 72, 96 to determine handset receive-side pro another set of partitions may be based on cost or performance thresholds. For example, a base headset may have no built-in cessing 78 and, if applicable, headset receive-side processing processing. The next level up may include only echo cancel lation. The next level up might add noise cancellation and frequency extension. The next level up might add acoustic 102. Signal extractor 178 generates control signal 180 indi cation the operation of handset receive-side processing 78. Signal extractor 178 generates control signal 182, sent over link 40, indicating the operation of headset receive-side pro 65 shock protection. Once partitioning is decided, sound enhancement processing suites can be developed. US 7,856,240 B2 11 12 A charge Will be included for the use of sound processing algorithms in headsets, as in block 192. Headsets 38 includ ing sound enhancement suites 104 according to the present communication With the handset for controlling selectively placing or removing the at least one headset sound enhancing invention Will provide superior sound quality and ?exibility 5. A system for enhancing sound quality as in claim 1 Wherein the handset is further operative to adjust the opera algorithm. to users. Users Will recognize these bene?ts and absorb the tion of the handset suite based on a signal received from the cost of implementing the present invention. Sound processing algorithms for use in handsets Will be freely distributed, as in block 194. If freely available, handset manufacturers Will incorporate the present invention into handsets 52 since handset suite 80 Will improve the perfor headset describing an operating condition of the headset. 6. A system for enhancing sound quality as in claim 1 Wherein the handset is a ?rst handset, the system further comprising a second handset in communication With the ?rst handset, the ?rst handset further operative to transmit infor mation to the second handset indicative of each handset sound mance of handset 52 Whether or not handset 52 is connected to headset 38. In addition, the inclusion of handset suite 80 Will provide increased ?exibility for use of handset 52 With a enhancement algorithm placed in-channel. Wider variety of headsets 38. While embodiments of the invention have been illustrated and described, it is not intended that these embodiments illustrate and describe all possible forms of the invention. Rather, the words used in the speci?cation are words of description rather than limitation, and it is understood that various changes may be made Without departing from the spirit and scope of the invention. 20 7. A system for enhancing sound quality as in claim 6 Wherein the second handset is operative to determine opera tion of receive-side sound enhancement processing based on the information transmitted from the ?rst handset. 8. A system for enhancing sound quality as in claim 6 Wherein the second handset is operative to determine opera tion of send-side sound enhancement processing based on the information transmitted from the ?rst handset. 9. A system for enhancing sound quality, the system com prising: What is claimed is: a handset implementing a handset suite of cooperating 1. A system for enhancing sound quality comprising: sound enhancement algorithms, each handset sound enhancement algorithm in the suite of handset sound a handset implementing a handset suite of cooperating enhancement algorithms operative to be either placed sound enhancement algorithms, each handset sound enhancement algorithm in the suite of handset sound enhancement algorithms operative to be either placed in-channel for sound processing or removed from in 30 channel sound processing; and a plurality of headsets, each headset of the plurality of headsets capable of operating in communication With the handset, each headset implementing a headset suite of cooperating sound enhancement algorithms that is cooperating sound enhancement algorithms, the headset operative to notify the handset of its headset suite of cooperating sound enhancement algorithms; and the handset operative to selectively place each handset different from a second suite of cooperating sound enhancement algorithms implemented in a different headset, each headset operative to notify the handset of its headset suite of cooperating sound enhancement 40 a second headset capable of operating in communication With the handset, the second headset not implementing a the handset operative to selectively place each handset one headset that does not implement a suite of cooperating sound enhancement algorithm in-channel based on receiving noti?cation of the headset suite for the headset in communication With the handset. 10. A system for enhancing sound quality as in claim 9 further comprising: algorithms; sound enhancement algorithm in-channel based on receiving noti?cation of the headset suite for each of the plurality of headsets in communication With the handset. 2. A system for enhancing sound quality as in claim 1 Wherein the plurality of headsets further comprises at least channel sound processing; a headset capable of operating in communication With the handset, the headset implementing a headset suite of in-channel for sound processing or removed from in 45 suite of cooperating sound enhancement algorithms; and the handset, When in communication With the second head set, being further operative to recognize that the second headset does not implement a suite of cooperating sound 50 enhancement algorithms and to selectively place prede sound enhancement algorithms and Wherein the handset, termined handset sound enhancement algorithms When in communication With the at least one headset, is further operative to recognize that the at least one headset does not implement a suite of cooperating sound enhance in-channel based on the recognition. 11. A system for enhancing sound quality as in claim 9 Wherein the headset is operative to either selectively place at least one of the headset sound enhancement algorithms in the ment algorithms and to selectively place predetermined hand 55 set sound enhancement algorithms in-channel based on the headset suite of cooperating sound enhancement algorithms recognition. in-channel or to selectively remove the at least one of the 3. A system for enhancing sound quality as in claim 1 Wherein, for at least a subset of the plurality of headsets, each headset is operative to either selectively place at least one of the headset sound enhancement algorithms in the headset headset sound enhancement algorithms from in-channel pro cessing. 60 12. A system for enhancing sound quality as in claim 11 Wherein the handset is further operative to transmit a signal to suite of cooperating sound enhancement algorithms in-chan the headset for controlling selectively placing or removing nel or to selectively remove the at least one headset sound the at least one headset sound enhancing algorithm. 13. A system for enhancing sound quality as in claim 9 Wherein the handset is further operative to adjust the opera tion of the handset suite based on a signal received from the headset describing an operating condition of the headset. enhancement algorithms from in-channel processing. 4. A system for enhancing sound quality as in claim 3 Wherein the handset is further operative to transmit a signal to each headset in the subset of the plurality of headsets in 65 US 7,856,240 B2 13 14 14. A system for enhancing sound quality as in claim 9 wherein the handset is a ?rst handset, the system further comprising a second handset in communication With the ?rst handset, the ?rst handset further operative to transmit infor mation to the second handset indicative of each handset sound tion of receive-side sound enhancement processing based on the information transmitted from the ?rst handset. 16. A system for enhancing sound quality as in claim 14 Wherein the second handset is operative to determine opera tion of send-side sound enhancement processing based on the information transmitted from the ?rst handset. enhancement algorithm placed in-channel. 15. A system for enhancing sound quality as in claim 14 Wherein the second handset is operative to determine opera
* Your assessment is very important for improving the work of artificial intelligence, which forms the content of this project
advertisement
© 2021