`
`Docket No.: 070469-1079
`
`IN THE CLAIMS:
`
`Please amendthe claims as follows:
`
`1. (Currently amended) A translation device which, in a conversation betweenafirst speaker
`
`and a second speaker, translates a language of one speakerinto a language of the other speaker and
`
`outputs a synthesized voice after amplifying a sound level of the synthesized voice, the translation
`
`device comprising:
`
`a first microphone that receives input ofa first voice of the first speaker;
`
`a first voice recognition circuit that recognizes the first voice to output a first character
`
`string;
`
`a first translation circuit that translates the first character string output from the first voice
`
`recognition circuit into a language of the second speaker to output a third character string;
`
`a first voice synthesis circuit that converts the third character string output from the first
`
`translation circuit into a first translated voice;
`
`a first loudspeaker that amplifies a soundlevel ofthe first translated voice;
`
`a second microphonethat receives input of a second voice of the second speaker;
`
`a second voice recognition circuit that recognizes the second voice to output a second
`
`characterstring;
`
`a secondtranslation circuit that translates the second character string output from the second
`
`voice recognition circuit into a languageofthe first speaker to output a fourth character string;
`
`a second voice synthesis circuit that converts the fourth character string output from the
`
`second translation circuit into a second translated voice;
`
`a second loudspeaker that amplifies a sound level of the secondtranslated voice;
`
`
`
`Application No.: 17/296,825
`
`Docket No.: 070469-1079
`
`a first echo canceller that, when first echo refers to a phenomenonin whichthefirst
`
`translated voice whose sound level has been amplified by the first loudspeaker enters into the
`
`second microphone, estimates a first echo signal indicating the first echo from the first translated
`
`voice anda first transfer function correspondingto the first echo, and removesthefirst echo signal
`
`from an output signal of the second microphone;
`
`a second echo canceller that, when second echorefers to a phenomenon in which the second
`
`translated voice whose sound level has been amplified by the second loudspeakerenters into the
`
`first microphone, estimates a second echosignal indicating the second echo from the second
`
`translated voice and a secondtransfer function corresponding to the second echo, and removes the
`
`second echo signal from an output signal of the first microphone; [[and]]
`
`a control circuit,
`
`wherein the control circuit causes:
`
`the first echo canceller to update the first transfer function used to estimate the first
`
`echo signal during a period in whichthefirst voice synthesis circuit is outputting the first translated
`
`voice; and
`
`the second echo canceller to update the second transfer function used to estimate the
`
`second echo signal during a period in which the second voice synthesis circuit is outputting the
`
`second translated voice;
`
`a first crosstalk canceller that, when first crosstalk refers to a phenomenon in whichthefirst
`
`voice enters into the second microphone, estimatesa first crosstalk signal indicating the first
`
`crosstalk from the first voice and removesthefirst crosstalk signal from the output signal of the
`
`second microphone; and
`
`
`
`Application No.: 17/296,825
`
`Docket No.: 070469-1079
`
`a second crosstalk canceller that, when second crosstalk refers to a phenomenon in which the
`
`second voice enters into the first microphone, estimates a second crosstalk signal indicating the
`
`second crosstalk from the second voice and removes the second crosstalk signal from the output
`
`signal of the first microphone.
`
`2. (Original) The translation device according to claim 1, further comprising:
`
`a third echo canceller that, when third echo refers to a phenomenon in whichthefirst
`
`translated voice whose sound level has been amplified by the first loudspeaker enters into thefirst
`
`microphone, estimates a third echo signal indicating the third echo from thefirst translated voice
`
`and a third transfer function corresponding to the third echo, and removesthe third echo signal from
`
`the output signal of the first microphone; and
`
`a fourth echo canceller that, when fourth echo refers to a phenomenonin which the second
`
`translated voice whose sound level has been amplified by the second loudspeakerenters into the
`
`second microphone, estimates a fourth echo signal indicating the fourth echo from the second
`
`translated voice and a fourth transfer function corresponding to the fourth echo, and removesthe
`
`fourth echo signal from the output signal of the second microphone,
`
`wherein the control circuit causes:
`
`the third echo canceller to update the third transfer function used to estimate the third echo
`
`signal during a period in which thefirst voice synthesis circuit is outputting the first translated
`
`voice; and
`
`the fourth echo canceller to update the fourth transfer function used to estimate the fourth
`
`echo signal during a period in which the second voice synthesis circuit is outputting the second
`
`translated voice.
`
`
`
`Application No.: 17/296,825
`
`Docket No.: 070469-1079
`
`3. (Currently amended) A translation device which, in a conversation betweena first speaker
`
`and a second speaker, translates a language of one speaker into a language of the other speaker and
`
`outputs a synthesized voice after amplifying a sound level of the synthesized voice, the translation
`
`device comprising:
`
`a first microphone that receives input ofa first voice of the first speaker;
`
`a first voice recognition circuit that recognizes the first voice to output a first character
`
`string;
`
`a first translation circuit that translates the first character string output from thefirst voice
`
`recognition circuit into a language of the second speaker to output a third character string;
`
`a first voice synthesis circuit that converts the third character string output from thefirst
`
`translation circuit into a first translated voice;
`
`a first loudspeaker that amplifies a soundlevel ofthe first translated voice;
`
`a second microphonethat receives input of a second voice of the second speaker;
`
`a second voice recognition circuit that recognizes the second voice to output a second
`
`characterstring;
`
`a secondtranslation circuit that translates the second character string output from the second
`
`voice recognition circuit into a languageofthe first speaker to output a fourth character string;
`
`a second voice synthesis circuit that converts the fourth character string output from the
`
`second translation circuit into a second translated voice;
`
`a second loudspeaker that amplifies a sound level of the secondtranslated voice;
`
`a third first echo canceller that, when thid first echo refers to a phenomenonin which the
`
`first translated voice whose sound level has been amplified by the first loudspeaker enters into the
`
`first microphone,estimates a third first echo signal indicating the third first echo from thefirst
`
`5
`
`
`
`Application No.: 17/296,825
`
`Docket No.: 070469-1079
`
`translated voice and a thie first transfer function correspondingto the thid first echo, and removes
`
`the third first echo signal from an output signal of the first microphone;
`
`a feurth second echo canceller that, when feurth second echo refers to a phenomenonin
`
`which the second translated voice whose sound level has been amplified by the second loudspeaker
`
`enters into the second microphone, estimates a feurth second echo signal indicating the feurth
`
`second echo from the second translated voice and a feurth second transfer function corresponding to
`
`the fourth second echo, and removes the feurth second echosignal from an output signal of the
`
`second microphone; and
`
`a control circuit,
`
`wherein the control circuit causes:
`
`the third first echo canceller to update the third first transfer function used to estimate
`
`the third first echo signal during a period in whichthe first voice synthesis circuit is outputting the
`
`first translated voice; and
`
`the feurth second echo canceller to update the fourth second transfer function used to
`
`estimate the feurth second echosignal during a period in which the second voice synthesis circuit is
`
`outputting the secondtranslated voice;
`
`a first crosstalk canceller that, when first crosstalk refers to a phenomenon in whichthefirst
`
`voice enters into the second microphone, estimatesa first crosstalk signal indicating the first
`
`crosstalk from the first voice and removesthefirst crosstalk signal from the output signal of the
`
`second microphone; and
`
`a secondcrosstalk canceller that, when second crosstalk refers to a phenomenon in which the
`
`second voice enters into the first microphone, estimates a second crosstalk signal indicating the
`
`
`
`Application No.: 17/296,825
`
`Docket No.: 070469-1079
`
`second crosstalk from the second voice and removes the second crosstalk signal from the output
`
`signal of the first microphone.
`
`4. (Cancelled)
`
`5. (Previously presented) The translation device according to claim 1, further comprising:
`
`a first language selection circuit that receives a selection of a first language used bythefirst
`
`speaker from the first speaker and notifies the control circuit of the selection; and
`
`a second language selection circuit that receives a selection of a second language used by the
`
`second speaker from the second speaker and notifies the control circuit of the selection,
`
`wherein the control circuit causes:
`
`in accordance with the first language notified from the first language selection circuit and
`
`the second language notified from the second languageselection circuit,
`
`the first voice recognition circuit to recognize a voice in the first language;
`
`the second voice recognition circuit to recognize a voice in the second language;
`
`the first translation circuit to translate the first language into the second language;
`
`the secondtranslation circuit to translate the second language into the first language;
`
`the first voice synthesis circuit to synthesize a voice in the second language; and
`
`the second voice synthesis circuit to synthesize a voice in thefirst language.
`
`6. (Previously presented) The translation device according to claim 1, further comprising:
`
`a first language identification circuit that identifies a first language by the first voice and
`
`notifies the control circuit of a result of the identification; and
`
`a second language identification circuit that identifies a second language by the second voice
`
`and notifies the control circuit of a result of the identification,
`
`wherein the control circuit causes:
`
`
`
`Application No.: 17/296,825
`
`Docket No.: 070469-1079
`
`in accordance with the first language identified by the first language identification circuit
`
`and the second languageidentified by the second language identification circuit,
`
`the first voice recognition circuit to recognize a voice in the first language;
`
`the second voice recognition circuit to recognize a voice in the second language;
`
`the first translation circuit to translate the first language into the second language;
`
`the secondtranslation circuit to translate the second language into the first language;
`
`the first voice synthesis circuit to synthesize a voice in the second language; and
`
`the second voice synthesis circuit to synthesize a voice in thefirst language.
`
`7. (Original) The translation device according to claim 5,
`
`wherein whenthe first language received by the first language selection circuit and the
`
`second languagereceived by the second languageselection circuit are same,
`
`the control circuit deactivates the first echo canceller, the second echo canceller, the first
`
`translation circuit, the second translation circuit, the first voice synthesis circuit, and the second
`
`voice synthesis circuit.
`
`8. (Original) The translation device according to claim 6,
`
`wherein whenthe first language identified by the first language identification circuit and the
`
`second language identified by the second languageidentification circuit are same,
`
`the control circuit deactivates the first echo canceller, the second echo canceller, the first
`
`translation circuit, the second translation circuit, the first voice synthesis circuit, and the second
`
`voice synthesis circuit.
`
`9. (Previously presented) The translation device according to claim 1, further comprising:
`
`a first voice sex-determination circuit that determines a sex ofthe first speaker from a first
`
`voice; and
`
`
`
`Application No.: 17/296,825
`
`Docket No.: 070469-1079
`
`a second voice sex-determination circuit that determines a sex of the second speaker from a
`
`secondvoice,
`
`wherein the control circuit causes:
`
`the first voice synthesis circuit to output a synthesized voice of the same sex as a result of
`
`the determination by the first voice sex-determination circuit; and
`
`the second voice synthesis circuit to output a synthesized voice of the same sex as a result of
`
`the determination by the second voice sex-determination circuit.
`
`10. (Previously presented) The translation device according to claim 1, further comprising:
`
`a first camera that captures an imageofa face ofthe first speaker;
`
`a first face recognition circuit that specifies the first speaker in accordance with a first image
`
`signal output from the first camera;
`
`a second camera that captures an image of a face of the second speaker;
`
`a second face recognition circuit that specifies the second speaker in accordance with a
`
`second image signal output from the second camera; and
`
`a database that stores a speaker and a language of the speakerin a pair,
`
`wherein the control circuit:
`
`notifies the first voice recognition circuit, the first translation circuit, the second translation
`
`circuit, and the first voice synthesis circuit of a first language ofthe first speaker when a language of
`
`the first speaker identified by the first face recognition circuit is stored in the database; and
`
`notifies the second voice recognition circuit, the first translation circuit, the second
`
`translation circuit, and the second voice synthesis circuit of a second language of the second speaker
`
`whena language of the second speakeridentified by the second face recognition circuit is stored in
`
`the database.
`
`
`
`Application No.: 17/296,825
`
`Docket No.: 070469-1079
`
`11. (Original) The translation device according to claim 10, further comprising:
`
`a first image sex-determination circuit that determines a sex ofthe first speaker from the first
`
`image signal output from the first camera; and
`
`a second image sex-determination circuit that determines a sex of the second speaker from
`
`the second imagesignal output from the second camera,
`
`wherein the control circuit causes:
`
`the first voice synthesis circuit to output a synthesized voice of the same sex as a result of
`
`the determination by the first image sex-determination circuit; and
`
`the second voice synthesis circuit to output a synthesized voice of the same sex as a result of
`
`the determination by the second image sex-determination circuit.
`
`12. (Currently amended) A translation device which, in a conversation betweena first
`
`speaker and a secondspeaker, translates a language of one speakerinto a language of the other
`
`speaker and outputs a synthesized voice after amplifying a soundlevel of the synthesized voice, the
`
`translation device comprising:
`
`a first microphone that receives input ofa first voice of the first speaker;
`
`a first voice recognition circuit that recognizes the first voice to output a first character
`
`string;
`
`a first translation circuit that translates the first character string output from thefirst voice
`
`recognition circuit into a language of the second speaker to output a third character string;
`
`a first voice synthesis circuit that converts the third character string output from the first
`
`translation circuit into a first translated voice;
`
`a second microphonethat receives input of a second voice of the second speaker;
`
`10
`
`
`
`Application No.: 17/296,825
`
`Docket No.: 070469-1079
`
`a second voice recognition circuit that recognizes the second voice to output a second
`
`characterstring;
`
`a secondtranslation circuit that translates the second character string output from the second
`
`voice recognition circuit into a languageofthe first speaker to output a fourth character string;
`
`a second voice synthesis circuit that converts the fourth character string output from the
`
`second translation circuit into a second translated voice;
`
`a summingcircuit that sums the first translated voice output from the first voice synthesis
`
`circuit and the second translated voice output from the second voice synthesis circuit to output a
`
`sum translated voice;
`
`a loudspeaker that amplifies a sound level of the sum translated voice output from the
`
`summing circuit;
`
`a fH#th first echo canceller that, when fh first echo refers to a phenomenon in which the
`
`sum translated voice whose soundlevel has been amplified by the loudspeaker enters into the
`
`second microphone, emirates estimates a fH#th first echo signal indicating the fH#th first echo from
`
`the sum translated voice and a fh first transfer function corresponding to the 4h first echo, and
`
`removesthe fh first echo signal from an output signal of the second microphone;
`
`a shxth second echo canceller that, when steth second echo refers to a phenomenon in which
`
`the sum translated voice whose soundlevel has been amplified by the loudspeakerenters into the
`
`first microphone, estimates a st<th second echo signal indicating the stxth second echo from the sum
`
`
`translated voice and a s#xth second transfer function corresponding to the stxth second echo, and
`
`removesthe st#xth second echo signal from an output signal of the first microphone; and
`
`a control circuit,
`
`wherein the control circuit causes:
`
`11
`
`
`
`Application No.: 17/296,825
`
`Docket No.: 070469-1079
`
`the f#th first echo canceller to update the th first transfer function used to emirate estimate
`
`the fh first echo signal during a period in whichthe first voice synthesis circuit is outputting the
`
`first translated voice or the second voice synthesis circuit is outputting the second translated voice;
`
`and
`
`
`the stxth second echo canceller to update the steth second transfer function used to estimate
`
`
`the sixth second echo signal during a period in whichthefirst voice synthesis circuit is outputting
`
`the first translated voice or the second voice synthesis circuit is outputting the second translated
`
`voice.
`
`13. (Original) The translation device according to claim 12, further comprising:
`
`a first crosstalk canceller that, when first crosstalk refers to a phenomenonin whichthefirst
`
`voice enters into the second microphone,estimatesa first crosstalk signal indicating the first
`
`crosstalk from the first voice and removesthefirst crosstalk signal from the output signal of the
`
`second microphone; and
`
`a second crosstalk canceller that, when secondcrosstalk refers to a phenomenonin which the
`
`second voice enters into the first microphone, estimates a second crosstalk signal indicating the
`
`second crosstalk from the second voice and removes the second crosstalk signal from the output
`
`signal of the first microphone.
`
`14. (Currently amended) A translation methodfor, in a conversation betweena first speaker
`
`and a second speaker, translating a language of one speaker into a language of the other speaker and
`
`outputting a synthesized voice after amplifying a sound level of the synthesized voice, the
`
`translation method comprising:
`
`receiving input of a first voice of the first speaker;
`
`recognizing the first voice to outputa first character string;
`
`12
`
`
`
`Application No.: 17/296,825
`
`Docket No.: 070469-1079
`
`translating the first character string output in the recognizing ofthe first voice into a
`
`language of the second speaker to output a third characterstring;
`
`converting the third character string output in the translating of the first character string into
`
`a first translated voice;
`
`amplifying a sound levelofthe first translated voice;
`
`receiving input of a second voice of the second speaker;
`
`recognizing the second voice to output a second characterstring;
`
`translating the second character string output in the recognizing of the second voice into a
`
`language ofthe first speaker to output a fourth characterstring;
`
`converting the fourth character string output in the translating of the second characterstring
`
`into a secondtranslated voice;
`
`amplifying a sound level of the second translated voice;
`
`whenfirst echo refers to a phenomenon in whichthe first translated voice whose soundlevel
`
`has been amplified in the amplifying of the sound level ofthe first translated voice is received in the
`
`receiving of input of the second voice, estimating a first echo signal indicating the first echo from
`
`the first translated voice anda first transfer function correspondingto the first echo, and removing
`
`the first echo signal from an output signal output in the receiving of input of the second voice;
`
`when second echorefers to a phenomenonin which the second translated voice whose sound
`
`level has been amplified in the amplifying of the sound level of the secondtranslated voiceis
`
`received in the receiving of input of the first voice, estimating a second echo signal indicating the
`
`second echo from the second translated voice and a secondtransfer function corresponding to the
`
`second echo, and removing the second echo signal from an output signal output in the receiving of
`
`input of the first voice; [[and]]
`
`13
`
`
`
`Application No.: 17/296,825
`
`Docket No.: 070469-1079
`
`giving an instruction to update the first transfer function used to estimate the first echo signal
`
`in the estimating of the first echo signal during a period in whichthefirst translated voice is being
`
`output in the converting of the third character string, and to update the second transfer function used
`
`to estimate the second echo signal in the estimating of the second echo signal during a period in
`
`which the second translated voice is being output in the converting of the fourth character string;
`
`estimating a first crosstalk signal indicating a first crosstalk from the first voice and
`
`removing the first crosstalk signal from the output signal of the second microphone, wherethefirst
`
`crosstalk refers to a phenomenon in whichthefirst voice enters into the second microphone: and
`
`estimating a second crosstalk signal indicating a second crosstalk from the second voice and
`
`removing the second crosstalk signal from the output signal of the first microphone, where the
`
`secondcrosstalk refers to a phenomenon in which the second voice enters into the first microphone.
`
`15. (Currently amended) A translation methodfor, in a conversation betweena first speaker
`
`and a second speaker, translating a language of one speaker into a language of the other speaker and
`
`outputting a synthesized voice after amplifying a sound level of the synthesized voice, the
`
`translation method comprising:
`
`receiving input of a first voice of the first speaker;
`
`recognizing the first voice to outputa first character string;
`
`translating the first character string output in the recognizing ofthe first voice into a
`
`language of the second speaker to output a third characterstring;
`
`converting the third character string output in the translating of the first character string into
`
`a first translated voice;
`
`amplifying a sound levelofthe first translated voice;
`
`receiving input of a second voice of the second speaker;
`
`14
`
`
`
`Application No.: 17/296,825
`
`Docket No.: 070469-1079
`
`recognizing the second voice to output a second characterstring;
`
`translating the second character string output in the recognizing of the second voice into a
`
`language ofthe first speaker to output a fourth characterstring;
`
`converting the fourth character string output in the translating of the second characterstring
`
`into a secondtranslated voice;
`
`amplifying a sound level of the second translated voice;
`
`when Ā¢hitd first echo refers to a phenomenon in whichthefirst translated voice whose sound
`
`level has been amplified in the amplifying of the soundlevel ofthe first translated voice is received
`
`in the receiving of input of the first voice, estimating a third first echo signal indicating the third
`
`first echo from thefirst translated voice and a thied first transfer function corresponding to the third
`
`first echo, and removingthe third first echo signal from an output signal output in the receiving of
`
`input of the first voice;
`
`when fourth second echo refers to a phenomenon in whichthe secondtranslated voice
`
`whose sound level has been amplified in the amplifying of the sound level of the secondtranslated
`
`voice is received in the receiving of input of the second voice, estimating a feurth second echo
`
`signal indicating the feurth second echo from the second translated voice and a feurth second
`
`transfer function corresponding to the feurth second echo, and removing the feurth second echo
`
`signal from an output signal output in the receiving of input of the second voice; and
`
`giving an instruction to update the third first transfer function used to estimate the third first
`
`echo signal in the estimating of the third first echo signal during a period in whichthefirst
`
`translated voice is being output in the converting of the third character string, and to update the
`
`
`fourth second transfer function used to estimate the feurth second echosignal in the estimating of
`
`15
`
`
`
`Application No.: 17/296,825
`
`Docket No.: 070469-1079
`
`the feurth second echo signal during a period in which the secondtranslated voice is being output in
`
`the converting of the fourth characterstring;
`
`estimating a first crosstalk signal indicating a first crosstalk from the first voice and
`
`removing the first crosstalk signal from the output signal of the second microphone, wherethefirst
`
`crosstalk refers to a phenomenon in whichthefirst voice enters into the second microphone: and
`
`estimating a second crosstalk signal indicating a second crosstalk from the second voice and
`
`removing the second crosstalk signal from the output signal of the first microphone, where the
`
`secondcrosstalk refers to a phenomenon in which the second voice enters into the first microphone.
`
`16
`
`