`
`UNITED STATES DEPARTMENT OF COMMERCE
`United States Patent and Trademark Office
`Address: COMlVHSSIONER FOR PATENTS
`PO. Box 1450
`Alexandria1 Virginia 22313-1450
`www.uspto.gov
`
`
`
`
`
`14/016,465
`
`09/03/2013
`
`Yoshihiro MORIOKA
`
`OKUDPOSQSUS
`
`3080
`
`(14/19/2017 —MARK D. SARALINO (PAN) m
`7590
`51921
`RENNER, OTTO, BOISSELLE & SKLAR, LLP
`LEE, HMMYS
`1621 EUCLID AVENUE
`19TH FLOOR
`
`PAPER NUMBER
`
`CLEVELAND, OH 44115
`
`2486
`
`NOTIFICATION DATE
`
`DELIVERY MODE
`
`04/19/2017
`
`ELECTRONIC
`
`Please find below and/or attached an Office communication concerning this application or proceeding.
`
`The time period for reply, if any, is set in the attached communication.
`
`Notice of the Office communication was sent electronically on above—indicated "Notification Date" to the
`following e—mail address(es):
`
`ipdocket @rennerott0.c0m
`
`PTOL—90A (Rev. 04/07)
`
`

`

`
`
`Applicant(s)
`Application No.
` 14/016,465 MORIOKA ET AL.
`
`
`AIA (First Inventor to File)
`Art Unit
`Examiner
`Office Action Summary
`
`
`JIMMY 8. LEE its“ 2486
`-- The MAILING DA TE of this communication appears on the cover sheet with the correspondence address --
`Period for Reply
`
`A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE g MONTHS FROM THE MAILING DATE OF
`THIS COMMUNICATION.
`Extensions of time may be available under the provisions of 37 CFR1. 136( a).
`after SIX () MONTHS from the mailing date of this communication.
`If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication.
`-
`- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133).
`Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any
`earned patent term adjustment. See 37 CFR 1 .704(b).
`
`In no event, however, may a reply be timely filed
`
`Status
`
`1)IZI Responsive to communication(s) filed on 2/6/2017.
`El A declaration(s)/affidavit(s) under 37 CFR 1.130(b) was/were filed on
`
`2b)|ZI This action is non-final.
`2a)|:l This action is FINAL.
`3)|:I An election was made by the applicant in response to a restriction requirement set forth during the interview on
`
`; the restriction requirement and election have been incorporated into this action.
`
`4)|:| Since this application is in condition for allowance except for formal matters, prosecution as to the merits is
`
`closed in accordance with the practice under Exparte Quay/e, 1935 CD. 11, 453 O.G. 213.
`
`Disposition of Claims*
`
`5)IZI Claim(s) 1-10 is/are pending in the application.
`5a) Of the above claim(s)
`is/are withdrawn from consideration.
`
`is/are allowed.
`6)|:I Claim(s)
`7)|Z| Claim(s)_1-10 is/are rejected.
`8)|:I Claim(s)_ is/are objected to.
`
`
`are subject to restriction and/or election requirement.
`9)|:I Claim((s)
`* If any claims have been determined allowable, you may be eligible to benefit from the Patent Prosecution Highway program at a
`
`participating intellectual property office for the corresponding application. For more information, please see
`hit
`:/'I’\WIIW.LIsnto. ovI’ atentS/init events/
`
`
`
`iindex.‘s or send an inquiry to PPI-iieedback{®usgtc.00v.
`
`Application Papers
`
`10)I:l The specification is objected to by the Examiner.
`11)I:l The drawing(s) filed on
`is/are: a)I:I accepted or b)|:l objected to by the Examiner.
`Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a).
`
`Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121 (d).
`
`Priority under 35 U.S.C. § 119
`
`12)IXI Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f).
`Certified copies:
`
`a)IZl All
`
`b)|:l Some” c)I:l None of the:
`
`1.IXI Certified copies of the priority documents have been received.
`2.|:l Certified copies of the priority documents have been received in Application No.
`3.|:| Copies of the certified copies of the priority documents have been received in this National Stage
`
`application from the International Bureau (PCT Rule 17.2(a)).
`** See the attached detailed Office action for a list of the certified copies not received.
`
`Attachment(s)
`
`
`
`3) D Interview Summary (PTO-413)
`1) E Notice of References Cited (PTO-892)
`Paper No(s)/Mai| Date.
`.
`.
`4) I:I Other'
`2) E InformatIon DIsclosure Statement(s) (PTO/SB/08a and/or PTO/SB/08b)
`Paper No(s)/Mai| Date 9/3/2013.
`US. Patent and Trademark Office
`PTOL—326 (Rev. 11-13)
`
`Office Action Summary
`
`Part of Paper No./Mai| Date 20170413
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 2
`
`DETAILED ACTION
`
`Notice of Pre-AIA or AIA Status
`
`The present application is being examined under the pre-AIA first to invent provisions.
`
`Continued Examination Under 37 CFR 1.114
`
`A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 CFR 1.17(e), was filed in
`
`this application after final rejection. Since this application is eligible for continued examination under 37 CFR
`
`1.114, and the fee set forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action has
`
`been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 2/6/2017 has been entered.
`
`1.
`
`Acknowledgment is made of applicant’s claim for foreign priority under 35 U.S.C. 119 (a)-(d). The
`
`certified copy has been filed in parent Application No. JP 2012-009669, filed on 01/20/2012.
`
`Priority
`
`Response to Arguments
`
`2.
`
`Applicant's arguments with respect to the rejection under 35 U.S.C. 112(b) has been fully considered and is
`
`withdrawn.
`
`3.
`
`Applicant’s arguments with respect to claim 02/06/2017 have been considered but are moot because the
`
`arguments do not apply to any of the references being used in the current rejection.
`
`Claim Rejections - 35 US C § 103
`
`The following is a quotation of pre-AIA 35 U.S.C. 103(a) which forms the basis for all obviousness rejections set
`
`forth in this Office action:
`
`(a) A patent may not be obtained though the invention is not identically disclosed or described as set
`forth in section 102 of this title, if the differences between the subject matter sought to be patented and
`the prior art are such that the subject matter as a whole would have been obvious at the time the
`invention was made to a person having ordinary skill in the art to which said subject matter pertains.
`Patentability shall not be negatived by the manner in which the invention was made.
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 3
`
`The factual inquiries set forth in Graham v. John Deere C0., 383 US. 1, 148 USPQ 459 (1966), that are applied for
`
`establishing a background for determining obViousness under pre-AIA 35 U.S.C. 103(a) are summarized as follows:
`
`1. Determining the scope and contents of the prior art.
`
`2. Ascertaining the differences between the prior art and the claims at issue.
`
`3. ResolVing the level of ordinary skill in the pertinent art.
`
`4. Considering objective eVidence present in the application indicating obViousness or nonobViousness.
`
`1.
`
`Claim 1, 2, 5-7, 10, and 11 rejected under pre-AIA 35 U.S.C. 103(a) as being unpatentable over Lee et ai.
`
`(US 211116169921 Al) in View of Bieket‘siafi‘ et al. (US 331112315326 :11} in View of Saito (US 2111191698211 Al)
`
`in View of Nakazawa (US 2131111292227 A1).
`
`Regarding claim 1, Lee teaches,
`
`A stet'eoseopie shooting device (stereo camera 'i,iiii)iԤii7] comprising:
`
`a first optical systern (first lens unit 11i}}‘i{18}, the first optical system being 31 zoom optical
`
`system; (having optical zoom ei'tectsH‘Eiitli]
`
`a first sensor {first image sensor itZt}HFig.2~1 211} that receives ligitt transmitted through the first
`
`optical system (first lens 1111 gathers light from an object and “form images or; regions of the
`
`first image sensor i,2{i”i{ :22} and obtains a first image (first it;tege}[‘l§1?j by shooting a subject;
`
`("images picked up by first image sensor 121 ”, as degieteri by i'ig. 4Afl‘iEZti, Fig-4A}
`
`a second optical system; (seeonri Hens nnit 115ii1iE13}
`
`a second image sensor (seeond image sensor 125)i:1?ig.2~121il that receives light transmitted
`
`through the second optical system (seeonri tens 115 gathers tight from an ohjeet and “form
`
`images on regions oi" the second image sensor 125:”){1122'i and obtains a second. image (second
`
`image of the some seenemiiff} by shooting the subject; (“images picked on by seeonrii mage
`
`sensor 125”, as depicted by fig, tomes. Fig. éiiiizand
`
`circuitry (stereo camera 11111 crop using a stereo moteitingflfifié} which cuts respective image
`
`portions {erop the image aeqnireti by the iiiw-niitgiiii’iezatiort opiieai zoomfl‘flffifi} that have a
`
`same angie of View (crop the sarne region 525)i:‘fl.’36} out of the first and second images, {image
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 4
`
`acquired by the high-magnification optical zoom from the image acquired hy the lawn
`
`magnification optical aritimlillli‘lol
`
`wherein the circuitry {stereo camera tilt} crap using a stereo matchingliiliiti]
`
`selects a plurality {crop the same region 525il‘fifié] ol mutually corresponding image hioclts
`
`{acquired by the lowmagniiicatinn optical zoomfi‘flffifi} that have a same image feature { same
`
`region 525 as acquired by the highumagnil’ication optical south as the image acquired lay the
`
`luwxmagnilieation optical monitfiliitil from the first and second images, (first; and second
`
`image of the same scetreil‘filfl
`
`But, Lee
`
`does not explicitly teach,
`
`optical system including a plurality of lenses,
`
`calculates a vertical image area of the second image that has a same vertical direction. range as the
`
`first image hased on relative vertical positions of the image hloeks in the respective images,
`
`adjusts the number of horizontal lines included in the vertical image area of the second image and
`
`the number ot’l’torizontal lines included in the first image to a predetermined value,
`
`outputs a first horizontal line signal representing the horizontal lines included in the first image
`
`and a second horizontal line signal representing the horizontal lines included in the vertical image
`
`area ol‘ the second image,
`
`perl‘orrns stereo matching by comparing to each other the lirst and second. horizontal line signals
`
`supplied from the number of horizontal lines matching section, and
`
`wherein the circuitry determine the vertical image area by comparing the ratio ol‘ the vertical
`
`coordinates of respective representative points in a plurality of image blocks selected item the lirst
`
`image to the ratio ol. the vertical coordinates of respective representative points in a plurality ol~
`
`image hleclts selected from the second image.
`
`However, in the same field ol‘ endeavor, Bic-kerstafl‘ teaches additionally,
`
`optical system including a plurali y of lenses, (“optical imaging systems tilt,” each comprising
`
`“one or more tens assemblies” (represented schematically try “lenses 112, 114, and
`
`itt‘”t)ltt’?fil
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 5
`
`eateniates {“tteteet‘ feature tiisparities”)t€[49} a vertieai image area (“‘vertieai extent”)ifi153t oi
`
`the second image (“at the right iniage‘”,_ fig. 7A vwhich is a intniii'ieti versinn ni Fig. eBiEfiiSci,
`
`Fig. ”iii, an; that wentd have the same "vertical direction range {right hand image having “same
`
`iiehi at” View “as the iei't hand innagefl‘itiisit as the first image (“oi the ieit intage’h Fig. 6A
`
`was”, Fig. 6A} based Oil i‘eiative vertieai positions (“vertical extent”)fi§’4$} of the image bind-:3
`
`t‘“snhsm‘t‘ien5m having the Seine fietti ni‘ viewfifiifiin‘t} in the respective images, (iei‘t anti right
`
`images) E itfiit
`
`adjusts {“‘ertengiitg” snhseetinn having the. same fieiti ni‘ viewfifiisni the number of heriznntai
`
`tines (“hnrizentai extent at" the right hand image” )[fiifi’ti included in the vertical image area
`
`(“vertittai extent ntthe right hand ittiage’iififiéi} {if the seentitt image (at right hand image,
`
`Fig. ’FAH‘KSM and the nintiher ni horizontal tines; (“tinriznntai extent at“ the tei’t hanti
`
`image”) M51} inf Left hand image, Fig. t’iAH‘tiSét, Fig, {in} included in the first image to a
`
`predetermined value, therizentai extent at“ right hand image. etgnat tn the hnriznntat extentt (if
`
`the iett hand itnageiifiit‘i‘i}
`
`detentiineg the vettieai image area (“deteet feature disnarities” by ennitiarisnn nt’ features at
`
`the. edges anti attriitienaity anywhere within the pair at watered imagesflitét‘hfi i] by
`
`comparing (“estimate a disparity” in the resneetive tieitis ni‘ viewfl‘ftfiti] the ratio at the vertical
`
`cent‘dinates { the “vei'tieai extent” ennsisting iii the entire veriieai extent hi” the image in fig.
`
`{ihiiiflstif‘ig {EA} of respective representative points (pixets in the i‘ieitt ni’ View at the itch hantt
`
`iinage. Fig. tiA)tT§{5t3, iiig. {EA} in a plurality of image hieehs (i‘eatnres at the etigea anti
`
`attaiitinnntiy “anywhere within the pair at eaptnreti images”)£fii§th51} setected. from the first
`
`image (whats: image as basis at” enniparianhii‘flfiiiii to the ratio of the verticai coordinates (the
`
`“vertieat extent’9 etinsistihg (it the entire vertieat extent ni‘ the image in fig. tiliitiTiESttf‘ig, hit]
`
`at respective representative points (ninety; in the fiehi ni view at" the right hanti iinage, ii‘ig,
`
`{iBflfiSt}, Fig. {iii} in a plurality of image biochs selected from the second image. (whnie image EBS
`
`hash: at ennaeariwnhfitifii}
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 6
`
`It would have been ohvions to one with ordinary skill to combine the stereo camera of Lee with the
`
`imaging process of Biclierstal‘f to create a process where the difference between the left and right images is
`
`determined. The reason for this is that Bic-kerstaff offers a particular way of comparing the horizontal and
`
`vertical differences of the left and right eye images to define the differences by detecting an image tezttnre.
`
`But, Lee in vieW of Bickerstaff does not explicitly teach,
`
`selects a plurality of image blocks from the first image that mutually correspond to a plurality of
`
`image blocks from the second image based on variation in at least one of luminance signals or
`
`color signals, When the mutually corresponding image blocks have a same image feature,
`
`otnpnts a first horizontal line signal representing the horizontal lines inclnded in the first image
`
`and a second horizontal line signal representing the horizontal lines incittded in the verticai image
`
`area of the second image,
`
`performs stereo matching by comparing to each other the first and second horizontal iine signals
`
`supplied from the number of horizontal lines matching section, and
`
`However, Saito teaches additionally,
`
`selects a plurality of image blocks (range 401L and 405R “divided into blocks by means of
`
`parallax grid adjusted grids”)[‘][52,53] from the first image (“right-eye image 301R”)[1152, Fig.
`
`3A] that mutually correspond to a plurality of image blocks (entire corresponding range 405R
`
`with respect to range 401L Where “blocks on the right-eye image 301R corresponding to the
`
`blocks of the left-eye image 301L”)[1152] from the second image (“left-eye image 301L”)[1152,
`
`fig. 3b] based on variation in at least one of luminance signals or color signals, (“color
`
`information such as hue and luminance of the blocks on both the right-eye and left-eye
`
`images satisfactorily match each other”)[1152] when the mutually corresponding image blocks
`
`have a same image feature (figs. 3a-3d depicting an image similar to that of Figs. 2a and 2b
`
`which specifies that depict subject 102 Where the subject 102 of 301L contains range 401L
`
`that corresponds with range 405R 0f 301R)[‘][44-51, Fig. 2a,2b,3a,3b,3c,3d]
`
`performs stereo matching (“bionic tnat‘eiringflfilflj hy contpzn’ing to each other the first (“‘hinck
`
`of the first iniztge’”3fi[73] and second horizontal line signals (“part of the second imageflfiifll
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 7
`
`supplied lrotn the number of horizontal lines rnatching section (blotch matching the horizontal
`
`direction hy “position where the SAD becomes the smallest may he searched for while
`
`shifting the hloel; of the first image horizontally”)Mill
`
`It would have been obvious to one with ordinary skill to combine the stereo carnera ol‘ Lee with the
`
`imaging process ol‘ Biclrerstal‘l’ with the block correspondence of Saito to have a matching bloclt grid
`
`between a left and right images of a subject The reason for this would be for maintaining depth effects in a,
`
`range between left and right images
`
`But, Lee in View of Bickerstaff With Saito does not explicitly teach,
`
`outputs a first horizontal line signal. representing the horizontal lines included in the first image
`
`and a seconal horizontal line signal representing the horizontal lines included in the vertical irtiage
`
`area, of the second image,
`
`performs stereo matching by cotrtpariug to each other the first and second horizontal line signals
`
`supplied from the number of horizontal lines matching section, anal
`
`However, in the same field of endeavor, Nakaznwn teaches additionally,
`
`outputs a first horizontal line signal (Kl and X2 used in parallax measuring elreait tiltil‘ll'Z] (Xi
`
`indicating horizontal "coordinate of the characteristic point Pl.” ol' the image Sl_;l[‘lli32l
`
`representing the horizontal lines {Klillfllz‘t2, ll'ig. llfiil included in the first image {image Si)
`
`corresponding to the left eye )[tfilz‘tZ] and. a second horizontal line (3:2 indicating horizontal
`
`“coordinate of the characteristic point Hi” oi’ the image SRH‘EWLZ} signal representing the
`
`horizontal lines tXZ}{*}l92, lt‘lg‘ Elli} included of the second image, (image SR corresponding to
`
`the right eyellfifil
`
`performs stereo matching {parallax theasni*ingtlll192] by comparing to each other the first and
`
`second horizontal line signals (calculated as deLXZHFflQZ} supplied from the number of
`
`horizontal lines matching section, (coordinate of image SL and image SR)[Ԥ{92}
`
`lt would have been obvious to one with ortlint *y shill to combine the stereo camera of Lee with the
`
`imaging process of Bic-herstafl with the block correspondence of Saito with the correction ol‘ Nahazawa to
`
`create a process where the parallax of the plurality of Viewpoints can be calculated The reason tor this is
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 8
`
`that Nakazawa offers a procegs oi caicuiating parallax to correspond to a distance to a subject of each
`
`Viewpoint acquired by the imaging optical system.
`
`Regarding claim 2, Lee in View of Bickerstaff With Saito in View of Nakazawa teach the limitation of claim 1,
`
`Lee teaches additionally,
`
`second image sensor (settont‘i lens unit liif‘ifi‘filii] obtains. the second image (second imageli‘fi'i’ii
`
`by shooting the snhject {seenelfiiil’fl at a wider angie of View taeqtaia‘ed by the inw-
`
`magnification optical artotnlfii'fiél than an angle (3 ,7 View (magnification at" the first imagine and
`
`seettntl image. are {Eifferentf’ii‘fiiiti} at which the first image is shot. {isnage acquired by the high
`
`magnification optical attean‘liBtil
`
`Regarding claim 5, Lee in View of Bickerstaff With Saito in View of Nakazawa teach the limitation of claim 1,
`
`Nakazawa teaches additionally,
`
`generates parallax information {parallax as {E )[fii‘ifij based on the first and second horizontal line
`
`sigiiais,(d=Xi~X3}i‘il92]
`
`it “wonld have been obvious to one with ordinary skill to combine the stereo camera of Lee with the
`
`imaging process of Bickerstafl with the hiocl: correspondence of Saito with the correction ol‘ Nakazawa to
`
`create a process where the parallax of the plurality of Viewpoints can be calculated, The reason for this is
`
`that Nakazawa offers a process of calcttiating naraiiax to correspond to a distance to a subject of each
`
`Viewpoint acquired by the imaging optical system.
`
`Regarding claim 6, Lee in View of Bickerstaff With Saito in View of Nakazawa teach the limitation of claim 5,
`
`Bickerstaff teaches additionally,
`
`generates (images getteraiediiahs}, based on the first image, (crop of right hand itnage R’ is
`
`haseti on comparison with itariznntai and vertical extent of tel’t hand itnagefl‘jtfll a third
`
`image that tonns, (right hand image it” with same field of View as left hand image Fig. 6A,
`
`Fig, ’II'A)[‘§[54} along with the first image, (left hand itnage Fig. tiAii‘fi54] a pair of stereoscopic
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 9
`
`images (reduced disparity between respective iieids of View of the stereoscopic image
`
`pairflahsl
`
`It would have been obvious to one with ordinary skill to combine the stereo camera of Lee with the
`
`imaging process of Biciierstat't' with the block correspondence of Saito with the correction of Nakazawa to
`
`create a process where an adjusted right hand image is paired with a left hand image The reason is that the
`
`adjusted tight. hand image will have a reduced disparity,
`
`Bttl. does not explicitly teach,
`
`generates, based on the paraiiax information
`
`However, in the same field of endeavor, Nakazawa teaches additionaliy,
`
`generates, (synthesized image generated from corrected viewpoint iinagetlfiiWE based on the
`
`paraitax information toaraiiax d caicniated by the naraiiax measuring circuit SETH], a, third
`
`image {synthesized iinagefi‘tifij
`
`It would have been ohviotts to one with ordinary skill to combine the stereo camera of Lee with the
`
`imaging process of Bickerstaff with the block correspondence of Saito with the correction of Nakazawa to
`
`create a process where paratiax is important in synthesizing an image, 'lhe reason for this is that calculating
`
`parallax to correspond to a distance to a suhject of each v’e‘flpoint acquired by the imaging optical systenr
`
`Regarding claim 7, Lee in View of Bickerstaff With Saito in View of Nakazawa teach the limitation of claim 1,
`
`Lee teaches additionally,
`
`cuts an area that corresponds {crop same region Sfifiilifififii to a range of the first image (image
`
`acquired by the highvniagnii'ieation opticai zoonifl‘fifiot out of the second image {ioniv
`
`magnification npticai zoonittllwtil by reference to information (depth man determined hy
`
`crooning a region of the second image that corresponds to the first itnageHfilZsi} indicating the
`
`zoom power of the morn optical system (where zoom oi the first image is acquired by a high
`
`magnification nptieai zoom cone! to or higher than 745 opticai zoorn and second image
`
`acquired by iow~tnagnifieation opticai zoom such as no optieai zoohiflfiiif'tl and
`
`But does not exphcitiy teach,
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 10
`
`wherein the circuitry seiects a pini'ality of image blocks train the area that has been cut out by the
`
`rough cropping section.
`
`iriowever, in the same field of endeavor, Biclterstat't teaches,
`
`wherein the circuitry {digitai image processing “perfertucd by a CPU’”){°§[54} selects a plurality
`
`of image blocks (features 41% and éZttH‘fiSt}, Fig: eat from the area that has been cut out (right
`
`image with a greater degree of reunitiifidzii {Fig.8} showing a right image having a greater
`
`morn where features 42ft and 41% Eiqte‘tzi
`
`it wentd have been cihvious te- ene with ordinary skit} tn coi‘ahhte the stereo camera etiee with the
`
`imaging process of Biclterstaff with the block corresportdence of Suite with the cori‘ectien of Nakazzn 'a
`
`where digitai h‘aage precessiug seiects images blocks from. a reduced View h‘aage, The reason fer this is
`
`that when used in cnntparisnu of a, ieft and right images. disparities can be determined based on the
`
`differences.
`
`Regarding claim 9, Lee in View of Bickerstaff With Saito in View of Nakazawa teach the limitation of claim 1,
`
`Lee teaches additionally,
`
`cempares respective image features (depth infat‘matian intanrpnrated intn a depth nittp)[‘i{23j of
`
`the first and second images (depth int‘nrniatinn nt’ respective page at" the first and seennd
`
`integetiHfiZ] that are represented in multiple different resolutions {first image may he an image
`
`acquired by a high magnification optical shunt and secund image may he acquired by a inw~
`
`magnification mnntfl‘fiiit} and determine the plurality of image bin-cits based on a remit of the
`
`comparison;
`
`But does not exphcitiy teach
`
`compares respective image features of the first and second itnages and determine the pturaiity of
`
`image hiechs based on a result 01’ the comparison.
`
`Benet/er, in the same tieid of endeavor, Bic-kerstafi teaches additienaiiy,
`
`compares respective image features {features [mind in right hand image but nnt tet't hand
`
`imagfli‘fidfi] cf the first (left hand iinageihfidfi] and second images {right hand imagetiiiétil and
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 11
`
`determine the plurality of image hioclrs (subsection having the same fieid of VitiW)fi[5¢ii based
`
`on a result of the compza'ison. (feature 42%} circled in “fig... 63 is vertically dishiaced from the
`
`eorreshonding feature in fig. on by 3‘54.” and feature 41% cireies in “fig‘ 63 is horizontally
`
`dispiaced from the corresponding feature in fig on by 3%”):ifilfitij
`
`It would have been obvious to one with ordinary skill to combine the stereo camera of Lee with the
`
`imaging process of Biclterstaff with. the block correspondence of Saiio with the correction of Nakazawa
`
`where comparing features can. deteirtiiue the block of a subsection of an image. This is because the features
`
`not found in both left and right images indicate a disparity between the left and right images.
`
`Regarding claim 10, Lee in View of Bickerstaff With Saito in View of Nakazawa teach the limitation of claim 1,
`
`Nakazawa teaches additionally,
`
`performs the stereo matching (stereo matching teeliniquefi‘fifim by making, on the same
`
`horizontal rangethorizontai direction where the position coordinate between the
`
`characteristic ottirat and eorresporujiug gitrint are on the simiiar horizontal lines of images SR
`
`and SLHFig. it la, til b] the number of pixels (position coordinate between the characteristic.
`
`point and corresponding point)???” in the first horizontal signal {XE )filEPZ} and number of
`
`pixets in the second horizontal tine signals (X2)i‘fi92} equal to each other. trilenXLZH‘flQZE
`
`it wonld have been obvious to one with ordinary skill to combine the stereo camera of tee with the
`
`imaging process of Bicherstaft‘ with the hiocl: correspondence of Saito with the correction ot‘ Nakazawa
`
`where parallax is determined using the corresponding points in an image. The reason for this is that the
`
`coordinate of these points will indicate an accurate parallax measure for that position of the when the
`
`determined paraiiax is used in image synthesis
`
`2.
`
`Claim 3 rejected under pre-AIA 35 U.S.C. 103(a) as being unpatentable over Lee et a}. {US 23110169921
`
`Al) in View oi" Biekerstafl' at air if {ES 2t” ltiZthéZti Ali in View of Saito (Eli; Etlilttlt'itiiflti Al) in View oi”
`
`Nakazawa (US EtilltflgZEZ? Al) in View of Seta (US 6987534 B1)
`
`Regarding claim 3, Lee in View of Bickerstaff With Saito in View of Nakazawa teach the limitation of claim 1,
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Lee teaches additionally,
`
`Page 12
`
`color adjustment (while baianceHfilEZ} to reduce a dil‘terence (haiance){‘}{323 bets even in the first
`
`and second images (Correct the first and second image {8250)}E‘fi323 and then carries out the
`
`stereo matching (enntinnes with stereo matching the first and second image with depth map
`
`extraetingefSEt'iiiiii‘liiifi, Fig. 3]
`
`But does not explicitly teach,
`
`gain adjustment in order to reduce a difference in average iinninanee vaine between at least one
`
`pair of mutually corresponding image areas in the first and second images and second images to a,
`
`preset valne
`
`However, in the same field of endeavor, Seta teaches additionally,
`
`gain adjustment (gain enntr’oi atniiiii'ier adjusts hrigittnessfiabs} in order te- retlnee a diffs/trenee
`
`{reduce tiii'i'ereneefliabsj in average luininance value (adjust a brightness baianeeiiabsj
`
`between at least one pair (pair of iinagesilabs‘j of mutually corresponding image areas in the first
`
`and second images (magnitude of an entire. brightness of a first evaluation window and
`
`second evaination windowtlabs] to a preset mine {_gains of restieetive amniifiers 33
`
`established to mines according to gain indicating mines (EM/SEN, ("r-SUB)12:54~55j
`
`it wonlci have been obvious to one with ordinaiy slzili to combine the stereo camera of Lee with the
`
`imaging process of Bickerstafl with the hiocl: correspondence of Saito with the correction ol‘ Nakazawa
`
`with the gain adjustment oi~ Se a which balances images by use oi~ gain control amplifiers. This would be
`
`ohvions since gain balancing to improve the precision ol‘ the steieo matching
`
`3.
`
`Claim 4 rejected under pre-AIA 35 U.S.C. 103(a) as being unpatentable over Lee et ai. {US 20110169921
`
`Al) in view oi" Bieherstai‘i’ et ai‘ {iiS Ztii 10235326 Al) in View of Saito (iii); 20119169820 Al) in view oi”
`
`Nakazawa (ii-S 201i0292227 Al) in View of Diggins (US 20120062699 A1)
`
`Regarding claim 4, Lee in view of Bickerstaff with Saito in view of Nakazawa teach the limitation of claim 1,
`
`Bickerstaff teaches additionally,
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 13
`
`stereo matching (“detect feature disparities”): {€149} based the horizontal lines (“horizontal
`
`extent of the right hand image” #7551] included in the vertical image area (“vertical extent of
`
`the right hand image”)fii54l that has been calculated by the vertical area calculating section
`
`t digital image grocessing nerl‘ormed by a CPUH‘HSS] and the signal representing their
`
`corresponding horizontal lines (“horizontal extent of the left hand lniage‘”}{fl513 in the tirst
`
`image (of left; hand image, Fig. tiAfftfilc‘Eai, Fig 6A]
`
`Brit does not explicitly teach,
`
`stereo matching based on a cross-cratelatinn between the signal representing the horizontal lines
`
`included in the second stereoscopic image and the first image
`
`However, in the same field of err-:leavor, Higgins teaches additionally,
`
`stereo matching (detecting constituent ianagcsii‘flifil based on a cross-cratelatinn {oner-
`
`tiimcnsional cross—correlation)Hfifisl-j between the signal representing the horizontal lines
`
`included (horizontally averaged pixel valnesfl‘lBS] in the second stereoscopic image {from a to};
`
`half of the frame in an over~and~nnder eat‘riagte}{‘li35,37l and the first image {horizontally
`
`averaged pixel values from a bottom half of the frame in an overendvrmder carriage.)
`
`REESE
`
`lt wonld have been obvious to one with ordinary slzill to combine the stereo camera of tee with the
`
`imaging process of Biclterstafl with the hlocl: correspondence of Saito with the correction of Nakazawa
`
`with the stereoscopic detection ol~ Diggins to create a process where cross~corrciatitni is nsed to match the
`
`areas of stereoscopic images. This is because crossmcorrelation can determine if the detected correlation
`
`between the first top frame and the second lower frame are detectable stereoscopic image. A
`
`4.
`
`Claim 8 rejected under pre-AIA 35 U.S.C. 103(a) as being unpatentable over Lee cl at. {US 23110169921
`
`Al) in View nl’ Bielrerstai‘l’ et al‘ {LS 231 ltiZCSSZtS All in view of Saitn (Eli; Etllltl'ltititfltl Al) in view til”
`
`Nakazawa (ll-S 2hlltt£92227 Al) in View of Hoshino (US 20110279653 A1)
`
`Regarding claim 8, Lee in View of Bickerstaff With Saito in View of Nakazawa teach the limitation of claim 1,
`
`Bickerstaff teaches additionally,
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 14
`
`caiicuiates t“tietect feature disparities”)i€[49} the verticai image area tb‘vcrticai extent”)tfi]53jof
`
`the second irnaget“oi' the right intagc’h fig. m which is a modified version of trig. 53)}:‘3154,
`
`trig. 7A, hit} that has the same verticai direction range (right hand image having “sonic fiehi {it
`
`view “its the ictt hand iinagefl‘flfiéitas a first iniaget“of the ieit image”, Fig. 6A )E‘ficii}, Big, on
`
`it wontd have been obvious to one with ordinary skill to combine the stereo carnera of Lee with the
`
`imaging process; of Biekerstaft with. the hioek correspondence of Saito with the correction of Nakazstwa to
`
`create a process; where the difference between the ieft and right images is determined, The reason for this; is
`
`that Biekersnaif offers a particidar way of comparing the horizontai and vertica} differences; of the iett. and
`
`right eye images to define the differences by detecting an image feature.
`
`Brit. does not explicitly teach,
`
`instices; cor ‘ection on a distortion that has been caniseti h}? a lens distortion of the zoo