`
`UNITED STATES DEPARTMENT OF COMMERCE
`United States Patent and Trademark Office
`Address: COMlVHSSIONER FOR PATENTS
`PO. Box 1450
`Alexandria1 Virginia 22313-1450
`www.uspto.gov
`
`
`
`
`
`14/016,465
`
`09/03/2013
`
`Yoshihiro MORIOKA
`
`OKUDPOSQSUS
`
`3080
`
`08/17/2017 —MARK D. SARALINO (PAN) m
`7590
`51921
`RENNER, OTTO, BOISSELLE & SKLAR, LLP
`LEE, HMMYS
`1621 EUCLID AVENUE
`19TH FLOOR
`
`PAPER NUMBER
`
`CLEVELAND, OH 44115
`
`2486
`
`NOTIFICATION DATE
`
`DELIVERY MODE
`
`08/17/2017
`
`ELECTRONIC
`
`Please find below and/or attached an Office communication concerning this application or proceeding.
`
`The time period for reply, if any, is set in the attached communication.
`
`Notice of the Office communication was sent electronically on above—indicated "Notification Date" to the
`following e—mail address(es):
`
`ipdocket @rennerott0.c0m
`
`PTOL—90A (Rev. 04/07)
`
`

`

`
`
`Applicant(s)
`Application No.
` 14/016,465 MORIOKA ET AL.
`
`Examiner
`Art Unit
`AIA (First Inventorto File)
`Office Action Summary
`
`2486JIMMY 8. LEE first“
`
`-- The MAILING DA TE of this communication appears on the cover sheet with the correspondence address --
`Period for Reply
`
`A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE g MONTHS FROM THE MAILING DATE OF
`THIS COMMUNICATION.
`Extensions of time may be available under the provisions 0137 CFR 1.136(a).
`after SIX (6) MONTHS from the mailing date of this communication.
`If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication.
`Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133).
`Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any
`earned patent term adjustment. See 37 CFR 1.704(b).
`
`In no event, however, may a reply be timely filed
`
`-
`-
`
`Status
`
`1)IXI Responsive to communication(s) filed on 7/19/2017.
`[I A declaration(s)/affidavit(s) under 37 CFR 1.130(b) was/were filed on
`
`2b)|:| This action is non-final.
`2a)IZ| This action is FINAL.
`3)I:I An election was made by the applicant in response to a restriction requirement set forth during the interview on
`
`
`; the restriction requirement and election have been incorporated into this action.
`
`4)|:I Since this application is in condition for allowance except for formal matters, prosecution as to the merits is
`closed in accordance with the practice under EX parte Quay/e, 1935 CD. 11, 453 O.G. 213.
`
`3) D Interview Summary (PT0_413)
`1) E Notice of References Cited (PTO-892)
`Paper No(s)/Mai| Date.
`.
`.
`—
`4) I:I Other'
`2) D Information Disclosure Statement(s) (PTO/SB/08a and/or PTO/SB/08b)
`
`Paper No(s)/Mai| Date .
`U.S. Patent and Trademark Office
`PTOL-326 (Rev. 11-13)
`
`Office Action Summary
`
`Part of Paper No./Mai| Date 20170808
`
`Disposition of Claims*
`5)|XI CIaim(s)1-_10is/are pending in the application.
`5a) Of the above claim(s)
`is/are withdrawn from consideration.
`6 III Claim s) _ is/are allowed.
`s 1-_10 is/are rejected.
`
`is/are objected to.
`
`I )
`
`_
`
`
`are subject to restriction and/or election requirement.
`9)|:l Claim(s
`I
`* If any claims have been determined allowable, you may be eligible to benefit from the Patent Prosecution Highway program at a
`
`participating intellectual property office for the corresponding application. For more information, please see
`htt
`://www.usoto. ov/ atents/init events"
`h/index.‘s
`
`
`
`
`
`, or send an inquiry to PF"I-Ifeedback{<‘buspto.qov.
`
`Application Papers
`
`10)I:I The specification is objected to by the Examiner.
`11)|:I The drawing(s) filed on _ is/are: a)I:I accepted or b)I:I objected to by the Examiner.
`Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a).
`
`Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121 (d).
`
`Priority under 35 U.S.C. § 119
`12)IZI Acknowledgment is made of a claim for foreign priority under 35 U.S.C. §119(a)-(d) or (f).
`Certified copies:
`
`b)I:I Some” c)I:I None of the:
`a)le All
`1.IZI Certified copies of the priority documents have been received.
`2.I:I Certified copies of the priority documents have been received in Application No.
`3.I:I Copies of the certified copies of the priority documents have been received in this National Stage
`
`application from the International Bureau (PCT Rule 17.2(a)).
`** See the attached detailed Office action for a list of the certified copies not received.
`
`Attachment(s)
`
`
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 2
`
`DETAILED ACTION
`
`Notice ofPre-AIA 0r AIA Status
`
`The present application is being examined under the pre-AIA first to invent provisions.
`
`Response to Arguments
`
`1.
`
`Applicant‘s arguments filed 7/19/2017 have been fully considered but they are not persuasive. In particular,
`
`the applicant considers that the applied prior art does not teach the newly amended limitation. This is supported by
`
`the applicant when it is argued that Lee teaches that the optical zoom of both the first and second lens units have a
`
`zoom function, naming the aspect of "to extract depth map using the stereo matching method $230" to support this
`
`assertion. However, it should be noted that although Lee teaches two different lenses 110 (first) and 115 (second), it
`
`should be further noticed that Fig. 5a and 5b described are clearly indicated as having different zoom magnifications
`
`on fl[18, which specifies fig. 5a relates to optical zoom function of 5x and fig. 5b relates to optical zoom function of
`
`1x, rendering this similar to the claimed invention. Although there are different zooms attainable depending on the
`
`desired zoom for depth mapping, it should be noted that functionally the second lens unit capable of rendering this
`
`low-magnification optical zoom function 1x operates similarly to the claimed second optical system being not a
`
`zoom optical system. In this way, the examiner maintains that Lee teaches the amended limitation. The applicant
`
`argues that the other applied prior art does not teach the claimed amendment, however, the examiner, as previously
`
`disclosed, considers that Lee teaches the amended limitation.
`
`The dependent claim rejections are maintained in light of the argument put forth previously.
`
`Claim Rejections - 35 USC § 103
`
`The following is a quotation of pre-AIA 35 U.S.C. 103(a) which forms the basis for all obviousness rejections set
`
`forth in this Office action:
`
`(a) A patent may not be obtained though the invention is not identically disclosed or described as set
`forth in section 102 of this title, if the differences between the subject matter sought to be patented and
`the prior art are such that the subject matter as a whole would have been obvious at the time the
`invention was made to a person having ordinary skill in the art to which said subject matter pertains.
`Patentability shall not be negatived by the manner in which the invention was made.
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 3
`
`The factual inquiries set forth in Graham v. John Deere C0., 383 U.S. 1, 148 USPQ 459 (1966), that are applied for
`
`establishing a background for determining obViousness under pre-AIA 35 U.S.C. 103(a) are summarized as follows:
`
`1. Determining the scope and contents of the prior art.
`
`2. Ascertaining the differences between the prior art and the claims at issue.
`
`3. ResolVing the level of ordinary skill in the pertinent art.
`
`4. Considering objective eVidence present in the application indicating obViousness or nonobViousness.
`
`1.
`
`Claim 1, 2, 5-7, 10, and 11 rejected under pre-AIA 35 U.S.C. 103(a) as being unpatentable over Lee ei ai.
`
`(US Eti't 1916992} All) in View of Bieket‘stai‘i‘ et a}. (US 2%} 1532353826 A3,) in View of Saite (US 28110163825} All)
`
`in View of Nakamwa {US Eti'iitiEQZEZ’?’ A1).
`
`Regarding claim 1, Lee teaches,
`
`A stereoscopic shooting device (_stereo camera iittifl‘fii‘i’] comprising:
`
`a first optieai system (first tens unit 1 iitfli i S}, the ti rst ootieai system being 31 zoom optical
`
`system; (having ontieai zoom ei'teetsfl‘iijtti]
`
`a first sensor (first image sensor 12tiiiiii‘ig.2~i2ti} that receives light transmitted through the tirst
`
`optical system {first tens iitt gathers tight from an object and “form images on regions oi“ the
`
`first image sensor 32%”)E :32} and obtains a first image (first iniageiittft'i’j by shooting a subject;
`
`(“Images picked up by first image sensor 122‘ ”, es denieted by fig. 41%}E‘112tt, Fight]
`
`a second optics! system (seeonti tens unit iififl‘fiig} that is not a zoom optical system (second
`
`tens iinit, "having a iow~magnii'ieation optieei zoom t’nnetion KPHGJ iiii
`
`a second image sensor (seennei image sensor 125)}:E‘ig242t}; that receives iigiit transmitted
`
`through the second optieai s ysteni (second tens 115 gathers tight from an object and “form
`
`images on regions of the seeonei image sensor 125”}tfilflj and obtains a second image (seeenti
`
`image of the same seenefl‘iti’fl by shooting the subject; (“images picked up by seeoneii rnage
`
`sensor 125”, as depieteti by fig... sittfl‘filtt, Fig 43] and
`
`circuitry (stereo camera 10% crop using a, stereo snatehingflfifitj} which cuts respective image
`
`portions (not) the image aeonia‘ett by the towuriiagnii‘ieatien {tpiiélflti soomHfiBtj} that have a,
`
`some angie of‘view temp the same region SESH‘ESQ out of the first and second itrtztges, (inmge
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 4
`
`aeqnired hy the high-magnification optical zoom from the image acquired hy the lnw~
`
`magnification ontieal zttoanll‘llfiél wherein the first, image is ohtainetl hy the first image sensor
`
`(Fig. 5A depicting first image heing a “photograph taken by the first lens nnit”)fi‘glt§, iiig
`
`SA] when the zoom power of the first optical system (“lens having a high“magnification optical
`
`zoom inaction SX’Wl‘fil 8, Fig. 5A] is tlifle tent from a zoom power of the seccnitl optical. system,
`
`(Fig. SB depicting nitotograph with the ”lens having a iowuntagnil’ication ontieni noon;
`
`Function of Xi”’)l°lll,8, Fig. 5'33] anal the second itrtage is obtained lit)" the second itrtage sensor.
`
`{second image hazing a “photograph taken by the second lens iniit”)filll§l and
`
`wherein the circuitry (stereo camera tilt} ere}; using a stereo matchingll‘lfitil
`
`selects a plurality (crop the same region 525ll<ll3til of mntnally cotresponding image hloclts
`
`{acquired by the lnw~magnii'icatinn optical eotnnfifilfifi] that have a same image feature (same
`
`region 525 as acquired by the highumagnification optical zoom as the image acquired by the
`
`lnw~magnifieatittn optical znonilllllfifij from the first and second images {first and second
`
`image of the same scenell‘lllil‘j
`
`lint, lee
`
`does not explicitly teach,
`
`optical system including a plurality of lenses,
`
`calculates a vertical image area of the second image that has a same vertical direction range as the
`
`first image based on relative vertical positions of the image hlochs in the respective images,
`
`adjusts the number of horizontal lines included in the vertical image area ol‘ the second image and
`
`the tntmher ol'herizontai lines included in the lirst image to a predetermined value,
`
`ontpttts a first horizontal line signal representing the horizontal lines included in the first image
`
`and a second horizontal line signal representing the horizontal lines inclnded in the 'ertieai image
`
`area of the second image,
`
`pert'orrns stereo matching by comparing to each other the l'irst and second horizontal line signals
`
`supplied from the rtnmlaer of horizontal lines matching sect ion, and
`
`wherein the Cit‘ctlill‘)’ determine the vertical image area lay comparing the ratio of the vertical
`
`coordinates of respective representative points in a phitality of image blocks selected front the first
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 5
`
`image to the ratio of the vertical coordinates of respective representative points in a plurality of
`
`image blocks selected [rent the second image,
`
`lrlowe'ver, in the same iieltl of endeavor, litielterstafi teaches additionally,
`
`opt teat system ineinding a plurality of lenses, {“entieai imaging 5ysten35 119,” eaeh enniprising
`
`“tine nr tnnre tents assernhlies" (represented aehemalteally by “tenses 112, 11st, and
`
`116°°liiil76i
`
`calculates {*‘detet‘t feature disnarities”){$49} a vertical image area {“vertieai extent”)tfi§533 of
`
`the secend image {“nit" the right image”, fig, 7A which is a madil'ietl verainn at Fig. tihmlfid,
`
`Fig. 7A, 68] that would have the same vertical direction range (right hand image having “set me
`
`field at View “as the left hand iniagejti‘fiS-él as the first image (“at the left image”, Fig. tint
`
`Hit-49, Fig. {EA} based on relative vertical positions (“vertical extent”)fi'§4$l of the image blocks
`
`(”‘snhseetinn” having the granite field (if Vitenfltfilfld] in the respective images. (left and right
`
`imageslitlifiil
`
`adjusts t“ernpning” snhseetittn having the name field at Viewiillldfi the number cit" heriznntal
`
`lines (“hnriznntal extent at the right hand image” it‘llSli included in the vertical image area
`
`(“vertical extent at the right hand iniage”)fil5‘tj of the second image (at right hand image;
`
`Fig, 7A'yliifi54} and the number of horizontal tines (“herizentai extent at” the left hand
`
`intage”)ifil§ it {at Left hand image; li‘igo midlillfie'l, Fig. {in} included in the first image tn a
`
`predetermined value, ihnrizentai extent at right hand image etiaal tn the heriznntal extend at
`
`the tett hand imageiillifidj
`
`determines the vertical image area (“detect feature disearittes” hy enmparittnn {if features at
`
`the edge; and additionally anywhere within the pair at” eaetnred intttgesfl‘ilctltxfitl by
`
`comparing (“estimate a disparity” in the resneetive fields {it viewfi‘filiitll the ratio 01' the vertical
`
`coordinates { the “vertieat extent” emtnisting at the entire vertieat extent {it the irnage in fig:
`
`tidii‘liz‘itldiig. 6A.] of respective t‘epresentative points (pixeh‘ in the field at view at the lel't hand
`
`image, Fig. 6A)[fii§t§, Fig. 6A.] in a, plurality of image blocks (features at the edges and
`
`additinnaily “anywhere within the hair at captured itnages“*}lil5ti.,§ii saejteetett from the first
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 6
`
`image {whole image as basis of eoniparisonfifilifll to the ratio of the vertical coordinates (the
`
`“vertical extent" consisting of the entire vertical extent of the image in fig fiB)E‘lt5il,Fig. 63}
`
`of respecti ve representative points (pixels in the field of view of the right hand image, Fig
`
`éfili‘lififi, Fig. 63} in a plurality of image blocks selected from the second image. (whole image as
`
`basis of comparisonIti‘fiSi}
`
`lit wonld have been ohvions to one with ordinary skill to combine the stereo camera of tee with the
`
`imaging process of iiiiciterstaff to create a process where the difference between the left and right images is
`
`determined. The reason for this is that Bickerstaff offers 31 particular way of comparing the horizontal and
`
`vertical differences of the left and right eye images to define the differences by detecting an image feature.
`
`But, Lee in view of Bickerstaff does not explicitly teach,
`
`selects a plurality of image blocks from the first image that mutually correspond to a plurality of
`
`image blocks from the second image based on variation in at least one of luminance signals or
`
`color signals, when the mutually corresponding image blocks have a same image feature,
`
`outputs a first horizontal line signal representing the horizontal lines included in the first image
`
`and a second horizontal line signal representing the horizontal lines included in the vertical image
`
`area ol‘ the second image,
`
`perl‘ornis stereo matching by comparing to each other the first and second horizontal line signals
`
`supplied from the noniher ofhorinontai lines matching section, and
`
`However, 8.1: to teaches additionally,
`
`selects a plurality of image blocks (range 401L and 405R “divided into blocks by means of
`
`parallax grid adjusted grids”)[1152,53] from the first image (“right-eye image 301R”)[1152, Fig.
`
`3A] that mutually correspond to a plurality of image blocks (entire corresponding range 405R
`
`with respect to range 401L where “blocks on the right-eye image 301R corresponding to the
`
`blocks of the left-eye image 301L”)[1152] from the second image (“left-eye image 301L”)[1152,
`
`fig. 3b] based on variation in at least one of luminance signals or color signals, (“color
`
`information such as hue and luminance of the blocks on both the right-eye and left-eye
`
`images satisfactorily match each other”)[1152] when the mutually corresponding image blocks
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 7
`
`have a same image feature (figs. 3a-3d depicting an image similar to that of Figs. 2a and 2b
`
`which specifies that depict subject 102 where the subject 102 of 301L contains range 401L
`
`that corresponds with range 405R of 301R)[‘][44-51, Fig. 2a,2b,3a,3b,3c,3d]
`
`performs stereo matching (“hloch’ n3atehittg”)i€[7$l by comparing to ezteh mher the first {“hinek
`
`of the. first ianage”)lfi]73§ and second horizontal line signals (“part of the seemtd itnagewiillT/S]
`
`supplied front the number of intrizontal lines matehing section (block matching the horizontal
`
`direction by “position vwhere the SAD becomes the stnoiicst may he searched for while
`
`shifting the hittelc oi‘ the first; image horizontalliy”’)lfil73l
`
`It would have been obvious to one with ordinary skill to combine the stereo camera of lee with the
`
`imaging process of Biekerstati with the hloclc correspondence of Saito to. have a matching block grid
`
`between a left and right images of a, snhjeet. The reason for this wonld be for maintaining depth effects in a,
`
`range between left and right images.
`
`But, Lee in View of Bickerstaff with Saito does not explicitly teach,
`
`outputs a first horizontal line signal representing the horizontal lines included in the first image
`
`and a second horizontal line signal representing the horizontal lines included in the vertical image
`
`area ol‘ the second image,
`
`perl‘ornis stereo matching by comparing to each other the first and second horizontal line signals
`
`supplied from the number ofhorinontal lines matching section, and
`
`However, in the same field ot" endeavor, Nakaza‘wa teaches additionally,
`
`outputs a first horizontal line signal {Xi and X2 ttsetl in parallax measuring eirettit 8):?192} (Xi
`
`indicating horizontal “coordinate oi“ the characteristic point FL” oi“ the image SliililllélZl
`
`representing the horizontal lines {Xiilffiilz Fig. llA} inclnded in the first image {image SL
`
`corresponding to the iel't eye li‘ililzl and a second horizontal line (£2 intiieating horizontal
`
`“coordinate of the eharactcrisiie point Elli” ol‘ the image SRfl‘flQZl signal representing the
`
`horizontal lines {X2}[‘l{92, Fig. llli] included ofthe second image, (image SR corresponding to
`
`the right melting;
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 8
`
`performs stereo matching (parallax measnrlngflfing} by comparing to each other the first and
`
`second ltotizontal line signals {calculated as del xXEH‘EiQ’C/E] supplied from the ritnnlter of
`
`horizontal lines rnatcltiitg section. (coordinate at" image Slit and image Sillitlfilfil
`
`It wonld have been ohvions to one with ordinary ski ll to conihirte the stereo camera of tee with the
`
`imaging process of liéiclqerstaft with the ltlocl< correspondence of Saito with the correction of Nakazawa to
`
`create a process Where the parallax. of the plurality of Viewpoints can be calculated. The reason ior this is
`
`tltat Nakazawa offers a process of calculating parallax, to correspond to a, distance to a subject of each
`
`Viewpoint acquired by the imaging optical system.
`
`Regarding claim 2, Lee in View of Bickerstaff with Saito in View of Nakazawa teach the limitation of claim 1,
`
`Lee teaches additionally,
`
`second image sensor {second lens unit litfitfilléij obtains the second image (second imageii‘filfl
`
`by shooting the subject (scenelfiiit’l‘j at a Wider angle of View {acquired by the low~
`
`magnification optical zoonifl‘flliti} than an angle of View (magnll'ication of the limit imagine and
`
`second image are difl‘erentfl‘fifitt] at which the first image is shot. (image acquired hy the high
`
`magnification optical zoomH‘lBtE}
`
`Regarding claim 5, Lee in View of Bickerstaff with Saito in View of Nakazawa teach the limitation of claim 1,
`
`Nakazawa teaches additionally,
`
`generates parallax information (parallax as ti liltiflli based on the first and second horizontal hoe
`
`signalstdel~X2)E‘}l923
`
`it would have been obvious to one with 01‘(lll’it y sldll to combine the stereo camera of Lee with the
`
`imaging process of Bickerstai’i with the hlocls; correspondence of Saito with the correction ol'hlaltazawa to
`
`create a process Where the parallax of the plnrality of Viewpoints can be calculated The reason for this is
`
`that [‘iakazawa offers a process of calculating parallax to cotrespond to a distance to a subject of each
`
`Viewpoint acqnired hy the imaging optical system,
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 9
`
`Regarding claim 6, Lee in View of Bickerstaff with Saito in View of Nakazawa teach the limitation of claim 5,
`
`Bickerstaff teaches additionally,
`
`generates {images generatedllahsl, hascd on the first itrtage, {crop of right hand image R5 is
`
`based on comparison with horizontal and vertical extent; of left hand imagelilifiiil a third
`
`image that, forms, (right hand image R’ with, same field of View as left hand image Fig, 61%,
`
`Fig. 7Aii‘li54l along with. the first image, (left hand image Fig. firmifilS-ill a pair of stereoscopic
`
`images {reduced disparity between respective fields of View of the stereoscopic image
`
`paerahsl
`
`lt would have been obvious to one with ordinary skill to comhine the stereo camera of lee with the
`
`imaging process of Bickerstatl with the hloclt correspondence of finite with the correction of Naltazawa to
`
`create a process Where an adjusted right hand image is paired with a left hand image. The reason is that the
`
`adjusted t‘lgltl hand itnage will have a retlnced disparity.
`
`But does not explicitly teach,
`
`generates, hased on the parallax information
`
`However, in the same field ol~ endeavor, Nakaza‘wa teaches additionally,
`
`generates, {synthesized image generated from corrected viewpoint iinagellfilfll based on the
`
`parallax information (parallax tl calculated liy the parallax measuring circuit fililllil'i’l, a third
`
`image (synthesized iinztgellfilW}
`
`lt would have been obvious to one with ordinary 5 {ill to combine the stereo carnera of Lee with the
`
`imaging process of Bickerstal’l with the blocls; correspondence of Saito with the correction ol'NaltazaVv'a to
`
`create a process Where parallax is important; in synthesizing an image. The reason l'er this is that calculating
`
`parallax to correspond to a distance to a stthject of each Viewpoint acquired by the imaging optical system.
`
`Regarding claim 7, Lee in View of Bickerstaff with Saito in View of Nakazawa teach the limitation of claim 1,
`
`Lee teaches additionally,
`
`cuts an area that corresponds {crop same region. SZS’H‘EBti] to a range of the first image (image
`
`acquired by the ltigltuiriagriliieatieti optical zonirililififil out of the second image (lawn
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 10
`
`magnification eeticat zoninltfitfiéi hy reference to information (depth man determined by
`
`crooning a, region of the second image that correseonds re the first image’flififiai] indicat ing the.
`
`more power ofthe zooiri optieat system (where attain ot the that image it? aeqnired hy a high
`
`magnification critical zoom eqnai to or higher than x5 optieat zoom and second image
`
`aeqnired by inwuniagiajii'ieatit:iir onticat sienna tench as no entieat zonamt‘ttitiii and
`
`Bttt does not explicitly teach,
`
`wherein the circuitty seiects a phti'ality of image htocks from the area that has been cut out by the
`
`tough cropping section.
`
`However, in the same field of endeavor, Bickerstaft teaches,
`
`wherein the circuitry (digitat image processing “performed by a CPEI’MfiM-t selects a plurality
`
`of image hlocks (_features ditt and 42tiiiiti5ti, Fig. 63} from the area that has been cat out {right
`
`image with a greater degree of anemttfiia‘l} (Figfji‘: showing a right image having a greater
`
`noem where features $29 and, 415} )E‘it‘t-Et
`
`it wonid have been ehvions to one with ordinary ; {ill to combine the steieo camera of tee with the
`
`imagingr process of iiickerstaft" with the block correspondence of Saite with the correction of Nahazawa
`
`where digitai image processing selects in‘tages blocks from a reduced View image. The reason for this is
`
`that when used in con‘tparison of a left and right images, disparities can he determined based on the
`
`differences
`
`Regarding claim 9, Lee in View of Bickerstaff with Saito in View of Nakazawa teach the limitation of claim 1,
`
`Lee teaches additionally,
`
`compares respective image features {depth information incorporated into a depth may)? '23] of
`
`the first and second images (depth information of respective pixels oi the first and second
`
`imageflfitiil] that are represented in multiple different resolutions {first image may he an image
`
`aeqmred by a high magnification opiieai zoom and second image may he acquired by a tow
`
`magnifieatinn zoonni‘fi'tifii and (ieterirtine the pini'aiity of image htocks based on a result of the
`
`comparison
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`But does not explicitly teach
`
`Page 11
`
`trotnpares resmeetive itrtage features of the first and second images and determine the plurality of
`
`image blocks based on a result of the eoniparisrur
`
`llo'twver, in the same tield of endeavor, litieherstafi teaches additionally.
`
`trotnpares respective iirtage features (features found in right hand image hut not; iet't hand
`
`imageiifiétéil oftlie first (left hand imageiitfiatiil and second images (right hand image/it‘il‘t-Sl and
`
`determine the plurality of image hioelts tsubseetion having the same field of ‘s’iewilfiifi‘il based
`
`on :1 result of the comparison, (feature 42% circled in “fig. 63 is vertically displaced from the
`
`corresponding feature in lit}. on by 3%” and feature 4th circles in “fig. 63 is horizentatty
`
`disglaeed from the eorresponding feature in Fig, 61% try 3%”):E‘tliitlt
`
`it would have been obvious to one with ordinary skill to cornhine the stereo camera of lee with the
`
`imaging process of Bieherstn’t‘i’ with the block correspondence of finite with the correction of Nakazawa
`
`where comparing features can determine the block of a subsection of an image. This is because the features
`
`not found in both left and right images indicate a disparity hetween the eft and right images
`
`Regarding claim 10, Lee in View of Bickerstaff with Saito in View of Nakazawa teach the limitation of claim 1,
`
`Nakazawa teaches additionally,
`
`performs the stereo matching c’ stereo matching teeliniqneiiiiliitt] by making, on the same
`
`horizontal rangcthorizontai direction where the position coordinate between the
`
`characteristic point and corresponding point are on the similar horizontal lines of images SR
`
`and SL): Fig. lla, lite] the number of pixels (position coordinate hetween the eharaeteristir
`
`point and eorresponding pointittliilli in the first horizontal signal (Xlfl‘j‘iQZl and number of
`
`pixels in the second horizontal line signals (XZM‘ESEZE equal to each other. {deLXZH‘fiQZE
`
`it would have been obvious to one with ordinary ant to combine the stereo camera of Lee with the
`
`imaging process of Bickerstztt’i with the hiotrl; enrrespondertce of Saito with the trotreetiort ol Nahazaiwa
`
`where parallax is determined using the corresponding points in. an image. The reason for this is that the
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 12
`
`wordinate (if these points will indicate an accurate parallax measure for that position (if the when the
`
`determined parallax is used in image synthesis.
`
`2.
`
`Claim 3 rejected under pre-AIA 35 U.S.C. 103(a) as being unpatentable over Lee et al, (US 2%} 1531699251
`
`A}; in View of Bieiterstai‘f et al. (US Ztillti285826 All) in View of Saito t iiS Ztilltiifiitgzlt Ali in View of
`
`Naiiazawa t iiS 2&3119292227 Ali in View of Seta (US 6987534 B1)
`
`Regarding claim 3, Lee in View of Bickerstaff with Saito in View of Nakazawa teach the limitation of claim 1,
`
`Lee teaches additionally,
`
`color adiustment (white baiattee)[‘f§33] to rednee a differe nee (balanceii‘figifil between in the first
`
`and second images (enrreet the first and seennti image {SZSiifiHEBZ} and then carries out the
`
`stereo niateliing {enntinnes vwith stei'en matching the first and second image with death inap
`
`extr’aetiaig(826fi})fi{33, Fig. '3:
`
`But does not explicitly teach,
`
`gain adjustment in order to reduce a difference in average inminance value between at least one
`
`pair of inntnaily corresponding image areas in the first and second images and second images to a
`
`preset value
`
`However, in the same field of endeavor, Seta teaches additionally,
`
`gain adjustment { gain eontrnl amplifier adjusts tirigiitnessiiaiis} in order to reduce a ditterence
`
`(reduce dit’i‘ereneeflabsl in average luminance value (adjust a brightness isalaneeflatisi
`
`between at least one pair (pair {if itnagesfi abs] (if mutually corresponding image areas in the first
`
`and second images (magnitude of an entire brightness of a first evaluation window and
`
`second evalnatinn windnwflaosi to a preset value t gains ni‘ resneetive anmlii‘iers 3a
`
`established to vaities according in gain indicating vaines GMAlN, GSUBHZ: “4~SS}
`
`it would have been obvious to one with ordina y sldli to combine the stereo camera of Lee with the
`
`hanging princess of Biekerstal’i Willi tire black. antrespnndenee of Saito with the (retraction {ti Naitaza‘wa
`
`with lite gain adjustment at Sela \i’iiich balances; images; by use at gain ee-iitrol amplifiers, This wettid be
`
`obvious since gain balancing to iirtprrwe the precision at the steret’a matching.
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 13
`
`3.
`
`Claim 4 rejected under pre-AIA 35 U.S.C. 103(a) as being unpatentable over Lee et at, (US 2%} 101699251
`
`Ali in View of Bielterstai‘f et’ at. (US 20110285826 Al) in View of Salts t iiS Zilillilfiittlzti All in View of
`
`Nahazawa t iiS lel 1029222”? All in View of Diggins (US 20120062699 A1)
`
`Regarding claim 4, Lee in View of Bickerstaff with Saito in View of Nakazawa teach the limitation of claim 1,
`
`Bickerstaff teaches additionally,
`
`stereo matching (“detect feature tils;3ar:it:ies°”)ifi]49§ based the horizontal lines (“laijiriaontai
`
`extent of the right hand image” )l‘llfi l] included in the vertical image area (“vertical extent of
`
`the. right hand image”)fi54l that has been calculated by the vertical area calculating section
`
`{digital image processing performed by a {It’lm‘lififij and the signal representing their
`
`corresponding horizontal lines (“horizontal extent of the left hand image”){fi5ll in the first
`
`image, {of Left hand image, Fig. 61$)lfi154, Fig. {EA}
`
`But does not explicitly teach,
`
`stereo matching based on a cross~corre ation between the signal representing the horizontal lines
`
`included in the second stereoscopic image and the lirst image
`
`However, in the same field ol~ endeavor, Diggins teaches additionally,
`
`stereo matching t detecting constituent hnagesfl‘llfié} based on a cross~correlation (one
`
`dimensional crossncorrelationfl‘lli’uil between the signal representing the horizontal lines
`
`included {horizontally averaged pixel vainesfi‘ltfiil in the second stereoscopic image (from a top
`
`half {ii the frame in an over~andunnder carriagefiii‘fifiéfi'i] and the lirst image (horizontally
`
`averaged pixel values from a bottom half of the frame in an overvandunnder carriage)
`
`l‘ll35fi7i
`
`it would have been obvious to one with ordininjy' sl-dll to combine the stereo camera of Lee with the
`
`imaging process of Bickerstai’l with the hlocls; correspondence of Saito with the correction ol'Nalrazawa
`
`with the stereoscopic detection of liliggins to create a process where cross-eorrelation is used to nratch the
`
`areas of stereoscopic itriages. This is because cross-correlatioir can determine if the detected correlation
`
`hetweeri the first top frame and the second lower train-e are detectable stereoscopic images.
`
`

`

`Application/Control Number: 14/016,465
`
`Art Unit: 2486
`
`Page 14
`
`4.
`
`Claim 8 rejected under pre-AIA 35 U.S.C. 103(a) as being unpatentable over Lee et at. (US 2%} 1531699251
`
`All in View of Bicherstai‘f et’ at. (US 2%11fl285826 Al) i