`
`UNITED STATES DEPARTMENT OF COMMERCE
`United States Patent and Trademark Office
`Address: COMMISSIONER FOR PATENTS
`P.O. Box 1450
`Alexandria, Virginia 22313-1450
`www .uspto.gov
`
`APPLICATION NO.
`
`14/009,251
`
`
`
`
` FILING DATE
`
`10/01/2013
`
`FIRST NAMED INVENTOR
`
`ATTORNEY DOCKETNO.
`
`CONFIRMATIONNO.
`
`Norihiro Imamura
`
`OKUDP0916WOUS
`
`9412
`
`MARK D. SARALINO (PAN) Le
`
`RENNER, OTTO, BOISSELLE & SKLAR, LLP
`1621 EUCLID AVENUE
`1OTH FLOOR
`CLEVELAND, OH 44115
`
`ZHOU, ZHIHAN
`
`2482
`
`NOTIFICATION DATE
`
`DELIVERY MODE
`
`05/22/2017
`
`ELECTRONIC
`
`Please find below and/or attached an Office communication concerning this application or proceeding.
`
`The time period for reply, if any, is set in the attached communication.
`
`Notice of the Office communication was sent electronically on above-indicated "Notification Date" to the
`following e-mail address(es):
`ipdocket @rennerotto.com
`
`PTOL-90A (Rev. 04/07)
`
`

`

`
`
`Applicant(s)
`Application No.
` 14/009,251 IMAMURAETAL.
`
`Examiner
`Art Unit
`AIA (First Inventorto File)
`Office Action Summary
`
`ZHIHAN ZHOU Na 2482
`
`-- The MAILING DATEof this communication appears on the cover sheet with the correspondence address --
`Period for Reply
`
`A SHORTENED STATUTORY PERIOD FOR REPLYIS SET TO EXPIRE 3 MONTHS FROM THE MAILING DATE OF
`THIS COMMUNICATION.
`Extensions of time may be available underthe provisions of 37 CFR 1.136(a).
`after SIX (6) MONTHS from the mailing date of this communication.
`If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication.
`-
`- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133).
`Anyreply received by the Office later than three months after the mailing date of this communication, evenif timely filed, may reduce any
`earned patent term adjustment. See 37 CFR 1.704(b).
`
`In no event, however, may a reply betimely filed
`
`Status
`1)X] Responsive to communication(s)filed on 04/17/2017.
`LJ A declaration(s)/affidavit(s) under 37 CFR 1.130(b) was/werefiledon__
`2a)X] This action is FINAL.
`2b)L] This action is non-final.
`3)L] Anelection was made bythe applicant in responsetoarestriction requirementset forth during the interview on
`
`
`; the restriction requirement and election have been incorporatedinto this action.
`4)[] Since this application is in condition for allowance exceptfor formal matters, prosecution as to the merits is
`closed in accordance with the practice under Ex parte Quayle, 1935 C.D. 11, 453 O.G. 213.
`
` Attachment(s)
`
`Disposition of Claims*
`5)X] Claim(s) 1,2,4-9,11,12 and 15-23 is/are pending in the application.
`
`5a) Of the above claim(s)
`is/are withdrawn from consideration.
`6)L] Claim(s)____is/are allowed.
`
`7)X1 Claim(s) 1,2,4-9,11,12 and 15-23 is/are rejected.
`8)L] Claim(s)____is/are objectedto.
`
`9)L] Claim(s)
`are subject to restriction and/or election requirement.
`* If any claims have been determined allowable, you may be eligible to benefit from the Patent Prosecution Highway program at a
`participating intellectual property office for the corresponding application. For more information, please see
`or send an inquiry to PPHieedback@uspto.qoy.
`
`Application Papers
`10)L] The specification is objected to by the Examiner.
`
`11)L] The drawing(s)filed on
`is/are: a)L_] accepted or b)[_] objected to by the Examiner.
`Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a).
`Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d).
`
`Priority under 35 U.S.C. § 119
`12)[] Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f).
`Certified copies:
`a)L] All
`b)[-] Some** c)L] None ofthe:
`1..] Certified copies of the priority documents have been received.
`2.L] Certified copies of the priority documents have been received in Application No.
`3.L] Copies of the certified copies of the priority documents have been receivedin this National Stage
`application from the International Bureau (PCT Rule 17.2(a)).
`““ See the attached detailed Office action for a list of the certified copies not received.
`
`3) CT] Interview Summary (PTO-413)
`1) CT] Notice of References Cited (PTO-892)
`Paper No(s)/Mail Date.
`:
`.
`4 Ol Other:
`2) CT] Information Disclosure Statement(s) (PTO/SB/08a and/or PTO/SB/08b)
`Paper No(s)/Mail Date
`U.S. Patent and Trademark Office
`PTOL-326 (Rev. 11-13)
`
`Office Action Summary
`
`Part of Paper No./Mail Date 20170427
`
`

`

`Application/Control Number: 14/009,251
`
`Art Unit: 2482
`
`Page 2
`
`DETAILED ACTION
`
`This office action is in response to an amendmentfiled on 04/17/2017 in which claims 1, 2, 4-9,
`
`11, 12, and 15-23 are pending.
`
`Claim Rejections - 35 USC § 103
`
`1.
`
`The following is a quotation of pre-AIA 35 U.S.C. 103(a) which forms the basis for all obviousness
`
`rejections set forth in this Office action:
`
`(a) A patent may not be obtained though the invention is not identically disclosed or described
`as set forth in section 102 of thistitle, if the differences between the subject matter soughtto
`be patented and the prior art are such that the subject matter as a whole would have been
`obvious at the time the invention was made to a person having ordinary skill in the art to which
`said subject matter pertains. Patentability shall not be negatived by the manner in which the
`invention was made.
`
`2.
`
`Claims 1, 2, 9, 12, and 15 are rejected under pre-AlA 35 U.S.C. 103(a) as being unpatentable
`
`over Yosuke (JP 2008-015157 Translation) in view of Krijn (US 2012/0062991) and further in view of
`
`Sawai(US 6,343,862).
`
`3.
`
`4.
`
`Asto claim 1, Yosuke teaches an image pickup device comprising:
`
`a lens optical system which includesa first pupil region and a second pupil region thatis different
`
`from the first pupil region ([0023]-[0026] and FIG. 6 — pupil 92 and pupil 93);
`
`5.
`
`an image sensor with multiple groups of pixels, in each of whichfirst, second, third and fourth
`
`pixels, on which light that has passed through the lens optical system is incident ([0089] and FIG. 25), are
`
`arranged in two rows and two columns on an image capturing plane ([0092]-[0094] and FIG. 27 — 2x2
`
`RGB pixel matrix using Bayer array unit 240 consisting of G (241, 244), B (242), and R (243));
`
`

`

`Application/Control Number: 14/009,251
`
`Art Unit: 2482
`
`Page 3
`
`6.
`
`and an array of optical elements which is arranged between the lens optical system and the
`
`image sensor and whichincludesa plurality of optical elements ([0116]-[0120] and FIG. 38 — micro lenses
`
`530-533 facing on pixels 512a, 513a, 5126, and 513b on image sensor 211 (see FIG. 6 for image sensor
`
`211)),
`
`7.
`
`wherein the multiple groups of pixels are arrangedin first and second directions on the image
`
`capturing plane ([0092]-[0094] and FIG. 27 — column and row direction),
`
`
`
`8. wherein the first and second pixels haveafirst spectral transmittance characteristic, the third
`
`pixel has a second spectral transmittance characteristic, the fourth pixel has a third spectral transmittance
`
`characteristic, and in each said group ofpixels, the first and second pixels are arranged at mutually
`
`different positions in the second direction ([0092]-[0094] and FIG. 27 — 2x2 RGB pixel matrix using Bayer
`
`array unit 240 consisting of G (241, 244), B (242), and R (243); the two G pixels (241, 244) are arranged
`
`at mutually different positions in the y-direction),
`
`9.
`
`wherein in the array of optical elements, each of the plurality of optical elements is arranged at
`
`such a position as to face groupsof pixels that are arranged in a row in the first direction among the
`
`multiple groups of pixels ([0116]-[0120] and FIG. 38 — micro lenses 530-533 facing on pixels 512a, 513a,
`
`512b, and 513b on image sensor 211 (see FIG. 6 for image sensor 211)).
`
`10.
`
`Yosuke does not teach the array of optical elements facing towards the group of pixels that are
`
`arranged in a rowin the first direction among the multiple groups of pixels, and wherein each of the
`
`plurality of optical elements directs light that has passed through the first pupil region away from the
`
`second and fourth pixels and onto the first and third pixels and also directs light that has passed through
`
`the second pupil region away from the first and third pixels and onto the second and fourth pixels.
`
`

`

`Application/Control Number: 14/009,251
`
`Art Unit: 2482
`
`Page 4
`
`11.
`
`However, Krijn teaches an array of optical elements facing towards a group of pixels that are
`
`arranged in a rowin the first direction (FIG. 9C and [0092] — lens curvature faces the cover glass of the
`
`emitting pixel panel; looking at FIGs. 8, 9b, and 9c and [0079]-[0086], one can see pixel plane 86 and
`
`lens 90).
`
`12.
`
`Therefore, it would have been obvious to one of ordinary skill in the art at the time of the invention
`
`to modify Yosuke’s imaging device with Krijn’s autostereoscopic display device to show the array of
`
`optical elements facing towards the group ofpixels that are arranged in a row in the first direction among
`
`the multiple groups of pixels in order to reduce the number of, and preferably to eliminate the viewing
`
`cone boundaries (Krijn; [0011]). Krijn’s disclosure in FIG. 9c provides an example of an internal total
`
`reflection solution, where out coupling of light into the lenses is now bound by angle of incidence of the
`
`light by ensuring that the lens curvature faces the cover glass of the emitting pixel panel (OLED panel).
`
`Thus, for both types of display, the angle of light paths between the display panel and the barrier
`
`arrangementis limited to a first range each side of a normal direction. This enables the barrier to function
`
`to ensure the light from one pixel only reaches one barrier opening (Krijn; [0092]).
`
`13.
`
`The combination of Yosuke and Krjin does not teach wherein eachof the plurality of optical
`
`elements directs light that has passed through the first pupil region away from the second and fourth
`
`pixels and onto the first and third pixels and also directs light that has passed through the second pupil
`
`region away from the first and third pixels and onto the second and fourth pixels.
`
`14.
`
`However, Yosuke does teach wherein the array of optical elements directs light that has passed
`
`through the first pupil region away from the second and fourth pixels and onto the first and third pixels and
`
`also directs light that has passed through the second pupil region away from the first and third pixels and
`
`onto the second and fourth pixels ([0118] and FIG. 38; — “photoelectric conversion parts 512a and 512b
`
`are projected on the exit pupil 90 with the micro lenses 530 and 532 as a region containing the ranging
`
`pupil 92...photoelectric conversion parts 513a and 513b are projected on the exit pupil 90 with the micro
`
`

`

`Application/Control Number: 14/009,251
`
`Art Unit: 2482
`
`Page 5
`
`lenses 531 and 533 as a region containing the ranging pupil 93”; also see FIG. 25 for an embodimentof
`
`how the color filter is applied to the pixels/photoelectric conversion parts; also see FIG. 38(a) and [011 9]-
`
`[0120] wherelight flux 72 from ranging pupil 92 is emitted onto the photoelectric conversion part 512a,
`
`light flux 82 from ranging pupil 92 is emitted onto the photoelectric conversion part 512b, light flux 73 from
`
`ranging pupil 93 is emitted onto the photoelectric conversion part 513a, and wherelight flux 83 from
`
`ranging pupil 93 is emitted onto the photoelectric conversion part 513b; in other wordsthe polarizing
`
`element 522a transmits the light flux 72 and preventsthe light flux from ranging pupil 93 and polarizing
`
`element 522b transmits the light flux 82 and prevents the light flux from ranging pupil 93; correspondingly
`
`and looking at FIG. 38(a), Examiner has interpreted Yosuke as disclosing that polarizing element 523a
`
`transmits the light flux 73 and prevents the light flux from ranging pupil 92 and that polarizing element
`
`523b transmits the light flux 83 and prevents the light flux from ranging pupil 92, despite whatis stated in
`
`[0120] of the translated text; it is apparent from FIG. 38(a) that there is no light coming from ranging pupil
`
`92 that goes into any of the photoelectric conversion parts 513a and 513b; therefore, light that has
`
`passed through the first pupil region is directed away from the second and fourth pixels and onto the first
`
`and third pixels and light that has passed through the second pupil region is directed away from the first
`
`and third pixels and onto the second and fourth pixels).
`
`15.
`
`Yosukealso teaches, in FIG. 39 and [0122]-[0128], a single micro-lens associated with two
`
`photoelectric conversion part, for example micro-lens 630 associated with 612a and 613a. In addition,
`
`Sawai teaches a single micro-lens cell 17c, from a micro-lens array 17 that comprises multiple micro-lens
`
`cells 17c, that directs light to three different pixel units, each with three different adjacent pixels (see
`
`FIGs. 3 and 4 and col. 9, line 25 to col. 12, line 21).
`
`16.
`
`Therefore, it would have been obvious to one of ordinary skill in the art at the time of the invention
`
`to modify Yosuke’s imaging device and Krijn’s autostereoscopic display device with Sawai’s projecting
`
`image display device to show wherein each ofthe plurality of optical elements directs light that has
`
`passed through the first pupil region away from the second and fourth pixels and onto the first and third
`
`

`

`Application/Control Number: 14/009,251
`
`Art Unit: 2482
`
`Page 6
`
`pixels and also directs light that has passed through the second pupil region away from the first and third
`
`pixels and onto the second and fourth pixels in order to provide a projecting image display device that is
`
`capable of modulating all of the light from the light source and displaying images that are bright but which
`
`exhibits no unevennessin brightness, and that has a light modulating image display panel comprising
`
`pixels having a flat configuration (Sawai; col. 5, lines 1-6).
`
`17.
`
`Asto claim 2, Yosukefurther teaches wherein on a plane whichis parallel to the image
`
`capturing plane of the image senscr, the first and second pupil regions are arranged at mutually different
`
`positions in the second direction ([0023]-[0026] and FIG. 6 — pupil 92 and pupil 93).
`
`18.
`
`Asto claim 9, Yosukefurther teaches wherein the first, second, third and fourth pixels of the
`
`image sensor are arranged in a Bayer arrangement pattern ([0092] — Bayer array).
`
`19.
`
`Asto claim 12, the combination of Yosuke, Krijn, and Sawai teaches wherein the array of optical
`
`elements is a micro lens array, and wherein each of the plurality of optical elements includes a plurality of
`
`micro lenses that are arranged in the first direction, and wherein each of the plurality of micro lensesis
`
`arranged at such a position as to face two pixels that are arranged in the second direction (Yosuke;
`
`[0116]-[0120] and FIG. 38 — micro lenses 530-533 facing on pixels 512a, 513a, 5126, and 513b on image
`
`sensor 211 (see FIG. 6 for image sensor 211); Krijn; FIG. 9C and [0092)).
`
`20.
`
`Asto claim 15, Yosuke further teaches wherein the array of optical elements has been formed
`
`on the image sensor ([0116]-[0120] and FIG. 38 — micro lenses 530-533 facing on pixels 512a, 513a,
`
`512b, and 513b on image sensor 211 (see FIG. 6 for image sensor 211)).
`
`21.
`
`Claims 4-8, 22, and 23 are rejected under pre-AlA 35 U.S.C. 108(a) as being unpatentable over
`
`Yosukein view of Krijn and Sawai and further in view of Hirasawa (US 2009/0127430).
`
`

`

`Application/Control Number: 14/009,251
`
`Art Unit: 2482
`
`Page 7
`
`22.
`
`Asto claim 4, Yosukefurther teaches a signal processing section ([0030], [0037], and [0099)).
`
`23.
`
`The combination of Yosuke, Krijn, and Sawai does not teach wherein the signal processing
`
`section receives first and second pieces of image information that have been generated bythe first and
`
`second pixels, respectively, extracts the magnitude of parallax between the first and second piecesof
`
`image information, and generatesfirst and second color images with parallax based on the first, second,
`
`third and fourth pixels and the magnitude of parallax.
`
`24.
`
`However, Hirasawa teaches wherein the signal processing section receivesfirst and second
`
`pieces of image information that have been generated by the first and second pixels, respectively,
`
`extracts the magnitude of parallax between the first and second pieces of image information, and
`
`generatesfirst and second color images with parallax based on the first, second, third and fourth pixels
`
`and the magnitude of parallax (FIG. 8A and [0109]-[0111] — color filters in the Bayer arrangement; [0110]
`
`discusses the parallax amountin the x- and y-direction).
`
`25.
`
`It would have been obvious to one of ordinary skill in the art at the time of the invention to modify
`
`Yosuke’s imaging device, Krijn’s autostereoscopic display device, and Sawai’s projecting image display
`
`device with Hirasawa’s imaging apparatus in order to achieve a shifted pixel arrangementin a direction
`
`perpendicular to a direction in which the pixels are arranged. The subject distance has substantially no
`
`influence on the relationship of this shifted pixel arrangement. Therefore, it always is possible to obtain a
`
`high-resolution image regardless of the subject distance (Hirasawa; [0017]).
`
`26.
`
`Asto claim 5, the combination of Yosuke, Krijn, Sawai, and Hirasawa teaches wherein the first
`
`and second color images are generated by shifting, by the magnitude of parallax, third and fourth pieces
`
`of image information that have been generated by the third and fourth pixels (Hirasawa; [0008], [0062]-
`
`[0064], and [0109]-[0112]; [0110] and [0111] discuss parallax amountin the x- and y-direction as well as
`
`shifting in the x- and y- direction for the blue image and red image information, respectively).
`
`

`

`Application/Control Number: 14/009,251
`
`Art Unit: 2482
`
`Page 8
`
`27.
`
`Asto claim 6, the combination of Yosuke, Krijn, Sawai, and Hirasawa teaches wherein the first
`
`color image includes, as its components, the first piece of image information, the third piece of image
`
`information, and a piece of image information obtained by shifting the fourth piece of image information by
`
`the magnitude of parallax, and wherein the second color image includes, as its components, the second
`
`piece of image information, the fourth piece of image information, and a piece of image information
`
`obtained by shifting the third piece of image information by the magnitude of parallax (Yosuke; [0093]-
`
`[0094] — two images each comprising red, green, and blue components; Hirasawa; FIG. 8A and [01 09]-
`
`[0111] — color filters in the Bayer arrangement; [0110] discusses the parallax amount in the x- and y-
`
`direction; [0110] and [0111] discuss parallax amount in the x- and y-direction as well as shifting in the x-
`
`and y- direction for the blue image and red image information, respectively; [0111] discuses that the
`
`pieces of image information of red (R), green (G) and blue (B) colors are knownto be correlated in the
`
`local region of an image...it is known that information of the other two colors in a pixel having a filter of
`
`one color is estimated from color information of this pixel, thereby interpolating color information...since
`
`the red image information and the blue image information were shifted from the two pieces of green
`
`image information by an amount substantially corresponding to an odd multiple of one-half the pixel pitch,
`
`the above-mentioned interpolation of the color information was applicable...individual pieces of color
`
`information were superposed (synthesized) after achieving higher resolution, thereby obtaining a high-
`
`resolution color image).
`
`28.
`
`Asto claim 7, the combination of Yosuke, Krijn, Sawai, and Hirasawa teaches wherein the first
`
`and second color images are generated by shifting, by the magnitude of parallax, the first, second, third
`
`and fourth pieces of image information that have been generated bythe first, second, third and fourth
`
`pixels, respectively (Hirasawa; [0008], [0062]-[0064], and [0109]-[01 12]; [0110] and [0111] discuss
`
`parallax amountin the x- and y-direction as well as shifting in the x- and y- direction for the blue image
`
`and red image information, respectively; [0136] — “the pieces of image information of red, green and blue
`
`colors are known to be correlated in the local region of an image...it is known that information of the other
`
`

`

`Application/Control Number: 14/009,251
`
`Art Unit: 2482
`
`Page 9
`
`two colors in a pixel havingafilter of one color is estimated from color information of this pixel, thereby
`
`interpolating color information...by this known technique, pieces of color information of red, green and
`
`blue were obtained in the individual pixels...it was possible to achieve the shifted pixel arrangementfor
`
`each color of red, green and blue”; in other words, there is a teaching of shifting for the green image
`
`information).
`
`29.
`
`Asto claim 8, the combination of Yosuke, Krijn, Sawai, and Hirasawa teaches wherein the first
`
`color image includes, as its components, the first piece of image information, the third piece of image
`
`information, and a piece of image information obtained by shifting the second and fourth pieces of image
`
`information by the magnitude of parallax, and wherein the second color image includes, asits
`
`components, the second piece of image information, the fourth piece of image information, and a piece of
`
`image information obtained by shifting the first and third pieces of image information by the magnitude of
`
`parallax (Yosuke; [0093]-[0094] — two images each comprising red, green, and blue components;
`
`Hirasawa; FIG. 8A and [0109]-[0111] — color filters in the Bayer arrangement; [0110] discusses the
`
`parallax amountin the x- and y-direction; [0110] and [0111] discuss parallax amount in the x- and y-
`
`direction as well as shifting in the x- and y- direction for the blue image and red image information,
`
`respectively; [0111] discuses that the pieces of image information of red (R), green (G) and blue (B)
`
`colors are known to be correlated in the local region of an image...it is known that information of the other
`
`two colors in a pixel havingafilter of one color is estimated from color information of this pixel, thereby
`
`interpolating color information...since the red image information and the blue image information were
`
`shifted from the two pieces of green image information by an amountsubstantially corresponding to an
`
`odd multiple of one-half the pixel pitch, the above-mentioned interpolation of the color information was
`
`applicable...individual pieces of color information were superposed (synthesized) after achieving higher
`
`resolution, thereby obtaining a high-resolution color image; [0136] — “the pieces of image information of
`
`red, green and blue colors are knownto be correlated in the local region of an image...it is known that
`
`information of the other two colors in a pixel havingafilter of one color is estimated from color information
`
`of this pixel, thereby interpolating color information...by this known technique, pieces of color information
`
`

`

`Application/Control Number: 14/009,251
`
`Art Unit: 2482
`
`Page 10
`
`of red, green and blue were obtainedin the individual pixels...it was possible to achieve the shifted pixel
`
`arrangementfor each color of red, green and blue”; in other words, there is a teaching of shifting for the
`
`green image information).
`
`30.
`
`Asto claim 22, Yosuke teaches a distance measuring device comprising: the image pickup
`
`device of claim 1 (see claim 1).
`
`31.
`
`The combination of Yosuke, Krijn, and Sawai does not teach a second signal processing section
`
`which measuresthe distance to the object.
`
`32.
`
`However, Hirasawa teaches a second signal processing section which measures the distance to
`
`the object ([0047], [0051], [0054]-[0055], [0077], and [0088)).
`
`33.
`
`It would have been obvious to one of ordinary skill in the art at the time of the invention to modify
`
`Yosuke’s imaging device, Krijn’s autostereoscopic display device, and Sawai’s projecting image display
`
`device with Hirasawa’s imaging apparatus in order to achieve a shifted pixel arrangement in a direction
`
`perpendicular to a direction in which the pixels are arranged. The subject distance has substantially no
`
`influence on the relationship of this shifted pixel arrangement. Therefore, it always is possible to obtain a
`
`high-resolution image regardless of the subject distance (Hirasawa; [001 7]).
`
`34.
`
`Asto claim 23, Yosuke further teaches an image pickup system comprising the image pickup
`
`device of claim 1 and a signal processor (see claim 1 and [0030], [0037], and [0099)).
`
`35.
`
`The combination of Yosuke, Krijn, and Sawai does not teach wherein the signal processor
`
`receives first and second pieces of image information that have been generated bythe first and second
`
`pixels, respectively, extracts the magnitude of parallax between the first and second pieces of image
`
`

`

`Application/Control Number: 14/009,251
`
`Art Unit: 2482
`
`Page 11
`
`information, and generatesfirst and second color images with parallax based on the first, second, third
`
`and fourth pixels and the magnitude of parallax.
`
`36.
`
`However, Hirasawa teaches wherein the signal processor receivesfirst and second piecesof
`
`image information that have been generated bythe first and second pixels, respectively, extracts the
`
`magnitude of parallax between the first and second pieces of image information, and generatesfirst and
`
`second color images with parallax based on the first, second, third and fourth pixels and the magnitude of
`
`parallax (FIG. 8A and [0109]-[0111] — color filters in the Bayer arrangement; [0110] discusses the parallax
`
`amount in the x- and y-direction).
`
`37.
`
`It would have been obvious to one of ordinary skill in the art at the time of the invention to modify
`
`Yosuke’s imaging device, Krijn’s autostereoscopic display device, and Sawai’s projecting image display
`
`device with Hirasawa’s imaging apparatus in order to achieve a shifted pixel arrangementin a direction
`
`perpendicular to a direction in which the pixels are arranged. The subject distance has substantially no
`
`influence on the relationship of this shifted pixel arrangement. Therefore, it always is possible to obtain a
`
`high-resolution image regardless of the subject distance (Hirasawa; [0017]).
`
`38.
`
`Claims 11 and 16 are rejected under pre-AlA 35 U.S.C. 103(a) as being unpatentable over
`
`Yosukein view of Krijn and Sawai and further in view of Takeshi (JP2010-197868 Translation).
`
`39.
`
`Asto claim 11, the combination of Yosuke, Krijn, and Sawai does not teach wherein the array of
`
`optical elements is a lenticular lens. However, Takeshi teaches wherein the array of optical elements is a
`
`lenticular lens ([0002] and [0015)).
`
`40.
`
`It would have been obvious to one of ordinary skill in the art at the time of the invention to modify
`
`Yosuke’s imaging device, Krijn’s autostereoscopic display device, and Sawai’s projecting image display
`
`

`

`Application/Control Number: 14/009,251
`
`Art Unit: 2482
`
`Page 12
`
`device with Takeshi’s stereoscopic video display device in order to display 3-dimensional scenography
`
`with a reduced granular feeling (Takeshi; [0006}).
`
`41.
`
`Asto claim 16, the combination of Yosuke, Krijn, and Sawai does not teach a micro lens which is
`
`arranged between the array of optical elements and the image sensor, wherein the array of optical
`
`elements has been formed over the image sensor with the micro lens interposed.
`
`42.
`
`However, Yosuke teaches a micro lens arranged on the image sensor ([0116]-[0120] and FIG. 38
`
`— micro lenses 530-533 facing on pixels 512a, 513a, 512b, and 513b on image sensor 211 (see FIG. 6 for
`
`image sensor 211)). In addition, Takeshi teachesa diffusion board/optical element formed over the image
`
`sensor with a lens elementinterposed (FIG. 2 — diffusion board 40 and beam-of-light controller 30, which
`
`can be a lenticular lens or a microlens array; [0015]-[0016)).
`
`43.
`
`Therefore, it would have been obvious to one of ordinary skill in the art at the time of the invention
`
`to modify Yosuke’s imaging device, Krijn’s autostereoscopic display device, and Sawai’s projecting image
`
`display device with Takeshi’s stereoscopic video display device to show a micro lens whichis arranged
`
`between the array of optical elements and the image sensor, wherein the array of optical elements has
`
`been formed over the image sensor with the micro lens interposed in order to display 3-dimensional
`
`scenography with a reduced granular feeling (Takeshi; [O006]). In addition, the diffusion board diffuses
`
`and passes the beam oflight which entered and is arranged so that the range of the projection part and
`
`the admiration field angle of are dependent on optical properties and arrangement, and the optical
`
`properties of the beam-of-light controller and arrangement. It is also decided whichever one of them may
`
`be covered. Furthermore, the diffusion board is arranged in the position physically away from the beam-
`
`of-light controller. Thereby, the admiration person can admire the homogeneousstereoscopic model
`
`without a granular feeling (Takeshi; [0016)).
`
`

`

`Application/Control Number: 14/009,251
`
`Art Unit: 2482
`
`Page 13
`
`44.
`
`Claims 17 and 18 are rejected under pre-AlA 35 U.S.C. 103(a) as being unpatentable over
`
`Yosukein view of Krijn and Sawai and further in view of Ookawa (JP08-068962 Translation).
`
`
`
`45. Asto claim 17, the combination of Yosuke, Krijn, and Sawai does not teachaliquid crystal
`
`shutter array which changes the positions of the first and second pupil regions. However, Ookawa
`
`teachesa liquid crystal shutter array which changesthe positions of the first and second pupil regions
`
`({0017]-[0020)).
`
`46.
`
`It would have been obvious to one of ordinary skill in the art at the time of the invention to modify
`
`Yosuke’s imaging device, Krijn’s autostereoscopic display device, and Sawai’s projecting image display
`
`device with Ookawa’s device for reproducing stereoscopic video in order to observe 3-dimensional
`
`scenography easily without using glasses, such as a polarization eyeglass (Ookawa; [0030)).
`
`47.
`
`Asto claim 18, the combination of Yosuke, Krijn, Sawai, and Cokawa teaches wherein each of
`
`liquid crystal shutters in the liquid crystal shutter array has a variable transmittance (Ookawa; [001 7]-
`
`[0020]).
`
`48.
`
`Claim 19 is rejected under pre-AlA 35 U.S.C. 103(a) as being unpatentable over Yosukein view
`
`of Krijn and Sawai and further in view of Nobuo (JP07-208980 Translation).
`
`49.
`
`Asto claim 19, the combination of Yosuke, Krijn, and Sawai does not teach wherein the lens
`
`optical system further includes reflective members 1A and 1B which makelight incident on the first pupil
`
`region andreflective members 2A and 2B which makelight incident on the second pupil region. However,
`
`Nobuo teaches wherein the lens optical system further includes reflective members 1A and 1B which
`
`makelight incident on the first pupil region and reflective members 2A and 2B which makelight incident
`
`on the second pupil region ([0007]-[0008] and [0015]-[001 7]; FIGs. 1, 6, and 8).
`
`

`

`Application/Control Number: 14/009,251
`
`Art Unit: 2482
`
`Page 14
`
`50.
`
`It would have been obvious to one of ordinary skill in the art at the time of the invention to modify
`
`Yosuke’s imaging device, Krijn’s autostereoscopic display device, and Sawai’s projecting image display
`
`device with Nobuo’s distance measuring apparatus in order to obtain highly precise ranging accuracy
`
`(Nobuo; [0026] and [0028)).
`
`51.
`
`Claims 20 and 21 are rejected under pre-AlA 35 U.S.C. 103(a) as being unpatentable over
`
`Yosukein view of Krijn and Sawai and further in view of Kazumichi (JP2007-065593 Translation).
`
`52.
`
`Asto claim 20, the combination of Yosuke, Krijn, and Sawai does not teach a relay optical
`
`system. However, Kazumichi teaches a relay optical system ([0027]).
`
`53.
`
`It would have been obvious to one of ordinary skill in the art at the time of the invention to modify
`
`Yosuke’s imaging device, Krijn’s autostereoscopic display device, and Sawai’s projecting image display
`
`device with Kazumichi’s autofocus system in order to provide an autofocus system capable of using an
`
`AF imager, having imaging surfaces whoseoptical path lengths are appropriately different from each
`
`other for AF, having no relation to a recording/reproducing image (Kazumichi; abstract).
`
`54,
`
`Asto claim 21, the combination of Yosuke, Krijn, and Sawai does not teach a stop, wherein the
`
`stop makeslight that has come from the object incident on the first and second pupil regions. However,
`
`Kazumichi teaches a stop, wherein the stop makesl