UNITED STATES PATENT AND TRADEMARK OFFICE
`
`
`
`UNITED STATES DEPARTMENT OF COMMERCE
`United States Patent and Trademark Office
`Address: COMMISSIONER FOR PATENTS
`PO. Box 1450
`Alexandria, Virginia 2231371450
`www.uspto.gov
`
`15/888,002
`
`02/03/2018
`
`Masayuki AIHARA
`
`NIIPP0207US
`
`2481
`
`MARK D. SARALINO (PAN)
`RENNER, OTTO, BOISSELLE & SKLAR, LLP
`1621 EUCLID AVENUE
`19TH FLOOR
`CLEVELAND, OH 441 15
`
`NIRJHAK NASIM NAZRUL
`
`ART UNIT
`2482
`
`PAPER NUMBER
`
`NOTIFICATION DATE
`
`DELIVERY MODE
`
`06/25/2019
`
`ELECTRONIC
`
`Please find below and/or attached an Office communication concerning this application or proceeding.
`
`The time period for reply, if any, is set in the attached communication.
`
`Notice of the Office communication was sent electronically on above—indicated "Notification Date" to the
`
`following e—mail address(es):
`
`ipdoeket@rennerotto.eom
`
`PTOL-90A (Rev. 04/07)
`
`

`

`0/7709 A0170” Summary
`
`Application No.
`15/888,002
`Examiner
`NASIM N NIRJHAR
`
`Applicant(s)
`AIHARA et al.
`Art Unit
`2482
`
`AIA (FITF) Status
`Yes
`
`- The MAILING DA TE of this communication appears on the cover sheet wit/7 the correspondence address -
`Period for Reply
`
`A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE g MONTHS FROM THE MAILING
`DATE OF THIS COMMUNICATION.
`Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed after SIX (6) MONTHS from the mailing
`date of this communication.
`|f NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication.
`-
`- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133).
`Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any earned patent term
`adjustment. See 37 CFR 1.704(b).
`
`Status
`
`1). Responsive to communication(s) filed on 4/30/19.
`[:1 A declaration(s)/affidavit(s) under 37 CFR 1.130(b) was/were filed on
`
`2a). This action is FINAL.
`
`2b) C] This action is non-final.
`
`3)[:] An election was made by the applicant in response to a restriction requirement set forth during the interview on
`; the restriction requirement and election have been incorporated into this action.
`
`4)[:] Since this application is in condition for allowance except for formal matters, prosecution as to the merits is
`closed in accordance with the practice under Expat/7e Quay/e, 1935 CD. 11, 453 O.G. 213.
`
`Disposition of Claims*
`5)
`Claim(s)
`
`1—15 is/are pending in the application.
`
`5a) Of the above claim(s)
`
`is/are withdrawn from consideration.
`
`E] Claim(s)
`
`is/are allowed.
`
`Claim(s) fl is/are rejected.
`
`[:1 Claim(s) _ is/are objected to.
`
`) ) ) )
`
`6 7
`
`8
`
`
`
`are subject to restriction and/or election requirement
`[j Claim(s)
`9
`* If any claims have been determined aflowabie. you may be eligible to benefit from the Patent Prosecution Highway program at a
`
`participating intellectual property office for the corresponding application. For more information, please see
`
`http://www.uspto.gov/patents/init events/pph/index.jsp or send an inquiry to PPeredback@uspto.gov.
`
`Application Papers
`10)[:] The specification is objected to by the Examiner.
`
`11). The drawing(s) filed on 2/3/18 is/are: a). accepted or b)[:] objected to by the Examiner.
`
`Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a).
`Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121 (d).
`
`Priority under 35 U.S.C. § 119
`12). Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f).
`Certified copies:
`
`a). All
`
`b)D Some**
`
`C)D None of the:
`
`1.. Certified copies of the priority documents have been received.
`
`2.[:] Certified copies of the priority documents have been received in Application No.
`
`3:] Copies of the certified copies of the priority documents have been received in this National Stage
`application from the International Bureau (PCT Rule 17.2(a)).
`
`** See the attached detailed Office action for a list of the certified copies not received.
`
`Attachment(s)
`
`1) C] Notice of References Cited (PTO-892)
`
`2) D Information Disclosure Statement(s) (PTO/SB/08a and/or PTO/SB/08b)
`Paper No(s)/Mail Date_
`U.S. Patent and Trademark Office
`
`3) C] Interview Summary (PTO-413)
`Paper No(s)/Mail Date
`4) CI Other-
`
`PTOL-326 (Rev. 11-13)
`
`Office Action Summary
`
`Part of Paper No./Mai| Date 20190523
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 2
`
`DETAILED ACTION
`
`Notice of Pre-AIA or AIA Status
`
`1.
`
`The present application, filed on or after March 16, 2013, is being examined
`
`under the first inventor to file provisions of the AIA.
`
`2.
`
`3.
`
`This communication is responsive to the correspondence filled on 4/30/19.
`
`Claims 1-15 are presented for examination.
`
`IDS Considerations
`
`The information disclosure statement (IDS) submitted on 8/3/18 and 2/3/18 are
`
`being considered by the examiner as the submission is in compliance with the
`
`provisions of 37 CFR 1.97.
`
`Claim Objections
`
`Claim 14 objected to because of typographical error in the following limitation: “a
`
`first lens that has a shape that causes the image of the fi_st predetermined
`
`region”. Appropriate correction is required.
`
`Response to Arguments
`
`Applicant's arguments filed 4/30/19with respect to claims 1-15 have been
`
`considered but are moot in view of the new ground(s) of rejection. In addition,
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 3
`
`applicant's arguments filed 4/30/19 with respect to claims 1-14 has been considered but
`
`are not persuasive.
`
`Applicant argued in page 12-13 that prior art do not teach claim 1 because,
`
`the combining of the image is carried out by not adopting a portion with low resolution
`
`and instead adopting a portion with high resolution. Examiner disagree on this because
`
`claim language do not have specificity of how much overlapping region associated with
`
`specific resolution. Following example of overlapping the double region will Patrice will
`
`construe the system claimed in independent claims.
`
`
`
`Claim Rejections - 35 USC § 103
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 4
`
`The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness
`
`rejections set forth in this Office action:
`
`A patent for a claimed invention may not be obtained, notwithstanding that the claimed
`invention is not identically disclosed as set forth in section 102, if the differences between the
`claimed invention and the prior art are such that the claimed invention as a whole would have
`been obvious before the effective filing date of the claimed invention to a person having
`ordinary skill in the art to which the claimed invention pertains. Patentability shall not be
`negated by the manner in which the invention was made.
`
`6.
`
`Claims 1-14 are rejected under 35 U.S.C. 103 as being unpatentable over
`
`Patrice (Multi-task single lens for automotive vision applications - Proc. SPIE 7314,
`
`Photonics in the Transportation Industry: Auto to Aerospace ll, 731409 (29 April 2009),
`
`in view of Matono (U.S. Pub. No. 20180150949 A1), further in view of Kostrzewski (U.S.
`
`Pub. No. 20110221767 A1).
`
`Regarding to claim 1 and 14:
`
`14. Patrice teach a mobile system comprising: a generator that generates an
`
`image based on image data acquired from the first imaging element and the
`
`second Imaging element, (Patrice page 13 para 3 there are no limitations in terms of
`
`projection ability, although the scope for real applications requires imagination and,
`
`ultimately, driver understanding. For example, one could mount four (4) panomorph
`
`lenses all around the vehicle to provide a complete view for parking assistance (Figure
`
`13) with the added benefits of panomorph technology’s augmented resolution)
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 5
`
`such that a resolution is different between an overlapping portion (Patrice page 6
`
`Fig. 3 — overlapping camera region) of the first predetermined region that overlaps
`
`the second region and another portion of the first predetermined region, (Patrice
`
`page 13 para 1 Figures 12 and 13 show ways to avoid a blind zone. The driver can see
`
`everything in the blind zone using his/her onboard display. The panomorph lens design
`
`suggested in this paper increases the resolution of objects along the border and right in
`
`the middle)
`
`and in the first predetermined region, a resolution of the overlapping portion of
`
`the first predetermined region that overlaps the second region (Patrice page 6 Fig.
`
`3 - overlapping camera region) is higher than a resolution of the other portion of the
`
`first predetermined region, (Patrice page 7 Fig. 6b This combination of distortion
`
`control and anamorphic design provides an important gain in resolution pixel/degree in
`
`the zones of interest, and an advantage over all other types of panoramic imagers)
`
`such that, in the second region, a resolution of the overlapping portion of the
`
`second region that overlaps with the first predetermined region is lower than
`
`another portion of the second region, and (Patrice page 10 Fig. 9 With a panomorph
`
`lens, we can customize the distortion mapping to provide better resolution where
`
`required. Based on Figure 9 (used only for indicative purposes), we define three zones
`
`of interest in the horizontal plane. The first area of interest in which we would like to
`
`increase resolution is the forward view. The second and third areas are to the right of
`
`the left-corner views (see Figure 7 for suggested distortion curve). ++ are high
`
`resolution area and — is low resolution area) the generator generates a combined
`
`image (Patrice page 13 para 3 there are no limitations in terms of projection ability,
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 6
`
`although the scope for real applications requires imagination and, ultimately, driver
`
`understanding. For example, one could mount four (4) panomorph lenses all around the
`
`vehicle to provide a complete view for parking assistance (Figure 13) with the added
`
`benefits of panomorph technology’s
`
`augmented resolution) based on image data of a portion having a high resolution
`
`out of the overlapping portion (Patrice page 6 Fig. 3 — overlapping camera region)
`
`between the first predetermined region and the second region, (Patrice page 10
`
`Fig. 9 With a panomorph lens, we can customize the distortion mapping to provide
`
`better resolution where required. Based on Figure 9 (used only for indicative purposes),
`
`we define three zones of interest in the horizontal plane. The first area of interest in
`
`which we would like to increase resolution is the forward view. The second and third
`
`areas are to the right of the left-corner views (see Figure 7 for suggested distortion
`
`curve). ++ are high resolution area and — is low resolution area)
`
`and image data of a portion having a high resolution out of a non-overlapping
`
`portion between the second region and the first predetermined region. (Patrice
`
`page 10 Fig. 9 with a panomorph lens, we can customize the distortion mapping to
`
`provide better resolution where required. Based on Figure 9 (used only for indicative
`
`purposes), we define three zones of interest in the horizontal plane. The first area of
`
`interest in which we would like to increase resolution is the forward view. The second
`
`and third areas are to the right of the left-corner views (see Figure 7 for suggested
`
`distortion curve). ++ are high resolution area straight ahead of the vehicle is non
`
`overlapping region as per Fig. 3 and Fig. 7)
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 7
`
`Patrice do not explicitly teach a first imaging apparatus including a first imaging
`
`element in which a plurality of imaging pixels are arranged in a matrix, and a first
`
`optical system that forms an image of a first predetermined region on an imaging
`
`surface of the first imaging element; a second imaging apparatus including a
`
`second imaging element, and a second optical system that forms an image of a
`
`second region on an imaging surface of the second imaging element, the second
`
`region partially overlapping the first predetermined region; and a mobile body to
`
`which the imaging apparatus is attached and that moves in a space; a display
`
`apparatus that displays the image generated by the generator, wherein the first
`
`optical system includes a first lens that has a shape that causes the image of the
`
`first predetermined region to be formed on the imaging surface of the first
`
`imaging element the second optical system includes a second lens that has a
`
`shape that causes an image of the second region on the second imaging element.
`
`However Matono teach a first imaging apparatus including a first imaging element
`
`in which a plurality of imaging pixels are arranged in a matrix, (Matono FIG. 2A -
`
`2B, [0034]) and a first optical system (Matono Fig. 1 [0029] The image-capturing
`
`device 1 includes first and second image-capturing units 100a and 100b) that forms an
`
`image of a first predetermined region on an imaging surface of the first imaging
`
`element; (Matono [0035] FIG. 3 is a diagram schematically illustrating a range in which
`
`an image to be captured by an on-vehicle stereo camera of the present embodiment)
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 8
`
`a second imaging apparatus including a second imaging element, (Matono [0029]
`
`the image-capturing device 1 includes first and second image-capturing units 100a and
`
`100b)
`
`a display apparatus that displays the image (Matono FIG. 10 [0089]) generated by
`
`the generator, (Matono FIG. 3 [0044] resolution of the central area (area for which an
`
`incidence angle to the optical axis is small) of the image-capturing lens is set to be high.
`
`It is intended to recognize a target at a short distance (for example, approximately 20 m)
`
`from the vehicle 301 in the peripheral area of the image-capturing lens (area in which an
`
`incidence angle to the optical axis is large) and thus, resolution of the peripheral area of
`
`the image-capturing lens is set to be high)
`
`wherein the first optical system includes a first lens (Matono [0033] the first image-
`
`capturing unit 100a includes an optical element 101 a and an image-capturing element
`
`102a. The optical element 101a is an image-capturing lens having a structure for
`
`refracting light and forming an image on the image-capturing element) that has a
`
`shape (Matono Fig. 5. [0044] an area corresponding to the inflection point 403
`
`corresponds to the blurred area in the image of FIG. 6. Respective areas depicted in a
`
`fan shape in FIG. 3 are areas in which recognition as well as detection of an object can
`
`be made by the image processing device and an area (for example, a portion indicated
`
`by 302) located outside the recognizable area having the fan shape is an area in which
`
`detection of the object is possible but recognition of the object becomes difficult
`
`because a captured image becomes small) that causes the image of the first
`
`predetermined region to be formed on the imaging surface of the first imaging
`
`element (Matono [0032] That is, even when the pair of left and right images is images
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 9
`
`obtained by capturing the same target, the positions on the images deviate in left and
`
`right)
`
`the second optical system includes a second lens (Matono [0033] the first image-
`
`capturing unit 100a includes an optical element 101 a and an image-capturing element
`
`102a. The optical element 101a is an image-capturing lens having a structure for
`
`refracting light and forming an image on the image-capturing element) that has a
`
`shape (Matono Fig. 5. [0044] an area corresponding to the inflection point 403
`
`corresponds to the blurred area in the image of FIG. 6. Respective areas depicted in a
`
`fan shape in FIG. 3 are areas in which recognition as well as detection of an object can
`
`be made by the image processing device and an area (for example, a portion indicated
`
`by 302) located outside the recognizable area having the fan shape is an area in which
`
`detection of the object is possible but recognition of the object becomes difficult
`
`because a captured image becomes small) that causes an image of the second
`
`region on the second imaging element (Matono [0032] That is, even when the pair of
`
`left and right images is images obtained by capturing the same target, the positions on
`
`the images deviate in left and right. Second system is for pair of left and right images,
`
`because Matono Fig. 1 [0029] The image-capturing device 1 includes first and second
`
`image-capturing units 100a and 100b)
`
`It would have been obvious before the effective filing date of the claimed
`
`invention to a person having ordinary skill in the art to modify Patrice, further
`
`incorporating Matono in camera technology. One would be motivated to do so, to
`
`incorporate the first optical system includes a first lens that has a shape that causes the
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 10
`
`image of the first predetermined region to be formed on the imaging surface of the first
`
`imaging element the second optical system includes a second lens that has a shape
`
`that causes an image of the second region on the second imaging element. This
`
`functionality will provide better quality of image.
`
`The combination of Patrice and Kostrzewski do not explicitly teach a second optical
`
`system that forms an image of a second region on an imaging surface of the
`
`second imaging element, the second region partially overlapping the first
`
`predetermined region; and a mobile body to which the imaging apparatus is
`
`attached and that moves in a space;
`
`However Kostrzewski teach a second optical system that forms an image of a
`
`second region on an imaging surface of the second imaging element, the second
`
`region partially overlapping the first predetermined region; and (Kostrzewski
`
`[0042] FIG. 7 illustrates a two facet catoptric mirror and its resulting image geometry.
`
`Facets 251 and 252 are separated by a concave seam 250. Accordingly, each of the
`
`facets has a higher than 180.degree. FOV, resulting in regions of overlap 255 and 256
`
`in the images 254 and 233 on the sensor plane)
`
`a mobile body to which the imaging apparatus is attached and that moves in a
`
`space; (Kostrzewski [0051] this may be implemented when the imaging system is
`
`installed on a moving platform, such as an avionic platform like a UAV (Unmanned
`
`Aerial Vehicle))
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 11
`
`It would have been obvious before the effective filing date of the claimed
`
`invention to a person having ordinary skill in the art to modify Patrice, further
`
`incorporating Matono and Kostrzewski in camera technology. One would be motivated
`
`to do so, to incorporate a mobile body to which the imaging apparatus is attached and
`
`that moves in a space. This functionality will provide low cost solution for image to be
`
`taken from drone.
`
`2. (Cancelled)
`
`Regarding to claim 3:
`
`3. Patrice teach the imaging system according to claim 1, wherein in the first lens
`
`included in the first optical system, the resolution gradually increases from one
`
`end portion toward the other end portion of the first predetermined region.
`
`(Patrice page 8 para 2 Figure 7 shows the same image taken by a panomorph lens with
`
`increased resolution in the center and along the border)
`
`Regarding to claim 4:
`
`4. Patrice teach the imaging system according to claim 1, wherein the first lens
`
`included in the first optical system has a shape that allows the image of the first
`
`predetermined region to be formed on the imaging surface of the first imaging
`
`element such that the total number of the imaging pixels that capture the image
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 12
`
`of the first predetermined region is higher as compared with a case where an
`
`entire image captured by a fish-eye lens is formed. (Patrice Fig. 6a, 6b, page 7,
`
`Figure 6a and 6b: Images taken with a fisheye lens (6a, left) and with a panomorph lens
`
`(6b, right) boxes represent equivalent areas. Panomorph lens has higher resolution than
`
`fish eye lens)
`
`Regarding to claim 5:
`
`5. Patrice teach the imaging system according to claim 1, such that the resolution
`
`is different between an overlapping portion (Patrice page 6 Fig. 3 — overlapping
`
`camera region) of the first predetermined region that overlaps the second
`
`region and another portion of the first predetermined region, and (Patrice page 13
`
`para 1 Figures 12 and 13 show ways to avoid a blind zone. The driver can see
`
`everything in the blind zone using his/her onboard display. The panomorph lens design
`
`suggested in this paper increases the resolution of objects along the border and right in
`
`the middle)
`
`the generator generates a combined image based on image data acquired from
`
`the first imaging element and the second imaging element. (Patrice page 13 para 2
`
`one could mount four (4) panomorph lenses all around the vehicle to provide a complete
`
`view for parking assistance (Figure 13) with the added benefits of panomorph
`
`technology’s augmented [combined image] resolution)
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 13
`
`Patrice do not explicitly teach wherein the first lens has a shape that causes the
`
`image of the first predetermined region to be formed on the imaging surface of
`
`the first imaging element; wherein the first lens has a shape that causes the
`
`image of the first predetermined region to be formed on the imaging surface of
`
`the first imaging element.
`
`However Matono teach wherein the first lens (Matono [0033] The first image-capturing
`
`unit 100a includes an optical element 101 a and an image-capturing element 102a. The
`
`optical element 101a is an image-capturing lens having a structure for refracting light
`
`and forming an image on the image-capturing element) has a shape (Matono Fig. 5.
`
`[0044] an area corresponding to the inflection point 403 corresponds to the blurred area
`
`in the image of FIG. 6. Respective areas depicted in a fan shape in FIG. 3 are areas in
`
`which recognition as well as detection of an object can be made by the image
`
`processing device and an area (for example, a portion indicated by 302) located outside
`
`the recognizable area having the fan shape is an area in which detection of the object is
`
`possible but recognition of the object becomes difficult because a captured image
`
`becomes small) that causes the image of the first predetermined region to be
`
`formed on the imaging surface of the first imaging element (Matono [0032] That is,
`
`even when the pair of left and right images is images obtained by capturing the same
`
`target, the positions on the images deviate in left and right)
`
`wherein the first lens (Matono [0033] the first image-capturing unit 100a includes an
`
`optical element 101a and an image-capturing element 102a. The optical element 101a
`
`is an image-capturing lens having a structure for refracting light and forming an image
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 14
`
`on the image-capturing element) has a shape (Matono Fig. 5. [0044] an area
`
`corresponding to the inflection point 403 corresponds to the blurred area in the image of
`
`FIG. 6. Respective areas depicted in a fan shape in FIG. 3 are areas in which
`
`recognition as well as detection of an object can be made by the image processing
`
`device and an area (for example, a portion indicated by 302) located outside the
`
`recognizable area having the fan shape is an area in which detection of the object is
`
`possible but recognition of the object becomes difficult because a captured image
`
`becomes small) that causes the image of the first predetermined region to be
`
`formed on the imaging surface of the first imaging element (Matono [0032] That is,
`
`even when the pair of left and right images is images obtained by capturing the same
`
`target, the positions on the images deviate in left and right)
`
`Regarding to claim 6:
`
`6. Patrice teach the imaging system according to claim 5, further comprising:
`
`Claim 6 is rejected for the same reasons as claim 5 above. Patrice also teach a third
`
`imaging apparatus including a third imaging element and a third optical system
`
`that forms an image of a third region on an imaging surface of the third
`
`imaging element, the third region partially overlapping the second region and
`
`being different from the first predetermined region. (Patrice Table 1 and Figure 1,
`
`side view camera. Second and third camera will use algorithm described in claim 5 for
`
`first and second camera)
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Regarding to claim 7:
`
`Page 15
`
`7. Patrice teach the imaging system according to claim 6, further comprising:
`
`Claim 7 is rejected for the same reasons as claim 5 and 6 above. Patrice also teach a
`
`fourth imaging apparatus including a fourth imaging element and a fourth optical
`
`system that forms an image of a fourth region on an imaging surface of the fourth
`
`imaging element. (Patrice Table 1 and Figure 1, side view camera from the second
`
`side of vehicle. First and fourth camera will use algorithm described in claim 5 for first
`
`and second camera)
`
`Regarding to claim 8:
`
`8. Patrice teach the imaging system according to claim 1, wherein when a planar
`
`region (Patrice Fig. 4 and page 14 Figure 13 road) is provided in parallel or
`
`substantially parallel to an optical axis within the first predetermined region,
`
`(Patrice page 14 Figure 13: View of area surrounding vehicle using four (4) panomorph
`
`lenses. Camera view is parallel to road)
`
`the first optical system that includes the lens has a higher resolution in a portion
`
`far from the optical axis than in a portion close to the optical axis in a direction
`
`extending along the planar region, and (Patrice page 8 Figure 7 shows the same
`
`image taken by a panomorph lens with increased resolution in the center and along the
`
`border)
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 16
`
`relative to an image of a low-resolution portion based on the image data acquired
`
`from the first imaging element. (Patrice page 6 Fig. 3 — overlapping camera region.
`
`Patrice page 10 Fig. 9 with a panomorph lens, we can customize the distortion mapping
`
`to provide better resolution where required. Based on Figure 9 (used only for indicative
`
`purposes), we define three zones of interest in the horizontal plane. The first area of
`
`interest in which we would like to increase resolution is the forward view. The second
`
`and third areas are to the right of the left-corner views (see Figure 7 for suggested
`
`distortion curve). ++ are high resolution area and — is low resolution area)
`
`Patrice do not explicitly teach the generator generates an image in which a shape of
`
`the planar region is reproduced by enlarging an image of a high-resolution
`
`portion.
`
`However Matono teach the generator generates an image in which a shape of the
`
`planar region (Matono [0078] FIG. 12 1201) is reproduced by enlarging an image of
`
`a high-resolution portion. (Matono [0078] FIG. 12 is a diagram for explaining a
`
`preferred example of the first cut-out image and the second cut-out image. A reference
`
`numeral 1201 indicates an enlarged view of pixels of an area (area surrounded by a
`
`circle) inside of the third area 203 in the reference image 1001. A reference numeral
`
`1202 indicates an enlarged view of pixels of an area (area surrounded by a circle) inside
`
`of the third area 203 in the standard image 1002)
`
`Regarding to claim 9 - 10:
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 17
`
`9. Patrice teach the imaging system according to claim 1, wherein when a planar
`
`region (Patrice Fig. 10, Fig. 4 and page 14 Figure 13 road. Interpretation is based
`
`applicant specification PGPUB [0067]) is provided in parallel or substantially parallel
`
`to an optical axis within the first predetermined region, (Patrice page 14 Figure 13:
`
`View of area surrounding vehicle using four (4) panomorph lenses. Camera view is
`
`parallel to road)
`
`the lens included in the first optical system has a higher resolution in a portion
`
`far from the first optical system in the planar region (Patrice Fig. 4 and page 14
`
`Figure 13 center of the lens compared to left and right side of the road is far with high
`
`resolution as shown in Fig. 9 shows front planar region higher resolution ++. Figure 10:
`
`Lane departure custom projection rendering is multiple planar region) than in a portion
`
`close to the first optical system in the planar region, and (Patrice page 13 Figure 12
`
`shows high resolution image of two sides which are far from optical system)
`
`relative to an image of a low-resolution portion based on the image data acquired
`
`from the first imaging element. (Patrice page 6 Fig. 3 — overlapping camera region.
`
`(Patrice page 10 Fig. 9 With a panomorph lens, we can customize the distortion
`
`mapping to provide better resolution where required. Based on Figure 9 (used only for
`
`indicative purposes), we define three zones of interest in the horizontal plane. The first
`
`area of interest in which we would like to increase resolution is the forward view. The
`
`second and third areas are to the right of the left-corner views (see Figure 7 for
`
`suggested distortion curve). ++ are high resolution area and — is low resolution area)
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 18
`
`Patrice do not explicitly teach the generator generates an image in which a shape of
`
`the planar region is reproduced by enlarging an image of a high-resolution
`
`portion.
`
`However Matono teach the generator generates an image in which a shape of the
`
`planar region is reproduced by enlarging an image of a high-resolution portion
`
`(Matono [0078] FIG. 12 is a diagram for explaining a preferred example of the first cut-
`
`out image and the second cut-out image. A reference numeral 1201 indicates an
`
`enlarged view of pixels of an area (area surrounded by a circle) inside of the third area
`
`203 in the reference image 1001. A reference numeral 1202 indicates an enlarged view
`
`of pixels of an area (area surrounded by a circle) inside of the third area 203 in the
`
`standard image 1002)
`
`Regarding to claim 11:
`
`11. Patrice teach the imaging system according to claim 1, including: a fifth
`
`imaging apparatus including a fifth imaging element and a fifth optical system
`
`that forms an image of a fifth region on an imaging surface of the fifth
`
`imaging element, the fifth region including a first planar region; and (Patrice Table
`
`1 and Figure 1, side view camera [Fifth camera] and rear view camera from the second
`
`side of vehicle. Fifth camera will use same algorithm described in claim 9)
`
`a sixth imaging apparatus including a sixth imaging element and a sixth optical
`
`system that forms an image of a sixth region on an imaging surface of the sixth
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 19
`
`imaging element, (Patrice Table 1 and Figure 1, side view camera and rear view
`
`camera [sixth camera] from the second side of vehicle. Sixth camera will use same
`
`algorithm described in claim 9)
`
`the sixth region including a second planar region that makes contact with the first
`
`planar region within a same plane with the first planar region, (Patrice page 13 Fig.
`
`13 shows second planar region that makes contact with the first planar from Fig. 12)
`
`such that the resolution is higher in a portion close to the second planar region
`
`(Patrice Fig. 4 and page 14 Figure 13 center of the lens compared to left and right side
`
`of the road is far with high resolution as shown in Fig. 9 shows front planar region higher
`
`resolution ++. Figure 10: Lane departure custom projection rendering is multiple planar
`
`region) than in a portion close to an optical axis of the fifth optical system in
`
`a direction extending along the first planar region, (Patrice page 13 Figure 12
`
`shows high resolution image of two sides which are far from optical system)
`
`such that the resolution is higher in a portion close to the first planar region
`
`(Patrice Fig. 4 and page 14 Figure 13 center of the lens compared to left and right side
`
`of the road is far with high resolution as shown in Fig. 9 shows front planar region higher
`
`resolution ++. Figure 10: Lane departure custom projection rendering is multiple planar
`
`region) than in a portion close to an optical axis of the sixth optical system in
`
`a direction extending along the second planar region, and (Patrice page 13 Figure
`
`12 shows high resolution image of two s