UNITED STATES PATENT AND TRADEMARK OFFICE
`
`
`
`UNITED STATES DEPARTMENT OF COMMERCE
`United States Patent and Trademark Office
`Address: COMMISSIONER FOR PATENTS
`PO. Box 1450
`Alexandria, Virginia 2231371450
`www.uspto.gov
`
`15/888,002
`
`02/03/2018
`
`Masayuki AIHARA
`
`NIIPP0207US
`
`2481
`
`MARK D. SARALINO (PAN)
`RENNER, OTTO, BOISSELLE & SKLAR, LLP
`1621 EUCLID AVENUE
`19TH FLOOR
`CLEVELAND, OH 441 15
`
`NIRJHAK NASIM NAZRUL
`
`ART UNIT
`2482
`
`PAPER NUMBER
`
`NOTIFICATION DATE
`
`DELIVERY MODE
`
`01/31/2019
`
`ELECTRONIC
`
`Please find below and/or attached an Office communication concerning this application or proceeding.
`
`The time period for reply, if any, is set in the attached communication.
`
`Notice of the Office communication was sent electronically on above—indicated "Notification Date" to the
`
`following e—mail address(es):
`
`ipdoeket@rennerotto.eom
`
`PTOL-90A (Rev. 04/07)
`
`

`

`Off/09 A0170” Summary
`
`Application No.
`15/888,002
`Examiner
`NASIM N NIRJHAR
`
`Applicant(s)
`AIHARA et al.
`Art Unit
`2482
`
`AIA Status
`Yes
`
`- The MAILING DA TE of this communication appears on the cover sheet wit/7 the correspondence address -
`Period for Reply
`
`A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE g MONTHS FROM THE MAILING
`DATE OF THIS COMMUNICATION.
`Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed after SIX (6) MONTHS from the mailing
`date of this communication.
`|f NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication.
`-
`- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133).
`Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any earned patent term
`adjustment. See 37 CFR 1.704(b).
`
`Status
`
`1). Responsive to communication(s) filed on 2/3/18.
`[:1 A declaration(s)/affidavit(s) under 37 CFR 1.130(b) was/were filed on
`
`2a)D This action is FINAL.
`
`2b)
`
`This action is non-final.
`
`3)[:] An election was made by the applicant in response to a restriction requirement set forth during the interview on
`; the restriction requirement and election have been incorporated into this action.
`
`4)[:] Since this application is in condition for allowance except for formal matters, prosecution as to the merits is
`closed in accordance with the practice under Expat/7e Quay/e, 1935 CD. 11, 453 O.G. 213.
`
`Disposition of Claims*
`5)
`Claim(s)
`
`1—14is/are pending in the application.
`
`5a) Of the above claim(s)
`
`is/are withdrawn from consideration.
`
`E] Claim(s)
`
`is/are allowed.
`
`Claim(s) 1—7 and 14 is/are rejected.
`
`Claim(s) fl is/are objected to.
`
`) ) ) )
`
`6 7
`
`8
`
`
`
`are subject to restriction and/or election requirement
`[:1 Claim(s)
`9
`* If any claims have been determined allowable, you may be eligible to benefit from the Patent Prosecution Highway program at a
`
`participating intellectual property office for the corresponding application. For more information, please see
`
`http://www.uspto.gov/patents/init events/pph/index.'sp or send an inquiry to PPeredback@uspto.gov.
`
`Application Papers
`10):] The specification is objected to by the Examiner.
`
`11). The drawing(s) filed on 2/3/18 is/are: a). accepted or b)C] objected to by the Examiner.
`
`Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a).
`Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121 (d).
`
`Priority under 35 U.S.C. § 119
`12). Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f).
`Certified copies:
`
`a). All
`
`b)|:] Some”
`
`c)C] None of the:
`
`1.. Certified copies of the priority documents have been received.
`
`2.|:] Certified copies of the priority documents have been received in Application No.
`
`3D Copies of the certified copies of the priority documents have been received in this National Stage
`application from the International Bureau (PCT Rule 17.2(a)).
`
`** See the attached detailed Office action for a list of the certified copies not received.
`
`Attachment(s)
`
`1)
`
`Notice of References Cited (PTO-892)
`
`Information Disclosure Statement(s) (PTO/SB/08a and/or PTO/SB/08b)
`2)
`Paper No(s)/Mail DateW.
`U.S. Patent and Trademark Office
`
`3) C] Interview Summary (PTO-413)
`Paper No(s)/Mail Date
`4) CI Other-
`
`PTOL-326 (Rev. 11-13)
`
`Office Action Summary
`
`Part of Paper No./Mai| Date 20190102
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 2
`
`DETAILED ACTION
`
`Notice of Pre-AIA or AIA Status
`
`1.
`
`The present application, filed on or after March 16, 2013,
`
`is being examined
`
`under the first inventor to file provisions of the AIA.
`
`2.
`
`3.
`
`This communication is responsive to the correspondence filled on 2/3/18.
`
`Claims 1-14 are presented for examination.
`
`IDS Considerations
`
`The information disclosure statement (IDS) submitted on 8/3/18 and 2/3/18 are
`
`being considered by the examiner as the submission is in compliance with the
`
`provisions of 37 CFR 1.97.
`
`Claim Objections
`
`Claim 2 objected to because of missing essential elements: position and relation
`
`between first axis and second axis are unclear. Appropriate correction is required.
`
`Claim Rejections - 35 USC § 103
`
`The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness
`
`rejections set forth in this Office action:
`
`A patent for a claimed invention maynotbe obtained, notwithstanding that the claimed
`invention is not identicallydisclosed as set forth in section 102, if the differences between the
`claimed invention and the priorartare such that the claimed invention as awhole would have
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 3
`
`been obvious before the effective filing date of the claimed invention to a person having
`ordinaryskill in the art to which the claimed invention pertains. Patentabilitys hall notbe
`negated by the manner in which the invention was made.
`
`6.
`
`Claims 1-2 and 14 are rejected under 35 U.S.C. 103 as being unpatentable over
`
`Matono (U.S. Pub. No. 20180150949 A1),
`
`in view of Togino (U.S. Pub. No.
`
`20110285973 A1), further in View of Kostrzewski (U.S. Pub. No. 20110221767 A1).
`
`Regarding to claim 1 and 14:
`
`14. Matono teach a mobile system comprising: an imaging apparatus including an
`
`imaging element in which a plurality of imaging pixels are arranged in a matrix,
`
`(Matono FIG. 2A - 2B, [0034])
`
`and an optical system that forms an image of a predetermined region on an
`
`imaging surface of the imaging element; (Matono [0035] FIG. 3 is adiagram
`
`schematically illustrating a range in which an image to be captured by an on-vehicle
`
`stereo camera of the present embodiment)
`
`a generator that generates an image based on image data acquired from the
`
`imaging element; and (Matono [0042] FIG. 6 is a diagram illustrating an image
`
`obtained by cutting out a portion of an image captured by a camera using the image-
`
`capturing lens having the optical characteristics described above)
`
`a display apparatus that displays the image of the predetermined region
`
`generated by the generator, (Matono FIG. 3 [0044] resolution of the central area
`
`[predetermined region] (area for which an incidence angle to the optical axis is small) of
`
`the image-capturing lens is set to be high.
`
`It is intended to recognize a target at a short
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 4
`
`distance (for example, approximately 20 m) from the vehicle 301 in the peripheral area
`
`of the image-capturing lens (area in which an incidence angle to the optical axis is
`
`large) and thus, resolution of the peripheral area of the image-capturing lens is set to be
`
`high.)
`
`lens that has a shape (Matono Fig. 5. [0044] an area corresponding to the inflection
`
`point 403 corresponds to the blurred area in the image of FIG. 6. Respective areas
`
`depicted in a fan shape in FIG. 3 are areas in which recognition as well as detection of
`
`an object can be made by the image processing device and an area (for example, a
`
`portion indicated by 302) located outside the recognizable area having the fan shape is
`
`an area in which detection of the object is possible but recognition of the object
`
`becomes difficult because a captured image becomes small)
`
`that allows the image of the predetermined region to be formed on the imaging
`
`surface of the imaging element such that a resolution is different between a
`
`portion of the predetermined region and another portion of the predetermined
`
`region, (Matono [0044] resolution of the central area (area for which an incidence angle
`
`to the optical axis is small) of the image-capturing lens is set to be high
`
`FIG. 3 are
`
`areas in which recognition as well as detection of an object can be made by the image
`
`processing device and an area (for example, a portion indicated by 302) located outside
`
`the recognizable area having the fan shape is an area in which detection of the object is
`
`possible but recognition of the object becomes difficult because a captured image
`
`becomes small. [0046] With regard to the image of FIG. 7, change in resolution (MTF)
`
`along the line A—A is illustrated. The resolution is decreased in the doughnut-shaped
`
`third area 203 and thereafter, the resolution is increased in the second area 202.
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 5
`
`Accordingly, when the image-capturing lens according to the present embodiment is
`
`defined by an image captured by the image-capturing lens, the image-capturing lens
`
`may be expressed as a lens having characteristics that an intermediate incidence angle
`
`area, in which the resolution is lowered than the small incidence angle area and the
`
`large incidence angle area)
`
`the resolution being defined as a total number of the imaging pixels that capture
`
`an image within a unit field angle. (Matono [0039] an image-capturing element such
`
`as the CCD image sensor, the CMOS image sensor, or the like is adopted as the
`
`image-capturing element, a value which indicates how many pixels are included per unit
`
`incidence angle becomes an indicator for an image-capturing lens. [0034] an incidence
`
`angle represented by a single pixel has a range and when targets are within the
`
`incidence angles indicated by straight lines, the image-capturing device 1 can recognize
`
`that the targets exist in the same direction. For example, as in FIG. 2A, when the
`
`angular resolution is high, an incidence angle captured by a single pixel 21 of the
`
`image-capturing element 102a is narrow and thus, it becomes possible to identify each
`
`of a plurality of targets 20A and 20B and accuracy of distance measurement is
`
`increased. However, as in FIG. 2B, when the angular resolution is low, the incidence
`
`angle captured by a single pixel of the image-capturing element 102a is wide and thus,
`
`it is unable to identify the plurality of targets 20A and 20B)
`
`Matono do not explicitly teach a mobile body to which the imaging apparatus is
`
`attached and that moves in a space; wherein the optical system includes a free-
`
`form surface lens;
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 6
`
`However Togino teach wherein the optical system includes a free-form surface
`
`lens (Togino [0050] for the optical device that is rotationally asymmetric about the
`
`optical axis, use may be made of a cylindrical lens, a free-form surface lens, a free-form
`
`surface mirror)
`
`It would have been obvious before the effective filing date of the claimed
`
`invention to a person having ordinary skill in the art to modify Matono, further
`
`incorporating Togino in camera technology. One would be motivated to do so, to
`
`incorporate the optical system includes afree-form surface lens. This will provide better
`
`quality of image in areas of interest for lower cost.
`
`The combination of Matono and Togino do not explicitly teach a mobile body to
`
`which the imaging apparatus is attached and that moves in a space;
`
`However Kostrzewski teach a mobile body to which the imaging apparatus is
`
`attached and that moves in a space; (Kostrzewski [0051] this may be implemented
`
`when the imaging system is installed on a moving platform, such as an avionic platform
`
`like a UAV (Unmanned Aerial Vehicle))
`
`It would have been obvious before the effective filing date of the claimed
`
`invention to a person having ordinary skill in the art to modify Matono, further
`
`incorporating Togino and Kostrzewski in camera technology. One would be motivated to
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 7
`
`do so, to incorporate a mobile body to which the imaging apparatus is attached and that
`
`moves in a space. This will allow the system to be used more freely in space.
`
`Regarding to claim 2:
`
`2. Matono teach the imaging system according to claim 1, wherein in the free-form
`
`surface lens included in the optical system, a cross section taken along an
`
`imaginary plane including an optical axis and a first axis perpendicular to the
`
`optical axis and a cross section taken along an imaginary plane including the
`
`optical axis and a second axis perpendicular to the optical axis and the first axis
`
`have different shapes and are non-arcuate. (Claim 2 is interpreted based on
`
`applicant Fig. 3. Matono Fig. 5 will accommodate same axis relations as claimed)
`
`7.
`
`Claims 3-7 are rejected under 35 U.S.C. 103 as being unpatentable over Matono
`
`(U.S. Pub. No. 20180150949 A1),
`
`in View of Togino (U.S. Pub. No. 20110285973 A1),
`
`further in view of Kostrzewski (U.S. Pub. No. 20110221767 A1) and Patrice (Multi-task
`
`single lens for automotive vision applications - Proc. SPIE 7314, Photonics in the
`
`Transportation Industry: Auto to Aerospace ll, 731409 (29 April 2009).
`
`Regarding to claim 3:
`
`3. Matono teach the imaging system according to claim 1, Matono do not explicitly
`
`teach wherein in the free-form surface lens included in the optical system, the
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 8
`
`resolution gradually increases from one end portion toward the other end portion
`
`of the predetermined region.
`
`However Togino teach wherein in the free-form surface lens included in the optical
`
`system, (Togino [0050] for the optical device that is rotationally asymmetric about the
`
`optical axis, use may be made of a cylindrical lens, a free-form surface lens, a free-form
`
`surface mirror)
`
`However Patrice teach the resolution gradually increases from one end portion
`
`toward the other end portion of the predetermined region. (Patrice page 8 para 2
`
`Figure 7 shows the same image taken by a panomorph lens with increased resolution in
`
`the center and along the border)
`
`The motivation for combining Matono, Togino and Kostrzewski as set forth in
`
`claim 1
`
`is equally applicable to claim 3.
`
`It would have been obvious before the effective
`
`filing date of the claimed invention to a person having ordinary skill in the art to modify
`
`Matono, further incorporating Togino, Kostrzewski and Patrice in camera technology.
`
`One would be motivated to do so, to incorporate the resolution gradually increases. This
`
`will develop a better imaging system.
`
`Regarding to claim 4:
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 9
`
`4. Matono teach the imaging system according to claim 1, Matono do not explicitly
`
`teach wherein the free-form surface lens included in the optical system has a
`
`shape that allows the image of the predetermined region to be formed on
`
`the imaging surface of the imaging element such that the total number of the
`
`imaging pixels that capture the image of the predetermined region is higher
`
`as compared with a case where an entire image captured by a fish-eye lens
`
`is formed.
`
`However Togino teach wherein the free-form surface lens included in the optical
`
`system has a shape (Togino [0050] for the optical device that is rotationally
`
`asymmetric about the optical axis, use may be made of a cylindrical lens, a free-form
`
`surface lens, a free-form surface mirror)
`
`However Patrice teach that allows the image of the predetermined region to be
`
`formed on the imaging surface of the imaging element such that the total number
`
`of the imaging pixels that capture the image of the predetermined region is higher
`
`as compared with a case where an entire image captured by a fish-eye lens
`
`is formed. (Patrice Fig. 6a, 6b, page 7, Figure 6a and 6b: Images taken with afisheye
`
`lens (6a, left) and with a panomorph lens (6b, right) boxes represent equivalent areas.
`
`Panomorph lens has higher resolution than fish eye lens)
`
`Regarding to claim 5:
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 10
`
`5. Matono teach the imaging system according to claim 1, wherein the imaging
`
`apparatus includes: a first imaging apparatus including a first imaging element
`
`and a first optical system that forms an image of a first region on an imaging
`
`surface of the first imaging element; and (Matono [0029] The image-capturing device
`
`1
`
`includes first and second image-capturing units 100a and 100b that are a pair of left
`
`and right image-capturing units, each of which captures an image of the front of the
`
`vehicle, and an operation unit 110)
`
`such that the resolution is different between the second region and another
`
`portion of the first region, and (Matono [0044] resolution of the central area (area for
`
`which an incidence angle to the optical axis is small) of the image-capturing lens is set
`
`to be high
`
`FIG. 3 are areas in which recognition as well as detection of an object can
`
`be made by the image processing device and an area (for example, a portion indicated
`
`by 302) located outside the recognizable area having the fan shape is an area in which
`
`detection of the object is possible but recognition of the object becomes difficult
`
`because a captured image becomes small. [0046] With regard to the image of FIG. 7,
`
`change in resolution (MTF) along the line A-A is illustrated. The resolution is decreased
`
`in the doughnut-shaped third area 203 and thereafter, the resolution is increased in the
`
`second area 202. Accordingly, when the image-capturing lens according to the present
`
`embodiment is defined by an image captured by the image-capturing lens, the image-
`
`capturing lens may be expressed as a lens having characteristics that an intermediate
`
`incidence angle area, in which the resolution is lowered than the small incidence angle
`
`area and the large incidence angle area)
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 11
`
`Matono do not explicitly teach a second imaging apparatus including a second
`
`imaging element and a second optical system that forms an image of a second
`
`region on an imaging surface of the second imaging element, the second region
`
`partially overlapping the first region, the first optical system includes a first free-
`
`form surface lens that has a shape that causes the image of the first region to be
`
`formed on the imaging surface of the first imaging element an overlapping
`
`portion of the first region that overlaps, and the generator generatesa combined
`
`image based on image data acquired from the first imaging element and the
`
`second imaging element.
`
`However Togino teach the first optical system includes a first free-form surface
`
`lens that has a shape that causes the image of the first region to be formed on the
`
`imaging surface of the first imaging element (Togino [0050] For the optical device
`
`that is rotationally asymmetric about the optical axis, use may be made of a cylindrical
`
`lens, a free-form surface lens, a free-form surface mirror)
`
`However Kostrzewski teach an overlapping portion of the first region that overlaps
`
`(Kostrzewski Fig. 7-8, [0042] in further embodiments, the number of facets in the
`
`catoptric mirror may be varied. For example, FIG. 7 illustrates a two facet catoptric
`
`mirror and its resulting image geometry. Facets 251 and 252 are separated by a
`
`concave seam 250. Accordingly, each of the facets has a higher than 180.degree. FOV,
`
`resulting in regions of overlap 255 and 256 in the images 254 and 233 on the sensor
`
`plane)
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 12
`
`the second region partially overlapping the first region, (Kostrzewski Fig. 7-8,
`
`[0042] in further embodiments, the number of facets in the catoptric mirror may be
`
`varied. For example, FIG. 7 illustrates a two facet catoptric mirror and its resulting
`
`image geometry. Facets 251 and 252 are separated by a concave seam 250.
`
`Accordingly, each of the facets has a higher than 180.degree. FOV, resulting in regions
`
`of overlap 255 and 256 in the images 254 and 233 on the sensor plane)
`
`However Patrice teach a second imaging apparatus including a second imaging
`
`element and a second optical system that forms an image of a second region on
`
`an imaging surface of the second imaging element, (Patrice Table 1 and Figure 1,
`
`page 4 para 3 Depending on the approach, the algorithm can use a front or rear
`
`camera.)
`
`the generator generatesa combined image based on image data acquired from
`
`the first imaging element and the second imaging element. (Patrice page 13 para 2
`
`one could mount four (4) panomorph lenses all around the vehicle to provide a complete
`
`view for parking assistance (Figure 13) with the added benefits of panomorph
`
`technology’s augmented [combined image] resolution)
`
`Regarding to claim 6:
`
`6. Matono teach the imaging system according to claim 5. Claim 6 is rejected for the
`
`same reasons as claim 5 above. Matono do not explicitly teach third imaging
`
`apparatus; second region have a resolution lower than a resolution of another
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 13
`
`portion of the second region, the second region has a resolution higher than a
`
`resolution of another portion of the third region.
`
`However Patrice teach third imaging apparatus; (Patrice Table 1 and Figure 1, side
`
`view camera. Second and third camera will use algorithm described in claim 5 for first
`
`and second camera)
`
`second region have a resolution lower than a resolution of another portion of the
`
`second region, (Patrice Figure 9: Augmented-resolution areas of interest for a
`
`panomorph front view lens. Patrice page 13 para 2 for a collision warning application,
`
`there is a need to see farther on both sides when crossing an intersection. One
`
`needs also to see farther right in the middle, to detect a vehicle in the same lane. Figure
`
`9 shows the resulting areas of interest over the entire FoV. As defined by Thibault12,
`
`the resolution of this type of lens is 8.42 pixels/degree on the targeted sensor within the
`
`zone of interest. Using formulas (1) and (2), a 10-pixel object would be 97 meters from
`
`the car, a 70% increase compared to a theoretical fisheye lens within the same area of
`
`interest.)
`
`the second region has a resolution higher than a resolution of another portion of
`
`the third region, and (Patrice Figure 9: Augmented-resolution areas of interest for a
`
`panomorph front view lens. Patrice page 13 para 2 for a collision warning application,
`
`there is a need to see farther on both sides when crossing an intersection. One
`
`needs also to see farther right in the middle, to detect a vehicle in the same lane. Figure
`
`9 shows the resulting areas of interest over the entire FoV. As defined by Thibault12,
`
`the resolution of this type of lens is 8.42 pixels/degree on the targeted sensor within the
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 14
`
`zone of interest. Using formulas (1) and (2), a 10-pier object would be 97 meters from
`
`the car, a 70% increase compared to a theoretical fisheye lens within the same area of
`
`interest.)
`
`Regarding to claim 7:
`
`7. Matono teach the imaging system according to claim 6, Claim 7 is rejected for the
`
`same reasons as claim 5 and 6 above. Matono do not explicitly teach fourth imaging
`
`apparatus.
`
`However Patrice teach a fourth imaging apparatus including a fourth imaging
`
`element and (Patrice Table 1 and Figure 1, side view camera from the second side of
`
`vehicle. First and fourth camera will use algorithm described in claim 5 for first and
`
`second camera)
`
`Allowable subject matter
`
`7.
`
`Claims 8-13 are objected to as being dependent upon a rejected base claim, but
`
`would be allowable if rewritten in independent form including all of the limitations of the
`
`base claim and any intervening claims.
`
`The following is a statement of reasons for the indication of allowable subject
`
`m atter:
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 15
`
`Regarding to claim 8-10:
`
`8. Matono teach the imaging system according to claim 1, but prior art does not
`
`teach wherein when a planar region is provided in parallel or substantially parallel
`
`to an optical axis within the predetermined region, the optical system that
`
`includes the free-form surface lens has a higher resolution in a portion far from
`
`the optical axis than in a portion close to the optical axis in a direction extending
`
`along the planar region, and the generator generates an image in which a shape
`
`of the planar region is reproduced by enlarging an image of a high-resolution
`
`portion relative to an image of a low-resolution portion based on the image data
`
`acquired from the imaging element.
`
`Regarding to claim 11-13:
`
`11. Matono teach the imaging system according to claim 1, but prior art does not
`
`teach wherein the imaging apparatus includes a fifth imaging apparatus including
`
`a fifth imaging element and a fifth optical system that forms an image of a fifth
`
`region on an imaging surface of the fifth imaging element, the fifth region
`
`including a first planar region; and a sixth imaging apparatus including a sixth
`
`imaging element and a sixth optical system that forms an image of a sixth region
`
`on an imaging surface of the sixth imaging element, the sixth region including a
`
`second planar region that makes contact with the first planar region within a
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 16
`
`same plane with the first planar region,
`
`the fifth optical system includes a fifth
`
`free-form surface lens that has a shape that causes the image of the fifth region
`
`to be formed on the imaging surface of the fifth imaging element such that the
`
`resolution is higher in a portion close to the second planar region than in a
`
`portion close to an optical axis of the fifth optical system in a direction extending
`
`along the first planar region, the sixth optical system includes a sixth free-form
`
`surface lens that has a shape that causes the image of the sixth region to be
`
`formed on the imaging surface of the sixth imaging element such that the
`
`resolution is higher in a portion close to the first planar region than in a portion
`
`close to an optical axis of the sixth optical system in a direction extending along
`
`the second planar region, and the generator generates, based on a high-
`
`resolution portion of image data acquired from the fifth imaging element and the
`
`sixth imaging element, a combined image in which the first planar region and the
`
`second planar region are connected.
`
`Conclusion
`
`Any inquiry concerning this communication or earlier communications from the
`
`examiner should be directed to NASIM N NIRJHAR whose telephone number is
`
`(571)272-3792. The examiner can normally be reached on Monday - Friday, 8 am to 5
`
`pm ET.
`
`

`

`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 17
`
`If attempts to reach the examiner by telephone are unsuccessful, the examiner’s
`
`supervisor, Christopher Kelley can be reached on (571)272-7331. The fax phone
`
`number for the organization where this application or proceeding is assigned is 571 -
`
`273-8300.
`
`Information regarding the status of an application may be obtained from the
`
`Patent Application Information Retrieval (PAIR) system. Status information for
`
`published applications may be obtained from either Private PAIR or Public PAIR.
`
`Status information for unpublished applications is available through Private PAIR only.
`
`For more information about the PAIR system, see http://pair-direct.uspto.gov. Should
`
`you have questions on access to the Private PAIR system, contact the Electronic
`
`Business Center (EBC) at 866-217-9197 (toll-free).
`
`If you would like assistance from a
`
`USPTO Customer Service Representative or access to the automated information
`
`system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
`
`/NASIM N NIRJHAR/
`
`Examiner, Art Unit 2482
`
`/CHRISTOPHER S KELLEY/
`
`Supervisory Patent Examiner, Art Unit 2482
`
`