UNITED STATES PATENT AND TRADEMARK OFFICE
`
`
`
`UNITED STATES DEPARTMENT OF COMMERCE
`United States Patent and Trademark Office
`Address: COMMISSIONER FOR PATENTS
`PO. Box 1450
`Alexandria, Virginia 2231371450
`www.uspto.gov
`
`15/888,002
`
`02/03/2018
`
`Masayuki AIHARA
`
`NIIPP0207US
`
`2481
`
`MARK D. SARALINO (PAN)
`RENNER, OTTO, BOISSELLE & SKLAR, LLP
`1621 EUCLID AVENUE
`19TH FLOOR
`CLEVELAND, OH 441 15
`
`NIRJHAK NASIM NAZRUL
`
`ART UNIT
`2482
`
`PAPER NUMBER
`
`NOTIFICATION DATE
`
`DELIVERY MODE
`
`12/26/2019
`
`ELECTRONIC
`
`Please find below and/or attached an Office communication concerning this application or proceeding.
`
`The time period for reply, if any, is set in the attached communication.
`
`Notice of the Office communication was sent electronically on above—indicated "Notification Date" to the
`
`following e—mail address(es):
`
`ipdoeket@rennerotto.eom
`
`PTOL-90A (Rev. 04/07)
`
`
`
`
`
`UNITED STATES DEPARTMENT OF COMMERCE
`United States Patent and Trademark Office
`Address: COMMISSIONER FOR PATENTS
`PO. Box 1450
`Alexandria, Virginia 2231371450
`www.uspto.gov
`
`15/888,002
`
`02/03/2018
`
`Masayuki AIHARA
`
`NIIPP0207US
`
`2481
`
`MARK D. SARALINO (PAN)
`RENNER, OTTO, BOISSELLE & SKLAR, LLP
`1621 EUCLID AVENUE
`19TH FLOOR
`CLEVELAND, OH 441 15
`
`NIRJHAK NASIM NAZRUL
`
`ART UNIT
`2482
`
`PAPER NUMBER
`
`NOTIFICATION DATE
`
`DELIVERY MODE
`
`12/26/2019
`
`ELECTRONIC
`
`Please find below and/or attached an Office communication concerning this application or proceeding.
`
`The time period for reply, if any, is set in the attached communication.
`
`Notice of the Office communication was sent electronically on above—indicated "Notification Date" to the
`
`following e—mail address(es):
`
`ipdoeket@rennerotto.eom
`
`PTOL-90A (Rev. 04/07)
`
`
`
`
`
`Commissionerfor Patents
`United States Patent and TrademarkOffice
`PO. Box 1450
`Alexandria, VA 22313—1450
`www.uspto.gov
`
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
`Application Number: 15/888,002
`
`Filing Date: 3 Feb 2018
`
`Appellant(s): AIHARA et a1.
`
`Luis A. Carrion
`
`Reg. No. 61,255
`
`For Appellant
`
`EXAMINER’S ANSWER
`
`This is in response to the appeal brief filed 11/22/19.
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 3
`
`(1) Grounds of Rejection to be Reviewed on Appeal
`
`Every ground of rejection set forth in the Office action dated 6/25/2019 from
`
`which the appeal is taken is being maintained by the examiner except for the grounds of
`
`rejection (if any) listed under the subheading “WITHDRAWN REJECTIONS.” New
`
`grounds of rejection (if any) are provided under the subheading “NEW GROUNDS OF
`
`REJECTION.”
`
`The following ground(s) of rejection are applicable to the appealed claims.
`
`Claim Rejections - 35 USC § 103
`
`The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness
`
`rejections set forth in this Office action:
`
`A patent for a claimed invention maynotbe obtained, notwithstanding that the claimed
`invention is not identicallydisclosed as set forth in section 102, if the differences between the
`claimed invention and the priorartare such that the claimed invention as awhole would have
`been obvious before the effective filing date of the claimed invention to a person having
`ordinaryskill in the art to which the claimed invention pertains. Patentabi lityshall notbe
`negated by the manner in which the invention was made.
`
`6.
`
`Claims 1-14 are rejected under 35 U.S.C. 103 as being unpatentable over
`
`Patrice (Multi-task single lens for automotive vision applications - Proc. SPIE 7314,
`
`Photonics in the Transportation Industry: Auto to Aerospace ll, 731409 (29 April 2009),
`
`in view of Matono (U.S. Pub. No. 20180150949 A1), further in view of Kostrzewski (U.S.
`
`Pub. No. 20110221767 A1).
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Regarding to claim 1 and 14:
`
`Page 4
`
`14. Patrice teach a mobile system comprising: a generator that generates an
`
`image based on image data acquired from the first imaging element and the
`
`second Imaging element, (Patrice page 13 para 3 there are no limitations in terms of
`
`projection ability, although the scope for real applications requires imagination and,
`
`ultimately, driver understanding. For example, one could mount four (4) panomorph
`
`lenses all around the vehicle to provide a complete view for parking assistance (Figure
`
`13) with the added benefits of panomorph technology’s augmented resolution)
`
`such that a resolution is different between an overlapping portion (Patrice page 6
`
`Fig. 3 — overlapping camera region) of the first predetermined region that overlaps
`
`the second region and another portion of the first predetermined region, (Patrice
`
`page 13 para 1 Figures 12 and 13 show ways to avoid a blind zone. The driver can see
`
`everything in the blind zone using his/her onboard display. The panomorph lens design
`
`suggested in this paper increases the resolution of objects along the border and right in
`
`the middle)
`
`and in the first predetermined region, a resolution of the overlapping portion of
`
`the first predetermined region that overlaps the second region (Patrice page 6 Fig.
`
`3 - overlapping camera region) is higher than a resolution of the other portion of the
`
`first predetermined region, (Patrice page 7 Fig. 6b This combination of distortion
`
`control and anamorphic design provides an important gain in resolution pixel/degree in
`
`the zones of interest, and an advantage over all other types of panoramic imagers)
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 5
`
`such that, in the second region, a resolution of the overlapping portion of the
`
`second region that overlaps with the first predetermined region is lower than
`
`another portion of the second region, and (Patrice page 10 Fig. 9 With a panomorph
`
`lens, we can customize the distortion mapping to provide better resolution where
`
`required. Based on Figure 9 (used only for indicative purposes), we define three zones
`
`of interest in the horizontal plane. The first area of interest in which we would like to
`
`increase resolution is the forward view. The second and third areas are to the right of
`
`the left-corner views (see Figure 7 for suggested distortion curve). ++ are high
`
`resolution area and — is low resolution area) the generator generatesa combined
`
`image (Patrice page 13 para 3 there are no limitations in terms of projection ability,
`
`although the scope for real applications requires imagination and, ultimately, driver
`
`understanding. For example, one could mount four (4) panomorph lenses all around the
`
`vehicle to provide a complete view for parking assistance (Figure 13) with the added
`
`benefits of panomorph technology’s
`
`augmented resolution) based on image data of a portion having a high resolution
`
`out of the overlapping portion (Patrice page 6 Fig. 3 — overlapping camera region)
`
`between the first predetermined region and the second region, (Patrice page 10
`
`Fig. 9 With a panomorph lens, we can customize the distortion mapping to provide
`
`better resolution where required. Based on Figure 9 (used only for indicative purposes),
`
`we define three zones of interest in the horizontal plane. The first area of interest in
`
`which we would like to increase resolution is the forward view. The second and third
`
`areas are to the right of the left-corner views (see Figure 7 for suggested distortion
`
`curve). ++ are high resolution area and — is low resolution area)
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 6
`
`and image data of a portion having a high resolution out of a non-overlapping
`
`portion between the second region and the first predetermined region. (Patrice
`
`page 10 Fig. 9 with a panomorph lens, we can customize the distortion mapping to
`
`provide better resolution where required. Based on Figure 9 (used only for indicative
`
`purposes), we define three zones of interest in the horizontal plane. The first area of
`
`interest in which we would like to increase resolution is the forward view. The second
`
`and third areas are to the right of the left-corner views (see Figure 7 for suggested
`
`distortion curve). ++ are high resolution area straight ahead of the vehicle is non
`
`overlapping region as per Fig. 3 and Fig. 7)
`
`Patrice do not explicitly teach a first imaging apparatus including a first imaging
`
`element in which a plurality of imaging pixels are arranged in a matrix, and a first
`
`optical system that forms an image of a first predetermined region on an imaging
`
`surface of the first imaging element; a second imaging apparatus including a
`
`second imaging element, and a second optical system that forms an image of a
`
`second region on an imaging surface of the second imaging element, the second
`
`region partially overlapping the first predetermined region; and a mobile body to
`
`which the imaging apparatus is attached and that moves in a space; a display
`
`apparatus that displays the image generated by the generator, wherein the first
`
`optical system includes a first lens that has a shape that causes the image of the
`
`first predetermined region to be formed on the imaging surface of the first
`
`imaging element the second optical system includes a second lens that has a
`
`shape that causes an image of the second region on the second imaging element.
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 7
`
`However Matono teach a first imaging apparatus including afirst imaging element
`
`in which a plurality of imaging pixels are arranged in a matrix, (Matono FIG. 2A -
`
`2B, [0034]) and a first optical system (Matono Fig.
`
`1 [0029] The image-capturing
`
`device 1 includes first and second image-capturing units 100a and 100b) that forms an
`
`image of a first predetermined region on an imaging surface of the first imaging
`
`element; (Matono [0035] FIG. 3 is adiagram schematically illustrating a range in which
`
`an image to be captured by an on-vehicle stereo camera of the present embodiment)
`
`a second imaging apparatus including a second imaging element, (Matono [0029]
`
`the image-capturing device 1 includes first and second image-capturing units 100a and
`
`100b)
`
`a display apparatus that displays the image (Matono FIG. 10 [0089]) generated by
`
`the generator, (Matono FIG. 3 [0044] resolution of the central area (area for which an
`
`incidence angle to the optical axis is small) of the image-capturing lens is set to be high.
`
`It is intended to recognize a target at a short distance (for example, approximately 20 m)
`
`from the vehicle 301 in the peripheral area of the image-capturing lens (area in which an
`
`incidence angle to the optical axis is large) and thus, resolution of the peripheral area of
`
`the image-capturing lens is set to be high)
`
`wherein the first optical system includes a first lens (Matono [0033] the first image-
`
`capturing unit 100a includes an optical element 101a and an image-capturing element
`
`102a. The optical element 101a is an image-capturing lens having a structure for
`
`refracting light and forming an image on the image-capturing element) that has a
`
`shape (Matono Fig. 5. [0044] an area corresponding to the inflection point 403
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 8
`
`corresponds to the blurred area in the image of FIG. 6. Respective areas depicted in a
`
`fan shape in FIG. 3 are areas in which recognition as well as detection of an object can
`
`be made by the image processing device and an area (for example, a portion indicated
`
`by 302) located outside the recognizable area having the fan shape is an area in which
`
`detection of the object is possible but recognition of the object becomes difficult
`
`because a captured image becomes small) that causes the image of the first
`
`predetermined region to be formed on the imaging surface of the first imaging
`
`element (Matono [0032] That is, even when the pair of left and right images is images
`
`obtained by capturing the sametarget, the positions on the images deviate in left and
`
`right)
`
`the second optical system includes a second lens (Matono [0033] the first image-
`
`capturing unit 100a includes an optical element 101a and an image-capturing element
`
`102a. The optical element 101a is an image-capturing lens having a structure for
`
`refracting light and forming an image on the image-capturing element) that has a
`
`shape (Matono Fig. 5. [0044] an area corresponding to the inflection point 403
`
`corresponds to the blurred area in the image of FIG. 6. Respective areas depicted in a
`
`fan shape in FIG. 3 are areas in which recognition as well as detection of an object can
`
`be made by the image processing device and an area (for example, a portion indicated
`
`by 302) located outside the recognizable area having the fan shape is an area in which
`
`detection of the object is possible but recognition of the object becomes difficult
`
`because a captured image becomes small) that causes an image of the second
`
`region on the second imaging element (Matono [0032] That is, even when the pair of
`
`left and right images is images obtained by capturing the same target, the positions on
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 9
`
`the images deviate in left and right. Second system is for pair of left and right images,
`
`because Matono Fig.
`
`1 [0029] The image-capturing device 1 includes first and second
`
`image-capturing units 100a and 100b)
`
`It would have been obvious before the effective filing date of the claimed
`
`invention to a person having ordinary skill in the art to modify Patrice, further
`
`incorporating Matono in camera technology. One would be motivated to do so, to
`
`incorporate the first optical system includes a first lens that has a shape that causes the
`
`image of the first predetermined region to be formed on the imaging surface of the first
`
`imaging element the second optical system includes a second lens that has a shape
`
`that causes an image of the second region on the second imaging element. This
`
`functionality will provide better quality of image.
`
`The combination of Patrice and Kostrzewski do not explicitly teach a second optical
`
`system that forms an image of a second region on an imaging surface of the
`
`second imaging element, the second region partially overlapping the first
`
`predetermined region; and a mobile body to which the imaging apparatus is
`
`attached and that moves in a space;
`
`However Kostrzewski teach a second optical system that forms an image of a
`
`second region on an imaging surface of the second imaging element, the second
`
`region partially overlapping the first predetermined region; and (Kostrzewski
`
`[0042] FIG. 7 illustrates a two facet catoptric mirror and its resulting image geometry.
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 10
`
`Facets 251 and 252 are separated by a concave seam 250. Accordingly, each of the
`
`facets has a higher than 180.degree. FOV, resulting in regions of overlap 255 and 256
`
`in the images 254 and 233 on the sensor plane)
`
`a mobile body to which the imaging apparatus is attached and that moves in a
`
`space; (Kostrzewski [0051] this may be implemented when the imaging system is
`
`installed on a moving platform, such as an avionic platform like a UAV (Unmanned
`
`Aerial Vehicle))
`
`It would have been obvious before the effective filing date of the claimed
`
`invention to a person having ordinary skill in the art to modify Patrice, further
`
`incorporating Matono and Kostrzewski in camera technology. One would be motivated
`
`to do so, to incorporate a mobile body to which the imaging apparatus is attached and
`
`that moves in a space. This functionality will provide low cost solution for image to be
`
`taken from drone.
`
`2. (Cancelled)
`
`Regarding to claim 3:
`
`3. Patrice teach the imaging system according to claim 1, wherein in the first lens
`
`included in the first optical system, the resolution gradually increases from one
`
`end portion toward the other end portion of the first predetermined region.
`
`(Patrice page 8 para 2 Figure 7 shows the same image taken by a panomorph lens with
`
`increased resolution in the center and along the border)
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 11
`
`Regarding to claim 4:
`
`4. Patrice teach the imaging system according to claim 1, wherein the first lens
`
`included in the first optical system has a shape that allows the image of the first
`
`predetermined region to be formed on the imaging surface of the first imaging
`
`element such that the total number of the imaging pixels that capture the image
`
`of the first predetermined region is higher as compared with a case where an
`
`entire image captured by a fish-eye lens is formed. (Patrice Fig. 6a, 6b, page 7,
`
`Figure 6a and 6b: Images taken with a fisheye lens (6a, left) and with a panomorph lens
`
`(6b, right) boxes represent equivalent areas. Panomorph lens has higher resolution than
`
`fish eye lens)
`
`Regarding to claim 5:
`
`5. Patrice teach the imaging system according to claim 1, such that the resolution
`
`is different between an overlapping portion (Patrice page 6 Fig. 3 — overlapping
`
`camera region) of the first predetermined region that overlapsthe second
`
`region and another portion of the first predetermined region, and (Patrice page 13
`
`para 1 Figures 12 and 13 show ways to avoid a blind zone. The driver can see
`
`everything in the blind zone using his/her onboard display. The panomorph lens design
`
`suggested in this paper increases the resolution of objects along the border and right in
`
`the middle)
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 12
`
`the generator generatesa combined image based on image data acquired from
`
`the first imaging element and the second imaging element. (Patrice page 13 para 2
`
`one could mount four (4) panomorph lenses all around the vehicle to provide a complete
`
`view for parking assistance (Figure 13) with the added benefits of panomorph
`
`technology’s augmented [combined image] resolution)
`
`Patrice do not explicitly teach wherein the first lens has a shape that causes the
`
`image of the first predetermined region to be formed on the imaging surface of
`
`the first imaging element; wherein the first lens has a shape that causes the
`
`image of the first predetermined region to be formed on the imaging surface of
`
`the first imaging element.
`
`However Matono teach wherein the first lens (Matono [0033] The first image-capturing
`
`unit 100a includes an optical element 101a and an image-capturing element 102a. The
`
`optical element 101a is an image-capturing lens having a structure for refracting light
`
`and forming an image on the image-capturing element) has a shape (Matono Fig. 5.
`
`[0044] an area corresponding to the inflection point 403 corresponds to the blurred area
`
`in the image of FIG. 6. Respective areas depicted in a fan shape in FIG. 3 are areas in
`
`which recognition as well as detection of an object can be made by the image
`
`processing device and an area (for example, a portion indicated by 302) located outside
`
`the recognizable area having the fan shape is an area in which detection of the object is
`
`possible but recognition of the object becomes difficult because a captured image
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 13
`
`becomes small) that causes the image of the first predetermined region to be
`
`formed on the imaging surface of the first imaging element (Matono [0032] That is,
`
`even when the pair of left and right images is images obtained by capturing the same
`
`target, the positions on the images deviate in left and right)
`
`wherein the first lens (Matono [0033] the first image-capturing unit 100a includes an
`
`optical element 101a and an image-capturing element 102a. The optical element 101a
`
`is an image-capturing lens having a structure for refracting light and forming an image
`
`on the image-capturing element) has a shape (Matono Fig. 5. [0044] an area
`
`corresponding to the inflection point 403 corresponds to the blurred area in the image of
`
`FIG. 6. Respective areas depicted in a fan shape in FIG. 3 are areas in which
`
`recognition as well as detection of an object can be made by the image processing
`
`device and an area (for example, a portion indicated by 302) located outside the
`
`recognizable area having the fan shape is an area in which detection of the object is
`
`possible but recognition of the object becomes difficult because a captured image
`
`becomes small) that causes the image of the first predetermined region to be
`
`formed on the imaging surface of the first imaging element (Matono [0032] That is,
`
`even when the pair of left and right images is images obtained by capturing the same
`
`target, the positions on the images deviate in left and right)
`
`Regarding to claim 6:
`
`6. Patrice teach the imaging system according to claim 5, further comprising:
`
`Claim 6 is rejected for the same reasons as claim 5 above. Patrice also teach a third
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 14
`
`imaging apparatus including a third imaging element and a third optical system
`
`that forms an image of a third region on an imaging surface of the third
`
`imaging element, the third region partially overlapping the second region and
`
`being different from the first predetermined region. (Patrice Table 1 and Figure 1,
`
`side view camera. Second and third camera will use algorithm described in claim 5 for
`
`first and second camera)
`
`Regarding to claim 7:
`
`7. Patrice teach the imaging system according to claim 6, further comprising:
`
`Claim 7 is rejected for the same reasons as claim 5 and 6 above. Patrice also teach a
`
`fourth imaging apparatus including a fourth imaging element and a fourth optical
`
`system that forms an image of a fourth region on an imaging surface of the fourth
`
`imaging element. (Patrice Table 1 and Figure 1, side view camera from the second
`
`side of vehicle. First and fourth camera will use algorithm described in claim 5 for first
`
`and second camera)
`
`Regarding to claim 8:
`
`8. Patrice teach the imaging system according to claim 1, wherein when a planar
`
`region (Patrice Fig. 4 and page 14 Figure 13 road) is provided in parallel or
`
`substantially parallel to an optical axis within the first predetermined region,
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 15
`
`(Patrice page 14 Figure 13: View of area surrounding vehicle using four (4) panomorph
`
`lenses. Camera view is parallel to road)
`
`the first optical system that includes the lens has a higher resolution in a portion
`
`far from the optical axis than in a portion close to the optical axis in a direction
`
`extending along the planar region, and (Patrice page 8 Figure 7 shows the same
`
`image taken by a panomorph lens with increased resolution in the center and along the
`
`border)
`
`relative to an image of a low-resolution portion based on the image data acquired
`
`from the first imaging element. (Patrice page 6 Fig. 3 — overlapping camera region.
`
`Patrice page 10 Fig. 9 with a panomorph lens, we can customize the distortion mapping
`
`to provide better resolution where required. Based on Figure 9 (used only for indicative
`
`purposes), we define three zones of interest in the horizontal plane. The first area of
`
`interest in which we would like to increase resolution is the forward view. The second
`
`and third areas are to the right of the left-corner views (see Figure 7 for suggested
`
`distortion curve). ++ are high resolution area and — is low resolution area)
`
`Patrice do not explicitly teach the generator generates an image in which a shape of
`
`the planar region is reproduced by enlarging an image of a high-resolution
`
`portion.
`
`However Matono teach the generator generates an image in which a shape of the
`
`planar region (Matono [0078] FIG. 12 1201) is reproduced by enlarging an image of
`
`a high-resolution portion. (Matono [0078] FIG. 12 is a diagram for explaining a
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 16
`
`preferred example of the first cut-out image and the second cut-out image. A reference
`
`numeral 1201 indicates an enlarged view of pixels of an area (area surrounded by a
`
`circle) inside of the third area 203 in the reference image 1001. A reference numeral
`
`1202 indicates an enlarged view of pixels of an area (area surrounded by a circle) inside
`
`of the third area 203 in the standard image 1002)
`
`Regarding to claim 9 - 10:
`
`9. Patrice teach the imaging system according to claim 1, wherein when a planar
`
`region (Patrice Fig. 10, Fig. 4 and page 14 Figure 13 road. Interpretation is based
`
`applicant specification PGPUB [0067]) is provided in parallel or substantially parallel
`
`to an optical axis within the first predetermined region, (Patrice page 14 Figure 13:
`
`View of area surrounding vehicle using four (4) panomorph lenses. Camera view is
`
`parallel to road)
`
`the lens included in the first optical system has a higher resolution in a portion
`
`far from the first optical system in the planar region (Patrice Fig. 4 and page 14
`
`Figure 13 center of the lens compared to left and right side of the road is far with high
`
`resolution as shown in Fig. 9 shows front planar region higher resolution ++. Figure 10:
`
`Lane departure custom projection rendering is multiple planar region) than in a portion
`
`close to the first optical system in the planar region, and (Patrice page 13 Figure 12
`
`shows high resolution image of two sides which are far from optical system)
`
`relative to an image of a low-resolution portion based on the image data acquired
`
`from the first imaging element. (Patrice page 6 Fig. 3 — overlapping camera region.
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 17
`
`(Patrice page 10 Fig. 9 With a panomorph lens, we can customize the distortion
`
`mapping to provide better resolution where required. Based on Figure 9 (used only for
`
`indicative purposes), we define three zones of interest in the horizontal plane. The first
`
`area of interest in which we would like to increase resolution is the forward view. The
`
`second and third areas are to the right of the left-corner views (see Figure 7 for
`
`suggested distortion curve). ++ are high resolution area and — is low resolution area)
`
`Patrice do not explicitly teach the generator generates an image in which a shape of
`
`the planar region is reproduced by enlarging an image of a high-resolution
`
`portion.
`
`However Matono teach the generator generates an image in which a shape of the
`
`planar region is reproduced by enlarging an image of a high-resolution portion
`
`(Matono [0078] FIG. 12 is a diagram for explaining a preferred example of the first cut-
`
`out image and the second cut-out image. A reference numeral 1201 indicates an
`
`enlarged view of pixels of an area (area surrounded by a circle) inside of the third area
`
`203 in the reference image 1001. A reference numeral 1202 indicates an enlarged view
`
`of pixels of an area (area surrounded by a circle) inside of the third area 203 in the
`
`standard image 1002)
`
`Regarding to claim 11:
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 18
`
`11. Patrice teach the imaging system according to claim 1, including: a fifth
`
`imaging apparatus including a fifth imaging element and a fifth optical system
`
`that forms an image of a fifth region on an imaging surface of the fifth
`
`imaging element, the fifth region including a first planar region; and (Patrice Table
`
`1 and Figure 1, side view camera [Fifth camera] and rear view camera from the second
`
`side of vehicle. Fifth camera will use same algorithm described in claim 9)
`
`a sixth imaging apparatus including a sixth imaging element and a sixth optical
`
`system that forms an image of a sixth region on an imaging surface of the sixth
`
`imaging element, (Patrice Table 1 and Figure 1, side view camera and rear view
`
`camera [sixth camera] from the second side of vehicle. Sixth camera will use same
`
`algorithm described in claim 9)
`
`the sixth region including a second planar region that makes contact with the first
`
`planar region within a same plane with the first planar region, (Patrice page 13 Fig.
`
`13 shows second planar region that makes contact with the first planar from Fig. 12)
`
`such that the resolution is higher in a portion close to the second planar region
`
`(Patrice Fig. 4 and page 14 Figure 13 center of the lens compared to left and right side
`
`of the road is far with high resolution as shown in Fig. 9 shows front planar region higher
`
`resolution ++. Figure 10: Lane departure custom projection rendering is multiple planar
`
`region) than in a portion close to an optical axis of the fifth optical system in
`
`a direction extending along the first planar region, (Patrice page 13 Figure 12
`
`shows high resolution image of two sides which are far from optical system)
`
`such that the resolution is higher in a portion close to the first planar region
`
`(Patrice Fig. 4 and page 14 Figure 13 center of the lens compared to left and right side
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 19
`
`of the road is far with high resolution as shown in Fig. 9 shows front planar region higher
`
`resolution ++. Figure 10: Lane departure custom projection rendering is multiple planar
`
`region) than in a portion close to an optical axis of the sixth optical system in
`
`a direction extending along the second planar region, and (Patrice page 13 Figure
`
`12 shows high resolution image of two sides which are far from optical system)
`
`the generator generates, based on a high-resolution portion of image data
`
`acquired from the fifth imaging element and the sixth imaging element, a
`
`combined image in which the first planar region and the second planar region are
`
`connected. (Patrice page 13 Fig. 13 shows combined image from Fig. 12 where planar
`
`region are connected)
`
`Patrice do not explicitly teach the fifth optical system includes a fifth lens
`
`that has a shape that causes the image of the fifth region to be formed on the
`
`imaging surface of the fifth imaging element; the sixth optical system includes a
`
`sixth lens that has a shape that causes the image of the sixth region to be formed
`
`on the imaging surface of the sixth imaging element.
`
`However Matono teach the fifth optical system includes a fifth lens (Matono [0033]
`
`the first image capturing unit 100a includes an optical element 101a and an image-
`
`capturing element 102a. The optical element 101a is an image-capturing lens having a
`
`structure for refracting light and forming an image on the image-capturing element.
`
`Algorithm is applicable for any number of optical system) that has a shape (Matono
`
`Fig. 5. [0044] an area corresponding to the inflection point 403 corresponds to the
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 20
`
`blurred area in the image of FIG. 6. Respective areas depicted in a fan shape in FIG. 3
`
`are areas in which recognition as well as detection of an object can be made by the
`
`image processing device and an area (for example, a portion indicated by 302) located
`
`outside the recognizable area having the fan shape is an area in which detection of the
`
`object is possible but recognition of the object becomes difficult because a captured
`
`image becomes small) that causes the image of the fifth region to be formed on the
`
`imaging surface of the fifth imaging element (Matono [0032] That is, even when the
`
`pair of left and right images is images obtained by capturing the same target, the
`
`positions on the images deviate in left and right)
`
`the sixth optical system includes a sixth lens (Matono [0033] the first image
`
`capturing unit 100a includes an optical element 101a and an image-capturing element
`
`102a. The optical element 101a is an image-capturing lens having a structure for
`
`refracting light and forming an image on the image-capturing element. Algorithm is
`
`applicable for any number of optical system) that has a shape (Matono Fig. 5. [0044]
`
`an area corresponding to the inflection point 403 corresponds to the blurred area in the
`
`image of FIG. 6. Respective areas depicted in a fan shape in FIG. 3 are areas in which
`
`recognition as well as detection of an object can be made by the image processing
`
`device and an area (for example, a portion indicated by 302) located outside the
`
`recognizable area having the fan shape is an area in which detection of the object is
`
`possible but recognition of the object becomes difficult because a captured image
`
`becomes small) that causes the image of the sixth region to be formed on the
`
`imaging surface of the sixth imaging element. (Matono [0032] That is, even when
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 21
`
`the pair of left and right images is images obtained by capturing the same target, the
`
`positions on the images deviate in left and right)
`
`Regarding to claim 12 - 13:
`
`12. Patrice teach the imaging system according to claim 1, including: Claim 12 is
`
`rejected for the same reasons as claim 9 and 11 above.
`
`7.
`
`Claims 15 is rejected under 35 U.S.C. 103 as being unpatentable over Patrice
`
`(Multi-task single lens for automotive vision applications - Proc. SPIE 7314, Photonics in
`
`the Transportation Industry: Auto to Aerospace ll, 731409 (29 April 2009), in view of
`
`Matono (U.S. Pub. No. 20180150949 A1), further in view of Kostrzewski (U.S. Pub. No.
`
`20110221767 A1) and Togino (U.S. Pub. No. 20110285973 A1).
`
`Regarding to claim 15:
`
`15. Patrice teach the imaging system according to claim 1, Patrice do not explicitly
`
`teach wherein the first lens and the second lens are both free-form surface
`
`lenses.
`
`However Togino teach wherein the first lens and the second lens are both free-
`
`form surface lenses. (Togino [0050] for the optical device that is rotationally
`
`
`
`Application/Control Number: 15/888,002
`Art Unit: 2482
`
`Page 22
`
`asymmetric about the optical axis, use may be made of a cylindrical lens,
Accessing this document will incur an additional charge of $.
After purchase, you can access this document again without charge.
Accept $ Charge
Still Working On It
This document is taking longer than usual to download. This can happen if we need to contact the court directly to obtain the document and their servers are running slowly.
Give it another minute or two to complete, and then try the refresh button.
A few More Minutes ... Still Working
It can take up to 5 minutes for us to download a document if the court servers are running slowly.
Thank you for your continued patience.
This document could not be displayed.
We could not find this document within its docket. Please go back to the docket page and check the link. If that does not work, go back to the docket and refresh it to pull the newest information.
Your account does not support viewing this document.
You need a Paid Account to view this document. Click here to change your account type.
Your account does not support viewing this document.
Set your membership
status to view this document.
With a Docket Alarm membership, you'll
get a whole lot more, including:
- Up-to-date information for this case.
- Email alerts whenever there is an update.
- Full text search for other cases.
- Get email alerts whenever a new case matches your search.
One Moment Please
The filing “” is large (MB) and is being downloaded.
Please refresh this page in a few minutes to see if the filing has been downloaded. The filing will also be emailed to you when the download completes.
Your document is on its way!
If you do not receive the document in five minutes, contact support at support@docketalarm.com.
Sealed Document
We are unable to display this document, it may be under a court ordered seal.
If you have proper credentials to access the file, you may proceed directly to the court's system using your government issued username and password.
Access Government Site
